[mkgmap-dev] mkgmap r4025 implements --x-dem-poly option

Fri Jan 5 11:46:03 GMT 2018

splitter options:
java -Xmx1500M -jar splitter.jar --max-nodes=$MAXNODES 
--geonames-file=geonames/cities15000_$ABR.zip --mapid=551${FID}001 
--output=o5m $pais.o5m

areas.list attached

Late this evening I'll try in another machine with more RAM available 
and report.

El 05/01/18 a las 09:54, Gerd Petermann escribió:
> Hi Carlos,
>
> I am now trying to use your options.
> Maybe you use different options for splitter, with my options I have to use --block-size=2048 to avoid MapFailedException.
> Please post the split-file created by splitter (areas.list).
> Up to now I've tested with -Xmx6G and I think the value 2500m looks too low.
> So, my 2nd suggestion is to try with a higher value.
>
> Gerd
>
> ________________________________________
> Von: mkgmap-dev<mkgmap-dev-bounces at lists.mkgmap.org.uk>  im Auftrag von Carlos Dávila<cdavilam at orangecorreo.es>
> Gesendet: Donnerstag, 4. Januar 2018 23:14:36
> An:mkgmap-dev at lists.mkgmap.org.uk
> Betreff: Re: [mkgmap-dev] mkgmap r4025 implements --x-dem-poly option
>
> Hi Gerd
> I also use hgt files from viewfinderpanoramas. I split bolivia with
> max-nodes=100000 and then run mkgmap as follows:
> java -Xmx2500m -ea -Dlog.config=logging.properties -jar mkgmap-dem.jar
> --block-size=1024 --x-dem=../DEM/hgt --x-dem-poly=polygons/bolivia.poly
> --x-dem-dists=3312,5846,8948,12646,20282 --x-overview-dem-dist=128000
> --gmapi --show-profiles=1 --output-dir=../mapas/$pais
> --bounds=bounds.zip --precomp-sea=sea.zip --max-jobs=1 --route --latin1
> --code-page=1252 --country-name=$PAIS --country-abbr=$ABR
> --area-name=$MAPA --family-name="OpenStreetMap $MAPA" --family-id=1$FID
> --product-id=1 --product-version=$VERSION --series-name="OSM-$MAPA"
> --overview-mapname=$ABR-1${FID} --overview-mapnumber=551${FID}000
> --name-tag-list=$NAMETAG --index --process-destination --process-exits
> --housenumbers --reduce-point-density=4 --polygon-size-limits="24:12,
> 18:10, 16:0" --add-pois-to-areas --link-pois-to-ways
> --location-autofill=is_in,nearest --drive-on=detect,$DRIVEON
> --license-file=license_ODbL.txt --copyright-message="OpenStreetMap
> contributors, ODbL. See:http://www.openstreetmap.org/copyright"
> $LANGUAGE --road-name-config=$CONFIG
> --x-mdr7-del=GRADE0,GRADE1,GRADE2,GRADE3,GRADE4,GRADE5,GRADE6,GRADE7,UNNAMED
> --remove-ovm-work-files=true --style-file=../resources/styles
> --style=mio --check-styles -c $pais.args
>
> Tomorrow I'll try with default style, just to see if it makes any difference
>
> El 04/01/18 a las 07:35, Gerd Petermann escribió:
>> Hi Carlos,
>>
>> I was not yet able to reproduce the problem. I've used the (unzipped) 3´´ files fromhttp://viewfinderpanoramas.org/Coverage%20map%20viewfinderpanoramas_org3.htm
>> and my overview map is created with the default style. I tried different values for --x-overview-dem-dist and it worked without problems.
>> The only special option that I needed was --block-size=2048 for some tiles.
>> If you already use that please post further details about commands and maybe a link to your hgt files.
>>
>> Gerd
>>
>> ________________________________________
>> Von: mkgmap-dev<mkgmap-dev-bounces at lists.mkgmap.org.uk>  im Auftrag von Carlos Dávila<cdavilam at orangecorreo.es>
>> Gesendet: Mittwoch, 3. Januar 2018 20:15:14
>> An:mkgmap-dev at lists.mkgmap.org.uk
>> Betreff: Re: [mkgmap-dev] mkgmap r4025 implements --x-dem-poly option
>>
>> Thanks Gerd. If you need input file or commands, just let me know.
>>
>> El 03/01/18 a las 20:00, Gerd Petermann escribió:
>>> Hi Carlos,
>>>
>>> I'll try to reproduce the problem tomorrow. Sounds as if something else goes wrong
>>> and the try / catch block interprets the problem in the same way as a missing hgt file.
>>>
>>> Gerd
>>>
>>> ________________________________________
>>> Von: mkgmap-dev<mkgmap-dev-bounces at lists.mkgmap.org.uk>  im Auftrag von Carlos Dávila<cdavilam at orangecorreo.es>
>>> Gesendet: Dienstag, 2. Januar 2018 19:40:00
>>> An:mkgmap-dev at lists.mkgmap.org.uk
>>> Betreff: Re: [mkgmap-dev] mkgmap r4025 implements --x-dem-poly option
>>>
>>> --x-dem-poly option works like a charm, thanks!
>>> I'm doing my tests with Bolivia map and there's some problem with
>>> overview map generation. Log file is recording a lot of lines like "file
>>> S19W069.hgt not found. Is expected to cover sea.", but the given hgt
>>> *does exist* in the hgt folder. "Missing" hgt's are different in
>>> different runs of mkgmap, see screenshots [1] and [2]. Watching at the
>>> overview map, it seems mkgmap starts building DEM correctly, but at a
>>> given point it fails to read hgt's and rest of DEM is not generated. DEM
>>> for tiles in the "missing" areas are correctly generated. BuildDEMFile
>>> creates correct overview, see [3].
>>> [1] ||http://files.mkgmap.org.uk/download/381/Screenshot_20180102_181555.png
>>> |[2]
>>> |||http://files.mkgmap.org.uk/download/380/Screenshot_20180102_185917.png
>>> [3]
>>> |||||http://files.mkgmap.org.uk/download/382/Screenshot_20180102_192228.png|||
>>>
>>> El 31/12/17 a las 11:53, Henning Scholland escribió:
>>>> Hi Gerd,
>>>>
>>>> I got an OutOfMemory exception (see below) while reading zipped 1" SRTM
>>>> files in Scandinavia. Unzipped it's all fine.
>>>>
>>>> Btw. it would be nice to move the 'DEM file calculation for ... took 265
>>>> ms'-messages from stdout to logging Information.
>>>>
>>>> Henning
>>>>
>>>> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
>>>>         at java.nio.HeapByteBuffer.<init>(Unknown Source)
>>>>         at java.nio.ByteBuffer.allocate(Unknown Source)
>>>>         at
>>>> uk.me.parabola.mkgmap.reader.hgt.HGTReader.extractFromZip(HGTReader.java:123)
>>>>         at uk.me.parabola.mkgmap.reader.hgt.HGTReader.<init>(HGTReader.java:90)
>>>>         at
>>>> uk.me.parabola.mkgmap.reader.hgt.HGTConverter.<init>(HGTConverter.java:66)
>>>>         at uk.me.parabola.imgfmt.app.dem.DEMFile.calc(DEMFile.java:47)
>>>>         at uk.me.parabola.mkgmap.build.MapBuilder.makeMap(MapBuilder.java:334)
>>>>         at
>>>> uk.me.parabola.mkgmap.combiners.OverviewBuilder.writeOverviewMap(OverviewBuilder.java:191)
>>>>         at
>>>> uk.me.parabola.mkgmap.combiners.OverviewBuilder.onFinish(OverviewBuilder.java:103)
>>>>         at uk.me.parabola.mkgmap.main.Main.endOptions(Main.java:617)
>>>>         at
>>>> uk.me.parabola.mkgmap.CommandArgsReader.readArgs(CommandArgsReader.java:128)
>>>>         at uk.me.parabola.mkgmap.main.Main.mainStart(Main.java:136)
>>>>         at uk.me.parabola.mkgmap.main.Main.main(Main.java:107)
>>>>
>>>> On 28.12.2017 18:18, Gerd Petermann wrote:
>>>>> Hi all,
>>>>>
>>>>> seehttp://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4025
>>>>> this is useful if you create a map for a country extract like nepal (nepal-latest.osm.pbf)
>>>>>
>>>>> Here is a screenshot of a map created with the option --x-dem-poly=nepal.poly
>>>>> http://files.mkgmap.org.uk/download/378/nepal-with-poly.jpg
>>>>>
>>>>> The screenshot also shows some wrong reliefs, and I think I used files without many holes :-(
>>>>> So, next step is to find out what goes wrong with DEM in low resolutions. This might take longer,
>>>>> I hope Frank has an idea.
>>>>> It seems to be a good idea to use a rather high res for the overview map for now. For the screenshot I used
>>>>> --x-overview-dem-dist=276160, with --x-overview-dem-dist=88000 the problems are gone and DEM file is still only
>>>>> ~300KB.
>>>>>
>>>>> Gerd
>>>>> P.S.
>>>>> See alsohttp://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&path=%2F&rev=4024
>>>>> I've moved some messages into the logger, so there will be less noise from mkgmap.
>>>>>

-------------- next part --------------
# List of areas
# Generated Fri Jan 05 08:40:47 CET 2018
#
55133001: -688128,-3033088 to -544768,-2942976
#       : -14.765625,-65.083008 to -11.689453,-63.149414

55133002: -763904,-3014656 to -688128,-2942976
#       : -16.391602,-64.687500 to -14.765625,-63.149414

55133003: -763904,-3033088 to -712704,-3014656
#       : -16.391602,-65.083008 to -15.292969,-64.687500

55133004: -712704,-3033088 to -688128,-3014656
#       : -15.292969,-65.083008 to -14.765625,-64.687500

55133005: -661504,-2942976 to -585728,-2809856
#       : -14.194336,-63.149414 to -12.568359,-60.292969

55133006: -763904,-2865152 to -661504,-2713600
#       : -16.391602,-61.479492 to -14.194336,-58.227539

55133007: -733184,-2942976 to -661504,-2865152
#       : -15.732422,-63.149414 to -14.194336,-61.479492

55133008: -763904,-2942976 to -733184,-2865152
#       : -16.391602,-63.149414 to -15.732422,-61.479492

55133009: -641024,-3246080 to -548864,-3141632
#       : -13.754883,-69.653320 to -11.777344,-67.412109

55133010: -548864,-3203072 to -481280,-3141632
#       : -11.777344,-68.730469 to -10.327148,-67.412109

55133011: -548864,-3246080 to -505856,-3203072
#       : -11.777344,-69.653320 to -10.854492,-68.730469

55133012: -641024,-3084288 to -546816,-3033088
#       : -13.754883,-66.181641 to -11.733398,-65.083008

55133013: -641024,-3141632 to -546816,-3084288
#       : -13.754883,-67.412109 to -11.733398,-66.181641

55133014: -546816,-3141632 to -454656,-3090432
#       : -11.733398,-67.412109 to -9.755859,-66.313477

55133015: -546816,-3090432 to -448512,-3033088
#       : -11.733398,-66.313477 to -9.624023,-65.083008

55133016: -712704,-3108864 to -641024,-3033088
#       : -15.292969,-66.708984 to -13.754883,-65.083008

55133017: -763904,-3108864 to -712704,-3033088
#       : -16.391602,-66.708984 to -15.292969,-65.083008

55133018: -716800,-3145728 to -641024,-3108864
#       : -15.380859,-67.500000 to -13.754883,-66.708984

55133019: -763904,-3145728 to -716800,-3108864
#       : -16.391602,-67.500000 to -15.380859,-66.708984

55133020: -763904,-3162112 to -733184,-3145728
#       : -16.391602,-67.851563 to -15.732422,-67.500000

55133021: -763904,-3194880 to -733184,-3162112
#       : -16.391602,-68.554688 to -15.732422,-67.851563

55133022: -763904,-3264512 to -733184,-3207168
#       : -16.391602,-70.048828 to -15.732422,-68.818359

55133023: -763904,-3207168 to -733184,-3194880
#       : -16.391602,-68.818359 to -15.732422,-68.554688

55133024: -733184,-3190784 to -641024,-3145728
#       : -15.732422,-68.466797 to -13.754883,-67.500000

55133025: -714752,-3258368 to -641024,-3190784
#       : -15.336914,-69.916992 to -13.754883,-68.466797

55133026: -733184,-3209216 to -714752,-3190784
#       : -15.732422,-68.862305 to -15.336914,-68.466797

55133027: -733184,-3264512 to -714752,-3209216
#       : -15.732422,-70.048828 to -15.336914,-68.862305

55133028: -942080,-2811904 to -763904,-2674688
#       : -20.214844,-60.336914 to -16.391602,-57.392578

55133029: -1019904,-2912256 to -763904,-2811904
#       : -21.884766,-62.490234 to -16.391602,-60.336914

55133030: -1071104,-3008512 to -1007616,-2912256
#       : -22.983398,-64.555664 to -21.621094,-62.490234

55133031: -1007616,-3008512 to -972800,-2912256
#       : -21.621094,-64.555664 to -20.874023,-62.490234

55133032: -972800,-3008512 to -921600,-2983936
#       : -20.874023,-64.555664 to -19.775391,-64.028320

55133033: -972800,-2983936 to -921600,-2912256
#       : -20.874023,-64.028320 to -19.775391,-62.490234

55133034: -802816,-3008512 to -763904,-2912256
#       : -17.226563,-64.555664 to -16.391602,-62.490234

55133035: -921600,-3008512 to -888832,-2994176
#       : -19.775391,-64.555664 to -19.072266,-64.248047

55133036: -888832,-3008512 to -854016,-2994176
#       : -19.072266,-64.555664 to -18.325195,-64.248047

55133037: -854016,-3008512 to -802816,-2994176
#       : -18.325195,-64.555664 to -17.226563,-64.248047

55133038: -821248,-2947072 to -802816,-2912256
#       : -17.622070,-63.237305 to -17.226563,-62.490234

55133039: -821248,-2994176 to -802816,-2947072
#       : -17.622070,-64.248047 to -17.226563,-63.237305

55133040: -921600,-2940928 to -821248,-2912256
#       : -19.775391,-63.105469 to -17.622070,-62.490234

55133041: -921600,-2994176 to -884736,-2940928
#       : -19.775391,-64.248047 to -18.984375,-63.105469

55133042: -884736,-2994176 to -868352,-2940928
#       : -18.984375,-64.248047 to -18.632813,-63.105469

55133043: -868352,-2994176 to -839680,-2977792
#       : -18.632813,-64.248047 to -18.017578,-63.896484

55133044: -868352,-2977792 to -839680,-2940928
#       : -18.632813,-63.896484 to -18.017578,-63.105469

55133045: -839680,-2994176 to -821248,-2953216
#       : -18.017578,-64.248047 to -17.622070,-63.369141

55133046: -827392,-2953216 to -821248,-2940928
#       : -17.753906,-63.369141 to -17.622070,-63.105469

55133047: -839680,-2945024 to -827392,-2940928
#       : -18.017578,-63.193359 to -17.753906,-63.105469

55133048: -839680,-2953216 to -827392,-2945024
#       : -18.017578,-63.369141 to -17.753906,-63.193359

55133049: -1071104,-3174400 to -1015808,-3090432
#       : -22.983398,-68.115234 to -21.796875,-66.313477

55133050: -1015808,-3207168 to -897024,-3166208
#       : -21.796875,-68.818359 to -19.248047,-67.939453

55133051: -917504,-3166208 to -897024,-3090432
#       : -19.687500,-67.939453 to -19.248047,-66.313477

55133052: -1015808,-3166208 to -917504,-3127296
#       : -21.796875,-67.939453 to -19.687500,-67.104492

55133053: -1015808,-3127296 to -948224,-3090432
#       : -21.796875,-67.104492 to -20.346680,-66.313477

55133054: -948224,-3127296 to -917504,-3090432
#       : -20.346680,-67.104492 to -19.687500,-66.313477

55133055: -997376,-3090432 to -964608,-3051520
#       : -21.401367,-66.313477 to -20.698242,-65.478516

55133056: -985088,-3051520 to -964608,-3008512
#       : -21.137695,-65.478516 to -20.698242,-64.555664

55133057: -997376,-3051520 to -985088,-3008512
#       : -21.401367,-65.478516 to -21.137695,-64.555664

55133058: -1071104,-3090432 to -1019904,-3008512
#       : -22.983398,-66.313477 to -21.884766,-64.555664

55133059: -1019904,-3041280 to -997376,-3008512
#       : -21.884766,-65.258789 to -21.401367,-64.555664

55133060: -1019904,-3090432 to -997376,-3041280
#       : -21.884766,-66.313477 to -21.401367,-65.258789

55133061: -964608,-3090432 to -940032,-3047424
#       : -20.698242,-66.313477 to -20.170898,-65.390625

55133062: -940032,-3059712 to -897024,-3047424
#       : -20.170898,-65.654297 to -19.248047,-65.390625

55133063: -940032,-3090432 to -915456,-3059712
#       : -20.170898,-66.313477 to -19.643555,-65.654297

55133064: -915456,-3090432 to -897024,-3059712
#       : -19.643555,-66.313477 to -19.248047,-65.654297

55133065: -964608,-3047424 to -931840,-3031040
#       : -20.698242,-65.390625 to -19.995117,-65.039063

55133066: -964608,-3031040 to -931840,-3008512
#       : -20.698242,-65.039063 to -19.995117,-64.555664

55133067: -907264,-3047424 to -897024,-3008512
#       : -19.467773,-65.390625 to -19.248047,-64.555664

55133068: -931840,-3047424 to -907264,-3035136
#       : -19.995117,-65.390625 to -19.467773,-65.126953

55133069: -931840,-3035136 to -907264,-3008512
#       : -19.995117,-65.126953 to -19.467773,-64.555664

55133070: -897024,-3162112 to -837632,-3115008
#       : -19.248047,-67.851563 to -17.973633,-66.840820

55133071: -837632,-3162112 to -811008,-3115008
#       : -17.973633,-67.851563 to -17.402344,-66.840820

55133072: -792576,-3137536 to -763904,-3115008
#       : -17.006836,-67.324219 to -16.391602,-66.840820

55133073: -811008,-3137536 to -792576,-3115008
#       : -17.402344,-67.324219 to -17.006836,-66.840820

55133074: -811008,-3162112 to -784384,-3137536
#       : -17.402344,-67.851563 to -16.831055,-67.324219

55133075: -784384,-3162112 to -763904,-3137536
#       : -16.831055,-67.851563 to -16.391602,-67.324219

55133076: -897024,-3239936 to -819200,-3192832
#       : -19.248047,-69.521484 to -17.578125,-68.510742

55133077: -897024,-3192832 to -819200,-3162112
#       : -19.248047,-68.510742 to -17.578125,-67.851563

55133078: -819200,-3174400 to -774144,-3162112
#       : -17.578125,-68.115234 to -16.611328,-67.851563

55133079: -774144,-3174400 to -763904,-3162112
#       : -16.611328,-68.115234 to -16.391602,-67.851563

55133080: -819200,-3248128 to -796672,-3174400
#       : -17.578125,-69.697266 to -17.094727,-68.115234

55133081: -796672,-3248128 to -763904,-3182592
#       : -17.094727,-69.697266 to -16.391602,-68.291016

55133082: -770048,-3182592 to -763904,-3174400
#       : -16.523438,-68.291016 to -16.391602,-68.115234

55133083: -796672,-3182592 to -770048,-3174400
#       : -17.094727,-68.291016 to -16.523438,-68.115234

55133084: -897024,-3078144 to -862208,-3061760
#       : -19.248047,-66.049805 to -18.500977,-65.698242

55133085: -897024,-3115008 to -874496,-3078144
#       : -19.248047,-66.840820 to -18.764648,-66.049805

55133086: -874496,-3115008 to -862208,-3078144
#       : -18.764648,-66.840820 to -18.500977,-66.049805

55133087: -862208,-3115008 to -835584,-3094528
#       : -18.500977,-66.840820 to -17.929688,-66.401367

55133088: -862208,-3080192 to -835584,-3061760
#       : -18.500977,-66.093750 to -17.929688,-65.698242

55133089: -862208,-3094528 to -835584,-3080192
#       : -18.500977,-66.401367 to -17.929688,-66.093750

55133090: -864256,-3061760 to -835584,-3041280
#       : -18.544922,-65.698242 to -17.929688,-65.258789

55133091: -864256,-3041280 to -835584,-3008512
#       : -18.544922,-65.258789 to -17.929688,-64.555664

55133092: -882688,-3061760 to -864256,-3039232
#       : -18.940430,-65.698242 to -18.544922,-65.214844

55133093: -897024,-3061760 to -882688,-3039232
#       : -19.248047,-65.698242 to -18.940430,-65.214844

55133094: -882688,-3039232 to -864256,-3008512
#       : -18.940430,-65.214844 to -18.544922,-64.555664

55133095: -897024,-3039232 to -882688,-3008512
#       : -19.248047,-65.214844 to -18.940430,-64.555664

55133096: -774144,-3035136 to -763904,-3008512
#       : -16.611328,-65.126953 to -16.391602,-64.555664

55133097: -774144,-3076096 to -763904,-3035136
#       : -16.611328,-66.005859 to -16.391602,-65.126953

55133098: -806912,-3076096 to -774144,-3049472
#       : -17.314453,-66.005859 to -16.611328,-65.434570

55133099: -786432,-3049472 to -774144,-3008512
#       : -16.875000,-65.434570 to -16.611328,-64.555664

55133100: -806912,-3049472 to -786432,-3008512
#       : -17.314453,-65.434570 to -16.875000,-64.555664

55133101: -825344,-3047424 to -806912,-3008512
#       : -17.709961,-65.390625 to -17.314453,-64.555664

55133102: -835584,-3047424 to -825344,-3008512
#       : -17.929688,-65.390625 to -17.709961,-64.555664

55133103: -815104,-3076096 to -806912,-3047424
#       : -17.490234,-66.005859 to -17.314453,-65.390625

55133104: -823296,-3076096 to -815104,-3047424
#       : -17.666016,-66.005859 to -17.490234,-65.390625

55133105: -835584,-3076096 to -823296,-3047424
#       : -17.929688,-66.005859 to -17.666016,-65.390625

55133106: -808960,-3115008 to -796672,-3096576
#       : -17.358398,-66.840820 to -17.094727,-66.445313

55133107: -796672,-3115008 to -763904,-3096576
#       : -17.094727,-66.840820 to -16.391602,-66.445313

55133108: -802816,-3096576 to -763904,-3076096
#       : -17.226563,-66.445313 to -16.391602,-66.005859

55133109: -808960,-3096576 to -802816,-3076096
#       : -17.358398,-66.445313 to -17.226563,-66.005859

55133110: -835584,-3102720 to -808960,-3092480
#       : -17.929688,-66.577148 to -17.358398,-66.357422

55133111: -835584,-3115008 to -808960,-3102720
#       : -17.929688,-66.840820 to -17.358398,-66.577148

55133112: -835584,-3092480 to -808960,-3084288
#       : -17.929688,-66.357422 to -17.358398,-66.181641

55133113: -835584,-3084288 to -813056,-3076096
#       : -17.929688,-66.181641 to -17.446289,-66.005859

55133114: -813056,-3082240 to -808960,-3076096
#       : -17.446289,-66.137695 to -17.358398,-66.005859

55133115: -813056,-3084288 to -808960,-3082240
#       : -17.446289,-66.181641 to -17.358398,-66.137695