[mkgmap-dev] geofabrik

Fri Sep 28 23:20:16 BST 2012

geoff the map size i feel is far to big
i have increased the nodes for it , and the memory was set to  800 mb
but still no joy at all
stephen


On Sat, Sep 29, 2012 at 5:27 AM, Geoff Sherlock
<geoffrey_sherlock at btinternet.com> wrote:
> Are you getting the problem in the splitter?
>
> I tried to recreate with a small set of data.
> I downloaded latest pbf for Iceland, splitter did fine, but mkgmap hung in
> some loop, then (eventually died).
>
> Could be a problem with the splitter and mkgmap!!
>
> I guessed increasing the nodes would be a fix for the splitter (if the
> memory is there), but I don't know a fix for mkgmap.
>
> Output follows:
> C:\Geoff\Walks\OSM\splitter>java -Xmx5000M -jar splitter.jar
> iceland.osm.pbf --
> ax-nodes=300000  --mapid=56750001
> cache=
> description=
> geonames-file=
> legacy-mode=false
> mapid=56750001
> max-areas=255
> max-nodes=300000
> max-threads=4 (auto)
> mixed=false
> no-trim=false
> output=pbf
> output-dir=
> overlap=2000
> resolution=13
> split-file=
> status-freq=120
> write-kml=
> Elapsed time: 0s   Memory: Current 121MB (2MB used, 119MB free) Max 4444MB
> Time started: Fri Sep 28 20:09:05 BST 2012
> Map is being split for resolution 13:
> - area boundaries are aligned to 0x800 map units
> - areas are multiples of 0x1000 map units wide and high
> Processing iceland.osm.pbf
> Bounding box -25.740850000000002 62.845530000000004 -12.41708 67.50085
> in 1 file
> Time: Fri Sep 28 20:09:06 BST 2012
> Exact map coverage is (62.84553050994873,-25.740838050842285) to
> (67.5008368492
> 265,-12.41706132888794)
> Trimmed and rounded map coverage is (62.8857421875,-25.048828125) to
> (67.368164
> 625,-12.392578125)
> Splitting nodes into areas containing a maximum of 300,000 nodes each...
> Area (63.5009765625,-23.73046875) to (64.2919921875,-21.884765625) contains
> 234
> 963 nodes. DONE!
> Area (63.0615234375,-21.884765625) to (64.0283203125,-20.654296875) contains
> 20
> 679 nodes. DONE!
> Area (64.0283203125,-21.884765625) to (64.2919921875,-20.654296875) contains
> 29
> ,530 nodes. DONE!
> Area (64.2919921875,-25.048828125) to (66.7529296875,-20.654296875) contains
> 16
> ,219 nodes. DONE!
> Area (62.8857421875,-20.654296875) to (64.8193359375,-12.744140625) contains
> 14
> ,736 nodes. DONE!
> Area (64.8193359375,-20.654296875) to (67.3681640625,-12.392578125) contains
> 17
> ,626 nodes. DONE!
> 6 areas:
> Area 56750001 covers (0x2cd800,0xfff07000) to (0x2d8800,0xfff15000)
> Area 56750002 covers (0x2db800,0xffee3000) to (0x2f7800,0xfff15000)
> Area 56750003 covers (0x2cb800,0xfff15000) to (0x2e1800,0xfff6f000)
> Area 56750004 covers (0x2d8800,0xfff07000) to (0x2db800,0xfff15000)
> Area 56750005 covers (0x2e1800,0xfff15000) to (0x2fe800,0xfff73000)
> Area 56750006 covers (0x2d2800,0xffef2000) to (0x2db800,0xfff07000)
> Writing out split osm files Fri Sep 28 20:09:06 BST 2012
> Processing 6 areas in a single pass
> (63.0615234375,-21.884765625) to (64.0283203125,-20.654296875)
> (64.2919921875,-25.048828125) to (66.7529296875,-20.654296875)
> (62.8857421875,-20.654296875) to (64.8193359375,-12.744140625)
> (64.0283203125,-21.884765625) to (64.2919921875,-20.654296875)
> (64.8193359375,-20.654296875) to (67.3681640625,-12.392578125)
> (63.5009765625,-23.73046875) to (64.2919921875,-21.884765625)
> Starting pass 1 of 1, processing 6 areas (56750001 to 56750006)
> Grid [512][512] for grid area (62.84282684326172,-25.09174346923828) to
> (67.411
> 7940673828,-12.349662780761719) requires max. 3 checks for each node.
> Grid was created in 59 ms
> Allocating three-tier structure to save area info
> (HashMap->vector->chunkvector
>
> Allocating three-tier structure to save area info
> (HashMap->vector->chunkvector
>
> Processing iceland.osm.pbf
> Bounding box -25.740850000000002 62.845530000000004 -12.41708 67.50085
> MAP occupancy: 1,000,000, number of area dictionary entries: 21 of 65535
> Map details: HashMap -> 7 vectors for 65,307 chunks(vector usage < 1%)
> Writing ways Fri Sep 28 20:09:08 BST 2012
> Writing relations Fri Sep 28 20:09:10 BST 2012
> ***********************************************************
> Final statistics
> ***********************************************************
> Needed dictionary entries: 23 of 65535
> coords occupancy
> MAP occupancy: 1,024,755
> Length-6 chunks: 58,084 (Bytes: 1,394,016)
> Length-10 chunks: 4,059 (Bytes: 129,888)
> Length-14 chunks: 1,871 (Bytes: 74,840)
> Length-18 chunks: 672 (Bytes: 32,256)
> Length-22 chunks: 528 (Bytes: 29,568)
> Length-26 chunks: 371 (Bytes: 23,744)
> Length-30 chunks: 247 (Bytes: 17,784)
> Length-34 chunks: 224 (Bytes: 17,920)
> Length-38 chunks: 156 (Bytes: 13,728)
> Length-42 chunks: 90 (Bytes: 8,640)
> Length-46 chunks: 52 (Bytes: 5,408)
> Length-50 chunks: 28 (Bytes: 3,136)
> Length-54 chunks: 19 (Bytes: 2,280)
> Length-58 chunks: 14 (Bytes: 1,792)
> Length-62 chunks: 13 (Bytes: 1,768)
> Length-66 chunks: 12 (Bytes: 1,728)
> Length-68 chunks: 28 (Bytes: 4,256)
> RLE compresion info: compressed / uncompressed size / ratio: 482,512 /
> 1,381,47
> / 66%
> Map details: HashMap -> 8 vectors for 66,468 chunks(vector usage < 1%)
> ways occupancy
> MAP occupancy: 88,187
> Length-6 chunks: 9,798 (Bytes: 235,152)
> Length-10 chunks: 300 (Bytes: 9,600)
> Length-14 chunks: 275 (Bytes: 11,000)
> Length-18 chunks: 145 (Bytes: 6,960)
> Length-22 chunks: 84 (Bytes: 4,704)
> Length-26 chunks: 42 (Bytes: 2,688)
> Length-30 chunks: 25 (Bytes: 1,800)
> Length-34 chunks: 18 (Bytes: 1,440)
> Length-38 chunks: 20 (Bytes: 1,760)
> Length-42 chunks: 11 (Bytes: 1,056)
> Length-46 chunks: 8 (Bytes: 832)
> Length-50 chunks: 16 (Bytes: 1,792)
> Length-54 chunks: 9 (Bytes: 1,080)
> Length-58 chunks: 13 (Bytes: 1,664)
> Length-62 chunks: 17 (Bytes: 2,312)
> Length-66 chunks: 32 (Bytes: 4,608)
> Length-68 chunks: 11 (Bytes: 1,672)
> RLE compresion info: compressed / uncompressed size / ratio: 80,094 /
> 144,704 /
> 45%
> Map details: HashMap -> 1 vectors for 10,824 chunks(vector usage < 1%)
>
> Thread worker-2 has finished
> Thread worker-0 has finished
> Thread worker-1 has finished
> Time finished: Fri Sep 28 20:09:10 BST 2012
> Total time taken: 5s
>
> C:\Geoff\Walks\OSM\splitter>move /-Y iceland.osm.pbf iceland
>         1 file(s) moved.
>
> C:\Geoff\Walks\OSM\splitter>move /-Y *.osm.pbf ..\mkgmap
> C:\Geoff\Walks\OSM\splitter\56750001.osm.pbf
> C:\Geoff\Walks\OSM\splitter\56750002.osm.pbf
> C:\Geoff\Walks\OSM\splitter\56750003.osm.pbf
> C:\Geoff\Walks\OSM\splitter\56750004.osm.pbf
> C:\Geoff\Walks\OSM\splitter\56750005.osm.pbf
> C:\Geoff\Walks\OSM\splitter\56750006.osm.pbf
>         6 file(s) moved.
>
> C:\Geoff\Walks\OSM\splitter>cd ..\mkgmap
>
> C:\Geoff\Walks\OSM\mkgmap>echo Iceland split completed. . .
> 1>>compilemaps.txt
>
>
> C:\Geoff\Walks\OSM\mkgmap>time /T  1>>compilemaps.txt
>
> C:\Geoff\Walks\OSM\mkgmap>rem
>
> C:\Geoff\Walks\OSM\mkgmap>rem Mapnik style
>
> C:\Geoff\Walks\OSM\mkgmap>rem
>
> C:\Geoff\Walks\OSM\mkgmap>pause
> Press any key to continue . . .
>
> C:\Geoff\Walks\OSM\mkgmap>java -Xmx5000M -jar
> mkgmap.jar --index --tdbfile --ro
> te --generate-sea=multipolygon,close-gaps=1000 --mapname=56730001 --family-id=4
> --family-name="icemapnik" --series-name="icemapnik"--description="OsmICEMapnik
> --remove-short-arcs --add-pois-to-areas --nsis --drive-on-left --overview-mapn
> me="OsmICEMapnik" --style-file=mapnik_styles/mapnik *.pbf icenik.typ
> Time started: Fri Sep 28 20:09:33 BST 2012
>
>
> On Friday, September 28, 2012 12:23 PM, steve sgalowski  wrote:
>
> -----Original Message-----
> From: steve sgalowski
> Sent: Friday, September 28, 2012 12:23 PM
> To: Development list for mkgmap
> Subject: Re: [mkgmap-dev] geofabrik
>
> true , but now when  you use the splitter , it will not work on t he
> new odbl license files
> as it spits the dummy , when you have a map size of 0 x 200
> 0 x 400  is ok for ausralia
>
> Stephen
>
>
> On Fri, Sep 28, 2012 at 9:19 PM, Geoff Sherlock
> <geoffrey_sherlock at btinternet.com> wrote:
>> Francois, you mention .osm.bz2 files. If you are only putting them through
>> splitter and mkgmap, it is much quicker to both download and process the
>> binary .pbf extracts.
>>
>> Regards, Geoff.
>>
>> -----Original Message-----
>> From: Francois
>> Sent: Friday, September 28, 2012 11:23 AM
>> Cc: 'Development list for mkgmap'
>> Subject: Re: [mkgmap-dev] geofabrik
>>
>> On 28/09/2012 12:18, RheinSkipper wrote:
>>> They changed the folder name after the license change:
>>> http://download.geofabrik.de/openstreetmap/
>>
>> Great. Thank you. Francois
>>
>> _______________________________________________
>> mkgmap-dev mailing list
>> mkgmap-dev at lists.mkgmap.org.uk
>> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
>>
>> _______________________________________________
>> mkgmap-dev mailing list
>> mkgmap-dev at lists.mkgmap.org.uk
>> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
>
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev