[mkgmap-dev] geofabrik

Fri Sep 28 20:27:05 BST 2012

Are you getting the problem in the splitter?

I tried to recreate with a small set of data.
I downloaded latest pbf for Iceland, splitter did fine, but mkgmap hung in 
some loop, then (eventually died).

Could be a problem with the splitter and mkgmap!!

I guessed increasing the nodes would be a fix for the splitter (if the 
memory is there), but I don't know a fix for mkgmap.

Output follows:
C:\Geoff\Walks\OSM\splitter>java -Xmx5000M -jar splitter.jar 
iceland.osm.pbf --
ax-nodes=300000  --mapid=56750001
cache=
description=
geonames-file=
legacy-mode=false
mapid=56750001
max-areas=255
max-nodes=300000
max-threads=4 (auto)
mixed=false
no-trim=false
output=pbf
output-dir=
overlap=2000
resolution=13
split-file=
status-freq=120
write-kml=
Elapsed time: 0s   Memory: Current 121MB (2MB used, 119MB free) Max 4444MB
Time started: Fri Sep 28 20:09:05 BST 2012
Map is being split for resolution 13:
- area boundaries are aligned to 0x800 map units
- areas are multiples of 0x1000 map units wide and high
Processing iceland.osm.pbf
Bounding box -25.740850000000002 62.845530000000004 -12.41708 67.50085
in 1 file
Time: Fri Sep 28 20:09:06 BST 2012
Exact map coverage is (62.84553050994873,-25.740838050842285) to 
(67.5008368492
265,-12.41706132888794)
Trimmed and rounded map coverage is (62.8857421875,-25.048828125) to 
(67.368164
625,-12.392578125)
Splitting nodes into areas containing a maximum of 300,000 nodes each...
Area (63.5009765625,-23.73046875) to (64.2919921875,-21.884765625) contains 
234
963 nodes. DONE!
Area (63.0615234375,-21.884765625) to (64.0283203125,-20.654296875) contains 
20
679 nodes. DONE!
Area (64.0283203125,-21.884765625) to (64.2919921875,-20.654296875) contains 
29
,530 nodes. DONE!
Area (64.2919921875,-25.048828125) to (66.7529296875,-20.654296875) contains 
16
,219 nodes. DONE!
Area (62.8857421875,-20.654296875) to (64.8193359375,-12.744140625) contains 
14
,736 nodes. DONE!
Area (64.8193359375,-20.654296875) to (67.3681640625,-12.392578125) contains 
17
,626 nodes. DONE!
6 areas:
Area 56750001 covers (0x2cd800,0xfff07000) to (0x2d8800,0xfff15000)
Area 56750002 covers (0x2db800,0xffee3000) to (0x2f7800,0xfff15000)
Area 56750003 covers (0x2cb800,0xfff15000) to (0x2e1800,0xfff6f000)
Area 56750004 covers (0x2d8800,0xfff07000) to (0x2db800,0xfff15000)
Area 56750005 covers (0x2e1800,0xfff15000) to (0x2fe800,0xfff73000)
Area 56750006 covers (0x2d2800,0xffef2000) to (0x2db800,0xfff07000)
Writing out split osm files Fri Sep 28 20:09:06 BST 2012
Processing 6 areas in a single pass
(63.0615234375,-21.884765625) to (64.0283203125,-20.654296875)
(64.2919921875,-25.048828125) to (66.7529296875,-20.654296875)
(62.8857421875,-20.654296875) to (64.8193359375,-12.744140625)
(64.0283203125,-21.884765625) to (64.2919921875,-20.654296875)
(64.8193359375,-20.654296875) to (67.3681640625,-12.392578125)
(63.5009765625,-23.73046875) to (64.2919921875,-21.884765625)
Starting pass 1 of 1, processing 6 areas (56750001 to 56750006)
Grid [512][512] for grid area (62.84282684326172,-25.09174346923828) to 
(67.411
7940673828,-12.349662780761719) requires max. 3 checks for each node.
Grid was created in 59 ms
Allocating three-tier structure to save area info 
(HashMap->vector->chunkvector

Allocating three-tier structure to save area info 
(HashMap->vector->chunkvector

Processing iceland.osm.pbf
Bounding box -25.740850000000002 62.845530000000004 -12.41708 67.50085
MAP occupancy: 1,000,000, number of area dictionary entries: 21 of 65535
Map details: HashMap -> 7 vectors for 65,307 chunks(vector usage < 1%)
Writing ways Fri Sep 28 20:09:08 BST 2012
Writing relations Fri Sep 28 20:09:10 BST 2012
***********************************************************
Final statistics
***********************************************************
Needed dictionary entries: 23 of 65535
coords occupancy
MAP occupancy: 1,024,755
Length-6 chunks: 58,084 (Bytes: 1,394,016)
Length-10 chunks: 4,059 (Bytes: 129,888)
Length-14 chunks: 1,871 (Bytes: 74,840)
Length-18 chunks: 672 (Bytes: 32,256)
Length-22 chunks: 528 (Bytes: 29,568)
Length-26 chunks: 371 (Bytes: 23,744)
Length-30 chunks: 247 (Bytes: 17,784)
Length-34 chunks: 224 (Bytes: 17,920)
Length-38 chunks: 156 (Bytes: 13,728)
Length-42 chunks: 90 (Bytes: 8,640)
Length-46 chunks: 52 (Bytes: 5,408)
Length-50 chunks: 28 (Bytes: 3,136)
Length-54 chunks: 19 (Bytes: 2,280)
Length-58 chunks: 14 (Bytes: 1,792)
Length-62 chunks: 13 (Bytes: 1,768)
Length-66 chunks: 12 (Bytes: 1,728)
Length-68 chunks: 28 (Bytes: 4,256)
RLE compresion info: compressed / uncompressed size / ratio: 482,512 / 
1,381,47
/ 66%
Map details: HashMap -> 8 vectors for 66,468 chunks(vector usage < 1%)
ways occupancy
MAP occupancy: 88,187
Length-6 chunks: 9,798 (Bytes: 235,152)
Length-10 chunks: 300 (Bytes: 9,600)
Length-14 chunks: 275 (Bytes: 11,000)
Length-18 chunks: 145 (Bytes: 6,960)
Length-22 chunks: 84 (Bytes: 4,704)
Length-26 chunks: 42 (Bytes: 2,688)
Length-30 chunks: 25 (Bytes: 1,800)
Length-34 chunks: 18 (Bytes: 1,440)
Length-38 chunks: 20 (Bytes: 1,760)
Length-42 chunks: 11 (Bytes: 1,056)
Length-46 chunks: 8 (Bytes: 832)
Length-50 chunks: 16 (Bytes: 1,792)
Length-54 chunks: 9 (Bytes: 1,080)
Length-58 chunks: 13 (Bytes: 1,664)
Length-62 chunks: 17 (Bytes: 2,312)
Length-66 chunks: 32 (Bytes: 4,608)
Length-68 chunks: 11 (Bytes: 1,672)
RLE compresion info: compressed / uncompressed size / ratio: 80,094 / 
144,704 /
45%
Map details: HashMap -> 1 vectors for 10,824 chunks(vector usage < 1%)

Thread worker-2 has finished
Thread worker-0 has finished
Thread worker-1 has finished
Time finished: Fri Sep 28 20:09:10 BST 2012
Total time taken: 5s

C:\Geoff\Walks\OSM\splitter>move /-Y iceland.osm.pbf iceland
        1 file(s) moved.

C:\Geoff\Walks\OSM\splitter>move /-Y *.osm.pbf ..\mkgmap
C:\Geoff\Walks\OSM\splitter\56750001.osm.pbf
C:\Geoff\Walks\OSM\splitter\56750002.osm.pbf
C:\Geoff\Walks\OSM\splitter\56750003.osm.pbf
C:\Geoff\Walks\OSM\splitter\56750004.osm.pbf
C:\Geoff\Walks\OSM\splitter\56750005.osm.pbf
C:\Geoff\Walks\OSM\splitter\56750006.osm.pbf
        6 file(s) moved.

C:\Geoff\Walks\OSM\splitter>cd ..\mkgmap

C:\Geoff\Walks\OSM\mkgmap>echo Iceland split completed. . . 
1>>compilemaps.txt

C:\Geoff\Walks\OSM\mkgmap>time /T  1>>compilemaps.txt

C:\Geoff\Walks\OSM\mkgmap>rem

C:\Geoff\Walks\OSM\mkgmap>rem Mapnik style

C:\Geoff\Walks\OSM\mkgmap>rem

C:\Geoff\Walks\OSM\mkgmap>pause
Press any key to continue . . .

C:\Geoff\Walks\OSM\mkgmap>java -Xmx5000M -jar 
mkgmap.jar --index --tdbfile --ro
te --generate-sea=multipolygon,close-gaps=1000 --mapname=56730001 --family-id=4
--family-name="icemapnik" --series-name="icemapnik"--description="OsmICEMapnik
--remove-short-arcs --add-pois-to-areas --nsis --drive-on-left --overview-mapn
me="OsmICEMapnik" --style-file=mapnik_styles/mapnik *.pbf icenik.typ
Time started: Fri Sep 28 20:09:33 BST 2012

On Friday, September 28, 2012 12:23 PM, steve sgalowski  wrote:

-----Original Message----- 
From: steve sgalowski
Sent: Friday, September 28, 2012 12:23 PM
To: Development list for mkgmap
Subject: Re: [mkgmap-dev] geofabrik

true , but now when  you use the splitter , it will not work on t he
new odbl license files
as it spits the dummy , when you have a map size of 0 x 200
0 x 400  is ok for ausralia

Stephen

On Fri, Sep 28, 2012 at 9:19 PM, Geoff Sherlock
<geoffrey_sherlock at btinternet.com> wrote:
> Francois, you mention .osm.bz2 files. If you are only putting them through
> splitter and mkgmap, it is much quicker to both download and process the
> binary .pbf extracts.
>
> Regards, Geoff.
>
> -----Original Message-----
> From: Francois
> Sent: Friday, September 28, 2012 11:23 AM
> Cc: 'Development list for mkgmap'
> Subject: Re: [mkgmap-dev] geofabrik
>
> On 28/09/2012 12:18, RheinSkipper wrote:
>> They changed the folder name after the license change:
>> http://download.geofabrik.de/openstreetmap/
>
> Great. Thank you. Francois
>
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
>
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev 