[mkgmap-dev] splitter r279

Sun Jan 13 09:50:21 GMT 2013

Hi Minko,

1400m heap is probably not enough for the keep-complete algorithm. 
The OOME happened just before the program reached the most critical point, so maybe only 50kb are missing.

You may try o5m input, it will probably consume less memory and is much faster anyway.
If that doesn't help you can use --keep-complete=false or a smaller input file. 
The max-areas parameter does not have an influence on this part of the program, and I see no easy way to change that.

If that doesn't help:
Please add 
-XX:+HeapDumpOnOutOfMemoryError -XX:+PrintGCTimeStamps -XX:+PrintGCDetails to your JVM options to produce a log of the GC.
Add also 
> splitter.log 
so that you can look at the sysout of splitter.
Send me the logs and the *.

Gerd

> Date: Sun, 13 Jan 2013 10:27:55 +0100
> From: ligfietser at online.nl
> To: mkgmap-dev at lists.mkgmap.org.uk
> Subject: Re: [mkgmap-dev] splitter r279
> 
> I have tried to split a large part of Western Europe (6 Gb) on a modest laptop (Win32, java -Xmx1400m) and after several hours the splitting process is stopped: 
> 
> Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
> 	at uk.me.parabola.splitter.MultiTileProcessor.endMap(MultiTileProcessor.java:247)
> 	at uk.me.parabola.splitter.Main.processMap(Main.java:817)
> 	at uk.me.parabola.splitter.Main.writeAreas(Main.java:705)
> 	at uk.me.parabola.splitter.Main.split(Main.java:250)
> 	at uk.me.parabola.splitter.Main.start(Main.java:156)
> 	at uk.me.parabola.splitter.Main.main(Main.java:145)
> 
> I couldnt see when it happened, I guess it was after the splitting process has done several sections (8/8).
> There wasn't any osm.pbf file produced, only densities-out.txt, areas.list and areas.poly.
> 
> java -Xmx1400m -jar %SPLITTER% --output-dir=splitter --polygon-file=w-eu2.poly --keep-complete --overlap=0 --max-areas=100 --mapid=97810001 --max-nodes=1400000 --write-kml=%areas%.kml --output=pbf --geonames-file=cities5000.txt --description=OFM_EU w-eu.osm.pbf 2>log.txt
> 
> The w-eu.osm.pbf extract is a combined file with osm data (Benelux, Germany, Switzerland, France, Northern  Italy and Northern Spain) and contour lines.
>   
> I had no problems with a Germany extract or another Europe extract (the input files were .05m format though, will this consume less memory?). I could try to split the extract in 05m instead of osm.pbf. What other options can I try, higher than 1400m is no option, java wouldnt run. Or a lower value of max-areas?
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> http://lists.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20130113/3cebb420/attachment.html 