[mkgmap-dev] Crash "Illegal Capacity" when converting map

Mon Dec 19 18:55:49 GMT 2016

Hi Jakob,

I can reproduce the problem. I hope I can reduce it to a few files tomorrow.

Gerd

________________________________
Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk> im Auftrag von Jakob Mühldorfer <mail at jmuehldorfer.de>
Gesendet: Montag, 19. Dezember 2016 19:05:06
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] Crash "Illegal Capacity" when converting map

Yes, sorry for the europe-latest thing, but I have a crop polygon that includes many countries and sadly I could not narrow it down.
I wondered if resolution and max nodes does not contradict a bit, thanks for letting me know it really does

Will use a lower resolution

Am 19.12.2016 um 18:58 schrieb Gerd Petermann:

Hi Jakob,

okay, that will take a while. Did not expect europe-latest as input file ;-)

BTW: Why do you use resolution=15 in combination with max-nodes=2500000? This seems to require lots of memory and CPU without much benefit.

Gerd

________________________________
Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces at lists.mkgmap.org.uk> im Auftrag von Jakob Mühldorfer <mail at jmuehldorfer.de><mailto:mail at jmuehldorfer.de>
Gesendet: Montag, 19. Dezember 2016 18:43:24
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] Crash "Illegal Capacity" when converting map

Hi Gerd,

you can find the workfolder and script here:

https://www.jmuehldorfer.de/owncloud/index.php/s/yAKF6E47Y9pyxAd

Sorry for the chaos in the options, the script was created piece by piece, they are not in logical order

You also need to add a copy of bounds.zip and sea.zip into the preload folder, I did not include that because you likely already have them on your machine

And you might need to adjust java ram settings in the script

Hope you can trigger the bug, thanks for looking into this!
Luckily one recent map converted just fine, and I don't need mkgmap again until end of January

Jakob

Am 19.12.2016 um 18:33 schrieb Gerd Petermann:

Hi Jakob,

that sound like we have a field which is not properly initiated [:(]

Please post your scripts etc., maybe I can reproduce the problem.

Gerd

________________________________
Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces at lists.mkgmap.org.uk> im Auftrag von Jakob Mühldorfer <mail at jmuehldorfer.de><mailto:mail at jmuehldorfer.de>
Gesendet: Montag, 19. Dezember 2016 18:27:30
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] Crash "Illegal Capacity" when converting map

It is not that simple

I do get an empty tile, the way you recommended, but when i manually start conversion of just that tile, it works and outputs a 3.5MB img file for this tile

It is some kind of effect where you need to convert multiple tiles at once to trigger the bug

Am 19.12.2016 um 16:31 schrieb Gerd Petermann:

Hi Jakob,

yes, send the scripts. You should be able to find the problem tile if you add option

--keep-going

to mkgmap. When it finishes you should see an empty *.img file, the corresponding input file

is probably the cause.

Gerd

________________________________
Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces at lists.mkgmap.org.uk> im Auftrag von Jakob Mühldorfer <mail at jmuehldorfer.de><mailto:mail at jmuehldorfer.de>
Gesendet: Montag, 19. Dezember 2016 16:18:48
An: Development list for mkgmap
Betreff: Re: [mkgmap-dev] Crash "Illegal Capacity" when converting map

Hi Gerd,

I am trying to reproduce it, but not getting very far

Different splitter parameters, that did nothing
Deleting 2 tiles that need to be converted, still the same, delete just one other tile, and the bug was gone.
Unfortunately I am leaving this PC over christmas and can't try much more, can I send you the folder with the script used to convert the maps maybe?

Jakob

Am 19.12.2016 um 06:41 schrieb Gerd Petermann:

Hi Jakob,

this seems to be a special case in the (OSM) data. I can probably add a check to avoid the crash

but I'd like to know what happens and I was not yet able to reproduce it.

I assume it happens only for one input file?

Please post a link to that file and maybe your style and options if needed.

Gerd

________________________________
Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces at lists.mkgmap.org.uk> im Auftrag von Jakob Mühldorfer <mail at jmuehldorfer.de><mailto:mail at jmuehldorfer.de>
Gesendet: Montag, 19. Dezember 2016 02:17:20
An: mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
Betreff: [mkgmap-dev] Crash "Illegal Capacity" when converting map

Hi,

currently I am getting a ton of crashes like this:

> java.lang.IllegalArgumentException: Illegal Capacity: -1
>     at java.util.ArrayList.<init>(ArrayList.java:156)
>     at
> uk.me.parabola.mkgmap.filters.ShapeMergeFilter.mergeLongestSequence(ShapeMergeFilter.java:363)
>     at
> uk.me.parabola.mkgmap.filters.ShapeMergeFilter.tryMerge(ShapeMergeFilter.java:226)
>     at
> uk.me.parabola.mkgmap.filters.ShapeMergeFilter.addWithConnectedHoles(ShapeMergeFilter.java:167)
>     at
> uk.me.parabola.mkgmap.filters.ShapeMergeFilter.merge(ShapeMergeFilter.java:98)
>     at
> uk.me.parabola.mkgmap.build.MapBuilder.processShapes(MapBuilder.java:1124)
>     at
> uk.me.parabola.mkgmap.build.MapBuilder.makeSubdivision(MapBuilder.java:791)
>     at
> uk.me.parabola.mkgmap.build.MapBuilder.makeMapAreas(MapBuilder.java:701)
>     at uk.me.parabola.mkgmap.build.MapBuilder.makeMap(MapBuilder.java:232)
>     at uk.me.parabola.mkgmap.main.MapMaker.makeMap(MapMaker.java:107)
>     at uk.me.parabola.mkgmap.main.MapMaker.makeMap(MapMaker.java:69)
>     at uk.me.parabola.mkgmap.main.Main$1.call(Main.java:256)
>     at uk.me.parabola.mkgmap.main.Main$1.call(Main.java:252)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>     at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>     at java.lang.Thread.run(Thread.java:745)
> Exiting - if you want to carry on regardless, use the --keep-going option

Any idea what might be wrong?

It happened in 3706 to 3730
Sometimes the exact same conversion process (splitting+mkgmap) on the
exact same OSM file works, but that is rarely the case
If you need any more information, or an upload of the style and split
tiles that cause the crash, let me know.

Hope you can help
Jakob
_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20161219/ffe551cd/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ATT00001.png
Type: image/png
Size: 506 bytes
Desc: ATT00001.png
URL: <http://www.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20161219/ffe551cd/attachment.png>