[mkgmap-dev] failure of splitter on parcel data

Wed Nov 23 01:10:27 GMT 2011

I have a file that is the result of translated a shapefile of parcel
boundaries obtained from MassGIS using a modified polyshp2osm.  The file
is in .osm format and has several thousand closed ways, each with a
bunch of tags, boundary=parcel and some metadata from the shapefile.
Long ago I used to just mix this in to a cloudmade massachusetts
extract, split, and then compile with mkgmap.  My mkgmap style file has
an extra rule to map boundary=parcel to a minor depth contour, so I get
think blue lines for the parcel boundaries.

At some point, splitter started having trouble with this file.  I tried
again, with just "stow-lots.osm", and got the following, with splitter
just sitting there consuming CPU.

I can provide the file to anyone who wants to debug this, but I'm
guessing the backtrace might be enough to spot the issue.

  Thanks,
  Greg

----------------------------------------
cache=
description=
geonames-file=
legacy-mode=false
mapid=63240001
max-areas=255
max-nodes=1000000
max-threads=8 (auto)
mixed=false
no-trim=false
output=pbf
output-dir=
overlap=2000
resolution=13
split-file=
status-freq=120
write-kml=
Elapsed time: 0s   Memory: Current 81MB (2MB used, 79MB free) Max 3055MB
Time started: Tue Nov 22 19:31:23 EST 2011
Map is being split for resolution 13:
 - area boundaries are aligned to 0x800 map units
 - areas are multiples of 0x1000 map units wide and high
Processing stow-lots.osm
in 1 file
Time: Tue Nov 22 19:31:23 EST 2011
Exact map coverage is (42.39023208618164,-71.55908346176147) to (42.46644973754883,-71.46432638168335)
Trimmed and rounded map coverage is (42.4072265625,-71.5869140625) to (42.4951171875,-71.4990234375)
Splitting nodes into areas containing a maximum of 1,000,000 nodes each...
Area (42.4072265625,-71.5869140625) to (42.4951171875,-71.4990234375) contains 12,291 nodes. DONE!
1 areas:
Area 63240001 covers (0x1e2800,0xffcd1800) to (0x1e3800,0xffcd2800)
Writing out split osm files Tue Nov 22 19:31:23 EST 2011
Processing 1 areas in a single pass
(42.4072265625,-71.5869140625) to (42.4951171875,-71.4990234375)
Starting pass 1 of 1, processing 1 areas (63240001 to 63240001)
Making SparseMultiMap
Making SparseMultiMap
Processing stow-lots.osm
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: -3473
	at it.unimi.dsi.fastutil.longs.LongArrayList.getLong(LongArrayList.java:231)
	at it.unimi.dsi.fastutil.longs.AbstractLongList.get(AbstractLongList.java:403)
	at uk.me.parabola.splitter.SparseInt2ShortMapInline.containsKey(SparseInt2ShortMapInline.java:112)
	at uk.me.parabola.splitter.SparseInt2ShortMultiMap$Inner.put(SparseInt2ShortMultiMap.java:78)
	at uk.me.parabola.splitter.SparseInt2ShortMultiMap.put(SparseInt2ShortMultiMap.java:31)
	at uk.me.parabola.splitter.SplitProcessor.writeNode(SplitProcessor.java:209)
	at uk.me.parabola.splitter.SplitProcessor.processNode(SplitProcessor.java:118)
	at uk.me.parabola.splitter.OSMParser.endElement(OSMParser.java:243)
	at uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:57)
	at uk.me.parabola.splitter.Main.processMap(Main.java:412)
	at uk.me.parabola.splitter.Main.writeAreas(Main.java:368)
	at uk.me.parabola.splitter.Main.split(Main.java:190)
	at uk.me.parabola.splitter.Main.start(Main.java:118)
	at uk.me.parabola.splitter.Main.main(Main.java:107)
Elapsed time: 1m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
Elapsed time: 3m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
Elapsed time: 5m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
Elapsed time: 7m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
Elapsed time: 9m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
Elapsed time: 11m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
Elapsed time: 13m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
Elapsed time: 15m 59s   Memory: Current 81MB (3MB used, 78MB free) Max 3055MB
***** Full GC *****
Elapsed time: 18m 0s   Memory: Current 81MB (1MB used, 80MB free) Max 3055MB
Elapsed time: 20m 0s   Memory: Current 81MB (2MB used, 79MB free) Max 3055MB
Elapsed time: 22m 0s   Memory: Current 81MB (2MB used, 79MB free) Max 3055MB
Elapsed time: 24m 0s   Memory: Current 81MB (2MB used, 79MB free) Max 3055MB
Elapsed time: 26m 0s   Memory: Current 81MB (2MB used, 79MB free) Max 3055MB

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20111122/af468ea1/attachment.bin 