logo separator

[mkgmap-dev] Problem with splitter r412: invalid bbox area in pbf file

From KeenOnKites keenonkites at gmx.net on Mon Oct 20 11:31:45 BST 2014 

Gerd,

I did a quick test with success:

  * using osmconvert to get *.osm file
  * removed the 'wrong' bounds tag
  * using osmconvert to convert back to *.pbf file
  * running splitter with success

I will contact geofabrik guys.... many thanks again.

Patrik

On 20.10.2014 10:28, Patrik Brunner wrote:
> Gerd,
>
> many thanks..... I think I got the point:
>
>   * splitter fails on a wrong bounds tag.... if that one would be
>     absent it would check real bounds according existing nodes.
>   * osmconvert doesn't read out that wrong tag (else it would be the
>     'wrong bounds' too) but just reports bounds according to existing
>     nodes
>
> It might be an option to have an '--override-bounds' or 
> '--ignore-bounds' argument for splitter for the future, but I 
> completely agree: the data should be fixed at the source, at geofabrik...
> ... fixing the tools isn't the right solution for this... ;-)
>
> I've learnt again something about these files, and the behaviour of 
> the different tools around them, thanks for teaching me, really 
> appreciated....
>
> Cheers Patrik
>
> On 20.10.2014 10:16, Gerd Petermann wrote:
>> Hi Patrik,
>>
>> I have checked the data from geofabrik. The invalid (?)
>> bounds tag really is in the data (also in the *.osm.bz2 file)
>>
>> I am not sure what to do with this.
>> I can change splitter to ignore invalid bounds,
>> but I think you should contact the guys at geofabrik
>> to correct the data.
>>
>> Regarding the differences in the reported min/max values:
>> osmconvert reports correct values, the values reported by splitter
>> in the line starting ""Exact map coverage is "
>> depend on the bounds tag. If (valid) bounds were found,
>> they are used, if not, splitter also reports (and uses)
>> the real min/max values found in the nodes.
>>
>> Gerd
>>
>> > Date: Sun, 19 Oct 2014 15:58:02 +0200
>> > From: keenonkites at gmx.net
>> > To: mkgmap-dev at lists.mkgmap.org.uk
>> > Subject: [mkgmap-dev] Problem with splitter r412: invalid bbox area 
>> in pbf file
>> >
>> > Gents,
>> >
>> > We run into a problem with the splitter about invalid bbox area in pbf
>> > file throwing the following error:
>> > java.lang.IllegalArgumentException: invalid bbox area in pbf file:
>> > (49.808900356292725,-179.95320081710815) to
>> > (73.79793405532837,180.00049352645874)
>> >
>> > But this is sort of strange as osmconvert tells me different values 
>> for
>> > the bbox. Additionally it has to be said that another file 
>> containing a
>> > larger area (while containing the complete dataset of the file that
>> > causes the trouble) works without troubles with the same call of
>> > splitter and the same set of precompiled sea files and so on...
>> >
>> > Any help/comments would be appreciated....
>> >
>> > More Details:
>> > ============================================================
>> > The file triggering the problem:
>> > 
>> --------------------------------------------------------------------------------------------------
>> > http://download.geofabrik.de/north-america/us/alaska-latest.osm.pbf
>> >
>> > And here the call and the output of the splitter:
>> > 
>> --------------------------------------------------------------------------------------------------
>> > java -Xmx1536M -jar
>> > 
>> /home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/tools/splitter/splitter.jar 
>>
>> > --max-threads=2
>> > 
>> --geonames-file=/home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/cities/cities15000.zip 
>>
>> > --no-trim
>> > 
>> --precomp-sea=/home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/sea 
>>
>> > --keep-complete=true --mapid=98600001 --max-nodes=800000 --output=xml
>> > 
>> --output-dir=/home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/work/Freizeitkarte_US_ALASKA 
>>
>> > 
>> /home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/work/Freizeitkarte_US_ALASKA/Freizeitkarte_US_ALASKA.osm.pbf
>> > Splitter version 412 compiled 2014-06-21T13:47:04+0100
>> > boundary-tags=use-exclude-list
>> > cache=
>> > description=
>> > 
>> geonames-file=/home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/cities/cities15000.zip
>> > keep-complete=true
>> > mapid=98600001
>> > max-areas=512
>> > max-nodes=800000
>> > max-threads=2
>> > mixed=false
>> > no-trim=true
>> > num-tiles=
>> > output=xml
>> > 
>> output-dir=/home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/work/Freizeitkarte_US_ALASKA
>> > overlap=auto
>> > polygon-desc-file=
>> > polygon-file=
>> > 
>> precomp-sea=/home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/sea
>> > problem-file=
>> > problem-report=
>> > resolution=13
>> > search-limit=200000
>> > split-file=
>> > status-freq=120
>> > stop-after=dist
>> > write-kml=
>> > Elapsed time: 0s Memory: Current 479MB (5MB used, 474MB free) Max 
>> 1365MB
>> > Time started: Sun Oct 19 15:28:09 CEST 2014
>> > Map is being split for resolution 13:
>> > - area boundaries are aligned to 0x800 map units (0.0439453125 degrees)
>> > - areas are multiples of 0x800 map units wide and high
>> > Processing
>> > 
>> /home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/work/Freizeitkarte_US_ALASKA/Freizeitkarte_US_ALASKA.osm.pbf
>> > Bounding box -179.9532 49.8089 180.00050000000002 73.79794000000001
>> > java.lang.IllegalArgumentException: invalid bbox area in pbf file:
>> > (49.808900356292725,-179.95320081710815) to
>> > (73.79793405532837,180.00049352645874)
>> > at
>> > uk.me.parabola.splitter.BinaryMapParser.parse(BinaryMapParser.java:233)
>> > at crosby.binary.BinaryParser.handleBlock(Unknown Source)
>> > at crosby.binary.file.FileBlock.process(Unknown Source)
>> > at crosby.binary.file.BlockInputStream.process(Unknown Source)
>> > at uk.me.parabola.splitter.Main.processOSMFiles(Main.java:1380)
>> > at uk.me.parabola.splitter.Main.processMap(Main.java:878)
>> > at uk.me.parabola.splitter.Main.calculateAreas(Main.java:574)
>> > at uk.me.parabola.splitter.Main.split(Main.java:252)
>> > at uk.me.parabola.splitter.Main.start(Main.java:181)
>> > at uk.me.parabola.splitter.Main.main(Main.java:151)
>> > uk.me.parabola.splitter.SplitFailedException: ERROR: file
>> > 
>> /home/pab/develop/fzk-mde-garmin/Freizeitkarte-Entwicklung/work/Freizeitkarte_US_ALASKA/Freizeitkarte_US_ALASKA.osm.pbf 
>>
>> > contains unexpected data
>> > at uk.me.parabola.splitter.Main.processOSMFiles(Main.java:1402)
>> > at uk.me.parabola.splitter.Main.processMap(Main.java:878)
>> > at uk.me.parabola.splitter.Main.calculateAreas(Main.java:574)
>> > at uk.me.parabola.splitter.Main.split(Main.java:252)
>> > at uk.me.parabola.splitter.Main.start(Main.java:181)
>> > at uk.me.parabola.splitter.Main.main(Main.java:151)
>> >
>> > osmconvert output containing the statistics about the file
>> > 
>> --------------------------------------------------------------------------------------------------
>> > tools/osmconvert/linux/osmconvert32
>> > work/Freizeitkarte_US_ALASKA/Freizeitkarte_US_ALASKA.osm.pbf
>> > --out-statistics
>> > timestamp min: 2007-06-05T03:23:59Z
>> > timestamp max: 2014-10-18T11:48:05Z
>> > lon min: -180.0000000
>> > lon max: -122.5122521
>> > lat min: 48.6234931
>> > lat max: 71.6048217
>> > nodes: 4028420
>> > ways: 171349
>> > relations: 1803
>> > node id min: 27207079
>> > node id max: 3136662460
>> > way id min: 4708608
>> > way id max: 308379297
>> > relation id min: 13971
>> > relation id max: 4116925
>> > keyval pairs max: 302
>> > keyval pairs max object: relation 60189
>> > noderefs max: 2000
>> > noderefs max object: way 42394334
>> > relrefs max: 739
>> > relrefs max object: relation 3337277
>> >
>> > File not causing any troubles (us-pacific, superset of ALASKA):
>> > 
>> --------------------------------------------------------------------------------------------------
>> > http://download.geofabrik.de/north-america/us-pacific.html
>> >
>> > splitter 'bounds' running against us-pacific file: part of the output
>> > 
>> --------------------------------------------------------------------------------------------------
>> > ...
>> > Exact map coverage is (15.920970439910889,-179.99648094177246) to
>> > (72.98844337463379,-129.79979753494263)
>> > Rounded map coverage is (15.908203125,-180.0) to
>> > (72.9931640625,-129.7705078125)
>> > ...
>> >
>> > Output of the osmconvert running against us-pacific file
>> > 
>> --------------------------------------------------------------------------------------------------
>> > tools/osmconvert/linux/osmconvert32
>> > 
>> work/Freizeitkarte_US_PACIFIC/Kartendaten_Freizeitkarte_US_PACIFIC.osm.pbf 
>>
>> > --out-statistics
>> > timestamp min: 2006-12-08T15:49:14Z
>> > timestamp max: 2014-10-18T18:10:31Z
>> > lon min: -180.0000000
>> > lon max: -122.5122521
>> > lat min: 15.5631200
>> > lat max: 71.6048217
>> > nodes: 4906880
>> > ways: 233739
>> > relations: 2417
>> > node id min: 21442033
>> > node id max: 3136662460
>> > way id min: 4045672
>> > way id max: 308379297
>> > relation id min: 13971
>> > relation id max: 4116925
>> > keyval pairs max: 302
>> > keyval pairs max object: relation 60189
>> > noderefs max: 2000
>> > noderefs max object: way 42394334
>> > relrefs max: 739
>> > relrefs max object: relation 3337277
>> >
>> >
>> > Many thanks already in advance...
>> > Patrik
>> > _______________________________________________
>> > mkgmap-dev mailing list
>> > mkgmap-dev at lists.mkgmap.org.uk
>> > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
>>
>>
>> _______________________________________________
>> mkgmap-dev mailing list
>> mkgmap-dev at lists.mkgmap.org.uk
>> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
>
>
>
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20141020/ce5bb307/attachment.html>

More information about the mkgmap-dev mailing list