<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>Hi all,<br><br>wouldn't it be easier to let mkgmap report those words<br>which appear in more than n (e.g. 20) roads and use that list to <br>produce a user-defined list of stop-words?<br><br>Gerd<br><br><br><div>> From: paco.tyson@free.fr<br>> Date: Sat, 14 Feb 2015 15:06:16 +0100<br>> To: mkgmap-dev@lists.mkgmap.org.uk<br>> Subject: Re: [mkgmap-dev] mixed index branch merge<br>> <br>> Hi all,<br>> <br>> In French, from the top of my head, I can think of : <br>> <br>> Rue, Ruelle, Avenue, Boulevard, Quai, Chaussée, Route, Cour, Cours, Cité, Chemin, Place, Esplanade, Passage, Allée, Carrefour, Sentier, Square, Villa.<br>> <br>> This list is without a doubt not complete but should cover more than 95% of named addresses in France.<br>> <br>> They should only be ignored from index if they're in the first place and followed by anything else.<br>> <br>> <br>> Cheers,<br>> Paco<br>> <br>> Le 14 févr. 2015 ā 08:50, Marko Mäkelä <marko.makela@iki.fi> a écrit :<br>> <br>> > On Thu, Feb 12, 2015 at 01:24:29PM +0000, Steve Ratcliffe wrote:<br>> >> So finally I will merge the mixed index branch.<br>> > <br>> > I believe that the database terminology for this is 'inverted index' or 'fulltext index'.<br>> > <br>> >> I think it would be best to selectively enable it per country along with lists of names to avoid. This would be best done by people from or familiar with the countries in question.<br>> > <br>> > In fulltext search, these are called 'stopwords'.<br>> > <br>> > It might not be necessary to do anything to for countries where street names are commonly written as a single word. Example: "Main Street" would be "Hauptstrasse" in German, "Huvudgatan" in Sweden and "Päätie" in Finnish. Only if the first part of the street name is a proper name such as a person's name, the second part could be written as a separate word, separated by a space or dash.<br>> > <br>> > That said, I guess it would still make sense to introduce some stopwords. Words that I can think of:<br>> > <br>> > Swedish: gata, gatan, gränd, gränden, stig, stigen, (stråk, stråket)<br>> > Finnish: tie, katu, polku, kuja, (raitti, taival)<br>> > German: Straße, Strasse, Weg, Allee, Chaussee<br>> > Estonian: mnt, maantee, tn, tänav, pst, puiestee<br>> > <br>> > In Estonia, it seems to be common to write the tn, mnt or pst as a separate word.<br>> > <br>> > I could be missing some stopwords in Estonian and for German-speaking countries. Also, it could be that the French loan words Allee and Chaussee are sometimes accented.<br>> > <br>> > The Finnish and Swedish words that I have put in parenthesis should be very rare, typically used for ways for non-motorized traffic. I don't think that including them would pollute the index much. You might in fact want to search for such a name when you are looking for a nice walking or cycling route (i.e., you expect there to exist some random-famous-person-name-stråket, but you do not know the random name).<br>> > <br>> > Marko<br>> > _______________________________________________<br>> > mkgmap-dev mailing list<br>> > mkgmap-dev@lists.mkgmap.org.uk<br>> > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev<br>> <br>> _______________________________________________<br>> mkgmap-dev mailing list<br>> mkgmap-dev@lists.mkgmap.org.uk<br>> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev<br></div> </div></body>
</html>