This DB is mostly used to retrieve all the street names for a given
city. Adding an index for the full_insee field greatly improves the
query time.
Without the index:
time $(echo 'select * from fantoir where full_insee="65054";' | sqlite3 fantoir.sqlite)
real 0m2,230s
user 0m1,896s
sys 0m0,337s
With the index:
time $(echo 'select * from fantoir where full_insee=65054;' | sqlite3 fantoir.sqlite)
real 0m0,148s
user 0m0,126s
sys 0m0,024s
The fantoir label alone isn't enough to fully qualify a street name.
We need to take into account the street type and reflect it to the
final street name.
Does not even terminate after a full night worth of run (~12h).
I probably should implement some kind of progress bar to estimate the
total run duration.
Perf:
$ time target/release/fast-fantoir FANTOIR0721
real 0m0,608s
user 0m0,526s
sys 0m0,081s
$ time target/debug/fast-fantoir FANTOIR0721
real 0m11,664s
user 0m11,549s
sys 0m0,113s
I highly suspect the release build to optimize out the useless file
read, partially explaining the *MASSIVE* perf difference between the
release build and the debug one.
This gives up a baseline speed order though. We should probably be
able to stay below 1 minute to generate the DB.
Félix Baylac-Jacqué