location/location-database.git
2 months agoAuto-generated update
Location Database [Wed, 27 May 2020 04:11:45 +0000 (04:11 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Tue, 26 May 2020 10:13:48 +0000 (10:13 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Tue, 26 May 2020 03:57:34 +0000 (03:57 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Mon, 25 May 2020 10:56:27 +0000 (10:56 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Sat, 23 May 2020 04:20:55 +0000 (04:20 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Fri, 22 May 2020 04:21:02 +0000 (04:21 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Thu, 21 May 2020 04:21:08 +0000 (04:21 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Wed, 20 May 2020 04:22:17 +0000 (04:22 +0000)] 
Auto-generated update

2 months agocountries: Add names
Michael Tremer [Tue, 19 May 2020 17:25:05 +0000 (17:25 +0000)] 
countries: Add names

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agoAuto-generated update
Location Database [Tue, 19 May 2020 12:49:58 +0000 (12:49 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Tue, 19 May 2020 04:20:09 +0000 (04:20 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Mon, 18 May 2020 16:05:42 +0000 (16:05 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Mon, 18 May 2020 05:17:46 +0000 (05:17 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Fri, 15 May 2020 14:19:54 +0000 (14:19 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Fri, 15 May 2020 13:53:04 +0000 (13:53 +0000)] 
Auto-generated update

2 months agoAuto-generated update
Location Database [Fri, 15 May 2020 13:41:24 +0000 (13:41 +0000)] 
Auto-generated update

2 months agoother: Fix spelling of "aut-num"
Michael Tremer [Fri, 15 May 2020 13:31:51 +0000 (13:31 +0000)] 
other: Fix spelling of "aut-num"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agoAuto-generated update
Location Database [Fri, 15 May 2020 12:36:39 +0000 (12:36 +0000)] 
Auto-generated update

2 months agoFix typo in subnet mask
Michael Tremer [Fri, 15 May 2020 12:22:13 +0000 (12:22 +0000)] 
Fix typo in subnet mask

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agoA{1,2} overrides: replace "net" by "aut-num" for ASNs
Peter Müller [Fri, 15 May 2020 10:23:11 +0000 (10:23 +0000)] 
A{1,2} overrides: replace "net" by "aut-num" for ASNs

Cc: Michael Tremer <michael.tremer@ipfire.org>
Signed-off-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agooverride-other.txt: add some ASNs with faked location
Peter Müller [Fri, 15 May 2020 10:27:44 +0000 (10:27 +0000)] 
override-other.txt: add some ASNs with faked location

Signed-off-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agooverride-other.txt: drop non-routable IP networks
Peter Müller [Fri, 15 May 2020 10:27:21 +0000 (10:27 +0000)] 
override-other.txt: drop non-routable IP networks

These are now handled by the location-importer, so we do not need to
maintain an additional list here.

Signed-off-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agoDrop all existing data
Michael Tremer [Fri, 15 May 2020 09:25:20 +0000 (09:25 +0000)] 
Drop all existing data

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agoRename country-overrides -> overrides
Michael Tremer [Fri, 15 May 2020 09:24:29 +0000 (09:24 +0000)] 
Rename country-overrides -> overrides

We can basically override anything, so the name did not make
much sense any more

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 months agoDrop all code from this repository
Michael Tremer [Fri, 15 May 2020 09:23:26 +0000 (09:23 +0000)] 
Drop all code from this repository

This has been moved into libloc

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
3 months agooverride-a2.txt: rework A2 overrides
Peter Müller [Sat, 9 May 2020 16:01:08 +0000 (18:01 +0200)] 
override-a2.txt: rework A2 overrides

This patch reworks the A2 override file. Instead of setting "country"
nor "newcountry", networks of satellite internet providers are now flagged
by "is-satellite-provider: yes".

ASNs have been added again, as their usage is very helpful.

Cc: Michael Tremer <michael.tremer.ipfire.org>
Signed-off-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
3 months agooverride-a1.txt: rework A1 overrides
Peter Müller [Sat, 9 May 2020 11:58:30 +0000 (13:58 +0200)] 
override-a1.txt: rework A1 overrides

This patch reworks the A1 override file. Instead of setting "country"
nor "newcountry", networks of anonymous proxy services are now flagged
by "is-anonymous-proxy: yes".

ASNs have been added again, as their usage is very helpful.

Cc: Michael Tremer <michael.tremer.ipfire.org>
Signed-off-by: Peter Müller <peter.mueller@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
6 months agotools: Handle any error messages inlined into the response
Michael Tremer [Thu, 6 Feb 2020 16:25:42 +0000 (16:25 +0000)] 
tools: Handle any error messages inlined into the response

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
6 months agotools: Add the correct WHOIS servers to each RIR
Michael Tremer [Thu, 6 Feb 2020 16:10:18 +0000 (16:10 +0000)] 
tools: Add the correct WHOIS servers to each RIR

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
6 months agotools: Add a caching layer to WHOIS
Michael Tremer [Thu, 6 Feb 2020 16:09:55 +0000 (16:09 +0000)] 
tools: Add a caching layer to WHOIS

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
6 months agoAFRINIC: Add ASN names
Michael Tremer [Thu, 6 Feb 2020 15:28:42 +0000 (15:28 +0000)] 
AFRINIC: Add ASN names

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
6 months agotools: Fetch organization names for ASes from WHOIS
Michael Tremer [Thu, 6 Feb 2020 15:28:03 +0000 (15:28 +0000)] 
tools: Fetch organization names for ASes from WHOIS

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Fix skipping the version line
Michael Tremer [Tue, 7 Jan 2020 20:42:40 +0000 (20:42 +0000)] 
tools: Fix skipping the version line

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Attempt parsing lines without an organisation id
Michael Tremer [Tue, 7 Jan 2020 20:30:27 +0000 (20:30 +0000)] 
tools: Attempt parsing lines without an organisation id

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Drop more dead code
Michael Tremer [Tue, 7 Jan 2020 20:25:29 +0000 (20:25 +0000)] 
tools: Drop more dead code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agoAdd date of allocation to ASes and networks
Michael Tremer [Tue, 7 Jan 2020 20:23:32 +0000 (20:23 +0000)] 
Add date of allocation to ASes and networks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Remove dead code
Michael Tremer [Tue, 7 Jan 2020 18:34:57 +0000 (18:34 +0000)] 
tools: Remove dead code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: This is no longer a LACNIC parser only any more
Michael Tremer [Tue, 7 Jan 2020 18:34:39 +0000 (18:34 +0000)] 
tools: This is no longer a LACNIC parser only any more

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Do not raise exception immediately
Michael Tremer [Tue, 7 Jan 2020 18:34:10 +0000 (18:34 +0000)] 
tools: Do not raise exception immediately

Was a debugging line that was left in

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Skip everything that isn't assigned (yet)
Michael Tremer [Tue, 7 Jan 2020 17:31:21 +0000 (17:31 +0000)] 
tools: Skip everything that isn't assigned (yet)

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Skip the version line and others
Michael Tremer [Tue, 7 Jan 2020 17:29:18 +0000 (17:29 +0000)] 
tools: Skip the version line and others

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agoImport data from all RIRs in new file format
Michael Tremer [Tue, 7 Jan 2020 17:21:15 +0000 (17:21 +0000)] 
Import data from all RIRs in new file format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
7 months agotools: Mirgate to use extended format
Michael Tremer [Tue, 7 Jan 2020 17:10:31 +0000 (17:10 +0000)] 
tools: Mirgate to use extended format

This patch drops parsing the "whois" information and uses
the "new" "RIR Statistics Exchange Format":

  ftp://ftp.ripe.net/ripe/stats/RIR-Statistics-Exchange-Format.txt

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
8 months agoAdd some more country codes.
Stefan Schantl [Wed, 27 Nov 2019 08:41:55 +0000 (09:41 +0100)] 
Add some more country codes.

* Bonaire, Sint Eustatius and Saba (BQ)
* Curacao (CW)
* South Sudan (SS)
* Sint Maarten (SX)

Signed-off-by: Stefan Schantl <stefan.schantl@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
8 months agooverrides: Rename newcountry to country
Michael Tremer [Fri, 15 Nov 2019 15:44:13 +0000 (15:44 +0000)] 
overrides: Rename newcountry to country

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
8 months agooverrides: Remove all networks with an invalid subnet
Michael Tremer [Fri, 15 Nov 2019 15:35:40 +0000 (15:35 +0000)] 
overrides: Remove all networks with an invalid subnet

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
8 months agodatabase: Import custom overrides
Michael Tremer [Fri, 15 Nov 2019 15:35:18 +0000 (15:35 +0000)] 
database: Import custom overrides

Fixes: #11755
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
8 months agodatabase: Set flags when parsing A1-A3
Michael Tremer [Fri, 15 Nov 2019 15:34:26 +0000 (15:34 +0000)] 
database: Set flags when parsing A1-A3

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
9 months agoAdd countries to database
Michael Tremer [Tue, 15 Oct 2019 14:55:03 +0000 (14:55 +0000)] 
Add countries to database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
9 months agoImport
Michael Tremer [Tue, 15 Oct 2019 14:54:55 +0000 (14:54 +0000)] 
Import

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
10 months agoUpdate all RIRs
Michael Tremer [Mon, 30 Sep 2019 09:32:58 +0000 (09:32 +0000)] 
Update all RIRs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
10 months agoFix downloading databases in the default format
Michael Tremer [Sat, 28 Sep 2019 19:01:23 +0000 (19:01 +0000)] 
Fix downloading databases in the default format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
18 months agoadd networks with faked KP location
Peter Müller [Thu, 16 Aug 2018 15:12:42 +0000 (17:12 +0200)] 
add networks with faked KP location

These networks claim to be located in North Korea, but are mostly used
for VPN or other anonymisation purposes. Therefore they are added to
A1 or "others" override files.

See https://blog.trendmicro.com/trendlabs-security-intelligence/a-closer-look-at-north-koreas-internet/
for details. 57.73.224.0/19 was reassigned since then and contains
valid data now, causing it to be omitted.

The second version of this patch superseds the first
one which was broken due to bugs in the MUAs GPG implementation.

Fixes #11757.

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
18 months agoImport for import of LACNIC
Michael Tremer [Mon, 14 Jan 2019 09:33:16 +0000 (09:33 +0000)] 
Import for import of LACNIC

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
18 months agoAdd parser for LACNIC
Michael Tremer [Mon, 14 Jan 2019 09:33:03 +0000 (09:33 +0000)] 
Add parser for LACNIC

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
18 months agoMigrate to a binary-encoded database format
Michael Tremer [Mon, 14 Jan 2019 07:58:49 +0000 (07:58 +0000)] 
Migrate to a binary-encoded database format

This approach is very similar to the one that we used before, but instead of storing
IP addresses as two integers, they are encoded as a big-endian 128 bit long binary
"string".

This is then stored as the BLOB data type of sqlite which has fewer limitations in
length, can be indexed and uses memcmp() which should be at least as fast as comparing
integers.

This allows a slightly easier query and seems to me significantly faster than the
PostgreSQL approach.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
18 months agoUpdate data for AFRINIC
Michael Tremer [Mon, 14 Jan 2019 04:29:33 +0000 (04:29 +0000)] 
Update data for AFRINIC

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
18 months agoFix merging the database with SQLite
Michael Tremer [Sun, 13 Jan 2019 22:38:41 +0000 (22:38 +0000)] 
Fix merging the database with SQLite

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
19 months agoRevert "Replace sqlite with PostgreSQL"
Michael Tremer [Sun, 13 Jan 2019 15:40:06 +0000 (15:40 +0000)] 
Revert "Replace sqlite with PostgreSQL"

This reverts commit 44c781ac664bf0f6670651e0a721fe2ddc446e66.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoUpdate ARIN
Michael Tremer [Sat, 30 Jun 2018 16:37:05 +0000 (17:37 +0100)] 
Update ARIN

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoUpdate AfriNIC
Michael Tremer [Sat, 30 Jun 2018 14:08:26 +0000 (15:08 +0100)] 
Update AfriNIC

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoIgnore some blocks in the source from AfriNIC
Michael Tremer [Sat, 30 Jun 2018 14:07:43 +0000 (15:07 +0100)] 
Ignore some blocks in the source from AfriNIC

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoUpdate RIPE
Michael Tremer [Thu, 21 Jun 2018 15:11:18 +0000 (16:11 +0100)] 
Update RIPE

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoA1 overrides: add missing PureVPN networks and clean up
Peter Müller [Sat, 9 Jun 2018 10:33:56 +0000 (12:33 +0200)] 
A1 overrides: add missing PureVPN networks and clean up

GZ Systems Ltd. has some other networks which were not added to A1 overrides
by mistake. To clean up the list a little bit and make file processing faster,
some of the networks were allocated in bigger ones (>= /23).

Sorry for this large patch, but I guess it does not make much sense to add
a bunch of networks fist and then split them apart afterwards. :-|

Signed-off-by: Peter Müller
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoA1 overrides: add IAPS Security Services, L.L.C.
Peter Müller [Sat, 9 Jun 2018 08:36:57 +0000 (10:36 +0200)] 
A1 overrides: add IAPS Security Services, L.L.C.

IAPS is a VPN provider claiming its networks to be located in VA.

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoUpdate APNIC
Michael Tremer [Mon, 18 Jun 2018 09:58:59 +0000 (10:58 +0100)] 
Update APNIC

These networks now contain the correct subnet

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agotools: Actually print the correct subnet to file
Michael Tremer [Mon, 18 Jun 2018 09:58:33 +0000 (10:58 +0100)] 
tools: Actually print the correct subnet to file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agotools: Commit to database only once when importing data
Michael Tremer [Sun, 17 Jun 2018 20:27:09 +0000 (21:27 +0100)] 
tools: Commit to database only once when importing data

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoImport APNIC
Michael Tremer [Sun, 17 Jun 2018 20:26:37 +0000 (21:26 +0100)] 
Import APNIC

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoReplace sqlite with PostgreSQL
Michael Tremer [Sun, 17 Jun 2018 20:25:55 +0000 (21:25 +0100)] 
Replace sqlite with PostgreSQL

sqlite cannot match any subnets which makes it useless for us.

PostgreSQL has a data type for IP addresses which can be used
to match subnets against each other.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoSet database vendor
Michael Tremer [Sun, 17 Jun 2018 14:13:59 +0000 (15:13 +0100)] 
Set database vendor

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoadd networks to overrides-other which must not be added
Peter Müller [Sun, 18 Mar 2018 14:35:03 +0000 (15:35 +0100)] 
add networks to overrides-other which must not be added

These networks are covered for special use by some RFCs
and must not be added to the database.

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoadd A2 overrides
Peter Müller [Sun, 18 Mar 2018 14:13:33 +0000 (15:13 +0100)] 
add A2 overrides

Add override entries for A2 networks (satellite internet providers).

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoadd missing A1 overrides
Peter Müller [Sun, 18 Mar 2018 13:07:40 +0000 (14:07 +0100)] 
add missing A1 overrides

Add missing A1 overrides (mostly GZ Systems Ltd./PureVPN).

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoadd missing A1 overrides
Peter Müller [Sun, 11 Feb 2018 19:16:32 +0000 (20:16 +0100)] 
add missing A1 overrides

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoUse the organisation's name as AS name
Michael Tremer [Wed, 31 Jan 2018 00:43:01 +0000 (00:43 +0000)] 
Use the organisation's name as AS name

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoImport data from AFRINIC, APNIC, ARIN & RIPE
Michael Tremer [Tue, 30 Jan 2018 16:47:31 +0000 (16:47 +0000)] 
Import data from AFRINIC, APNIC, ARIN & RIPE

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoAdd script to export data into a location database
Michael Tremer [Tue, 30 Jan 2018 16:44:56 +0000 (16:44 +0000)] 
Add script to export data into a location database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoutil: Remove any inline comments
Michael Tremer [Tue, 30 Jan 2018 16:44:25 +0000 (16:44 +0000)] 
util: Remove any inline comments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoSkip any mntner: blocks
Michael Tremer [Tue, 30 Jan 2018 15:49:53 +0000 (15:49 +0000)] 
Skip any mntner: blocks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoEnsure that country codes are uppercase and fix some bugs in the ARIN database
Michael Tremer [Tue, 30 Jan 2018 15:47:54 +0000 (15:47 +0000)] 
Ensure that country codes are uppercase and fix some bugs in the ARIN database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoSkip any blocks where IP addresses could not be parsed
Michael Tremer [Tue, 30 Jan 2018 15:47:33 +0000 (15:47 +0000)] 
Skip any blocks where IP addresses could not be parsed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoutil: In the RIPE database, % is a comment, too
Michael Tremer [Tue, 30 Jan 2018 15:17:12 +0000 (15:17 +0000)] 
util: In the RIPE database, % is a comment, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoMove some commonly used functions to util submodule
Michael Tremer [Tue, 30 Jan 2018 15:14:36 +0000 (15:14 +0000)] 
Move some commonly used functions to util submodule

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agotools: Move filename generation into RIR class
Michael Tremer [Tue, 30 Jan 2018 14:35:27 +0000 (14:35 +0000)] 
tools: Move filename generation into RIR class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoAdd parser to parse database formats that are in RIPE format
Michael Tremer [Tue, 30 Jan 2018 14:29:35 +0000 (14:29 +0000)] 
Add parser to parse database formats that are in RIPE format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agodownloader: Only return blocks with content in them
Michael Tremer [Tue, 30 Jan 2018 14:01:38 +0000 (14:01 +0000)] 
downloader: Only return blocks with content in them

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agodownloader: Skip commented lines
Michael Tremer [Tue, 30 Jan 2018 14:01:08 +0000 (14:01 +0000)] 
downloader: Skip commented lines

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agodownloader: Only strip right hand side of lines
Michael Tremer [Tue, 30 Jan 2018 14:00:12 +0000 (14:00 +0000)] 
downloader: Only strip right hand side of lines

This should make stripping a bit faster

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agodownloader: Seperate downloaded files into blocks and iterate over those
Michael Tremer [Mon, 29 Jan 2018 20:33:21 +0000 (20:33 +0000)] 
downloader: Seperate downloaded files into blocks and iterate over those

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoAdd downloader which decodes files downloaded from the RIRs on-the-fly
Michael Tremer [Mon, 29 Jan 2018 19:26:48 +0000 (19:26 +0000)] 
Add downloader which decodes files downloaded from the RIRs on-the-fly

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoadd override country code to A1 overrides
Peter Müller [Thu, 18 Jan 2018 14:51:20 +0000 (15:51 +0100)] 
add override country code to A1 overrides

Adding a "newcountry" flag for each AS (no IP ranges currently
listed here) in the A1 override file. This makes parsing of
several override files much easier, since we do not need to
care about file names, for example.

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoA1 overrides: Sort them by ASN
Peter Müller [Tue, 16 Jan 2018 19:30:18 +0000 (20:30 +0100)] 
A1 overrides: Sort them by ASN

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoA1 override: add AS396507 (Emerald Onion)
Peter Müller [Tue, 19 Dec 2017 15:33:06 +0000 (16:33 +0100)] 
A1 override: add AS396507 (Emerald Onion)

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoA1 override: add AS51852 (Private Layer INC)
Peter Müller [Tue, 19 Dec 2017 15:30:36 +0000 (16:30 +0100)] 
A1 override: add AS51852 (Private Layer INC)

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoA1 override: add AS10914 (Cypherpunk Privacy Network)
Peter Müller [Tue, 19 Dec 2017 15:28:29 +0000 (16:28 +0100)] 
A1 override: add AS10914 (Cypherpunk Privacy Network)

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agoA1 override: add AS37560 (Cyberdyne S.A.)
Peter Müller [Tue, 19 Dec 2017 15:25:46 +0000 (16:25 +0100)] 
A1 override: add AS37560 (Cyberdyne S.A.)

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
2 years agocountry override files: inital checkin
Peter Müller [Tue, 19 Dec 2017 15:16:32 +0000 (16:16 +0100)] 
country override files: inital checkin

Initially create manual override files for country data.

Signed-off-by: Peter Müller <peter.mueller@link38.eu>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>