export: Improve the slightly broken header in DNS zones

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Update translation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Build for Ubuntu 25.10, but no longer for 24.10

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Write more metadata into the zone apex

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Allow passing nameservers for a zone

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Write a SOA for all DNS zones

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Write the everything zone

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Support exporting a zone with the network prefixes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Support exporting a zone with country codes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

exporter: Call the correct functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Add new translation strings

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

exporter: Implement exporting AS names over DNS

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Refactor writing zones

We have too many different types to make this super plain.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Give the origin zone the correct name

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

export: Support exporting a zone with all bogons

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

network: Refactor composing the reverse pointer

The previous versions had a lot of memory leaks because of the repeated
use of asprintf and appended a trailing dot if there was not suffix
given.

This version allocates the buffer only once and only appends a dot if
there is a suffix.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

location: Add a command to export the database as a DNS zone file

This is experimental and only supports the "ASN" format for now.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: network: Add a new property "subnets" to fetch any subnets

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Import the POT file and create a target to update it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

importer: Accept ASNs larger than PostgreSQL's integer

We seem to be importing some garbage here which makes the temporary
table overflow. Therefore we are increase the maximum size of the ASN
field to be able to render the database.

Any invalid data is being filtered out regardless.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

importer: Fix SyntaxWarning about regular expressions

/usr/bin/location-importer:1654: SyntaxWarning: invalid escape sequence '\s'
  route = re.compile(b"^\s(.+?)\s+.+?\[(?:AS(.*?))?.\]$")
/usr/bin/location-importer:1724: SyntaxWarning: invalid escape sequence '\s'
  m = re.match(b"\s+BGP\.as_path:.* (\d+) {\d+}$", line)

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Explicitely install gettext/autopoint

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Fix backtracking after no match was found at the end of the tree

This is a rare bug which only appears if the tree has not been 100%
optimised which might happen because it would not be worth the effort to
remove all dead ends all of the time.

Therefore, we could be reaching a node which is not an actual leaf but
still not find our network. In that case, we will have to go backwards
slightly to check if there has been a less specific match (but a match
nonetheless).

This was broken in commit 9e72b8a0c56403ca7d23c6a767d66038e0d63c14 when
the return code for no match was changed to zero.

Fixes: #13861 - libloc-0.9.18 fails to find some ASN info
Reported-by: Adolf Belka <adolf.belka@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Cleanup the switch statement

No functional changes.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Explicitely configure Gettext

From version 0.25, Gettext will complain about not calling autopoint to
set up all required macros requied by autoconf later on.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Makefile: Automatically add all tools/ to POTFILE.in

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Fedora no longer seems to install awk by default

This is needed to run the configure script.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Ensure loc_database_lookup finds a match

Commit 9e72b8a modified the lookup function to return 0 even if no
matches are found. As result, the test case could pass even if the
database lookup did not find any matches.

This commit restores the original intent of the test case, by adding
a failure condition when `network1` is NULL. This is similar to how
the subsequent test case was modified for the inverse condition.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Revert "jenkins: Build Debian packages for riscv64, too"

This reverts commit 92bfc43af92eb19a5ed95ff04f2a71e56087a75b.

Well, this did not last very long...

+ apt-get install -y apt-utils build-essential crossbuild-essential-riscv64 devscripts qemu-user-static
Reading package lists...
Building dependency tree...
Reading state information...
E: Unable to locate package crossbuild-essential-riscv64
script returned exit code 100

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Build Debian packages for riscv64, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Fix passing custom LDFLAGS

Fixes: #13829 - Overlinking Lua and Python bindings
Reported-by: Petr Pisar <ppisar@redhat.com>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Fix indentation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

debian: Update libloc1.symbols for version 0.9.18

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Okay, drop Alma Linux again

This thing just seems to be too ancient and does not have packages for
Lua. Instead of creating too many if/else blocks to cover this, let's
remove it again. As far as I am aware, we don't have any known users on
this distribution.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Alma Linux does not seem to understand Code Ready

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Fix installing development tools on Alma Linux

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Try building for Alma Linux 9

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Build for s390x again

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

address: Fix endianess problem when fetching octets in IPv4 addresses

Fixes: #13828
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Publish Debian packages for all supported architectures

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Bump version to 0.9.18

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Remove broken architectures for now

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Correctly check return value of dup()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

network: Remove dead assignment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix string formatting issues on 32 bit systems

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

debian: Package Lua files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

debian: Update filelists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

debian: Build against Lua again

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

debian: Don't build man pages

This is not great, but I currently don't have any better option.
Installing asciidoc conflicts with python3-all-dev when cross-compiling.
Since asciidoc is optional and Python isn't this at least generates a
package at the end.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Fix unintended fallthrough

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

python: Fix type for keyword lists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Fix syntax to install perl(Test::More)

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

lua: Perform formatting string sanitization

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tree: Replace bitfields with flags to mark deleted nodes

clang does not seem to like these much.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

log: Perform formatting string sanitation when logging to stderr

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Install perl(Test::More) on Fedora

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Constify path to open in database test

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

address: Never pass zero to __builtin_ctz

This is undefined behaviour which worked just fine in GCC, but in clang
the code is doing funny business.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Enable more compiler warnings

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix all sorts of string formatting issues

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: Make bit length mismatch message clearer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Upload logs from tests in src/, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tree: Try harder to merge networks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tree: Add network to the stack after we have tried again

If we add it before, we will try to merge the network with itself which
is not necessary as it will never result in anything good.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Make Lua check work on Fedora, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Install lua-unit wherever available

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Don't run Lua tests if luaunit is not available

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

debian: Don't build packages against Lua

This is a little bit more complicated, because we probably want to build
against multiple versions and I don't know how to do this.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Actually install Lua when we want to build against it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Add all supported Debian architectures

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Fail if Lua was enabled, but not found

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Remove extra tests we currently don't support

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Don't expect any tests to fail

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Always Lua extension, too

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Check syntax of Lua check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Don't automatically detect systemdunitdir

This is no longer possible on newer versions of systemd where the
variable has been removed from pkg-config.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jenkins: Initial import

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

data: Import today's database

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

po: Update POTFILES.in

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

perl: Return nothing in case invalid data has been passed to libloc

The old croach approch instantly will stop the script if invalid data
will be passed to libloc and also will fail to proper execute the
testsuite.

Signed-off-by: Stefan Schantl <stefan.schantl@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

importer: Don't import /4 or /10 networks from the routing table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

importer: Ignore any sudden disconnects when we fetch a Geofeed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

importer: Update a few AWS locations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

perl: Fix a couple of NULL-pointer derefences in the module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libloc: Refactor summarizing IP address ranges

The algorithm seems to have had some bugs where it generated too many
unnecessary subnets which caused the system to run out of memory very
quickly when determining bogons.

This version of the algorithm is now a little bit smarter and should be
significantly faster as well.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

tests: lua: Set a variable to true if we are checking for a boolean later

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

lua: Ensure that the testsuite is being executed with the correct version

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

lua: Check if we got returned something on some tests

Since Lua does not know about exceptions, functions usually return nil
instead of some value.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

importer: Ensure that we set timestamps in the announcements table

Otherwise aging out older announcements does not work.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

lua: Fix raising an exception if no network was found

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Have the lookup function return 0 even if nothing was found

This is a potentially breaking change, but I think we need to do this as
the previous return code was not very descriptive.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

lua: Implement setting a log callback function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

libloc: Allow passing a pointer to the log callback

This is basically re-implemnting the logic to pass log settings as the
previous functions were inappropriately named.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Revert "database: Re-open the file handle in r+ mode"

This reverts commit 7654a5beb9b46758af613f15e01f8e0d0b3bd730.

This change breaks the library on Linux.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

lua: Initialize the database object pointer

Unfortunately Lua does not initialize any new user data. Therefore it
could happen that the cleanup function will try to tidy up after a new
Database object could not be set up correctly and cause a segmentation
fault.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

configure: Scan for multiple Lua versions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Re-open the file handle in r+ mode

On Mac OS, we cannot re-read our temporary file from the testsuite unless we re-open in r+ mode.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

writer: Move the cursor back to end when finished writing

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

writer: Fail if the header could not be written successfully

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Makefile: Don't try to use -export-symbols if --version-script= isn't available

libtool seems to mess up our symbol table by prepending an underscore character
to all lines which renders the file unparsable.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>