users: Read the VAPID keys from the configuration file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build groups: Fix rendering macro

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Relax relationship between test groups

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix the empty state of the job queue

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix rendering the job index page

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Show a message if the queue is empty

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix rendering the queue

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix queries that generate the queue

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Drop message

This was an unused concept.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Use joined loading a little bit more often

Since we have so many objects that have so many very close relationships
between each other, we can have lots of roundtrips to the database when
we fetch them all individually in an extra query.

The joined loads will however increase the size of the result by quite a
siginificant amount of data when applied to 1:N relationships with
larger Ns. It is pretty much free in a 1:1 relationship.

Therefore this commit changes that we fetch lots of stuff in one go so
we don't have as many roundtrips to the database. It will however result
in larger queries and potentially a little bit more bandwidth usage.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix running the installcheck

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix storing the result of the installcheck

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Add helper function to find the least busy builders

This works out a little bit easier than fetching the job queue for each
individual builder.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Correctly wrap transactions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Add filter to show the name of an ASN

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Add handler that disables authentication

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Fix rendering the mirror list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Asynchronously create jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Let failed default to False

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix wrong argument name for groups

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Correctly open a transaction

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds+jobs: Generate a random UUID

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Properly await write_error()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Fix deleting a repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Fix editinig repos

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Make them sortable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Go back to statically set current_user

This changes it so that we will always try to log in the user. That way,
we don't have to always call the get_current_user() function which makes
the code rather messy.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Don't show an empty mirrorlist

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Use os.path to compose URLs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Fix creating custom repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Refactor iterating over repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Drop loading the unused tempfile module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Create CTEs to easily fetch all packages and builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

keys: Correct the type of the key_id field

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Make the package mapping table accessible from other modules

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Allow listing repos without build membership

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Fix rendering page

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Fix showing total builds/build time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Fix cleanup

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sessions: Rename valid_until into expires_at

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Re-enable the periodic cleanup job

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ratelimiter: Fix cleanup

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sessions: Fix cleanup

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Fix rendering page and fetch builds manually

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Add property to disable test builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Add a relationship to commits

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Don't import everything from handlers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Remove any old UI methods

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Drop importing the removed ui_modules module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix accessing uploads

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Fix deletion

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Fix deletion

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Don't fetch all builds all of the time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Fix sending errors for API requests

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Refactor importing filelists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Create tag as a generated column

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Refactor dispatching jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fetch the builder again on message

This is necessary because this will be launched in a new task. Since we
cannot use the object from a different session, we have to fetch the
builder again.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix logging stats

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix connecting to the controller

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Implement fetching uploads

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Remove the unused ReleasesList module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Add missing shorter argument to BuildList

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

bulma: Upgrade to Bulma 0.9.4

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

events: Don't link to deleted items

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix creating/deleting builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Remove unused declarations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Remove extra attributes that were used by the testsuite

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Create a handler that can only be called by admins

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix starting/stopping builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix editing builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Make the modal template fit for Jinja

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix current user permission check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Replace authentication decorate with our custom version

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix name of edit handler

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix showing running jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix showing the total build time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: The hostname has been renamed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

events: Repositories have been renamed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Fail if template variables are not defined

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Always set the XSRF token in the environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Release the strong relationship to releases

We don't want to fetch all releases every time we access the
distribution.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cache: Remove unused Redis cache

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Limit viewing/downloading of files

This is all going into a single bucket so that we don't have a rate
limiter per path.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ratelimiter: Allow passing arbitrary arguments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ratelimiter: Reimplement using the PostgreSQL database

Redis does not seem the right choice for this. We can have a fast,
unlogged database table for any of this data and we can drop the entire
depdency to redis.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

auth: Fix logging out

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Allow to execute raw statements

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Import any schema changes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Rename from repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Rename from distributions

I don't want to typo so many letters...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

images: Split them off into their own module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Split them off into their own file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Migrate to an even more async design

This monster commit replaces our database engine by SQLAlchemy so that
we can utilise eager loading and don't have to implement this on our
own. Although Jinja is a lot more flexible and allows us to
asynchronically fetch any data, we cannot really have async properties.
Therefore it is a good idea to have some eager loading happening when we
fetch certain objects that will always depend on some other objects.

This has been a major rewrite of the backend which still isn't done, but
I needed to commit this somehow. There was little point it doing it
gradually so here is this mountain of a commit. Enjoy.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Load krb5 and sync settings from config

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

AWS: Read configuration from file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Implement translation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Load some useful Jinja extensions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Convert login page to Jinja

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Set globals to avoid a namespace that is too large

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>