sessions: Rename valid_until into expires_at

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Re-enable the periodic cleanup job

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ratelimiter: Fix cleanup

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sessions: Fix cleanup

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Fix rendering page and fetch builds manually

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Add property to disable test builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Add a relationship to commits

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Don't import everything from handlers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Remove any old UI methods

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Drop importing the removed ui_modules module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix accessing uploads

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Fix deletion

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Fix deletion

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Don't fetch all builds all of the time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Fix sending errors for API requests

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Refactor importing filelists

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Create tag as a generated column

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Refactor dispatching jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fetch the builder again on message

This is necessary because this will be launched in a new task. Since we
cannot use the object from a different session, we have to fetch the
builder again.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix logging stats

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix connecting to the controller

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Implement fetching uploads

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Remove the unused ReleasesList module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Add missing shorter argument to BuildList

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

bulma: Upgrade to Bulma 0.9.4

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

events: Don't link to deleted items

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix creating/deleting builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Remove unused declarations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Remove extra attributes that were used by the testsuite

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Create a handler that can only be called by admins

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix starting/stopping builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix editing builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Make the modal template fit for Jinja

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix current user permission check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Replace authentication decorate with our custom version

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix name of edit handler

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix showing running jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix showing the total build time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: The hostname has been renamed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

events: Repositories have been renamed

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Fail if template variables are not defined

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Always set the XSRF token in the environment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Release the strong relationship to releases

We don't want to fetch all releases every time we access the
distribution.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cache: Remove unused Redis cache

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Limit viewing/downloading of files

This is all going into a single bucket so that we don't have a rate
limiter per path.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ratelimiter: Allow passing arbitrary arguments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ratelimiter: Reimplement using the PostgreSQL database

Redis does not seem the right choice for this. We can have a fast,
unlogged database table for any of this data and we can drop the entire
depdency to redis.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

auth: Fix logging out

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Allow to execute raw statements

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Import any schema changes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Rename from repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Rename from distributions

I don't want to typo so many letters...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

images: Split them off into their own module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Split them off into their own file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Migrate to an even more async design

This monster commit replaces our database engine by SQLAlchemy so that
we can utilise eager loading and don't have to implement this on our
own. Although Jinja is a lot more flexible and allows us to
asynchronically fetch any data, we cannot really have async properties.
Therefore it is a good idea to have some eager loading happening when we
fetch certain objects that will always depend on some other objects.

This has been a major rewrite of the backend which still isn't done, but
I needed to commit this somehow. There was little point it doing it
gradually so here is this mountain of a commit. Enjoy.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Load krb5 and sync settings from config

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

AWS: Read configuration from file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Implement translation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Load some useful Jinja extensions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Convert login page to Jinja

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Set globals to avoid a namespace that is too large

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

templates: Convert the error template to Jinja

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

templates: Convert the base template to Jinja

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Make the request handler as async as possible

This code is mainly copied from upstream and made to work with async
functions for the error handlers.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Make the new template engine async

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Replace the Tornado template engine with Jinja

We need this to support any async code in the templates.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Try to make this entire application async

We will need this so that we won't run out of database file descriptors
as psycopg3 currently can only use select() which does not support a
file descriptor to have a number over 1024.

We will also need this to scale this application better. However,
Tornado has some limitations in its template engine which is why we will
need to replace the template engine with Jinja.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

httpclient: Read proxy configuration from config file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Read base URL from configuration

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Launch Pakfire with its own context

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: jobs: Include the default backend

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Drop the POST-based stats handler

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Require authentication when uploading the payload

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Regularly ping WebSocket clients to keep connections alive

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

auth: Disable autocomplete for passwords

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cookies: Set secure attribute for all cookies

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Pakfire: Remove deprecated arguments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Update setting the cache path

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Update API

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Update API authentication

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix API authentication

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Make statistics percentage value range from 0 - 1

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Add a new stats handler

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Update API error response codes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Show if payload has been received and block sending it again

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Require SPNEGO

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Use errno codes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Log any incorrect digests

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Align response codes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Fail quickly if no payload was received

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Fix deleting uploads if no payload was received

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Do not try to send (multiline) error messages in status

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Make APIError inherit from HTTPError

This way, tornado will catch the exception and log something useful

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Send better errors for failed upload requests

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

uploads: Rewrite the whole thing

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Add decorator to require clients to do SPNEGO

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Return 0 when no quota has been used

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Create a temporary directory

As a non-privileged user, we cannot mount a ramdisk which is why we
cannot use this and need to pre-create an empty directory.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Only set priority if configured

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix quota calculation for release builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>