distros: Use my new arch colors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

images: Add modal with all checksums

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

JS: Add code for modals

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Catch non-existant files on stat()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Perform some path validation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Send the correct MIME type

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Set Etag header in HEAD response

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Ask clients to not cache the redirect

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Support HEAD requests in load balancer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Don't send any Content-Type headers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Check if the file exists at all

We should not query any mirrors for files that even we don't have
ourselves.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Don't send body in error responses

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ratelimiter: Add primary key

So that I can edit the table.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Limit for up to 100 requests per hour for downloads

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

mirrors: Add a universal download load balancer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cache: Import datetime

This is being used in the code but was not imported.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Add some basic Python built-ins

They don't need any special wrapping, so lets pass them as they come.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Add a simple listing of images

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Extend path to URL function to support mirrors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Allow assembling absolute URLs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: I will never learn this

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Add helper function to make paths relative

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Make the decision whether to mirror or not a bit more complex

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

CSS: Assign special colours for architectures

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Show release date as short as possible

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Fix publishing releases

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Fix deleting releases and their images

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Fix editing a release

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Fix creating a new release

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Fix rendering the detail page

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Fix rendering the index page

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Mirror all stable releases

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Add banner to ask to subscribe on front page

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

events: Always import the Text macro

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix adding/removing from repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix comments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Run autoscaling on startup

This is to potentially shut down any builders that should not be
running.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Abort when the build job has crashed

I think we want to collect a little bit more meta information about the
crash, but for now we at least see that something has aborted the job.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Automatically abort jobs that have timed out

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Use the @run_in_thread decorator

This allows us to write shorter code but achieve the same.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build joins: Load builds joined

I don't know why this has to be this way, but if not, it does not work.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

build groups: Fix database field names of ownership

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

decorators: Drop the lazy_property decorator

We don't need this to be settable any more, so therefore we can use the
functools.cached_property decorator that comes with the standard
distribution.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registy: Use the new cache instead of the in-memory cache

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cache: Add a simple key/value cache with expiry time

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix typo in class name

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Don't fail if we could not find a file inside an image

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Add a simple in-memory cache for indexes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Respond with the correct code when manifest was not found

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Add a tags handler

This lists all available tags

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Send proper API error if something wasn't found

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Split the combined handlers

I think this might all be slightly better to read instead of all the ifs
and elses.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Stream blobs from a separate thread

We need this to not block the main thread on really large blobs.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

decorators: Create a decorator to run something in a thread

This is just for convenience and to write less code since we are using
this pattern a lot.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Create a function to find a blob

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

registry: Build a basic read-only OCI registry

This allows us to easily run any OCI images in Docker/podman/etc. for CI
testing without engaging any external storage, etc.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

images: Build out class and add the table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix relationship to groups

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix creating test groups

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix dedicated log streaming page

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Wrap avatars in <figure>

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Put most recently finished jobs to the top

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix the watchers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Let Apache deliver the log files

This will be even more efficient than sending them in the main process.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Call the right function to create a group

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix fetching reverse requires

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix log streaming

This will now dynamically turn this on and off whenever it is needed.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Drop the old log stream module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

messages: Fix sending emails

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Move log stream frontend code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix sending emails to watchers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Send a push notification when a build is ready

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Hash builders by hostname for their stats connections

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix memory usage calculation

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Add a combined operation to flush and refresh

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Fix fetching watchers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix sending stats

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix fetching the value for enabled

It has to be a boolean.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Move stats JS into the main file

We currently cannot easily add more files in the right place, so since
there is only so little code, we just ship it all together.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Associate imported packages with the job

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Flush and refresh to read the finished timestamp

This feels like a stupid hack but this at least prevents utter mayhem
happening after this.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Turn JobPackage into a model

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Log less

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Remove some dead code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Let's try running autoscaling in the background

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Use the renamed checksum functions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Simplify the queue estimation

It is not a very exact science anyways to try to guess how long a job
will take, so we are now just counting them which should save a couple
of complex database queries when running this.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

aws: Be a little bit less verbose

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Commit to the database as soon as we have dispatched it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix finishing jobs

Obviously the database field is nullable and NULL by default.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Actually call the add_watcher() coroutine

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Ensure that we have packages when a job finishes

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Allow passing keyword arguments to background tasks

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Don't cache preceeding jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Break some dependency cycle somewhere

SQLAlchemy failed to load alljobs in Builds and I could not quite figure
out why. It seems that when both properties that form the relationship
should be fetched in a single join, nothing happens and SQLAlchemy does
not even seem to complain about it. Oh well.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Require builders to be created by someone

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Drop the settings table

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Use as many inner joins as possible

We also are very unlikely to fetch any deleted objects, so let's rather
pull in the users that have deleted something by "SELECT IN" so that the
queries will be smaller and we don't add any joins which almost never
will find anything.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

messages: Fetch messages in badges

We would have otherwise looped for forever since we cannot check in
advance whether the iterator actually has any elements, but we don't
want to connect to the mail relay if there is literally nothing to send.
So as a compromise we fetch messages in batches.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Fix fetching running jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>