builds: Commit forgotten bug templates

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Use the more efficient version comparison function

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Close connections sooner

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Move database operations into the main thread

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Replace more occurences of the UUID type

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Move all sorts of database operations into the main thread

We no longer support any database operations from any other thread than
the main thread (because otherwise we cannot figure out which Task we
are running in).

For that reason, we have to split a couple of tasks off at different
times and send blocking operations to an executor thread later.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: psycopg3 is returning UUIDs as UUID type instead of string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

release monitoring: Fix cleaning up the repository if none was created

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Replace the old database model with a connection pool

This patch introduces a connection pool to the database. When a function
is executing a query, a connection will be handed to the (asyncio) Task
and remains with that task until its end.

That way, multiple concurrent tasks (even when they are running in the
same thread) will have an exclusive connection to the database which
will avoid that we overwrite and commit transactions of other tasks.

Additionally, transactions can now be nested as psycopg's transactions
are more advanced than the previous Transaction class.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Move temporary tables into CTEs

It was a nice idea, but if we want to pool connections, we will only
create the temporary tables on one connection with the others losing
out.

An alternative could have been to create all tables on all connections
first, but I suppose that is going to create a lot of unnecessary
overhead for short-lived connections.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: jobs: Add HTTP status code to exception

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Remove aliases for common exceptions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

database: Migrate to psycopg3

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Show better tags

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

CSS: Don't use our custom red as it clashes with the primary colour

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Fix rendering page when source has never been fetched

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Create dist jobs for all packages on the initial commit import

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Store empty strings if summary/description are empty

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: Sync schema

I don't quite know why the diff is so large when there have been only a
few fields changed...

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Catch the correct exception on disconnect

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Avoid removing the tmp directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Actually filter the latest release

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Implement controls to publish

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: "Publish" instead of "Release"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Link to releases

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Implement controls to delete a release

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

events: Add releases

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Add controls to create and edit releases

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

release: Drop reference to repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

releases: Change prerelease to stable

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

distros: Add scaffolding for releases

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Add detail page for commits

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Add any watchers from commits to builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Refactor Commit class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Fix wrong table name in SQL query

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Text: Implement showing pre-formatted text

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Drop unused source modules

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Remove old state column

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Run jobs only once

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

sources: Run jobs after fetching commits

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Move test builds view into code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Fix deleting user repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Remove all builds before deletion

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Refactor search

This patch drops the materialized view as it becomes painfully slow to
update. Instead we store the search data as an auto-generated row and
put a GIN index over it.

This should be sufficiently fast even with a large number of packages in
the database.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Fix search for filenames

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Add binary packages to the disk usage

This patch also creates an index to search through all scratch builds
quicker.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Move disk usage view into the code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Move estimated build time view into code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

index: Remove log stream

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

release monitoring: Show the follow strategy

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

release monitoring: Implement following the current branch

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

release monitoring: Implement build check

This is so that we won't import any releases that are older than what we
already know.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

release monitoring: Implement following stable releases and the latest

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Use misc.group() to group packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Fix rendering page when there are no scratch builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Show scratch builds for packages and enhance search

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

web: Build function to easily compose URLs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Move name page into its own directory

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Show status on detail page

Since we are polling the API now, we may as well show the status

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Add controls to manually start/stop builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Drop sync with AWS

This does nothing apart from logging things.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

keys: Drop download handler

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

keys: Require comments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

keys: Add comments

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

keys: Refactor with new Ed25519 keys

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Refactor deleting UI

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Replace asyncio.gather() with task groups

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Refactor SQL statements

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Replace asyncio.gather() with task groups

This is easier to write/read and we can run multiple actions
concurrently.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

monitorings: Update bug report after the build has finished

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

monitoring: Reference build in bug report

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

monitoring: Implement creating builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Always try to dispatch after installcheck

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix launching retried jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

events: Add Creating/Deleting builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Refactor deleteing builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Refactor creating new builders

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: rmtree: Ignore if path didn't exist

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Build controls to delete a repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Show status on detail page

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builders: Add maintenance mode

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Implement deleting repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

backend: Drop a couple of unneeded imports

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

misc: Make all slugs lowercase

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builds: Make launching jobs more efficient

There is a (although very unlikely) chance that we have multiple builds
with jobs from the same repository which should all be launched
together.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Don't list deleted builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Show log button when build is running (again)

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Show status as "queued"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Run dispatch less often and smarter

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

db: PostgreSQL like to shuffle tables around it seems

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Rename dependency check to installcheck

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Return pending jobs as generator

There could be a large number which does not need to waste too much
memory.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Refactor installcheck

This is now being performed more efficiently by only initializing
Pakfire once per architecture.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Hide package names for packages which don't have any builds

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repos: Implement relaunching jobs in sibling repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Improve performance of finding reverse requires

This won't be performed when the job has no packages and we won't run
the search query if there are no matches found.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Launch Pakfire as native arch on "noarch"

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

jobs: Fix using the depcheck ratelimiter

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

users: Fix fetching user repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

repositories: Make updates smarter

Repositories won't be (re-)written more than once at a time. Instead we
will mark that another update was requested and execute it as soon as
the first one finished.

That way, multiple updates will only cause the repository to be
rewritten twice.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>