Delete the repo cache to clean a repository

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

InstalledPackages: Drop dead code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Extend Python bindings to use libpakfire for dependency resolution

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Fix wrong function call

The function was renamed to make clearer what it actually does

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

_pakfire: Implement Package based on libpakfire

This wraps around libpakfire and enables Python to
get access to packages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

_pakfire: Use repository management code from libpakfire

This is very much WIP but now uses the new pakfire library
to manage repositories in memory.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

_pakfire: Import Archive class

This can be used to read a package archive and extract
files from it.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Cleanup any clashes in include protectors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rewrite _pakfire.Pool based on libpakfire

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Import libpakfire

libpakfire is a C implementation of some functionality
of pakfire. It is supposed to make code cleaner and avoid
too much wrapping in python. It is also intended to make
the code faster where ever performance is critical.

This patch adds a dependency to libarchive which is used
to read and write packages.

This implementation is not fully finished and possibly
rough around the edges. It has to be integrated into
the existing Python code and redundant code will have to
be dropped.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Automatically initialize any locally configured repositories

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

PakfireContext: Add shortcut to repos

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove outdated TODO list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Add option for client code to skip mirrors

In case any higher-level code is not satisfied with
a download (checksum doesn't match, data too old),
it can decide to skip the current mirror and the next
best one is chosen.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Download to a temporary file

This patch makes the HTTP client download data
into memory first and writes it to a temporary
file after 10M of data was downloaded.

This makes downloads faster and reduces IO load
but does not give us any limitation in case bigger
files are downloaded.

We get rid of some file locking which is always
difficult to entertain.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move remove() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move downgrade() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move update() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move reinstall() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move install() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Remove unused builder attribute

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Drop unnecessary repo_list

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move provides() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop groulist command

This does not have much use and is therefore
not supported any longer

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop groupinstall command

This was just a shortcut and I have personally never
used that and there is probably only little use for it.

Hence this patch drops it.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move check() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Move search() to PakfireContext

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Add PakfireContext

To make initializing Pakfire easier, this patch introduces
PakfireContext. So writing code like

  with Pakfire() as p:
      p.some_action()

will automatically take care of initializing Pakfire and
cleaning up afterwards.

Actions that do not require initialization will remain
in Pakfire so that they can be accessed as

  p = Pakfire()
  p.some_other_action()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ui: Format bytes with proper whitespace and decimal points

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Reset only when necessary

This is when an error occoured and it will also
remove any partially downloaded content.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Fix dist command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Replace old downloader code with new one

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Truncate the downloaded file instead re-opening it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

progressbar: Only reset when progress is larger than zero

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Reset the progressbar when download restarts

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Only initialize the progress bar once

When a request fails and we move to the next mirror
we do not want to show an other progressbar.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Catch all download errors and move on to the next mirror

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Use error widget to show any download errors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

progressbar: Add widget to show any errors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Make filename argument optional

Use the basename of the URL if omitted

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Pick mirror when downloading

This avoids some unnecessary work when mirrors are added
(because mirror lists can be large) and unnecessary log
messages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Exclusively lock download files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Use buffer size value from constants

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

constants: Remove unused setting

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Use new HTTP client to make source packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Add support for mirrors

This patch add support for mirrors to the downloader. If a list
of mirrors is given, it will try to retrieve files from a mirror
and fall back to the next one on the list in case the request
was not successful.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Actually write downloaded files to the filesystem

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

system: Add host distro

The system module loads details about the host's distribution
which will be used by Pakfire if nothing else is configured.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Move architecture to Pakfire class

This used to be located in Distribution but is actually
not that closely tied with that.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

arch: Rename arch variable to name

Both don't sound right, but it makes more sense to use
arch.name than arch.arch.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

system: Move architecture-dependent things into an own module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Remove unnecessary import of system module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Drop unused function check_host_arch()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Also ignore vim read-only swap files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rename "clean all" to clean

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Rename distro-sync to sync

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Use new Pakfire context mechanism

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Turn Pakfire initialization into a context

This makes code smaller and easier to read and users
of the Pakfire class do not have to take care of any
initialization and cleanup.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Convert pakfire to new format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Remove unused PakfireClient class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Remove unused kernel_version

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: No need to reset the logger after Pakfire is deleted

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Convert pakfire-builder to new format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Drop old Config class with was replaced

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Add get_repos() to get all repository definitions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Allow fetching an entire section with get()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Drop unused ConfigDaemon class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Use correct function to read from file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Add function to read configuration from string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop unused ConfigClient class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Move support for decoding strings into HTTP client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop old transport module which is replaced by the hub module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Adopt new internal modules to implement the daemon

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Allow setting a timeout for a request

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Actually refresh data when watching builds/jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Allow watching jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Add CLI to watch a build

This will follow a build and print live status on the console

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Cleanup function hell for creating the parser

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Remove any commands that don't work any more

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Rewrite connection check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Use new client in CLI

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Rewrite function handling of handlers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Rewrite of the client that interacts with the hub

This is a rewrite of the client that interacts with the Pakfire Hub
to upload scratch builds and retrieve the status of builds and jobs.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Automatically configure client

This patch makes the HTTP client read some basic
settings from the configuration file.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

hub: Decode returned build IDs to string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Ignore VIM swap files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Use the new HTTP client to download source packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Logging is now initialised on a module level

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

hub: Remove debugging line

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Fix Python 3 syntax

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Remove old logging options and add a new debugging option

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Write a new configuration parser

This is always initialised when the new module is loaded
and things like logging use it to set themselves up.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Clean up import of version number of the module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rewrite module logging

The module now starts logging as soon as it is initialized
which makes the base classes slinker.

Logging is also only supported to syslog and not to a file
any more.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ui: Import CLI abstraction

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ui.progressbar: Rename update_increment method to increment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Don't retry on Internet Server Error

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

hub: Import a new Pakfire Hub client implementation

This is a refactored implementation of the hub client. It
is based on the new HTTP client.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Convert data argument according to method

data is a dict() with various arguments that are either
posted in the body of the request (POST) or added to the
URL (GET).

For a simple way to send requests, the HTTP client takes
care of building a correct request.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Add missing import of time module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>