ui: Format bytes with proper whitespace and decimal points

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Reset only when necessary

This is when an error occoured and it will also
remove any partially downloaded content.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Fix dist command

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

packages: Replace old downloader code with new one

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Truncate the downloaded file instead re-opening it

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

progressbar: Only reset when progress is larger than zero

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Reset the progressbar when download restarts

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Only initialize the progress bar once

When a request fails and we move to the next mirror
we do not want to show an other progressbar.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Catch all download errors and move on to the next mirror

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Use error widget to show any download errors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

progressbar: Add widget to show any errors

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Make filename argument optional

Use the basename of the URL if omitted

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Pick mirror when downloading

This avoids some unnecessary work when mirrors are added
(because mirror lists can be large) and unnecessary log
messages.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Exclusively lock download files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Use buffer size value from constants

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

constants: Remove unused setting

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Use new HTTP client to make source packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Add support for mirrors

This patch add support for mirrors to the downloader. If a list
of mirrors is given, it will try to retrieve files from a mirror
and fall back to the next one on the list in case the request
was not successful.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Actually write downloaded files to the filesystem

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

system: Add host distro

The system module loads details about the host's distribution
which will be used by Pakfire if nothing else is configured.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Move architecture to Pakfire class

This used to be located in Distribution but is actually
not that closely tied with that.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

arch: Rename arch variable to name

Both don't sound right, but it makes more sense to use
arch.name than arch.arch.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

system: Move architecture-dependent things into an own module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Remove unnecessary import of system module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Drop unused function check_host_arch()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Also ignore vim read-only swap files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rename "clean all" to clean

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Rename distro-sync to sync

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Use new Pakfire context mechanism

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Turn Pakfire initialization into a context

This makes code smaller and easier to read and users
of the Pakfire class do not have to take care of any
initialization and cleanup.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Convert pakfire to new format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: Remove unused PakfireClient class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

builder: Remove unused kernel_version

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

base: No need to reset the logger after Pakfire is deleted

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Convert pakfire-builder to new format

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Drop old Config class with was replaced

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Add get_repos() to get all repository definitions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Allow fetching an entire section with get()

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Drop unused ConfigDaemon class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Use correct function to read from file

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Add function to read configuration from string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop unused ConfigClient class

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Move support for decoding strings into HTTP client

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Drop old transport module which is replaced by the hub module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Adopt new internal modules to implement the daemon

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Allow setting a timeout for a request

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Actually refresh data when watching builds/jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Allow watching jobs

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Add CLI to watch a build

This will follow a build and print live status on the console

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Cleanup function hell for creating the parser

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Remove any commands that don't work any more

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Rewrite connection check

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Use new client in CLI

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Rewrite function handling of handlers

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

client: Rewrite of the client that interacts with the hub

This is a rewrite of the client that interacts with the Pakfire Hub
to upload scratch builds and retrieve the status of builds and jobs.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Automatically configure client

This patch makes the HTTP client read some basic
settings from the configuration file.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

hub: Decode returned build IDs to string

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

.gitignore: Ignore VIM swap files

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

daemon: Use the new HTTP client to download source packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Logging is now initialised on a module level

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

hub: Remove debugging line

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

cli: Fix Python 3 syntax

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Remove old logging options and add a new debugging option

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

config: Write a new configuration parser

This is always initialised when the new module is loaded
and things like logging use it to set themselves up.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Clean up import of version number of the module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Rewrite module logging

The module now starts logging as soon as it is initialized
which makes the base classes slinker.

Logging is also only supported to syslog and not to a file
any more.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ui: Import CLI abstraction

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ui.progressbar: Rename update_increment method to increment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Don't retry on Internet Server Error

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

hub: Import a new Pakfire Hub client implementation

This is a refactored implementation of the hub client. It
is based on the new HTTP client.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Convert data argument according to method

data is a dict() with various arguments that are either
posted in the body of the request (POST) or added to the
URL (GET).

For a simple way to send requests, the HTTP client takes
care of building a correct request.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Add missing import of time module

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

ui.progressbar: Support python context

This patch allows us to use the progressbar inside a with
statement which makes code shorter and sweeter and we need
to take care less about the progressbar implementation where
ever we are using it.

e.g.:
p = ProgressBar()
...

with p:
do something
p.update(i)

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Allow decoding of received content

This allows to let the module decode JSON content right
away so that this doesn't have to be handled in the module
that is using the HTTP client.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Support HTTP Basic authentication

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

http: Fix wrong baseurl variable assignment

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Remove some lines of dead code

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Add a basic HTTP client

In Python3, urlgrabber is no longer available.

This patch adds a component which will replace urlgrabber
by an own custom implementation that only relies on
Python3-internal modules (i.e. urllib).

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Create UI submodule

This patch moves things like the progressbar module
and functions that format bytes into a human-readable format
into a seperate ui module.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Migrate to Python 3

This will totally not run since some dependencies are missing
(e.g. urlgrabber, gpgme).

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Performance check: Count iterations as unsigned long

Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>

Replace bogomips by fibonnacci benchmark

BogoMIPS cannot be used as an easy way to determine how fast
a system is any more since there is only dummy values available
in newer kernels.

We use a simple fibonnacci function now which is executed for
a set amount of time (defaults to one second) and count the
number of iterations performed. This is then multiplied by the
number of CPU cores.

Fibonnacci is a very simple test that relies on the integer
unit (no FPU involved) and is not depending on anything else.

This will also allow us to quantitatively determine the
difference in speed between processors.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Revert "Enable aarch64 systems to build armv7hl and armv5tel as well"

This reverts commit 3a38a9f6db09b7b54b4f3a7dad2187b7981dcb66.

Not all kernels support executing this, even if the hardware supports
it. We will need to come up with a way how to determine this at runtime.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Enable aarch64 systems to build armv7hl and armv5tel as well

Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>

Explicetly set libsolv disttype

This will define what is assumed to be "noarch"
and on Debian/Ubuntu-based systems this will default
to something else.

If MULTI_SEMANTICS is enabled in libsolv, this will
allow us to use "noarch" as independent architecture.

Signed-off-by: Arne Fitzenreiter <arne_f@ipfire.org>

Remove shipped version of debugedit

We are now shipping this as a seperate package so that
we can update it easier.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Bump version to 0.9.27

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

perl.macro: Add "perl_version"

This variable is used to store the current used perl version, which
will be used in various external perl modules to track API dependencies.

Signed-off-by: Stefan Schantl <stefan.schantl@ipfire.org>
Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Explicitely add hardening to the LDFLAGS

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Automatically update autotools for aarch64 compatibility

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

quality-agent: Remove any absolute path arguments from env interpreter

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

INSTALL: Update build instructions

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

INSTALL: The OBS service is not maintained any more

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

CFLAGS: Explicitely add RELRO and BIND_NOW options

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Update translations

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Fix execution of scriptlets in a dirty environment

The environment will be populated with a basic set of
variables and cleared from the rest.

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>

Merge branch 'master' of git://git.ipfire.org/pakfire

Explicitely add hardening flags

Add -z relro to the linker command line and -D_FORTIFY_SOURCE=2
for the preprocessor.

Always set the 64-bit mark as it is only applied when needed

Perform less parallelism

Sometimes we have trouble with latest versions of g++
that requires too much RAM so that the OOM killer kills
all the compiler processes. Hence we will start less processes
at once for now.

This may to be increased even more in the future as it
seems that g++ requires much more memory with every release.