]> git.ipfire.org Git - thirdparty/libvirt.git/log
thirdparty/libvirt.git
4 months agoqemu: monitor: Add support for ThrottleGroup operations
Chun Feng Wu [Wed, 19 Feb 2025 16:57:09 +0000 (22:27 +0530)] 
qemu: monitor: Add support for ThrottleGroup operations

This change contains QMP requests for ThrottleGroup

* ThrottleGroup is updated through "qemuMonitorJSONUpdateThrottleGroup"
* ThrottleGroup is retrieved through "qemuMonitorJSONGetThrottleGroup"
* ThrottleGroup is deleted by reusing "qemuMonitorDelObject"
* ThrottleGroup is added by reusing "qemuMonitorAddObject"
* "qemuMonitorMakeThrottleGroupLimits" will be used by building qemu cmd as well

Signed-off-by: Chun Feng Wu <danielwuwy@163.com>
* change throttle group config conversions P to U allow zero.
* Apply suggested coding style changes.

Signed-off-by: Harikumar Rajkumar <harirajkumar230@gmail.com>
* Deleted all getter code.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoconfig: Introduce ThrottleFilter and corresponding XML parsing
Chun Feng Wu [Wed, 19 Feb 2025 16:57:08 +0000 (22:27 +0530)] 
config: Introduce ThrottleFilter and corresponding XML parsing

Introduce throttle filter along with corresponding operations.

* Define new struct 'virDomainThrottleFilterDef' and corresponding destructor
* Update _virDomainDiskDef to include virDomainThrottleFilterDef
* Support throttle filter "Parse" and "Format" for operations between DOM XML
  and structs. Note, this commit just contains parse/format of group name for
  throttle filter in domain_conf.c, there is other commit to handle throttle
  filter nodename parse/format between throttlefilter and diskPrivateData for
  statusxml in qemu_domain.c when processing qemuDomainDiskPrivate and
  qemuDomainDiskPrivate

Signed-off-by: Chun Feng Wu <danielwuwy@163.com>
* Error handling for null throttle group.
* Update of code documentation comments.
* Apply suggested coding style changes.

Signed-off-by: Harikumar Rajkumar <harirajkumar230@gmail.com>
* Fixed naming of virDomainThrottleFilterDefClear to ...Free
* Fixed memleak of the throttle filter definitions

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoconfig: Introduce ThrottleGroup and corresponding XML parsing
Chun Feng Wu [Wed, 19 Feb 2025 16:57:07 +0000 (22:27 +0530)] 
config: Introduce ThrottleGroup and corresponding XML parsing

Introduce throttlegroup into domain and provide corresponding methods

* Define new struct 'virDomainThrottleGroupDef' and corresponding destructor
* Add operations(Add, Update, Del, ByName, Copy, Free) for 'virDomainThrottleGroupDef'
* Update _virDomainDef to include virDomainThrottleGroupDef
* Support new resource "Parse" and "Format" for operations between struct and DOM XML
* Make sure "group_name" is defined in xml

Signed-off-by: Chun Feng Wu <danielwuwy@163.com>
* Validation check for zero throttle groups.
* Update of code documentation comments.

Signed-off-by: Harikumar Rajkumar <harirajkumar230@gmail.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoschema: Add new domain elements to support multiple throttle filters
Chun Feng Wu [Wed, 19 Feb 2025 16:57:06 +0000 (22:27 +0530)] 
schema: Add new domain elements to support multiple throttle filters

Introduce schema for defining '<throttlefilters>' element which
references throttling groups to form filter chain in qemu for specific
disk

* Add new elements '<throttlefilters>'
* <ThrottleFilters> can include multiple throttlegroup references to
  form filter chain in qemu
* Chained throttle filters feature in qemu is described at
  https://gitlab.com/qemu-project/qemu/blob/master/docs/throttle.txt

Signed-off-by: Chun Feng Wu <danielwuwy@163.com>
Signed-off-by: Harikumar Rajkumar <harirajkumar230@gmail.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoschema: Add new domain elements to support multiple throttle groups
Chun Feng Wu [Wed, 19 Feb 2025 16:57:05 +0000 (22:27 +0530)] 
schema: Add new domain elements to support multiple throttle groups

Introduce schema for defining '<throttlegroups>' element which
configures throttling groups which can be configured for multiple
disks.

* Refactor "diskIoTune" to extract common schema "iotune"
* Add new elements '<throttlegroups>'
* <ThrottleGroups> contains <ThrottleGroup> defintion, which references
  "iotune"

Signed-off-by: Chun Feng Wu <danielwuwy@163.com>
Signed-off-by: Harikumar Rajkumar <harirajkumar230@gmail.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agovirsh: Introduce new hypervisor-cpu-models command
David Judkovics [Thu, 20 Mar 2025 05:28:24 +0000 (01:28 -0400)] 
virsh: Introduce new hypervisor-cpu-models command

Add new virsh command 'hypervisor-cpu-models'.  Command pulls from the
existing domcapabilities XML and uses xpath to parse CPU model strings.
By default, only models reported as usable by the hypervisor on the
host system are printed.  User may specify "--all" to also print
models which are not supported on the host.

Signed-off-by: David Judkovics <djudkovi@linux.ibm.com>
Signed-off-by: Boris Fiuczynski <fiuczy@linux.ibm.com>
Signed-off-by: Collin Walling <walling@linux.ibm.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agohypervisor: emit systemd status & log messages while saving
Daniel P. Berrangé [Tue, 7 Jan 2025 15:25:33 +0000 (15:25 +0000)] 
hypervisor: emit systemd status & log messages while saving

Since processing running VMs on OS shutdown can take a while, it is
beneficial to send systemd status messages about the progress.

The systemd status is a point-in-time message, with no ability to
look at the history of received messages. So in the systemd status
we include the progress information. For the same reason there is
no benefit in sending failure messages, as they'll disappear as soon
as a status is sent for the subsequent VM to be processed.

The libvirt log statements can be viewed as a complete log record
so don't need progress info, but do include warnings about failures
(present from earlier commits).

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agorpc: don't let systemd shutdown daemon while saving VMs
Daniel P. Berrangé [Tue, 7 Jan 2025 15:22:14 +0000 (15:22 +0000)] 
rpc: don't let systemd shutdown daemon while saving VMs

The service unit "TimeoutStopSec" setting controls how long systemd
waits for a service to stop before aggressively killing it, defaulting
to 30 seconds if not set.

When we're processing shutdown of VMs in response to OS shutdown, we
very likely need more than 30 seconds to complete this job, and can
not stop the daemon during this time.

To avoid being prematurely killed, setup a timer that repeatedly
extends the "TimeoutStopSec" value while stop of running VMs is
arranged.

This does mean if libvirt hangs while stoppping VMs, systemd won't
get to kill the libvirt daemon, but this is considered less harmful
that forcefully killing running VMs.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoadmin: add 'daemon-shutdown' command
Daniel P. Berrangé [Tue, 7 Jan 2025 13:25:49 +0000 (13:25 +0000)] 
admin: add 'daemon-shutdown' command

The daemons are wired up to shutdown in responsible to UNIX process
signals, as well as in response to login1 dbus signals, or loss of
desktop session. The latter two options can optionally preserve state
(ie running VMs).

In non-systemd environments, as well as for testing, it would be useful
to have a way to trigger shutdown with state preservation more directly.

Thus a new admin protocol API is introduced

  virAdmConnectDaemonShutdown

which will trigger a daemon shutdown, and preserve running VMs if the
VIR_DAEMON_SHUTDOWN_PRESERVE flag is set.

It has a corresponding 'virt-admin daemon-shutdown [--preserve]' command
binding.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agorpc: fix shutdown sequence when preserving state
Daniel P. Berrangé [Tue, 7 Jan 2025 11:05:51 +0000 (11:05 +0000)] 
rpc: fix shutdown sequence when preserving state

The preserving of state (ie running VMs) requires a fully functional
daemon and hypervisor driver. If any part has started shutting down
then saving state may fail, or worse, hang.

The current shutdown sequence does not guarantee safe ordering, as
we synchronize with the state saving thread only after the hypervisor
driver has had its 'shutdownPrepare' callback invoked. In the case of
QEMU this means that worker threads processing monitor events may well
have been stopped.

This implements a full state machine that has a well defined ordering
that an earlier commit documented as the desired semantics.

With this change, nothing will start shutting down if the state saving
thread is still running.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agorpc: don't unconditionally quit after preserving state
Daniel P. Berrangé [Tue, 7 Jan 2025 10:27:21 +0000 (10:27 +0000)] 
rpc: don't unconditionally quit after preserving state

The call to preserve state (ie running VMs) is triggered in response to
the desktop session dbus terminating (session daemon), or logind sending
a "PrepareForShutdown" signal. In the case of the latter, daemons
should only save their state, not actually exit yet. Other things on the
system may still expect the daemon to be running at this stage.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agorpc: move state stop into virNetDaemon class
Daniel P. Berrangé [Tue, 7 Jan 2025 10:27:01 +0000 (10:27 +0000)] 
rpc: move state stop into virNetDaemon class

Currently the remote daemon code is responsible for calling virStateStop
in a background thread. The virNetDaemon code wants to synchronize with
this during shutdown, however, so the virThreadPtr must be passed over.

Even the limited synchronization done currently, however, is flawed and
to fix this requires the virNetDaemon code to be responsible for calling
virStateStop in a thread more directly.

Thus the logic is moved over into virStateStop via a further callback
to be registered by the remote daemon.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agorpc: rename virNetDaemonSetShutdownCallbacks
Daniel P. Berrangé [Tue, 11 Mar 2025 17:44:44 +0000 (17:44 +0000)] 
rpc: rename virNetDaemonSetShutdownCallbacks

The next patch will be introducing a new callback, so rename the method
to virNetDaemonSetLifecycleCallbacks to reflect the more general usage.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agosrc: clarify semantics of the various virStateNNN methods
Daniel P. Berrangé [Tue, 11 Mar 2025 17:24:34 +0000 (17:24 +0000)] 
src: clarify semantics of the various virStateNNN methods

It is not documented what the various virStateNNN methods are each
responsible for doing and the names give little guidance either.
Provide some useful documentation comments to explain the intended
usage of each.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoqemu: add config to control if auto-shutdown VMs are restored
Daniel P. Berrangé [Fri, 20 Dec 2024 12:55:49 +0000 (12:55 +0000)] 
qemu: add config to control if auto-shutdown VMs are restored

If shutting down running VMs at host shutdown, it can be useful to
automatically start them again on next boot. This adds a config
parameter 'auto_shutdown_restore', which defaults to enabled, which
leverages the autostart once feature.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoqemu: wire up support for once only autostart
Daniel P. Berrangé [Fri, 20 Dec 2024 12:43:28 +0000 (12:43 +0000)] 
qemu: wire up support for once only autostart

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agohypervisor: wire up support for auto restore of running domains
Daniel P. Berrangé [Fri, 20 Dec 2024 11:38:01 +0000 (11:38 +0000)] 
hypervisor: wire up support for auto restore of running domains

When performing auto-shutdown of running domains, there is now the
option to mark them as "autostart once",  so that their state is
restored on next boot. This applies on top of the traditional
autostart flag.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoconf: implement support for autostart once feature
Daniel P. Berrangé [Fri, 20 Dec 2024 11:26:55 +0000 (11:26 +0000)] 
conf: implement support for autostart once feature

This is maintained in the same way as the autostart flag, using a
symlink. The difference is that instead of '.xml', the symlink
suffix is '.xml.once'.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agosrc: add new APIs for marking a domain to autostart once
Daniel P. Berrangé [Fri, 20 Dec 2024 10:55:30 +0000 (10:55 +0000)] 
src: add new APIs for marking a domain to autostart once

When a domain is marked for autostart, it will be started on every
subsequent host OS boot. There may be times when it is desirable to
mark a domain to be autostarted, on the next boot only.

Thus we add virDomainSetAutostartOnce / virDomainGetAutostartOnce.

An alternative would have been to overload the existing
virDomainSetAutostart method, to accept values '1' or '2' for
the autostart flag. This was not done because it is expected
that language bindings will have mapped the current autostart
flag to a boolean, and thus turning it into an enum would create
a compatibility problem.

A further alternative would have been to create a new method
virDomainSetAutostartFlags, with a VIR_DOMAIN_AUTOSTART_ONCE
flag defined. This was not done because it is felt desirable
to clearly separate the two flags. Setting the "once" flag
should not interfere with existing autostart setting, whether
it is enabled or disabled currently.

The 'virsh autostart' command, however, is still overloaded
by just adding a --once flag, while current state is added
to 'virsh dominfo'.

No ability to filter by 'autostart once' status is added to
the domain list APIs. The most common use of autostart once
will be to automatically set it on host shutdown, and it be
cleared on host startup. Thus there would rarely be scenarios
in which a running app will need to filter on this new flag.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoqemu: add config parameter to control auto-save bypass cache
Daniel P. Berrangé [Thu, 19 Dec 2024 19:21:31 +0000 (19:21 +0000)] 
qemu: add config parameter to control auto-save bypass cache

When doing managed save of VMs, triggered by OS shutdown, it may
be desirable to control cache usage.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agohypervisor: support bypassing cache for managed save
Daniel P. Berrangé [Thu, 19 Dec 2024 19:18:04 +0000 (19:18 +0000)] 
hypervisor: support bypassing cache for managed save

Bypassing cache can make save performance more predictable and avoids
trashing the OS cache with data that will not be read again.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoqemu: configurable delay for shutdown before poweroff
Daniel P. Berrangé [Thu, 19 Dec 2024 19:13:04 +0000 (19:13 +0000)] 
qemu: configurable delay for shutdown before poweroff

Allow users to control how many seconds libvirt waits for QEMU
shutdown before force powering off a guest.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoqemu: improve shutdown defaults for session daemon
Daniel P. Berrangé [Fri, 20 Dec 2024 17:32:49 +0000 (17:32 +0000)] 
qemu: improve shutdown defaults for session daemon

Currently the session daemon will try a managed save on all VMs,
leaving them running if that fails.

This limits the managed save just to persistent VMs, as there will
usually not be any way to restore transient VMs later.

It also enables graceful shutdown and then forced poweroff, should
save fail for some reason.

These new defaults can be overridden in the config file if needed.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoqemu: support automatic VM managed save in system daemon
Daniel P. Berrangé [Tue, 17 Dec 2024 17:45:05 +0000 (17:45 +0000)] 
qemu: support automatic VM managed save in system daemon

Currently automatic VM managed save is only performed in session
daemons, on desktop session close, or host OS shutdown request.

With this change it is possible to control shutdown behaviour for
all daemons. A recommended setup might be:

  auto_shutdown_try_save = "persistent"
  auto_shutdown_try_shutdown = "all"
  auto_shutdown_poweroff = "all"

Each setting accepts 'none', 'persistent', 'transient', and 'all'
to control what types of guest it applies to.

For historical compatibility, for the system daemon, the settings
currently default to:

  auto_shutdown_try_save = "none"
  auto_shutdown_try_shutdown = "none"
  auto_shutdown_poweroff = "none"

while for the session daemon they currently default to

  auto_shutdown_try_save = "persistent"
  auto_shutdown_try_shutdown = "none"
  auto_shutdown_poweroff = "none"

The system daemon settings should NOT be enabled if the traditional
libvirt-guests.service is already enabled.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agohypervisor: custom shutdown actions for transient vs persistent VMs
Daniel P. Berrangé [Fri, 20 Dec 2024 13:56:19 +0000 (13:56 +0000)] 
hypervisor: custom shutdown actions for transient vs persistent VMs

It may be desirable to treat transient VMs differently from persistent
VMs. For example, while performing managed save on persistent VMs makes
sense, the same not usually true of transient VMs, since by their
nature they will have no config to restore from.

This also lets us fix a long standing problem with incorrectly
attempting to perform managed save on transient VMs.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agohypervisor: expand available shutdown actions
Daniel P. Berrangé [Thu, 19 Dec 2024 18:57:47 +0000 (18:57 +0000)] 
hypervisor: expand available shutdown actions

The auto shutdown code can currently only perform managed save,
which may fail in some cases, for example when PCI devices are
assigned. On failure, shutdown inhibitors remain in place which
may be undesirable.

This expands the logic to try a sequence of operations

 * Managed save
 * Graceful shutdown
 * Forced poweroff

Each of these operations can be enabled or disabled, but they
are always applied in this order.

With the shutdown option, a configurable time is allowed for
shutdown to complete, defaulting to 30 seconds, before moving
onto the forced poweroff phase.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoremote: always invoke virStateStop for all daemons
Daniel P. Berrangé [Tue, 17 Dec 2024 17:06:18 +0000 (17:06 +0000)] 
remote: always invoke virStateStop for all daemons

Currently the virStateStop method is only wired up to run save for
the unprivileged daemons, so there is no functional change.

IOW, session exit, or host OS shutdown will trigger VM managed saved
for QEMU session daemon, but not the system daemon.

This changes the daemon code to always run virStateStop for all
daemons. Instead the QEMU driver is responsible for skipping its
own logic when running privileged...for now.

This means that virStateStop will now be triggered by logind's
PrepareForShutdown signal.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agohypervisor: move support for auto-shutdown out of QEMU driver
Daniel P. Berrangé [Tue, 17 Dec 2024 10:04:35 +0000 (10:04 +0000)] 
hypervisor: move support for auto-shutdown out of QEMU driver

This is a move of the code that currently exists in the QEMU
driver, into the common layer that can be used by multiple
drivers.

The code currently supports performing managed save of all
running guests, ignoring any failures.

Reviewed-by: Peter Krempa <pkrempa@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoqemuHotplugRemoveManagedPR: Integrate check whether removal is needed
Peter Krempa [Mon, 17 Mar 2025 17:18:37 +0000 (18:18 +0100)] 
qemuHotplugRemoveManagedPR: Integrate check whether removal is needed

Calls to 'qemuHotplugRemoveManagedPR' needed to be guarded by a check if
the removed elements actually caused us to add the manager in the first
place.

The two new calls added in commit 1697323bfe6000c2f5a2519c06f0ba81 were
not guarded by such check and thus would spam the debug log with:

  [{"id": "libvirt-59", "error": {"class": "GenericError", "desc": "object 'pr-helper0' not found"}}]

Luckily 'qemuHotplugRemoveManagedPR' didn't request the error to be
reported as a proper error.

Don't attempt the removal unless needed.

Fixes: 1697323bfe6000c2f5a2519c06f0ba81f7b792eb
Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
4 months agoqemuDomainChangeEjectableMedia: Separate rollback and success code paths
Peter Krempa [Mon, 17 Mar 2025 17:09:03 +0000 (18:09 +0100)] 
qemuDomainChangeEjectableMedia: Separate rollback and success code paths

Do not use the rollback code path on success just to avoid extra call to
qemuHotplugRemoveManagedPR.

Rename the label and use it only when rolling back.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
4 months agoqemu: Remove return value from 'qemuHotplugRemoveManagedPR'
Peter Krempa [Mon, 17 Mar 2025 16:50:42 +0000 (17:50 +0100)] 
qemu: Remove return value from 'qemuHotplugRemoveManagedPR'

The only place which actually checked the return value would skip code
e.g. to delete unused files or stop no longer used services. The rest of
the callers ignored the value.

As this is expected to be used on cleanup code paths which have no
possibility to report errors we should remove the return value
completely.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
4 months agoqemu: Do not replace filter nodes with virDomainBlockCopy
Peter Krempa [Mon, 17 Mar 2025 16:35:12 +0000 (17:35 +0100)] 
qemu: Do not replace filter nodes with virDomainBlockCopy

The block copy operation is supposed to just move the disk to a new
destination. While in certain scenarios it'd make sense to drop the
copy-on-read layer, the definition would not correspond to it.

This was caused by a fix to the behaviour of the block job after
conversion to -blockdev as 'blockdev-mirror' requires the top node of
the disk to be selected. This also causes that the 'copy-on-read' filter
is ejected but libvirt doesn't unplug it.

Instead we need to use the 'replaces' argument of 'blockdev-mirror'
which allows to keep filters in place. This will preserve the
configuration (which can be optimized later) and also fixes a spurious
error logged when trying to unplug the first real file node after
copy-on-read which still looks used to qemu.

This is also needed for the upcoming feature which adds 'throttle'
filter layers as we need to keep those in place too to facilitate the
throttling.

Resolves: https://issues.redhat.com/browse/RHEL-40077
Fixes: e3137539a9c4af25ab085506d5467ec0847b0ecc
Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
4 months agoqemu: monitor: Wire up 'replaces' attribute for 'blockdev-mirror'
Peter Krempa [Mon, 17 Mar 2025 16:15:22 +0000 (17:15 +0100)] 
qemu: monitor: Wire up 'replaces' attribute for 'blockdev-mirror'

The 'replaces' field controls which node will be replaced by the job.
This can be used to e.g. keep filter nodes in place after the copy
finishes.

This will be used to keep the 'copy-on-read' and 'throttle' layers in
place after a copy.

This patch wires up the monitor and test, but the real callers pass NULL
for now.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
4 months agoNEWS: Mention multiple iothread support for 'virtio-scsi' controller
Peter Krempa [Mon, 3 Mar 2025 15:16:41 +0000 (16:16 +0100)] 
NEWS: Mention multiple iothread support for 'virtio-scsi' controller

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemuxmlconftest: Add 'iothreads-virtio-scsi-mapping' case
Peter Krempa [Fri, 14 Feb 2025 14:58:54 +0000 (15:58 +0100)] 
qemuxmlconftest: Add 'iothreads-virtio-scsi-mapping' case

Test the XML and commandline for iothread<->virtqueue mapping for
'virtio-scsi' controllers.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: Implement support for iothread <-> virtqueue mapping for 'virtio-scsi' controllers
Peter Krempa [Fri, 14 Feb 2025 14:13:36 +0000 (15:13 +0100)] 
qemu: Implement support for iothread <-> virtqueue mapping for 'virtio-scsi' controllers

Similarly to 'virtio-blk' users can map multiple iothreads and pin them
appropriately for 'virtio-scsi' controllers to ensure the best
performance.

Implement the validation and command line generation based on the
helpers we have for 'virtio-blk'.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoconf: Add support for iothread to queue mapping config for 'virtio-scsi'
Peter Krempa [Fri, 14 Feb 2025 14:13:36 +0000 (15:13 +0100)] 
conf: Add support for iothread to queue mapping config for 'virtio-scsi'

Upcoming qemu release will support configuring mapping iothreads to
virtio queues for 'virtio-scsi' controllers in order to improve
performance.

Reuse the infrastructure we have from the same configuration for
'virti-blk' to implement the conf support for this feature.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: capabilities: Introduce QEMU_CAPS_VIRTIO_SCSI_IOTHREAD_MAPPING
Peter Krempa [Tue, 11 Feb 2025 16:53:51 +0000 (17:53 +0100)] 
qemu: capabilities: Introduce QEMU_CAPS_VIRTIO_SCSI_IOTHREAD_MAPPING

The 'virtio-scsi' controller now supports iothread<->virtqueue mapping
configuration.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemucapabilitiestest: Update 'caps_10.0.0_x86_64' to v9.2.0-2799-g0462a32b4f
Peter Krempa [Tue, 11 Feb 2025 16:50:36 +0000 (17:50 +0100)] 
qemucapabilitiestest: Update 'caps_10.0.0_x86_64' to v9.2.0-2799-g0462a32b4f

Notable changes:
 - 'virtio-scsi' supports 'iothread-vq-mapping'
 - 'vfio-pci' device gained two unstable options 'x-igd-legacy-mode'
   and 'x-igd-lpc'

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoconf: also free auth for rdp in virDomainGraphicsDefFree
Ján Tomko [Tue, 18 Mar 2025 17:55:25 +0000 (18:55 +0100)] 
conf: also free auth for rdp in virDomainGraphicsDefFree

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Fixes: bfa7d5aaa8834c6801cacbfc6c6ea83a8ecaca9c
4 months agoqemu: remove unreachable breaks in qemuDomainAssignMemoryDeviceSlot
Ján Tomko [Tue, 18 Mar 2025 17:01:33 +0000 (18:01 +0100)] 
qemu: remove unreachable breaks in qemuDomainAssignMemoryDeviceSlot

Signed-off-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu_domain_address: fix CCW virtio-mem hotplug
Boris Fiuczynski [Tue, 18 Mar 2025 13:48:50 +0000 (14:48 +0100)] 
qemu_domain_address: fix CCW virtio-mem hotplug

Since commit f23f8ff91a virtio-mem supports also CCW. When hotplugging a
virtio-mem device with a CCW address results in a PCI device getting
attached. The method qemuDomainAssignMemoryDeviceSlot is only
considering PCI as address type and overwriting the CCW address. Adding
support for address type CCW.

Signed-off-by: Boris Fiuczynski <fiuczy@linux.ibm.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
Signed-off-by: Ján Tomko <jtomko@redhat.com>
4 months agotests: add qemu <graphics type='rdp'/> test
Marc-André Lureau [Sun, 16 Mar 2025 08:18:41 +0000 (12:18 +0400)] 
tests: add qemu <graphics type='rdp'/> test

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: add RDP support
Marc-André Lureau [Sun, 16 Mar 2025 08:18:40 +0000 (12:18 +0400)] 
qemu: add RDP support

Wire the external server RDP support with QEMU.

Check the configuration, allocate a port, start the process
and set the credentials.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: add 'rdp' capability if qemu-rdp is available
Marc-André Lureau [Sun, 16 Mar 2025 08:18:39 +0000 (12:18 +0400)] 
qemu: add 'rdp' capability if qemu-rdp is available

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: pass virQEMUDriverConfig to capabilities
Marc-André Lureau [Sun, 16 Mar 2025 08:18:38 +0000 (12:18 +0400)] 
qemu: pass virQEMUDriverConfig to capabilities

This will help with the following patch, which also requires config access.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: add qemu-rdp helper unit
Marc-André Lureau [Sun, 16 Mar 2025 08:18:37 +0000 (12:18 +0400)] 
qemu: add qemu-rdp helper unit

Helpers to start the qemu-rdp server and set it up.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: validate RDP configuration
Marc-André Lureau [Sun, 16 Mar 2025 08:18:36 +0000 (12:18 +0400)] 
qemu: validate RDP configuration

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu/dbus: log daemon stdout/err, use domainLogContext
Marc-André Lureau [Sun, 16 Mar 2025 08:18:35 +0000 (12:18 +0400)] 
qemu/dbus: log daemon stdout/err, use domainLogContext

Currently, if dbus-daemon writes on errfd, it will SIGPIPE.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu/dbus: keep a connection to the VM D-Bus
Marc-André Lureau [Sun, 16 Mar 2025 08:18:34 +0000 (12:18 +0400)] 
qemu/dbus: keep a connection to the VM D-Bus

The following changes are going to communicate with the qemu-rdp server
through the VM D-Bus bus, keep a connection for that and further usage.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu/virtiofs: use domainLogContext
Marc-André Lureau [Sun, 16 Mar 2025 08:18:33 +0000 (12:18 +0400)] 
qemu/virtiofs: use domainLogContext

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: limit to one <graphics type='rdp'>
Marc-André Lureau [Sun, 16 Mar 2025 08:18:32 +0000 (12:18 +0400)] 
qemu: limit to one <graphics type='rdp'>

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: add RDP ports range allocator
Marc-André Lureau [Sun, 16 Mar 2025 08:18:31 +0000 (12:18 +0400)] 
qemu: add RDP ports range allocator

RDP server uses port 3389 by default.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: use virDomainDefHasGraphics
Marc-André Lureau [Sun, 16 Mar 2025 08:18:30 +0000 (12:18 +0400)] 
qemu: use virDomainDefHasGraphics

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoconf: generalize virDomainDefHasSpiceGraphics
Marc-André Lureau [Sun, 16 Mar 2025 08:18:29 +0000 (12:18 +0400)] 
conf: generalize virDomainDefHasSpiceGraphics

Generalize the function, broaden its potential usage.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoconf: parse optional RDP username & password
Marc-André Lureau [Sun, 16 Mar 2025 08:18:28 +0000 (12:18 +0400)] 
conf: parse optional RDP username & password

Like VNC, allow to set credentials for RDP.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: add qemu RDP configuration
Marc-André Lureau [Sun, 16 Mar 2025 08:18:27 +0000 (12:18 +0400)] 
qemu: add qemu RDP configuration

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu: add rdp state directory
Marc-André Lureau [Sun, 16 Mar 2025 08:18:26 +0000 (12:18 +0400)] 
qemu: add rdp state directory

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoutil: annotate non-null arguments for virGDBusCallMethod()
Marc-André Lureau [Sun, 16 Mar 2025 08:18:25 +0000 (12:18 +0400)] 
util: annotate non-null arguments for virGDBusCallMethod()

Helps avoid/debug a potential SEGV if conn is NULL, since gio will not
set the "gerror" in that case and we will crash later at:
  virReportError(VIR_ERR_DBUS_SERVICE, "%s", gerror->message);

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agoqemu-slirp: drop unneeded check for OOM
Marc-André Lureau [Sun, 16 Mar 2025 08:18:24 +0000 (12:18 +0400)] 
qemu-slirp: drop unneeded check for OOM

glib anti-pattern, since it aborts on OOM.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agobuild: fix -Werror=maybe-uninitialized
Marc-André Lureau [Sun, 16 Mar 2025 08:18:23 +0000 (12:18 +0400)] 
build: fix -Werror=maybe-uninitialized

When compiled with -Doptimization=g

../tools/nss/libvirt_nss_macs.c:155:8: error: ‘jerr’ may be used uninitialized [-Werror=maybe-uninitialized]
  155 |     if (jerr == json_tokener_continue) {
      |        ^

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agobuild-sys: drop -Winline when optimization=g
Marc-André Lureau [Sun, 16 Mar 2025 08:18:22 +0000 (12:18 +0400)] 
build-sys: drop -Winline when optimization=g

The warning is triggered when compiling with various build options, such
as -Doptimization=g.

From gcc(1) man page about -Winline:
seemingly insignificant changes in the source program can cause the warnings produced by -Winline to appear or disappear.

Such flaky behaviour is best left to the user discretion.

Signed-off-by: Marc-André Lureau <marcandre.lureau@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agonews: Add item for guest load averages
Martin Kletzander [Mon, 3 Mar 2025 13:31:48 +0000 (14:31 +0100)] 
news: Add item for guest load averages

Signed-off-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
4 months agosrc: add new target for regenerating protocol structs files
Daniel P. Berrangé [Thu, 13 Mar 2025 15:53:07 +0000 (15:53 +0000)] 
src: add new target for regenerating protocol structs files

Introduce a new ninja target

   ninja -C build regen-{PROTO}

eg

   ninja -C build regen-admin_protocol

that will re-create the reference output file based on what the
current pdwtags command emits. A small change is made to squash
whitespace on enum declarations so that introducing a new longer
enum name doesn't trigger re-indent of all existing enum names.

Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agosrc: normalize whitespace in protocol structs files
Daniel P. Berrangé [Thu, 13 Mar 2025 15:53:01 +0000 (15:53 +0000)] 
src: normalize whitespace in protocol structs files

This makes the output match what current pdwtags will emit,
modulo some whitespace changes made by the check script
before comparison.

Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoch: Fix refcounting in virCHEventHandlerLoop() and virCHStartEventHandler()
Kirill Shchetiniuk [Fri, 14 Mar 2025 11:51:19 +0000 (12:51 +0100)] 
ch: Fix refcounting in virCHEventHandlerLoop() and virCHStartEventHandler()

When event handler thread is created inside of
virCHStartEventHandler() the monitor object is refed because the thread
(virCHEventHandlerLoop()) that's created in the very next step
uses it. But right after that, the monitor object is unrefed,
which is wrong because it takes away the reference which was
handed over to the thread. The monitor must be unrefed inside the
thread, when no longer needed.

And while at it, move the unref call of the domain object after
the debug print which obviously accesses the domain definition.

Signed-off-by: Kirill Shchetiniuk <kshcheti@redhat.com>
Reviewed-by: Michal Privoznik <mprivozn@redhat.com>
4 months agoch: preserve last error in virCHProcessStop()
Kirill Shchetiniuk [Fri, 14 Mar 2025 11:51:18 +0000 (12:51 +0100)] 
ch: preserve last error in virCHProcessStop()

If starting a CH domain fails an error is reported and
virCHProcessStart() calls virCHProcessStop() to clean up any
residues. Problem is, inside of virCHProcessStop() some public
APIs might be called (e.g. virNetworkLookupByName(),
virNetworkPortLookupByUUID() and/or virNetworkPortDelete()). Per
our design, public APIs reset last error which means the useful
error reported earlier is lost.

Fix this by calling virErrorPreserveLast() + virErrorRestore()
combo inside of virCHProcessStop().

Signed-off-by: Kirill Shchetiniuk <kshcheti@redhat.com>
Reviewed-by: Michal Privoznik <mprivozn@redhat.com>
4 months agodocs: Fix some typos
Thomas Huth [Mon, 17 Mar 2025 10:41:20 +0000 (11:41 +0100)] 
docs: Fix some typos

Found with the codespell utility.

Signed-off-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
4 months agodocs: remove references to removed APIs
Daniel P. Berrangé [Mon, 17 Mar 2025 10:02:24 +0000 (10:02 +0000)] 
docs: remove references to removed APIs

The glib adoption docs was suggesting avoidance of certain APIs that
were obsoleted by glib, during the transition period. Now that the
referenced APIs no longer exist in libvirt code, they can also be
removed from the docs.

NB, the virStringListRemoveDuplicates method remains since there is
no glib equivalent.

Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoscripts: add execute permission to several files
Daniel P. Berrangé [Mon, 17 Mar 2025 10:11:01 +0000 (10:11 +0000)] 
scripts: add execute permission to several files

Most, but not all, files in scripts have execute permission. While we
don't need this in order to launch them via meson/ninja build rules,
it is nice to direct execution if they have execution permission. This
makes the practice consistent across all scripts.

Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agodocs: document workaround for DMARC countermeasures
Daniel P. Berrangé [Mon, 17 Mar 2025 11:18:17 +0000 (11:18 +0000)] 
docs: document workaround for DMARC countermeasures

If a contributor's email domain has a DMARC policy of 'p=quarantine'
or 'p=reject', mailman will apply DMARC countermeasures on all mails
sent to lists.libvirt.org rewriting the "From" header to remove the
sender's email address. e.g.

  From: Your Name via <lists.libvirt.org>

If these countermeasures were not applied, affected mail would either
have gone directly to SPAM, or have been entirely rejected. Mailman3
is unable to be configured to guarantee no mangling of the mail body
so these countermeasures are unavoidable for lists.libvirt.org.

Amongst the various downsides, the From address rewriting has the
bad effect of mangling git commit author attribution.

To avoid this it is required to add two additional git config
settings:

  $ git config --global format.from "Your Name <your@email.com>"
  $ git config --global format.forceInBodyFrom true

Note, *both* are required, even if your ``format.from`` matches
your existing git identity, because the latter only takes effect
once the former is set.

Reviewed-by: Jiri Denemark <jdenemar@redhat.com>
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
4 months agoconf: parse interface/source/@dev for all interface types (with backend type='passt')
Laine Stump [Fri, 7 Mar 2025 00:19:12 +0000 (19:19 -0500)] 
conf: parse interface/source/@dev for all interface types (with backend type='passt')

The original implementation of the passt backend for vhost-user
interfaces erroneously forgot to parse:

  <source dev='blah'/>

for interface type='vhostuser', so it wasn't being added to the passt
commandline, and also wasn't being saved to the domain config. Now we
parse it whenever the <backend> type='passt', no matter what the
interface type, and then throw an error during validation if
source/@dev was specified for interface type = 'user|vhostuser' and
backend type != 'passt'.

Fixes: 1e9054b9c79d721a55f413c2983c5370044f8f60
Resolves: https://issues.redhat.com/browse/RHEL-82539
Signed-off-by: Laine Stump <laine@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoRemove unreachable breaks right after return
Ján Tomko [Thu, 13 Mar 2025 15:27:27 +0000 (16:27 +0100)] 
Remove unreachable breaks right after return

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: remove unused vm from qemuBuildPVCommandLine
Ján Tomko [Thu, 13 Mar 2025 15:03:23 +0000 (16:03 +0100)] 
qemu: remove unused vm from qemuBuildPVCommandLine

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: remove unused vm from qemuBuildSEVSNPCommandLine
Ján Tomko [Thu, 13 Mar 2025 15:01:03 +0000 (16:01 +0100)] 
qemu: remove unused vm from qemuBuildSEVSNPCommandLine

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: remove qemuCaps from qemuBuildIOThreadCommandLine
Ján Tomko [Thu, 13 Mar 2025 14:56:29 +0000 (15:56 +0100)] 
qemu: remove qemuCaps from qemuBuildIOThreadCommandLine

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: remove qemuCaps from qemuBuildObjectCommandline
Ján Tomko [Thu, 13 Mar 2025 14:55:53 +0000 (15:55 +0100)] 
qemu: remove qemuCaps from qemuBuildObjectCommandline

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: remove qemuCaps from qemuBuildTLSx509CommandLine
Ján Tomko [Thu, 13 Mar 2025 14:54:45 +0000 (15:54 +0100)] 
qemu: remove qemuCaps from qemuBuildTLSx509CommandLine

Also from qemuBuildGraphicsVNCCommandLine

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: remove qemuCaps from qemuBuildObjectSecretCommandLine
Ján Tomko [Thu, 13 Mar 2025 14:53:17 +0000 (15:53 +0100)] 
qemu: remove qemuCaps from qemuBuildObjectSecretCommandLine

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: remove qemuCaps from qemuBuildObjectCommandlineFromJSON
Ján Tomko [Thu, 13 Mar 2025 14:52:00 +0000 (15:52 +0100)] 
qemu: remove qemuCaps from qemuBuildObjectCommandlineFromJSON

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: validate: fs: remove unneeded parameter
Ján Tomko [Thu, 13 Mar 2025 14:45:53 +0000 (15:45 +0100)] 
qemu: validate: fs: remove unneeded parameter

No longer required since we don't require driver->privileged anymore.

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: seccomp sandbox: remove incorect G_GNUC_UNUSED marker
Ján Tomko [Thu, 13 Mar 2025 14:45:18 +0000 (15:45 +0100)] 
qemu: seccomp sandbox: remove incorect G_GNUC_UNUSED marker

qemuCaps is obviously used.

Signed-off-by: Ján Tomko <jtomko@redhat.com>
Reviewed-by: Martin Kletzander <mkletzan@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoNEWS: Mention new 'image_format' parameter for virDomainSaveParams
Jim Fehlig [Mon, 3 Mar 2025 18:31:34 +0000 (11:31 -0700)] 
NEWS: Mention new 'image_format' parameter for virDomainSaveParams

Signed-off-by: Jim Fehlig <jfehlig@suse.com>
Reviewed-by: Pavel Hrdina <phrdina@redhat.com>
4 months agodocs: Clarify what source and name attributes of TPM profile describe
Stefan Berger [Mon, 16 Dec 2024 19:16:44 +0000 (14:16 -0500)] 
docs: Clarify what source and name attributes of TPM profile describe

Clarify what source and name attributes of TPM profile describe and
update the version placeholder to the libvirt version when profiles
were first supported, v10.10. Also mention that profiles with prefix
'custom:' in their name can be modified.

Signed-off-by: Stefan Berger <stefanb@linux.vnet.ibm.com>
Reviewed-by: Marc-André Lureau <marcandre.lureau@redhat.com>
4 months agoch: Rework virCHProcessConnectMonitor()
Michal Privoznik [Thu, 13 Mar 2025 12:03:02 +0000 (13:03 +0100)] 
ch: Rework virCHProcessConnectMonitor()

Firstly, let's switch from explicit virCHDriverGetConfig() +
virObjectUnref() combo to g_autoptr(virCHDriverConfig). This
leaves us with the @monitor variable which is initialized to NULL
only to be then set to the retval of virCHMonitorNew() and
returned instantly. Well, the variable is now useless and can be
dropped.

Signed-off-by: Michal Privoznik <mprivozn@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoch: Unref @cfg in virCHProcessStop()
Michal Privoznik [Thu, 13 Mar 2025 12:02:33 +0000 (13:02 +0100)] 
ch: Unref @cfg in virCHProcessStop()

At the beginning of virCHProcessStop() the ref to driver config
is obtained (via virCHDriverGetConfig()), but corresponding unref
call is lacking. Use g_autoptr() to make sure the config is
unrefed always.

Signed-off-by: Michal Privoznik <mprivozn@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoch: Free @iothreads array in virCHProcessSetupIOThreads()
Michal Privoznik [Thu, 13 Mar 2025 12:02:17 +0000 (13:02 +0100)] 
ch: Free @iothreads array in virCHProcessSetupIOThreads()

When the CH driver starts a domain virCHProcessSetupIOThreads()
is called eventually which in turn calls
virCHMonitorGetIOThreads(). The latter returns an array of
iothreads which is never freed leading to a memleak:

130 (104 direct, 26 indirect) bytes in 1 blocks are definitely lost in loss record 1,804 of 1,998
   at 0x484CEF3: calloc (vg_replace_malloc.c:1675)
   by 0x4F0E7A9: g_malloc0 (in /usr/lib64/libglib-2.0.so.0.8000.5)
   by 0xB3A9359: virCHMonitorGetIOThreads (ch_monitor.c:1183)
   by 0xB3AA5BB: virCHProcessSetupIOThreads (ch_process.c:348)
   by 0xB3AAC59: virCHProcessSetup (ch_process.c:480)
   by 0xB3AC75A: virCHProcessStart (ch_process.c:973)
   by 0xB39B7D4: chDomainCreateXML (ch_driver.c:246)
   by 0x4CC9D32: virDomainCreateXML (libvirt-domain.c:188)
   by 0x168F91: remoteDispatchDomainCreateXML (remote_daemon_dispatch_stubs.h:5186)
   by 0x168F18: remoteDispatchDomainCreateXMLHelper (remote_daemon_dispatch_stubs.h:5167)
   by 0x4B20066: virNetServerProgramDispatchCall (virnetserverprogram.c:423)
   by 0x4B1FB99: virNetServerProgramDispatch (virnetserverprogram.c:299)

Signed-off-by: Michal Privoznik <mprivozn@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoch: Don't leak virCHDomainObjPrivate struct members
Michal Privoznik [Thu, 13 Mar 2025 12:01:58 +0000 (13:01 +0100)] 
ch: Don't leak virCHDomainObjPrivate struct members

There are some members of the virCHDomainObjPrivate struct that
are allocated at various stages of domain lifecycle but then are
never freed:

1) cgroup - allocated in virDomainCgroupSetupCgroup()
2) autoCpuset - this one is actually never allocated (and thus is
                always NULL, but soon it may be used. Just free
                it for now, which is a NOP anyways.
3) autoNodeset - same story as 2).

There are two more members, which shouldn't be freed:

1) driver - this is just a raw pointer to the CH driver (see
   virCHDomainObjPrivateAlloc()).

2) monitor - this member is cleared in virCHProcessStop(), way
             before control even gets to
             virCHDomainObjPrivateFree().

452 (400 direct, 52 indirect) bytes in 1 blocks are definitely lost in loss record 1,944 of 1,998
   at 0x484CEF3: calloc (vg_replace_malloc.c:1675)
   by 0x4F0E7A9: g_malloc0 (in /usr/lib64/libglib-2.0.so.0.8000.5)
   by 0x49479CE: virCgroupNewFromParent (vircgroup.c:893)
   by 0x49481BA: virCgroupNewDomainPartition (vircgroup.c:1068)
   by 0x494915E: virCgroupNewMachineManual (vircgroup.c:1378)
   by 0x49492FE: virCgroupNewMachine (vircgroup.c:1432)
   by 0x4B5E3DE: virDomainCgroupInitCgroup (domain_cgroup.c:377)
   by 0x4B5E9CD: virDomainCgroupSetupCgroup (domain_cgroup.c:524)
   by 0xB3AC693: virCHProcessStart (ch_process.c:951)
   by 0xB39B7D4: chDomainCreateXML (ch_driver.c:246)
   by 0x4CC9D32: virDomainCreateXML (libvirt-domain.c:188)
   by 0x168F91: remoteDispatchDomainCreateXML (remote_daemon_dispatch_stubs.h:5186)

Signed-off-by: Michal Privoznik <mprivozn@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoch: Free retval of curl_slist_append()
Michal Privoznik [Thu, 13 Mar 2025 12:01:44 +0000 (13:01 +0100)] 
ch: Free retval of curl_slist_append()

There are two places where curl_slist_append() is called but
corresponding call to curl_slist_free_all() is missing:
virCHMonitorPutNoContent() and virCHMonitorGet() which leads to
memleaks:

41 (16 direct, 25 indirect) bytes in 1 blocks are definitely lost in loss record 992 of 1,998
   at 0x4845888: malloc (vg_replace_malloc.c:446)
   by 0x5B2F8FE: curl_slist_append (in /usr/lib64/libcurl.so.4.8.0)
   by 0xB3A7B41: virCHMonitorPutNoContent (ch_monitor.c:824)
   by 0xB3A89FF: virCHMonitorBootVM (ch_monitor.c:1030)
   by 0xB3AC6F1: virCHProcessStart (ch_process.c:967)
   by 0xB39B7D4: chDomainCreateXML (ch_driver.c:246)
   by 0x4CC9D32: virDomainCreateXML (libvirt-domain.c:188)
   by 0x168F91: remoteDispatchDomainCreateXML (remote_daemon_dispatch_stubs.h:5186)
   by 0x168F18: remoteDispatchDomainCreateXMLHelper (remote_daemon_dispatch_stubs.h:5167)
   by 0x4B20066: virNetServerProgramDispatchCall (virnetserverprogram.c:423)
   by 0x4B1FB99: virNetServerProgramDispatch (virnetserverprogram.c:299)
   by 0x4B28B5E: virNetServerProcessMsg (virnetserver.c:135)

88 (16 direct, 72 indirect) bytes in 1 blocks are definitely lost in loss record 1,501 of 1,998
   at 0x4845888: malloc (vg_replace_malloc.c:446)
   by 0x5B2F8FE: curl_slist_append (in /usr/lib64/libcurl.so.4.8.0)
   by 0xB3A7E41: virCHMonitorGet (ch_monitor.c:864)
   by 0xB3A92E2: virCHMonitorGetInfo (ch_monitor.c:1157)
   by 0xB3A9CEA: virCHProcessUpdateInfo (ch_process.c:142)
   by 0xB3AAD36: virCHProcessSetup (ch_process.c:492)
   by 0xB3AC75A: virCHProcessStart (ch_process.c:973)
   by 0xB39B7D4: chDomainCreateXML (ch_driver.c:246)
   by 0x4CC9D32: virDomainCreateXML (libvirt-domain.c:188)
   by 0x168F91: remoteDispatchDomainCreateXML (remote_daemon_dispatch_stubs.h:5186)
   by 0x168F18: remoteDispatchDomainCreateXMLHelper (remote_daemon_dispatch_stubs.h:5167)
   by 0x4B20066: virNetServerProgramDispatchCall (virnetserverprogram.c:423)

Signed-off-by: Michal Privoznik <mprivozn@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agonetwork: Free inhibitor in networkStateCleanup()
Michal Privoznik [Thu, 13 Mar 2025 12:01:19 +0000 (13:01 +0100)] 
network: Free inhibitor in networkStateCleanup()

The shutdown inhibitor is created in networkStateInitialize() but
corresponding call to virInhibitorFree() is missing in
networkStateCleanup() leading to a memleak:

116 (72 direct, 44 indirect) bytes in 1 blocks are definitely lost in loss record 1,769 of 1,998
   at 0x484CEF3: calloc (vg_replace_malloc.c:1675)
   by 0x4F0E7A9: g_malloc0 (in /usr/lib64/libglib-2.0.so.0.8000.5)
   by 0x4993B9B: virInhibitorNew (virinhibitor.c:152)
   by 0x5279394: networkStateInitialize (bridge_driver.c:654)
   by 0x4CC74DC: virStateInitialize (libvirt.c:665)
   by 0x15B719: daemonRunStateInit (remote_daemon.c:613)
   by 0x49F2B44: virThreadHelper (virthread.c:256)
   by 0x5356662: start_thread (in /usr/lib64/libc.so.6)
   by 0x53D7DA3: clone (in /usr/lib64/libc.so.6)

Signed-off-by: Michal Privoznik <mprivozn@redhat.com>
Reviewed-by: Peter Krempa <pkrempa@redhat.com>
4 months agoqemu: capabilites: Retire QEMU_CAPS_MIGRATION_PARAM_BLOCK_BITMAP_MAPPING
Peter Krempa [Wed, 12 Mar 2025 16:12:40 +0000 (17:12 +0100)] 
qemu: capabilites: Retire QEMU_CAPS_MIGRATION_PARAM_BLOCK_BITMAP_MAPPING

The capability is no logner used as all qemus support it.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: migration: Always assume support for QEMU_CAPS_MIGRATION_PARAM_BLOCK_BITMAP_MAPPING
Peter Krempa [Wed, 12 Mar 2025 16:10:59 +0000 (17:10 +0100)] 
qemu: migration: Always assume support for QEMU_CAPS_MIGRATION_PARAM_BLOCK_BITMAP_MAPPING

The 'transform' attribute of 'bitmaps' was added in qemu-6.0, thus
we can assume all qemus we're willing to use support it.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: domain: Remove qemuDomainSupportsCheckpointsBlockjobs
Peter Krempa [Wed, 12 Mar 2025 16:08:33 +0000 (17:08 +0100)] 
qemu: domain: Remove qemuDomainSupportsCheckpointsBlockjobs

The function now serves no real purpose.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: capabilites: Retire QEMU_CAPS_INCREMENTAL_BACKUP
Peter Krempa [Wed, 12 Mar 2025 16:06:39 +0000 (17:06 +0100)] 
qemu: capabilites: Retire QEMU_CAPS_INCREMENTAL_BACKUP

All supported qemu versions now support this. Retire the capability.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: Always assume support for QEMU_CAPS_INCREMENTAL_BACKUP
Peter Krempa [Wed, 12 Mar 2025 16:04:04 +0000 (17:04 +0100)] 
qemu: Always assume support for QEMU_CAPS_INCREMENTAL_BACKUP

The support for incremental backup (not the backup api itself) was gated
on support for migrating bitmaps. As the ability to migrate bitmaps was
added in qemu-6.0 we can now assume that all supported qemu versions
support incremental backup.

Remove the interlocking.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: capabilities: Retire QEMU_CAPS_BLOCKDEV_SNAPSHOT_ALLOW_WRITE_ONLY
Peter Krempa [Wed, 12 Mar 2025 15:58:07 +0000 (16:58 +0100)] 
qemu: capabilities: Retire QEMU_CAPS_BLOCKDEV_SNAPSHOT_ALLOW_WRITE_ONLY

All supported qemus have this and we already deleted alternate code.
Retire the feature flag.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: Always assume support for QEMU_CAPS_BLOCKDEV_SNAPSHOT_ALLOW_WRITE_ONLY
Peter Krempa [Wed, 12 Mar 2025 15:56:29 +0000 (16:56 +0100)] 
qemu: Always assume support for QEMU_CAPS_BLOCKDEV_SNAPSHOT_ALLOW_WRITE_ONLY

qemu supports the @allow-write-only-overlay feature since qemu-5.0.
Remove the alternate code paths.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: capabilities: Retire QEMU_CAPS_BLOCKDEV_REOPEN
Peter Krempa [Wed, 12 Mar 2025 15:51:20 +0000 (16:51 +0100)] 
qemu: capabilities: Retire QEMU_CAPS_BLOCKDEV_REOPEN

'blockdev-reopen' is supported since qemu-6.1. Since we now don't have
any code using this capability we can retire it.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: Always assume support for QEMU_CAPS_BLOCKDEV_REOPEN
Peter Krempa [Wed, 12 Mar 2025 15:48:53 +0000 (16:48 +0100)] 
qemu: Always assume support for QEMU_CAPS_BLOCKDEV_REOPEN

'blockdev-reopen' is supported since qemu-6.1, thus we can now remove
the interlocks.

Document the change to 'mirror' as this patch removes the last clue why
we overwrite the mirror's readonly state to false unconditionally.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>
4 months agoqemu: capabilities: Retire QEMU_CAPS_QMP_QUERY_NAMED_BLOCK_NODES_FLAT
Peter Krempa [Wed, 12 Mar 2025 15:42:07 +0000 (16:42 +0100)] 
qemu: capabilities: Retire QEMU_CAPS_QMP_QUERY_NAMED_BLOCK_NODES_FLAT

The capability is no longer used as all qemus already support the
feature.

Signed-off-by: Peter Krempa <pkrempa@redhat.com>
Reviewed-by: Ján Tomko <jtomko@redhat.com>