Important Concepts
The following sections explain key concepts used internally in PackageKit.
Package ID
One important idea is the package_id.
This is the name;version;arch;data in
a single string and is meant to represent a single package.
This is important when multiple versions of a package are installed and
only the correct one is removed.
The package_id is parsed and checked carefully in
the helper code.
The package arch and data are optional, but 3 ;'s must
be present.
For instance, gnome-keyring-manager;2.18.0;; is
valid but gnome-keyring-manager;2.18.0 is not.
The data field is used for the repository name and/or installation state.
It should ideally not be parsed by frontends to extract state data, instead the
PkInfoEnum
that is often provided alongside a package_id
will provide more accurate state information.
The data field for an installed package can either be
installed for installed packages, auto
for automatically installed packages or manual for manually
installed packages. If the package has a repository origin, the installation state may be
prefixed to the origin, divided by a colon, e.g. auto:fedora-devel.
If a package is not installed, the data field is equal to the package origin.
The data field for an non-installed local package must be
local as this signifies a repository name is not available
and that package resides locally on the client system.
For example:
csup;20060318-5;x86_64;local: for locally available package file.
csup;20060318-5;x86_64;fedora-devel: for package that is not installed
and can be downladed from the Fedora development repostory.
csup;20060318-5;x86_64;installed:fedora-devel: for locally installed package
csup;20060318-5;x86_64;installed: for locally installed package without repository information
Situation
Value
Description
Searching
installed
If installed
available
If available to install
Getting Updates
low
If update is of low severity
normal
If update is of normal severity
important
If update is very important
security
If the update is security sensitive
Installing/Updating/Removing
downloading
If we are downloading this package
updating
If we are updating this package
installing
If we are installing this package
removing
If we are removing this package
Otherwise
unknown
If we cannot use any other option
The backend must ensure that the package_id only matches on one
single package.
A single package_id must be enough to uniquely identify a single object
in any repository used on the system.
Filters
Search filtering on the name is done in the backend for efficiency reasons.
This can be added into the compiled backend if this is not possible
in any new backend design.
Filter options are:
Option
Description
installed or ~installed
If the package is currently installed.
Packages returned with the ~installed filter set
are available in remote software sources.
devel or ~devel
Development packages are typically not required for normal operation
and typically have the suffixes -devel, -dgb and -static.
gui or ~gui
GUI programs typically depend on gtk, libkde or libxfce.
application or ~application
Packages that provide desktop files and are probably applications.
free or ~free
Free software. The package contains only software and
other content that is available under a free license.
See the Fedora wiki
for a list of licenses that are considered free.
If a license cannot be determined from the package metadata, or the
status of the license is not known, the package will be marked as 'non-free'.
visible or ~visible
Repositories may want to specify if a package should be visible
in an application chooser.
This is only really useful for embedded environments where the
package list is manually chosen.
supported or ~supported
If the package is supported by the distribution or retailer or is a
unsupported third party package.
basename or ~basename
The basename filter will only return results according to the
package basename.
This is useful if you are searching for pm-utils and you only
want to show the main pm-utils package, not any of the
-devel or -debuginfo or
-common suffixes in the UI.
The basename is normally the original name of the source package.
newest or ~newest
The newest filter will only return the newest package available.
This is useful if you are searching for gimp
and only gimp-2.4.5-1.fc9.i386 would be returned,
not gimp-2.4.5-1.fc9.i386,
gimp-2.4.4-1.fc9.i386 and
gimp-2.4.3-1.fc9.i386.
NOTE:
The newest filter processes installed and available
package lists separately and so the installed or
~installed filter also has to be specified if only one type of
results are required.
There is no way to do a newest filter across both
installed and available packages.
arch or ~arch
The arch filter will only return the packages that match the exact architecture
of the system, for instance only showing x86_64 packages on a AMD Turion 64.
This would mean that x86_64 packages could be filtered from non-native 32-bit
packages.
This allows the used to choose non-native packages if a multi-lib policy is allowed.
source or ~source
The source filter will only return source packages.
These are typically useful when rebuilding other packages.
So valid options would be:
Option
Description
none
All packages installed or available with no filtering
devel;~installed
All non-installed development packages
installed;~devel
All installed non-development packages
gui;~installed;~devel
All non-installed, non-devel gui programs
Removing installed versions in search results
When outputting a list of packages, it's important to remove the available
package if the same version is installed.
This is required, as the user may do SearchName("kernel",filter="none")
and only want to return results that can be operated on.
For instance, suppose we have installed:
kernel-2.6.29.4-167 (installed)
kernel-2.6.29.5-191 (installed)
And in the remote software sources we have:
kernel-2.6.29.4-167 (fedora)
kernel-2.6.29.5-191 (fedora-updates)
kernel-2.6.30.1-203 (fedora-updates)
If we do Resolve("kernel",filter="none") we should expect:
kernel-2.6.29.4-167 (installed)
kernel-2.6.29.5-191 (installed)
kernel-2.6.30.1-203 (fedora-updates)
If the kernel-2.6.29.4-167 (fedora) result was returned,
this will be in the list of results, and is a valid install target.
The user will get very confused why 2.6.29.4-167 is both
installed and not installed.
Filter examples
Suppose we have installed:
kernel-2.6.29.4-167 (installed)
kernel-2.6.29.5-191 (installed)
In the remote software sources we have:
kernel-2.6.29.4-167 (fedora)
kernel-2.6.29.5-191 (fedora-updates)
kernel-2.6.30.1-203 (fedora-updates)
If we do Resolve("kernel",filter="none") we should expect:
kernel-2.6.29.4-167 (installed)
kernel-2.6.29.5-191 (installed)
kernel-2.6.30.1-203 (fedora-updates)
If we do Resolve("kernel",filter="installed") we should expect:
kernel-2.6.29.4-167 (installed)
kernel-2.6.29.5-191 (installed)
If we do Resolve("kernel",filter="~installed") we should expect:
kernel-2.6.30.1-203 (fedora-updates)
If we do Resolve("kernel",filter="newest;installed") we should expect:
kernel-2.6.29.5-191 (installed)
If we do Resolve("kernel",filter="newest") we should expect:
kernel-2.6.29.5-191 (installed)
kernel-2.6.30.1-203 (fedora-updates)
Error Enums
If you have to handle an error, try to use internal-error
as little as possible.
Just ask on the mailing list, and we can add some more error enums to
cover the type of error in an abstract way as possible.
Every error should have an enumerated type
(e.g. out-of-memory) and also an error description.
The error description is not translated and not converted into the users
locale.
The error description should be descriptive, as it's for power users
and people trying to debug the problem.
For instance, "Out of memory" is not helpful as an error description
that is reported in a bugzilla, but "Could not create database index" is.
For the description use ; to separate the lines if
required.
The following error enumerated types are available for use in all
backends:
Error
Description
out-of-memory
There is an out of memory condition
no-network
There is no network connection that can be used
not-supported
Not supported by the backend.
NOTE: You shouldn't be setting non-NULL in the compiled
backend symbol table if you find yourself using this.
internal-error
There was an unspecified internal error.
NOTE: Please try and be more specific.
If you are using this then we should probably add a new type.
no-cache
The operation is trying to read from the cache, but the cache
is not present or invalid
gpg-failure
There was a GPG failure in the transaction
package-id-invalid
The package ID is not valid for this transaction
package-not-installed
The package that is trying to be removed or updated is not
installed
package-not-found
The package that is trying to be removed or updated is not
installed
package-already-installed
The (single) package that is trying to be installed or updated is already
installed
all-packages-already-installed
Multiple package installs were attempted, but all of
them were already installed. The backend should
generate package-already-installed messages (not errors)
for each package.
package-download-failed
A package failed to download correctly
invalid-package-file
The file that is supposed to contain a package to
install is corrupt, or is not a valid package file
package-install-blocked
The backend's configuration or policy prevents the
install or updating of a package
dep-resolution-failed
Dependency resolution failed
filter-invalid
The filter was invalid.
NOTE: syntax checking is done in the backend loader, so you
should only use this if the filter is not supported by the
backend.
group-not-found
The specified software group was not found.
create-thread-failed
Failed to create a thread
transaction-error
There was a generic transaction error, but please give more
details in the description
transaction-cancelled
The transaction was cancelled as the result of a call
to Cancel()
repo-not-found
The repository name could not be found
repo-configuration-error
One of the enabled repositories has invalid configuration
repo-not-available
There was a (possibly transient) problem connecting to a
repository
cannot-remove-system-package
Could not remove a protected system package that is needed for
stable operation of the system
process-quit
The process was asked to quit, probably because it was cancelled
process-kill
The process was forcibly killed, probably because ignored the
quit request. This is probably due to it being cancelled
failed-config-parsing
Configuration files could not be read or parsed.
cannot-cancel
The Cancel() method was called, but it is too late to
cancel the current transaction.
cannot-get-lock
The backend could not acquire a lock on the underlying
package management system.
no-packages-to-update
UpdatePackages() was called, but there are no packages to update.
cannot-write-repo-config
RepoEnable() or RepoSetData() was called, but the
repository configuration file could not be written to.
local-install-failed
A local file could not be installed. The file might not
be readable, or it might not contain a valid package.
bad-gpg-signature
The package is signed with a GPG signature, but that
signature is not valid in some way.
package-corrupt
The downloaded package is corrupt.
file-not-found
The file could not be found on the system.
Group type
Groups are enumerated for localisation.
Backends should try to put packages in different groups if possible,
else just don't advertise SearchGroup and the options should not be
shown in the UI.
The following group enumerated types are available, but please check
libpackagekit/pk-enum.h for the latest list.
Group
Description
accessibility
Accessibility
accessories
Accessories
admin-tools
Admin tools
communication
Communication
desktop-gnome
Gnome
desktop-kde
KDE
desktop-dde
DDE
desktop-other
Other desktops
desktop-xfce
Xfce
education
Education
fonts
Fonts
games
Games
graphics
Graphics
internet
Internet
legacy
Legacy
localization
Localization
maps
Maps
network
Network
office
Office
other
Other
power-management
Power management
programming
Programming
publishing
Publishing
multimedia
Multimedia
security
Security
servers
Servers
system
System
virtualization
Virtualization
science
Science
documentation
Documentation
electronics
Electronics
vendor
Vendor
Cancellation
If you have a multipart transaction that can be aborted in one phase but
not another then the AllowCancel signal can be sent.
This allows for example the hif download to be cancelled, but not the
install transaction.
By cancelling a job all subtransactions are killed.
By default actions cannot be cancelled unless enabled in the backend.
Use AllowCancel(true) to enable cancellation
and AllowCancel(false) to disable it.
This can be done for any job type.
For compiled backends that are threaded, the
cancel() method can be used to terminate
the thread.
For spawned backends, there are two staggered signals send to allow
locks to be released or for the backend to clean up after itself:
Send the process SIGQUIT.
Wait 500ms
If the process has not already quit, send the process
SIGKILL to terminate it.
Transactions
PackageKit does not ask the user questions when the transaction is running.
It also supports a fire-and-forget method invocation, which means that transactions will
have one calling method, and have many signals going back to the caller.
Each transaction is a new path on the org.freedesktop.PackageKit
service, and to create a path you have to call CreateTransaction on the base
interface which creates the new DBUS path, and returns the new path for you to connect to.
In the libpackagekit binding, PkControl handles the base interface,
whilst PkClient handles all the transaction interface stuff.
The org.freedesktop.PackageKit.Transaction interface can be used
on the newly created path, but only used once.
New methods require a new transaction path (i.e. another call to CreateTransaction)
which is synchronous and thus very fast.
Transaction example: Success
A typical successful transaction would emit many signals such as
::Progress(), ::Package() and
::StatusChanged().
These are used to inform the client application of the current state,
so widgets such as icons or description text can be updated.
These different signals are needed for a few different reasons:
::StatusChanged(): The global state of the
transaction, which will be useful for some GUIs.
Examples include downloading or installing, and this is designed
to be a 40,000ft view of what is happening.
::Package(): Used to either return a result
(e.g. returning results of the SearchName() method)
or to return progress about a _specific_ package.
For instance, when doing UpdatePackages(), sending
::Package(downloading) and then
::Package(installing) for each package as processed
in the transaction allows a GUI to position the cursor on the worked
on package and show the correct icon for that package.
::ErrorCode(): to show an error to the user about
the transaction, which can be cleaned up before sending
::Finished().
::Finished(): to show the transaction has
finished, and others can be scheduled.
Transaction example: Failure
This is the typical transaction failure case when there is no network available.
The user is not given the chance to requeue the transaction as it is a fatal error.
Transaction example: Trusted
In this non-trivial example, a local file install is being attempted.
First the InstallFile is called with the only_trusted
flag set.
This will fail if the package does not have a valid GPG key, and ordinarily the transaction
would fail. What the client can do, e.g. using libpackagekit, is
to re-request the InstallFile with non-trusted.
This will use a different PolicyKit authentication, and allow the file to succeed.
So why do we bother calling only_trusted in the first place?
Well, the only_trusted PolicyKit role can be saved in the gnome-keyring, or could be
set to the users password as the GPG key is already only_trusted by the user.
The non-trusted action would likely ask for the administrator password,
and not allowed to be saved. This gives the user the benifit of installing only_trusted local
files without a password (common case) but requiring something stronger for untrusted or
unsigned files.
Transaction example: Auto Untrusted
If SimulateInstallPackage or
SimulateInstallFile is used then the client
may receive a INFO_UNTRUSTED package.
This is used to inform the client that the action would require
the untrusted authentication type, which means the client does
not attempt to do SimulateInstallPackage(only_trusted=TRUE)
and only does SimulateInstallPackage(only_trusted=FALSE).
This ensures the user has to only authenticate once for the
transaction as the only_trusted=TRUE action
may also require a password.
Transaction example: Package signature install
If the package is signed, and a valid GPG signature is available, then we need to ask the
user to import the key, and re-run the transaction.
This is done as three transactions, as other transactions may be queued and have a higher
priority, and to make sure that the transaction object is not reused.
Keep in mind that PackageKit can only be running one transaction at any
one time.
If we had designed the PackageKit API to block and wait for user input,
then no other transactions could be run whilst we are waiting for the user.
This is best explained using an example:
User clicks "install vmware" followed by "confirm".
User walks away from the computer and takes a nap
System upgrade is scheduled (300Mb of updates)
The vmware package is downloaded, but cannot be installed until a EULA
is agreed to.
If we pause the transaction then we never apply the updates automatically
and the computer is not kept up to date.
The user would have to wait a substantial amount of time waiting for
the updates to download when returning from his nap after clicking "I agree"
to the vmware EULA.
In the current system where transactions cannot block, the first
transaction downloads vmware, and then it finishes, and puts up a UI
for the user to click.
In the meantime the second transaction (the update) is scheduled,
downloaded and installed, and then finishes.
The user returns, clicks "okay" and a third transaction is created that
accepts the eula, and a forth that actually installs vmware.
It seems complicated, but it's essential to make sure none of the
callbacks block and stop other transactions from happening.
Transaction example: Download
When the DownloadPackages() method is called on a number
of packages, then these are downloaded by the daemon into a temporary
directory.
This directory can only be written by the packagekitd
user (usually root) but can be read by all users.
The files are not downloaded into any specific directory, instead a
random one is created in /var/cache/PackageKit/downloads.
The reason for this intermediate step is that the
DownloadPackages() method does not take a destination
directory as the dameon is running as a different user to the user,
and in a different SELinux context.
To preserve the SELinux attributes and the correct user and group ownership
of the newly created files, the client (running in the user session) has
to copy the files from the temporary directory into the chosen destination
directory.
NOTE: this copy step is optional but recommended, as the files will remain in
the temporary directory until the daemon is times out and is restarted.
As the client does not know (intentionally) the temporary directory or the
filenames of the packages that are created, the ::Files()
signal is emitted with the full path of the downloaded files.
It is expected the package_id parameter of
::Files() will be blank, although this is not mandated.
Multiple ::Files() signals can be sent by the dameon,
as the download operation may be pipelined, and the client should honour
every signal by copying each file.
Transaction example: Setting the locale
The PackageKit backend may support native localisation, which we should support if the
translations exist.
In the prior examples the SetLocale() method has been left out for brevity.
If you are using the raw DBUS methods to access PackageKit, you will also need to make
a call to SetLocale() so the daemon knows what locale to assign the
transaction.
If you are using libpackagekit to schedule transactions, then the locale will be set
automatically in the PkControl GObject, and you do not need to call
pk_client_set_locale() manually.
Transaction example: Repair
If the package management system is damaged, a repair may be required.
This is not automatically done befor each transaction as the user
may have to verify destructive package actions or make manual changes to
configuration files.
This transaction sequence is not common and is not supported on
many backends.
It may be completely implemented in the frontend or not at all.
Transaction IDs
A transaction_id is a unique identifier that
identifies the present or past transaction.
A transaction is made up of one or more sub-transactions.
A transaction has one role for the entire lifetime,
but the transaction can different values of status
as the transaction is processed.
For example, if the user "Installed OpenOffice" and the backend has to:
update libxml2 as a dependency
install java as dependency
install openoffice-bin
install openoffice-clipart
This is one single transaction with the role install,
with 4 different sub-transactions.
The transaction_id must be of the format
/job_identifier_data where the daemon controls
all parameters.
job is a monotonically updating number and is
retained over reboots.
identifier is random data used by the daemon to
ensure jobs started in parallel cannot race, and also to make a
malicious client program harder to write.
data can be used for ref-counting in the backend or
for any other purpose.
It is designed to make the life of a backend writer a little bit easier.
An example transaction_id would be
/45_dafeca_checkpoint32
Status Values
A transaction will have different status values as it it queued, prepared
and executed.
The ::StatusChanged signal from PkClient allow you
to design user interfaces that tell the user what is happening with the
transaction.
A typical transaction will have the following states:
Queued in the active queue (PK_STATUS_ENUM_WAIT)
Transaction started, and is being prepared (PK_STATUS_ENUM_SETUP)
The transaction is running (PK_STATUS_ENUM_RUNNING)
(optional) Data is downloading (PK_STATUS_ENUM_DOWNLOADING)
(optional) Data is installing (PK_STATUS_ENUM_INSTALLING)
The transaction is finished (PK_STATUS_ENUM_FINISHED)
If the transaction is waiting for other jobs to finish (in the active queue)
then the status will be stuck at PK_STATUS_ENUM_WAIT
and the UI should show a message to this effect.
If the transaction is waiting for a package lock (when a legacy tool like
pirut is loaded and has the hif lock)
then the transaction will be stuck at PK_STATUS_ENUM_WAITING_FOR_LOCK.
As a backend writer, you do not have to set PK_STATUS_ENUM_RUNNING
manually, as this will be set for you if you set any other value such as
PK_STATUS_ENUM_DOWNLOADING or PK_STATUS_ENUM_INFO.
However, you will need to avoid setting any status values until a package
lock is available and the transaction has started.