Added no-cache cache control to APT.

[apt-legacy.git] / doc / apt-ftparchive.1

.\"     Title: apt\-ftparchive
.\"    Author: Jason Gunthorpe
.\" Generator: DocBook XSL Stylesheets v1.71.0 <http://docbook.sf.net/>
.\"      Date: 29 February 2004
.\"    Manual: 
.\"    Source: Linux
.\"
.TH "APT\-FTPARCHIVE" "1" "29 February 2004" "Linux" ""
.\" disable hyphenation
.nh
.\" disable justification (adjust text to left margin only)
.ad l
.SH "NAME"
apt\-ftparchive \- Utility to generate index files
.SH "SYNOPSIS"
.HP 15
\fBapt\-ftparchive\fR [\fB\-hvdsq\fR] [\fB\-\-md5\fR] [\fB\-\-delink\fR] [\fB\-\-readonly\fR] [\fB\-\-contents\fR] [\fB\-o=\fR\fB\fIconfig\ string\fR\fR] [\fB\-c=\fR\fB\fIfile\fR\fR] {[packages\ \fIpath\fR...\ [\fIoverride\fR\ [\fIpathprefix\fR]]] | [sources\ \fIpath\fR...\ [\fIoverride\fR\ [\fIpathprefix\fR]]] | [contents\ \fIpath\fR] | [release\ \fIpath\fR] | [generate\ \fIconfig\-file\fR\ \fIsection\fR...] | [clean\ \fIconfig\-file\fR]}
.SH "DESCRIPTION"
.PP
\fBapt\-ftparchive\fR
is the command line tool that generates the index files that APT uses to access a distribution source. The index files should be generated on the origin site based on the content of that site.
.PP
\fBapt\-ftparchive\fR
is a superset of the
\fBdpkg\-scanpackages\fR(8)
program, incorporating its entire functionality via the
packages
command. It also contains a contents file generator,
contents, and an elaborate means to 'script' the generation process for a complete archive.
.PP
Internally
\fBapt\-ftparchive\fR
can make use of binary databases to cache the contents of a .deb file and it does not rely on any external programs aside from
\fBgzip\fR(1). When doing a full generate it automatically performs file\-change checks and builds the desired compressed output files.
.PP
Unless the
\fB\-h\fR, or
\fB\-\-help\fR
option is given one of the commands below must be present.
.PP
packages
.RS 3n
The packages command generates a package file from a directory tree. It takes the given directory and recursively searches it for .deb files, emitting a package record to stdout for each. This command is approximately equivalent to
\fBdpkg\-scanpackages\fR(8).
.sp
The option
\fB\-\-db\fR
can be used to specify a binary caching DB.
.RE
.PP
sources
.RS 3n
The
sources
command generates a source index file from a directory tree. It takes the given directory and recursively searches it for .dsc files, emitting a source record to stdout for each. This command is approximately equivalent to
\fBdpkg\-scansources\fR(8).
.sp
If an override file is specified then a source override file will be looked for with an extension of .src. The \-\-source\-override option can be used to change the source override file that will be used.
.RE
.PP
contents
.RS 3n
The
contents
command generates a contents file from a directory tree. It takes the given directory and recursively searches it for .deb files, and reads the file list from each file. It then sorts and writes to stdout the list of files matched to packages. Directories are not written to the output. If multiple packages own the same file then each package is separated by a comma in the output.
.sp
The option
\fB\-\-db\fR
can be used to specify a binary caching DB.
.RE
.PP
release
.RS 3n
The
release
command generates a Release file from a directory tree. It recursively searches the given directory for Packages, Packages.gz, Packages.bz2, Sources, Sources.gz, Sources.bz2, Release and md5sum.txt files. It then writes to stdout a Release file containing an MD5 digest and SHA1 digest for each file.
.sp
Values for the additional metadata fields in the Release file are taken from the corresponding variables under
APT::FTPArchive::Release, e.g.
APT::FTPArchive::Release::Origin. The supported fields are:
Origin,
Label,
Suite,
Version,
Codename,
Date,
Architectures,
Components,
Description.
.RE
.PP
generate
.RS 3n
The
generate
command is designed to be runnable from a cron script and builds indexes according to the given config file. The config language provides a flexible means of specifying which index files are built from which directories, as well as providing a simple means of maintaining the required settings.
.RE
.PP
clean
.RS 3n
The
clean
command tidies the databases used by the given configuration file by removing any records that are no longer necessary.
.RE
.SH "THE GENERATE CONFIGURATION"
.PP
The
generate
command uses a configuration file to describe the archives that are going to be generated. It follows the typical ISC configuration format as seen in ISC tools like bind 8 and dhcpd.
\fBapt.conf\fR(5)
contains a description of the syntax. Note that the generate configuration is parsed in sectional manner, but
\fBapt.conf\fR(5)
is parsed in a tree manner. This only effects how the scope tag is handled.
.PP
The generate configuration has 4 separate sections, each described below.
.SS "Dir Section"
.PP
The
Dir
section defines the standard directories needed to locate the files required during the generation process. These directories are prepended to certain relative paths defined in later sections to produce a complete an absolute path.
.PP
ArchiveDir
.RS 3n
Specifies the root of the FTP archive, in a standard Debian configuration this is the directory that contains the
\fIls\-LR\fR
and dist nodes.
.RE
.PP
OverrideDir
.RS 3n
Specifies the location of the override files.
.RE
.PP
CacheDir
.RS 3n
Specifies the location of the cache files
.RE
.PP
FileListDir
.RS 3n
Specifies the location of the file list files, if the
FileList
setting is used below.
.RE
.SS "Default Section"
.PP
The
Default
section specifies default values, and settings that control the operation of the generator. Other sections may override these defaults with a per\-section setting.
.PP
Packages::Compress
.RS 3n
Sets the default compression schemes to use for the Package index files. It is a string that contains a space separated list of at least one of: '.' (no compression), 'gzip' and 'bzip2'. The default for all compression schemes is '. gzip'.
.RE
.PP
Packages::Extensions
.RS 3n
Sets the default list of file extensions that are package files. This defaults to '.deb'.
.RE
.PP
Sources::Compress
.RS 3n
This is similar to
Packages::Compress
except that it controls the compression for the Sources files.
.RE
.PP
Sources::Extensions
.RS 3n
Sets the default list of file extensions that are source files. This defaults to '.dsc'.
.RE
.PP
Contents::Compress
.RS 3n
This is similar to
Packages::Compress
except that it controls the compression for the Contents files.
.RE
.PP
DeLinkLimit
.RS 3n
Specifies the number of kilobytes to delink (and replace with hard links) per run. This is used in conjunction with the per\-section
External\-Links
setting.
.RE
.PP
FileMode
.RS 3n
Specifies the mode of all created index files. It defaults to 0644. All index files are set to this mode with no regard to the umask.
.RE
.SS "TreeDefault Section"
.PP
Sets defaults specific to
Tree
sections. All of these variables are substitution variables and have the strings $(DIST), $(SECTION) and $(ARCH) replaced with their respective values.
.PP
MaxContentsChange
.RS 3n
Sets the number of kilobytes of contents files that are generated each day. The contents files are round\-robined so that over several days they will all be rebuilt.
.RE
.PP
ContentsAge
.RS 3n
Controls the number of days a contents file is allowed to be checked without changing. If this limit is passed the mtime of the contents file is updated. This case can occur if the package file is changed in such a way that does not result in a new contents file [override edit for instance]. A hold off is allowed in hopes that new .debs will be installed, requiring a new file anyhow. The default is 10, the units are in days.
.RE
.PP
Directory
.RS 3n
Sets the top of the .deb directory tree. Defaults to
\fI$(DIST)/$(SECTION)/binary\-$(ARCH)/\fR
.RE
.PP
SrcDirectory
.RS 3n
Sets the top of the source package directory tree. Defaults to
\fI$(DIST)/$(SECTION)/source/\fR
.RE
.PP
Packages
.RS 3n
Sets the output Packages file. Defaults to
\fI$(DIST)/$(SECTION)/binary\-$(ARCH)/Packages\fR
.RE
.PP
Sources
.RS 3n
Sets the output Packages file. Defaults to
\fI$(DIST)/$(SECTION)/source/Sources\fR
.RE
.PP
InternalPrefix
.RS 3n
Sets the path prefix that causes a symlink to be considered an internal link instead of an external link. Defaults to
\fI$(DIST)/$(SECTION)/\fR
.RE
.PP
Contents
.RS 3n
Sets the output Contents file. Defaults to
\fI$(DIST)/Contents\-$(ARCH)\fR. If this setting causes multiple Packages files to map onto a single Contents file (such as the default) then
\fBapt\-ftparchive\fR
will integrate those package files together automatically.
.RE
.PP
Contents::Header
.RS 3n
Sets header file to prepend to the contents output.
.RE
.PP
BinCacheDB
.RS 3n
Sets the binary cache database to use for this section. Multiple sections can share the same database.
.RE
.PP
FileList
.RS 3n
Specifies that instead of walking the directory tree,
\fBapt\-ftparchive\fR
should read the list of files from the given file. Relative files names are prefixed with the archive directory.
.RE
.PP
SourceFileList
.RS 3n
Specifies that instead of walking the directory tree,
\fBapt\-ftparchive\fR
should read the list of files from the given file. Relative files names are prefixed with the archive directory. This is used when processing source indexs.
.RE
.SS "Tree Section"
.PP
The
Tree
section defines a standard Debian file tree which consists of a base directory, then multiple sections in that base directory and finally multiple Architectures in each section. The exact pathing used is defined by the
Directory
substitution variable.
.PP
The
Tree
section takes a scope tag which sets the
$(DIST)
variable and defines the root of the tree (the path is prefixed by
ArchiveDir). Typically this is a setting such as
\fIdists/woody\fR.
.PP
All of the settings defined in the
TreeDefault
section can be use in a
Tree
section as well as three new variables.
.PP
When processing a
Tree
section
\fBapt\-ftparchive\fR
performs an operation similar to:
.sp .RS 3n .nf for i in Sections do for j in Architectures do Generate for DIST=scope SECTION=i ARCH=j .fi .RE
.PP
Sections
.RS 3n
This is a space separated list of sections which appear under the distribution, typically this is something like
main contrib non\-free
.RE
.PP
Architectures
.RS 3n
This is a space separated list of all the architectures that appear under search section. The special architecture 'source' is used to indicate that this tree has a source archive.
.RE
.PP
BinOverride
.RS 3n
Sets the binary override file. The override file contains section, priority and maintainer address information.
.RE
.PP
SrcOverride
.RS 3n
Sets the source override file. The override file contains section information.
.RE
.PP
ExtraOverride
.RS 3n
Sets the binary extra override file.
.RE
.PP
SrcExtraOverride
.RS 3n
Sets the source extra override file.
.RE
.SS "BinDirectory Section"
.PP
The
bindirectory
section defines a binary directory tree with no special structure. The scope tag specifies the location of the binary directory and the settings are similar to the
Tree
section with no substitution variables or
SectionArchitecture
settings.
.PP
Packages
.RS 3n
Sets the Packages file output.
.RE
.PP
Sources
.RS 3n
Sets the Sources file output. At least one of
Packages
or
Sources
is required.
.RE
.PP
Contents
.RS 3n
Sets the Contents file output. (optional)
.RE
.PP
BinOverride
.RS 3n
Sets the binary override file.
.RE
.PP
SrcOverride
.RS 3n
Sets the source override file.
.RE
.PP
ExtraOverride
.RS 3n
Sets the binary extra override file.
.RE
.PP
SrcExtraOverride
.RS 3n
Sets the source extra override file.
.RE
.PP
BinCacheDB
.RS 3n
Sets the cache DB.
.RE
.PP
PathPrefix
.RS 3n
Appends a path to all the output paths.
.RE
.PP
FileList, SourceFileList
.RS 3n
Specifies the file list file.
.RE
.SH "THE BINARY OVERRIDE FILE"
.PP
The binary override file is fully compatible with
\fBdpkg\-scanpackages\fR(8). It contains 4 fields separated by spaces. The first field is the package name, the second is the priority to force that package to, the third is the the section to force that package to and the final field is the maintainer permutation field.
.PP
The general form of the maintainer field is:
.sp
.RS 3n
.nf
old [// oldn]* => new
.fi
.RE
.sp
or simply,
.sp
.RS 3n
.nf
new
.fi
.RE
.sp
The first form allows a double\-slash separated list of old email addresses to be specified. If any of those are found then new is substituted for the maintainer field. The second form unconditionally substitutes the maintainer field.
.SH "THE SOURCE OVERRIDE FILE"
.PP
The source override file is fully compatible with
\fBdpkg\-scansources\fR(8). It contains 2 fields separated by spaces. The first fields is the source package name, the second is the section to assign it.
.SH "THE EXTRA OVERRIDE FILE"
.PP
The extra override file allows any arbitrary tag to be added or replaced in the output. It has 3 columns, the first is the package, the second is the tag and the remainder of the line is the new value.
.SH "OPTIONS"
.PP
All command line options may be set using the configuration file, the descriptions indicate the configuration option to set. For boolean options you can override the config file by using something like
\fB\-f\-\fR,\fB\-\-no\-f\fR,
\fB\-f=no\fR
or several other variations.
.PP
\fB\-\-md5\fR
.RS 3n
Generate MD5 sums. This defaults to on, when turned off the generated index files will not have MD5Sum fields where possible. Configuration Item:
APT::FTPArchive::MD5
.RE
.PP
\fB\-d\fR, \fB\-\-db\fR
.RS 3n
Use a binary caching DB. This has no effect on the generate command. Configuration Item:
APT::FTPArchive::DB.
.RE
.PP
\fB\-q\fR, \fB\-\-quiet\fR
.RS 3n
Quiet; produces output suitable for logging, omitting progress indicators. More q's will produce more quiet up to a maximum of 2. You can also use
\fB\-q=#\fR
to set the quiet level, overriding the configuration file. Configuration Item:
quiet.
.RE
.PP
\fB\-\-delink\fR
.RS 3n
Perform Delinking. If the
External\-Links
setting is used then this option actually enables delinking of the files. It defaults to on and can be turned off with
\fB\-\-no\-delink\fR. Configuration Item:
APT::FTPArchive::DeLinkAct.
.RE
.PP
\fB\-\-contents\fR
.RS 3n
Perform contents generation. When this option is set and package indexes are being generated with a cache DB then the file listing will also be extracted and stored in the DB for later use. When using the generate command this option also allows the creation of any Contents files. The default is on. Configuration Item:
APT::FTPArchive::Contents.
.RE
.PP
\fB\-s\fR, \fB\-\-source\-override\fR
.RS 3n
Select the source override file to use with the
sources
command. Configuration Item:
APT::FTPArchive::SourceOverride.
.RE
.PP
\fB\-\-readonly\fR
.RS 3n
Make the caching databases read only. Configuration Item:
APT::FTPArchive::ReadOnlyDB.
.RE
.PP
\fB\-h\fR, \fB\-\-help\fR
.RS 3n
Show a short usage summary.
.RE
.PP
\fB\-v\fR, \fB\-\-version\fR
.RS 3n
Show the program version.
.RE
.PP
\fB\-c\fR, \fB\-\-config\-file\fR
.RS 3n
Configuration File; Specify a configuration file to use. The program will read the default configuration file and then this configuration file. See
\fBapt.conf\fR(5)
for syntax information.
.RE
.PP
\fB\-o\fR, \fB\-\-option\fR
.RS 3n
Set a Configuration Option; This will set an arbitary configuration option. The syntax is
\fB\-o Foo::Bar=bar\fR.
.RE
.SH "EXAMPLES"
.PP
To create a compressed Packages file for a directory containing binary packages (.deb):
.sp
.RS 3n
.nf
\fBapt\-ftparchive\fR packages \fIdirectory\fR | \fBgzip\fR > \fIPackages.gz\fR
.fi
.RE
.SH "SEE ALSO"
.PP
\fBapt.conf\fR(5)
.SH "DIAGNOSTICS"
.PP
\fBapt\-ftparchive\fR
returns zero on normal operation, decimal 100 on error.
.SH "BUGS"
.PP
[1]\&\fIAPT bug page\fR. If you wish to report a bug in APT, please see
\fI/usr/share/doc/debian/bug\-reporting.txt\fR
or the
\fBreportbug\fR(1)
command.
.SH "AUTHORS"
.PP
\fBJason Gunthorpe\fR
.sp -1n
.IP "" 3n
Author.
.PP
\fBAPT team\fR
.sp -1n
.IP "" 3n
Author.
.SH "REFERENCES"
.TP 3
1.\ APT bug page
\%http://bugs.debian.org/src:apt