Compressors are specified in description file.
For example:

[compressor]
gzip = *
none = *.gz, *.bz2
bzip2 = rootfs*

This description file set gzip as default compressor, do not compress payload
which end with .gz and .bz2 and use bzip2 as compressor for payload matching
'rootfs*'

Signed-off-by: Sébastien Luttringer <sebastien.luttringer@smartjog.com>

configobj keeps the order of options in config file, we don't need to use
OrderedDict.

Seblu: Sad :'(

Signed-off-by: Sébastien Luttringer <sebastien.luttringer@smartjog.com>

It is in the RST format, so this adds python-docutils as a build-dependency.

Signed-off-by: Sébastien Luttringer <sebastien.luttringer@smartjog.com>

With the permission of Romain Degez, CTO of Smartjog and Sébastien Luttringer.

Signed-off-by: Sébastien Luttringer <sebastien.luttringer@smartjog.com>

Signed-off-by: Sébastien Luttringer <sebastien.luttringer@smartjog.com>

This function walk across a directory, for every template which match the
extension, remplace by the rendered file with the same mode/uid/gid as the
template file.
Use jinja2 as template engine.

Signed-off-by: Sébastien Luttringer <sebastien.luttringer@smartjog.com>

E: python-installsystems: depends-on-essential-package-without-using-version depends: gzip
E: python-installsystems: depends-on-essential-package-without-using-version depends: tar
N:
N:    The package declares a depends on an essential package, e.g. dpkg,
N:    without using a versioned depends. Packages do not need to depend on
N:    essential packages; essential means that they will always be present.
N:    The only reason to list an explicit dependency on an essential package
N:    is if you need a particular version of that package, in which case the
N:    version should be given in the dependency.
N:
N:    Refer to Debian Policy Manual section 3.5 (Dependencies) for details.
N:
N:    Severity: important, Certainty: certain
N:

E: installsystems source: missing-python-build-dependency
N:
N:    The package appears to use Python as part of its build process in
N:    debian/rules but doesn't depend on Python.
N:
N:    Normally, packages that use Python as part of the build process should
N:    build-depend on one of python, python-all, python-dev, or python-all-dev
N:    depending on whether they support multiple versions of Python and
N:    whether they're building modules or only using Python as part of the
N:    package build process. Packages that depend on a specific version of
N:    Python may build-depend on the appropriate pythonX.Y or pythonX.Y-dev
N:    package instead.
N:
N:    Refer to Debian Policy Manual section 4.2 (Package relationships) for
N:    details.
N:
N:    Severity: important, Certainty: certain
N:

We now use system tar and gzip to compress/decompress payloads

Goals are:
- Speed-up extraction and creation of payloads.
- Allow to use non-python supported compressor like (pbzip2 and xz)
- Remove python2.7.1 tarfile.py module
- Remove python 2.7.1 gzip.py to avoid filename to be in gzip headers
- Remove gzipstream.py module used to stream gzip file

this options are also settable by config
allow to have installsystems niced before launch action

python-psutil minimun version is 0.2.1 to support set_ionice

we need python-progressbar >= 2.3 to work with is.
We previously ship inside it because debian doesn't have 2.3 package available.
now we have built a debian package, we can remove code and add a dependency

python-argparse (1.1) shipped with debian squeeze is bugged and doesn't work with installsystems needs
python-argparse 1.2.1 (last upstream version) was backported into squeeze and we need it.

argparse is available in python2.7 (archlinux) and on python-argparse package in debian. So
we add a dependency to this package.

We need installsystems is functional on squeeze systems...

So we needs to embed:
- argparse 2.7.1 (not in python2.6)
- progressbar 2.3 (not in debian squeeze)

This commit introduce remote repository and file accross ssh

We now use PipeFile to handle complex file type and compute md5 and filesize.

This commit add the following features in installsystems:
- A download progress bad
- check size before download
- check size after download
- check md5 after download

This will help remi to be cool and save some day in his life