rockdrilla/mmdebstrap
1
0
Fork 0
forked from josch/mmdebstrap
Code Issues Pull requests Projects Releases Wiki Activity
1056 commits 2 branches 0 tags 17 MiB
Commit graph

592 commits

Author SHA1 Message Date
Johannes 'josch' Schauer
43ca8a5211
it is wrong to match the suite for the package set selection if more than one apt index is given (because the suite name might be equal) instead check whether there is more than zero matching and more than zero not-matching suites 2020-12-02 00:47:16 +01:00
Johannes 'josch' Schauer
2c232e0661
don't ignore packages added via --include if multiple apt indices are used 2020-12-02 00:33:18 +01:00
Johannes 'josch' Schauer
85328c5c7e
mmdebstrap: check for defined-ness before integer comparison 2020-11-29 20:54:50 +01:00
Johannes 'josch' Schauer
165cc82f97
preserve permissions of /etc/resolv.conf and /etc/hostname and resolve symlinks as debootstrap does it 2020-11-29 20:54:31 +01:00
Johannes 'josch' Schauer
beb0b8c177
name solver mmdebstrap-dump-solution in official apt path 2020-11-29 02:30:03 +01:00
Johannes 'josch' Schauer
f76bcb5750
release 0.7.2 2020-11-28 14:32:14 +01:00
Johannes 'josch' Schauer
732fde54f8
documentation improvements, add OPERATION section 2020-11-28 14:30:50 +01:00
Johannes 'josch' Schauer
da449be3fe
fix missing I in front of <> 2020-11-28 00:49:46 +01:00
Johannes 'josch' Schauer
2e19a8bda4
remove nonsense code comment 2020-11-28 00:48:38 +01:00
Johannes 'josch' Schauer
96f45ec2e7
info messages start with lower case character 2020-11-28 00:48:18 +01:00
Johannes 'josch' Schauer
b7e257871d
use Debian::DistroInfo if available 2020-11-28 00:46:48 +01:00
Johannes 'josch' Schauer
b2ea7b230f
remove no-op if statement 2020-11-28 00:45:54 +01:00
Johannes 'josch' Schauer
1e7e002eb1
print explicit info message about installing essential packages 2020-11-28 00:45:32 +01:00
Johannes 'josch' Schauer
ad56754a2a
pkgs_to_install might contain duplicates when multiple suites are used -- avoid that by using a hash instead of an array 2020-11-15 22:58:26 +01:00
Johannes 'josch' Schauer
0c990abc48
coverage.sh: only consider non-POD parts for maximum line length check 2020-11-15 11:30:04 +01:00
Johannes 'josch' Schauer
534798dbd2
add example for how to use a cache directory 2020-11-15 11:27:51 +01:00
Johannes 'josch' Schauer
12b26a8817
use /usr/share/distro-info/debian.csv to figure out the security mirror for bullseye and beyond 2020-11-15 10:14:03 +01:00
Johannes 'josch' Schauer
9d32dee3f5
if a suite name was specified, use the matching apt index to figure out the package set to install 2020-11-14 23:25:07 +01:00
Johannes 'josch' Schauer
21a26b5dac
pass verbosity to hook-listener 2020-11-13 22:37:53 +01:00
Johannes 'josch' Schauer
e71487af5e
improve hook-helper and hook-listener debug output 2020-11-13 22:36:58 +01:00
Johannes 'josch' Schauer
bf87e83bdb
make it possible to seed /var/cache/apt/archives with deb packages 2020-11-13 19:02:41 +01:00
Johannes 'josch' Schauer
50d8d5edae
check whether dpkg, apt and others are installed (closes: #18) 2020-11-12 22:36:10 +01:00
Johannes 'josch' Schauer
0a985948cf
create temporary test ext2 image in TMPDIR and not in CWD 2020-11-12 15:49:10 +01:00
Johannes 'josch' Schauer
1000a033e8
release 0.7.1 2020-09-18 13:43:42 +02:00
Johannes 'josch' Schauer
259a188e06
fix typo: 3030 -> 2020 (thanks Trent W. Buck!) 2020-09-02 22:58:50 +02:00
Johannes 'josch' Schauer
65e40c8c34
redirect stderr of dpkg --version to /dev/null to prevent error output if dpkg is too old (thanks Trent W. Buck!) 2020-09-02 22:58:20 +02:00
Johannes 'josch' Schauer
58925dc493
add two more debug messages 2020-08-28 14:36:14 +02:00
Johannes 'josch' Schauer
400b51ad7b
release 0.7.0 2020-08-27 20:52:47 +02:00
Johannes 'josch' Schauer
3713735240
document non-functional --variant=standard due to bug #968217 2020-08-25 18:08:35 +02:00
Johannes 'josch' Schauer
7c752fa8a0
print elapsed time after successful run 2020-08-25 18:08:31 +02:00
Johannes 'josch' Schauer
74725ac451
coverage.sh: test eatmydata and merged-usr hooks 2020-08-25 16:05:10 +02:00
Johannes 'josch' Schauer
465c056434
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility 2020-08-25 13:02:33 +02:00
Johannes 'josch' Schauer
8f09c3e02f
unless in chrootless mode, omitting stuff in /var/lib/dpkg does not depend on the dpkg version outside, but on the version inside the chroot (and we don't know that one yet) 2020-08-24 18:45:22 +02:00
Johannes 'josch' Schauer
dd64e8220d
use distro-info-data and debootstrap to help with suite name and keyring discovery 2020-08-24 18:45:22 +02:00
Johannes 'josch' Schauer
87d383d754
replace -t STDERR with a common function that explains the 'no critic' annotation 2020-08-24 18:45:18 +02:00
Johannes 'josch' Schauer
307cbf5a41
prefix certain progress bars with what is being done (closes: #16) 2020-08-18 14:31:38 +02:00
Johannes 'josch' Schauer
df18304449
add a new pipe to communicate the number of blocks to the parent instead of abusing the hookhelper/listener 2020-08-18 12:08:55 +02:00
Johannes 'josch' Schauer
a5ea38cbad
fix docs: there are four hooks, not three 2020-08-18 09:38:22 +02:00
Johannes 'josch' Schauer
0451d5f004
do not suggest using --dpkgopt=force-unsafe-io because it barely brings any speedups, see Debian bug #613428 2020-08-18 09:37:53 +02:00
Johannes 'josch' Schauer
614ef0e43d
make it clear that --aptopt and --dpkgopt add their content permamently 2020-08-18 09:37:08 +02:00
Johannes 'josch' Schauer
23fb2055e4
fix error message to specify the right command 2020-08-18 09:36:27 +02:00
Johannes 'josch' Schauer
501e29fdeb
fix closedir calls 2020-08-18 09:35:56 +02:00
Johannes 'josch' Schauer
12f41ad33f
fix syntax for perltidy 2020-08-17 18:57:36 +02:00
Johannes 'josch' Schauer
075645289f
add --hook-directory option and a directory with hooks 2020-08-16 00:50:46 +02:00
Johannes 'josch' Schauer
e2a759967f
put hook listener into its own function and expose it to the CLI via --hook-listener 2020-08-15 22:36:13 +02:00
Johannes 'josch' Schauer
c2c270390b
implement dpkg-realpath in perl so that we don't need to run tar inside the chroot anymore for modes other than fakechroot and proot 2020-08-15 18:29:17 +02:00
Johannes 'josch' Schauer
dc67c1f4be
if we got dpkg >= 1.20.0, then we don't have to create certain files and directories ourselves 2020-08-15 18:09:06 +02:00
Johannes 'josch' Schauer
904274b9f4
adjust genext2fs (>= 1.5.0) interface 2020-07-09 07:34:03 +02:00
Johannes 'josch' Schauer
112c0a5a6d
add documentation about --{setup,extract,essential,customize}-hooks and --skip option, making them an official interface 2020-06-23 23:14:37 +02:00
Johannes 'josch' Schauer
40b6155967
add another --dpkgopt example 2020-06-23 23:12:16 +02:00
Johannes 'josch' Schauer
4d041140d5
instead of 'du' we use File::Find to avoid different results on different filesystems, see https://bugs.debian.org/650077 for a discussion 2020-06-23 22:45:17 +02:00
Johannes 'josch' Schauer
655857e525
don't use apt sandboxing in fakechroot or proot modes 2020-06-08 15:45:22 +02:00
Johannes 'josch' Schauer
af13116336
do not hide errors even with --quiet 
This change also fixes the problem that when --quiet is given, an error
will never lead to a non-zero exit status because the error function
returns before it runs die()
 2020-05-10 13:36:54 +02:00
Johannes 'josch' Schauer
dc9a5dc281
document how to use mmdebstrap as a debootstrap wrapper 2020-05-03 17:19:03 +02:00
Johannes 'josch' Schauer
fa12e4f488
create /tmp with chmod 01777 2020-05-03 17:18:34 +02:00
Johannes 'josch' Schauer
b60893aa83
add --skip=output/dev 2020-05-03 15:06:41 +02:00
Johannes 'josch' Schauer
e1d0a17751
return immediately if nothing to do in download, extract and essential stages 2020-05-03 15:06:24 +02:00
Johannes 'josch' Schauer
ccae6de410
fix message 'failed to start' -> 'failed to run' 2020-05-02 23:55:34 +02:00
Johannes 'josch' Schauer
be2bb0bb7e
do not emit a tarball with xattrs for squashfs and ext2 output because tar2sqfs and genext2fs do not support extended attributes 2020-05-02 23:55:05 +02:00
Johannes 'josch' Schauer
da88c56b9f
warn if chrootless mode is run by the root user 2020-05-02 23:54:04 +02:00
Johannes 'josch' Schauer
6af46f0b4a
fix typo squasfs -> squashfs 2020-05-02 23:53:41 +02:00
Johannes 'josch' Schauer
08319f6c77
Return the same block number irrespective of what is in /dev 
Depending on the mode an on whether mknod works (mount options of
$TMPDIR) different stuff might be in /dev. To make the blocksize in of
the ext2 output format reproducible, ignore the content of /dev.
 2020-05-02 23:51:58 +02:00
Johannes 'josch' Schauer
af5841269c
always check if _apt user can access /var/lib/apt/lists/partial 2020-05-02 23:51:33 +02:00
Johannes 'josch' Schauer
af4e77903b
add instructions how to convert from ext2 to ext3 and ext4 2020-05-02 00:12:31 +02:00
Johannes 'josch' Schauer
3b67de6d31
add note about the dangers of chrootless mode 2020-05-02 00:12:31 +02:00
Johannes 'josch' Schauer
5cf209996e
format mmdebstrap bold in POD 2020-05-02 00:12:31 +02:00
Johannes 'josch' Schauer
4ea784c1bc
add --skip check/empty 2020-05-02 00:12:26 +02:00
Johannes 'josch' Schauer
1b380e4513
add --skip check/qemu 2020-05-01 07:39:26 +02:00
Helmut Grohne
d7f7f8cb34
skip the emulation check in chrootless mode 
Whenever the selected architecture differs from the native architecture
of the system that runs mmdebstrap, mmdebstrap checks whether it can run
the selected architecture. In the majority of cases, this is good and
helps avoid difficult to diagnose issues. However when running in
chrootless mode, we don't actually want to run any binaries from the
target system. For that reason, the emulation check should be skipped in
chrootless mode.
 2020-04-14 18:25:55 +02:00
Johannes 'josch' Schauer
9717faef59
refer to MODES section in docs for directory format 2020-04-12 09:11:35 +02:00
Johannes 'josch' Schauer
2678ccaf38
mention missing TARGET in docs for auto format 2020-04-12 09:11:21 +02:00
Johannes 'josch' Schauer
2ce9555dc5
expand docs for unshare mode 2020-04-12 09:10:30 +02:00
Johannes 'josch' Schauer
a0c097a6fa
TARGET must be italic not bold 2020-04-11 23:10:13 +02:00
Johannes 'josch' Schauer
f1a952d468
explicitly inform the user why apt-transport-https or apt-transport-tor are getting installed 2020-04-10 12:55:52 +02:00
Johannes 'josch' Schauer
9195972bef
dump contents of /etc/apt/apt.conf.d/99mmdebstrap and /etc/dpkg/dpkg.cfg.d/99mmdebstrap in debug mode 2020-04-10 12:55:31 +02:00
Johannes 'josch' Schauer
f6214e343f
add debug output of which command is run in run_progress() 2020-04-10 12:55:02 +02:00
Johannes 'josch' Schauer
ab5d5777d5
check whether qemu-$arch-static exists early 2020-04-10 12:26:42 +02:00
Johannes 'josch' Schauer
f50ca9bf6d
also warn if /usr/sbin/update-binfmts has non-zero exit 2020-04-10 12:26:14 +02:00
Johannes 'josch' Schauer
df1827d991
check if /usr/sbin/update-binfmts exists 2020-04-10 12:26:00 +02:00
Johannes 'josch' Schauer
a0c393f256
fix /proc/mounts regex to find binfmt_misc 2020-04-10 12:25:45 +02:00
Johannes 'josch' Schauer
d26f5de912
check whether arch-test exists 2020-04-10 12:25:24 +02:00
Johannes 'josch' Schauer
46f477f339
add --skip option 2020-04-10 00:00:36 +02:00
Johannes 'josch' Schauer
1076e9a78d
split up setup() into multiple functions 2020-04-10 00:00:02 +02:00
Johannes 'josch' Schauer
895c388ede
add --format option and ext2 image output 2020-04-09 20:40:23 +02:00
Johannes 'josch' Schauer
15d6f5528b
also print apt-get --version output with --debug 2020-04-09 18:40:23 +02:00
Johannes 'josch' Schauer
8d04ffee64
unset APT_CONFIG env var when running hook 2020-04-09 18:40:23 +02:00
Johannes 'josch' Schauer
d29bdafb89
add workaround for dpkg bug to docs 2020-04-09 18:40:23 +02:00
Johannes 'josch' Schauer
323a353548
output tarball if output is named pipe or character special 2020-04-09 18:40:23 +02:00
Johannes 'josch' Schauer
412039bd66
commit de8b6a45 forgot to also run re-install with /proc, /dev and /sys mounted 2020-04-09 18:40:22 +02:00
Johannes 'josch' Schauer
02ed5e33f8
add --extract-hook 2020-04-09 18:40:18 +02:00
Johannes 'josch' Schauer
5fae5e83f9
release 0.6.1 2020-03-08 23:21:16 +01:00
Johannes 'josch' Schauer
e1008006fc
add stub for future ext2 image support 2020-03-07 23:43:29 +01:00
Johannes 'josch' Schauer
773249a0ca
document limitation of missing /etc/ld.so.cache when using fakechroot 2020-03-07 23:42:41 +01:00
Johannes 'josch' Schauer
7bad5fb1e6
in unshare mode, the unshared process might not have enough permissions to rmdir root directory -- try again as normal user 2020-03-07 23:42:19 +01:00
Johannes 'josch' Schauer
3922851636
use Dpkg::Vendor::Debian and Dpkg::Vendor::Ubuntu for keyring locations, if they are available 2020-03-07 23:41:28 +01:00
Johannes 'josch' Schauer
89e7dd6756
store temporary files in /tmp inside the rootfs to avoid problems in unshare mode and TMPDIR set 2020-03-07 23:40:55 +01:00
Johannes 'josch' Schauer
b9db466a26
add note about usage of /usr/sbin/policy-rc.d 2020-03-07 23:39:53 +01:00
Johannes 'josch' Schauer
ff9b6509fb
add more usage examples 2020-03-07 02:25:55 +01:00
Johannes 'josch' Schauer
6c6378a6e0
emit more warnings about setting kernel.unprivileged_userns_clone to 1 2020-03-07 02:13:53 +01:00
Johannes 'josch' Schauer
48914894cb
dump temporary apt.conf with --debug 2020-03-07 02:13:26 +01:00
Johannes 'josch' Schauer
1ff5ba7e9e
set APT::Immediate-Configure to false in dry-run mode 2020-03-07 02:12:21 +01:00
Johannes 'josch' Schauer
3e50d09b43
create temporary apt.conf inside chroot because unshared process might not have permissions to write into TMPDIR 2020-03-07 02:11:35 +01:00
Johannes 'josch' Schauer
9918809a65
add another example about how to use mmdebstrap to make a bootable live system 2020-03-07 02:07:10 +01:00
Johannes 'josch' Schauer
bd84829595
unset TMPDIR environment variable for everything running inside the chroot 2020-03-07 02:06:11 +01:00
Johannes 'josch' Schauer
5bf8c3fcf9
add sync, umount and shutdown to guestfish calls 2020-03-04 13:29:07 +01:00
Johannes 'josch' Schauer
c4a47947ab
mount /sys and /proc as read-only in root mode 2020-01-24 10:14:10 +01:00
Johannes 'josch' Schauer
d503e4fd96
put fh variables into their own scope 2020-01-22 23:31:00 +01:00
Johannes 'josch' Schauer
62159d124a
support deb822-style format apt sources 2020-01-22 23:30:28 +01:00
Johannes 'josch' Schauer
1579d06380
use tempdir(..., TMPDIR => 1) instead of tempdir(..., DIR => File::Spec->tmpdir) 2020-01-22 00:30:12 +01:00
Johannes 'josch' Schauer
ae15fe3d9f
convert gpg keyring processing to less nesting and abort earlier if possible 2020-01-22 00:29:38 +01:00
Johannes 'josch' Schauer
c26ec4d6fc
instead of hardcoding /etc/apt/trusted.gpg, read it from apt-config shell 2020-01-22 00:28:48 +01:00
Johannes 'josch' Schauer
efaea907e9
run apt-cache policy instead of dumping sources.list 2020-01-22 00:28:22 +01:00
Johannes 'josch' Schauer
c45e7d9baf
print warning if apt trusted cannot be read 2020-01-22 00:27:57 +01:00
Johannes 'josch' Schauer
75428e37dd
assign the absolute key path and not the relative one 2020-01-21 13:38:53 +01:00
Johannes 'josch' Schauer
64fedc530e
Restore deterministic tar with pax and xattr support 
- all creating and extraction of tarballs respects extended attributes
 - extended attributes require pax format, so explicitly request the
   format
 - to make pax bit-by-bit reproducible, ctime, atime and PID have to be
   removed from the headers with:
   --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime
 - always pass --numeric-owner to tar
 - always pass --xattrs when creating a tar
 - always pass --xattrs --xattrs-include=* when extracting a tar
 2020-01-21 13:24:49 +01:00
Johannes 'josch' Schauer
a1df1a9730
fix docs: default variant is 'debootstrap' and not 'required' 2020-01-21 13:17:31 +01:00
Johannes 'josch' Schauer
bef4c890d8
if /etc/machine-id exists, replace by an empty file 2020-01-21 13:13:58 +01:00
Johannes 'josch' Schauer
9eaacca795
dump apt config with verbosity level >= 3 2020-01-21 13:12:44 +01:00
Johannes 'josch' Schauer
6455cda34b
release 0.6.0 2020-01-19 22:24:32 +01:00
Johannes 'josch' Schauer
c33ded3539
improve differences to debootstrap docs a bit more 2020-01-19 22:22:50 +01:00
Johannes 'josch' Schauer
98c8c573de
coverage.sh: test taridshift 2020-01-18 23:13:10 +01:00
Johannes 'josch' Schauer
30ec192c50
some improvements to the docs 2020-01-16 18:03:13 +01:00
Johannes 'josch' Schauer
6e829ca066
send error package when anything goes wrong in special hook handling 2020-01-16 12:02:11 +01:00
Johannes 'josch' Schauer
7d152ec7e0
add sync-in and sync-out hooks 2020-01-16 10:38:14 +01:00
Johannes 'josch' Schauer
7852a33d01
don't forget chrootless in the list of mode names 2020-01-10 12:05:01 +01:00
Johannes 'josch' Schauer
2cb6438454
add --dry-run and --simulate 2020-01-10 11:44:15 +01:00
Johannes 'josch' Schauer
9441184bf1
reformat some code to keep opening curly brace on the right 2020-01-10 09:29:34 +01:00
Johannes 'josch' Schauer
f867384c20
coverage.sh: test with perlcritic 2020-01-09 08:39:40 +01:00
Johannes 'josch' Schauer
4ba82a41cf
format code with perltidy 2020-01-08 17:46:41 +01:00
Johannes 'josch' Schauer
bba8922243
reformat code that would exceed 79 character width even after perltidy 2020-01-08 17:41:46 +01:00
Johannes 'josch' Schauer
6abbb3ebd9
wrap POD to 79 characters width 2020-01-08 17:19:30 +01:00
Johannes 'josch' Schauer
2782d14348
rewrite comments so that they fit into 79 characters 2020-01-08 17:07:17 +01:00
Johannes 'josch' Schauer
27bd6df320
add vim modeline 2020-01-08 16:22:51 +01:00
Johannes 'josch' Schauer
b10177cb6e
use spaces instead of tabs 2020-01-08 15:41:49 +01:00
Johannes 'josch' Schauer
6d3a824b45
disable Devel::Cover before exec-ing external tools to avoid massive slowdowns 2020-01-08 15:40:42 +01:00
Johannes 'josch' Schauer
4fed488c35
when re-execing itself, keep Devel::Cover options 2020-01-08 15:33:49 +01:00
Johannes 'josch' Schauer
dbdf3f34c6
add support for generating squashfs images using tar2sqfs 2020-01-07 17:40:13 +01:00
Johannes 'josch' Schauer
c6944d0b8f
cleanup leftovers in /tmp inside the chroot 2020-01-06 12:44:49 +01:00
Johannes 'josch' Schauer
61db086921
also clean package lists and apt cache from sources.d directory 2020-01-06 12:44:29 +01:00
Johannes 'josch' Schauer
327c0e83ca
further document prerequisites and limitations of different modes 2020-01-04 01:10:46 +01:00
Johannes 'josch' Schauer
ecd5c7a662
fixup warning message 2020-01-04 01:09:59 +01:00
Johannes 'josch' Schauer
8abb93633c
warn that creating tarball might also fail in proot mode for extract and custom variants 2020-01-04 00:59:22 +01:00
Johannes 'josch' Schauer
05e796cd95
add missing error handlers for fork() and open() calls 2020-01-04 00:39:00 +01:00
Johannes 'josch' Schauer
ed0b5069ce
on debug level verbosity, also print the line number 2020-01-04 00:37:49 +01:00
Johannes 'josch' Schauer
c8f79cf4b5
document that --xattrs --xattrs-include='*' is needed when extracting a tarball 2020-01-03 16:05:28 +01:00
Benjamin Drung
1dbb576c99
Preserve extended attributes in tarball 
When specifying a tarball as output format, the extended attributes are
lost. This leads to programs like ping fail to run as normal user.

Therefore preserve the extended attributes when generating the tarball.

Signed-off-by: Benjamin Drung <benjamin.drung@cloud.ionos.com>
 2019-12-10 17:38:36 +01:00
Johannes 'josch' Schauer
868081727e
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download 2019-12-09 10:40:51 +01:00
Johannes 'josch' Schauer
e6d5d74d87
--keyring now overwrites the default apt keyring 
- apt can only handle one directory and one file as keyring
 - the signed-by option is used to specify the keyrings for suites that
   are not known by apt
 2019-12-03 10:16:43 +01:00
Johannes 'josch' Schauer
db1e7f27ad
add oldoldstable and jessie 2019-12-03 00:05:56 +01:00
Johannes 'josch' Schauer
2de2eb6a8c
add space between negation operator and test operator 2019-12-02 23:59:43 +01:00
Johannes 'josch' Schauer
394731102a
before unmounting /proc, check if /proc/sys/fs/binfmt_misc is mounted 2019-12-02 23:54:48 +01:00
Johannes 'josch' Schauer
d262d67877
Fix parallel xz compression... hopefully for the last time... 2019-12-02 21:17:45 +01:00
Johannes 'josch' Schauer
9f2ea61265
Fix parallel xz compression 2019-11-29 08:51:45 +01:00
Johannes 'josch' Schauer
aad36777e8
add --man option and reduce output of --help option 
Printing the full man page requires the perl-doc package. To avoid this
dependency, print the less verbose output containing only the synopsis
and the option list for the --help option and print the full output
(requiring perldoc) for the --man option.
 2019-11-29 08:45:13 +01:00
Johannes 'josch' Schauer
de8b6a457d
also run initial installation of Essential:yes with /proc, /dev and /sys mounted 
In Debian Jessie, init is part of Essential:yes and thus systemd gets
installed which needs working /proc, /dev and /sys
 2019-11-29 08:18:35 +01:00
Johannes 'josch' Schauer
3a1d5413e2
also remove /var/log/apt/eipp.log.xz 2019-11-29 07:48:44 +01:00
Johannes 'josch' Schauer
f5afbfaab0
don't let make_path fail if directory already existed 2019-11-21 22:56:59 +01:00
Benjamin Drung
4b82a664da
Use parallel xz compression 
One of mmdebstrap benefits over deboostrap is that it is faster.
Creating a xz tarball as output will take a lot of time, since xz
consumes a lot of compute power and tar uses only one core.

Therefore use parallel xz compression since xz supports it using the -T
parameter.

Closes: #943327
Signed-off-by: Benjamin Drung <benjamin.drung@cloud.ionos.com>
 2019-11-13 12:02:42 +01:00
Johannes 'josch' Schauer
bc423e6ab6
Add disclaimer of warranty and limitation of liability 2019-11-13 11:53:30 +01:00
Johannes 'josch' Schauer
a2cd0e9843
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted... 2019-10-28 16:29:38 +01:00
Johannes 'josch' Schauer
6cac8e70e8
allow multiple --include options and use array instead of hash 
Package order is important when calling apt. Consider this dependency
graph:

    A -> B -> C | D , E -> D | C

"apt install A E" it will install "A B C E"
"apt install E A" it will install "E D A B"
 2019-10-28 15:35:36 +01:00
Johannes 'josch' Schauer
e12db588bd
add debug output for unknown data type 2019-10-28 14:53:03 +01:00
Johannes 'josch' Schauer
da4f9e4349
check whether /sbin/start-stop-daemon.REAL exists before overwriting it 2019-10-28 14:52:21 +01:00
Johannes 'josch' Schauer
daab09bfdd
only write /usr/sbin/policy-rc.d if /usr/sbin exists in the chroot 2019-10-28 14:51:49 +01:00
Johannes 'josch' Schauer
e0732140c0
make hooks work in chrootless mode 2019-10-28 14:27:37 +01:00
Johannes 'josch' Schauer
d36ba6b371
allow multiple --architecture options and separation by whitespace 2019-10-27 22:16:23 +01:00
Johannes 'josch' Schauer
7eb0851c59
only remove policy-rc.d if it exists 2019-10-23 14:00:55 +02:00
Johannes 'josch' Schauer
1f15f690e7
release 0.5.1 2019-10-19 23:26:10 +02:00
Johannes 'josch' Schauer
59472cc8fc
improve error message about arch not being executable 2019-10-19 16:25:02 +02:00
Johannes 'josch' Schauer
22c90c2ca6
it's possible that apt is already downloaded at the time where we want to install it 2019-10-19 16:24:58 +02:00
Johannes 'josch' Schauer
78358eaf9a
improve --components parsing with comma and whitespace as separator 2019-10-19 08:10:36 +02:00
Johannes 'josch' Schauer
9978cbddcb
turn error when --include is used with essential variant into a warning 2019-10-19 08:02:03 +02:00
Johannes 'josch' Schauer
86b430190f
set qemu binfmt identifier before using it to avoid uninitialized value error 2019-10-06 18:37:30 +02:00
Johannes 'josch' Schauer
ec1619d664
release 0.5.0 2019-10-05 21:24:47 +02:00
Johannes 'josch' Schauer
1f5e1483c7
add more to bugs section of man page 2019-10-05 07:51:18 +02:00
Johannes 'josch' Schauer
39a3915ea6
add more examples to man page 2019-10-05 07:51:05 +02:00
Johannes 'josch' Schauer
ad6883992a
fix mirror URIs for ubuntu 2019-10-05 07:49:15 +02:00
Johannes 'josch' Schauer
7a4cefaee2
only append to QEMU_LD_PREFIX if it's already set 2019-10-05 07:48:40 +02:00
Johannes 'josch' Schauer
b3536b98d0
export QEMU_LD_PREFIX in chrootless mode 2019-10-05 07:48:16 +02:00
Johannes 'josch' Schauer
d2a1029ee5
collect all diagnostics about binfmt_misc before throwing error 2019-09-27 10:18:15 +02:00
Johannes 'josch' Schauer
d5033dd0d1
also check for situations in which a non-native arch can be executed without emulation 2019-09-26 10:14:45 +02:00
Johannes 'josch' Schauer
3d3d3fe12d
Do not copy /etc/resolv.conf or /etc/hostname if the host system doesn't have them 2019-09-15 14:12:49 +02:00
Johannes 'josch' Schauer
3dc32b81b0
add --force-check-gpg dummy option 2019-09-14 18:25:40 +02:00
Helmut Grohne
4b440a0e01
allow messing with s-s-d in hooks 
Presently, mmdebstrap fails hard if e.g. a --setup-hook removes
start-stop-daemon.REAL.
 2019-09-13 23:15:18 +02:00
Helmut Grohne
ea0a6bcd89
make errors about moving s-s-d more verbose 2019-09-13 23:15:12 +02:00
Helmut Grohne
519046094e
fix error message about opening s-s-d 2019-09-13 23:15:00 +02:00
Johannes 'josch' Schauer
58ae0bb97d
select the right mirror for ubuntu, kali and tanglu 2019-09-10 12:46:49 +02:00
Johannes 'josch' Schauer
b70d8a0381
fix typo unpriviliged -> unprivileged 2019-09-04 15:47:15 +02:00
Johannes 'josch' Schauer
874a19050c
document that autopkgtest needs an additional entry in /etc/hosts 2019-09-04 15:45:43 +02:00
Johannes 'josch' Schauer
c8a3f053d7
document that the full apt syntax can be used 2019-09-04 15:45:18 +02:00
Johannes 'josch' Schauer
bfba0e7dce
add more debug output 2019-09-04 15:44:54 +02:00
Johannes 'josch' Schauer
4447769b50
when creating a tarball in chrootless mode, use root ownership 2019-09-04 13:50:25 +02:00
Johannes 'josch' Schauer
a921e32e6c
Do not unconditionally read standard input 
mmdebstrap used to attempt reading stdin if it was not a tty. This leads
to unexpected behaviour when mmdebstrap is used through ssh without a
pseudo-terminal allocated like so:

    $ ssh remote mmdebstrap unstable /output/dir http://mirror

This will stall forever, waiting for data on standard input. Or
consider:

    $ ssh remote << END
    > somecommand
    > mmdebstrap unstable /output/dir http://mirror
    > othercommand
    END

This will make mmdebstrap read "othercommand" and everything that
follows as a sources.list entry. To prevent this unexpected behaviour,
the following ways to use mmdebstrap will not be supported anymore:

    $ mmdebstrap unstable /output/dir < sources.list
    $ mmdebstrap unstable /output/dir http://mirror < sources.list

Instead, one must now explicitly pass "-" if one wants mmdebstrap to
read from stdin:

    $ mmdebstrap unstable /output/dir - < sources.list
    $ mmdebstrap unstable /output/dir http://mirror - < sources.list
 2019-08-28 00:53:04 +02:00
Johannes 'josch' Schauer
1219a65723
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs 2019-08-26 18:25:21 +02:00
Helmut Grohne
4f2e655ad5
Only attempt removing qemu-user-static for root or unshare mode 2019-08-26 16:34:35 +02:00
Johannes 'josch' Schauer
2d2cdfbbc3
create /var/lib/dpkg/cmethopt for dselect (see #930788) 2019-08-21 14:57:54 +02:00
Johannes 'josch' Schauer
68d7ec15bd
fix docs: fakechroot is tried before proot in auto mode 2019-07-24 16:47:47 +02:00
Johannes 'josch' Schauer
da489c6a53
Only error out on W: and Err: lines, on "apt-get update" 
Otherwise, maintainer scripts that output W: or Err: lines will break
package installation on "apt-get install".
 2019-04-30 00:07:35 +02:00
Johannes 'josch' Schauer
c734a59f86
chdir to parent of root before remove_tree to prevent 'cannot stat initial working directory' of File::Path 2019-04-25 08:56:42 +02:00
Johannes 'josch' Schauer
ca37c4e89e
chmod 0755 on qemu-user-static binary 2019-04-25 08:54:31 +02:00
Johannes 'josch' Schauer
14d3a4e30f
add Dir::State::Status to apt config for apt << 1.3 2019-04-25 08:51:42 +02:00
Johannes 'josch' Schauer
dd5214a8c8
chdir() before 'apt-get update' to accomodate for apt << 1.5 (Debian bug #860738) 2019-04-25 08:49:28 +02:00
Johannes 'josch' Schauer
b2d5a45932
cleanup auxfiles *after* running apt-get update or otherwise it will be re-created 2019-04-23 13:28:55 +02:00
Johannes 'josch' Schauer
19fdb4914d
coverage.sh: auto generate package list for aspcud instead of hardcoding it 2019-03-27 11:44:45 +01:00
Johannes 'josch' Schauer
454dd9fa3e
Annotate examples with a description of their effect 2019-03-25 14:50:41 +01:00
Johannes 'josch' Schauer
a69a2d39b8
also re-exec under fakechroot if fakechroot is picked in 'auto' mode 2019-03-25 14:35:38 +01:00
Johannes 'josch' Schauer
3e8a251e1f
fix EDSP output for external solvers so that apt doesn't mark itself as Essential:yes 2019-03-25 14:31:45 +01:00
Johannes 'josch' Schauer
6a51d410ec
do not skip package installation in 'custom' variant 2019-03-25 14:27:34 +01:00
Johannes 'josch' Schauer
6d774a3d92
release 0.4.1 2019-03-01 12:56:57 +01:00
Johannes 'josch' Schauer
016cac22f8
add note about dpkg config bug 2019-03-01 12:53:16 +01:00
Johannes 'josch' Schauer
52b1a9dc6e
instead of touching a file, test if /var/lib/apt/lists/partial is readable to decide about apt sandboxing 2019-03-01 01:05:32 +01:00
Johannes 'josch' Schauer
473bc354ae
only set apt Dir config option instead of setting apt directories individually 2019-02-28 12:22:42 +01:00
Johannes 'josch' Schauer
e1a41fac94
print errno when unlink fails 2019-02-28 12:20:42 +01:00
Johannes 'josch' Schauer
920877fa2a
disable apt sandboxing if the chroot directory is not accessible by the _apt user 2019-02-28 11:54:03 +01:00
Johannes 'josch' Schauer
d0f0283120
do not cleanup apt and dpkg lock files to not set bad precedence 2019-02-28 00:20:00 +01:00
Johannes 'josch' Schauer
e3219a5c8f
release 0.4.0 2019-02-23 13:25:56 +01:00
Johannes 'josch' Schauer
48e34852a2
clean /var/lib/apt/lists/auxfiles so that apt older than 1.6 has no problem with the chroot 2019-02-23 13:22:44 +01:00
Johannes 'josch' Schauer
a91a825e67
add --version option 2019-02-23 08:55:31 +01:00
Johannes 'josch' Schauer
d73b8396ac
print the used temporary directory as info message 2019-02-23 08:50:02 +01:00
Johannes 'josch' Schauer
e06f2e9c57
the mmdebstrap command name has to be written in bold 2019-02-23 08:49:19 +01:00
Johannes 'josch' Schauer
1b8ad8400b
add --logfile option 2019-02-23 08:43:15 +01:00
Johannes 'josch' Schauer
1fe5da3d56
Better documentation of example showing mmdebstrap with sources.list on stdin 2019-02-20 18:18:31 +01:00
Johannes 'josch' Schauer
6e61c1a183
document the behaviour if --quiet, --silent, --verbose or --debug are passed at the same time 2019-02-20 18:17:00 +01:00
Johannes 'josch' Schauer
db415fe4f4
add short options for --quiet, --silent, --verbose and --debug 2019-02-20 18:02:55 +01:00
Johannes 'josch' Schauer
fffd74afc2
explicitly configure Getopt::Long 2019-02-20 18:00:52 +01:00
Johannes 'josch' Schauer
0b058c7db1
add --setup-hook, --essential-hook and rename --customize to --customize-hook 2019-02-20 13:32:49 +01:00
Johannes 'josch' Schauer
89718d367e
test no-op options and print info message when they are used 2019-02-15 12:42:46 +01:00
Johannes 'josch' Schauer
5115ca87c3
don't unset environment variables in @chrootcmd so that hooks still have access to them 2019-02-15 11:40:06 +01:00
Johannes 'josch' Schauer
3f15f66892
fix example for vmdb2 replacement 2019-02-15 11:36:40 +01:00
Johannes 'josch' Schauer
548130867b
do not run another apt-get pass with custom variant 2019-02-15 11:32:44 +01:00
Johannes 'josch' Schauer
bde4c795ef
document that security mirrors are only implicitly added if no mirror was specified 2019-01-24 12:39:01 +01:00
Johannes 'josch' Schauer
b9e78796b2
prefer fakechroot to proot in auto mode because the latter produces wrong ownership 2019-01-24 12:37:44 +01:00
Johannes 'josch' Schauer
a3afe24fc0
Instead of using gzip compression support, run compressor ourselves 
- otherwise ./dev tar cannot be concatenated with the rest
 - test compressor early
 - better document the TARGET option
 2019-01-24 12:32:46 +01:00
Johannes 'josch' Schauer
84b0b5061b
start sanitizing the environment with chroot() and don't pass on TMPDIR 2019-01-20 10:46:19 +01:00
Johannes 'josch' Schauer
6f8bb8c977
since copy() is using syswrite(), we must flush the filehandle before calling it 2019-01-20 10:46:16 +01:00
Johannes 'josch' Schauer
982f8e982c
add --quiet and --debug switches and debug/verbose/info/warning/error functions 2019-01-20 10:39:01 +01:00
Johannes 'josch' Schauer
58a3069495
add mmdebstrap prefix to temporary directory name 2019-01-14 22:24:33 +01:00
Johannes 'josch' Schauer
765f5b91e9
call apt with Dpkg::Use-Pty=false to enable immediate termination upon SIGINT and prevent it from messing up the terminal with tcsetattr() 2019-01-14 22:23:02 +01:00
Johannes 'josch' Schauer
be1af15489
use common function for run_dpkg_progress and run_apt_progress 2019-01-13 22:04:25 +01:00
Johannes 'josch' Schauer
7f58c4596a
handle INT, HUB, PIPE and TERM signals, wait for child processes and clean up mounts 2019-01-13 10:17:46 +01:00
Johannes 'josch' Schauer
0345d30ae6
run_*_progress: fix error message when exec() failed 2019-01-12 00:48:40 +01:00
Johannes 'josch' Schauer
a3f69f8874
add undocumented --customize option 2019-01-08 11:28:27 +01:00
Johannes 'josch' Schauer
d66a5a7d74
Several formatting improvements to POD 2019-01-08 11:27:56 +01:00
Johannes 'josch' Schauer
e0ea1e6d65
add FIXME option to also support Debian derivatives 2019-01-08 11:26:24 +01:00
Johannes 'josch' Schauer
fa836c01f7
refer to #898446 when warning about unprivileged_userns_clone 2019-01-08 11:23:39 +01:00
Johannes 'josch' Schauer
e0b107453d
add another example --aptopt to man page 2019-01-07 13:19:38 +01:00
Johannes 'josch' Schauer
25bec4d5e1
add --merged-usr and --no-merged-usr no-op options for debootstrap compatibility 2019-01-07 13:18:59 +01:00
Johannes 'josch' Schauer
418b42746e
create an empty /var/lib/dpkg/available as otherwise dpkg fails on package removal 2019-01-07 13:16:51 +01:00
Johannes 'josch' Schauer
1e0b4cb3b0
now that fakechroot and proot are fixed, add support for for variants beyond essential and apt 2019-01-01 14:28:56 +01:00
Johannes 'josch' Schauer
29550acb88
add --interactive=never to rm call to avoid prompts for removal of write protected files in proot mode 2018-12-30 17:18:27 +01:00
Johannes 'josch' Schauer
e6ce901be4
run several binfmt checks before using qemu-user mode 2018-12-28 07:19:24 +01:00
Johannes 'josch' Schauer
4a2bf62931
add --resolve-deps no-op option for sbuild-createchroot compatibility 2018-12-28 07:19:23 +01:00
Johannes 'josch' Schauer
3f29fa461a
don't die if output cannot be written to tarball and instead check error condition early 2018-12-28 07:19:23 +01:00
Johannes 'josch' Schauer
f4263ebd74
add --verbose option that prints apt and dpkg output instead of progress bars 2018-12-28 07:19:23 +01:00
Johannes 'josch' Schauer
61ad8a8e45
update --help output for --aptopt using single quotes to avoid escaping of double quotes 2018-12-28 07:19:23 +01:00
Johannes 'josch' Schauer
97d273aaf6
disable merged usr 2018-12-07 00:17:10 +01:00
Johannes 'josch' Schauer
f101057e1b
add qemu TODO item 2018-12-06 17:15:56 +01:00
Johannes 'josch' Schauer
b0979d1d6b
add verbose mode to test_unshare() so that it can report what went wrong 2018-12-05 08:06:26 +01:00
Johannes 'josch' Schauer
3ffc8ea35f
add FIXME comment about binfmt_misc support 2018-12-05 08:05:32 +01:00
Johannes 'josch' Schauer
4ef1eda200
append to $PATH instead of replacing its content 2018-11-23 17:30:32 +01:00
Johannes 'josch' Schauer
972b207508
implement 'extract' variant 2018-11-21 00:21:47 +01:00
Johannes 'josch' Schauer
16d2a4a8d9
allow empty lost+found directory in target directory 2018-11-21 00:21:46 +01:00
Johannes 'josch' Schauer
1730a17286
add two code comments 2018-11-21 00:21:46 +01:00
Johannes 'josch' Schauer
2949691591
When packaging the tarball with proot, exclude /host-rootfs 2018-11-21 00:21:46 +01:00
Johannes 'josch' Schauer
1890e22b14
do not make the default mirror for the native arch only. The sane expectation is, that the default mirror is for any architecture. 2018-11-21 00:21:46 +01:00
Johannes 'josch' Schauer
cc7dddb1b3
re-installing packages with dpkg also requires --force-depends because dpkg doesn't consider Pre-Depends 2018-11-21 00:21:46 +01:00
Johannes 'josch' Schauer
a9765a3ad2
fix Apt::Architectures architecture list 2018-11-21 00:21:46 +01:00
Johannes 'josch' Schauer
7948894159
dereference array foreignarchs before iterating 2018-11-02 17:24:28 +01:00
Johannes 'josch' Schauer
4c9d2bd3d7
add sanity check for fakechroot/proot renameat2 bug 2018-10-24 02:41:43 +02:00
Johannes 'josch' Schauer
b8c63f8797
check the mode earlier so that we can re-exec under fakechroot earlier 2018-10-23 18:04:34 +02:00
Johannes 'josch' Schauer
70c1468453
in fakechroot mode, do not create symlinks to non-existing /proc 2018-10-23 18:04:34 +02:00
Johannes 'josch' Schauer
a5866a347c
add --qemu option to proot when creating tar of foreign arch chroot 2018-10-23 18:04:33 +02:00
Johannes 'josch' Schauer
174d54f933
for simplicity, always use our own /dev tar entries 2018-10-23 18:04:33 +02:00
Johannes 'josch' Schauer
7534a7607f
Add chrootless mode and extract and custom variants 2018-10-23 15:29:20 +02:00
Johannes 'josch' Schauer
07f0e53081
Add POD section for environment variables 2018-10-23 15:29:20 +02:00
Johannes 'josch' Schauer
a6d6ad4d0d
Add more markup to POD 2018-10-23 15:29:20 +02:00
Johannes 'josch' Schauer
2d6703add0
fix tar call in proot mode (avoid extra entry for /dev and error message about non-existant working directory) 2018-10-23 15:29:20 +02:00
Johannes 'josch' Schauer
5498f61ce5
apt does not support double quotes in paths 2018-10-23 15:29:20 +02:00
Johannes 'josch' Schauer
27f10e2300
fix error string (apt is part of the required variant) 2018-10-23 15:29:19 +02:00
Johannes 'josch' Schauer
1409405af7
always clean apt from the outside in case there is no apt inside the chroot 2018-10-23 15:29:19 +02:00
Johannes 'josch' Schauer
61ff05566a
as a defensive measure, in conditionals for variant and mode, always check for unknown variant/mode 
That way, when adding new variants or modes, we have to consciously
choose which branch is to be taken instead of accidentally taking the
default branch.
 2018-10-23 15:29:19 +02:00
Johannes 'josch' Schauer
12fc63385b
skip /dev in directory creation 2018-10-23 15:29:19 +02:00
Johannes 'josch' Schauer
145bfe5233
symlinks must also be created with havemknod 2018-10-23 15:29:19 +02:00
Johannes 'josch' Schauer
b0efc9aa86
also conditionally only act on symlinks if havemknod is false 2018-10-23 15:29:19 +02:00
Johannes 'josch' Schauer
3c48bce2b2
don't set /usr/bin/env in FAKECHROOT_CMD_SUBST 2018-10-23 15:29:19 +02:00
Johannes 'josch' Schauer
7a25de31db
Don't rely on Architecture field in indextargets output because it's only filled for non-flat mirrors 2018-10-23 15:29:18 +02:00
Johannes 'josch' Schauer
bdbe12fec8
don't set Apt::Get::Download-Only in the default apt config but do it explicitly in each apt call 2018-10-23 15:29:18 +02:00
Johannes 'josch' Schauer
191bc47f2c
make sure that apt puts its logs into the chroot 2018-10-23 15:29:18 +02:00
Johannes 'josch' Schauer
11633c7278
don't clean auxfiles anymore 2018-10-23 15:29:18 +02:00
Johannes 'josch' Schauer
7412d5fbce
also unmount in unshare mode to prevent wrong directory permissions of mount targets 2018-10-08 11:26:31 +02:00
Johannes 'josch' Schauer
ac8084cb42
only unmount device nodes and directories with --no-mtab in unshare mode 2018-10-08 11:25:39 +02:00
Johannes 'josch' Schauer
594a37d093
add comment about mounting sys with rbind in unshare mode 2018-10-08 11:24:29 +02:00
Johannes 'josch' Schauer
c6099857e2
do not chmod symlinks because that will change the target of the symlink and not the symlink itself 2018-10-03 09:22:18 +02:00
Johannes 'josch' Schauer
d634095da1
Skip the loop if nothing was created so that chmod later doesn't fail 2018-10-03 09:21:12 +02:00
Johannes 'josch' Schauer
eeb1ba4e11
add comment explaining the situation with *-archive-keyring packages 2018-10-03 09:21:12 +02:00
Johannes 'josch' Schauer
ab96341957
die if chmod fails 2018-10-03 09:19:28 +02:00
Johannes 'josch' Schauer
f2a3f23acf
Fix havemknod test 
"last" only exits the innermost block, thus we need a label. Since
blocks are semantically the same as loops that only execute once, we
also replace the while() with a single block.
 2018-10-03 07:29:50 +02:00
Johannes 'josch' Schauer
c073d0b446
don't use default mirror if no mirror was specified but data was given on standard input 2018-10-02 10:09:22 +02:00
Johannes 'josch' Schauer
d25e939363
suppress warnings when the test for the arch-test binary fails 2018-10-02 04:11:41 +02:00
Johannes 'josch' Schauer
edb3c9ed9a
add FIXME comment 2018-10-02 04:11:22 +02:00