tambre/mmdebstrap
1
0
Fork 0
forked from josch/mmdebstrap
Code Issues Pull requests Projects Releases Wiki Activity
mmdebstrap/coverage.sh

3645 lines
121 KiB
Bash
Raw Permalink Normal View History

add coverage.sh
2018-10-22 18:37:31 +00:00
#!/bin/sh
set -eu
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
if [ -e ./mmdebstrap -a -e ./taridshift -a -e ./tarfilter ]; then
TMPFILE=$(mktemp)
perltidy < ./mmdebstrap > "$TMPFILE"
ret=0
diff -u ./mmdebstrap "$TMPFILE" || ret=$?
if [ "$ret" -ne 0 ]; then
echo "perltidy failed" >&2
rm "$TMPFILE"
exit 1
fi
coverage.sh: write mmdebstrap.tdy into temporary file instead of current directory
2020-01-21 12:07:18 +00:00
rm "$TMPFILE"
format code with perltidy
2020-01-08 16:44:07 +00:00
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
if [ $(sed -e '/^__END__$/,$d' ./mmdebstrap | wc --max-line-length) -gt 79 ]; then
echo "exceeded maximum line length of 79 characters" >&2
exit 1
fi
coverage.sh: test with perlcritic
2020-01-09 07:39:40 +00:00
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
perlcritic --severity 4 --verbose 8 ./mmdebstrap
coverage.sh: test with perlcritic
2020-01-09 07:39:40 +00:00
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
black --check ./taridshift ./tarfilter
fi
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
make_mirror.sh: never leave the cache in an inconsistent state by atomically switching symlinks
2018-12-28 06:44:54 +00:00
mirrordir="./shared/cache/debian"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
coverage.sh: don't run make_mirror.sh
2019-10-18 20:46:23 +00:00
if [ ! -e "$mirrordir" ]; then
echo "run ./make_mirror.sh before running $0" >&2
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# we use -f because the file might not exist
rm -f shared/cover_db.img
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
: "${DEFAULT_DIST:=unstable}"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
: "${HAVE_QEMU:=yes}"
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
: "${RUN_MA_SAME_TESTS:=yes}"
coverage.sh: test ubuntu focal
2020-08-26 07:44:29 +00:00
: "${ONLINE:=no}"
coverage.sh: do not run cap_sys_admin test under lxc
2021-02-06 13:46:00 +00:00
: "${CONTAINER:=no}"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
HOSTARCH=$(dpkg --print-architecture)
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
# prepare image for cover_db
reduce cover_db.img size, now that we don't run it for exec-ed processes anymore
2020-01-09 11:41:26 +00:00
guestfish -N shared/cover_db.img=disk:64M -- mkfs vfat /dev/sda
coverage.sh: check requirement for disk image and debootstrap tarballs before running
2018-12-27 13:38:00 +00:00
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
if [ ! -e "./shared/cache/debian-$DEFAULT_DIST.qcow" ]; then
echo "./shared/cache/debian-$DEFAULT_DIST.qcow does not exist" >&2
coverage.sh: check requirement for disk image and debootstrap tarballs before running
2018-12-27 13:38:00 +00:00
exit 1
fi
fi
# check if all required debootstrap tarballs exist
notfound=0
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
for dist in oldstable stable testing unstable; do
coverage.sh: check requirement for disk image and debootstrap tarballs before running
2018-12-27 13:38:00 +00:00
for variant in minbase buildd -; do
if [ ! -e "shared/cache/debian-$dist-$variant.tar" ]; then
echo "shared/cache/debian-$dist-$variant.tar does not exist" >&2
notfound=1
fi
done
done
if [ "$notfound" -ne 0 ]; then
echo "not all required debootstrap tarballs are present" >&2
exit 1
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
coverage.sh: conditionally copy mmdebstrap to ./shared - only copy if local copy is newer than the copy in ./shared - this enables the autopkgtest to place its own version in ./shared which will then not be overwritten
2018-11-23 16:27:36 +00:00
# only copy if necessary
if [ ! -e shared/mmdebstrap ] || [ mmdebstrap -nt shared/mmdebstrap ]; then
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
if [ -e ./mmdebstrap ]; then
cp -a mmdebstrap shared
else
cp -a /usr/bin/mmdebstrap shared
fi
coverage.sh: conditionally copy mmdebstrap to ./shared - only copy if local copy is newer than the copy in ./shared - this enables the autopkgtest to place its own version in ./shared which will then not be overwritten
2018-11-23 16:27:36 +00:00
fi
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
if [ ! -e shared/taridshift ] || [ taridshift -nt shared/taridshift ]; then
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
if [ -e ./taridshift ]; then
cp -a ./taridshift shared
else
cp -a /usr/bin/mmtaridshift shared/taridshift
fi
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
fi
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility
2020-08-25 11:02:33 +00:00
if [ ! -e shared/tarfilter ] || [ tarfilter -nt shared/tarfilter ]; then
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
if [ -e ./tarfilter ]; then
cp -a tarfilter shared
else
cp -a /usr/bin/mmtarfilter shared/tarfilter
fi
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
fi
name solver mmdebstrap-dump-solution in official apt path
2020-11-29 01:30:03 +00:00
if [ ! -e shared/proxysolver ] || [ proxysolver -nt shared/proxysolver ]; then
if [ -e ./proxysolver ]; then
cp -a proxysolver shared
else
cp -a /usr/lib/apt/solvers/mmdebstrap-dump-solution shared/proxysolver
fi
fi
add ldconfig.fakechroot and translate symlinks for bit-by-bit identical buildd variant
2021-09-16 14:23:46 +00:00
if [ ! -e shared/ldconfig.fakechroot ] || [ ldconfig.fakechroot -nt shared/ldconfig.fakechroot ]; then
if [ -e ./ldconfig.fakechroot ]; then
cp -a ldconfig.fakechroot shared
else
cp -a /usr/libexec/mmdebstrap/ldconfig.fakechroot shared/ldconfig.fakechroot
fi
fi
coverage.sh: setup00-merged-usr.sh moved into a subdirectory
2021-09-21 21:01:58 +00:00
mkdir -p shared/hooks/merged-usr
if [ ! -e shared/hooks/merged-usr/setup00.sh ] || [ hooks/merged-usr/setup00.sh -nt shared/hooks/merged-usr/setup00.sh ]; then
if [ -e hooks/merged-usr/setup00.sh ]; then
cp -a hooks/merged-usr/setup00.sh shared/hooks/merged-usr/
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
else
coverage.sh: setup00-merged-usr.sh moved into a subdirectory
2021-09-21 21:01:58 +00:00
cp -a /usr/share/mmdebstrap/hooks/merged-usr/setup00.sh shared/hooks/merged-usr/
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
fi
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
fi
mkdir -p shared/hooks/eatmydata
if [ ! -e shared/hooks/eatmydata/extract.sh ] || [ hooks/eatmydata/extract.sh -nt shared/hooks/eatmydata/extract.sh ]; then
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
if [ -e hooks/eatmydata/extract.sh ]; then
cp -a hooks/eatmydata/extract.sh shared/hooks/eatmydata/
else
cp -a /usr/share/mmdebstrap/hooks/eatmydata/extract.sh shared/hooks/eatmydata/
fi
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
fi
if [ ! -e shared/hooks/eatmydata/customize.sh ] || [ hooks/eatmydata/customize.sh -nt shared/hooks/eatmydata/customize.sh ]; then
coverage.sh: only copy or test files that actually exist
2020-11-27 00:00:56 +00:00
if [ -e hooks/eatmydata/customize.sh ]; then
cp -a hooks/eatmydata/customize.sh shared/hooks/eatmydata/
else
cp -a /usr/share/mmdebstrap/hooks/eatmydata/customize.sh shared/hooks/eatmydata/
fi
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
starttime=
coverage.sh: remove redundant tests
2021-11-09 06:27:10 +00:00
total=177
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=0
runtests=0
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
i=1
print_header() {
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo ------------------------------------------------------------------------------ >&2
echo "($i/$total) $1" >&2
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
if [ -z "$starttime" ]; then
starttime=$(date +%s)
else
currenttime=$(date +%s)
timeleft=$(((total-i+1)*(currenttime-starttime)/(i-1)))
printf "time left: %02d:%02d:%02d\n" $((timeleft/3600)) $(((timeleft%3600)/60)) $((timeleft%60))
fi
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo ------------------------------------------------------------------------------ >&2
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
i=$((i+1))
}
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# choose the timestamp of the unstable Release file, so that we get
# reproducible results for the same mirror timestamp
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
SOURCE_DATE_EPOCH=$(date --date="$(grep-dctrl -s Date -n '' "$mirrordir/dists/$DEFAULT_DIST/Release")" +%s)
add coverage.sh
2018-10-22 18:37:31 +00:00
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# for traditional sort order that uses native byte values
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
: "${HAVE_UNSHARE:=yes}"
: "${HAVE_PROOT:=yes}"
: "${HAVE_BINFMT:=yes}"
defaultmode="auto"
if [ "$HAVE_UNSHARE" != "yes" ]; then
defaultmode="root"
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# by default, use the mmdebstrap executable in the current directory together
# with perl Devel::Cover but allow to overwrite this
: "${CMD:=perl -MDevel::Cover=-silent,-nogcov ./mmdebstrap}"
mirror="http://127.0.0.1/debian"
add coverage.sh
2018-10-22 18:37:31 +00:00
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
for dist in oldstable stable testing unstable; do
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
for variant in minbase buildd -; do
coverage.sh: fix total number ant print_header position
2020-11-29 10:41:36 +00:00
print_header "mode=$defaultmode,variant=$variant: check against debootstrap $dist"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
use apt from the outside by setting DPkg::Chroot-Directory
2021-08-16 11:32:20 +00:00
# we create the apt user ourselves or otherwise its uid/gid will differ
# compared to the one chosen in debootstrap because of different installation
# order in comparison to the systemd users
# https://bugs.debian.org/969631
$CMD --variant=$variant --mode=$defaultmode \
--essential-hook='if [ $variant = - ]; then echo _apt:*:100:65534::/nonexistent:/usr/sbin/nologin >> "\$1"/etc/passwd; fi' \
$dist /tmp/debian-$dist-mm.tar $mirror
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
mkdir /tmp/debian-$dist-mm
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
tar --xattrs --xattrs-include='*' -C /tmp/debian-$dist-mm -xf /tmp/debian-$dist-mm.tar
coverage.sh: remove tarball earlier to free some space
2021-01-06 10:18:46 +00:00
rm /tmp/debian-$dist-mm.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
mkdir /tmp/debian-$dist-debootstrap
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
tar --xattrs --xattrs-include='*' -C /tmp/debian-$dist-debootstrap -xf "cache/debian-$dist-$variant.tar"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# diff cannot compare device nodes, so we use tar to do that for us and then
# delete the directory
tar -C /tmp/debian-$dist-debootstrap -cf dev1.tar ./dev
tar -C /tmp/debian-$dist-mm -cf dev2.tar ./dev
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
ret=0
cmp dev1.tar dev2.tar || ret=\$?
if [ "\$ret" -ne 0 ]; then
if type diffoscope >/dev/null; then
diffoscope dev1.tar dev2.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
else
echo "no diffoscope installed" >&2
fi
if type base64 >/dev/null; then
base64 dev1.tar
base64 dev2.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
else
echo "no base64 installed" >&2
fi
if type xxd >/dev/null; then
xxd dev1.tar
xxd dev2.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
else
echo "no xxd installed" >&2
fi
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
rm dev1.tar dev2.tar
rm -r /tmp/debian-$dist-debootstrap/dev /tmp/debian-$dist-mm/dev
# remove downloaded deb packages
rm /tmp/debian-$dist-debootstrap/var/cache/apt/archives/*.deb
# remove aux-cache
rm /tmp/debian-$dist-debootstrap/var/cache/ldconfig/aux-cache
# remove logs
rm /tmp/debian-$dist-debootstrap/var/log/dpkg.log \
/tmp/debian-$dist-debootstrap/var/log/bootstrap.log \
/tmp/debian-$dist-debootstrap/var/log/alternatives.log
# remove *-old files
rm /tmp/debian-$dist-debootstrap/var/cache/debconf/config.dat-old \
/tmp/debian-$dist-mm/var/cache/debconf/config.dat-old
rm /tmp/debian-$dist-debootstrap/var/cache/debconf/templates.dat-old \
/tmp/debian-$dist-mm/var/cache/debconf/templates.dat-old
rm /tmp/debian-$dist-debootstrap/var/lib/dpkg/status-old \
/tmp/debian-$dist-mm/var/lib/dpkg/status-old
# remove dpkg files
create /var/lib/dpkg/cmethopt for dselect (see #930788)
2019-08-21 12:57:54 +00:00
rm /tmp/debian-$dist-debootstrap/var/lib/dpkg/available
also create cmethopt and available in chrootless mode - this allows bit-by-bit identical output of chrootless mode compared to other modes
2021-09-22 13:22:15 +00:00
rm /tmp/debian-$dist-debootstrap/var/lib/dpkg/cmethopt
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# since we installed packages directly from the .deb files, Priorities differ
# thus we first check for equality and then remove the files
chroot /tmp/debian-$dist-debootstrap dpkg --list > dpkg1
chroot /tmp/debian-$dist-mm dpkg --list > dpkg2
diff -u dpkg1 dpkg2
rm dpkg1 dpkg2
grep -v '^Priority: ' /tmp/debian-$dist-debootstrap/var/lib/dpkg/status > status1
grep -v '^Priority: ' /tmp/debian-$dist-mm/var/lib/dpkg/status > status2
diff -u status1 status2
rm status1 status2
rm /tmp/debian-$dist-debootstrap/var/lib/dpkg/status /tmp/debian-$dist-mm/var/lib/dpkg/status
# debootstrap exposes the hosts's kernel version
coverage.sh: /etc/apt/apt.conf.d/01autoremove-kernels is not anymore always created
2020-11-26 22:10:38 +00:00
if [ -e /tmp/debian-$dist-debootstrap/etc/apt/apt.conf.d/01autoremove-kernels ]; then
rm /tmp/debian-$dist-debootstrap/etc/apt/apt.conf.d/01autoremove-kernels
fi
if [ -e /tmp/debian-$dist-mm/etc/apt/apt.conf.d/01autoremove-kernels ]; then
rm /tmp/debian-$dist-mm/etc/apt/apt.conf.d/01autoremove-kernels
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# who creates /run/mount?
coverage.sh: /run/mount/utab is created inside qemu but not on gitlab CI -- weird...
2019-02-27 23:18:06 +00:00
if [ -e "/tmp/debian-$dist-debootstrap/run/mount/utab" ]; then
rm "/tmp/debian-$dist-debootstrap/run/mount/utab"
fi
if [ -e "/tmp/debian-$dist-debootstrap/run/mount" ]; then
rmdir "/tmp/debian-$dist-debootstrap/run/mount"
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# debootstrap doesn't clean apt
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
rm /tmp/debian-$dist-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_${dist}_main_binary-${HOSTARCH}_Packages \
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
/tmp/debian-$dist-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_${dist}_Release \
/tmp/debian-$dist-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_${dist}_Release.gpg
if [ "$variant" = "-" ]; then
rm /tmp/debian-$dist-debootstrap/etc/machine-id
rm /tmp/debian-$dist-mm/etc/machine-id
rm /tmp/debian-$dist-debootstrap/var/lib/systemd/catalog/database
rm /tmp/debian-$dist-mm/var/lib/systemd/catalog/database
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
cap=\$(chroot /tmp/debian-$dist-debootstrap /sbin/getcap /bin/ping)
coverage.sh: the output of getcap differs depending on the version
2021-01-06 10:19:15 +00:00
expected="/bin/ping cap_net_raw=ep"
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
if [ "$dist" = oldstable ]; then
coverage.sh: the output of getcap differs depending on the version
2021-01-06 10:19:15 +00:00
expected="/bin/ping = cap_net_raw+ep"
fi
if [ "\$cap" != "\$expected" ]; then
echo "expected bin/ping to have capabilities \$expected" >&2
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "but debootstrap produced: \$cap" >&2
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
exit 1
fi
cap=\$(chroot /tmp/debian-$dist-mm /sbin/getcap /bin/ping)
coverage.sh: the output of getcap differs depending on the version
2021-01-06 10:19:15 +00:00
if [ "\$cap" != "\$expected" ]; then
echo "expected bin/ping to have capabilities \$expected" >&2
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "but mmdebstrap produced: \$cap" >&2
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
fi
do not cleanup apt and dpkg lock files to not set bad precedence
2019-02-27 23:20:00 +00:00
rm /tmp/debian-$dist-mm/var/cache/apt/archives/lock
rm /tmp/debian-$dist-mm/var/lib/apt/extended_states
rm /tmp/debian-$dist-mm/var/lib/apt/lists/lock
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: account for differently ordered /etc/shells
2018-12-06 23:13:51 +00:00
# the list of shells might be sorted wrongly
for f in "/tmp/debian-$dist-debootstrap/etc/shells" "/tmp/debian-$dist-mm/etc/shells"; do
sort -o "\$f" "\$f"
done
coverage.sh: work around bug #917773
2019-02-19 23:31:06 +00:00
# workaround for https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=917773
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
if ! cmp /tmp/debian-$dist-debootstrap/etc/shadow /tmp/debian-$dist-mm/etc/shadow; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo patching /etc/shadow on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
awk -v FS=: -v OFS=: -v SDE=\$SOURCE_DATE_EPOCH '{ print \$1,\$2,int(SDE/60/60/24),\$4,\$5,\$6,\$7,\$8,\$9 }' < /tmp/debian-$dist-mm/etc/shadow > /tmp/debian-$dist-mm/etc/shadow.bak
coverage.sh: also compare permissions, ownership, symlink targets and mtimes
2020-03-22 13:07:00 +00:00
cat /tmp/debian-$dist-mm/etc/shadow.bak > /tmp/debian-$dist-mm/etc/shadow
rm /tmp/debian-$dist-mm/etc/shadow.bak
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo no difference for /etc/shadow on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
fi
if ! cmp /tmp/debian-$dist-debootstrap/etc/shadow- /tmp/debian-$dist-mm/etc/shadow-; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo patching /etc/shadow- on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
awk -v FS=: -v OFS=: -v SDE=\$SOURCE_DATE_EPOCH '{ print \$1,\$2,int(SDE/60/60/24),\$4,\$5,\$6,\$7,\$8,\$9 }' < /tmp/debian-$dist-mm/etc/shadow- > /tmp/debian-$dist-mm/etc/shadow-.bak
coverage.sh: also compare permissions, ownership, symlink targets and mtimes
2020-03-22 13:07:00 +00:00
cat /tmp/debian-$dist-mm/etc/shadow-.bak > /tmp/debian-$dist-mm/etc/shadow-
rm /tmp/debian-$dist-mm/etc/shadow-.bak
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo no difference for /etc/shadow- on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
fi
coverage.sh: work around bug #917773
2019-02-19 23:31:06 +00:00
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# check if the file content differs
coverage.sh: print unified diff
2020-07-09 05:35:59 +00:00
diff --unified --no-dereference --recursive /tmp/debian-$dist-debootstrap /tmp/debian-$dist-mm
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: also compare permissions, ownership, symlink targets and mtimes
2020-03-22 13:07:00 +00:00
# check permissions, ownership, symlink targets, modification times using tar
# directory mtimes will differ, thus we equalize them first
find /tmp/debian-$dist-debootstrap /tmp/debian-$dist-mm -type d -print0 | xargs -0 touch --date="@$SOURCE_DATE_EPOCH"
# debootstrap never ran apt -- fixing permissions
for d in ./var/lib/apt/lists/partial ./var/cache/apt/archives/partial; do
chroot /tmp/debian-$dist-debootstrap chmod 0700 \$d
chroot /tmp/debian-$dist-debootstrap chown _apt:root \$d
done
tar -C /tmp/debian-$dist-debootstrap --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root1.tar .
tar -C /tmp/debian-$dist-mm --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root2.tar .
tar --full-time --verbose -tf /tmp/root1.tar > /tmp/root1.tar.list
tar --full-time --verbose -tf /tmp/root2.tar > /tmp/root2.tar.list
diff -u /tmp/root1.tar.list /tmp/root2.tar.list
rm /tmp/root1.tar /tmp/root2.tar /tmp/root1.tar.list /tmp/root2.tar.list
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# check if file properties (permissions, ownership, symlink names, modification time) differ
#
coverage.sh: fix typo
2020-03-22 13:07:28 +00:00
# we cannot use this (yet) because it cannot cope with paths that have [ or @ in them
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
#fmtree -c -p /tmp/debian-$dist-debootstrap -k flags,gid,link,mode,size,time,uid | sudo fmtree -p /tmp/debian-$dist-mm
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
rm -r /tmp/debian-$dist-debootstrap /tmp/debian-$dist-mm
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
done
done
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: test wrapping debootstrap in mmdebstrap
2020-05-03 18:32:50 +00:00
# this is a solution for https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=829134
print_header "mode=unshare,variant=custom: as debootstrap unshare wrapper"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
adduser --gecos user --disabled-password user
runuser -u user -- $CMD --variant=custom --mode=unshare --setup-hook='env container=lxc debootstrap --no-merged-usr unstable "\$1" $mirror' - /tmp/debian-mm.tar $mirror
mkdir /tmp/debian-mm
tar --xattrs --xattrs-include='*' -C /tmp/debian-mm -xf /tmp/debian-mm.tar
mkdir /tmp/debian-debootstrap
tar --xattrs --xattrs-include='*' -C /tmp/debian-debootstrap -xf "cache/debian-unstable--.tar"
# diff cannot compare device nodes, so we use tar to do that for us and then
# delete the directory
tar -C /tmp/debian-debootstrap -cf dev1.tar ./dev
tar -C /tmp/debian-mm -cf dev2.tar ./dev
cmp dev1.tar dev2.tar
rm dev1.tar dev2.tar
rm -r /tmp/debian-debootstrap/dev /tmp/debian-mm/dev
# remove downloaded deb packages
rm /tmp/debian-debootstrap/var/cache/apt/archives/*.deb
# remove aux-cache
rm /tmp/debian-debootstrap/var/cache/ldconfig/aux-cache
# remove logs
rm /tmp/debian-debootstrap/var/log/dpkg.log \
/tmp/debian-debootstrap/var/log/bootstrap.log \
/tmp/debian-debootstrap/var/log/alternatives.log \
/tmp/debian-mm/var/log/bootstrap.log
# debootstrap doesn't clean apt
rm /tmp/debian-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_unstable_main_binary-${HOSTARCH}_Packages \
/tmp/debian-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_unstable_Release \
/tmp/debian-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_unstable_Release.gpg
rm /tmp/debian-debootstrap/etc/machine-id /tmp/debian-mm/etc/machine-id
rm /tmp/debian-mm/var/cache/apt/archives/lock
rm /tmp/debian-mm/var/lib/apt/lists/lock
# check if the file content differs
diff --no-dereference --recursive /tmp/debian-debootstrap /tmp/debian-mm
# check permissions, ownership, symlink targets, modification times using tar
# mtimes of directories created by mmdebstrap will differ, thus we equalize them first
several fixes to chrootless mode
2021-08-17 21:39:20 +00:00
for d in etc/apt/preferences.d/ etc/apt/sources.list.d/ etc/dpkg/dpkg.cfg.d/ var/log/apt/; do
coverage.sh: test wrapping debootstrap in mmdebstrap
2020-05-03 18:32:50 +00:00
touch --date="@$SOURCE_DATE_EPOCH" /tmp/debian-debootstrap/\$d /tmp/debian-mm/\$d
done
# debootstrap never ran apt -- fixing permissions
for d in ./var/lib/apt/lists/partial ./var/cache/apt/archives/partial; do
chroot /tmp/debian-debootstrap chmod 0700 \$d
chroot /tmp/debian-debootstrap chown _apt:root \$d
done
tar -C /tmp/debian-debootstrap --numeric-owner --xattrs --xattrs-include='*' --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root1.tar .
tar -C /tmp/debian-mm --numeric-owner --xattrs --xattrs-include='*' --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root2.tar .
tar --full-time --verbose -tf /tmp/root1.tar > /tmp/root1.tar.list
tar --full-time --verbose -tf /tmp/root2.tar > /tmp/root2.tar.list
# despite SOURCE_DATE_EPOCH and --clamp-mtime, the timestamps in the tarball
# will slightly differ from each other in the sub-second precision (last
# decimals) so the tarballs will not be identical, so we use diff to compare
# content and tar to compare attributes
diff -u /tmp/root1.tar.list /tmp/root2.tar.list
rm /tmp/root1.tar /tmp/root2.tar /tmp/root1.tar.list /tmp/root2.tar.list
rm /tmp/debian-mm.tar
rm -r /tmp/debian-debootstrap /tmp/debian-mm
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
print_header "test --help"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: redirect grep output to /dev/null instead of using --quiet to prevent broken pipe
2020-01-10 11:07:03 +00:00
# we redirect to /dev/null instead of using --quiet to not cause a broken pipe
# when grep exits before mmdebstrap was able to write all its output
$CMD --help | grep --fixed-strings 'mmdebstrap [OPTION...] [SUITE [TARGET [MIRROR...]]]' >/dev/null
add --man option and reduce output of --help option Printing the full man page requires the perl-doc package. To avoid this dependency, print the less verbose output containing only the synopsis and the option list for the --help option and print the full output (requiring perldoc) for the --man option.
2019-11-29 07:45:08 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --man option and reduce output of --help option Printing the full man page requires the perl-doc package. To avoid this dependency, print the less verbose output containing only the synopsis and the option list for the --help option and print the full output (requiring perldoc) for the --man option.
2019-11-29 07:45:08 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --man option and reduce output of --help option Printing the full man page requires the perl-doc package. To avoid this dependency, print the less verbose output containing only the synopsis and the option list for the --help option and print the full output (requiring perldoc) for the --man option.
2019-11-29 07:45:08 +00:00
fi
print_header "test --man"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: redirect to /dev/null instead of --quiet to avoid broken pipe
2020-01-04 00:14:01 +00:00
# we redirect to /dev/null instead of using --quiet to not cause a broken pipe
# when grep exits before mmdebstrap was able to write all its output
$CMD --man | grep --fixed-strings 'mmdebstrap [OPTION...] [*SUITE* [*TARGET* [*MIRROR*...]]]' >/dev/null
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
END
add --version option
2019-02-23 07:55:31 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --version option
2019-02-23 07:55:31 +00:00
else
coverage.sh: always run --help and --version tests as root
2019-09-27 06:29:17 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --version option
2019-02-23 07:55:31 +00:00
fi
print_header "test --version"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: redirect grep output to /dev/null instead of using --quiet to prevent broken pipe
2020-01-10 11:07:03 +00:00
# we redirect to /dev/null instead of using --quiet to not cause a broken pipe
# when grep exits before mmdebstrap was able to write all its output
$CMD --version | egrep '^mmdebstrap [0-9](\.[0-9])+$' >/dev/null
add --version option
2019-02-23 07:55:31 +00:00
END
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
coverage.sh: always run --help and --version tests as root
2019-09-27 06:29:17 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: create directory"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
chroot /tmp/debian-chroot dpkg-query --showformat '\${binary:Package}\n' --show > pkglist.txt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort > tar1.txt
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
allow unshare as root user - this is useful when you are already root and want the benefits of unsharing the mount namespace to prevent messing up your system - if the unshare mode is used as root, the user namespace is not unshared anymore and newuidmap, setuid and friends are not called anymore - if the unshare mode is used as non-root test if the user namespace can be unshared, otherwise test if the mount namespace can be unshared
2021-01-13 15:05:57 +00:00
print_header "mode=unshare,variant=apt: unshare as root user"
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
allow unshare as root user - this is useful when you are already root and want the benefits of unsharing the mount namespace to prevent messing up your system - if the unshare mode is used as root, the user namespace is not unshared anymore and newuidmap, setuid and friends are not called anymore - if the unshare mode is used as non-root test if the user namespace can be unshared, otherwise test if the mount namespace can be unshared
2021-01-13 15:05:57 +00:00
[ "\$(whoami)" = "root" ]
$CMD --mode=unshare --variant=apt \
--customize-hook='chroot "\$1" sh -c "test -e /proc/self/fd"' \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
END
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
improve error message for missing /etc/subuid entry (closes: #9)
2021-08-18 20:15:05 +00:00
print_header "mode=unshare,variant=apt: fail without /etc/subuid"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
rm /etc/subuid
ret=0
runuser -u user -- $CMD --mode=unshare --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
echo expected failure but got exit \$ret >&2
exit 1
fi
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
print_header "mode=unshare,variant=apt: fail without username in /etc/subuid"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
awk -F: '\$1!="user"' /etc/subuid > /etc/subuid.tmp
mv /etc/subuid.tmp /etc/subuid
ret=0
runuser -u user -- $CMD --mode=unshare --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
echo expected failure but got exit \$ret >&2
exit 1
fi
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
run unshare --mount with --propagation unchanged to prevent 'cannot change root filesystem propagation' when running mmdebstrap from inside a chroot
2021-02-06 09:11:53 +00:00
# Before running unshare mode as root, we run "unshare --mount" but that fails
# if mmdebstrap itself is executed from within a chroot:
# unshare: cannot change root filesystem propagation: Invalid argument
# This test tests the workaround in mmdebstrap using --propagation unchanged
print_header "mode=root,variant=apt: unshare as root user inside chroot"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
[ "\$(whoami)" = "root" ]
cat << 'SCRIPT' > script.sh
#!/bin/sh
set -eu
rootfs="\$1"
mkdir -p "\$rootfs/mnt"
[ -e /usr/bin/mmdebstrap ] && cp -aT /usr/bin/mmdebstrap "\$rootfs/usr/bin/mmdebstrap"
[ -e ./mmdebstrap ] && cp -aT ./mmdebstrap "\$rootfs/mnt/mmdebstrap"
chroot "\$rootfs" env --chdir=/mnt \
$CMD --mode=unshare --variant=apt \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
SCRIPT
chmod +x script.sh
$CMD --mode=root --variant=apt --include=perl,mount \
--customize-hook=./script.sh \
--customize-hook="download /tmp/debian-chroot.tar /tmp/debian-chroot.tar" \
$DEFAULT_DIST /dev/null $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar script.sh
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
also run unshare with --propagation unchanged in root mode
2021-02-19 11:53:14 +00:00
# Same as above but this time we run mmdebstrap in root mode from inside a
# chroot.
print_header "mode=root,variant=apt: root mode inside chroot"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
[ "\$(whoami)" = "root" ]
cat << 'SCRIPT' > script.sh
#!/bin/sh
set -eu
rootfs="\$1"
mkdir -p "\$rootfs/mnt"
[ -e /usr/bin/mmdebstrap ] && cp -aT /usr/bin/mmdebstrap "\$rootfs/usr/bin/mmdebstrap"
[ -e ./mmdebstrap ] && cp -aT ./mmdebstrap "\$rootfs/mnt/mmdebstrap"
chroot "\$rootfs" env --chdir=/mnt \
$CMD --mode=root --variant=apt \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
SCRIPT
chmod +x script.sh
$CMD --mode=root --variant=apt --include=perl,mount \
--customize-hook=./script.sh \
--customize-hook="download /tmp/debian-chroot.tar /tmp/debian-chroot.tar" \
$DEFAULT_DIST /dev/null $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar script.sh
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
Automatically skip using mount if that's not possible - instead of throwing an error, just print a warning - can now run as root without cap_sys_admin - can now run without mount installed - --skip=check/canmount is not needed anymore
2021-08-26 13:40:27 +00:00
print_header "mode=unshare,variant=apt: root without cap_sys_admin"
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
Automatically skip using mount if that's not possible - instead of throwing an error, just print a warning - can now run as root without cap_sys_admin - can now run without mount installed - --skip=check/canmount is not needed anymore
2021-08-26 13:40:27 +00:00
[ "\$(whoami)" = "root" ]
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
capsh --drop=cap_sys_admin -- -c 'exec "\$@"' exec \
Automatically skip using mount if that's not possible - instead of throwing an error, just print a warning - can now run as root without cap_sys_admin - can now run without mount installed - --skip=check/canmount is not needed anymore
2021-08-26 13:40:27 +00:00
$CMD --mode=root --variant=apt \
--customize-hook='chroot "\$1" sh -c "test ! -e /proc/self/fd"' \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
END
coverage.sh: do not run cap_sys_admin test under lxc
2021-02-06 13:46:00 +00:00
if [ "$CONTAINER" = "lxc" ]; then
# see https://stackoverflow.com/questions/65748254/
echo "cannot run under lxc -- Skipping test..." >&2
skipped=$((skipped+1))
elif [ "$HAVE_QEMU" = "yes" ]; then
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
Automatically skip using mount if that's not possible - instead of throwing an error, just print a warning - can now run as root without cap_sys_admin - can now run without mount installed - --skip=check/canmount is not needed anymore
2021-08-26 13:40:27 +00:00
print_header "mode=root,variant=apt: mount is missing"
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
Automatically skip using mount if that's not possible - instead of throwing an error, just print a warning - can now run as root without cap_sys_admin - can now run without mount installed - --skip=check/canmount is not needed anymore
2021-08-26 13:40:27 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
exit 1
fi
Automatically skip using mount if that's not possible - instead of throwing an error, just print a warning - can now run as root without cap_sys_admin - can now run without mount installed - --skip=check/canmount is not needed anymore
2021-08-26 13:40:27 +00:00
for p in /bin /usr/bin /sbin /usr/sbin; do
rm -f "\$p/mount"
done
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
In root mode, check whether it's possible to mount - even if the user is root, they might not have permission to mount - check for CAP_SYS_ADMIN and unshare --mount before proceeding - allow one to disable the check with --skip=check/canmount - this is useful in container environments like docker
2021-01-13 17:40:24 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
Automatically skip using mount if that's not possible - instead of throwing an error, just print a warning - can now run as root without cap_sys_admin - can now run without mount installed - --skip=check/canmount is not needed anymore
2021-08-26 13:40:27 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
for variant in essential apt minbase buildd important standard; do
for format in tar squashfs ext2; do
coverage.sh: add fakechroot to test name
2021-09-21 12:19:31 +00:00
print_header "mode=root/unshare/fakechroot,variant=$variant: check for bit-by-bit identical $format output"
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
# fontconfig doesn't install reproducibly because differences
# in /var/cache/fontconfig/. See
# https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=864082
if [ "$variant" = "standard" ]; then
echo "skipping test because of #864082" >&2
skipped=$((skipped+1))
continue
fi
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
if [ "$variant" = "important" ] && [ "$DEFAULT_DIST" = "oldstable" ]; then
echo "skipping test on oldstable because /var/lib/systemd/catalog/database differs" >&2
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
skipped=$((skipped+1))
continue
fi
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
if [ "$format" = "squashfs" ] && [ "$DEFAULT_DIST" = "oldstable" ]; then
echo "skipping test on oldstable because squashfs-tools-ng is not available" >&2
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
skipped=$((skipped+1))
continue
fi
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
if [ "$format" = "ext2" ] && [ "$DEFAULT_DIST" = "oldstable" ]; then
echo "skipping test on oldstable because genext2fs does not support SOURCE_DATE_EPOCH" >&2
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
skipped=$((skipped+1))
continue
fi
cat << END > shared/test.sh
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
$CMD --mode=root --variant=$variant $DEFAULT_DIST /tmp/debian-chroot-root.$format $mirror
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
if [ "$format" = tar ]; then
printf 'ustar ' | cmp --bytes=6 --ignore-initial=257:0 /tmp/debian-chroot-root.tar -
elif [ "$format" = squashfs ]; then
printf 'hsqs' | cmp --bytes=4 /tmp/debian-chroot-root.squashfs -
elif [ "$format" = ext2 ]; then
printf '\123\357' | cmp --bytes=2 --ignore-initial=1080:0 /tmp/debian-chroot-root.ext2 -
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
else
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
echo "unknown format: $format" >&2
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
fi
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
runuser -u user -- $CMD --mode=unshare --variant=$variant $DEFAULT_DIST /tmp/debian-chroot-unshare.$format $mirror
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
cmp /tmp/debian-chroot-root.$format /tmp/debian-chroot-unshare.$format
make fakechroot mode bit-by-bit identical to the others
2021-08-27 17:50:11 +00:00
rm /tmp/debian-chroot-unshare.$format
add ldconfig.fakechroot and translate symlinks for bit-by-bit identical buildd variant
2021-09-16 14:23:46 +00:00
case $variant in essential|apt|minbase|buildd)
# variants important and standard differ because permissions drwxr-sr-x
# and extended attributes of ./var/log/journal/ cannot be preserved
# in fakechroot mode
make fakechroot mode bit-by-bit identical to the others
2021-08-27 17:50:11 +00:00
runuser -u user -- $CMD --mode=fakechroot --variant=$variant $DEFAULT_DIST /tmp/debian-chroot-fakechroot.$format $mirror
cmp /tmp/debian-chroot-root.$format /tmp/debian-chroot-fakechroot.$format
rm /tmp/debian-chroot-fakechroot.$format
;;
esac
rm /tmp/debian-chroot-root.$format
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
END
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
done
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
done
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
print_header "mode=unshare,variant=apt: test taridshift utility"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
echo user:100000:65536 | cmp /etc/subuid -
echo user:100000:65536 | cmp /etc/subgid -
sysctl -w kernel.unprivileged_userns_clone=1
# include iputils-ping so that we can verify that taridshift does not remove
# extended attributes
# run through tarshift no-op to create a tarball that should be bit-by-bit
# identical to a round trip through "taridshift X" and "taridshift -X"
runuser -u user -- $CMD --mode=unshare --variant=apt --include=iputils-ping $DEFAULT_DIST - $mirror \
| ./taridshift 0 > /tmp/debian-chroot.tar
coverage.sh: check that xattrs are set in the original tarball
2020-08-15 16:05:59 +00:00
# make sure that xattrs are set in the original tarball
mkdir /tmp/debian-chroot
tar --xattrs --xattrs-include='*' --directory /tmp/debian-chroot -xf /tmp/debian-chroot.tar ./bin/ping
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
echo "/tmp/debian-chroot/bin/ping cap_net_raw=ep" > /tmp/expected
getcap /tmp/debian-chroot/bin/ping | diff -u /tmp/expected -
coverage.sh: check that xattrs are set in the original tarball
2020-08-15 16:05:59 +00:00
rm /tmp/debian-chroot/bin/ping
rmdir /tmp/debian-chroot/bin
rmdir /tmp/debian-chroot
# shift the uid/gid forward by 100000 and backward by 100000
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
./taridshift 100000 < /tmp/debian-chroot.tar > /tmp/debian-chroot-shifted.tar
./taridshift -100000 < /tmp/debian-chroot-shifted.tar > /tmp/debian-chroot-shiftedback.tar
# the tarball before and after the roundtrip through taridshift should be bit
# by bit identical
cmp /tmp/debian-chroot.tar /tmp/debian-chroot-shiftedback.tar
# manually adjust uid/gid and compare "tar -t" output
tar --numeric-owner -tvf /tmp/debian-chroot.tar \
| sed 's# 100/0 # 100100/100000 #' \
| sed 's# 0/0 # 100000/100000 #' \
| sed 's# 0/5 # 100000/100005 #' \
| sed 's# 0/8 # 100000/100008 #' \
| sed 's# 0/42 # 100000/100042 #' \
| sed 's# 0/43 # 100000/100043 #' \
| sed 's# 0/50 # 100000/100050 #' \
| sed 's/ \\+/ /g' \
> /tmp/debian-chroot.txt
tar --numeric-owner -tvf /tmp/debian-chroot-shifted.tar \
| sed 's/ \\+/ /g' \
| diff -u /tmp/debian-chroot.txt -
mkdir /tmp/debian-chroot
tar --xattrs --xattrs-include='*' --directory /tmp/debian-chroot -xf /tmp/debian-chroot-shifted.tar
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
echo "100000 100000" > /tmp/expected
stat --format="%u %g" /tmp/debian-chroot/bin/ping | diff -u /tmp/expected -
echo "/tmp/debian-chroot/bin/ping cap_net_raw=ep" > /tmp/expected
getcap /tmp/debian-chroot/bin/ping | diff -u /tmp/expected -
echo "0 0" > /tmp/expected
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
runuser -u user -- $CMD --unshare-helper /usr/sbin/chroot /tmp/debian-chroot stat --format="%u %g" /bin/ping \
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
| diff -u /tmp/expected -
echo "/bin/ping cap_net_raw=ep" > /tmp/expected
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
runuser -u user -- $CMD --unshare-helper /usr/sbin/chroot /tmp/debian-chroot getcap /bin/ping \
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
| diff -u /tmp/expected -
rm /tmp/debian-chroot.tar /tmp/debian-chroot-shifted.tar /tmp/debian-chroot.txt /tmp/debian-chroot-shiftedback.tar /tmp/expected
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
rm -r /tmp/debian-chroot
END
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
if [ "$DEFAULT_DIST" = "oldstable" ]; then
echo "the python3 tarfile module in oldstable does not preserve xattrs -- Skipping test..." >&2
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
skipped=$((skipped+1))
elif [ "$HAVE_QEMU" = "yes" ]; then
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
print_header "mode=$defaultmode,variant=apt: test progress bars on fake tty"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
script -qfc "$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror" /dev/null
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
print_header "mode=$defaultmode,variant=apt: test --debug output on fake tty"
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
script -qfc "$CMD --mode=$defaultmode --debug --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror" /dev/null
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: existing empty directory"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
mkdir /tmp/debian-chroot
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
print_header "mode=root,variant=apt: existing directory with lost+found"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
mkdir /tmp/debian-chroot
mkdir /tmp/debian-chroot/lost+found
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
rmdir /tmp/debian-chroot/lost+found
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
fi
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
print_header "mode=$defaultmode,variant=apt: fail installing to non-empty lost+found"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
mkdir /tmp/debian-chroot
mkdir /tmp/debian-chroot/lost+found
touch /tmp/debian-chroot/lost+found/exists
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
rm /tmp/debian-chroot/lost+found/exists
rmdir /tmp/debian-chroot/lost+found
rmdir /tmp/debian-chroot
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
fi
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
print_header "mode=$defaultmode,variant=apt: fail installing to non-empty target directory"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
mkdir /tmp/debian-chroot
mkdir /tmp/debian-chroot/lost+found
touch /tmp/debian-chroot/exists
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
rmdir /tmp/debian-chroot/lost+found
rm /tmp/debian-chroot/exists
rmdir /tmp/debian-chroot
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
fi
Rework /dev, /sys, /proc mounting - assume all entries in @devfiles to be in /dev - allow for /dev, /sys and /proc not to exist in the target and print warning - allow for /dev entries as well as /sys and /proc not to exist on the outside - simplify umount by storing special options in @umountopts - remove superfluous checks for root and unshare mode - make sure /dev entries are less than 100 chars in size for tar
2021-03-08 07:04:35 +00:00
print_header "mode=unshare,variant=apt: missing device nodes outside the chroot"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
rm /dev/console
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
runuser -u user -- $CMD --mode=unshare --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
print_header "mode=unshare,variant=custom: missing /dev, /sys, /proc inside the chroot"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
runuser -u user -- $CMD --mode=unshare --variant=custom --include=dpkg,dash,diffutils,coreutils,libc-bin,sed $DEFAULT_DIST /dev/null $mirror
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
print_header "mode=root,variant=apt: chroot directory not accessible by _apt user"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
mkdir /tmp/debian-chroot
chmod 700 /tmp/debian-chroot
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
fi
use rm and find instead of remove_tree() * remove_tree() requires the CWD to be accessible or fails with cannot chdir to $CWD from $DIR_TO_DELETE: Permission denied, aborting. * CWD is not always accessible -- example: run mmdebstrap from a directory only accessible by the current user (like a tempdir) in unshare mode * find from findutils *also* requires CWD to be accessible but it's easier to temporarily change CWD in a subprocess because using there is no utility in perl core that changes CWD temporarily and cleans up after itself * we need to use find from findutils instead of rm in unshare mode because the root directory itself might not be removable by the unshared user so we only want to remove its subdirectories
2021-10-06 19:20:41 +00:00
print_header "mode=unshare,variant=apt: CWD directory not accessible by unshared user"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
mkdir /tmp/debian-chroot
chmod 700 /tmp/debian-chroot
chown user:user /tmp/debian-chroot
if [ "$CMD" = "./mmdebstrap" ]; then
CMD=\$(realpath --canonicalize-existing ./mmdebstrap)
elif [ "$CMD" = "perl -MDevel::Cover=-silent,-nogcov ./mmdebstrap" ]; then
CMD="perl -MDevel::Cover=-silent,-nogcov \$(realpath --canonicalize-existing ./mmdebstrap)"
else
CMD="$CMD"
fi
env --chdir=/tmp/debian-chroot runuser -u user -- \$CMD --mode=unshare --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
Instead of using gzip compression support, run compressor ourselves - otherwise ./dev tar cannot be concatenated with the rest - test compressor early - better document the TARGET option
2019-01-20 09:41:29 +00:00
print_header "mode=unshare,variant=apt: create gzip compressed tarball"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
runuser -u user -- $CMD --mode=unshare --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.gz $mirror
coverage.sh: make sure we have a gzip compressed file by checking the first three magic bytes
2020-01-03 23:36:21 +00:00
printf '\037\213\010' | cmp --bytes=3 /tmp/debian-chroot.tar.gz -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar.gz | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar.gz
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
fi
coverage.sh: add test that makes sure that TMPDIR is used and works in unshare mode
2020-03-07 22:34:32 +00:00
print_header "mode=unshare,variant=apt: custom TMPDIR"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
homedir=\$(runuser -u user -- sh -c 'cd && pwd')
runuser -u user -- mkdir "\$homedir/tmp"
runuser -u user -- env TMPDIR="\$homedir/tmp" $CMD --mode=unshare --variant=apt \
--setup-hook='case "\$1" in "'"\$homedir/tmp/mmdebstrap."'"??????????) exit 0;; *) exit 1;; esac' \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
# use rmdir as a quick check that nothing is remaining in TMPDIR
runuser -u user -- rmdir "\$homedir/tmp"
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
print_header "mode=$defaultmode,variant=apt: test xz compressed tarball"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.xz $mirror
printf '\3757zXZ\0' | cmp --bytes=6 /tmp/debian-chroot.tar.xz -
tar -tf /tmp/debian-chroot.tar.xz | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar.xz
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
fi
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
print_header "mode=$defaultmode,variant=apt: directory ending in .tar"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt --format=directory $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
ftype=\$(stat -c %F /tmp/debian-chroot.tar)
if [ "\$ftype" != directory ]; then
echo "expected directory but got: \$ftype" >&2
exit 1
fi
tar -C /tmp/debian-chroot.tar --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
print_header "mode=auto,variant=apt: test auto-mode without unshare capabilities"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=0
runuser -u user -- $CMD --mode=auto --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.gz $mirror
make fakechroot mode bit-by-bit identical to the others
2021-08-27 17:50:11 +00:00
tar -tf /tmp/debian-chroot.tar.gz | sort | diff -u tar1.txt -
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
rm /tmp/debian-chroot.tar.gz
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
fi
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
print_header "mode=$defaultmode,variant=apt: fail with missing lz4"
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.lz4 $mirror || ret=\$?
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
print_header "mode=$defaultmode,variant=apt: fail with path with quotes"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/quoted\"path $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
fi
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
print_header "mode=root,variant=apt: create tarball with /tmp mounted nodev"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
mount -t tmpfs -o nodev,nosuid,size=300M tmpfs /tmp
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
# use --customize-hook to exercise the mounting/unmounting code of block devices in root mode
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --customize-hook='mount | grep /dev/full' --customize-hook='test "\$(echo foo | tee /dev/full 2>&1 1>/dev/null)" = "tee: /dev/full: No space left on device"' $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
print_header "mode=$defaultmode,variant=apt: read from stdin, write to stdout"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo "deb $mirror $DEFAULT_DIST main" | $CMD --mode=$defaultmode --variant=apt > /tmp/debian-chroot.tar
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
fi
print_header "mode=$defaultmode,variant=apt: supply components manually"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt --components="main main" --comp="main,main" $DEFAULT_DIST /tmp/debian-chroot $mirror
echo "deb $mirror $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added
2019-01-25 11:06:34 +00:00
print_header "mode=root,variant=apt: stable default mirror"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added
2019-01-25 11:06:34 +00:00
cat << HOSTS >> /etc/hosts
127.0.0.1 deb.debian.org
127.0.0.1 security.debian.org
HOSTS
apt-cache policy
cat /etc/apt/sources.list
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt stable /tmp/debian-chroot
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list
coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added
2019-01-25 11:06:34 +00:00
deb http://deb.debian.org/debian stable main
deb http://deb.debian.org/debian stable-updates main
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
deb http://security.debian.org/debian-security stable-security main
coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added
2019-01-25 11:06:34 +00:00
SOURCES
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: pass distribution but implicitly write to stdout"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
cat << HOSTS >> /etc/hosts
127.0.0.1 deb.debian.org
127.0.0.1 security.debian.org
HOSTS
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST > /tmp/debian-chroot.tar
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
print_header "mode=$defaultmode,variant=apt: test aspcud apt solver"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=custom \
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
--include \$(cat pkglist.txt | tr '\n' ',') \
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
--aptopt='APT::Solver "aspcud"' \
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort \
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
| grep -v '^./etc/apt/apt.conf.d/99mmdebstrap$' \
| diff -u tar1.txt -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot.tar
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
fi
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: mirror is -"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo "deb $mirror $DEFAULT_DIST main" | $CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar -
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
print_header "mode=$defaultmode,variant=apt: copy:// mirror"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test requires the cache directory to be mounted on /mnt and should only be run inside a container" >&2
exit 1
fi
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar "deb copy:///mnt/cache/debian $DEFAULT_DIST main"
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
fi
print_header "mode=$defaultmode,variant=apt: fail with file:// mirror"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test requires the cache directory to be mounted on /mnt and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar "deb file:///mnt/cache/debian unstable main" || ret=\$?
rm /tmp/debian-chroot.tar
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
fi
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: mirror is deb..."
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar "deb $mirror $DEFAULT_DIST main"
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: mirror is real file"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo "deb $mirror $DEFAULT_DIST main" > /tmp/sources.list
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar /tmp/sources.list
support deb822-style format apt sources
2020-01-22 22:30:28 +00:00
tar -tf /tmp/debian-chroot.tar \
| sed 's#^./etc/apt/sources.list.d/0000sources.list\$#./etc/apt/sources.list#' \
| sort | diff -u tar1.txt -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot.tar /tmp/sources.list
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
support deb822-style format apt sources
2020-01-22 22:30:28 +00:00
print_header "mode=$defaultmode,variant=apt: test deb822 (1/2)"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
cat << SOURCES > /tmp/deb822.sources
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" > /tmp/sources.list
echo "deb ${mirror}3 $DEFAULT_DIST main" \
| $CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST \
/tmp/debian-chroot \
/tmp/deb822.sources \
${mirror}4 \
- \
"deb ${mirror}5 $DEFAULT_DIST main" \
${mirror}6 \
/tmp/sources.list
test ! -e /tmp/debian-chroot/etc/apt/sources.list
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0000deb822.sources -
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0001main.list -
deb ${mirror}4 $DEFAULT_DIST main
deb ${mirror}3 $DEFAULT_DIST main
deb ${mirror}5 $DEFAULT_DIST main
deb ${mirror}6 $DEFAULT_DIST main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0002sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . \
| {
tar -t \
| grep -v "^./etc/apt/sources.list.d/0000deb822.sources$" \
| grep -v "^./etc/apt/sources.list.d/0001main.list$" \
| grep -v "^./etc/apt/sources.list.d/0002sources.list";
printf "./etc/apt/sources.list\n";
} | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
rm /tmp/sources.list /tmp/deb822.sources
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
print_header "mode=$defaultmode,variant=apt: test deb822 (2/2)"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
cat << SOURCES > /tmp/deb822
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" > /tmp/sources
cat << SOURCES | $CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST \
/tmp/debian-chroot \
/tmp/deb822 \
- \
/tmp/sources
Types: deb
URIs: ${mirror}3
Suites: $DEFAULT_DIST
Components: main
SOURCES
test ! -e /tmp/debian-chroot/etc/apt/sources.list
ls -lha /tmp/debian-chroot/etc/apt/sources.list.d/
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0000deb822.sources -
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0001main.sources -
Types: deb
URIs: ${mirror}3
Suites: $DEFAULT_DIST
Components: main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0002sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . \
| {
tar -t \
| grep -v "^./etc/apt/sources.list.d/0000deb822.sources$" \
| grep -v "^./etc/apt/sources.list.d/0001main.sources$" \
| grep -v "^./etc/apt/sources.list.d/0002sources.list$";
printf "./etc/apt/sources.list\n";
} | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
rm /tmp/sources /tmp/deb822
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
Do not unconditionally read standard input mmdebstrap used to attempt reading stdin if it was not a tty. This leads to unexpected behaviour when mmdebstrap is used through ssh without a pseudo-terminal allocated like so: $ ssh remote mmdebstrap unstable /output/dir http://mirror This will stall forever, waiting for data on standard input. Or consider: $ ssh remote << END > somecommand > mmdebstrap unstable /output/dir http://mirror > othercommand END This will make mmdebstrap read "othercommand" and everything that follows as a sources.list entry. To prevent this unexpected behaviour, the following ways to use mmdebstrap will not be supported anymore: $ mmdebstrap unstable /output/dir < sources.list $ mmdebstrap unstable /output/dir http://mirror < sources.list Instead, one must now explicitly pass "-" if one wants mmdebstrap to read from stdin: $ mmdebstrap unstable /output/dir - < sources.list $ mmdebstrap unstable /output/dir http://mirror - < sources.list
2019-08-27 22:53:04 +00:00
print_header "mode=$defaultmode,variant=apt: automatic mirror from suite"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: don't execute test modifying /etc/hosts without qemu
2020-12-01 23:44:57 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
cat << HOSTS >> /etc/hosts
127.0.0.1 deb.debian.org
127.0.0.1 security.debian.org
HOSTS
Do not unconditionally read standard input mmdebstrap used to attempt reading stdin if it was not a tty. This leads to unexpected behaviour when mmdebstrap is used through ssh without a pseudo-terminal allocated like so: $ ssh remote mmdebstrap unstable /output/dir http://mirror This will stall forever, waiting for data on standard input. Or consider: $ ssh remote << END > somecommand > mmdebstrap unstable /output/dir http://mirror > othercommand END This will make mmdebstrap read "othercommand" and everything that follows as a sources.list entry. To prevent this unexpected behaviour, the following ways to use mmdebstrap will not be supported anymore: $ mmdebstrap unstable /output/dir < sources.list $ mmdebstrap unstable /output/dir http://mirror < sources.list Instead, one must now explicitly pass "-" if one wants mmdebstrap to read from stdin: $ mmdebstrap unstable /output/dir - < sources.list $ mmdebstrap unstable /output/dir http://mirror - < sources.list
2019-08-27 22:53:04 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: don't execute test modifying /etc/hosts without qemu
2020-12-01 23:44:57 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
print_header "mode=$defaultmode,variant=apt: invalid mirror"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror/invalid || ret=\$?
coverage.sh: remove /tmp/debian-chroot before exiting
2019-09-27 21:08:18 +00:00
rm /tmp/debian-chroot.tar
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
print_header "mode=root,variant=apt: fail installing to /"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
$CMD --mode=root --variant=apt $DEFAULT_DIST / $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
fi
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
print_header "mode=root,variant=apt: fail installing to existing file"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
touch /tmp/exists
ret=0
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/exists $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
fi
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
print_header "mode=$defaultmode,variant=apt: test arm64 without qemu support"
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
apt-get remove --yes qemu-user-static binfmt-support qemu-user
ret=0
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
$CMD --mode=$defaultmode --variant=apt --architectures=arm64 $DEFAULT_DIST /tmp/debian-chroot.tar $mirror || ret=\$?
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
exit 1
fi
END
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_QEMU" = "yes" ]; then
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
fi
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
print_header "mode=$defaultmode,variant=apt: test i386 (which can be executed without qemu)"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
# remove qemu just to be sure
apt-get remove --yes qemu-user-static binfmt-support qemu-user
$CMD --mode=$defaultmode --variant=apt --architectures=i386 $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
# we ignore differences between architectures by ignoring some files
# and renaming others
{ tar -tf /tmp/debian-chroot.tar \
| grep -v '^\./usr/bin/i386$' \
| grep -v '^\./lib/ld-linux\.so\.2$' \
| grep -v '^\./lib/i386-linux-gnu/ld-linux\.so\.2$' \
| grep -v '^\./usr/lib/gcc/i686-linux-gnu/$' \
coverage.sh: use regex to not rely on exact gcc version
2020-03-06 07:44:22 +00:00
| grep -v '^\./usr/lib/gcc/i686-linux-gnu/[0-9]\+/$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| grep -v '^\./usr/share/man/man8/i386\.8\.gz$' \
coverage.sh: also filter out changelog of Debian native packages
2019-09-28 18:57:33 +00:00
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.i386\.gz$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| sed 's/i386-linux-gnu/x86_64-linux-gnu/' \
| sed 's/i386/amd64/';
} | sort > tar2.txt
{ cat tar1.txt \
| grep -v '^\./usr/bin/i386$' \
| grep -v '^\./usr/bin/x86_64$' \
| grep -v '^\./lib64/$' \
| grep -v '^\./lib64/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./usr/lib/gcc/x86_64-linux-gnu/$' \
coverage.sh: use regex to not rely on exact gcc version
2020-03-06 07:44:22 +00:00
| grep -v '^\./usr/lib/gcc/x86_64-linux-gnu/[0-9]\+/$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| grep -v '^\./lib/x86_64-linux-gnu/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec-2\.[0-9]\+\.so$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec\.so\.1$' \
coverage.sh: also filter out changelog of Debian native packages
2019-09-28 18:57:33 +00:00
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.amd64\.gz$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| grep -v '^\./usr/share/man/man8/i386\.8\.gz$' \
| grep -v '^\./usr/share/man/man8/x86_64\.8\.gz$';
} | sort | diff -u - tar2.txt
rm /tmp/debian-chroot.tar
END
coverage.sh: comparing amd64 with i386 should only be done with RUN_MA_SAME_TESTS = yes
2020-06-24 21:11:03 +00:00
# this test compares the contents of different architectures, so this might
# fail if the versions do not match
if [ "$RUN_MA_SAME_TESTS" = "yes" ]; then
if [ "$HOSTARCH" != amd64 ]; then
echo "HOSTARCH != amd64 -- Skipping test..." >&2
skipped=$((skipped+1))
elif [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
else
coverage.sh: comparing amd64 with i386 should only be done with RUN_MA_SAME_TESTS = yes
2020-06-24 21:11:03 +00:00
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
fi
coverage.sh: instead of installing gcc-8-base:armhf, install libmagic-mgc:armhf - is not part of the native installation set - does not have any dependencies - installs only few files - doesn't change its name regularly (like gcc-*-base)
2019-08-26 13:45:38 +00:00
# to test foreign architecture package installation we choose a package which
# - is not part of the native installation set
# - does not have any dependencies
# - installs only few files
# - doesn't change its name regularly (like gcc-*-base)
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
print_header "mode=root,variant=apt: test --include=libmagic-mgc:arm64"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
$CMD --mode=root --variant=apt --architectures=amd64,arm64 --include=libmagic-mgc:arm64 $DEFAULT_DIST /tmp/debian-chroot $mirror
{ echo "amd64"; echo "arm64"; } | cmp /tmp/debian-chroot/var/lib/dpkg/arch -
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/arch
rm /tmp/debian-chroot/var/lib/apt/extended_states
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.list
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.md5sums
rm /tmp/debian-chroot/usr/lib/file/magic.mgc
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/README.Debian
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.Debian.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/copyright
rm /tmp/debian-chroot/usr/share/file/magic.mgc
rm /tmp/debian-chroot/usr/share/misc/magic.mgc
rmdir /tmp/debian-chroot/usr/share/doc/libmagic-mgc/
rmdir /tmp/debian-chroot/usr/share/file/magic/
rmdir /tmp/debian-chroot/usr/share/file/
rmdir /tmp/debian-chroot/usr/lib/file/
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
if [ "$RUN_MA_SAME_TESTS" = "yes" ]; then
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_QEMU" = "yes" ]; then
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
fi
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
fi
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
print_header "mode=root,variant=apt: test --include=libmagic-mgc:arm64 with multiple --arch options"
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
$CMD --mode=root --variant=apt --architectures=amd64 --architectures=arm64 --include=libmagic-mgc:arm64 $DEFAULT_DIST /tmp/debian-chroot $mirror
{ echo "amd64"; echo "arm64"; } | cmp /tmp/debian-chroot/var/lib/dpkg/arch -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/arch
rm /tmp/debian-chroot/var/lib/apt/extended_states
coverage.sh: instead of installing gcc-8-base:armhf, install libmagic-mgc:armhf - is not part of the native installation set - does not have any dependencies - installs only few files - doesn't change its name regularly (like gcc-*-base)
2019-08-26 13:45:38 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.list
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.md5sums
rm /tmp/debian-chroot/usr/lib/file/magic.mgc
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/README.Debian
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.Debian.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/copyright
rm /tmp/debian-chroot/usr/share/file/magic.mgc
rm /tmp/debian-chroot/usr/share/misc/magic.mgc
rmdir /tmp/debian-chroot/usr/share/doc/libmagic-mgc/
rmdir /tmp/debian-chroot/usr/share/file/magic/
rmdir /tmp/debian-chroot/usr/share/file/
rmdir /tmp/debian-chroot/usr/lib/file/
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
if [ "$RUN_MA_SAME_TESTS" = "yes" ]; then
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_QEMU" = "yes" ]; then
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: test --aptopt"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
echo 'Acquire::Languages "none";' > /tmp/config
$CMD --mode=root --variant=apt --aptopt='Acquire::Check-Valid-Until "false"' --aptopt=/tmp/config $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
printf 'Acquire::Check-Valid-Until "false";\nAcquire::Languages "none";\n' | cmp /tmp/debian-chroot/etc/apt/apt.conf.d/99mmdebstrap -
rm /tmp/debian-chroot/etc/apt/apt.conf.d/99mmdebstrap
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
rm -r /tmp/debian-chroot /tmp/config
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
print_header "mode=root,variant=apt: test --keyring"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
rm /etc/apt/trusted.gpg.d/*.gpg
make_mirro.sh: install gpg into qemu machine
2020-01-21 12:08:35 +00:00
$CMD --mode=root --variant=apt --keyring=/usr/share/keyrings/debian-archive-keyring.gpg --keyring=/usr/share/keyrings/ $DEFAULT_DIST /tmp/debian-chroot "deb $mirror $DEFAULT_DIST main"
# make sure that no [signedby=...] managed to make it into the sources.list
echo "deb $mirror $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list -
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
fi
print_header "mode=root,variant=apt: test --keyring overwrites"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
mkdir -p /tmp/emptydir
touch /tmp/emptyfile
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
# this overwrites the apt keyring options and should fail
ret=0
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
$CMD --mode=root --variant=apt --keyring=/tmp/emptydir --keyring=/tmp/emptyfile $DEFAULT_DIST /tmp/debian-chroot "deb $mirror $DEFAULT_DIST main" || ret=\$?
make_mirro.sh: install gpg into qemu machine
2020-01-21 12:08:35 +00:00
# make sure that no [signedby=...] managed to make it into the sources.list
echo "deb $mirror $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list -
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
rm -r /tmp/debian-chroot
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rmdir /tmp/emptydir
rm /tmp/emptyfile
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
exit 1
fi
END
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
fi
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
print_header "mode=root,variant=apt: test signed-by without host keys"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
rm /etc/apt/trusted.gpg.d/*.gpg
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
printf 'deb [signed-by="/usr/share/keyrings/debian-archive-keyring.gpg"] $mirror $DEFAULT_DIST main\n' | cmp /tmp/debian-chroot/etc/apt/sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
fi
print_header "mode=root,variant=apt: test signed-by with host keys"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
printf 'deb $mirror $DEFAULT_DIST main\n' | cmp /tmp/debian-chroot/etc/apt/sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
else
make_mirro.sh: install gpg into qemu machine
2020-01-21 12:08:35 +00:00
./run_null.sh SUDO
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: test --dpkgopt"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
echo no-pager > /tmp/config
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility
2020-08-25 11:02:33 +00:00
$CMD --mode=root --variant=apt --dpkgopt="path-exclude=/usr/share/doc/*" --dpkgopt=/tmp/config --dpkgopt="path-include=/usr/share/doc/dpkg/copyright" $DEFAULT_DIST /tmp/debian-chroot $mirror
printf 'path-exclude=/usr/share/doc/*\nno-pager\npath-include=/usr/share/doc/dpkg/copyright\n' | cmp /tmp/debian-chroot/etc/dpkg/dpkg.cfg.d/99mmdebstrap -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/etc/dpkg/dpkg.cfg.d/99mmdebstrap
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort > tar2.txt
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility
2020-08-25 11:02:33 +00:00
{ grep -v '^./usr/share/doc/.' tar1.txt; echo ./usr/share/doc/dpkg/; echo ./usr/share/doc/dpkg/copyright; } | sort | diff -u - tar2.txt
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
rm -r /tmp/debian-chroot /tmp/config
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: test --include"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
rm /tmp/debian-chroot/var/lib/apt/extended_states
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
allow multiple --include options and use array instead of hash Package order is important when calling apt. Consider this dependency graph: A -> B -> C | D , E -> D | C "apt install A E" it will install "A B C E" "apt install E A" it will install "E D A B"
2019-10-28 14:35:29 +00:00
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --include options and use array instead of hash Package order is important when calling apt. Consider this dependency graph: A -> B -> C | D , E -> D | C "apt install A E" it will install "A B C E" "apt install E A" it will install "E D A B"
2019-10-28 14:35:29 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --include options and use array instead of hash Package order is important when calling apt. Consider this dependency graph: A -> B -> C | D , E -> D | C "apt install A E" it will install "A B C E" "apt install E A" it will install "E D A B"
2019-10-28 14:35:29 +00:00
fi
print_header "mode=root,variant=apt: test multiple --include"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=root --variant=apt --include=doc-debian --include=tzdata $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
rm /tmp/debian-chroot/etc/localtime
rm /tmp/debian-chroot/etc/timezone
rm /tmp/debian-chroot/usr/sbin/tzconfig
rm -r /tmp/debian-chroot/usr/share/doc/tzdata
rm -r /tmp/debian-chroot/usr/share/zoneinfo
rm /tmp/debian-chroot/var/lib/apt/extended_states
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.list
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.config
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.postinst
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.postrm
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.templates
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
don't ignore packages added via --include if multiple apt indices are used
2020-12-01 23:33:18 +00:00
# This checks for https://bugs.debian.org/976166
# Since $DEFAULT_DIST varies, we hardcode stable and unstable.
print_header "mode=root,variant=apt: test --include with multiple apt sources"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=root --variant=minbase --include=doc-debian unstable /tmp/debian-chroot "deb $mirror unstable main" "deb $mirror stable main"
chroot /tmp/debian-chroot dpkg-query --show doc-debian
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
print_header "mode=root,variant=apt: test merged-usr via --setup-hook"
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
$CMD --mode=root --variant=apt \
coverage.sh: setup00-merged-usr.sh moved into a subdirectory
2021-09-21 21:01:58 +00:00
--setup-hook=./hooks/merged-usr/setup00.sh \
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
--customize-hook='[ -L "\$1"/bin -a -L "\$1"/sbin -a -L "\$1"/lib ]' \
$DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort > tar2.txt
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
{
sed -e 's/^\.\/bin\//.\/usr\/bin\//;s/^\.\/lib\//.\/usr\/lib\//;s/^\.\/sbin\//.\/usr\/sbin\//;' tar1.txt | {
case $HOSTARCH in
amd64) sed -e 's/^\.\/lib32\//.\/usr\/lib32\//;s/^\.\/lib64\//.\/usr\/lib64\//;s/^\.\/libx32\//.\/usr\/libx32\//;';;
ppc64el) sed -e 's/^\.\/lib64\//.\/usr\/lib64\//;';;
*) cat;;
esac
};
echo ./bin;
echo ./lib;
echo ./sbin;
case $HOSTARCH in
amd64)
echo ./lib32;
echo ./lib64;
echo ./libx32;
echo ./usr/lib32/;
echo ./usr/libx32/;
;;
coverage.sh,make_mirror.sh: add i386 support
2020-11-29 20:39:08 +00:00
i386)
echo ./lib64;
echo ./libx32;
echo ./usr/lib64/;
echo ./usr/libx32/;
;;
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
ppc64el)
echo ./lib64;
;;
coverage.sh: support for s390x
2021-11-09 06:28:59 +00:00
s390x)
echo ./lib32;
echo ./usr/lib32/;
;;
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
esac
} | sort -u | diff -u - tar2.txt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
fi
print_header "mode=root,variant=apt: test --essential-hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
cat << 'SCRIPT' > /tmp/essential.sh
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
#!/bin/sh
echo tzdata tzdata/Zones/Europe select Berlin | chroot "\$1" debconf-set-selections
SCRIPT
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
chmod +x /tmp/essential.sh
$CMD --mode=root --variant=apt --include=tzdata --essential-hook='echo tzdata tzdata/Areas select Europe | chroot "\$1" debconf-set-selections' --essential-hook=/tmp/essential.sh $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo Europe/Berlin | cmp /tmp/debian-chroot/etc/timezone
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort \
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
| grep -v '^./etc/localtime' \
| grep -v '^./etc/timezone' \
| grep -v '^./usr/sbin/tzconfig' \
| grep -v '^./usr/share/doc/tzdata' \
| grep -v '^./usr/share/zoneinfo' \
| grep -v '^./var/lib/dpkg/info/tzdata.' \
do not cleanup apt and dpkg lock files to not set bad precedence
2019-02-27 23:20:00 +00:00
| grep -v '^./var/lib/apt/extended_states$' \
coverage.sh: use pipe to diff instead of temporary file
2019-03-15 09:24:13 +00:00
| diff -u tar1.txt -
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/essential.sh
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
fi
print_header "mode=root,variant=apt: test --customize-hook"
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
cat << 'SCRIPT' > /tmp/customize.sh
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
#!/bin/sh
chroot "\$1" whoami > "\$1/output2"
chroot "\$1" pwd >> "\$1/output2"
SCRIPT
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
chmod +x /tmp/customize.sh
$CMD --mode=root --variant=apt --customize-hook='chroot "\$1" sh -c "whoami; pwd" > "\$1/output1"' --customize-hook=/tmp/customize.sh $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
printf "root\n/\n" | cmp /tmp/debian-chroot/output1
printf "root\n/\n" | cmp /tmp/debian-chroot/output2
rm /tmp/debian-chroot/output1
rm /tmp/debian-chroot/output2
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/customize.sh
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
END
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
print_header "mode=root,variant=apt: test failing --customize-hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --customize-hook='chroot "\$1" sh -c "exit 1"' $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
coverage.sh: remove /tmp/debian-chroot before exiting
2019-09-27 21:08:18 +00:00
rm -r /tmp/debian-chroot
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
print_header "mode=root,variant=apt: test sigint during --customize-hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
setsid --wait $CMD --mode=root --variant=apt --customize-hook='touch done && sleep 10 && touch fail' $DEFAULT_DIST /tmp/debian-chroot $mirror &
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
pid=\$!
while sleep 1; do [ -e done ] && break; done
rm done
pgid=\$(echo \$(ps -p \$pid -o pgid=))
/bin/kill --signal INT -- -\$pgid
ret=0
wait \$pid || ret=\$?
coverage.sh: remove /tmp/debian-chroot before exiting
2019-09-27 21:08:18 +00:00
rm -r /tmp/debian-chroot
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ -e fail ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo customize hook was not interrupted >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
rm fail
exit 1
fi
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
fi
coverage.sh: add test for hook-dir
2020-08-17 16:59:54 +00:00
print_header "mode=root,variant=apt: test --hook-directory"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
for h in hookA hookB; do
mkdir /tmp/\$h
for s in setup extract essential customize; do
cat << SCRIPT > /tmp/\$h/\${s}00.sh
#!/bin/sh
echo \$h/\${s}00 >> "\\\$1/\$s"
SCRIPT
chmod +x /tmp/\$h/\${s}00.sh
cat << SCRIPT > /tmp/\$h/\${s}01.sh
echo \$h/\${s}01 >> "\\\$1/\$s"
SCRIPT
chmod +x /tmp/\$h/\${s}01.sh
done
done
$CMD --mode=root --variant=apt \
--setup-hook='echo cliA/setup >> "\$1"/setup' \
--extract-hook='echo cliA/extract >> "\$1"/extract' \
--essential-hook='echo cliA/essential >> "\$1"/essential' \
--customize-hook='echo cliA/customize >> "\$1"/customize' \
--hook-dir=/tmp/hookA \
--setup-hook='echo cliB/setup >> "\$1"/setup' \
--extract-hook='echo cliB/extract >> "\$1"/extract' \
--essential-hook='echo cliB/essential >> "\$1"/essential' \
--customize-hook='echo cliB/customize >> "\$1"/customize' \
--hook-dir=/tmp/hookB \
--setup-hook='echo cliC/setup >> "\$1"/setup' \
--extract-hook='echo cliC/extract >> "\$1"/extract' \
--essential-hook='echo cliC/essential >> "\$1"/essential' \
--customize-hook='echo cliC/customize >> "\$1"/customize' \
$DEFAULT_DIST /tmp/debian-chroot $mirror
printf "cliA/setup\nhookA/setup00\nhookA/setup01\ncliB/setup\nhookB/setup00\nhookB/setup01\ncliC/setup\n" | diff -u - /tmp/debian-chroot/setup
printf "cliA/extract\nhookA/extract00\nhookA/extract01\ncliB/extract\nhookB/extract00\nhookB/extract01\ncliC/extract\n" | diff -u - /tmp/debian-chroot/extract
printf "cliA/essential\nhookA/essential00\nhookA/essential01\ncliB/essential\nhookB/essential00\nhookB/essential01\ncliC/essential\n" | diff -u - /tmp/debian-chroot/essential
printf "cliA/customize\nhookA/customize00\nhookA/customize01\ncliB/customize\nhookB/customize00\nhookB/customize01\ncliC/customize\n" | diff -u - /tmp/debian-chroot/customize
for s in setup extract essential customize; do
rm /tmp/debian-chroot/\$s
done
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
for h in hookA hookB; do
for s in setup extract essential customize; do
rm /tmp/\$h/\${s}00.sh
rm /tmp/\$h/\${s}01.sh
done
rmdir /tmp/\$h
done
rm -r /tmp/debian-chroot
END
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
print_header "mode=root,variant=apt: test eatmydata via --hook-dir"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
cat << SCRIPT > /tmp/checkeatmydata.sh
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
#!/bin/sh
set -exu
cat << EOF | diff - "\\\$1"/usr/bin/dpkg
#!/bin/sh
exec /usr/bin/eatmydata /usr/bin/dpkg.distrib "\\\\\\\$@"
EOF
[ -e "\\\$1"/usr/bin/eatmydata ]
SCRIPT
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
chmod +x /tmp/checkeatmydata.sh
coverage.sh: assemble ELF header according to bits and endian
2020-11-29 21:24:01 +00:00
# first four bytes: magic
elfheader="\\177ELF"
# fifth byte: bits
case "\$(dpkg-architecture -qDEB_HOST_ARCH_BITS)" in
32) elfheader="\$elfheader\\001";;
64) elfheader="\$elfheader\\002";;
*) echo "bits not supported"; exit 1;;
esac
# sixth byte: endian
case "\$(dpkg-architecture -qDEB_HOST_ARCH_ENDIAN)" in
little) elfheader="\$elfheader\\001";;
big) elfheader="\$elfheader\\002";;
*) echo "endian not supported"; exit 1;;
esac
# seventh and eigth byte: elf version (1) and abi (unset)
elfheader="\$elfheader\\001\\000"
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
$CMD --mode=root --variant=apt \
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
--customize-hook=/tmp/checkeatmydata.sh \
--essential-hook=/tmp/checkeatmydata.sh \
coverage.sh: assemble ELF header according to bits and endian
2020-11-29 21:24:01 +00:00
--extract-hook='printf "'"\$elfheader"'" | cmp --bytes=8 - "\$1"/usr/bin/dpkg' \
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
--hook-dir=./hooks/eatmydata \
coverage.sh: assemble ELF header according to bits and endian
2020-11-29 21:24:01 +00:00
--customize-hook='printf "'"\$elfheader"'" | cmp --bytes=8 - "\$1"/usr/bin/dpkg' \
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
$DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/checkeatmydata.sh
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
rm -r /tmp/debian-chroot
END
coverage.sh: add test for hook-dir
2020-08-17 16:59:54 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
put hook listener into its own function and expose it to the CLI via --hook-listener
2020-08-15 20:36:13 +00:00
print_header "mode=root,variant=apt: test special hooks using helpers"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
mkfifo /tmp/myfifo
mkdir /tmp/root
ln -s /real /tmp/root/link
mkdir /tmp/root/real
run_testA() {
echo content > /tmp/foo
coverage.sh: send adios to hook-listener
2020-08-28 12:37:05 +00:00
{ { { $CMD --hook-helper /tmp/root root setup env 1 upload /tmp/foo \$1 < /tmp/myfifo 3>&-; echo \$? >&3; printf "\\000\\000adios";
pass verbosity to hook-listener
2020-11-13 21:37:53 +00:00
} | $CMD --hook-listener 1 3>&- >/tmp/myfifo; echo \$?; } 3>&1;
put hook listener into its own function and expose it to the CLI via --hook-listener
2020-08-15 20:36:13 +00:00
} | { read xs1; [ "\$xs1" -eq 0 ]; read xs2; [ "\$xs2" -eq 0 ]; }
echo content | diff -u - /tmp/root/real/foo
rm /tmp/foo
rm /tmp/root/real/foo
}
run_testA link/foo
run_testA /link/foo
run_testA ///link///foo///
run_testA /././link/././foo/././
run_testA /link/../link/foo
run_testA /link/../../link/foo
run_testA /../../link/foo
rmdir /tmp/root/real
rm /tmp/root/link
rmdir /tmp/root
rm /tmp/myfifo
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
expose hook name to hooks via MMDEBSTRAP_HOOK environment variable
2021-02-06 08:18:05 +00:00
print_header "mode=root,variant=apt: test special hooks using helpers and env vars"
set MMDEBSTRAP_APT_CONFIG, MMDEBSTRAP_MODE and MMDEBSTRAP_HOOKSOCK for hook scripts
2021-01-09 18:41:59 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
cat << 'SCRIPT' > /tmp/script.sh
#!/bin/sh
set -eu
echo "MMDEBSTRAP_APT_CONFIG \$MMDEBSTRAP_APT_CONFIG"
expose hook name to hooks via MMDEBSTRAP_HOOK environment variable
2021-02-06 08:18:05 +00:00
echo "\$MMDEBSTRAP_HOOK" >> /tmp/hooks
set MMDEBSTRAP_APT_CONFIG, MMDEBSTRAP_MODE and MMDEBSTRAP_HOOKSOCK for hook scripts
2021-01-09 18:41:59 +00:00
[ "\$MMDEBSTRAP_MODE" = "root" ]
expose hook name to hooks via MMDEBSTRAP_HOOK environment variable
2021-02-06 08:18:05 +00:00
echo test-content \$MMDEBSTRAP_HOOK > test
$CMD --hook-helper "\$1" "\$MMDEBSTRAP_MODE" "\$MMDEBSTRAP_HOOK" env 1 upload test /test <&\$MMDEBSTRAP_HOOKSOCK >&\$MMDEBSTRAP_HOOKSOCK
set MMDEBSTRAP_APT_CONFIG, MMDEBSTRAP_MODE and MMDEBSTRAP_HOOKSOCK for hook scripts
2021-01-09 18:41:59 +00:00
rm test
echo "content inside chroot:"
cat "\$1/test"
expose hook name to hooks via MMDEBSTRAP_HOOK environment variable
2021-02-06 08:18:05 +00:00
[ "test-content \$MMDEBSTRAP_HOOK" = "\$(cat "\$1/test")" ]
$CMD --hook-helper "\$1" "\$MMDEBSTRAP_MODE" "\$MMDEBSTRAP_HOOK" env 1 download /test test <&\$MMDEBSTRAP_HOOKSOCK >&\$MMDEBSTRAP_HOOKSOCK
set MMDEBSTRAP_APT_CONFIG, MMDEBSTRAP_MODE and MMDEBSTRAP_HOOKSOCK for hook scripts
2021-01-09 18:41:59 +00:00
echo "content outside chroot:"
cat test
expose hook name to hooks via MMDEBSTRAP_HOOK environment variable
2021-02-06 08:18:05 +00:00
[ "test-content \$MMDEBSTRAP_HOOK" = "\$(cat test)" ]
set MMDEBSTRAP_APT_CONFIG, MMDEBSTRAP_MODE and MMDEBSTRAP_HOOKSOCK for hook scripts
2021-01-09 18:41:59 +00:00
rm test
SCRIPT
chmod +x /tmp/script.sh
$CMD --mode=root --variant=apt \
expose hook name to hooks via MMDEBSTRAP_HOOK environment variable
2021-02-06 08:18:05 +00:00
--setup-hook=/tmp/script.sh \
--extract-hook=/tmp/script.sh \
--essential-hook=/tmp/script.sh \
--customize-hook=/tmp/script.sh \
set MMDEBSTRAP_APT_CONFIG, MMDEBSTRAP_MODE and MMDEBSTRAP_HOOKSOCK for hook scripts
2021-01-09 18:41:59 +00:00
$DEFAULT_DIST /tmp/debian-chroot $mirror
expose hook name to hooks via MMDEBSTRAP_HOOK environment variable
2021-02-06 08:18:05 +00:00
printf "setup\nextract\nessential\ncustomize\n" | diff -u - /tmp/hooks
rm /tmp/script.sh /tmp/hooks
set MMDEBSTRAP_APT_CONFIG, MMDEBSTRAP_MODE and MMDEBSTRAP_HOOKSOCK for hook scripts
2021-01-09 18:41:59 +00:00
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
# test special hooks
for mode in root unshare fakechroot proot; do
print_header "mode=$mode,variant=apt: test special hooks with $mode mode"
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_PROOT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
continue
fi
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && [ "$mode" != "root" ] && prefix="runuser -u user --"
[ "$mode" = "fakechroot" ] && prefix="\$prefix fakechroot fakeroot"
symlinktarget=/real
case $mode in fakechroot|proot) symlinktarget='\$1/real';; esac
echo copy-in-setup > /tmp/copy-in-setup
echo copy-in-essential > /tmp/copy-in-essential
echo copy-in-customize > /tmp/copy-in-customize
echo tar-in-setup > /tmp/tar-in-setup
echo tar-in-essential > /tmp/tar-in-essential
echo tar-in-customize > /tmp/tar-in-customize
Restore deterministic tar with pax and xattr support - all creating and extraction of tarballs respects extended attributes - extended attributes require pax format, so explicitly request the format - to make pax bit-by-bit reproducible, ctime, atime and PID have to be removed from the headers with: --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime - always pass --numeric-owner to tar - always pass --xattrs when creating a tar - always pass --xattrs --xattrs-include=* when extracting a tar
2020-01-21 12:24:49 +00:00
tar --numeric-owner --format=pax --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime -C /tmp -cf /tmp/tar-in-setup.tar tar-in-setup
tar --numeric-owner --format=pax --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime -C /tmp -cf /tmp/tar-in-essential.tar tar-in-essential
tar --numeric-owner --format=pax --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime -C /tmp -cf /tmp/tar-in-customize.tar tar-in-customize
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
rm /tmp/tar-in-setup
rm /tmp/tar-in-essential
rm /tmp/tar-in-customize
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
echo upload-setup > /tmp/upload-setup
echo upload-essential > /tmp/upload-essential
echo upload-customize > /tmp/upload-customize
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
mkdir /tmp/sync-in-setup
mkdir /tmp/sync-in-essential
mkdir /tmp/sync-in-customize
echo sync-in-setup > /tmp/sync-in-setup/file
echo sync-in-essential > /tmp/sync-in-essential/file
echo sync-in-customize > /tmp/sync-in-customize/file
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
\$prefix $CMD --mode=$mode --variant=apt \
--setup-hook='mkdir "\$1/real"' \
--setup-hook='copy-in /tmp/copy-in-setup /real' \
--setup-hook='echo copy-in-setup | cmp "\$1/real/copy-in-setup" -' \
--setup-hook='rm "\$1/real/copy-in-setup"' \
--setup-hook='echo copy-out-setup > "\$1/real/copy-out-setup"' \
--setup-hook='copy-out /real/copy-out-setup /tmp' \
--setup-hook='rm "\$1/real/copy-out-setup"' \
--setup-hook='tar-in /tmp/tar-in-setup.tar /real' \
--setup-hook='echo tar-in-setup | cmp "\$1/real/tar-in-setup" -' \
--setup-hook='tar-out /real/tar-in-setup /tmp/tar-out-setup.tar' \
--setup-hook='rm "\$1"/real/tar-in-setup' \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
--setup-hook='upload /tmp/upload-setup /real/upload' \
--setup-hook='echo upload-setup | cmp "\$1/real/upload" -' \
--setup-hook='download /real/upload /tmp/download-setup' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--setup-hook='rm "\$1/real/upload"' \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
--setup-hook='sync-in /tmp/sync-in-setup /real' \
--setup-hook='echo sync-in-setup | cmp "\$1/real/file" -' \
--setup-hook='sync-out /real /tmp/sync-out-setup' \
--setup-hook='rm "\$1/real/file"' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--essential-hook='ln -s "'"\$symlinktarget"'" "\$1/symlink"' \
--essential-hook='copy-in /tmp/copy-in-essential /symlink' \
--essential-hook='echo copy-in-essential | cmp "\$1/real/copy-in-essential" -' \
--essential-hook='rm "\$1/real/copy-in-essential"' \
--essential-hook='echo copy-out-essential > "\$1/real/copy-out-essential"' \
--essential-hook='copy-out /symlink/copy-out-essential /tmp' \
--essential-hook='rm "\$1/real/copy-out-essential"' \
--essential-hook='tar-in /tmp/tar-in-essential.tar /symlink' \
--essential-hook='echo tar-in-essential | cmp "\$1/real/tar-in-essential" -' \
--essential-hook='tar-out /symlink/tar-in-essential /tmp/tar-out-essential.tar' \
--essential-hook='rm "\$1"/real/tar-in-essential' \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
--essential-hook='upload /tmp/upload-essential /symlink/upload' \
--essential-hook='echo upload-essential | cmp "\$1/real/upload" -' \
--essential-hook='download /symlink/upload /tmp/download-essential' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--essential-hook='rm "\$1/real/upload"' \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
--essential-hook='sync-in /tmp/sync-in-essential /symlink' \
--essential-hook='echo sync-in-essential | cmp "\$1/real/file" -' \
--essential-hook='sync-out /real /tmp/sync-out-essential' \
--essential-hook='rm "\$1/real/file"' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--customize-hook='copy-in /tmp/copy-in-customize /symlink' \
--customize-hook='echo copy-in-customize | cmp "\$1/real/copy-in-customize" -' \
--customize-hook='rm "\$1/real/copy-in-customize"' \
--customize-hook='echo copy-out-customize > "\$1/real/copy-out-customize"' \
--customize-hook='copy-out /symlink/copy-out-customize /tmp' \
--customize-hook='rm "\$1/real/copy-out-customize"' \
--customize-hook='tar-in /tmp/tar-in-customize.tar /symlink' \
--customize-hook='echo tar-in-customize | cmp "\$1/real/tar-in-customize" -' \
--customize-hook='tar-out /symlink/tar-in-customize /tmp/tar-out-customize.tar' \
--customize-hook='rm "\$1"/real/tar-in-customize' \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
--customize-hook='upload /tmp/upload-customize /symlink/upload' \
--customize-hook='echo upload-customize | cmp "\$1/real/upload" -' \
--customize-hook='download /symlink/upload /tmp/download-customize' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--customize-hook='rm "\$1/real/upload"' \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
--customize-hook='sync-in /tmp/sync-in-customize /symlink' \
--customize-hook='echo sync-in-customize | cmp "\$1/real/file" -' \
--customize-hook='sync-out /real /tmp/sync-out-customize' \
--customize-hook='rm "\$1/real/file"' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--customize-hook='rmdir "\$1/real"' \
--customize-hook='rm "\$1/symlink"' \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
for n in setup essential customize; do
ret=0
cmp /tmp/tar-in-\$n.tar /tmp/tar-out-\$n.tar || ret=\$?
if [ "\$ret" -ne 0 ]; then
if type diffoscope >/dev/null; then
diffoscope /tmp/tar-in-\$n.tar /tmp/tar-out-\$n.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
echo "no diffoscope installed" >&2
fi
if type base64 >/dev/null; then
base64 /tmp/tar-in-\$n.tar
base64 /tmp/tar-out-\$n.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
echo "no base64 installed" >&2
fi
if type xxd >/dev/null; then
xxd /tmp/tar-in-\$n.tar
xxd /tmp/tar-out-\$n.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
echo "no xxd installed" >&2
fi
exit 1
fi
done
echo copy-out-setup | cmp /tmp/copy-out-setup -
echo copy-out-essential | cmp /tmp/copy-out-essential -
echo copy-out-customize | cmp /tmp/copy-out-customize -
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
echo upload-setup | cmp /tmp/download-setup -
echo upload-essential | cmp /tmp/download-essential -
echo upload-customize | cmp /tmp/download-customize -
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
echo sync-in-setup | cmp /tmp/sync-out-setup/file -
echo sync-in-essential | cmp /tmp/sync-out-essential/file -
echo sync-in-customize | cmp /tmp/sync-out-customize/file -
make fakechroot mode bit-by-bit identical to the others
2021-08-27 17:50:11 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
rm /tmp/debian-chroot.tar \
/tmp/copy-in-setup /tmp/copy-in-essential /tmp/copy-in-customize \
/tmp/copy-out-setup /tmp/copy-out-essential /tmp/copy-out-customize \
/tmp/tar-in-setup.tar /tmp/tar-in-essential.tar /tmp/tar-in-customize.tar \
/tmp/tar-out-setup.tar /tmp/tar-out-essential.tar /tmp/tar-out-customize.tar \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
/tmp/upload-setup /tmp/upload-essential /tmp/upload-customize \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
/tmp/download-setup /tmp/download-essential /tmp/download-customize \
/tmp/sync-in-setup/file /tmp/sync-in-essential/file /tmp/sync-in-customize/file \
/tmp/sync-out-setup/file /tmp/sync-out-essential/file /tmp/sync-out-customize/file
rmdir /tmp/sync-in-setup /tmp/sync-in-essential /tmp/sync-in-customize \
/tmp/sync-out-setup /tmp/sync-out-essential /tmp/sync-out-customize
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
coverage.sh: two tests need qemu isolation
2020-08-28 12:37:50 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
fi
done
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
print_header "mode=root,variant=apt: debootstrap no-op options"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: also test --force-check-gpg
2019-09-29 08:24:01 +00:00
$CMD --mode=root --variant=apt --resolve-deps --merged-usr --no-merged-usr --force-check-gpg $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
fi
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
print_header "mode=root,variant=apt: --verbose"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --verbose $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
fi
print_header "mode=root,variant=apt: --debug"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --debug $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
fi
print_header "mode=root,variant=apt: --quiet"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --quiet $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
fi
add --logfile option
2019-02-23 07:43:15 +00:00
print_header "mode=root,variant=apt: --logfile"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: check the full log to also prevent debug printfs to accidentally make it into a commit
2020-01-10 11:03:49 +00:00
# we check the full log to also prevent debug printfs to accidentally make it into a commit
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
$CMD --mode=root --variant=apt --logfile=/tmp/log $DEFAULT_DIST /tmp/debian-chroot $mirror
print elapsed time after successful run
2020-08-25 14:06:05 +00:00
# omit the last line which should contain the runtime
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
head --lines=-1 /tmp/log > /tmp/trimmed
cat << LOG | diff -u - /tmp/trimmed
coverage.sh: host architecture in --logfile output must depend on host
2020-01-24 09:12:29 +00:00
I: chroot architecture $HOSTARCH is equal to the host's architecture
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
I: automatically chosen format: directory
coverage.sh: check the full log to also prevent debug printfs to accidentally make it into a commit
2020-01-10 11:03:49 +00:00
I: running apt-get update...
I: downloading packages with apt...
I: extracting archives...
print explicit info message about installing essential packages
2020-11-27 23:45:32 +00:00
I: installing essential packages...
coverage.sh: check the full log to also prevent debug printfs to accidentally make it into a commit
2020-01-10 11:03:49 +00:00
I: cleaning package lists and apt cache...
LOG
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
tail --lines=1 /tmp/log | grep '^I: success in .* seconds$'
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/log /tmp/trimmed
add --logfile option
2019-02-23 07:43:15 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --logfile option
2019-02-23 07:43:15 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --logfile option
2019-02-23 07:43:15 +00:00
fi
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
print_header "mode=$defaultmode,variant=apt: without /etc/resolv.conf and /etc/hostname"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
rm /etc/resolv.conf /etc/hostname
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
{ tar -tf /tmp/debian-chroot.tar;
printf "./etc/hostname\n";
printf "./etc/resolv.conf\n";
} | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
fi
preserve permissions of /etc/resolv.conf and /etc/hostname and resolve symlinks as debootstrap does it
2020-11-29 19:54:31 +00:00
print_header "mode=$defaultmode,variant=custom: preserve mode of /etc/resolv.conf and /etc/hostname"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
for f in /etc/resolv.conf /etc/hostname; do
# preserve original content
cat "\$f" > "\$f.bak"
# in case \$f is a symlink, we replace it by a real file
if [ -L "\$f" ]; then
rm "\$f"
cp "\$f.bak" "\$f"
fi
chmod 644 "\$f"
[ "\$(stat --format=%A "\$f")" = "-rw-r--r--" ]
done
$CMD --variant=custom --mode=$defaultmode $DEFAULT_DIST /tmp/debian-chroot $mirror
for f in /etc/resolv.conf /etc/hostname; do
[ "\$(stat --format=%A "/tmp/debian-chroot/\$f")" = "-rw-r--r--" ]
done
rm /tmp/debian-chroot/dev/console
rm /tmp/debian-chroot/dev/fd
rm /tmp/debian-chroot/dev/full
rm /tmp/debian-chroot/dev/null
rm /tmp/debian-chroot/dev/ptmx
rm /tmp/debian-chroot/dev/random
rm /tmp/debian-chroot/dev/stderr
rm /tmp/debian-chroot/dev/stdin
rm /tmp/debian-chroot/dev/stdout
rm /tmp/debian-chroot/dev/tty
rm /tmp/debian-chroot/dev/urandom
rm /tmp/debian-chroot/dev/zero
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/dpkg/status
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
for f in /etc/resolv.conf /etc/hostname; do
chmod 755 "\$f"
[ "\$(stat --format=%A "\$f")" = "-rwxr-xr-x" ]
done
$CMD --variant=custom --mode=$defaultmode $DEFAULT_DIST /tmp/debian-chroot $mirror
for f in /etc/resolv.conf /etc/hostname; do
[ "\$(stat --format=%A "/tmp/debian-chroot/\$f")" = "-rwxr-xr-x" ]
done
rm /tmp/debian-chroot/dev/console
rm /tmp/debian-chroot/dev/fd
rm /tmp/debian-chroot/dev/full
rm /tmp/debian-chroot/dev/null
rm /tmp/debian-chroot/dev/ptmx
rm /tmp/debian-chroot/dev/random
rm /tmp/debian-chroot/dev/stderr
rm /tmp/debian-chroot/dev/stdin
rm /tmp/debian-chroot/dev/stdout
rm /tmp/debian-chroot/dev/tty
rm /tmp/debian-chroot/dev/urandom
rm /tmp/debian-chroot/dev/zero
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/dpkg/status
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
for f in /etc/resolv.conf /etc/hostname; do
rm "\$f"
ln -s "\$f.bak" "\$f"
[ "\$(stat --format=%A "\$f")" = "lrwxrwxrwx" ]
done
$CMD --variant=custom --mode=$defaultmode $DEFAULT_DIST /tmp/debian-chroot $mirror
for f in /etc/resolv.conf /etc/hostname; do
[ "\$(stat --format=%A "/tmp/debian-chroot/\$f")" = "-rw-r--r--" ]
done
rm /tmp/debian-chroot/dev/console
rm /tmp/debian-chroot/dev/fd
rm /tmp/debian-chroot/dev/full
rm /tmp/debian-chroot/dev/null
rm /tmp/debian-chroot/dev/ptmx
rm /tmp/debian-chroot/dev/random
rm /tmp/debian-chroot/dev/stderr
rm /tmp/debian-chroot/dev/stdin
rm /tmp/debian-chroot/dev/stdout
rm /tmp/debian-chroot/dev/tty
rm /tmp/debian-chroot/dev/urandom
rm /tmp/debian-chroot/dev/zero
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/dpkg/status
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: fix typo in header message
2020-01-21 12:10:36 +00:00
print_header "mode=$defaultmode,variant=essential: test not having to install apt in --include because a hook did it before"
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: fix test that was wrongly installing outside the chroot and download-only
2021-08-16 21:14:18 +00:00
$CMD --mode=$defaultmode --variant=essential --include=apt \
coverage.sh: use MMDEBSTRAP_APT_CONFIG to prevent apt options (like foreign archs) leaking into the apt calls
2021-09-22 07:04:27 +00:00
--essential-hook='APT_CONFIG=\$MMDEBSTRAP_APT_CONFIG apt-get update' \
--essential-hook='APT_CONFIG=\$MMDEBSTRAP_APT_CONFIG apt-get --yes install -oDPkg::Chroot-Directory="\$1" apt' \
coverage.sh: fix test that was wrongly installing outside the chroot and download-only
2021-08-16 21:14:18 +00:00
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
use apt from the outside by setting DPkg::Chroot-Directory
2021-08-16 11:32:20 +00:00
tar -tf /tmp/debian-chroot.tar | sort | grep -v ./var/lib/apt/extended_states | diff -u tar1.txt -
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
fi
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
print_header "mode=$defaultmode,variant=apt: remove start-stop-daemon and policy-rc.d in hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt --customize-hook='rm "\$1/usr/sbin/policy-rc.d"; rm "\$1/sbin/start-stop-daemon"' $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
fi
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
# test that the user can drop archives into /var/cache/apt/archives as well as
# into /var/cache/apt/archives/partial
for variant in extract custom essential apt minbase buildd important standard; do
print_header "mode=$defaultmode,variant=$variant: compare output with pre-seeded /var/cache/apt/archives"
coverage.sh: reenabling tests because bugs got fixed - systemd didn't get fixed but somehow the order matches again (bug #963788) - python is installable again (bug #968217) - apt immediate configure was not fixed but src:glibc changed to not trigger the bug anymore (bugs #973305, #973325 and #972552)
2021-01-06 10:33:37 +00:00
# fontconfig doesn't install reproducibly because differences
# in /var/cache/fontconfig/. See
# https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=864082
coverage.sh: also test variant=custom with dropping archives into /var/cache/apt/archives
2020-11-29 10:40:26 +00:00
if [ "$variant" = "standard" ]; then
coverage.sh: reenabling tests because bugs got fixed - systemd didn't get fixed but somehow the order matches again (bug #963788) - python is installable again (bug #968217) - apt immediate configure was not fixed but src:glibc changed to not trigger the bug anymore (bugs #973305, #973325 and #972552)
2021-01-06 10:33:37 +00:00
echo "skipping test because of #864082" >&2
coverage.sh: also test variant=custom with dropping archives into /var/cache/apt/archives
2020-11-29 10:40:26 +00:00
skipped=$((skipped+1))
continue
fi
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
if [ "$variant" = "important" ] && [ "$DEFAULT_DIST" = "oldstable" ]; then
echo "skipping test on oldstable because /var/lib/systemd/catalog/database differs" >&2
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
skipped=$((skipped+1))
continue
fi
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: test using /mnt requires qemu
2020-11-28 14:22:56 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test requires the cache directory to be mounted on /mnt and should only be run inside a container" >&2
exit 1
fi
coverage.sh: also test variant=custom with dropping archives into /var/cache/apt/archives
2020-11-29 10:40:26 +00:00
include="--include=doc-debian"
if [ "$variant" = "custom" ]; then
include="\$include,base-files,base-passwd,coreutils,dash,diffutils,dpkg,libc-bin,sed"
fi
$CMD \$include --mode=$defaultmode --variant=$variant \
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
--setup-hook='mkdir -p "\$1"/var/cache/apt/archives/partial' \
--setup-hook='touch "\$1"/var/cache/apt/archives/lock' \
--setup-hook='chmod 0640 "\$1"/var/cache/apt/archives/lock' \
$DEFAULT_DIST - $mirror > orig.tar
# somehow, when trying to create a tarball from the 9p mount, tar throws the
# following error: tar: ./doc-debian_6.4_all.deb: File shrank by 132942 bytes; padding with zeros
# to reproduce, try: tar --directory /mnt/cache/debian/pool/main/d/doc-debian/ --create --file - . | tar --directory /tmp/ --extract --file -
# this will be different:
# md5sum /mnt/cache/debian/pool/main/d/doc-debian/*.deb /tmp/*.deb
# another reason to copy the files into a new directory is, that we can use shell globs
tmpdir=\$(mktemp -d)
cp /mnt/cache/debian/pool/main/b/busybox/busybox_*"_$HOSTARCH.deb" /mnt/cache/debian/pool/main/a/apt/apt_*"_$HOSTARCH.deb" "\$tmpdir"
coverage.sh: also test variant=custom with dropping archives into /var/cache/apt/archives
2020-11-29 10:40:26 +00:00
$CMD \$include --mode=$defaultmode --variant=$variant \
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
--setup-hook='mkdir -p "\$1"/var/cache/apt/archives/partial' \
--setup-hook='sync-in "'"\$tmpdir"'" /var/cache/apt/archives/partial' \
$DEFAULT_DIST - $mirror > test1.tar
cmp orig.tar test1.tar
coverage.sh: also test variant=custom with dropping archives into /var/cache/apt/archives
2020-11-29 10:40:26 +00:00
$CMD \$include --mode=$defaultmode --variant=$variant --skip=download/empty \
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
--customize-hook='touch "\$1"/var/cache/apt/archives/partial' \
--setup-hook='mkdir -p "\$1"/var/cache/apt/archives/' \
--setup-hook='sync-in "'"\$tmpdir"'" /var/cache/apt/archives/' \
--setup-hook='chmod 0755 "\$1"/var/cache/apt/archives/' \
$DEFAULT_DIST - $mirror > test2.tar
cmp orig.tar test2.tar
coverage.sh: clean up some additional files
2021-02-04 16:39:50 +00:00
rm "\$tmpdir"/*.deb orig.tar test1.tar test2.tar
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
rmdir "\$tmpdir"
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
coverage.sh: test using /mnt requires qemu
2020-11-28 14:22:56 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
make it possible to seed /var/cache/apt/archives with deb packages
2020-11-13 18:02:41 +00:00
fi
done
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
print_header "mode=$defaultmode,variant=apt: create directory --dry-run"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --dry-run --variant=apt --setup-hook="exit 1" --essential-hook="exit 1" --customize-hook="exit 1" $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/dev/console
rm /tmp/debian-chroot/dev/fd
rm /tmp/debian-chroot/dev/full
rm /tmp/debian-chroot/dev/null
rm /tmp/debian-chroot/dev/ptmx
rm /tmp/debian-chroot/dev/random
rm /tmp/debian-chroot/dev/stderr
rm /tmp/debian-chroot/dev/stdin
rm /tmp/debian-chroot/dev/stdout
rm /tmp/debian-chroot/dev/tty
rm /tmp/debian-chroot/dev/urandom
rm /tmp/debian-chroot/dev/zero
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/dpkg/status
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
END
coverage.sh: reenabling tests because bugs got fixed - systemd didn't get fixed but somehow the order matches again (bug #963788) - python is installable again (bug #968217) - apt immediate configure was not fixed but src:glibc changed to not trigger the bug anymore (bugs #973305, #973325 and #972552)
2021-01-06 10:33:37 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
# test all --dry-run variants
also test minbase buildd important standard with --dry-run/--simulate
2021-08-26 06:34:30 +00:00
# we are testing all variants here because with 0.7.5 we had a bug:
# mmdebstrap sid /dev/null --simulate ==> E: cannot read /var/cache/apt/archives/
for variant in extract custom essential apt minbase buildd important standard; do
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
for mode in root unshare fakechroot proot chrootless; do
print_header "mode=$mode,variant=$variant: create tarball --dry-run"
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
skipped=$((skipped+1))
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
echo "HAVE_PROOT != yes -- Skipping test..." >&2
skipped=$((skipped+1))
continue
fi
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
prefix=
include=
if [ "\$(id -u)" -eq 0 ] && [ "$mode" != root ]; then
# this must be qemu
if ! id -u user >/dev/null 2>&1; then
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
sysctl -w kernel.unprivileged_userns_clone=1
fi
prefix="runuser -u user --"
if [ "$mode" = extract ] || [ "$mode" = custom ]; then
include="--include=\$(cat pkglist.txt | tr '\n' ',')"
fi
fi
\$prefix $CMD --mode=$mode \$include --dry-run --variant=$variant $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
if [ -e /tmp/debian-chroot.tar ]; then
echo "/tmp/debian-chroot.tar must not be created with --dry-run" >&2
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
done
done
add coverage.sh
2018-10-22 18:37:31 +00:00
# test extract variant also with chrootless mode
for mode in root unshare fakechroot proot chrootless; do
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=$mode,variant=extract: unpack doc-debian"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_PROOT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && [ "$mode" != "root" ] && prefix="runuser -u user --"
[ "$mode" = "fakechroot" ] && prefix="\$prefix fakechroot fakeroot"
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
\$prefix $CMD --mode=$mode --variant=extract --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot $mirror
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# delete contents of doc-debian
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# delete real files
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
rm /tmp/debian-chroot/var/lib/apt/lists/lock
disable merged usr
2018-12-06 23:17:10 +00:00
## delete merged usr symlinks
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# delete ./dev (files might exist or not depending on the mode)
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -f /tmp/debian-chroot/dev/console
rm -f /tmp/debian-chroot/dev/fd
rm -f /tmp/debian-chroot/dev/full
rm -f /tmp/debian-chroot/dev/null
rm -f /tmp/debian-chroot/dev/ptmx
rm -f /tmp/debian-chroot/dev/random
rm -f /tmp/debian-chroot/dev/stderr
rm -f /tmp/debian-chroot/dev/stdin
rm -f /tmp/debian-chroot/dev/stdout
rm -f /tmp/debian-chroot/dev/tty
rm -f /tmp/debian-chroot/dev/urandom
rm -f /tmp/debian-chroot/dev/zero
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# the rest should be empty directories that we can rmdir recursively
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: two tests need qemu isolation
2020-08-28 12:37:50 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
done
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=chrootless,variant=custom: install doc-debian"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
\$prefix $CMD --mode=chrootless --variant=custom --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot $mirror
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
tar -C /tmp/debian-chroot --owner=0 --group=0 --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/debian-chroot.tar .
tar tvf /tmp/debian-chroot.tar > doc-debian.tar.list
rm /tmp/debian-chroot.tar
add coverage.sh
2018-10-22 18:37:31 +00:00
# delete contents of doc-debian
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
add coverage.sh
2018-10-22 18:37:31 +00:00
# delete real files
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
rm /tmp/debian-chroot/var/lib/apt/lists/lock
disable merged usr
2018-12-06 23:17:10 +00:00
## delete merged usr symlinks
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
add coverage.sh
2018-10-22 18:37:31 +00:00
# in chrootless mode, there is more to remove
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Lock
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Unincorp
rm /tmp/debian-chroot/var/lib/dpkg/status-old
rm /tmp/debian-chroot/var/lib/dpkg/info/format
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
add coverage.sh
2018-10-22 18:37:31 +00:00
# the rest should be empty directories that we can rmdir recursively
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: document how to check for new chrootless packages
2020-07-09 05:40:54 +00:00
# regularly check whether more packages work with chrootless:
coverage.sh: add more docs for chrootless essential test
2021-03-08 18:32:19 +00:00
# for p in $(grep-aptavail -F Essential yes -s Package -n | sort -u); do ./mmdebstrap --mode=chrootless --variant=custom --include=bsdutils,coreutils,debianutils,diffutils,dpkg,findutils,grep,gzip,hostname,init-system-helpers,ncurses-base,ncurses-bin,perl-base,sed,sysvinit-utils,tar,$p unstable /dev/null; done
#
# see https://bugs.debian.org/cgi-bin/pkgreport.cgi?users=debian-dpkg@lists.debian.org;tag=dpkg-root-support
#
# base-files: #824594
# base-passwd: debconf
# bash: depends base-files
# bsdutils: ok
# coreutils: ok
# dash: debconf
# debianutils: ok
# diffutils: ok
# dpkg: ok
# findutils: ok
# grep: ok
# gzip: ok
# hostname: ok
# init-system-helpers: ok
# libc-bin: #983412
# login: debconf
# ncurses-base: ok
# ncurses-bin: ok
# perl-base: ok
# sed: ok
# sysvinit-utils: ok
# tar: ok
# util-linux: debconf
coverage.sh: add test for known-good chrootless packages
2020-06-24 21:10:29 +00:00
print_header "mode=chrootless,variant=custom: install known-good from essential:yes"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
coverage.sh: sysvinit-utils also works with chrootless
2021-03-08 18:32:53 +00:00
\$prefix $CMD --mode=chrootless --variant=custom --include=bsdutils,coreutils,debianutils,diffutils,dpkg,findutils,grep,gzip,hostname,init-system-helpers,ncurses-base,ncurses-bin,perl-base,sed,sysvinit-utils,tar $DEFAULT_DIST /dev/null $mirror
coverage.sh: add test for known-good chrootless packages
2020-06-24 21:10:29 +00:00
END
changes for release of Debian 11 Buster
2021-08-16 11:11:42 +00:00
if [ "$DEFAULT_DIST" = "oldstable" ]; then
echo "chrootless doesn't work in oldstable -- Skipping test..." >&2
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
skipped=$((skipped+1))
coverage.sh: disable chrootless test broken by #983425
2021-09-21 12:19:55 +00:00
elif true; then
# https://salsa.debian.org/pkg-debconf/debconf/-/merge_requests/8
echo "blocked by #983425 -- Skipping test..." >&2
skipped=$((skipped+1))
coverage.sh: allow to run on stable
2021-01-11 12:28:18 +00:00
elif [ "$HAVE_QEMU" = "yes" ]; then
coverage.sh: add test for known-good chrootless packages
2020-06-24 21:10:29 +00:00
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
print_header "mode=chrootless,variant=custom: install doc-debian and output tarball"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
\$prefix $CMD --mode=chrootless --variant=custom --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar tvf /tmp/debian-chroot.tar | grep -v ' ./dev' | diff -u doc-debian.tar.list -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
fi
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
print_header "mode=chrootless,variant=custom: install doc-debian and test hooks"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
several fixes to chrootless mode
2021-08-17 21:39:20 +00:00
\$prefix $CMD --mode=chrootless --skip=cleanup/tmp --variant=custom --include=doc-debian --setup-hook='touch "\$1/tmp/setup"' --customize-hook='touch "\$1/tmp/customize"' $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/tmp/setup
rm /tmp/debian-chroot/tmp/customize
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
tar -C /tmp/debian-chroot --owner=0 --group=0 --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/debian-chroot.tar .
tar tvf /tmp/debian-chroot.tar | grep -v ' ./dev' | diff -u doc-debian.tar.list -
rm /tmp/debian-chroot.tar
# delete contents of doc-debian
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
# delete real files
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
rm /tmp/debian-chroot/var/lib/apt/lists/lock
## delete merged usr symlinks
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
# in chrootless mode, there is more to remove
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Lock
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Unincorp
rm /tmp/debian-chroot/var/lib/dpkg/status-old
rm /tmp/debian-chroot/var/lib/dpkg/info/format
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
fi
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
print_header "mode=chrootless,variant=custom: install libmagic-mgc on arm64"
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
\$prefix $CMD --mode=chrootless --variant=custom --architectures=arm64 --include=libmagic-mgc $DEFAULT_DIST /tmp/debian-chroot $mirror
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
# delete contents of libmagic-mgc
rm /tmp/debian-chroot/usr/lib/file/magic.mgc
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/README.Debian
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.Debian.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/copyright
rm /tmp/debian-chroot/usr/share/file/magic.mgc
rm /tmp/debian-chroot/usr/share/misc/magic.mgc
# delete real files
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
rm /tmp/debian-chroot/var/lib/apt/lists/lock
## delete merged usr symlinks
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
# in chrootless mode, there is more to remove
rm /tmp/debian-chroot/var/lib/dpkg/arch
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Lock
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Unincorp
rm /tmp/debian-chroot/var/lib/dpkg/status-old
rm /tmp/debian-chroot/var/lib/dpkg/info/format
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.list
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
END
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_BINFMT" = "yes" ]; then
coverage.sh: require binfmt support form chrootless installation of libmagic-mgc on armhf
2019-10-06 16:42:44 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: require binfmt support form chrootless installation of libmagic-mgc on armhf
2019-10-06 16:42:44 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: require binfmt support form chrootless installation of libmagic-mgc on armhf
2019-10-06 16:42:44 +00:00
fi
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_BINFMT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
fi
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
print_header "mode=root,variant=custom: install busybox-based sub-essential system"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
pkgs=base-files,base-passwd,busybox,debianutils,dpkg,libc-bin,mawk,tar
add --extract-hook
2020-03-22 13:08:21 +00:00
# busybox --install -s will install symbolic links into the rootfs, leaving
# existing files untouched. It has to run after extraction (otherwise there is
# no busybox binary) and before first configuration
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
$CMD --mode=root --variant=custom \
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
--include=\$pkgs \
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
--setup-hook='mkdir -p "\$1/bin"' \
--setup-hook='echo root:x:0:0:root:/root:/bin/sh > "\$1/etc/passwd"' \
--setup-hook='printf "root:x:0:\nmail:x:8:\nutmp:x:43:\n" > "\$1/etc/group"' \
add --extract-hook
2020-03-22 13:08:21 +00:00
--extract-hook='chroot "\$1" busybox --install -s' \
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
$DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
echo "\$pkgs" | tr ',' '\n' > /tmp/expected
chroot /tmp/debian-chroot dpkg-query -f '\${binary:Package}\n' -W \
| comm -12 - /tmp/expected \
| diff -u - /tmp/expected
rm /tmp/expected
add --extract-hook
2020-03-22 13:08:21 +00:00
for cmd in echo cat sed grep; do
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
test -L /tmp/debian-chroot/bin/\$cmd
add --extract-hook
2020-03-22 13:08:21 +00:00
test "\$(readlink /tmp/debian-chroot/bin/\$cmd)" = "/bin/busybox"
done
for cmd in sort; do
test -L /tmp/debian-chroot/usr/bin/\$cmd
test "\$(readlink /tmp/debian-chroot/usr/bin/\$cmd)" = "/bin/busybox"
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
done
chroot /tmp/debian-chroot echo foobar \
| chroot /tmp/debian-chroot cat \
| chroot /tmp/debian-chroot sort \
| chroot /tmp/debian-chroot sed 's/foobar/blubber/' \
coverage.sh: redirect grep output to /dev/null instead of using --quiet to prevent broken pipe
2020-01-10 11:07:03 +00:00
| chroot /tmp/debian-chroot grep blubber >/dev/null
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
# test foreign architecture with all modes
# create directory in sudo mode
for mode in root unshare fakechroot proot; do
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
print_header "mode=$mode,variant=apt: create arm64 tarball"
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
continue
fi
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
if [ "$RUN_MA_SAME_TESTS" != yes ]; then
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
skipped=$((skipped+1))
continue
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_BINFMT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_BINFMT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_PROOT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && [ "$mode" != "root" ] && prefix="runuser -u user --"
[ "$mode" = "fakechroot" ] && prefix="\$prefix fakechroot fakeroot"
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
\$prefix $CMD --mode=$mode --variant=apt --architectures=arm64 $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# we ignore differences between architectures by ignoring some files
# and renaming others
# in proot mode, some extra files are put there by proot
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
{ tar -tf /tmp/debian-chroot.tar \
replace armhf with arm64 in the testsuite because builds of gcc on armhf can take more than 2 days, resulting in a long m-a:same version skew
2020-11-26 22:16:36 +00:00
| grep -v '^\./lib/ld-linux-aarch64\.so\.1$' \
| grep -v '^\./lib/aarch64-linux-gnu/ld-linux-aarch64\.so\.1$' \
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.arm64\.gz$' \
| sed 's/aarch64-linux-gnu/x86_64-linux-gnu/' \
| sed 's/arm64/amd64/';
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
} | sort > tar2.txt
{ cat tar1.txt \
coverage.sh: make regex more precise and relax it for version numbers
2018-12-05 11:01:58 +00:00
| grep -v '^\./usr/bin/i386$' \
| grep -v '^\./usr/bin/x86_64$' \
disable merged usr
2018-12-06 23:17:10 +00:00
| grep -v '^\./lib64/$' \
| grep -v '^\./lib64/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./lib/x86_64-linux-gnu/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec-2\.[0-9]\+\.so$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec\.so\.1$' \
coverage.sh: also filter out changelog of Debian native packages
2019-09-28 18:57:33 +00:00
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.amd64\.gz$' \
coverage.sh: make regex more precise and relax it for version numbers
2018-12-05 11:01:58 +00:00
| grep -v '^\./usr/share/man/man8/i386\.8\.gz$' \
| grep -v '^\./usr/share/man/man8/x86_64\.8\.gz$';
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ "$mode" = "proot" ] && printf "./etc/ld.so.preload\n";
} | sort | diff -u - tar2.txt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
done
coverage.sh: test ubuntu focal
2020-08-26 07:44:29 +00:00
print_header "mode=$defaultmode,variant=apt: test ubuntu focal"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if ! /usr/lib/apt/apt-helper download-file http://archive.ubuntu.com/ubuntu/dists/focal/Release /dev/null && grep "QEMU Virtual CPU" /proc/cpuinfo; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
ip link set dev ens3 up
ip addr add 10.0.2.15/24 dev ens3
ip route add default via 10.0.2.2 dev ens3
echo "nameserver 10.0.2.3" > /etc/resolv.conf
fi
$CMD --mode=$defaultmode --variant=apt --customize-hook='grep UBUNTU_CODENAME=focal "\$1/etc/os-release"' focal /dev/null
END
if [ "$ONLINE" = "yes" ]; then
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
else
coverage.sh: fix HOSTARCH -> ONLINE
2020-11-26 22:45:32 +00:00
echo "ONLINE != yes -- Skipping test..." >&2
coverage.sh: test ubuntu focal
2020-08-26 07:44:29 +00:00
skipped=$((skipped+1))
fi
coverage.sh: produce report inside VM to prevent errors from version mismatches
2020-08-24 13:01:49 +00:00
if [ -e shared/cover_db.img ]; then
# produce report inside the VM to make sure that the versions match or
# otherwise we might get:
# Can't read shared/cover_db/runs/1598213854.252.64287/cover.14 with Sereal: Sereal: Error: Bad Sereal header: Not a valid Sereal document. at offset 1 of input at srl_decoder.c line 600 at /usr/lib/x86_64-linux-gnu/perl5/5.30/Devel/Cover/DB/IO/Sereal.pm line 34, <$fh> chunk 1.
cat << END > shared/test.sh
coverage.sh: let cover output to stderr to prevent wrong message output order
2021-03-08 18:33:24 +00:00
cover -nogcov -report html_basic cover_db >&2
coverage.sh: produce report inside VM to prevent errors from version mismatches
2020-08-24 13:01:49 +00:00
mkdir -p report
for f in common.js coverage.html cover.css css.js mmdebstrap--branch.html mmdebstrap--condition.html mmdebstrap.html mmdebstrap--subroutine.html standardista-table-sorting.js; do
cp -a cover_db/\$f report
done
coverage.sh: let cover output to stderr to prevent wrong message output order
2021-03-08 18:33:24 +00:00
cover -delete cover_db >&2
coverage.sh: produce report inside VM to prevent errors from version mismatches
2020-08-24 13:01:49 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
else
./run_null.sh
fi
echo
echo open file://$(pwd)/shared/report/coverage.html in a browser
echo
fi
coverage.sh: check that the expected number of tests get executed
2019-10-28 13:50:56 +00:00
if [ "$((i-1))" -ne "$total" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "unexpected number of tests: got $((i-1)) but expected $total" >&2
coverage.sh: check that the expected number of tests get executed
2019-10-28 13:50:56 +00:00
exit 1
fi
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
if [ "$skipped" -gt 0 ]; then
echo "number of skipped tests: $skipped" >&2
fi
if [ "$runtests" -gt 0 ]; then
echo "number of executed tests: $runtests" >&2
fi
if [ "$((skipped+runtests))" -ne "$total" ]; then
echo "sum of skipped and executed tests is not equal to $total" >&2
exit 1
fi
coverage.sh: clean up some additional files
2021-02-04 16:39:50 +00:00
rm shared/test.sh shared/tar1.txt shared/tar2.txt shared/pkglist.txt shared/doc-debian.tar.list shared/mmdebstrap shared/taridshift shared/tarfilter shared/proxysolver
Reference in a new issue Copy permalink