rockdrilla/mmdebstrap
1
0
Fork 0
forked from josch/mmdebstrap
Code Issues Pull requests Projects Releases Wiki Activity
mmdebstrap/coverage.sh

3241 lines
107 KiB
Bash
Raw Permalink Normal View History

add coverage.sh
2018-10-22 18:37:31 +00:00
#!/bin/sh
set -eu
coverage.sh: write mmdebstrap.tdy into temporary file instead of current directory
2020-01-21 12:07:18 +00:00
TMPFILE=$(mktemp)
perltidy < mmdebstrap > "$TMPFILE"
format code with perltidy
2020-01-08 16:44:07 +00:00
ret=0
coverage.sh: write mmdebstrap.tdy into temporary file instead of current directory
2020-01-21 12:07:18 +00:00
diff -u mmdebstrap "$TMPFILE" || ret=$?
format code with perltidy
2020-01-08 16:44:07 +00:00
if [ "$ret" -ne 0 ]; then
echo "perltidy failed" >&2
coverage.sh: write mmdebstrap.tdy into temporary file instead of current directory
2020-01-21 12:07:18 +00:00
rm "$TMPFILE"
format code with perltidy
2020-01-08 16:44:07 +00:00
exit 1
fi
coverage.sh: write mmdebstrap.tdy into temporary file instead of current directory
2020-01-21 12:07:18 +00:00
rm "$TMPFILE"
format code with perltidy
2020-01-08 16:44:07 +00:00
coverage.sh: test with perlcritic
2020-01-09 07:39:40 +00:00
if [ $(wc -L < mmdebstrap) -gt 79 ]; then
echo "exceeded maximum line length of 79 characters" >&2
exit 1
fi
perlcritic --severity 4 --verbose 8 mmdebstrap
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility
2020-08-25 11:02:33 +00:00
black --check taridshift tarfilter
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
make_mirror.sh: never leave the cache in an inconsistent state by atomically switching symlinks
2018-12-28 06:44:54 +00:00
mirrordir="./shared/cache/debian"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
coverage.sh: don't run make_mirror.sh
2019-10-18 20:46:23 +00:00
if [ ! -e "$mirrordir" ]; then
echo "run ./make_mirror.sh before running $0" >&2
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# we use -f because the file might not exist
rm -f shared/cover_db.img
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
: "${DEFAULT_DIST:=unstable}"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
: "${HAVE_QEMU:=yes}"
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
: "${RUN_MA_SAME_TESTS:=yes}"
coverage.sh: test ubuntu focal
2020-08-26 07:44:29 +00:00
: "${ONLINE:=no}"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
HOSTARCH=$(dpkg --print-architecture)
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
# prepare image for cover_db
reduce cover_db.img size, now that we don't run it for exec-ed processes anymore
2020-01-09 11:41:26 +00:00
guestfish -N shared/cover_db.img=disk:64M -- mkfs vfat /dev/sda
coverage.sh: check requirement for disk image and debootstrap tarballs before running
2018-12-27 13:38:00 +00:00
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
if [ ! -e "./shared/cache/debian-$DEFAULT_DIST.qcow" ]; then
echo "./shared/cache/debian-$DEFAULT_DIST.qcow does not exist" >&2
coverage.sh: check requirement for disk image and debootstrap tarballs before running
2018-12-27 13:38:00 +00:00
exit 1
fi
fi
# check if all required debootstrap tarballs exist
notfound=0
for dist in stable testing unstable; do
for variant in minbase buildd -; do
if [ ! -e "shared/cache/debian-$dist-$variant.tar" ]; then
echo "shared/cache/debian-$dist-$variant.tar does not exist" >&2
notfound=1
fi
done
done
if [ "$notfound" -ne 0 ]; then
echo "not all required debootstrap tarballs are present" >&2
exit 1
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
coverage.sh: conditionally copy mmdebstrap to ./shared - only copy if local copy is newer than the copy in ./shared - this enables the autopkgtest to place its own version in ./shared which will then not be overwritten
2018-11-23 16:27:36 +00:00
# only copy if necessary
if [ ! -e shared/mmdebstrap ] || [ mmdebstrap -nt shared/mmdebstrap ]; then
cp -a mmdebstrap shared
fi
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
if [ ! -e shared/taridshift ] || [ taridshift -nt shared/taridshift ]; then
cp -a taridshift shared
fi
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility
2020-08-25 11:02:33 +00:00
if [ ! -e shared/tarfilter ] || [ tarfilter -nt shared/tarfilter ]; then
cp -a tarfilter shared
fi
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
mkdir -p shared/hooks
if [ ! -e shared/hooks/setup00-merged-usr.sh ] || [ hooks/setup00-merged-usr.sh -nt shared/hooks/setup00-merged-usr.sh ]; then
cp -a hooks/setup00-merged-usr.sh shared/hooks/setup00-merged-usr.sh
fi
mkdir -p shared/hooks/eatmydata
if [ ! -e shared/hooks/eatmydata/extract.sh ] || [ hooks/eatmydata/extract.sh -nt shared/hooks/eatmydata/extract.sh ]; then
cp -a hooks/eatmydata/extract.sh shared/hooks/eatmydata/extract.sh
fi
if [ ! -e shared/hooks/eatmydata/customize.sh ] || [ hooks/eatmydata/customize.sh -nt shared/hooks/eatmydata/customize.sh ]; then
cp -a hooks/eatmydata/customize.sh shared/hooks/eatmydata/customize.sh
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
starttime=
coverage.sh: test ubuntu focal
2020-08-26 07:44:29 +00:00
total=151
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=0
runtests=0
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
i=1
print_header() {
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo ------------------------------------------------------------------------------ >&2
echo "($i/$total) $1" >&2
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
if [ -z "$starttime" ]; then
starttime=$(date +%s)
else
currenttime=$(date +%s)
timeleft=$(((total-i+1)*(currenttime-starttime)/(i-1)))
printf "time left: %02d:%02d:%02d\n" $((timeleft/3600)) $(((timeleft%3600)/60)) $((timeleft%60))
fi
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo ------------------------------------------------------------------------------ >&2
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
i=$((i+1))
}
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# choose the timestamp of the unstable Release file, so that we get
# reproducible results for the same mirror timestamp
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
SOURCE_DATE_EPOCH=$(date --date="$(grep-dctrl -s Date -n '' "$mirrordir/dists/$DEFAULT_DIST/Release")" +%s)
add coverage.sh
2018-10-22 18:37:31 +00:00
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# for traditional sort order that uses native byte values
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
: "${HAVE_UNSHARE:=yes}"
: "${HAVE_PROOT:=yes}"
: "${HAVE_BINFMT:=yes}"
defaultmode="auto"
if [ "$HAVE_UNSHARE" != "yes" ]; then
defaultmode="root"
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# by default, use the mmdebstrap executable in the current directory together
# with perl Devel::Cover but allow to overwrite this
: "${CMD:=perl -MDevel::Cover=-silent,-nogcov ./mmdebstrap}"
mirror="http://127.0.0.1/debian"
add coverage.sh
2018-10-22 18:37:31 +00:00
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
for dist in stable testing unstable; do
for variant in minbase buildd -; do
coverage.sh: skip tests because of #963788
2020-07-09 05:34:38 +00:00
if [ $dist != stable ] && [ $variant = - ]; then
# skipping because of #963788
continue
fi
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
print_header "mode=$defaultmode,variant=$variant: check against debootstrap $dist"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
$CMD --variant=$variant --mode=$defaultmode $dist /tmp/debian-$dist-mm.tar $mirror
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
mkdir /tmp/debian-$dist-mm
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
tar --xattrs --xattrs-include='*' -C /tmp/debian-$dist-mm -xf /tmp/debian-$dist-mm.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
mkdir /tmp/debian-$dist-debootstrap
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
tar --xattrs --xattrs-include='*' -C /tmp/debian-$dist-debootstrap -xf "cache/debian-$dist-$variant.tar"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# diff cannot compare device nodes, so we use tar to do that for us and then
# delete the directory
tar -C /tmp/debian-$dist-debootstrap -cf dev1.tar ./dev
tar -C /tmp/debian-$dist-mm -cf dev2.tar ./dev
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
ret=0
cmp dev1.tar dev2.tar || ret=\$?
if [ "\$ret" -ne 0 ]; then
if type diffoscope >/dev/null; then
diffoscope dev1.tar dev2.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
else
echo "no diffoscope installed" >&2
fi
if type base64 >/dev/null; then
base64 dev1.tar
base64 dev2.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
else
echo "no base64 installed" >&2
fi
if type xxd >/dev/null; then
xxd dev1.tar
xxd dev2.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
coverage.sh: in addition to cmp, run diffoscope and base64 and xxd
2019-10-18 21:00:51 +00:00
else
echo "no xxd installed" >&2
fi
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
rm dev1.tar dev2.tar
rm -r /tmp/debian-$dist-debootstrap/dev /tmp/debian-$dist-mm/dev
# remove downloaded deb packages
rm /tmp/debian-$dist-debootstrap/var/cache/apt/archives/*.deb
# remove aux-cache
rm /tmp/debian-$dist-debootstrap/var/cache/ldconfig/aux-cache
# remove logs
rm /tmp/debian-$dist-debootstrap/var/log/dpkg.log \
/tmp/debian-$dist-debootstrap/var/log/bootstrap.log \
/tmp/debian-$dist-debootstrap/var/log/alternatives.log
# remove *-old files
rm /tmp/debian-$dist-debootstrap/var/cache/debconf/config.dat-old \
/tmp/debian-$dist-mm/var/cache/debconf/config.dat-old
rm /tmp/debian-$dist-debootstrap/var/cache/debconf/templates.dat-old \
/tmp/debian-$dist-mm/var/cache/debconf/templates.dat-old
rm /tmp/debian-$dist-debootstrap/var/lib/dpkg/status-old \
/tmp/debian-$dist-mm/var/lib/dpkg/status-old
# remove dpkg files
create /var/lib/dpkg/cmethopt for dselect (see #930788)
2019-08-21 12:57:54 +00:00
rm /tmp/debian-$dist-debootstrap/var/lib/dpkg/available
coverage.sh: mmdebstrap now creates /var/lib/dpkg/available
2019-01-13 09:14:25 +00:00
touch /tmp/debian-$dist-debootstrap/var/lib/dpkg/available
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# since we installed packages directly from the .deb files, Priorities differ
# thus we first check for equality and then remove the files
chroot /tmp/debian-$dist-debootstrap dpkg --list > dpkg1
chroot /tmp/debian-$dist-mm dpkg --list > dpkg2
diff -u dpkg1 dpkg2
rm dpkg1 dpkg2
grep -v '^Priority: ' /tmp/debian-$dist-debootstrap/var/lib/dpkg/status > status1
grep -v '^Priority: ' /tmp/debian-$dist-mm/var/lib/dpkg/status > status2
diff -u status1 status2
rm status1 status2
rm /tmp/debian-$dist-debootstrap/var/lib/dpkg/status /tmp/debian-$dist-mm/var/lib/dpkg/status
# debootstrap exposes the hosts's kernel version
rm /tmp/debian-$dist-debootstrap/etc/apt/apt.conf.d/01autoremove-kernels \
/tmp/debian-$dist-mm/etc/apt/apt.conf.d/01autoremove-kernels
# who creates /run/mount?
coverage.sh: /run/mount/utab is created inside qemu but not on gitlab CI -- weird...
2019-02-27 23:18:06 +00:00
if [ -e "/tmp/debian-$dist-debootstrap/run/mount/utab" ]; then
rm "/tmp/debian-$dist-debootstrap/run/mount/utab"
fi
if [ -e "/tmp/debian-$dist-debootstrap/run/mount" ]; then
rmdir "/tmp/debian-$dist-debootstrap/run/mount"
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# debootstrap doesn't clean apt
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
rm /tmp/debian-$dist-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_${dist}_main_binary-${HOSTARCH}_Packages \
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
/tmp/debian-$dist-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_${dist}_Release \
/tmp/debian-$dist-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_${dist}_Release.gpg
if [ "$variant" = "-" ]; then
rm /tmp/debian-$dist-debootstrap/etc/machine-id
rm /tmp/debian-$dist-mm/etc/machine-id
rm /tmp/debian-$dist-debootstrap/var/lib/systemd/catalog/database
rm /tmp/debian-$dist-mm/var/lib/systemd/catalog/database
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
cap=\$(chroot /tmp/debian-$dist-debootstrap /sbin/getcap /bin/ping)
if [ "\$cap" != "/bin/ping = cap_net_raw+ep" ]; then
echo "expected bin/ping to have capabilities cap_net_raw+ep" >&2
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "but debootstrap produced: \$cap" >&2
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
exit 1
fi
cap=\$(chroot /tmp/debian-$dist-mm /sbin/getcap /bin/ping)
if [ "\$cap" != "/bin/ping = cap_net_raw+ep" ]; then
echo "expected bin/ping to have capabilities cap_net_raw+ep" >&2
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "but mmdebstrap produced: \$cap" >&2
coverage.sh: test xattr support When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'
2020-01-03 15:02:35 +00:00
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
fi
do not cleanup apt and dpkg lock files to not set bad precedence
2019-02-27 23:20:00 +00:00
rm /tmp/debian-$dist-mm/var/cache/apt/archives/lock
rm /tmp/debian-$dist-mm/var/lib/apt/extended_states
rm /tmp/debian-$dist-mm/var/lib/apt/lists/lock
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: account for differently ordered /etc/shells
2018-12-06 23:13:51 +00:00
# the list of shells might be sorted wrongly
for f in "/tmp/debian-$dist-debootstrap/etc/shells" "/tmp/debian-$dist-mm/etc/shells"; do
sort -o "\$f" "\$f"
done
coverage.sh: work around bug #917773
2019-02-19 23:31:06 +00:00
# workaround for https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=917773
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
if ! cmp /tmp/debian-$dist-debootstrap/etc/shadow /tmp/debian-$dist-mm/etc/shadow; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo patching /etc/shadow on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
awk -v FS=: -v OFS=: -v SDE=\$SOURCE_DATE_EPOCH '{ print \$1,\$2,int(SDE/60/60/24),\$4,\$5,\$6,\$7,\$8,\$9 }' < /tmp/debian-$dist-mm/etc/shadow > /tmp/debian-$dist-mm/etc/shadow.bak
coverage.sh: also compare permissions, ownership, symlink targets and mtimes
2020-03-22 13:07:00 +00:00
cat /tmp/debian-$dist-mm/etc/shadow.bak > /tmp/debian-$dist-mm/etc/shadow
rm /tmp/debian-$dist-mm/etc/shadow.bak
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo no difference for /etc/shadow on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
fi
if ! cmp /tmp/debian-$dist-debootstrap/etc/shadow- /tmp/debian-$dist-mm/etc/shadow-; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo patching /etc/shadow- on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
awk -v FS=: -v OFS=: -v SDE=\$SOURCE_DATE_EPOCH '{ print \$1,\$2,int(SDE/60/60/24),\$4,\$5,\$6,\$7,\$8,\$9 }' < /tmp/debian-$dist-mm/etc/shadow- > /tmp/debian-$dist-mm/etc/shadow-.bak
coverage.sh: also compare permissions, ownership, symlink targets and mtimes
2020-03-22 13:07:00 +00:00
cat /tmp/debian-$dist-mm/etc/shadow-.bak > /tmp/debian-$dist-mm/etc/shadow-
rm /tmp/debian-$dist-mm/etc/shadow-.bak
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo no difference for /etc/shadow- on $dist $variant >&2
coverage.sh: only patch /etc/shadow if necessary
2020-01-05 20:01:10 +00:00
fi
coverage.sh: work around bug #917773
2019-02-19 23:31:06 +00:00
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# check if the file content differs
coverage.sh: print unified diff
2020-07-09 05:35:59 +00:00
diff --unified --no-dereference --recursive /tmp/debian-$dist-debootstrap /tmp/debian-$dist-mm
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: also compare permissions, ownership, symlink targets and mtimes
2020-03-22 13:07:00 +00:00
# check permissions, ownership, symlink targets, modification times using tar
# directory mtimes will differ, thus we equalize them first
find /tmp/debian-$dist-debootstrap /tmp/debian-$dist-mm -type d -print0 | xargs -0 touch --date="@$SOURCE_DATE_EPOCH"
# debootstrap never ran apt -- fixing permissions
for d in ./var/lib/apt/lists/partial ./var/cache/apt/archives/partial; do
chroot /tmp/debian-$dist-debootstrap chmod 0700 \$d
chroot /tmp/debian-$dist-debootstrap chown _apt:root \$d
done
tar -C /tmp/debian-$dist-debootstrap --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root1.tar .
tar -C /tmp/debian-$dist-mm --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root2.tar .
tar --full-time --verbose -tf /tmp/root1.tar > /tmp/root1.tar.list
tar --full-time --verbose -tf /tmp/root2.tar > /tmp/root2.tar.list
diff -u /tmp/root1.tar.list /tmp/root2.tar.list
rm /tmp/root1.tar /tmp/root2.tar /tmp/root1.tar.list /tmp/root2.tar.list
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# check if file properties (permissions, ownership, symlink names, modification time) differ
#
coverage.sh: fix typo
2020-03-22 13:07:28 +00:00
# we cannot use this (yet) because it cannot cope with paths that have [ or @ in them
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
#fmtree -c -p /tmp/debian-$dist-debootstrap -k flags,gid,link,mode,size,time,uid | sudo fmtree -p /tmp/debian-$dist-mm
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
rm /tmp/debian-$dist-mm.tar
rm -r /tmp/debian-$dist-debootstrap /tmp/debian-$dist-mm
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
done
done
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: test wrapping debootstrap in mmdebstrap
2020-05-03 18:32:50 +00:00
# this is a solution for https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=829134
print_header "mode=unshare,variant=custom: as debootstrap unshare wrapper"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
adduser --gecos user --disabled-password user
runuser -u user -- $CMD --variant=custom --mode=unshare --setup-hook='env container=lxc debootstrap --no-merged-usr unstable "\$1" $mirror' - /tmp/debian-mm.tar $mirror
mkdir /tmp/debian-mm
tar --xattrs --xattrs-include='*' -C /tmp/debian-mm -xf /tmp/debian-mm.tar
mkdir /tmp/debian-debootstrap
tar --xattrs --xattrs-include='*' -C /tmp/debian-debootstrap -xf "cache/debian-unstable--.tar"
# diff cannot compare device nodes, so we use tar to do that for us and then
# delete the directory
tar -C /tmp/debian-debootstrap -cf dev1.tar ./dev
tar -C /tmp/debian-mm -cf dev2.tar ./dev
cmp dev1.tar dev2.tar
rm dev1.tar dev2.tar
rm -r /tmp/debian-debootstrap/dev /tmp/debian-mm/dev
# remove downloaded deb packages
rm /tmp/debian-debootstrap/var/cache/apt/archives/*.deb
# remove aux-cache
rm /tmp/debian-debootstrap/var/cache/ldconfig/aux-cache
# remove logs
rm /tmp/debian-debootstrap/var/log/dpkg.log \
/tmp/debian-debootstrap/var/log/bootstrap.log \
/tmp/debian-debootstrap/var/log/alternatives.log \
/tmp/debian-mm/var/log/bootstrap.log
# debootstrap doesn't clean apt
rm /tmp/debian-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_unstable_main_binary-${HOSTARCH}_Packages \
/tmp/debian-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_unstable_Release \
/tmp/debian-debootstrap/var/lib/apt/lists/127.0.0.1_debian_dists_unstable_Release.gpg
rm /tmp/debian-debootstrap/etc/machine-id /tmp/debian-mm/etc/machine-id
rm /tmp/debian-mm/var/cache/apt/archives/lock
rm /tmp/debian-mm/var/lib/apt/lists/lock
# check if the file content differs
diff --no-dereference --recursive /tmp/debian-debootstrap /tmp/debian-mm
# check permissions, ownership, symlink targets, modification times using tar
# mtimes of directories created by mmdebstrap will differ, thus we equalize them first
for d in etc/apt/preferences.d/ etc/apt/sources.list.d/ etc/dpkg/dpkg.cfg.d/; do
touch --date="@$SOURCE_DATE_EPOCH" /tmp/debian-debootstrap/\$d /tmp/debian-mm/\$d
done
# debootstrap never ran apt -- fixing permissions
for d in ./var/lib/apt/lists/partial ./var/cache/apt/archives/partial; do
chroot /tmp/debian-debootstrap chmod 0700 \$d
chroot /tmp/debian-debootstrap chown _apt:root \$d
done
tar -C /tmp/debian-debootstrap --numeric-owner --xattrs --xattrs-include='*' --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root1.tar .
tar -C /tmp/debian-mm --numeric-owner --xattrs --xattrs-include='*' --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/root2.tar .
tar --full-time --verbose -tf /tmp/root1.tar > /tmp/root1.tar.list
tar --full-time --verbose -tf /tmp/root2.tar > /tmp/root2.tar.list
# despite SOURCE_DATE_EPOCH and --clamp-mtime, the timestamps in the tarball
# will slightly differ from each other in the sub-second precision (last
# decimals) so the tarballs will not be identical, so we use diff to compare
# content and tar to compare attributes
diff -u /tmp/root1.tar.list /tmp/root2.tar.list
rm /tmp/root1.tar /tmp/root2.tar /tmp/root1.tar.list /tmp/root2.tar.list
rm /tmp/debian-mm.tar
rm -r /tmp/debian-debootstrap /tmp/debian-mm
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
print_header "test --help"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: redirect grep output to /dev/null instead of using --quiet to prevent broken pipe
2020-01-10 11:07:03 +00:00
# we redirect to /dev/null instead of using --quiet to not cause a broken pipe
# when grep exits before mmdebstrap was able to write all its output
$CMD --help | grep --fixed-strings 'mmdebstrap [OPTION...] [SUITE [TARGET [MIRROR...]]]' >/dev/null
add --man option and reduce output of --help option Printing the full man page requires the perl-doc package. To avoid this dependency, print the less verbose output containing only the synopsis and the option list for the --help option and print the full output (requiring perldoc) for the --man option.
2019-11-29 07:45:08 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --man option and reduce output of --help option Printing the full man page requires the perl-doc package. To avoid this dependency, print the less verbose output containing only the synopsis and the option list for the --help option and print the full output (requiring perldoc) for the --man option.
2019-11-29 07:45:08 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --man option and reduce output of --help option Printing the full man page requires the perl-doc package. To avoid this dependency, print the less verbose output containing only the synopsis and the option list for the --help option and print the full output (requiring perldoc) for the --man option.
2019-11-29 07:45:08 +00:00
fi
print_header "test --man"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: redirect to /dev/null instead of --quiet to avoid broken pipe
2020-01-04 00:14:01 +00:00
# we redirect to /dev/null instead of using --quiet to not cause a broken pipe
# when grep exits before mmdebstrap was able to write all its output
$CMD --man | grep --fixed-strings 'mmdebstrap [OPTION...] [*SUITE* [*TARGET* [*MIRROR*...]]]' >/dev/null
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
END
add --version option
2019-02-23 07:55:31 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --version option
2019-02-23 07:55:31 +00:00
else
coverage.sh: always run --help and --version tests as root
2019-09-27 06:29:17 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --version option
2019-02-23 07:55:31 +00:00
fi
print_header "test --version"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: redirect grep output to /dev/null instead of using --quiet to prevent broken pipe
2020-01-10 11:07:03 +00:00
# we redirect to /dev/null instead of using --quiet to not cause a broken pipe
# when grep exits before mmdebstrap was able to write all its output
$CMD --version | egrep '^mmdebstrap [0-9](\.[0-9])+$' >/dev/null
add --version option
2019-02-23 07:55:31 +00:00
END
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
coverage.sh: always run --help and --version tests as root
2019-09-27 06:29:17 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: create directory"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
chroot /tmp/debian-chroot dpkg-query --showformat '\${binary:Package}\n' --show > pkglist.txt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort > tar1.txt
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
fix print_header output for test 'fail with unshare as root user'
2019-09-27 21:04:51 +00:00
print_header "mode=unshare,variant=apt: fail with unshare as root user"
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
ret=0
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=unshare --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
for format in tar squashfs ext2; do
print_header "mode=unshare/root,variant=debootstrap: check for bit-by-bit identical $format output"
cat << END > shared/test.sh
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
$CMD --mode=root --variant=debootstrap $DEFAULT_DIST /tmp/debian-chroot-root.$format $mirror
if [ "$format" = tar ]; then
printf 'ustar ' | cmp --bytes=6 --ignore-initial=257:0 /tmp/debian-chroot-root.tar -
elif [ "$format" = squashfs ]; then
printf 'hsqs' | cmp --bytes=4 /tmp/debian-chroot-root.squashfs -
elif [ "$format" = ext2 ]; then
printf '\123\357' | cmp --bytes=2 --ignore-initial=1080:0 /tmp/debian-chroot-root.ext2 -
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
else
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
echo "unknown format: $format" >&2
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
fi
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
runuser -u user -- $CMD --mode=unshare --variant=debootstrap $DEFAULT_DIST /tmp/debian-chroot-unshare.$format $mirror
cmp /tmp/debian-chroot-root.$format /tmp/debian-chroot-unshare.$format
rm /tmp/debian-chroot-root.$format /tmp/debian-chroot-unshare.$format
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
done
coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare
2020-01-21 12:32:05 +00:00
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
print_header "mode=unshare,variant=apt: test taridshift utility"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
echo user:100000:65536 | cmp /etc/subuid -
echo user:100000:65536 | cmp /etc/subgid -
sysctl -w kernel.unprivileged_userns_clone=1
# include iputils-ping so that we can verify that taridshift does not remove
# extended attributes
# run through tarshift no-op to create a tarball that should be bit-by-bit
# identical to a round trip through "taridshift X" and "taridshift -X"
runuser -u user -- $CMD --mode=unshare --variant=apt --include=iputils-ping $DEFAULT_DIST - $mirror \
| ./taridshift 0 > /tmp/debian-chroot.tar
coverage.sh: check that xattrs are set in the original tarball
2020-08-15 16:05:59 +00:00
# make sure that xattrs are set in the original tarball
mkdir /tmp/debian-chroot
tar --xattrs --xattrs-include='*' --directory /tmp/debian-chroot -xf /tmp/debian-chroot.tar ./bin/ping
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
echo "/tmp/debian-chroot/bin/ping cap_net_raw=ep" > /tmp/expected
getcap /tmp/debian-chroot/bin/ping | diff -u /tmp/expected -
coverage.sh: check that xattrs are set in the original tarball
2020-08-15 16:05:59 +00:00
rm /tmp/debian-chroot/bin/ping
rmdir /tmp/debian-chroot/bin
rmdir /tmp/debian-chroot
# shift the uid/gid forward by 100000 and backward by 100000
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
./taridshift 100000 < /tmp/debian-chroot.tar > /tmp/debian-chroot-shifted.tar
./taridshift -100000 < /tmp/debian-chroot-shifted.tar > /tmp/debian-chroot-shiftedback.tar
# the tarball before and after the roundtrip through taridshift should be bit
# by bit identical
cmp /tmp/debian-chroot.tar /tmp/debian-chroot-shiftedback.tar
# manually adjust uid/gid and compare "tar -t" output
tar --numeric-owner -tvf /tmp/debian-chroot.tar \
| sed 's# 100/0 # 100100/100000 #' \
| sed 's# 0/0 # 100000/100000 #' \
| sed 's# 0/5 # 100000/100005 #' \
| sed 's# 0/8 # 100000/100008 #' \
| sed 's# 0/42 # 100000/100042 #' \
| sed 's# 0/43 # 100000/100043 #' \
| sed 's# 0/50 # 100000/100050 #' \
| sed 's/ \\+/ /g' \
> /tmp/debian-chroot.txt
tar --numeric-owner -tvf /tmp/debian-chroot-shifted.tar \
| sed 's/ \\+/ /g' \
| diff -u /tmp/debian-chroot.txt -
mkdir /tmp/debian-chroot
tar --xattrs --xattrs-include='*' --directory /tmp/debian-chroot -xf /tmp/debian-chroot-shifted.tar
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
echo "100000 100000" > /tmp/expected
stat --format="%u %g" /tmp/debian-chroot/bin/ping | diff -u /tmp/expected -
echo "/tmp/debian-chroot/bin/ping cap_net_raw=ep" > /tmp/expected
getcap /tmp/debian-chroot/bin/ping | diff -u /tmp/expected -
echo "0 0" > /tmp/expected
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
runuser -u user -- $CMD --unshare-helper /usr/sbin/chroot /tmp/debian-chroot stat --format="%u %g" /bin/ping \
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
| diff -u /tmp/expected -
echo "/bin/ping cap_net_raw=ep" > /tmp/expected
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
runuser -u user -- $CMD --unshare-helper /usr/sbin/chroot /tmp/debian-chroot getcap /bin/ping \
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
| diff -u /tmp/expected -
rm /tmp/debian-chroot.tar /tmp/debian-chroot-shifted.tar /tmp/debian-chroot.txt /tmp/debian-chroot-shiftedback.tar /tmp/expected
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
print_header "mode=$defaultmode,variant=apt: test progress bars on fake tty"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
script -qfc "$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror" /dev/null
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
print_header "mode=$defaultmode,variant=apt: test --debug output on fake tty"
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
script -qfc "$CMD --mode=$defaultmode --debug --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror" /dev/null
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: existing empty directory"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
mkdir /tmp/debian-chroot
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
print_header "mode=root,variant=apt: existing directory with lost+found"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
mkdir /tmp/debian-chroot
mkdir /tmp/debian-chroot/lost+found
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
rmdir /tmp/debian-chroot/lost+found
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: test target directory with empty lost+found
2019-01-25 11:49:58 +00:00
fi
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
print_header "mode=$defaultmode,variant=apt: fail installing to non-empty lost+found"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
mkdir /tmp/debian-chroot
mkdir /tmp/debian-chroot/lost+found
touch /tmp/debian-chroot/lost+found/exists
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
rm /tmp/debian-chroot/lost+found/exists
rmdir /tmp/debian-chroot/lost+found
rmdir /tmp/debian-chroot
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty lost+found
2019-09-26 21:20:58 +00:00
fi
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
print_header "mode=$defaultmode,variant=apt: fail installing to non-empty target directory"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
mkdir /tmp/debian-chroot
mkdir /tmp/debian-chroot/lost+found
touch /tmp/debian-chroot/exists
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
rmdir /tmp/debian-chroot/lost+found
rm /tmp/debian-chroot/exists
rmdir /tmp/debian-chroot
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for non-empty target directory
2019-12-02 22:53:06 +00:00
fi
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
print_header "mode=root,variant=apt: chroot directory not accessible by _apt user"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
mkdir /tmp/debian-chroot
chmod 700 /tmp/debian-chroot
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
disable apt sandboxing if the chroot directory is not accessible by the _apt user
2019-02-28 10:54:03 +00:00
fi
Instead of using gzip compression support, run compressor ourselves - otherwise ./dev tar cannot be concatenated with the rest - test compressor early - better document the TARGET option
2019-01-20 09:41:29 +00:00
print_header "mode=unshare,variant=apt: create gzip compressed tarball"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
runuser -u user -- $CMD --mode=unshare --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.gz $mirror
coverage.sh: make sure we have a gzip compressed file by checking the first three magic bytes
2020-01-03 23:36:21 +00:00
printf '\037\213\010' | cmp --bytes=3 /tmp/debian-chroot.tar.gz -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar.gz | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar.gz
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
fi
coverage.sh: add test that makes sure that TMPDIR is used and works in unshare mode
2020-03-07 22:34:32 +00:00
print_header "mode=unshare,variant=apt: custom TMPDIR"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=1
homedir=\$(runuser -u user -- sh -c 'cd && pwd')
runuser -u user -- mkdir "\$homedir/tmp"
runuser -u user -- env TMPDIR="\$homedir/tmp" $CMD --mode=unshare --variant=apt \
--setup-hook='case "\$1" in "'"\$homedir/tmp/mmdebstrap."'"??????????) exit 0;; *) exit 1;; esac' \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
# use rmdir as a quick check that nothing is remaining in TMPDIR
runuser -u user -- rmdir "\$homedir/tmp"
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
print_header "mode=$defaultmode,variant=apt: test xz compressed tarball"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.xz $mirror
printf '\3757zXZ\0' | cmp --bytes=6 /tmp/debian-chroot.tar.xz -
tar -tf /tmp/debian-chroot.tar.xz | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar.xz
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
Fix parallel xz compression... hopefully for the last time...
2019-12-02 20:17:45 +00:00
fi
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
print_header "mode=$defaultmode,variant=apt: directory ending in .tar"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt --format=directory $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
ftype=\$(stat -c %F /tmp/debian-chroot.tar)
if [ "\$ftype" != directory ]; then
echo "expected directory but got: \$ftype" >&2
exit 1
fi
tar -C /tmp/debian-chroot.tar --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
add support for generating squashfs images using tar2sqfs
2020-01-07 16:40:13 +00:00
print_header "mode=$defaultmode,variant=apt: test squashfs image"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.squashfs $mirror
printf 'hsqs' | cmp --bytes=4 /tmp/debian-chroot.squashfs -
# workaround for https://github.com/AgentD/squashfs-tools-ng/issues/37
sed 's#\\([^.]\\)/\$#\\1#' tar1.txt | sort > /tmp/tar1noslash.txt
coverage.sh: workaround for squashfs-tools-ng/issues/42
2020-04-09 08:43:12 +00:00
# workaround for https://github.com/AgentD/squashfs-tools-ng/issues/42
sqfs2tar --no-skip --root-becomes . /tmp/debian-chroot.squashfs | tar -t \
| sed 's#\\([^.]\\)/\$#\\1#' \
| sort | diff -u /tmp/tar1noslash.txt -
add support for generating squashfs images using tar2sqfs
2020-01-07 16:40:13 +00:00
rm /tmp/debian-chroot.squashfs /tmp/tar1noslash.txt
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
for mode in root unshare fakechroot proot; do
print_header "mode=$mode,variant=apt: test ext2 image"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
prefix=
[ "\$(id -u)" -eq 0 ] && [ "$mode" != "root" ] && prefix="runuser -u user --"
[ "$mode" = "fakechroot" ] && prefix="\$prefix fakechroot fakeroot"
\$prefix $CMD --mode=$mode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.ext2 $mirror
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
mkdir /tmp/mnt
mount /tmp/debian-chroot.ext2 /tmp/mnt
rmdir /tmp/mnt/lost+found
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
# in fakechroot mode, we use a fake ldconfig, so we have to
# artificially add some files
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
{ tar -C /tmp/mnt -c . | tar -t;
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
[ "$mode" = "fakechroot" ] && printf "./etc/ld.so.cache\n./var/cache/ldconfig/\n";
[ "$mode" = "fakechroot" ] && printf "./etc/.pwd.lock\n";
} | sort | diff -u tar1.txt -
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
umount /tmp/mnt
rmdir /tmp/mnt
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
rm /tmp/debian-chroot.ext2
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
done
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
print_header "mode=auto,variant=apt: test auto-mode without unshare capabilities"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
adduser --gecos user --disabled-password user
sysctl -w kernel.unprivileged_userns_clone=0
runuser -u user -- $CMD --mode=auto --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.gz $mirror
{ tar -tf /tmp/debian-chroot.tar.gz;
printf "./etc/ld.so.cache\n./var/cache/ldconfig/\n./etc/.pwd.lock\n";
} | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar.gz
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test auto-mode without unshare capabilities
2019-03-27 10:29:36 +00:00
fi
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
print_header "mode=$defaultmode,variant=apt: fail with missing lz4"
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar.lz4 $mirror || ret=\$?
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
elif [ "$defaultmode" = "root" ]; then
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: switch several tests from mode=root to $defaultmode
2019-09-27 06:27:49 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
print_header "mode=$defaultmode,variant=apt: fail with path with quotes"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/quoted\"path $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for path with quotes
2019-09-26 21:24:10 +00:00
fi
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
print_header "mode=root,variant=apt: create tarball with /tmp mounted nodev"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
mount -t tmpfs -o nodev,nosuid,size=300M tmpfs /tmp
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
# use --customize-hook to exercise the mounting/unmounting code of block devices in root mode
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --customize-hook='mount | grep /dev/full' --customize-hook='test "\$(echo foo | tee /dev/full 2>&1 1>/dev/null)" = "tee: /dev/full: No space left on device"' $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
coverage.sh: create tarball as root with /tmp mounted nodev
2019-01-25 11:50:52 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
print_header "mode=$defaultmode,variant=apt: read from stdin, write to stdout"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo "deb $mirror $DEFAULT_DIST main" | $CMD --mode=$defaultmode --variant=apt > /tmp/debian-chroot.tar
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
improve --components parsing with comma and whitespace as separator
2019-10-19 06:10:36 +00:00
fi
print_header "mode=$defaultmode,variant=apt: supply components manually"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt --components="main main" --comp="main,main" $DEFAULT_DIST /tmp/debian-chroot $mirror
echo "deb $mirror $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added
2019-01-25 11:06:34 +00:00
print_header "mode=root,variant=apt: stable default mirror"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added
2019-01-25 11:06:34 +00:00
cat << HOSTS >> /etc/hosts
127.0.0.1 deb.debian.org
127.0.0.1 security.debian.org
HOSTS
apt-cache policy
cat /etc/apt/sources.list
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt stable /tmp/debian-chroot
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list
coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added
2019-01-25 11:06:34 +00:00
deb http://deb.debian.org/debian stable main
deb http://deb.debian.org/debian stable-updates main
deb http://security.debian.org/debian-security stable/updates main
SOURCES
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: pass distribution but implicitly write to stdout"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
echo "127.0.0.1 deb.debian.org" >> /etc/hosts
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST > /tmp/debian-chroot.tar
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
print_header "mode=$defaultmode,variant=apt: test aspcud apt solver"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=custom \
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
--include \$(cat pkglist.txt | tr '\n' ',') \
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
--aptopt='APT::Solver "aspcud"' \
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort \
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
| grep -v '^./etc/apt/apt.conf.d/99mmdebstrap$' \
| diff -u tar1.txt -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot.tar
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for aspcud external apt solver
2019-03-24 07:16:45 +00:00
fi
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: mirror is -"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo "deb $mirror $DEFAULT_DIST main" | $CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar -
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
print_header "mode=$defaultmode,variant=apt: copy:// mirror"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test requires the cache directory to be mounted on /mnt and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar "deb copy:///mnt/cache/debian unstable main"
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
fi
print_header "mode=$defaultmode,variant=apt: fail with file:// mirror"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test requires the cache directory to be mounted on /mnt and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
ret=0
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar "deb file:///mnt/cache/debian unstable main" || ret=\$?
rm /tmp/debian-chroot.tar
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for copy:// and file:// mirrors
2019-09-26 21:25:05 +00:00
fi
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: mirror is deb..."
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar "deb $mirror $DEFAULT_DIST main"
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: fix print_header with defaultmode tests
2019-02-23 07:47:53 +00:00
print_header "mode=$defaultmode,variant=apt: mirror is real file"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo "deb $mirror $DEFAULT_DIST main" > /tmp/sources.list
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar /tmp/sources.list
support deb822-style format apt sources
2020-01-22 22:30:28 +00:00
tar -tf /tmp/debian-chroot.tar \
| sed 's#^./etc/apt/sources.list.d/0000sources.list\$#./etc/apt/sources.list#' \
| sort | diff -u tar1.txt -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot.tar /tmp/sources.list
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
support deb822-style format apt sources
2020-01-22 22:30:28 +00:00
print_header "mode=$defaultmode,variant=apt: test deb822 (1/2)"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
cat << SOURCES > /tmp/deb822.sources
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" > /tmp/sources.list
echo "deb ${mirror}3 $DEFAULT_DIST main" \
| $CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST \
/tmp/debian-chroot \
/tmp/deb822.sources \
${mirror}4 \
- \
"deb ${mirror}5 $DEFAULT_DIST main" \
${mirror}6 \
/tmp/sources.list
test ! -e /tmp/debian-chroot/etc/apt/sources.list
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0000deb822.sources -
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0001main.list -
deb ${mirror}4 $DEFAULT_DIST main
deb ${mirror}3 $DEFAULT_DIST main
deb ${mirror}5 $DEFAULT_DIST main
deb ${mirror}6 $DEFAULT_DIST main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0002sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . \
| {
tar -t \
| grep -v "^./etc/apt/sources.list.d/0000deb822.sources$" \
| grep -v "^./etc/apt/sources.list.d/0001main.list$" \
| grep -v "^./etc/apt/sources.list.d/0002sources.list";
printf "./etc/apt/sources.list\n";
} | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
rm /tmp/sources.list /tmp/deb822.sources
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
print_header "mode=$defaultmode,variant=apt: test deb822 (2/2)"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
cat << SOURCES > /tmp/deb822
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" > /tmp/sources
cat << SOURCES | $CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST \
/tmp/debian-chroot \
/tmp/deb822 \
- \
/tmp/sources
Types: deb
URIs: ${mirror}3
Suites: $DEFAULT_DIST
Components: main
SOURCES
test ! -e /tmp/debian-chroot/etc/apt/sources.list
ls -lha /tmp/debian-chroot/etc/apt/sources.list.d/
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0000deb822.sources -
Types: deb
URIs: ${mirror}1
Suites: $DEFAULT_DIST
Components: main
SOURCES
cat << SOURCES | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0001main.sources -
Types: deb
URIs: ${mirror}3
Suites: $DEFAULT_DIST
Components: main
SOURCES
echo "deb ${mirror}2 $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list.d/0002sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . \
| {
tar -t \
| grep -v "^./etc/apt/sources.list.d/0000deb822.sources$" \
| grep -v "^./etc/apt/sources.list.d/0001main.sources$" \
| grep -v "^./etc/apt/sources.list.d/0002sources.list$";
printf "./etc/apt/sources.list\n";
} | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
rm /tmp/sources /tmp/deb822
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
Do not unconditionally read standard input mmdebstrap used to attempt reading stdin if it was not a tty. This leads to unexpected behaviour when mmdebstrap is used through ssh without a pseudo-terminal allocated like so: $ ssh remote mmdebstrap unstable /output/dir http://mirror This will stall forever, waiting for data on standard input. Or consider: $ ssh remote << END > somecommand > mmdebstrap unstable /output/dir http://mirror > othercommand END This will make mmdebstrap read "othercommand" and everything that follows as a sources.list entry. To prevent this unexpected behaviour, the following ways to use mmdebstrap will not be supported anymore: $ mmdebstrap unstable /output/dir < sources.list $ mmdebstrap unstable /output/dir http://mirror < sources.list Instead, one must now explicitly pass "-" if one wants mmdebstrap to read from stdin: $ mmdebstrap unstable /output/dir - < sources.list $ mmdebstrap unstable /output/dir http://mirror - < sources.list
2019-08-27 22:53:04 +00:00
print_header "mode=$defaultmode,variant=apt: automatic mirror from suite"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
Do not unconditionally read standard input mmdebstrap used to attempt reading stdin if it was not a tty. This leads to unexpected behaviour when mmdebstrap is used through ssh without a pseudo-terminal allocated like so: $ ssh remote mmdebstrap unstable /output/dir http://mirror This will stall forever, waiting for data on standard input. Or consider: $ ssh remote << END > somecommand > mmdebstrap unstable /output/dir http://mirror > othercommand END This will make mmdebstrap read "othercommand" and everything that follows as a sources.list entry. To prevent this unexpected behaviour, the following ways to use mmdebstrap will not be supported anymore: $ mmdebstrap unstable /output/dir < sources.list $ mmdebstrap unstable /output/dir http://mirror < sources.list Instead, one must now explicitly pass "-" if one wants mmdebstrap to read from stdin: $ mmdebstrap unstable /output/dir - < sources.list $ mmdebstrap unstable /output/dir http://mirror - < sources.list
2019-08-27 22:53:04 +00:00
echo "127.0.0.1 deb.debian.org" >> /etc/hosts
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
print_header "mode=$defaultmode,variant=apt: invalid mirror"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror/invalid || ret=\$?
coverage.sh: remove /tmp/debian-chroot before exiting
2019-09-27 21:08:18 +00:00
rm /tmp/debian-chroot.tar
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
print_header "mode=root,variant=apt: fail installing to /"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
$CMD --mode=root --variant=apt $DEFAULT_DIST / $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing into /
2019-09-26 21:28:27 +00:00
fi
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
print_header "mode=root,variant=apt: fail installing to existing file"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
touch /tmp/exists
ret=0
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/exists $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for installing onto existing file
2019-09-26 21:29:55 +00:00
fi
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
print_header "mode=$defaultmode,variant=apt: test armhf without qemu support"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
apt-get remove --yes qemu-user-static binfmt-support qemu-user
ret=0
$CMD --mode=$defaultmode --variant=apt --architectures=armhf $DEFAULT_DIST /tmp/debian-chroot.tar $mirror || ret=\$?
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
exit 1
fi
END
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_QEMU" = "yes" ]; then
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for armhf without qemu support
2019-09-26 21:31:08 +00:00
fi
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
print_header "mode=$defaultmode,variant=apt: test i386 (which can be executed without qemu)"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
# remove qemu just to be sure
apt-get remove --yes qemu-user-static binfmt-support qemu-user
$CMD --mode=$defaultmode --variant=apt --architectures=i386 $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
# we ignore differences between architectures by ignoring some files
# and renaming others
{ tar -tf /tmp/debian-chroot.tar \
| grep -v '^\./usr/bin/i386$' \
| grep -v '^\./lib/ld-linux\.so\.2$' \
| grep -v '^\./lib/i386-linux-gnu/ld-linux\.so\.2$' \
| grep -v '^\./usr/lib/gcc/i686-linux-gnu/$' \
coverage.sh: use regex to not rely on exact gcc version
2020-03-06 07:44:22 +00:00
| grep -v '^\./usr/lib/gcc/i686-linux-gnu/[0-9]\+/$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| grep -v '^\./usr/share/man/man8/i386\.8\.gz$' \
coverage.sh: also filter out changelog of Debian native packages
2019-09-28 18:57:33 +00:00
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.i386\.gz$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| sed 's/i386-linux-gnu/x86_64-linux-gnu/' \
| sed 's/i386/amd64/';
} | sort > tar2.txt
{ cat tar1.txt \
| grep -v '^\./usr/bin/i386$' \
| grep -v '^\./usr/bin/x86_64$' \
| grep -v '^\./lib64/$' \
| grep -v '^\./lib64/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./usr/lib/gcc/x86_64-linux-gnu/$' \
coverage.sh: use regex to not rely on exact gcc version
2020-03-06 07:44:22 +00:00
| grep -v '^\./usr/lib/gcc/x86_64-linux-gnu/[0-9]\+/$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| grep -v '^\./lib/x86_64-linux-gnu/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec-2\.[0-9]\+\.so$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec\.so\.1$' \
coverage.sh: also filter out changelog of Debian native packages
2019-09-28 18:57:33 +00:00
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.amd64\.gz$' \
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
| grep -v '^\./usr/share/man/man8/i386\.8\.gz$' \
| grep -v '^\./usr/share/man/man8/x86_64\.8\.gz$';
} | sort | diff -u - tar2.txt
rm /tmp/debian-chroot.tar
END
coverage.sh: comparing amd64 with i386 should only be done with RUN_MA_SAME_TESTS = yes
2020-06-24 21:11:03 +00:00
# this test compares the contents of different architectures, so this might
# fail if the versions do not match
if [ "$RUN_MA_SAME_TESTS" = "yes" ]; then
if [ "$HOSTARCH" != amd64 ]; then
echo "HOSTARCH != amd64 -- Skipping test..." >&2
skipped=$((skipped+1))
elif [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
echo "HAVE_QEMU != yes -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
else
coverage.sh: comparing amd64 with i386 should only be done with RUN_MA_SAME_TESTS = yes
2020-06-24 21:11:03 +00:00
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for i386 on amd64 without qemu
2019-09-26 21:32:52 +00:00
fi
coverage.sh: instead of installing gcc-8-base:armhf, install libmagic-mgc:armhf - is not part of the native installation set - does not have any dependencies - installs only few files - doesn't change its name regularly (like gcc-*-base)
2019-08-26 13:45:38 +00:00
# to test foreign architecture package installation we choose a package which
# - is not part of the native installation set
# - does not have any dependencies
# - installs only few files
# - doesn't change its name regularly (like gcc-*-base)
print_header "mode=root,variant=apt: test --include=libmagic-mgc:armhf"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: instead of installing gcc-8-base:armhf, install libmagic-mgc:armhf - is not part of the native installation set - does not have any dependencies - installs only few files - doesn't change its name regularly (like gcc-*-base)
2019-08-26 13:45:38 +00:00
$CMD --mode=root --variant=apt --architectures=amd64,armhf --include=libmagic-mgc:armhf $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
{ echo "amd64"; echo "armhf"; } | cmp /tmp/debian-chroot/var/lib/dpkg/arch -
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/arch
rm /tmp/debian-chroot/var/lib/apt/extended_states
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.list
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.md5sums
rm /tmp/debian-chroot/usr/lib/file/magic.mgc
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/README.Debian
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.Debian.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/copyright
rm /tmp/debian-chroot/usr/share/file/magic.mgc
rm /tmp/debian-chroot/usr/share/misc/magic.mgc
rmdir /tmp/debian-chroot/usr/share/doc/libmagic-mgc/
rmdir /tmp/debian-chroot/usr/share/file/magic/
rmdir /tmp/debian-chroot/usr/share/file/
rmdir /tmp/debian-chroot/usr/lib/file/
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
if [ "$RUN_MA_SAME_TESTS" = "yes" ]; then
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_QEMU" = "yes" ]; then
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
fi
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
allow multiple --architecture options and separation by whitespace
2019-10-27 21:04:21 +00:00
fi
print_header "mode=root,variant=apt: test --include=libmagic-mgc:armhf with multiple --arch options"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=root --variant=apt --architectures=amd64 --architectures=armhf --include=libmagic-mgc:armhf $DEFAULT_DIST /tmp/debian-chroot $mirror
{ echo "amd64"; echo "armhf"; } | cmp /tmp/debian-chroot/var/lib/dpkg/arch -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/arch
rm /tmp/debian-chroot/var/lib/apt/extended_states
coverage.sh: instead of installing gcc-8-base:armhf, install libmagic-mgc:armhf - is not part of the native installation set - does not have any dependencies - installs only few files - doesn't change its name regularly (like gcc-*-base)
2019-08-26 13:45:38 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.list
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.md5sums
rm /tmp/debian-chroot/usr/lib/file/magic.mgc
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/README.Debian
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.Debian.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/copyright
rm /tmp/debian-chroot/usr/share/file/magic.mgc
rm /tmp/debian-chroot/usr/share/misc/magic.mgc
rmdir /tmp/debian-chroot/usr/share/doc/libmagic-mgc/
rmdir /tmp/debian-chroot/usr/share/file/magic/
rmdir /tmp/debian-chroot/usr/share/file/
rmdir /tmp/debian-chroot/usr/lib/file/
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
if [ "$RUN_MA_SAME_TESTS" = "yes" ]; then
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_QEMU" = "yes" ]; then
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow to disable running tests that can fail because of m-a:same version skews
2019-10-05 05:23:25 +00:00
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: test --aptopt"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
echo 'Acquire::Languages "none";' > /tmp/config
$CMD --mode=root --variant=apt --aptopt='Acquire::Check-Valid-Until "false"' --aptopt=/tmp/config $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
printf 'Acquire::Check-Valid-Until "false";\nAcquire::Languages "none";\n' | cmp /tmp/debian-chroot/etc/apt/apt.conf.d/99mmdebstrap -
rm /tmp/debian-chroot/etc/apt/apt.conf.d/99mmdebstrap
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
rm -r /tmp/debian-chroot /tmp/config
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
print_header "mode=root,variant=apt: test --keyring"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
rm /etc/apt/trusted.gpg.d/*.gpg
make_mirro.sh: install gpg into qemu machine
2020-01-21 12:08:35 +00:00
$CMD --mode=root --variant=apt --keyring=/usr/share/keyrings/debian-archive-keyring.gpg --keyring=/usr/share/keyrings/ $DEFAULT_DIST /tmp/debian-chroot "deb $mirror $DEFAULT_DIST main"
# make sure that no [signedby=...] managed to make it into the sources.list
echo "deb $mirror $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list -
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
fi
print_header "mode=root,variant=apt: test --keyring overwrites"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
mkdir -p /tmp/emptydir
touch /tmp/emptyfile
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
# this overwrites the apt keyring options and should fail
ret=0
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
$CMD --mode=root --variant=apt --keyring=/tmp/emptydir --keyring=/tmp/emptyfile $DEFAULT_DIST /tmp/debian-chroot "deb $mirror $DEFAULT_DIST main" || ret=\$?
make_mirro.sh: install gpg into qemu machine
2020-01-21 12:08:35 +00:00
# make sure that no [signedby=...] managed to make it into the sources.list
echo "deb $mirror $DEFAULT_DIST main" | cmp /tmp/debian-chroot/etc/apt/sources.list -
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
rm -r /tmp/debian-chroot
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rmdir /tmp/emptydir
rm /tmp/emptyfile
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
exit 1
fi
END
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...
2019-10-28 15:29:38 +00:00
fi
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
print_header "mode=root,variant=apt: test signed-by without host keys"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
rm /etc/apt/trusted.gpg.d/*.gpg
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
printf 'deb [signed-by="/usr/share/keyrings/debian-archive-keyring.gpg"] $mirror $DEFAULT_DIST main\n' | cmp /tmp/debian-chroot/etc/apt/sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
fi
print_header "mode=root,variant=apt: test signed-by with host keys"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=root --variant=apt $DEFAULT_DIST /tmp/debian-chroot $mirror
printf 'deb $mirror $DEFAULT_DIST main\n' | cmp /tmp/debian-chroot/etc/apt/sources.list -
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
else
make_mirro.sh: install gpg into qemu machine
2020-01-21 12:08:35 +00:00
./run_null.sh SUDO
runtests=$((runtests+1))
--keyring now overwrites the default apt keyring - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt
2019-12-03 09:16:39 +00:00
fi
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: test --dpkgopt"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
echo no-pager > /tmp/config
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility
2020-08-25 11:02:33 +00:00
$CMD --mode=root --variant=apt --dpkgopt="path-exclude=/usr/share/doc/*" --dpkgopt=/tmp/config --dpkgopt="path-include=/usr/share/doc/dpkg/copyright" $DEFAULT_DIST /tmp/debian-chroot $mirror
printf 'path-exclude=/usr/share/doc/*\nno-pager\npath-include=/usr/share/doc/dpkg/copyright\n' | cmp /tmp/debian-chroot/etc/dpkg/dpkg.cfg.d/99mmdebstrap -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/etc/dpkg/dpkg.cfg.d/99mmdebstrap
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort > tar2.txt
no longer needs to install twice when --depkgopt=path-exclude is given by filtering the tarball with new tarfilter utility
2020-08-25 11:02:33 +00:00
{ grep -v '^./usr/share/doc/.' tar1.txt; echo ./usr/share/doc/dpkg/; echo ./usr/share/doc/dpkg/copyright; } | sort | diff -u - tar2.txt
coverage.sh: cleanup dpkg config
2020-01-06 12:03:29 +00:00
rm -r /tmp/debian-chroot /tmp/config
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=root,variant=apt: test --include"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
rm /tmp/debian-chroot/var/lib/apt/extended_states
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
allow multiple --include options and use array instead of hash Package order is important when calling apt. Consider this dependency graph: A -> B -> C | D , E -> D | C "apt install A E" it will install "A B C E" "apt install E A" it will install "E D A B"
2019-10-28 14:35:29 +00:00
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --include options and use array instead of hash Package order is important when calling apt. Consider this dependency graph: A -> B -> C | D , E -> D | C "apt install A E" it will install "A B C E" "apt install E A" it will install "E D A B"
2019-10-28 14:35:29 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
allow multiple --include options and use array instead of hash Package order is important when calling apt. Consider this dependency graph: A -> B -> C | D , E -> D | C "apt install A E" it will install "A B C E" "apt install E A" it will install "E D A B"
2019-10-28 14:35:29 +00:00
fi
print_header "mode=root,variant=apt: test multiple --include"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=root --variant=apt --include=doc-debian --include=tzdata $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
rm /tmp/debian-chroot/etc/localtime
rm /tmp/debian-chroot/etc/timezone
rm /tmp/debian-chroot/usr/sbin/tzconfig
rm -r /tmp/debian-chroot/usr/share/doc/tzdata
rm -r /tmp/debian-chroot/usr/share/zoneinfo
rm /tmp/debian-chroot/var/lib/apt/extended_states
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.list
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.config
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.postinst
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.postrm
rm /tmp/debian-chroot/var/lib/dpkg/info/tzdata.templates
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
print_header "mode=root,variant=apt: test merged-usr via --setup-hook"
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
$CMD --mode=root --variant=apt \
--setup-hook=./hooks/setup00-merged-usr.sh \
--customize-hook='[ -L "\$1"/bin -a -L "\$1"/sbin -a -L "\$1"/lib ]' \
$DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort > tar2.txt
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
{
sed -e 's/^\.\/bin\//.\/usr\/bin\//;s/^\.\/lib\//.\/usr\/lib\//;s/^\.\/sbin\//.\/usr\/sbin\//;' tar1.txt | {
case $HOSTARCH in
amd64) sed -e 's/^\.\/lib32\//.\/usr\/lib32\//;s/^\.\/lib64\//.\/usr\/lib64\//;s/^\.\/libx32\//.\/usr\/libx32\//;';;
ppc64el) sed -e 's/^\.\/lib64\//.\/usr\/lib64\//;';;
*) cat;;
esac
};
echo ./bin;
echo ./lib;
echo ./sbin;
case $HOSTARCH in
amd64)
echo ./lib32;
echo ./lib64;
echo ./libx32;
echo ./usr/lib32/;
echo ./usr/libx32/;
;;
ppc64el)
echo ./lib64;
;;
esac
} | sort -u | diff -u - tar2.txt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
fi
print_header "mode=root,variant=apt: test --essential-hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
cat << 'SCRIPT' > /tmp/essential.sh
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
#!/bin/sh
echo tzdata tzdata/Zones/Europe select Berlin | chroot "\$1" debconf-set-selections
SCRIPT
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
chmod +x /tmp/essential.sh
$CMD --mode=root --variant=apt --include=tzdata --essential-hook='echo tzdata tzdata/Areas select Europe | chroot "\$1" debconf-set-selections' --essential-hook=/tmp/essential.sh $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
echo Europe/Berlin | cmp /tmp/debian-chroot/etc/timezone
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort \
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
| grep -v '^./etc/localtime' \
| grep -v '^./etc/timezone' \
| grep -v '^./usr/sbin/tzconfig' \
| grep -v '^./usr/share/doc/tzdata' \
| grep -v '^./usr/share/zoneinfo' \
| grep -v '^./var/lib/dpkg/info/tzdata.' \
do not cleanup apt and dpkg lock files to not set bad precedence
2019-02-27 23:20:00 +00:00
| grep -v '^./var/lib/apt/extended_states$' \
coverage.sh: use pipe to diff instead of temporary file
2019-03-15 09:24:13 +00:00
| diff -u tar1.txt -
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/essential.sh
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --setup-hook, --essential-hook and rename --customize to --customize-hook
2019-02-20 12:32:49 +00:00
fi
print_header "mode=root,variant=apt: test --customize-hook"
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
cat << 'SCRIPT' > /tmp/customize.sh
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
#!/bin/sh
chroot "\$1" whoami > "\$1/output2"
chroot "\$1" pwd >> "\$1/output2"
SCRIPT
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
chmod +x /tmp/customize.sh
$CMD --mode=root --variant=apt --customize-hook='chroot "\$1" sh -c "whoami; pwd" > "\$1/output1"' --customize-hook=/tmp/customize.sh $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
printf "root\n/\n" | cmp /tmp/debian-chroot/output1
printf "root\n/\n" | cmp /tmp/debian-chroot/output2
rm /tmp/debian-chroot/output1
rm /tmp/debian-chroot/output2
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/customize.sh
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -r /tmp/debian-chroot
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
END
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
print_header "mode=root,variant=apt: test failing --customize-hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
ret=0
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --customize-hook='chroot "\$1" sh -c "exit 1"' $DEFAULT_DIST /tmp/debian-chroot $mirror || ret=\$?
coverage.sh: remove /tmp/debian-chroot before exiting
2019-09-27 21:08:18 +00:00
rm -r /tmp/debian-chroot
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
fi
print_header "mode=root,variant=apt: test sigint during --customize-hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
setsid --wait $CMD --mode=root --variant=apt --customize-hook='touch done && sleep 10 && touch fail' $DEFAULT_DIST /tmp/debian-chroot $mirror &
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
pid=\$!
while sleep 1; do [ -e done ] && break; done
rm done
pgid=\$(echo \$(ps -p \$pid -o pgid=))
/bin/kill --signal INT -- -\$pgid
ret=0
wait \$pid || ret=\$?
coverage.sh: remove /tmp/debian-chroot before exiting
2019-09-27 21:08:18 +00:00
rm -r /tmp/debian-chroot
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
if [ -e fail ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo customize hook was not interrupted >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
rm fail
exit 1
fi
if [ "\$ret" = 0 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo expected failure but got exit \$ret >&2
coverage.sh: add 7 more tests
2019-02-23 07:46:32 +00:00
exit 1
fi
END
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for --customize
2019-01-13 12:36:42 +00:00
fi
coverage.sh: add test for hook-dir
2020-08-17 16:59:54 +00:00
print_header "mode=root,variant=apt: test --hook-directory"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
for h in hookA hookB; do
mkdir /tmp/\$h
for s in setup extract essential customize; do
cat << SCRIPT > /tmp/\$h/\${s}00.sh
#!/bin/sh
echo \$h/\${s}00 >> "\\\$1/\$s"
SCRIPT
chmod +x /tmp/\$h/\${s}00.sh
cat << SCRIPT > /tmp/\$h/\${s}01.sh
echo \$h/\${s}01 >> "\\\$1/\$s"
SCRIPT
chmod +x /tmp/\$h/\${s}01.sh
done
done
$CMD --mode=root --variant=apt \
--setup-hook='echo cliA/setup >> "\$1"/setup' \
--extract-hook='echo cliA/extract >> "\$1"/extract' \
--essential-hook='echo cliA/essential >> "\$1"/essential' \
--customize-hook='echo cliA/customize >> "\$1"/customize' \
--hook-dir=/tmp/hookA \
--setup-hook='echo cliB/setup >> "\$1"/setup' \
--extract-hook='echo cliB/extract >> "\$1"/extract' \
--essential-hook='echo cliB/essential >> "\$1"/essential' \
--customize-hook='echo cliB/customize >> "\$1"/customize' \
--hook-dir=/tmp/hookB \
--setup-hook='echo cliC/setup >> "\$1"/setup' \
--extract-hook='echo cliC/extract >> "\$1"/extract' \
--essential-hook='echo cliC/essential >> "\$1"/essential' \
--customize-hook='echo cliC/customize >> "\$1"/customize' \
$DEFAULT_DIST /tmp/debian-chroot $mirror
printf "cliA/setup\nhookA/setup00\nhookA/setup01\ncliB/setup\nhookB/setup00\nhookB/setup01\ncliC/setup\n" | diff -u - /tmp/debian-chroot/setup
printf "cliA/extract\nhookA/extract00\nhookA/extract01\ncliB/extract\nhookB/extract00\nhookB/extract01\ncliC/extract\n" | diff -u - /tmp/debian-chroot/extract
printf "cliA/essential\nhookA/essential00\nhookA/essential01\ncliB/essential\nhookB/essential00\nhookB/essential01\ncliC/essential\n" | diff -u - /tmp/debian-chroot/essential
printf "cliA/customize\nhookA/customize00\nhookA/customize01\ncliB/customize\nhookB/customize00\nhookB/customize01\ncliC/customize\n" | diff -u - /tmp/debian-chroot/customize
for s in setup extract essential customize; do
rm /tmp/debian-chroot/\$s
done
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
for h in hookA hookB; do
for s in setup extract essential customize; do
rm /tmp/\$h/\${s}00.sh
rm /tmp/\$h/\${s}01.sh
done
rmdir /tmp/\$h
done
rm -r /tmp/debian-chroot
END
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
print_header "mode=root,variant=apt: test eatmydata via --hook-dir"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
cat << SCRIPT > /tmp/checkeatmydata.sh
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
#!/bin/sh
set -exu
cat << EOF | diff - "\\\$1"/usr/bin/dpkg
#!/bin/sh
exec /usr/bin/eatmydata /usr/bin/dpkg.distrib "\\\\\\\$@"
EOF
[ -e "\\\$1"/usr/bin/eatmydata ]
SCRIPT
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
chmod +x /tmp/checkeatmydata.sh
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
$CMD --mode=root --variant=apt \
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
--customize-hook=/tmp/checkeatmydata.sh \
--essential-hook=/tmp/checkeatmydata.sh \
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
--extract-hook='printf "\\177ELF\\002\\001\\001\\000" | cmp --bytes=8 - "\$1"/usr/bin/dpkg' \
--hook-dir=./hooks/eatmydata \
--customize-hook='printf "\\177ELF\\002\\001\\001\\000" | cmp --bytes=8 - "\$1"/usr/bin/dpkg' \
$DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/checkeatmydata.sh
coverage.sh: test eatmydata and merged-usr hooks
2020-08-25 14:05:10 +00:00
rm -r /tmp/debian-chroot
END
coverage.sh: add test for hook-dir
2020-08-17 16:59:54 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
put hook listener into its own function and expose it to the CLI via --hook-listener
2020-08-15 20:36:13 +00:00
print_header "mode=root,variant=apt: test special hooks using helpers"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
mkfifo /tmp/myfifo
mkdir /tmp/root
ln -s /real /tmp/root/link
mkdir /tmp/root/real
run_testA() {
echo content > /tmp/foo
{ { { $CMD --hook-helper /tmp/root root setup env 1 upload /tmp/foo \$1 < /tmp/myfifo 3>&-; echo \$? >&3;
} | $CMD --hook-listener 3>&- >/tmp/myfifo; echo \$?; } 3>&1;
} | { read xs1; [ "\$xs1" -eq 0 ]; read xs2; [ "\$xs2" -eq 0 ]; }
echo content | diff -u - /tmp/root/real/foo
rm /tmp/foo
rm /tmp/root/real/foo
}
run_testA link/foo
run_testA /link/foo
run_testA ///link///foo///
run_testA /././link/././foo/././
run_testA /link/../link/foo
run_testA /link/../../link/foo
run_testA /../../link/foo
rmdir /tmp/root/real
rm /tmp/root/link
rmdir /tmp/root
rm /tmp/myfifo
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh SUDO
runtests=$((runtests+1))
fi
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
# test special hooks
for mode in root unshare fakechroot proot; do
print_header "mode=$mode,variant=apt: test special hooks with $mode mode"
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_PROOT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
continue
fi
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && [ "$mode" != "root" ] && prefix="runuser -u user --"
[ "$mode" = "fakechroot" ] && prefix="\$prefix fakechroot fakeroot"
symlinktarget=/real
case $mode in fakechroot|proot) symlinktarget='\$1/real';; esac
echo copy-in-setup > /tmp/copy-in-setup
echo copy-in-essential > /tmp/copy-in-essential
echo copy-in-customize > /tmp/copy-in-customize
echo tar-in-setup > /tmp/tar-in-setup
echo tar-in-essential > /tmp/tar-in-essential
echo tar-in-customize > /tmp/tar-in-customize
Restore deterministic tar with pax and xattr support - all creating and extraction of tarballs respects extended attributes - extended attributes require pax format, so explicitly request the format - to make pax bit-by-bit reproducible, ctime, atime and PID have to be removed from the headers with: --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime - always pass --numeric-owner to tar - always pass --xattrs when creating a tar - always pass --xattrs --xattrs-include=* when extracting a tar
2020-01-21 12:24:49 +00:00
tar --numeric-owner --format=pax --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime -C /tmp -cf /tmp/tar-in-setup.tar tar-in-setup
tar --numeric-owner --format=pax --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime -C /tmp -cf /tmp/tar-in-essential.tar tar-in-essential
tar --numeric-owner --format=pax --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime -C /tmp -cf /tmp/tar-in-customize.tar tar-in-customize
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
rm /tmp/tar-in-setup
rm /tmp/tar-in-essential
rm /tmp/tar-in-customize
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
echo upload-setup > /tmp/upload-setup
echo upload-essential > /tmp/upload-essential
echo upload-customize > /tmp/upload-customize
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
mkdir /tmp/sync-in-setup
mkdir /tmp/sync-in-essential
mkdir /tmp/sync-in-customize
echo sync-in-setup > /tmp/sync-in-setup/file
echo sync-in-essential > /tmp/sync-in-essential/file
echo sync-in-customize > /tmp/sync-in-customize/file
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
\$prefix $CMD --mode=$mode --variant=apt \
--setup-hook='mkdir "\$1/real"' \
--setup-hook='copy-in /tmp/copy-in-setup /real' \
--setup-hook='echo copy-in-setup | cmp "\$1/real/copy-in-setup" -' \
--setup-hook='rm "\$1/real/copy-in-setup"' \
--setup-hook='echo copy-out-setup > "\$1/real/copy-out-setup"' \
--setup-hook='copy-out /real/copy-out-setup /tmp' \
--setup-hook='rm "\$1/real/copy-out-setup"' \
--setup-hook='tar-in /tmp/tar-in-setup.tar /real' \
--setup-hook='echo tar-in-setup | cmp "\$1/real/tar-in-setup" -' \
--setup-hook='tar-out /real/tar-in-setup /tmp/tar-out-setup.tar' \
--setup-hook='rm "\$1"/real/tar-in-setup' \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
--setup-hook='upload /tmp/upload-setup /real/upload' \
--setup-hook='echo upload-setup | cmp "\$1/real/upload" -' \
--setup-hook='download /real/upload /tmp/download-setup' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--setup-hook='rm "\$1/real/upload"' \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
--setup-hook='sync-in /tmp/sync-in-setup /real' \
--setup-hook='echo sync-in-setup | cmp "\$1/real/file" -' \
--setup-hook='sync-out /real /tmp/sync-out-setup' \
--setup-hook='rm "\$1/real/file"' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--essential-hook='ln -s "'"\$symlinktarget"'" "\$1/symlink"' \
--essential-hook='copy-in /tmp/copy-in-essential /symlink' \
--essential-hook='echo copy-in-essential | cmp "\$1/real/copy-in-essential" -' \
--essential-hook='rm "\$1/real/copy-in-essential"' \
--essential-hook='echo copy-out-essential > "\$1/real/copy-out-essential"' \
--essential-hook='copy-out /symlink/copy-out-essential /tmp' \
--essential-hook='rm "\$1/real/copy-out-essential"' \
--essential-hook='tar-in /tmp/tar-in-essential.tar /symlink' \
--essential-hook='echo tar-in-essential | cmp "\$1/real/tar-in-essential" -' \
--essential-hook='tar-out /symlink/tar-in-essential /tmp/tar-out-essential.tar' \
--essential-hook='rm "\$1"/real/tar-in-essential' \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
--essential-hook='upload /tmp/upload-essential /symlink/upload' \
--essential-hook='echo upload-essential | cmp "\$1/real/upload" -' \
--essential-hook='download /symlink/upload /tmp/download-essential' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--essential-hook='rm "\$1/real/upload"' \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
--essential-hook='sync-in /tmp/sync-in-essential /symlink' \
--essential-hook='echo sync-in-essential | cmp "\$1/real/file" -' \
--essential-hook='sync-out /real /tmp/sync-out-essential' \
--essential-hook='rm "\$1/real/file"' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--customize-hook='copy-in /tmp/copy-in-customize /symlink' \
--customize-hook='echo copy-in-customize | cmp "\$1/real/copy-in-customize" -' \
--customize-hook='rm "\$1/real/copy-in-customize"' \
--customize-hook='echo copy-out-customize > "\$1/real/copy-out-customize"' \
--customize-hook='copy-out /symlink/copy-out-customize /tmp' \
--customize-hook='rm "\$1/real/copy-out-customize"' \
--customize-hook='tar-in /tmp/tar-in-customize.tar /symlink' \
--customize-hook='echo tar-in-customize | cmp "\$1/real/tar-in-customize" -' \
--customize-hook='tar-out /symlink/tar-in-customize /tmp/tar-out-customize.tar' \
--customize-hook='rm "\$1"/real/tar-in-customize' \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
--customize-hook='upload /tmp/upload-customize /symlink/upload' \
--customize-hook='echo upload-customize | cmp "\$1/real/upload" -' \
--customize-hook='download /symlink/upload /tmp/download-customize' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--customize-hook='rm "\$1/real/upload"' \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
--customize-hook='sync-in /tmp/sync-in-customize /symlink' \
--customize-hook='echo sync-in-customize | cmp "\$1/real/file" -' \
--customize-hook='sync-out /real /tmp/sync-out-customize' \
--customize-hook='rm "\$1/real/file"' \
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
--customize-hook='rmdir "\$1/real"' \
--customize-hook='rm "\$1/symlink"' \
$DEFAULT_DIST /tmp/debian-chroot.tar $mirror
for n in setup essential customize; do
ret=0
cmp /tmp/tar-in-\$n.tar /tmp/tar-out-\$n.tar || ret=\$?
if [ "\$ret" -ne 0 ]; then
if type diffoscope >/dev/null; then
diffoscope /tmp/tar-in-\$n.tar /tmp/tar-out-\$n.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
echo "no diffoscope installed" >&2
fi
if type base64 >/dev/null; then
base64 /tmp/tar-in-\$n.tar
base64 /tmp/tar-out-\$n.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
echo "no base64 installed" >&2
fi
if type xxd >/dev/null; then
xxd /tmp/tar-in-\$n.tar
xxd /tmp/tar-out-\$n.tar
coverage.sh: exit 1 instead of continuing after printing differences
2020-01-07 17:10:12 +00:00
exit 1
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
echo "no xxd installed" >&2
fi
exit 1
fi
done
echo copy-out-setup | cmp /tmp/copy-out-setup -
echo copy-out-essential | cmp /tmp/copy-out-essential -
echo copy-out-customize | cmp /tmp/copy-out-customize -
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
echo upload-setup | cmp /tmp/download-setup -
echo upload-essential | cmp /tmp/download-essential -
echo upload-customize | cmp /tmp/download-customize -
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
echo sync-in-setup | cmp /tmp/sync-out-setup/file -
echo sync-in-essential | cmp /tmp/sync-out-essential/file -
echo sync-in-customize | cmp /tmp/sync-out-customize/file -
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
# in fakechroot mode, we use a fake ldconfig, so we have to
# artificially add some files
{ tar -tf /tmp/debian-chroot.tar;
[ "$mode" = "fakechroot" ] && printf "./etc/ld.so.cache\n./var/cache/ldconfig/\n";
[ "$mode" = "fakechroot" ] && [ "$variant" != "essential" ] && printf "./etc/.pwd.lock\n";
} | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar \
/tmp/copy-in-setup /tmp/copy-in-essential /tmp/copy-in-customize \
/tmp/copy-out-setup /tmp/copy-out-essential /tmp/copy-out-customize \
/tmp/tar-in-setup.tar /tmp/tar-in-essential.tar /tmp/tar-in-customize.tar \
/tmp/tar-out-setup.tar /tmp/tar-out-essential.tar /tmp/tar-out-customize.tar \
coverage.sh: strip -in from upload-in and download-in
2020-01-16 09:30:21 +00:00
/tmp/upload-setup /tmp/upload-essential /tmp/upload-customize \
add sync-in and sync-out hooks
2020-01-16 09:38:14 +00:00
/tmp/download-setup /tmp/download-essential /tmp/download-customize \
/tmp/sync-in-setup/file /tmp/sync-in-essential/file /tmp/sync-in-customize/file \
/tmp/sync-out-setup/file /tmp/sync-out-essential/file /tmp/sync-out-customize/file
rmdir /tmp/sync-in-setup /tmp/sync-in-essential /tmp/sync-in-customize \
/tmp/sync-out-setup /tmp/sync-out-essential /tmp/sync-out-customize
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add special hooks copy-in, copy-out, tar-in, tar-out, upload and download
2019-12-09 09:40:51 +00:00
fi
done
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
print_header "mode=root,variant=apt: debootstrap no-op options"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: also test --force-check-gpg
2019-09-29 08:24:01 +00:00
$CMD --mode=root --variant=apt --resolve-deps --merged-usr --no-merged-usr --force-check-gpg $DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
test no-op options and print info message when they are used
2019-02-15 11:42:46 +00:00
fi
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
print_header "mode=root,variant=apt: --verbose"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --verbose $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
fi
print_header "mode=root,variant=apt: --debug"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --debug $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
fi
print_header "mode=root,variant=apt: --quiet"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=apt --quiet $DEFAULT_DIST /tmp/debian-chroot $mirror
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add tests for --verbose, --debug and --quiet
2019-02-20 16:40:26 +00:00
fi
add --logfile option
2019-02-23 07:43:15 +00:00
print_header "mode=root,variant=apt: --logfile"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: check the full log to also prevent debug printfs to accidentally make it into a commit
2020-01-10 11:03:49 +00:00
# we check the full log to also prevent debug printfs to accidentally make it into a commit
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
$CMD --mode=root --variant=apt --logfile=/tmp/log $DEFAULT_DIST /tmp/debian-chroot $mirror
print elapsed time after successful run
2020-08-25 14:06:05 +00:00
# omit the last line which should contain the runtime
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
head --lines=-1 /tmp/log > /tmp/trimmed
cat << LOG | diff -u - /tmp/trimmed
coverage.sh: host architecture in --logfile output must depend on host
2020-01-24 09:12:29 +00:00
I: chroot architecture $HOSTARCH is equal to the host's architecture
add --format option and ext2 image output
2020-04-09 16:33:05 +00:00
I: automatically chosen format: directory
coverage.sh: check the full log to also prevent debug printfs to accidentally make it into a commit
2020-01-10 11:03:49 +00:00
I: running apt-get update...
I: downloading packages with apt...
I: extracting archives...
I: installing packages...
I: cleaning package lists and apt cache...
LOG
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
tail --lines=1 /tmp/log | grep '^I: success in .* seconds$'
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
tar -C /tmp/debian-chroot --one-file-system -c . | tar -t | sort | diff -u tar1.txt -
rm -r /tmp/debian-chroot
coverage.sh: store temporary files in /tmp and not in shared
2020-08-27 13:18:43 +00:00
rm /tmp/log /tmp/trimmed
add --logfile option
2019-02-23 07:43:15 +00:00
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --logfile option
2019-02-23 07:43:15 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
add --logfile option
2019-02-23 07:43:15 +00:00
fi
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
print_header "mode=$defaultmode,variant=apt: without /etc/resolv.conf and /etc/hostname"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: add safety measure to ensure certain tests are not run outside qemu
2020-01-04 00:24:17 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
rm /etc/resolv.conf /etc/hostname
$CMD --mode=$defaultmode --variant=apt $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
{ tar -tf /tmp/debian-chroot.tar;
printf "./etc/hostname\n";
printf "./etc/resolv.conf\n";
} | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_QEMU != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname
2019-09-26 21:26:47 +00:00
fi
coverage.sh: fix typo in header message
2020-01-21 12:10:36 +00:00
print_header "mode=$defaultmode,variant=essential: test not having to install apt in --include because a hook did it before"
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=essential --include=apt --setup-hook="apt-get update" --setup-hook="apt-get --yes -oApt::Get::Download-Only=true install apt" $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
it's possible that apt is already downloaded at the time where we want to install it
2019-10-19 06:33:00 +00:00
fi
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
print_header "mode=$defaultmode,variant=apt: remove start-stop-daemon and policy-rc.d in hook"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --variant=apt --customize-hook='rm "\$1/usr/sbin/policy-rc.d"; rm "\$1/sbin/start-stop-daemon"' $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort | diff -u tar1.txt -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook
2019-10-28 13:31:46 +00:00
fi
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
print_header "mode=$defaultmode,variant=apt: create directory --dry-run"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
$CMD --mode=$defaultmode --dry-run --variant=apt --setup-hook="exit 1" --essential-hook="exit 1" --customize-hook="exit 1" $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/dev/console
rm /tmp/debian-chroot/dev/fd
rm /tmp/debian-chroot/dev/full
rm /tmp/debian-chroot/dev/null
rm /tmp/debian-chroot/dev/ptmx
rm /tmp/debian-chroot/dev/random
rm /tmp/debian-chroot/dev/stderr
rm /tmp/debian-chroot/dev/stdin
rm /tmp/debian-chroot/dev/stdout
rm /tmp/debian-chroot/dev/tty
rm /tmp/debian-chroot/dev/urandom
rm /tmp/debian-chroot/dev/zero
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/dpkg/available
rm /tmp/debian-chroot/var/lib/dpkg/cmethopt
rm /tmp/debian-chroot/var/lib/dpkg/status
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
# test all --dry-run variants
for variant in extract custom essential apt; do
for mode in root unshare fakechroot proot chrootless; do
print_header "mode=$mode,variant=$variant: create tarball --dry-run"
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
skipped=$((skipped+1))
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
echo "HAVE_PROOT != yes -- Skipping test..." >&2
skipped=$((skipped+1))
continue
fi
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
prefix=
include=
if [ "\$(id -u)" -eq 0 ] && [ "$mode" != root ]; then
# this must be qemu
if ! id -u user >/dev/null 2>&1; then
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
sysctl -w kernel.unprivileged_userns_clone=1
fi
prefix="runuser -u user --"
if [ "$mode" = extract ] || [ "$mode" = custom ]; then
include="--include=\$(cat pkglist.txt | tr '\n' ',')"
fi
fi
\$prefix $CMD --mode=$mode \$include --dry-run --variant=$variant $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
if [ -e /tmp/debian-chroot.tar ]; then
echo "/tmp/debian-chroot.tar must not be created with --dry-run" >&2
exit 1
fi
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
done
done
add coverage.sh
2018-10-22 18:37:31 +00:00
# test all variants
for variant in essential apt required minbase buildd important debootstrap - standard; do
coverage.sh: skip prio:standard test because python is priority:standard but uninstallable since August 03 2020, see Debian bug #968217
2020-08-13 12:03:31 +00:00
if [ "$variant" = standard ]; then
# python is priority:standard but uninstallable since August 03
# 2020, see Debian bug #968217
continue
fi
add --dry-run and --simulate
2020-01-10 10:44:15 +00:00
print_header "mode=root,variant=$variant: create tarball"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
$CMD --mode=root --variant=$variant $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar -tf /tmp/debian-chroot.tar | sort > "$variant.txt"
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
# check if the other modes produce the same result in each variant
for mode in unshare fakechroot proot; do
# fontconfig doesn't install reproducibly because differences
# in /var/cache/fontconfig/. See
# https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=864082
if [ "$variant" = standard ]; then
continue
fi
case "$mode" in
now that fakechroot and proot are fixed, add support for for variants beyond essential and apt
2019-01-01 13:28:56 +00:00
proot)
case "$variant" in
important|debootstrap|-|standard)
# the systemd postint yields:
# chfn: PAM: System error
# adduser: `/usr/bin/chfn -f systemd Time Synchronization systemd-timesync' returned error code 1. Exiting.
# similar error with fakechroot https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=745082#75
# https://github.com/proot-me/PRoot/issues/156
continue
;;
esac
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
esac
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=$mode,variant=$variant: create tarball"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_PROOT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
\$prefix $CMD --mode=$mode --variant=$variant $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# in fakechroot mode, we use a fake ldconfig, so we have to
# artificially add some files
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
{ tar -tf /tmp/debian-chroot.tar;
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ "$mode" = "fakechroot" ] && printf "./etc/ld.so.cache\n./var/cache/ldconfig/\n";
coverage.sh: re-enable fakechroot testing as #915559 got fixed
2019-02-28 06:51:47 +00:00
[ "$mode" = "fakechroot" ] && [ "$variant" != "essential" ] && printf "./etc/.pwd.lock\n";
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
} | sort | diff -u "./$variant.txt" -
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
done
# some variants are equal and some are strict superset of the last
# special case of the buildd variant: nothing is a superset of it
case "$variant" in
essential) ;; # nothing to compare it to
apt)
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ $(comm -23 shared/essential.txt shared/apt.txt | wc -l) -eq 0 ]
[ $(comm -13 shared/essential.txt shared/apt.txt | wc -l) -gt 0 ]
rm shared/essential.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
required)
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ $(comm -23 shared/apt.txt shared/required.txt | wc -l) -eq 0 ]
[ $(comm -13 shared/apt.txt shared/required.txt | wc -l) -gt 0 ]
rm shared/apt.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
minbase) # equal to required
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cmp shared/required.txt shared/minbase.txt
rm shared/required.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
buildd)
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ $(comm -23 shared/minbase.txt shared/buildd.txt | wc -l) -eq 0 ]
[ $(comm -13 shared/minbase.txt shared/buildd.txt | wc -l) -gt 0 ]
rm shared/buildd.txt # we need minbase.txt but not buildd.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
important)
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ $(comm -23 shared/minbase.txt shared/important.txt | wc -l) -eq 0 ]
[ $(comm -13 shared/minbase.txt shared/important.txt | wc -l) -gt 0 ]
rm shared/minbase.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
debootstrap) # equal to important
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cmp shared/important.txt shared/debootstrap.txt
rm shared/important.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
-) # equal to debootstrap
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cmp shared/debootstrap.txt shared/-.txt
rm shared/debootstrap.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
standard)
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ $(comm -23 shared/-.txt shared/standard.txt | wc -l) -eq 0 ]
[ $(comm -13 shared/-.txt shared/standard.txt | wc -l) -gt 0 ]
rm shared/-.txt shared/standard.txt
add coverage.sh
2018-10-22 18:37:31 +00:00
;;
*) exit 1;;
esac
done
# test extract variant also with chrootless mode
for mode in root unshare fakechroot proot chrootless; do
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=$mode,variant=extract: unpack doc-debian"
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_PROOT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && [ "$mode" != "root" ] && prefix="runuser -u user --"
[ "$mode" = "fakechroot" ] && prefix="\$prefix fakechroot fakeroot"
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
\$prefix $CMD --mode=$mode --variant=extract --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot $mirror
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# delete contents of doc-debian
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# delete real files
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/lib/dpkg/available
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
create /var/lib/dpkg/cmethopt for dselect (see #930788)
2019-08-21 12:57:54 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/cmethopt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/var/lib/apt/lists/lock
disable merged usr
2018-12-06 23:17:10 +00:00
## delete merged usr symlinks
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# delete ./dev (files might exist or not depending on the mode)
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm -f /tmp/debian-chroot/dev/console
rm -f /tmp/debian-chroot/dev/fd
rm -f /tmp/debian-chroot/dev/full
rm -f /tmp/debian-chroot/dev/null
rm -f /tmp/debian-chroot/dev/ptmx
rm -f /tmp/debian-chroot/dev/random
rm -f /tmp/debian-chroot/dev/stderr
rm -f /tmp/debian-chroot/dev/stdin
rm -f /tmp/debian-chroot/dev/stdout
rm -f /tmp/debian-chroot/dev/tty
rm -f /tmp/debian-chroot/dev/urandom
rm -f /tmp/debian-chroot/dev/zero
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# the rest should be empty directories that we can rmdir recursively
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
done
coverage.sh: add more tests
2018-11-02 16:24:46 +00:00
print_header "mode=chrootless,variant=custom: install doc-debian"
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
\$prefix $CMD --mode=chrootless --variant=custom --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot $mirror
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
# preserve output with permissions and timestamps for later test
chmod 700 /tmp/debian-chroot
tar -C /tmp/debian-chroot --owner=0 --group=0 --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/debian-chroot.tar .
tar tvf /tmp/debian-chroot.tar > doc-debian.tar.list
rm /tmp/debian-chroot.tar
add coverage.sh
2018-10-22 18:37:31 +00:00
# delete contents of doc-debian
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
add coverage.sh
2018-10-22 18:37:31 +00:00
# delete real files
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/lib/dpkg/available
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
create /var/lib/dpkg/cmethopt for dselect (see #930788)
2019-08-21 12:57:54 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/cmethopt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/apt/extended_states
disable merged usr
2018-12-06 23:17:10 +00:00
## delete merged usr symlinks
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
add coverage.sh
2018-10-22 18:37:31 +00:00
# in chrootless mode, there is more to remove
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Lock
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Unincorp
rm /tmp/debian-chroot/var/lib/dpkg/status-old
rm /tmp/debian-chroot/var/lib/dpkg/info/format
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
add coverage.sh
2018-10-22 18:37:31 +00:00
# the rest should be empty directories that we can rmdir recursively
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
coverage.sh: document how to check for new chrootless packages
2020-07-09 05:40:54 +00:00
# regularly check whether more packages work with chrootless:
# for p in $(grep-aptavail -F Essential yes -s Package -n | sort -u); do ./mmdebstrap --mode=chrootless --variant=custom --include=bsdutils,coreutils,debianutils,diffutils,dpkg,findutils,grep,gzip,hostname,init-system-helpers,ncurses-base,ncurses-bin,perl-base,sed,tar,$p unstable /dev/null; done
coverage.sh: add test for known-good chrootless packages
2020-06-24 21:10:29 +00:00
print_header "mode=chrootless,variant=custom: install known-good from essential:yes"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
\$prefix $CMD --mode=chrootless --variant=custom --include=bsdutils,coreutils,debianutils,diffutils,dpkg,findutils,grep,gzip,hostname,init-system-helpers,ncurses-base,ncurses-bin,perl-base,sed,tar $DEFAULT_DIST /dev/null $mirror
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
print_header "mode=chrootless,variant=custom: install doc-debian and output tarball"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
\$prefix $CMD --mode=chrootless --variant=custom --include=doc-debian $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
tar tvf /tmp/debian-chroot.tar | grep -v ' ./dev' | diff -u doc-debian.tar.list -
rm /tmp/debian-chroot.tar
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
when creating a tarball in chrootless mode, use root ownership
2019-09-04 11:50:25 +00:00
fi
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
print_header "mode=chrootless,variant=custom: install doc-debian and test hooks"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
export SOURCE_DATE_EPOCH=$SOURCE_DATE_EPOCH
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
\$prefix $CMD --mode=chrootless --variant=custom --include=doc-debian --setup-hook='touch "\$1/setup"' --customize-hook='touch "\$1/customize"' $DEFAULT_DIST /tmp/debian-chroot $mirror
rm /tmp/debian-chroot/setup
rm /tmp/debian-chroot/customize
chmod 700 /tmp/debian-chroot
tar -C /tmp/debian-chroot --owner=0 --group=0 --numeric-owner --sort=name --clamp-mtime --mtime=$(date --utc --date=@$SOURCE_DATE_EPOCH --iso-8601=seconds) -cf /tmp/debian-chroot.tar .
tar tvf /tmp/debian-chroot.tar | grep -v ' ./dev' | diff -u doc-debian.tar.list -
rm /tmp/debian-chroot.tar
# delete contents of doc-debian
rm /tmp/debian-chroot/usr/share/doc-base/debian-*
rm -r /tmp/debian-chroot/usr/share/doc/debian
rm -r /tmp/debian-chroot/usr/share/doc/doc-debian
# delete real files
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/lib/dpkg/available
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
rm /tmp/debian-chroot/var/lib/dpkg/cmethopt
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/apt/extended_states
## delete merged usr symlinks
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
# in chrootless mode, there is more to remove
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Lock
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Unincorp
rm /tmp/debian-chroot/var/lib/dpkg/status-old
rm /tmp/debian-chroot/var/lib/dpkg/info/format
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/doc-debian.list
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
make hooks work in chrootless mode
2019-10-28 13:27:37 +00:00
fi
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
print_header "mode=chrootless,variant=custom: install libmagic-mgc on armhf"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && prefix="runuser -u user --"
\$prefix $CMD --mode=chrootless --variant=custom --architectures=armhf --include=libmagic-mgc $DEFAULT_DIST /tmp/debian-chroot $mirror
# delete contents of libmagic-mgc
rm /tmp/debian-chroot/usr/lib/file/magic.mgc
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/README.Debian
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.Debian.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/changelog.gz
rm /tmp/debian-chroot/usr/share/doc/libmagic-mgc/copyright
rm /tmp/debian-chroot/usr/share/file/magic.mgc
rm /tmp/debian-chroot/usr/share/misc/magic.mgc
# delete real files
rm /tmp/debian-chroot/etc/apt/sources.list
rm /tmp/debian-chroot/etc/fstab
rm /tmp/debian-chroot/etc/hostname
rm /tmp/debian-chroot/etc/resolv.conf
rm /tmp/debian-chroot/var/lib/dpkg/status
rm /tmp/debian-chroot/var/lib/dpkg/available
rm /tmp/debian-chroot/var/cache/apt/archives/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock
rm /tmp/debian-chroot/var/lib/dpkg/lock-frontend
rm /tmp/debian-chroot/var/lib/dpkg/cmethopt
rm /tmp/debian-chroot/var/lib/apt/lists/lock
rm /tmp/debian-chroot/var/lib/apt/extended_states
## delete merged usr symlinks
#rm /tmp/debian-chroot/libx32
#rm /tmp/debian-chroot/lib64
#rm /tmp/debian-chroot/lib32
#rm /tmp/debian-chroot/sbin
#rm /tmp/debian-chroot/bin
#rm /tmp/debian-chroot/lib
# in chrootless mode, there is more to remove
rm /tmp/debian-chroot/var/lib/dpkg/arch
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Lock
rm /tmp/debian-chroot/var/lib/dpkg/triggers/Unincorp
rm /tmp/debian-chroot/var/lib/dpkg/status-old
rm /tmp/debian-chroot/var/lib/dpkg/info/format
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.md5sums
rm /tmp/debian-chroot/var/lib/dpkg/info/libmagic-mgc.list
# the rest should be empty directories that we can rmdir recursively
find /tmp/debian-chroot -depth -print0 | xargs -0 rmdir
END
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
elif [ "$HAVE_BINFMT" = "yes" ]; then
coverage.sh: require binfmt support form chrootless installation of libmagic-mgc on armhf
2019-10-06 16:42:44 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: require binfmt support form chrootless installation of libmagic-mgc on armhf
2019-10-06 16:42:44 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: require binfmt support form chrootless installation of libmagic-mgc on armhf
2019-10-06 16:42:44 +00:00
fi
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
else
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_BINFMT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs
2019-08-26 16:25:21 +00:00
fi
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
print_header "mode=root,variant=custom: install busybox-based sub-essential system"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
pkgs=base-files,base-passwd,busybox,debianutils,dpkg,libc-bin,mawk,tar
add --extract-hook
2020-03-22 13:08:21 +00:00
# busybox --install -s will install symbolic links into the rootfs, leaving
# existing files untouched. It has to run after extraction (otherwise there is
# no busybox binary) and before first configuration
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
$CMD --mode=root --variant=custom \
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
--include=\$pkgs \
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
--setup-hook='mkdir -p "\$1/bin"' \
--setup-hook='echo root:x:0:0:root:/root:/bin/sh > "\$1/etc/passwd"' \
--setup-hook='printf "root:x:0:\nmail:x:8:\nutmp:x:43:\n" > "\$1/etc/group"' \
add --extract-hook
2020-03-22 13:08:21 +00:00
--extract-hook='chroot "\$1" busybox --install -s' \
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
$DEFAULT_DIST /tmp/debian-chroot $mirror
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
echo "\$pkgs" | tr ',' '\n' > /tmp/expected
chroot /tmp/debian-chroot dpkg-query -f '\${binary:Package}\n' -W \
| comm -12 - /tmp/expected \
| diff -u - /tmp/expected
rm /tmp/expected
add --extract-hook
2020-03-22 13:08:21 +00:00
for cmd in echo cat sed grep; do
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
test -L /tmp/debian-chroot/bin/\$cmd
add --extract-hook
2020-03-22 13:08:21 +00:00
test "\$(readlink /tmp/debian-chroot/bin/\$cmd)" = "/bin/busybox"
done
for cmd in sort; do
test -L /tmp/debian-chroot/usr/bin/\$cmd
test "\$(readlink /tmp/debian-chroot/usr/bin/\$cmd)" = "/bin/busybox"
coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore
2020-01-05 19:58:20 +00:00
done
chroot /tmp/debian-chroot echo foobar \
| chroot /tmp/debian-chroot cat \
| chroot /tmp/debian-chroot sort \
| chroot /tmp/debian-chroot sed 's/foobar/blubber/' \
coverage.sh: redirect grep output to /dev/null instead of using --quiet to prevent broken pipe
2020-01-10 11:07:03 +00:00
| chroot /tmp/debian-chroot grep blubber >/dev/null
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
rm -r /tmp/debian-chroot
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
else
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: auto generate package list for aspcud instead of hardcoding it
2019-03-27 10:44:45 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
# test foreign architecture with all modes
# create directory in sudo mode
for mode in root unshare fakechroot proot; do
now that fakechroot and proot are fixed, add support for for variants beyond essential and apt
2019-01-01 13:28:56 +00:00
print_header "mode=$mode,variant=apt: create armhf tarball"
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
if [ "$HOSTARCH" != amd64 ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HOSTARCH != amd64 -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running tests on architectures other than amd64 with reduced functionality
2020-01-06 10:10:31 +00:00
continue
fi
coverage.sh: check bit-by-bit identical squashfs and ext2 output using S_D_E between root and unshare modes
2020-05-03 07:40:37 +00:00
if [ "$RUN_MA_SAME_TESTS" != yes ]; then
echo "RUN_MA_SAME_TESTS != yes -- Skipping test..." >&2
skipped=$((skipped+1))
continue
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_BINFMT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_BINFMT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
if [ "$mode" = "unshare" ] && [ "$HAVE_UNSHARE" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_UNSHARE != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
if [ "$mode" = "proot" ] && [ "$HAVE_PROOT" != "yes" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "HAVE_PROOT != yes -- Skipping test..." >&2
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
skipped=$((skipped+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
continue
fi
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
cat << END > shared/test.sh
#!/bin/sh
set -eu
use LC_ALL=C.UTF-8 instead of LC_ALL=C
2018-12-27 13:16:23 +00:00
export LC_ALL=C.UTF-8
coverage.sh: abort early if the test system is about to be changed
2020-04-09 14:43:36 +00:00
if [ "\$(id -u)" -eq 0 ] && ! id -u user > /dev/null 2>&1; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
adduser --gecos user --disabled-password user
fi
if [ "$mode" = unshare ]; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
sysctl -w kernel.unprivileged_userns_clone=1
fi
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
prefix=
[ "\$(id -u)" -eq 0 ] && [ "$mode" != "root" ] && prefix="runuser -u user --"
[ "$mode" = "fakechroot" ] && prefix="\$prefix fakechroot fakeroot"
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
\$prefix $CMD --mode=$mode --variant=apt --architectures=armhf $DEFAULT_DIST /tmp/debian-chroot.tar $mirror
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
# we ignore differences between architectures by ignoring some files
# and renaming others
# in fakechroot mode, we use a fake ldconfig, so we have to
# artificially add some files
# in proot mode, some extra files are put there by proot
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
{ tar -tf /tmp/debian-chroot.tar \
disable merged usr
2018-12-06 23:17:10 +00:00
| grep -v '^\./lib/ld-linux-armhf\.so\.3$' \
| grep -v '^\./lib/arm-linux-gnueabihf/ld-linux\.so\.3$' \
| grep -v '^\./lib/arm-linux-gnueabihf/ld-linux-armhf\.so\.3$' \
coverage.sh: also filter out changelog of Debian native packages
2019-09-28 18:57:33 +00:00
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.armhf\.gz$' \
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
| sed 's/arm-linux-gnueabihf/x86_64-linux-gnu/' \
| sed 's/armhf/amd64/';
coverage.sh: re-enable fakechroot testing as #915559 got fixed
2019-02-28 06:51:47 +00:00
[ "$mode" = "fakechroot" ] && printf "./etc/ld.so.cache\n./var/cache/ldconfig/\n./etc/.pwd.lock\n";
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
} | sort > tar2.txt
{ cat tar1.txt \
coverage.sh: make regex more precise and relax it for version numbers
2018-12-05 11:01:58 +00:00
| grep -v '^\./usr/bin/i386$' \
| grep -v '^\./usr/bin/x86_64$' \
disable merged usr
2018-12-06 23:17:10 +00:00
| grep -v '^\./lib64/$' \
| grep -v '^\./lib64/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./lib/x86_64-linux-gnu/ld-linux-x86-64\.so\.2$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec-2\.[0-9]\+\.so$' \
| grep -v '^\./lib/x86_64-linux-gnu/libmvec\.so\.1$' \
coverage.sh: also filter out changelog of Debian native packages
2019-09-28 18:57:33 +00:00
| grep -v '^\./usr/share/doc/[^/]\+/changelog\(\.Debian\)\?\.amd64\.gz$' \
coverage.sh: make regex more precise and relax it for version numbers
2018-12-05 11:01:58 +00:00
| grep -v '^\./usr/share/man/man8/i386\.8\.gz$' \
| grep -v '^\./usr/share/man/man8/x86_64\.8\.gz$';
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
[ "$mode" = "proot" ] && printf "./etc/ld.so.preload\n";
} | sort | diff -u - tar2.txt
coverage.sh: allow setting chroot distribution with DEFAULT_DIST
2019-03-25 13:21:55 +00:00
rm /tmp/debian-chroot.tar
Instead of requiring root, use qemu - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh
2018-11-04 19:34:40 +00:00
END
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
else
./run_null.sh
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
runtests=$((runtests+1))
coverage.sh: allow running without qemu On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.
2018-12-05 09:33:03 +00:00
fi
add coverage.sh
2018-10-22 18:37:31 +00:00
done
coverage.sh: test ubuntu focal
2020-08-26 07:44:29 +00:00
print_header "mode=$defaultmode,variant=apt: test ubuntu focal"
cat << END > shared/test.sh
#!/bin/sh
set -eu
export LC_ALL=C.UTF-8
if ! /usr/lib/apt/apt-helper download-file http://archive.ubuntu.com/ubuntu/dists/focal/Release /dev/null && grep "QEMU Virtual CPU" /proc/cpuinfo; then
if [ ! -e /mmdebstrap-testenv ]; then
echo "this test modifies the system and should only be run inside a container" >&2
exit 1
fi
ip link set dev ens3 up
ip addr add 10.0.2.15/24 dev ens3
ip route add default via 10.0.2.2 dev ens3
echo "nameserver 10.0.2.3" > /etc/resolv.conf
fi
$CMD --mode=$defaultmode --variant=apt --customize-hook='grep UBUNTU_CODENAME=focal "\$1/etc/os-release"' focal /dev/null
END
if [ "$ONLINE" = "yes" ]; then
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
runtests=$((runtests+1))
elif [ "$defaultmode" = "root" ]; then
./run_null.sh SUDO
runtests=$((runtests+1))
else
./run_null.sh
runtests=$((runtests+1))
fi
else
echo "HOSTARCH != amd64 -- Skipping test..." >&2
skipped=$((skipped+1))
fi
coverage.sh: produce report inside VM to prevent errors from version mismatches
2020-08-24 13:01:49 +00:00
if [ -e shared/cover_db.img ]; then
# produce report inside the VM to make sure that the versions match or
# otherwise we might get:
# Can't read shared/cover_db/runs/1598213854.252.64287/cover.14 with Sereal: Sereal: Error: Bad Sereal header: Not a valid Sereal document. at offset 1 of input at srl_decoder.c line 600 at /usr/lib/x86_64-linux-gnu/perl5/5.30/Devel/Cover/DB/IO/Sereal.pm line 34, <$fh> chunk 1.
cat << END > shared/test.sh
cover -nogcov -report html_basic cover_db
mkdir -p report
for f in common.js coverage.html cover.css css.js mmdebstrap--branch.html mmdebstrap--condition.html mmdebstrap.html mmdebstrap--subroutine.html standardista-table-sorting.js; do
cp -a cover_db/\$f report
done
cover -delete cover_db
END
if [ "$HAVE_QEMU" = "yes" ]; then
./run_qemu.sh
elif [ "$mode" = "root" ]; then
./run_null.sh SUDO
else
./run_null.sh
fi
echo
echo open file://$(pwd)/shared/report/coverage.html in a browser
echo
fi
coverage.sh: check that the expected number of tests get executed
2019-10-28 13:50:56 +00:00
if [ "$((i-1))" -ne "$total" ]; then
coverage.sh: output messages on stderr
2020-01-06 11:56:40 +00:00
echo "unexpected number of tests: got $((i-1)) but expected $total" >&2
coverage.sh: check that the expected number of tests get executed
2019-10-28 13:50:56 +00:00
exit 1
fi
coverage.sh: keep track of executed and skipped tests
2020-01-06 12:02:27 +00:00
if [ "$skipped" -gt 0 ]; then
echo "number of skipped tests: $skipped" >&2
fi
if [ "$runtests" -gt 0 ]; then
echo "number of executed tests: $runtests" >&2
fi
if [ "$((skipped+runtests))" -ne "$total" ]; then
echo "sum of skipped and executed tests is not equal to $total" >&2
exit 1
fi
coverage.sh: test taridshift
2020-01-18 22:13:10 +00:00
rm shared/test.sh shared/tar1.txt shared/tar2.txt shared/pkglist.txt shared/doc-debian.tar.list shared/mmdebstrap shared/taridshift
Reference in a new issue Copy permalink