233 commits

Author	SHA1	Message	Date
Johannes 'josch' Schauer	446d66ea06	coverage.sh: fix typo	2020-03-22 14:07:28 +01:00
Johannes 'josch' Schauer	aa3d2875a8	coverage.sh: also compare permissions, ownership, symlink targets and mtimes	2020-03-22 14:07:00 +01:00
Johannes 'josch' Schauer	a91d7440cb	remove libgcc1 for libc6 >= 2.30-2 ... The buildd variant of debootstrap will install libgcc-s1 *and* libgcc1 even though the former provides the latter. Remove the latter manually. Since apt does not consider libgcc1 necessary, we have to download it explicitly for debootstrap. See Debian bug #953861	2020-03-15 14:04:57 +01:00
Johannes 'josch' Schauer	73b46e1812	coverage.sh: add test that makes sure that TMPDIR is used and works in unshare mode	2020-03-07 23:34:32 +01:00
Johannes 'josch' Schauer	5107116384	coverage.sh: use regex to not rely on exact gcc version	2020-03-06 08:44:22 +01:00
Johannes 'josch' Schauer	a8fa48fbc7	coverage.sh: host architecture in --logfile output must depend on host	2020-01-24 10:12:29 +01:00
Johannes 'josch' Schauer	62159d124a	support deb822-style format apt sources	2020-01-22 23:30:28 +01:00
Johannes 'josch' Schauer	3aef4dcc67	coverage.sh: add test comparing variant=debootstrap tarball for mode=root with mode=unshare	2020-01-21 13:32:05 +01:00
Johannes 'josch' Schauer	64fedc530e	Restore deterministic tar with pax and xattr support ... - all creating and extraction of tarballs respects extended attributes - extended attributes require pax format, so explicitly request the format - to make pax bit-by-bit reproducible, ctime, atime and PID have to be removed from the headers with: --pax-option=exthdr.name=%d/PaxHeaders/%f,delete=atime,delete=ctime - always pass --numeric-owner to tar - always pass --xattrs when creating a tar - always pass --xattrs --xattrs-include=* when extracting a tar	2020-01-21 13:24:49 +01:00
Johannes 'josch' Schauer	77c8bb7252	coverage.sh: fix typo in header message	2020-01-21 13:12:03 +01:00
Johannes 'josch' Schauer	1f59856858	make_mirro.sh: install gpg into qemu machine	2020-01-21 13:08:35 +01:00
Johannes 'josch' Schauer	8481068cd2	coverage.sh: write mmdebstrap.tdy into temporary file instead of current directory	2020-01-21 13:07:18 +01:00
Johannes 'josch' Schauer	98c8c573de	coverage.sh: test taridshift	2020-01-18 23:13:10 +01:00
Johannes 'josch' Schauer	7d152ec7e0	add sync-in and sync-out hooks	2020-01-16 10:38:14 +01:00
Johannes 'josch' Schauer	5e0f6d0ca8	coverage.sh: strip -in from upload-in and download-in	2020-01-16 10:30:21 +01:00
Johannes 'josch' Schauer	66957e6abd	coverage.sh: redirect grep output to /dev/null instead of using --quiet to prevent broken pipe	2020-01-10 12:07:03 +01:00
Johannes 'josch' Schauer	40c9f76d91	coverage.sh: check the full log to also prevent debug printfs to accidentally make it into a commit	2020-01-10 12:03:49 +01:00
Johannes 'josch' Schauer	2cb6438454	add --dry-run and --simulate	2020-01-10 11:44:15 +01:00
Johannes 'josch' Schauer	c36bfe25e7	reduce cover_db.img size, now that we don't run it for exec-ed processes anymore	2020-01-09 12:41:26 +01:00
Johannes 'josch' Schauer	f867384c20	coverage.sh: test with perlcritic	2020-01-09 08:39:40 +01:00
Johannes 'josch' Schauer	4ba82a41cf	format code with perltidy	2020-01-08 17:46:41 +01:00
Johannes 'josch' Schauer	4fed488c35	when re-execing itself, keep Devel::Cover options	2020-01-08 15:33:49 +01:00
Johannes 'josch' Schauer	f2ad2976ef	coverage.sh: remove some debugging output	2020-01-07 18:10:44 +01:00
Johannes 'josch' Schauer	caf8fd8283	coverage.sh: exit 1 instead of continuing after printing differences	2020-01-07 18:10:12 +01:00
Johannes 'josch' Schauer	161f8b0ec2	coverage.sh: bump cover_db.img size to 384MB	2020-01-07 18:08:20 +01:00
Johannes 'josch' Schauer	dbdf3f34c6	add support for generating squashfs images using tar2sqfs	2020-01-07 17:40:13 +01:00
Johannes 'josch' Schauer	51fab612ed	coverage.sh: cleanup shared/test.sh	2020-01-06 13:03:45 +01:00
Johannes 'josch' Schauer	8a0b003353	coverage.sh: cleanup dpkg config	2020-01-06 13:03:29 +01:00
Johannes 'josch' Schauer	b143e170e2	coverage.sh: keep track of executed and skipped tests	2020-01-06 13:02:27 +01:00
Johannes 'josch' Schauer	04e40eca47	coverage.sh: output messages on stderr	2020-01-06 12:56:40 +01:00
Johannes 'josch' Schauer	dc7663b3a8	coverage.sh: allow running tests on architectures other than amd64 with reduced functionality	2020-01-06 11:10:31 +01:00
Johannes 'josch' Schauer	4daae7e9be	coverage.sh: only patch /etc/shadow if necessary	2020-01-05 21:01:10 +01:00
Johannes 'josch' Schauer	46c9d4e058	coverage.sh: change busybox test to not be super sensitive about changes in unstable anymore	2020-01-05 20:58:20 +01:00
Johannes 'josch' Schauer	163da0a72d	coverage.sh: add safety measure to ensure certain tests are not run outside qemu	2020-01-04 01:24:17 +01:00
Johannes 'josch' Schauer	95e4a82937	coverage.sh: redirect to /dev/null instead of --quiet to avoid broken pipe	2020-01-04 01:14:01 +01:00
Johannes 'josch' Schauer	170344a611	coverage.sh: busybox sub-essential system now contains libcrypt1	2020-01-04 00:37:02 +01:00
Johannes 'josch' Schauer	75609a0b55	coverage.sh: make sure we have a gzip compressed file by checking the first three magic bytes	2020-01-04 00:36:21 +01:00
Johannes 'josch' Schauer	b3949f6f7a	coverage.sh: continue loop after finding a program to diff with	2020-01-04 00:35:11 +01:00
Johannes 'josch' Schauer	de85ad44b2	coverage.sh: reintroduce testing of debootstrap '-' variant	2020-01-04 00:34:09 +01:00
Johannes 'josch' Schauer	647e7e37f1	coverage.sh: test xattr support ... When creating a tarball: --xattrs When extracting a tarball: --xattrs --xattrs-include='*'	2020-01-03 16:02:38 +01:00
Johannes 'josch' Schauer	868081727e	add special hooks copy-in, copy-out, tar-in, tar-out, upload and download	2019-12-09 10:40:51 +01:00
Johannes 'josch' Schauer	e6d5d74d87	--keyring now overwrites the default apt keyring ... - apt can only handle one directory and one file as keyring - the signed-by option is used to specify the keyrings for suites that are not known by apt	2019-12-03 10:16:43 +01:00
Johannes 'josch' Schauer	6227bb2580	coverage.sh: add test for non-empty target directory	2019-12-02 23:53:06 +01:00
Johannes 'josch' Schauer	d262d67877	Fix parallel xz compression... hopefully for the last time...	2019-12-02 21:17:45 +01:00
Johannes 'josch' Schauer	aad36777e8	add --man option and reduce output of --help option ... Printing the full man page requires the perl-doc package. To avoid this dependency, print the less verbose output containing only the synopsis and the option list for the --help option and print the full output (requiring perldoc) for the --man option.	2019-11-29 08:45:13 +01:00
Johannes 'josch' Schauer	3a1d5413e2	also remove /var/log/apt/eipp.log.xz	2019-11-29 07:48:44 +01:00
Johannes 'josch' Schauer	f548c57ef8	coverage.sh: increase cover_db.img size to 256M	2019-11-29 07:47:06 +01:00
Johannes 'josch' Schauer	a2cd0e9843	add --keyring option as a shorthand for --aptopt='Dir::Etc::Trusted...	2019-10-28 16:29:38 +01:00
Johannes 'josch' Schauer	6cac8e70e8	allow multiple --include options and use array instead of hash ... Package order is important when calling apt. Consider this dependency graph: A -> B -> C | D , E -> D | C "apt install A E" it will install "A B C E" "apt install E A" it will install "E D A B"	2019-10-28 15:35:36 +01:00
Johannes 'josch' Schauer	c5a96736ef	coverage.sh: check that the expected number of tests get executed	2019-10-28 14:50:56 +01:00
Johannes 'josch' Schauer	c403b2b238	coverage.sh: add test for removal of start-stop-daemon and policy-rc.d in hook	2019-10-28 14:31:46 +01:00
Johannes 'josch' Schauer	e0732140c0	make hooks work in chrootless mode	2019-10-28 14:27:37 +01:00
Johannes 'josch' Schauer	d36ba6b371	allow multiple --architecture options and separation by whitespace	2019-10-27 22:16:23 +01:00
Johannes 'josch' Schauer	22c90c2ca6	it's possible that apt is already downloaded at the time where we want to install it	2019-10-19 16:24:58 +02:00
Johannes 'josch' Schauer	78358eaf9a	improve --components parsing with comma and whitespace as separator	2019-10-19 08:10:36 +02:00
Johannes 'josch' Schauer	503faaccf8	coverage.sh: in addition to cmp, run diffoscope and base64 and xxd	2019-10-18 23:06:57 +02:00
Johannes 'josch' Schauer	6bbf3943d1	coverage.sh: don't run make_mirror.sh	2019-10-18 22:46:23 +02:00
Johannes 'josch' Schauer	dde777123e	coverage.sh: require binfmt support form chrootless installation of libmagic-mgc on armhf	2019-10-06 18:42:44 +02:00
Johannes 'josch' Schauer	3d8b072e3f	coverage.sh: allow to disable running tests that can fail because of m-a:same version skews	2019-10-05 07:23:25 +02:00
Johannes 'josch' Schauer	b40f1530a2	coverage.sh: typo, delete shared/doc-debian.tar.list	2019-09-29 10:25:20 +02:00
Johannes 'josch' Schauer	4b919bbcc8	coverage.sh: busybox-based sub-essential does not need libattr1 anymore	2019-09-29 10:24:51 +02:00
Johannes 'josch' Schauer	594c8bbaa0	coverage.sh: also test --force-check-gpg	2019-09-29 10:24:01 +02:00
Johannes 'josch' Schauer	a7a80e22c1	coverage.sh: also filter out changelog of Debian native packages	2019-09-28 20:57:33 +02:00
Johannes 'josch' Schauer	fba31a078a	coverage.sh: remove /tmp/debian-chroot before exiting	2019-09-27 23:08:18 +02:00
Johannes 'josch' Schauer	311b58c689	fix print_header output for test 'fail with unshare as root user'	2019-09-27 23:04:51 +02:00
Johannes 'josch' Schauer	36d36d85ab	coverage.sh: always run --help and --version tests as root	2019-09-27 08:29:17 +02:00
Johannes 'josch' Schauer	87c742eded	coverage.sh: switch several tests from mode=root to $defaultmode	2019-09-27 08:27:49 +02:00
Johannes 'josch' Schauer	d4646fd8b0	coverage.sh: add test for i386 on amd64 without qemu	2019-09-26 23:32:52 +02:00
Johannes 'josch' Schauer	70b33609ea	coverage.sh: add test for armhf without qemu support	2019-09-26 23:31:08 +02:00
Johannes 'josch' Schauer	39503bd0af	coverage.sh: add test for installing onto existing file	2019-09-26 23:29:55 +02:00
Johannes 'josch' Schauer	d5cdc5b9b9	coverage.sh: add test for installing into /	2019-09-26 23:28:27 +02:00
Johannes 'josch' Schauer	598d353def	coverage.sh: add test for missing /etc/resolv.conf and /etc/hostname	2019-09-26 23:26:47 +02:00
Johannes 'josch' Schauer	c8b9a2ed96	coverage.sh: add test for copy:// and file:// mirrors	2019-09-26 23:25:05 +02:00
Johannes 'josch' Schauer	46eb9cdc5d	coverage.sh: add test for path with quotes	2019-09-26 23:24:10 +02:00
Johannes 'josch' Schauer	8a2897d629	coverage.sh: add test for non-empty lost+found	2019-09-26 23:20:58 +02:00
Johannes 'josch' Schauer	4447769b50	when creating a tarball in chrootless mode, use root ownership	2019-09-04 13:50:25 +02:00
Johannes 'josch' Schauer	a921e32e6c	Do not unconditionally read standard input ... mmdebstrap used to attempt reading stdin if it was not a tty. This leads to unexpected behaviour when mmdebstrap is used through ssh without a pseudo-terminal allocated like so: $ ssh remote mmdebstrap unstable /output/dir http://mirror This will stall forever, waiting for data on standard input. Or consider: $ ssh remote << END > somecommand > mmdebstrap unstable /output/dir http://mirror > othercommand END This will make mmdebstrap read "othercommand" and everything that follows as a sources.list entry. To prevent this unexpected behaviour, the following ways to use mmdebstrap will not be supported anymore: $ mmdebstrap unstable /output/dir < sources.list $ mmdebstrap unstable /output/dir http://mirror < sources.list Instead, one must now explicitly pass "-" if one wants mmdebstrap to read from stdin: $ mmdebstrap unstable /output/dir - < sources.list $ mmdebstrap unstable /output/dir http://mirror - < sources.list	2019-08-28 00:53:04 +02:00
Johannes 'josch' Schauer	1219a65723	add /var/lib/dpkg/arch in chrootless mode when chroot architecture differs	2019-08-26 18:25:21 +02:00
Johannes 'josch' Schauer	77f2cbee5d	coverage.sh: filter out potential binNMU changelogs	2019-08-26 15:47:11 +02:00
Johannes 'josch' Schauer	d9e5603f6f	coverage.sh: instead of installing gcc-8-base:armhf, install libmagic-mgc:armhf ... - is not part of the native installation set - does not have any dependencies - installs only few files - doesn't change its name regularly (like gcc-*-base)	2019-08-26 15:46:19 +02:00
Johannes 'josch' Schauer	2d2cdfbbc3	create /var/lib/dpkg/cmethopt for dselect (see #930788)	2019-08-21 14:57:54 +02:00
Johannes 'josch' Schauer	a425b948dd	updates for release of Debian buster	2019-07-24 21:29:14 +02:00
Johannes 'josch' Schauer	b2d5a45932	cleanup auxfiles *after* running apt-get update or otherwise it will be re-created	2019-04-23 13:28:55 +02:00
Johannes 'josch' Schauer	19fdb4914d	coverage.sh: auto generate package list for aspcud instead of hardcoding it	2019-03-27 11:44:45 +01:00
Johannes 'josch' Schauer	055af094ea	coverage.sh: add test auto-mode without unshare capabilities	2019-03-27 11:29:36 +01:00
Johannes 'josch' Schauer	ea8315a5f1	coverage.sh: allow setting chroot distribution with DEFAULT_DIST	2019-03-25 14:21:55 +01:00
Johannes 'josch' Schauer	6c39fe8b5a	coverage.sh: add test for aspcud external apt solver	2019-03-24 08:16:45 +01:00
Johannes 'josch' Schauer	f4ed753af5	coverage.sh: use pipe to diff instead of temporary file	2019-03-15 10:24:13 +01:00
Johannes 'josch' Schauer	b7f7f4e581	coverage.sh: fix total number of tests	2019-03-01 12:43:29 +01:00
Johannes 'josch' Schauer	920877fa2a	disable apt sandboxing if the chroot directory is not accessible by the _apt user	2019-02-28 11:54:03 +01:00
Johannes 'josch' Schauer	632b19eca3	coverage.sh: re-enable fakechroot testing as #915559 got fixed	2019-02-28 07:51:54 +01:00
Johannes 'josch' Schauer	d0f0283120	do not cleanup apt and dpkg lock files to not set bad precedence	2019-02-28 00:20:00 +01:00
Johannes 'josch' Schauer	0e49b70a0f	coverage.sh: /run/mount/utab is created inside qemu but not on gitlab CI -- weird...	2019-02-28 00:18:06 +01:00
Johannes 'josch' Schauer	c0ac77b01d	coverage.sh: stable default mirror: don't forget to remove chroot and only run test with qemu	2019-02-24 11:00:24 +01:00
Johannes 'josch' Schauer	48e34852a2	clean /var/lib/apt/lists/auxfiles so that apt older than 1.6 has no problem with the chroot	2019-02-23 13:22:44 +01:00
Johannes 'josch' Schauer	67343d0309	coverage.sh: adjust total number of tests	2019-02-23 08:58:08 +01:00
Johannes 'josch' Schauer	732eb2a1d2	coverage.sh: disable fakechroot because of https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=915559	2019-02-23 08:56:54 +01:00
Johannes 'josch' Schauer	5a618ea2f5	coverage.sh: add TODO item	2019-02-23 08:56:03 +01:00
Johannes 'josch' Schauer	a91a825e67	add --version option	2019-02-23 08:55:31 +01:00
Johannes 'josch' Schauer	26b1ff3fff	coverage.sh: fix print_header with defaultmode tests	2019-02-23 08:47:53 +01:00
Johannes 'josch' Schauer	93cf0544c6	coverage.sh: add 7 more tests	2019-02-23 08:46:32 +01:00
Johannes 'josch' Schauer	7126feff41	coverage.sh: increase cover_db.img size to 200M	2019-02-23 08:43:46 +01:00
Johannes 'josch' Schauer	1b8ad8400b	add --logfile option	2019-02-23 08:43:15 +01:00
Johannes 'josch' Schauer	0ced3cc3de	coverage.sh: add tests for --verbose, --debug and --quiet	2019-02-20 17:40:26 +01:00
Johannes 'josch' Schauer	1f967ed163	coverage.sh: don't be brief when diffing against debootstrap results	2019-02-20 17:37:53 +01:00
Johannes 'josch' Schauer	0b058c7db1	add --setup-hook, --essential-hook and rename --customize to --customize-hook	2019-02-20 13:32:49 +01:00
Johannes 'josch' Schauer	d72a582a8b	coverage.sh: work around bug #917773	2019-02-20 00:31:06 +01:00
Johannes 'josch' Schauer	89718d367e	test no-op options and print info message when they are used	2019-02-15 12:42:46 +01:00
Johannes 'josch' Schauer	2eed1262db	coverage.sh: create tarball as root with /tmp mounted nodev	2019-01-26 08:31:40 +01:00
Johannes 'josch' Schauer	316f909a1e	coverage.sh: test target directory with empty lost+found	2019-01-26 08:31:40 +01:00
Johannes 'josch' Schauer	9b3e2bce8d	coverage.sh: when adding foreign architecture, also install foreign package	2019-01-26 08:31:40 +01:00
Johannes 'josch' Schauer	e07b70c361	coverage.sh: perform default mirror test with stable so that we can also check if the security mirror gets added	2019-01-26 08:31:40 +01:00
Johannes 'josch' Schauer	a3afe24fc0	Instead of using gzip compression support, run compressor ourselves ... - otherwise ./dev tar cannot be concatenated with the rest - test compressor early - better document the TARGET option	2019-01-24 12:32:46 +01:00
Johannes 'josch' Schauer	6f8bb8c977	since copy() is using syswrite(), we must flush the filehandle before calling it	2019-01-20 10:46:16 +01:00
Johannes 'josch' Schauer	9453c7e2a9	coverage.sh: add test for --customize	2019-01-13 13:36:42 +01:00
Johannes 'josch' Schauer	1c7e0c86f0	coverage.sh: mmdebstrap now creates /var/lib/dpkg/available	2019-01-13 10:14:25 +01:00
Johannes 'josch' Schauer	80aea48fa7	coverage.sh: testing is now also affected by #917386 and #917407	2019-01-13 10:13:41 +01:00
Johannes 'josch' Schauer	1e0b4cb3b0	now that fakechroot and proot are fixed, add support for for variants beyond essential and apt	2019-01-01 14:28:56 +01:00
Johannes 'josch' Schauer	b113771a81	make_mirror.sh: never leave the cache in an inconsistent state by atomically switching symlinks	2018-12-30 16:37:03 +01:00
Johannes 'josch' Schauer	b6e8c9dbb7	coverage.sh: skip comparison with debootstrap unstable because of #917386 and #917407	2018-12-28 07:26:24 +01:00
Johannes 'josch' Schauer	076d035f65	coverage.sh: check requirement for disk image and debootstrap tarballs before running	2018-12-28 07:19:05 +01:00
Johannes 'josch' Schauer	ef576ab389	use LC_ALL=C.UTF-8 instead of LC_ALL=C	2018-12-27 14:16:23 +01:00
Johannes 'josch' Schauer	97d273aaf6	disable merged usr	2018-12-07 00:17:10 +01:00
Johannes 'josch' Schauer	c8dbe5bd15	coverage.sh: account for differently ordered /etc/shells	2018-12-07 00:13:51 +01:00
Johannes 'josch' Schauer	94862ef03e	coverage.sh: make regex more precise and relax it for version numbers	2018-12-05 12:01:58 +01:00
Johannes 'josch' Schauer	2618a587a0	coverage.sh: allow running without qemu ... On machines without kvm using qemu is not practical. Now, most tests can be run without a container. Also add support for missing unshare, proot and binfmt.	2018-12-05 10:33:03 +01:00
Johannes 'josch' Schauer	6634f4f49f	coverage.sh: fix status line	2018-12-05 08:27:57 +01:00
Johannes 'josch' Schauer	40e25ef653	coverage.sh: only run cover if coverage data exists ... This is useful if ./coverage.sh is run with CMD=./mmdebstrap and thus gathering coverage data is disabled.	2018-11-23 17:28:37 +01:00
Johannes 'josch' Schauer	13358fc039	coverage.sh: conditionally copy mmdebstrap to ./shared ... - only copy if local copy is newer than the copy in ./shared - this enables the autopkgtest to place its own version in ./shared which will then not be overwritten	2018-11-23 17:27:40 +01:00
Johannes 'josch' Schauer	935f5b7a66	Instead of requiring root, use qemu ... - unprivileged creation of rootfs using guestfish - allows full control over network, installed packages - merged test.sh into coverage.sh	2018-11-21 00:21:43 +01:00
Johannes 'josch' Schauer	bcb6b65b72	coverage.sh: add more tests	2018-11-02 17:24:46 +01:00
Johannes 'josch' Schauer	3c411012be	coverage.sh: print script progress	2018-10-24 02:37:45 +02:00
Johannes 'josch' Schauer	f3d227ae5f	add coverage.sh	2018-10-23 18:04:34 +02:00