DonKult/mmdebstrap
1
0
Fork 0
forked from josch/mmdebstrap
Code Issues Pull requests Projects Releases Wiki Activity
977 commits 2 branches 22 tags 10 MiB
Commit graph

245 commits

Author SHA1 Message Date
Johannes Schauer Marin Rodrigues
6b49a2dbbf
coverage.sh: pass any cli args on to coverage.py 2023-03-13 13:20:05 +01:00
Johannes Schauer Marin Rodrigues
5885291213
Use an caching apt proxy instead of copying /var/cache/apt/archives/*.deb 
- only download Release files once and not by apt as well as with curl
   and thus avoid a mirror push happening between both downloads
 - no heuristic needed to place the file in their correct mirror
   location
 - no manual checksum checking
 - only throttle download speed when actually downloading and not when
   retrieving files from the cache
 - no translation of filenames between how the epoch colon is stored in
   files in /var/cache/apt/archives versus how it is stored in files on
   the mirrors
 - no special handling of stable update and security mirrors
 - implemented in Python instead of shell and thus an order of magnitude
   faster
 2023-03-03 08:34:39 +01:00
Johannes Schauer Marin Rodrigues
80f8978ecc
coverage.sh: do not fail if files to be cleaned do not exist 2023-02-18 23:17:12 +01:00
Johannes Schauer Marin Rodrigues
5e07567d5a
move running debootstrap from make_mirror.sh to a test case 2023-02-12 14:05:09 +01:00
Johannes Schauer Marin Rodrigues
b18849caac
Assume that we can always run unshare 
With mount --rbind we can bind-mount /proc in a privileged docker
container as it is used by salsaci.
 2023-02-12 14:05:08 +01:00
Johannes Schauer Marin Rodrigues
b39713def5
remove last traces of proot 2022-12-23 10:06:27 +01:00
Johannes Schauer Marin Rodrigues
d442f436de
shellcheck everything 2022-11-16 13:59:38 +01:00
Johannes Schauer Marin Rodrigues
892e568496
coverage.sh: split up linting conditional 2022-09-05 06:21:17 +02:00
Johannes Schauer Marin Rodrigues
b85df6b8f2
coverage.sh: idshift 2022-09-05 06:21:17 +02:00
Johannes Schauer Marin Rodrigues
c1c6297db7
move copying files into shared directory from coverage.sh to coverage.py 2022-05-29 09:28:34 +02:00
Johannes Schauer Marin Rodrigues
4c3fddcd54
rewrite coverage.sh 
- multiple individual shell scripts instead of one 3.5k line monster
 - tests driven by Python script allowing:
    * declarative test description in coverage.txt
    * collecting errors instead of aborting on first error
    * skipping tests
    * running specific tests
 2022-05-28 17:49:05 +02:00
Johannes Schauer Marin Rodrigues
b99f1d53d5
add file-mirror-automount hook-dir 2022-05-26 07:36:21 +02:00
David Kalnischkies
cc3150ef04
Rework download stage to allow file:// mirrors 
- factor out package downloading function
 - replace -oApt::Get::Download-Only=true by -oDebug::pkgDpkgPm=1
 - remove guessing of package names in /var/cache/apt/archives/
 - drop edsp parsing with proxysolver/mmdebstrap-dump-solution to obtain
   downloaded filenames in favour of -oDpkg::Pre-Install-Pkgs::=cat
 - /var/cache/apt/archives/ is now allowed to contain packages
 - drop --skip=download/empty
 - file:// mirrors are now supported if their path is available inside
   the chroot
 2022-05-26 07:36:21 +02:00
Johannes Schauer Marin Rodrigues
c8835a6149
coverage.sh: make sure archives we copied into /var/cache/apt/archives are not deleted 2022-05-24 04:16:11 +02:00
Johannes Schauer Marin Rodrigues
2c155f7cc9
coverage.sh: only skip foreign arch if RUN_MA_SAME_TESTS==no and mode==fakechroot 2022-05-22 02:54:01 +02:00
Johannes Schauer Marin Rodrigues
d7b39b6c97
coverage.sh: enable building variant=standard 2022-05-22 02:53:17 +02:00
Johannes Schauer Marin Rodrigues
6ec09c27ca
coverage.sh: mount tmpfs as workaround for #1010957 2022-05-22 02:51:58 +02:00
Johannes Schauer Marin Rodrigues
70b081d299
allow running root mode inside unshare mode 2022-03-25 14:25:54 +01:00
Johannes Schauer Marin Rodrigues
4ce5a92123
coverage.sh: now that the _apt user is created as a system user by adduser, we also need to change /etc/shadow 2022-03-07 23:41:12 +01:00
Johannes Schauer Marin Rodrigues
3a9ba24d12
coverage.sh: output diff to stderr prevent interleaving with sh -x output 2022-03-07 11:30:45 +01:00
Johannes Schauer Marin Rodrigues
3962f36441
coverage.sh: since fontconfig was fixed, document the remaining reproducibility issues 2022-02-11 22:58:37 +01:00
Johannes Schauer Marin Rodrigues
88b9eaaad9
passwd since 1:4.11.1+dfsg1-1 creates an empty /var/mail/_apt 2022-02-11 22:57:59 +01:00
Johannes Schauer Marin Rodrigues
79ae6f03fd
coverage.sh: add test checking that ASCII armored keyrings work 2022-01-07 23:15:07 +01:00
Johannes Schauer Marin Rodrigues
88619e4d9c
test codename apt pattern as well, requires apt >= 2.3.14 
closes: #21
 2022-01-07 12:46:42 +01:00
Johannes Schauer Marin Rodrigues
3b2a681cc6
coverage.sh: support for s390x 2021-11-09 07:28:59 +01:00
Johannes Schauer Marin Rodrigues
4da43ec72e
coverage.sh: remove redundant tests 2021-11-09 07:27:10 +01:00
Johannes Schauer Marin Rodrigues
4f278deadf
use rm and find instead of remove_tree() 
* remove_tree() requires the CWD to be accessible or fails with
   cannot chdir to $CWD from $DIR_TO_DELETE: Permission denied, aborting.
 * CWD is not always accessible -- example: run mmdebstrap from a
   directory only accessible by the current user (like a tempdir) in
   unshare mode
 * find from findutils *also* requires CWD to be accessible but it's
   easier to temporarily change CWD in a subprocess because using
   there is no utility in perl core that changes CWD temporarily and
   cleans up after itself
 * we need to use find from findutils instead of rm in unshare mode
   because the root directory itself might not be removable by the
   unshared user so we only want to remove its subdirectories
 2021-10-07 07:07:45 +02:00
Johannes Schauer Marin Rodrigues
12ec2c50aa
also create cmethopt and available in chrootless mode 
- this allows bit-by-bit identical output of chrootless mode compared
   to other modes
 2021-09-22 15:22:35 +02:00
Johannes Schauer Marin Rodrigues
03ebda088f
coverage.sh: use MMDEBSTRAP_APT_CONFIG to prevent apt options (like foreign archs) leaking into the apt calls 2021-09-22 09:04:27 +02:00
Johannes Schauer Marin Rodrigues
450881f4ce
coverage.sh: setup00-merged-usr.sh moved into a subdirectory 2021-09-21 23:01:58 +02:00
Johannes Schauer Marin Rodrigues
28707c79d2
coverage.sh: disable chrootless test broken by #983425 2021-09-21 14:20:31 +02:00
Johannes Schauer Marin Rodrigues
7ff7609a4c
coverage.sh: add fakechroot to test name 2021-09-21 14:19:31 +02:00
Johannes Schauer Marin Rodrigues
f5f6343622
coverage.sh: remove redundant tests 2021-09-21 14:15:31 +02:00
Johannes Schauer Marin Rodrigues
6d59d51a4a
add ldconfig.fakechroot and translate symlinks for bit-by-bit identical buildd variant 2021-09-16 16:23:46 +02:00
Johannes Schauer Marin Rodrigues
6a8fbae9d8
make fakechroot mode bit-by-bit identical to the others 2021-08-29 10:25:34 +02:00
Johannes Schauer Marin Rodrigues
5a5f57b404
Automatically skip using mount if that's not possible 
- instead of throwing an error, just print a warning
 - can now run as root without cap_sys_admin
 - can now run without mount installed
 - --skip=check/canmount is not needed anymore
 2021-08-26 15:40:27 +02:00
Johannes Schauer Marin Rodrigues
e53d246a3b
also test minbase buildd important standard with --dry-run/--simulate 2021-08-26 08:34:30 +02:00
Joe Groocock
15029c1c3b
improve error message for missing /etc/subuid entry (closes: #9) 2021-08-19 11:18:53 +02:00
Johannes Schauer Marin Rodrigues
dfbf9cdcef
several fixes to chrootless mode 2021-08-17 23:39:20 +02:00
Johannes Schauer Marin Rodrigues
aae47da9ab
coverage.sh: fix test that was wrongly installing outside the chroot and download-only 2021-08-16 23:14:18 +02:00
Johannes Schauer Marin Rodrigues
3e488dd1dd
use apt from the outside by setting DPkg::Chroot-Directory 2021-08-16 22:33:39 +02:00
Johannes Schauer Marin Rodrigues
c63ad87310
changes for release of Debian 11 Buster 2021-08-16 13:11:42 +02:00
Johannes Schauer Marin Rodrigues
4cd69d444a
coverage.sh: let cover output to stderr to prevent wrong message output order 2021-03-08 19:33:24 +01:00
Johannes Schauer Marin Rodrigues
4cd547286c
coverage.sh: sysvinit-utils also works with chrootless 2021-03-08 19:32:53 +01:00
Johannes Schauer Marin Rodrigues
65070e23da
coverage.sh: add more docs for chrootless essential test 2021-03-08 19:32:19 +01:00
Johannes Schauer Marin Rodrigues
5a3d1ab5c4
Rework /dev, /sys, /proc mounting 
- assume all entries in @devfiles to be in /dev
 - allow for /dev, /sys and /proc not to exist in the target and print warning
 - allow for /dev entries as well as /sys and /proc not to exist on the outside
 - simplify umount by storing special options in @umountopts
 - remove superfluous checks for root and unshare mode
 - make sure /dev entries are less than 100 chars in size for tar
 2021-03-08 08:04:35 +01:00
Johannes Schauer Marin Rodrigues
5fd1ca62d9
coverage.sh: don't attempt deleting non-existant directory 2021-02-19 14:40:20 +01:00
Johannes Schauer Marin Rodrigues
067daaf4c2
also run unshare with --propagation unchanged in root mode 2021-02-19 12:53:14 +01:00
Johannes Schauer Marin Rodrigues
276363c2a1
coverage.sh: remove chroot directories 2021-02-06 14:46:37 +01:00
Johannes Schauer Marin Rodrigues
0009e62b3e
coverage.sh: do not run cap_sys_admin test under lxc 2021-02-06 14:46:37 +01:00