let's maintain jenkins.debian.org as a team
Holger Levsen <holger@debian.org>
DebConf17, 2017-08-07, Montreal, Canada
about me
- Debian user since 1995, contributing since 2001
- Debian-Edu (Debian for Education), since 2003
- DebConf organizer, founded the DebConf video team in 2005
- Debian developer since 2007,
holger@debian.og
- Freelancer since 2004
more about Debian QA and me
https://piuparts.debian.org
since 2009 - today juggling with 648988 logs from 53158 packages in 28 suites with Andreas Beckmann
https://jenkins.debian.net
since 2012
https://reproducible.debian.net
since 2014
- since 2015 funded by the Linux Foundation for working on
https://reproducible-builds.org
other Debian QA efforts elsewhere
lintian.debian.org
ci.debian.net
- periodic full archive rebuilds (amd64 only)
about jenkins.debian.net
- resources sponsored by Profitbricks since 2012
- first request on August 2nd 2012: 2-4 cores, 2GB RAM, 1 TB storage
Profitbricks resources used by jenkins.debian.net
- 17 machines (16*Debian, 1*FreeBSD, 13*64bit, 4*32bit)
in 2 datacenters (FKB + FRA)
- 168 cores (148 AMD, 20 Intel) with 498/503 GB RAM
- 2.9/3.1 TB HDD and 1.9/2 TB SDD storage
- no static IP addresses, no idea about traffic (500gb/month?)
- 2 DCD users: Mattia Rizzolo and me
jenkins.debian.net contributors:
- Mattia Rizzolo, Valerie Young and others: reproducible Debian
- Helmut Grohne: rebootstrap
- Samuel Thibault: hurd + accessibility
- Steven Chamberlain: kfreebsd
- Phil Hands: lvc
- Tomasz Nitecki: jenkins java support
- 36 contributors to
jenkins.debian.net.git
in total, also committers from Arch Linux, openSUSE, LEDE, coreboot, Guix, FreeBSD and NetBSD
Benefits for debian
-
IRC / mail notifications, #debian-qa IRC channel and 11 other channels, more mailinglists
-
Early notifications of problems - though bugs still need to be filed manually
-
Countless bug reports, ie 2670 done ftbfs via reproducible… (and 500 open…)
-
jenkins.debian.net
will become an offical service, jenkins.debian.org
chroot-installation tests
- 338 jobs basically running
apt install $metapackages
(gnome, kde, cinnamon, lxde, xfce, qt4, qt5, haskell, developer, debconf-video, debian-edu)
- new installations and upgrades tested in
wheezy (98), jessie (147), stretch (153), sid (98)
- wheezy monthly, jessie weekly, stretch every other day, sid daily
g-i-installation tests
- tests Debian Installer (d-i) in graphical mode ("g-i") and text mode
- creates videos and screenshots
- plain Debian (installations and rescue mode) and Debian Edu
- jessie, stretch and sid
- linux, kfreebsd and hurd
- finally almost deprecated today, will be replaced by lvc tests (libvirt-cucumber) maintained by Phil Hands
more debian-installer related jobs:
- 97 packages (building udebs) triggered by commits to their git master branches
- manual in 24 languages, also git triggered
- lvc and d-i from proposed branches planned
37 debian-edu jobs:
-
28 g-i tests for jessie and stretch
-
8 debian-edu packages build triggerd by commits on their git master branches
-
very useful for debian-edu-doc which is published for 7 languages in HTML, PDF & EPUB format.
rebootstrap:
- Cross bootstrap Debian from scratch…
- alpha arm64 arm64ilp32 armel armhf hppa hurd-amd64 hurd-i386 i386 kfreebsd-amd64 kfreebsd-armhf kfreebsd-i386 m68k mips mips64el mips64r6el mipsel mipsr6el musl-linux-arm64 musl-linux-armhf musl-linux-i386 musl-linux-mips musl-linux-mipsel nios2 powerpc powerpcel powerpcspe ppc64 ppc64el s390x sh4 sparc sparc64 tilegx x32
- Helmut Grohne files lots of cross-building and bootstrapping bugs.
more debian-qa related jobs:
orphaned packages without bug
dpkg trigger cycles
debhelper, debsums, lintian and piuparts are build on git commits in jessie, stretch and unstable
multiarch versionskew
reproducible-builds.org - "btw": over 2600 'FTBFS' bugs found and fixed so far, ~400 open…
reproducible.debian.net / tests.reproducible-builds.org/debian/
- created by 357 jobs on jenkins.debian.net
- it's not only about Debian anymore…
Resources used for reproducibility testing on jenkins.debian.net, by architecture & sponsor
FIXME: total jenkins numbers
- 13 amd64 systems, sponsored by Profitbricks
- 4 i386 systems, sponsored by Profitbricks
- 22 armhf systems, sponsored by vagrant@d.o, Debian & other donations
- 8 arm64 systems, sponsored by codethink.co.uk