let's maintain jenkins.debian.org as a team


Holger Levsen <holger@debian.org>

DebConf17, 2017-08-07, Montreal, Canada

about me

  • Debian user since 1995, contributing since 2001
  • Debian-Edu (Debian for Education), since 2003
  • DebConf organizer, founded the DebConf video team in 2005
  • Debian developer since 2007, holger@debian.og
  • Freelancer since 2004

more about Debian QA and me

  • https://piuparts.debian.org since 2009 - today juggling with 648988 logs from 53158 packages in 28 suites with Andreas Beckmann
  • https://jenkins.debian.net since 2012
  • https://reproducible.debian.net since 2014
  • since 2015 funded by the Linux Foundation for working on https://reproducible-builds.org

other Debian QA efforts elsewhere

  • lintian.debian.org
  • ci.debian.net
  • periodic full archive rebuilds (amd64 only)

about jenkins.debian.net

  • resources sponsored by Profitbricks since 2012
  • first request on August 2nd 2012: 2-4 cores, 2GB RAM, 1 TB storage
 

Profitbricks resources used by jenkins.debian.net

  • 17 machines (16*Debian, 1*FreeBSD, 13*64bit, 4*32bit)
    in 2 datacenters (FKB + FRA)
  • 168 cores (148 AMD, 20 Intel) with 498/503 GB RAM
  • 2.9/3.1 TB HDD and 1.9/2 TB SDD storage
  • no static IP addresses, no idea about traffic (500gb/month?)
  • 2 DCD users: Mattia Rizzolo and me

jenkins.debian.net contributors:

  • Mattia Rizzolo, Valerie Young and others: reproducible Debian
  • Helmut Grohne: rebootstrap
  • Samuel Thibault: hurd + accessibility
  • Steven Chamberlain: kfreebsd
  • Phil Hands: lvc
  • Tomasz Nitecki: jenkins java support
  • 36 contributors to jenkins.debian.net.git in total, also committers from Arch Linux, openSUSE, LEDE, coreboot, Guix, FreeBSD and NetBSD

Benefits for debian

  • IRC / mail notifications, #debian-qa IRC channel and 11 other channels, more mailinglists
  • Early notifications of problems - though bugs still need to be filed manually
  • Countless bug reports, ie 2670 done ftbfs via reproducible… (and 500 open…)
  • jenkins.debian.net will become an offical service, jenkins.debian.org

chroot-installation tests

  • 338 jobs basically running apt install $metapackages
    (gnome, kde, cinnamon, lxde, xfce, qt4, qt5, haskell, developer, debconf-video, debian-edu)
  • new installations and upgrades tested in
    wheezy (98), jessie (147), stretch (153), sid (98)
  • wheezy monthly, jessie weekly, stretch every other day, sid daily

g-i-installation tests

  • tests Debian Installer (d-i) in graphical mode ("g-i") and text mode
  • creates videos and screenshots
  • plain Debian (installations and rescue mode) and Debian Edu
  • jessie, stretch and sid
  • linux, kfreebsd and hurd
  • finally almost deprecated today, will be replaced by lvc tests (libvirt-cucumber) maintained by Phil Hands
 

more debian-installer related jobs:

  • 97 packages (building udebs) triggered by commits to their git master branches
  • manual in 24 languages, also git triggered
  • lvc and d-i from proposed branches planned

37 debian-edu jobs:

  • 28 g-i tests for jessie and stretch
  • 8 debian-edu packages build triggerd by commits on their git master branches
  • very useful for debian-edu-doc which is published for 7 languages in HTML, PDF & EPUB format.

rebootstrap:

  • Cross bootstrap Debian from scratch…
  • alpha arm64 arm64ilp32 armel armhf hppa hurd-amd64 hurd-i386 i386 kfreebsd-amd64 kfreebsd-armhf kfreebsd-i386 m68k mips mips64el mips64r6el mipsel mipsr6el musl-linux-arm64 musl-linux-armhf musl-linux-i386 musl-linux-mips musl-linux-mipsel nios2 powerpc powerpcel powerpcspe ppc64 ppc64el s390x sh4 sparc sparc64 tilegx x32
  • Helmut Grohne files lots of cross-building and bootstrapping bugs.

more debian-qa related jobs:

  • orphaned packages without bug
  • dpkg trigger cycles
  • debhelper, debsums, lintian and piuparts are build on git commits in jessie, stretch and unstable
  • multiarch versionskew
  • reproducible-builds.org - "btw": over 2600 'FTBFS' bugs found and fixed so far, ~400 open…

    • reproducible.debian.net / tests.reproducible-builds.org/debian/

    • created by 357 jobs on jenkins.debian.net
    • it's not only about Debian anymore…

    Resources used for reproducibility testing on jenkins.debian.net, by architecture & sponsor

    FIXME: total jenkins numbers
    • 13 amd64 systems, sponsored by Profitbricks
    • 4 i386 systems, sponsored by Profitbricks
    • 22 armhf systems, sponsored by vagrant@d.o, Debian & other donations
    • 8 arm64 systems, sponsored by codethink.co.uk

    Thanks:




    FIXME: codethink logo

    Questions?



    holger@debian.org B8BF 5413 7B09 D35C F026
    FE9D 091A B856 069A AA1C

    https://jenkins.debian.net
    git.debian.org/git/qa/jenkins.debian.net.git





    …and many thanks to Chris Lamb for the nice slide design!