From 8bb21e3750a4cd8bdaa37a309804e9b3b3e1713f Mon Sep 17 00:00:00 2001 From: Holger Levsen Date: Mon, 7 Aug 2017 17:23:37 -0400 Subject: finish talk for jenkins bof at dc17 Signed-off-by: Holger Levsen --- .../2017-08-07-DebConf17/images/codethink.png | Bin 0 -> 17192 bytes .../2017-08-07-DebConf17/images/mattia.png | Bin 0 -> 428371 bytes .../presentations/2017-08-07-DebConf17/index.html | 141 ++++++++++++++++----- 3 files changed, 110 insertions(+), 31 deletions(-) create mode 100644 userContent/presentations/2017-08-07-DebConf17/images/codethink.png create mode 100644 userContent/presentations/2017-08-07-DebConf17/images/mattia.png (limited to 'userContent/presentations') diff --git a/userContent/presentations/2017-08-07-DebConf17/images/codethink.png b/userContent/presentations/2017-08-07-DebConf17/images/codethink.png new file mode 100644 index 00000000..7580b43c Binary files /dev/null and b/userContent/presentations/2017-08-07-DebConf17/images/codethink.png differ diff --git a/userContent/presentations/2017-08-07-DebConf17/images/mattia.png b/userContent/presentations/2017-08-07-DebConf17/images/mattia.png new file mode 100644 index 00000000..1e6ca265 Binary files /dev/null and b/userContent/presentations/2017-08-07-DebConf17/images/mattia.png differ diff --git a/userContent/presentations/2017-08-07-DebConf17/index.html b/userContent/presentations/2017-08-07-DebConf17/index.html index fbec5eee..33b47023 100644 --- a/userContent/presentations/2017-08-07-DebConf17/index.html +++ b/userContent/presentations/2017-08-07-DebConf17/index.html @@ -115,9 +115,8 @@ torbrowser-launcher

I do care.

-
    -
  • I really want to maintain this as a team and there is a team already.
    • -
  • But there is 'just' Mattia (who is awesome) who has some overview about the whole setup.
    • +
      +
    • I really want to maintain this as a team and there is a team already. But it's still too much my setup…
    • There is jenkins.debian.org.
    • Let's go there. This is my outline, please hack it and send patches!
    @@ -125,10 +124,20 @@ torbrowser-launcher

    - jenkins.debian.net contributors: + jenkins.debian.net contributor #1 +

    +
      +
    • Mattia Rizzolo, the only other person having an overview about the whole thing. Has access to everything I have.
      • +
    + +
    + +
    +

    + jenkins.debian.net contributors

      -
    • Mattia Rizzolo, Valerie Young and others: reproducible Debian
      • +
    • Valerie Young and others: reproducible Debian
    • Helmut Grohne: rebootstrap
    • Samuel Thibault: hurd + accessibility
    • Steven Chamberlain: kfreebsd
      • @@ -149,6 +158,7 @@ torbrowser-launcher
    +

    Who are you?

      @@ -158,6 +168,16 @@ torbrowser-launcher
    +
    +

    + What is jenkins? +

    +
      +
    • to me: mostly a cron scheduler with a web UI and notifications.
      • +
    +
    + +

    about jenkins.debian.net @@ -179,8 +199,8 @@ torbrowser-launcher
    • 17 machines (16*Debian, 1*FreeBSD, 13*64bit, 4*32bit)
      in 2 datacenters (FKB + FRA)
      • -
    • 168 cores (148 AMD, 20 Intel) with 498/503 GB RAM
      • -
    • 2.9/3.1 TB HDD and 1.9/2 TB SDD storage
      • +
    • 168 cores (144 AMD, 24 Intel) with 498 GB RAM
      • +
    • 3 TB HDD and 2 TB SDD storage
    • no static IP addresses, no idea about traffic (500gb/month?)
    • 2 DCD users: Mattia Rizzolo and me
    @@ -190,16 +210,28 @@ torbrowser-launcher

    Resources used for reproducibility testing on jenkins.debian.net, by architecture & sponsor

    - FIXME: total jenkins numbers
    • 13 amd64 systems, sponsored by Profitbricks
    • 4 i386 systems, sponsored by Profitbricks
      • -
    • 22 armhf systems, sponsored by vagrant@d.o, Debian & other donations
      • +
    • 26 armhf systems, sponsored by vagrant@d.o, Debian & other donations
    • 8 arm64 systems, sponsored by codethink.co.uk
    +
    +

    + about jenkins.debian.net continued… +

    +
      +
    • git clone ssh://git.debian.org/git/qa/jenkins.debian.net.git
      • +
    • INSTALL, README, job-cfg/*, bin/*
      • +
    • code base grown in 5 years by 40 people…
      • +
    • ansible, builds with sbuild or jenkins-debian-glue, namespaces, you name it, please send patches
      • +
    • views so far were configured manually, but it's now possible with jenkins-job-builder too - please send patches!
      • +
    +
    +

    @@ -207,13 +239,13 @@ torbrowser-launcher

    • - IRC / mail notifications, #debian-qa IRC channel and 11 other channels, more mailinglists + IRC / mail / web notifications, #debian-qa IRC channel and 11 other channels, more mailinglists
    • Early notifications of problems - though bugs still need to be filed manually
    • - Countless bug reports, ie 2670 done ftbfs via reproducible… (and 500 open…) + Countless bug reports, ie 2670 done ftbfs via reproducible…
    @@ -232,17 +264,27 @@ torbrowser-launcher
+
+

+ misc debian-qa related jobs: +

+
  • orphaned packages without bug
    • +
  • dpkg trigger cycles
    • +
  • debhelper, debsums, lintian and piuparts are build on git commits in jessie, stretch and unstable
    • +
  • multiarch versionskew
    • + +

    chroot-installation tests

      -
    • 338 jobs basically running apt install $metapackages
      - (gnome, kde, cinnamon, lxde, xfce, qt4, qt5, haskell, developer, debconf-video, debian-edu)
      • +
    • 453 jobs basically running apt install $metapackages
      + (gnome, kde, cinnamon, lxde, xfce, qt4, qt5, haskell, developer, debconf-video, debian-edu, debian-parl, debian-design)
    • new installations and upgrades tested in
      - wheezy (98), jessie (147), stretch (153), sid (98)
      • -
    • wheezy monthly, jessie weekly, stretch every other day, sid daily
      • + jessie (85), stretch (226), buster (182), sid (184) +
    • jessie monthly, stretch weekly, buster every other day, sid daily
    @@ -264,6 +306,19 @@ torbrowser-launcher   +
    +

    + lvc = libvirt cucumber +

    +
      +
    • lvc tests are work in progress by Phil Hands
      • +
    • taken from Tails
      • +
    • now I've heard Tails wants to push us using those to improve the quality of Debian to improve the quality of Tails
      • +
    • not there yet, but they've started to get useful
      • +
    • should fully replace g-i-installation.sh at the end of the year?
      • +
    +
    +

    more debian-installer related jobs: @@ -304,44 +359,68 @@ torbrowser-launcher

    + +

    - more debian-qa related jobs: + reproducible.debian.net / tests.reproducible-builds.org/debian/

    -
  • orphaned packages without bug
    • -
  • dpkg trigger cycles
    • -
  • debhelper, debsums, lintian and piuparts are build on git commits in jessie, stretch and unstable
    • -
  • multiarch versionskew
    • -
  • - reproducible-builds.org - "btw": over 2600 'FTBFS' bugs found and fixed so far, ~400 open… -
    • +
      +
    • created by 483 jobs on jenkins.debian.net
      • +
    • we had 151 more jobs but those now run via a systemd service written in shell…/
      • +
    • it's not only about Debian anymore…
      • +
    • though let's rather talk about jenkins.debian.org now…
      • +
    +
    + +
    +

    + So, about the to migration jenkins.debian.org +

    +
      +
    • jerea.debian.org is ready and jenkins.debian.org is a CNAME pointing to it - thanks to DSA!
      • +
    • next: create another small script, to deploy (and only deploy) job-cfg/self.yaml
      • +
    • then: move on to the next yaml file, eg. piuparts.yaml or whatever. Then: rinse, repeat, until all are moved
      • +
    • jenkins.debian.net will become profitbricks-build0 and keep running the actual jobs (and the reproducible webpages) for now…
    +
    +

    + Ways to contribute +

    +
      +
    • please file bugs about all the issues jenkins finds
      • +
    • please file bugs about all the noise jenkins is doing
      • +
    • please send patches
      • +
    • we have ressources "for anything": write a useful test - and maintain it - and we will happily run it - and don't worry, noone has a test setup except Phil ;-)
      • +
    +

    - reproducible.debian.net / tests.reproducible-builds.org/debian/ + Contact us

      -
    • created by 357 jobs on jenkins.debian.net
      • -
    • it's not only about Debian anymore…
      • -
    • though let's rather talk about jenkins.debian.org now…
      • +
    • IRC: #debian-qa on irc.oftc.net
      • +
    • Bugs: bugs.debian.org/jenkins.debian.org
      • +
    • Lists: jenkins-dev@lists.alioth.debian.org
    - +

    Thanks:

    + +    
    - -

    + +
    - FIXME: codethink logo

    -- cgit v1.2.3-70-g09d2