22:58 <swhbot> icinga PROBLEM: service swh deposit on rp0.internal.staging.swh.network is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 395 bytes in 0.149 second response time
22:58 <swhbot> icinga PROBLEM: host softwareheritage.org is DOWN: PING CRITICAL - Packet loss = 100%
23:55 <swhbot> icinga PROBLEM: service swh webapp revision log end to end on webapp.internal.staging.swh.network is CRITICAL: HTTP CRITICAL: HTTP/1.1 404 Not Found - pattern not found - 10146 bytes in 0.010 second response time
01:10 <swhbot> icinga PROBLEM: service disk /srv/storage/space/mirrors/gitorious.org/mnt on uffizi.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/storage/space/mirrors/gitorious.org/mnt 417495 MB (8% inode=94%);
01:10 <swhbot> icinga PROBLEM: service disk /srv/storage/space/annex/public on uffizi.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/storage/space/annex/public 1127907 MB (6% inode=99%);
03:59 <swhbot> icinga PROBLEM: service disk / on thyssen.internal.softwareheritage.org is WARNING: DISK WARNING - free space: / 13953 MB (19% inode=32%);
04:27 <swhbot> icinga PROBLEM: service disk /srv/softwareheritage/scratch.2 on giverny.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/softwareheritage/scratch.2 66080 MB (1% inode=99%);
04:28 <swhbot> icinga PROBLEM: service disk /srv/softwareheritage/scratch.3 on giverny.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/softwareheritage/scratch.3 167826 MB (8% inode=99%);
05:07 <swhbot> icinga PROBLEM: service disk /srv/storage/space/oversize-objects on uffizi.softwareheritage.org is WARNING: DISK WARNING - free space: /srv/storage/space/oversize-objects 2342531 MB (13% inode=99%);
06:35 <swhbot> icinga PROBLEM: service disk /srv/storage/space/mirrors/boatbucket on uffizi.softwareheritage.org is WARNING: DISK WARNING - free space: /srv/storage/space/mirrors/boatbucket 2235389 MB (20% inode=93%);
07:44 <swhbot> icinga PROBLEM: service disk / on tate.softwareheritage.org is WARNING: DISK WARNING - free space: / 11751 MB (16% inode=88%);
08:47 <swhbot> icinga RECOVERY: service disk /srv/storage/space/mirrors/boatbucket on uffizi.softwareheritage.org is OK: DISK OK - free space: /srv/storage/space/mirrors/boatbucket 2240453 MB (21% inode=93%);
08:56 <swhbot> icinga PROBLEM: service disk /srv/storage/original-artifacts on uffizi.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/storage/original-artifacts 2278334 MB (3% inode=89%);
09:43 <swhbot> icinga PROBLEM: service journalbeat on rp0.internal.staging.swh.network is WARNING: JOURNAL LAG WARNING - monotonic_lag is 1363s (outside range 0:1200)
09:46 <swhbot> icinga PROBLEM: service disk /srv/softwareheritage/objects on uffizi.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/softwareheritage/objects 2370798 MB (0% inode=62%);
10:21 <swhbot> icinga PROBLEM: service journalbeat on rp0.internal.staging.swh.network is CRITICAL: JOURNAL LAG CRITICAL - monotonic_lag is 3643s (outside range 0:3600)
10:28 <swhbot> icinga RECOVERY: service journalbeat on rp0.internal.staging.swh.network is OK: JOURNAL LAG OK - 13.29s behind, 2 entries behind
10:33 <swhbot> icinga PROBLEM: service disk /var/lib/prometheus on pergamon.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /var/lib/prometheus 14009 MB (5% inode=99%);
10:57 <swhbot> icinga PROBLEM: service swh webapp https certificate on rp0.internal.staging.swh.network is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
10:57 <swhbot> icinga PROBLEM: service swh deposit http redirect on rp0.internal.staging.swh.network is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 396 bytes in 0.145 second response time
10:57 <swhbot> icinga PROBLEM: service swh webapp on rp0.internal.staging.swh.network is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
10:58 <swhbot> icinga PROBLEM: service swh webapp http redirect on rp0.internal.staging.swh.network is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
10:58 <swhbot> icinga PROBLEM: service swh deposit on rp0.internal.staging.swh.network is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 396 bytes in 0.347 second response time
10:58 <swhbot> icinga PROBLEM: host softwareheritage.org is DOWN: PING CRITICAL - Packet loss = 100%
11:55 <swhbot> icinga PROBLEM: service swh webapp revision log end to end on webapp.internal.staging.swh.network is CRITICAL: HTTP CRITICAL: HTTP/1.1 404 Not Found - pattern not found - 10138 bytes in 0.035 second response time
13:10 <swhbot> icinga PROBLEM: service disk /srv/storage/space/mirrors/gitorious.org/mnt on uffizi.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/storage/space/mirrors/gitorious.org/mnt 417495 MB (8% inode=94%);
13:10 <swhbot> icinga PROBLEM: service disk /srv/storage/space/annex/public on uffizi.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/storage/space/annex/public 1127907 MB (6% inode=99%);
13:15 <+zack> seirl: JFYI i'm gonna use granet a bit in the next few days (it was idle); let me know if that gets in the way of anything
15:21 <swhbot> icinga PROBLEM: service apt on giverny.softwareheritage.org is CRITICAL: APT CRITICAL: 50 packages available for upgrade (12 critical updates).
15:59 <swhbot> icinga PROBLEM: service disk / on thyssen.internal.softwareheritage.org is WARNING: DISK WARNING - free space: / 13316 MB (18% inode=32%);
16:27 <swhbot> icinga PROBLEM: service disk /srv/softwareheritage/scratch.2 on giverny.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/softwareheritage/scratch.2 66078 MB (1% inode=99%);
16:28 <swhbot> icinga PROBLEM: service disk /srv/softwareheritage/scratch.3 on giverny.softwareheritage.org is CRITICAL: DISK CRITICAL - free space: /srv/softwareheritage/scratch.3 167824 MB (8% inode=99%);
<