Source: balboa
Version: 2.0.0+ds-4
Severity: serious
Hi Sascha,
Where previously the autopkgtests for balboa would complete in seconds (<1
min), after the most recent no-change rebuild against new rocksdb they hang
indefinitely and eventually fail with a timeout.
Looking at the systemd journal output shows some segfaults, which might be
related!
Unfortunately, Debian does not run autopkgtests for binNMUs of packages and
does not gate promotion of binNMUs to testing on autopkgtest results, so
this regression is not reflected on
https://ci.debian.net/packages/b/balboa/. I noticed it because Ubuntu does
run autopkgtests for no-change rebuilds of packages
(https://autopkgtest.ubuntu.com/packages/b/balboa/kinetic/amd64), and I have
reproduced the failure in a Debian sid container:
[...]
root@balboa:~/balboa-2.0.0+ds# timeout 60 sh ./debian/tests/test-run
Jun 10 17:13:04 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:04 balboa balboa-rocksdb[1609]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:04 balboa systemd[1]: balboa-backend@rocksdb.service: Main process exited, code=dumped, status=11/SEGV
Jun 10 17:13:04 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with result 'core-dump'.
Jun 10 17:13:09 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled restart job, restart counter is at 1.
Jun 10 17:13:09 balboa systemd[1]: Stopped Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:09 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:09 balboa balboa-rocksdb[1625]: (blb_rocksdb_open) rocksdb_open() Jun 10 17:13:09 balboa balboa-rocksdb[1625]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:09 balboa systemd[1]: balboa-backend@rocksdb.service: Main process exited, code=dumped, status=11/SEGV
Jun 10 17:13:09 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with result 'core-dump'.
Jun 10 17:13:14 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled restart job, restart counter is at 2.
Jun 10 17:13:14 balboa systemd[1]: Stopped Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:14 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:14 balboa balboa-rocksdb[1637]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:14 balboa systemd[1]: balboa-backend@rocksdb.service: Main process exited, code=dumped, status=11/SEGV
Jun 10 17:13:14 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with result 'core-dump'.
Jun 10 17:13:19 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled restart job, restart counter is at 3.
Jun 10 17:13:19 balboa systemd[1]: Stopped Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:20 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:20 balboa balboa-rocksdb[1652]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:20 balboa systemd[1]: balboa-backend@rocksdb.service: Main process exited, code=dumped, status=11/SEGV
Jun 10 17:13:20 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with result 'core-dump'.
Jun 10 17:13:25 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled restart job, restart counter is at 4.
Jun 10 17:13:25 balboa systemd[1]: Stopped Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:25 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:25 balboa balboa-rocksdb[4004]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:25 balboa systemd[1]: balboa-backend@rocksdb.service: Main process exited, code=dumped, status=11/SEGV
Jun 10 17:13:25 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with result 'core-dump'.
Jun 10 17:13:30 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled restart job, restart counter is at 5.
Jun 10 17:13:30 balboa systemd[1]: Stopped Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:30 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:30 balboa balboa-rocksdb[4014]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:30 balboa systemd[1]: balboa-backend@rocksdb.service: Main process exited, code=dumped, status=11/SEGV
Jun 10 17:13:30 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with result 'core-dump'.
Jun 10 17:13:35 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled restart job, restart counter is at 6.
Jun 10 17:13:35 balboa systemd[1]: Stopped Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:35 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:35 balboa balboa-rocksdb[4061]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:35 balboa systemd[1]: balboa-backend@rocksdb.service: Main process exited, code=dumped, status=11/SEGV
Jun 10 17:13:35 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with result 'core-dump'.
Jun 10 17:13:40 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled restart job, restart counter is at 7.
Jun 10 17:13:40 balboa systemd[1]: Stopped Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:41 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:41 balboa balboa-rocksdb[4077]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
● balboa-backend@rocksdb.service - Basic Little Book of Answers, 'rocksdb' Backend
Loaded: loaded (/lib/systemd/system/balboa-backend@.service; enabled; vendor preset: enabled)
Drop-In: /run/systemd/system/service.d
└─zzz-lxc-service.conf
Active: active (running) since Fri 2022-06-10 17:13:41 UTC; 30ms ago
Docs: https://github.com/DCSO/balboa
Main PID: 4077 (balboa-rocksdb)
Tasks: 10 (limit: 37953)
Memory: 1.3M
CPU: 20ms
CGroup: /system.slice/system-balboa\x2dbackend.slice/balboa-backend@rocksdb.service
└─4077 /usr/bin/balboa-rocksdb
Jun 10 17:13:41 balboa systemd[1]: Started Basic Little Book of Answers, 'rocksdb' Backend.
Jun 10 17:13:41 balboa balboa-rocksdb[4077]: (blb_rocksdb_open) rocksdb_open() failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:03 balboa systemd[1]: Started Basic Little Book of Answers.
Jun 10 17:13:03 balboa balboa[1552]: time="2022-06-10T17:13:03Z" level=info msg="switching to log file /var/log/balboa.log"
● balboa.service - Basic Little Book of Answers
Loaded: loaded (/lib/systemd/system/balboa.service; enabled; vendor preset: enabled)
Drop-In: /run/systemd/system/service.d
└─zzz-lxc-service.conf
Active: active (running) since Fri 2022-06-10 17:13:03 UTC; 37s ago
Docs: https://github.com/DCSO/balboa
Main PID: 1552 (balboa)
Tasks: 17 (limit: 37953)
Memory: 33.5M
CPU: 303ms
CGroup: /system.slice/balboa.service
└─1552 /usr/bin/balboa serve -f /etc/balboa/feeders.yaml -l /var/log/balboa.log
Jun 10 17:13:03 balboa systemd[1]: Started Basic Little Book of Answers.
Jun 10 17:13:03 balboa balboa[1552]: time="2022-06-10T17:13:03Z" level=info msg="switching to log file /var/log/balboa.log"
{"level":"info","msg":"starting feeder HTTP Input","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"accepting submissions on port 8081","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"starting feeder Socket Input","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"starting feeder Suricata Socket Input","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:03Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"serving GraphQL on port 8080","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:13Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:13Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:13Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:23Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:23Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:23Z"}
{"level":"info","msg":"got 1562529 bytes via HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:33Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:33Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:33Z"}
Terminated
[...]
This definitely looks to me like it warrants further investigation before
promoting new rocksdb (and balboa) to testing.
Cheers,