42 Commits

Author SHA1 Message Date
Rainer Gerhards
4a0c28a10d
testbench modernization
Bump dependency versions, use newer distro versions for some tests.
Make kafka distcheck separate to help diagnose flaky kafka tests.
2021-01-18 08:58:07 +01:00
Rainer Gerhards
06946825ee
CI: use github actions for compile checks 2020-08-11 14:24:30 +02:00
Rainer Gerhards
33330e0742
CI: add github actions 2020-07-10 19:19:58 +02:00
Rainer Gerhards
92f22fecb8
bump default dev container to Ubuntu 20.04 2020-05-18 09:13:45 +02:00
Rainer Gerhards
7c2eaa8f2e
build system: change --enable-imfile-tests default to "yes"
This was accidentally set to "no". Test for imfile should by
default run when imfile is enabled.

We also temporarily disable the failing tests - this makes
it posible to run the remaining tests during CI and prevent
future errors. That is better than nothing. Tests are to be
re-enabled when the imfile bug mentioned below is fixed.

see also https://github.com/rsyslog/rsyslog/issues/4120

Signed-off-by: Rainer Gerhards <rgerhards@adiscon.com>
2020-01-30 09:36:35 +01:00
Rainer Gerhards
1ee866ddc0
dev tooling: gather log files only for actual test logs
the current tooling also picked up non-test logs
2020-01-28 15:22:57 +01:00
Rainer Gerhards
7cb5ecf337
Merge pull request #4152 from rgerhards/tb-show-lost-logs
devel tools: show stalled tests from "make check"
2020-01-26 13:09:51 +01:00
Rainer Gerhards
ac3b786d13
devtools: limit output codecov can generate
It looks like in some cases the codecov script generates execessive
output, which then causes buildbot to abort. This patch limits it
to a maximum of 3000 lines.
2020-01-26 10:42:14 +01:00
Rainer Gerhards
6be13dc092
devel tools: show stalled tests from "make check"
CI systems cancel out runs that are stalled. Unfortunately, it is very
hard to find the test that caused the stall. This commit extends the
toolset to detect logs without a matching .trs file, which is a strong
indication of an aborted test.

This alos modernizes some tests in order to remove sample *.log files
which would otherwise always clutter log output.
2020-01-24 18:45:12 +01:00
Rainer Gerhards
5b05b98816
testbench: add script for improved "failed test" log output
The main intent is to show only failed tests (not SKIPed ones)
to make it easier to interpret test failures.

This also limits the max output size of tests. This is especially
important because of a bug in buildbot that leads to DoS when
very large test logs are sent back to the build master (which
then aborts).

see also https://github.com/buildbot/buildbot/issues/4504
2020-01-24 10:40:32 +01:00
Rainer Gerhards
58dfe006a8
testbench: improve tests
modernize them, reduce robustness against slow machines, provide some
test framework functional enhancements and optimizie some tests
2020-01-19 16:09:44 +01:00
Rainer Gerhards
586158ea42
tooling: pass additional environment vars to dev container 2020-01-14 09:15:18 +01:00
Rainer Gerhards
73dc7fe13d
CI: emit failed test info to file failed-tests.log
this makes reviewing failures easier, especially if there are many SKIPped
tests involved
2020-01-13 09:49:43 +01:00
Rainer Gerhards
0845ff8e02
CI: add script to do a full CI run
The core ID is to use this script together with pretty generic
buildbot workers. This provides a simple way to load-balance
across the worker pool.
2020-01-11 12:10:48 +01:00
Rainer Gerhards
e7541dcd0f
new default development container and update Travis to new compilers 2019-12-20 16:13:28 +01:00
Rainer Gerhards
0307a0cc0a
testbench: improve mysql test framework plumbing
This is an initial try to make mysql tests able to run in parallel,
which also hardens them against some timing problems.
2019-11-26 10:56:33 +01:00
Rainer Gerhards
5aad8b19fe
testbench: fix issues with parallel test run
some serialization rules did not work correctly

Note: parallel testing is still experimental and not fully
supported.
2018-12-21 15:37:07 +01:00
Rainer Gerhards
ebc6a56250
Merge pull request #3336 from PascalWithopf/omclickhouse
new output module for DBMS Clickhouse
2018-12-20 15:11:00 +01:00
PascalWithopf
687f5c1ee1 new output module for clickhouse
This output module adds the posibility to send
INSERT querys to a Clickhouse database.
The messages are sent via a REST interface.

This commit also adds support of the testbench
for clickhouse tests, as well as  various tests.

Closes https://github.com/rsyslog/rsyslog/issues/2272
2018-12-20 10:49:45 +01:00
Rainer Gerhards
0494037aa2
some nitfixes and sligth testbench modernization 2018-12-18 18:12:29 +01:00
Jan Gerhards
795540dfbf cleanup legacy shell code
detected by codacy
2018-11-10 19:26:34 +01:00
Rainer Gerhards
72ee7a201a some cleanup 2018-10-24 19:20:43 +02:00
Pascal Withopf
b20dbd52bd codestyle: give error message when codestyle is incorrect (#2933)
The codestyle script will now put out an error message
when the codestyle is incorrect, explaining what went wrong
and providing a link to the documentation.
2018-08-15 18:53:39 +02:00
PascalWithopf
866336d997 activate codestyle for all files ending with .c/.h
Last changes to the codestyle and activation of
the codestyle checker.
2018-08-03 09:32:07 +02:00
PascalWithopf
c83e3ed216 correct codestyle in rsyslog part 2 2018-08-01 16:11:33 +02:00
PascalWithopf
19133327cc correct codestyle in rsyslog 2018-07-31 09:44:27 +02:00
Rainer Gerhards
5c7d6b9540 development tooling: do not hardcode clang to use for static analyzer run 2018-07-26 12:54:55 +02:00
Rainer Gerhards
d850865314 make devcontainer tool more developer friendly
slight improvement for easy interactive use
2018-07-12 16:55:41 +02:00
Rainer Gerhards
e27b59634c enable better testing via "make distcheck"
Also a couple of changes to testbench worth mentioning:
* use cp -f to ensure files can be overwirtten in VBUILD
* fix issue of missing include test file in EXTRA_DIST
* new supressions
* testbench: try to use local system dependency cache
  avoid going to Internet repos if not absolutely necessary. For
  development containers, they should be pre-populated with the
  important dependencies.
* do not enable libfaketime if ASAN is selected
  unfortunately, libfaketime does not work in that case

see also https://github.com/rsyslog/rsyslog/issues/174
2018-07-11 15:01:55 +02:00
Rainer Gerhards
9da5eb8cd6 devtools: permit to override default container 2018-06-14 15:15:53 +02:00
PascalWithopf
e7d5e64ebe codestyle: imrelp added to codestyle check 2018-05-02 08:40:26 +02:00
PascalWithopf
0a5314bc38 codestyle: check files that have correct codestyle
files which have the correct style are checked so that no
style errors are created with new pull requests.
2018-04-13 09:20:38 +02:00
Rainer Gerhards
cd38e5460f devcontainer: use some sensible defaults if params not set 2018-03-03 17:51:02 +01:00
Rainer Gerhards
a570ddfcd7 dev tools: do not use -ti in docker run
this does not properly work when the script is used in
cron jobs
2018-01-31 11:55:46 +01:00
Rainer Gerhards
de88a5984d devtools: run dev container under current user credentials 2018-01-30 08:09:41 +01:00
Rainer Gerhards
9052f535fd travis fix: cron job was not executed 2018-01-19 08:58:30 +01:00
Rainer Gerhards
b06a48d6b5 Travis: further collapse build matrix 2018-01-16 13:04:47 +01:00
Rainer Gerhards
7784576dee
Merge pull request #2392 from rgerhards/travis-combined-build-test
Travis: improve build matrix
2018-01-16 07:52:23 +01:00
Rainer Gerhards
89318b2dea travis: combine some build checks
... and do them via containers. This also reduces resource usage and
runtime on Travis a bit.
2018-01-15 18:07:06 +01:00
Rainer Gerhards
a8426f507a travis: do not unnecessarily run checks under cron 2018-01-14 17:31:12 +01:00
Rainer Gerhards
b89466e105 Travis: run static analyzer via standard dev container
also some improvements to somewhat optimize the build matrix so
that we avoid unnecessary work.
2018-01-14 13:56:27 +01:00
Rainer Gerhards
2fb499d5fe dev: add consistent development tools
most importantly provide a way to run the static analyzer consistently.
This is done via docker container.
2018-01-14 11:00:26 +01:00