12 Commits

Author SHA1 Message Date
Rainer Gerhards
6bba5a7577
testbench: guard tests against unexpected warning messages
Practice has shown that environment-induced error messages may
appear during test runs. For example, incorrect resolver settings
may cause name resolution warnings or errors. These are unrelated
to the test itself.

This patch enables tests that are otherwise unaffected by the faillures
to continue and provide "pass" test result.

see also https://github.com/rsyslog/rsyslog/issues/4619
2021-08-09 10:41:09 +02:00
Rainer Gerhards
6be13dc092
devel tools: show stalled tests from "make check"
CI systems cancel out runs that are stalled. Unfortunately, it is very
hard to find the test that caused the stall. This commit extends the
toolset to detect logs without a matching .trs file, which is a strong
indication of an aborted test.

This alos modernizes some tests in order to remove sample *.log files
which would otherwise always clutter log output.
2020-01-24 18:45:12 +01:00
Rainer Gerhards
4640680c54
testbench: fix some bash nits and test modernization
nits detected by shellcheck, lead to some additional improvements
2019-01-17 12:17:45 +01:00
Rainer Gerhards
69ef6e329b fix bad bash coding style and disable shellcheck false positives
Also now permit interactivly running tests without explicitly setting
$srcdir. This now works if we are inside ./tests and fails, as before,
when we are in a different directory.

Detected by shellcheck via CodeFactor.io
2018-10-23 13:27:37 +02:00
Rainer Gerhards
ca1af1b459
cleanup: shellcheck-found minor issues 2018-10-19 12:55:59 +02:00
Rainer Gerhards
a43a03f17e
testbench: make more test file names dynamic
This is required to support parallel test runs.

Among others, make thise files dynamic:
* test-spool
* rsyslog.input
* rsyslog.out*.log
* tmp.in

Also:
* convert presort test statement to function
* cleanup imfile truncation test
* cleanup imfile-growing-file-id test
  some cruft was left due to copy and paste error
* serialize mysql tests
2018-08-29 10:46:32 +02:00
Rainer Gerhards
8ea166d89d
testbench: fix some hardcoded names (#2895)
* testbench: fix some hardcoded names

This is prework to make parallel execution of tests possible.
2018-08-01 12:52:17 +02:00
Florian Riedl
61bec55a55 Test refactor part 4 2018-07-24 17:16:50 +02:00
Rainer Gerhards
2ba3c8ddde
testbench: modernize testbench plumbing
changes some of the test commands to use bash functions
includes some small bug fixes to tests where bugs were
previously not seen due to different plumbing.
2018-07-23 17:26:34 +02:00
PascalWithopf
bd8a1b8136 freeBSD: disable tests that are not working
FreeBSD is not able to run all tests, therefore all tests that can't be run will be disabled.
2017-10-27 12:18:59 +02:00
PascalWithopf
1628ef2a37 testbench: workaround for solaris 2017-04-13 14:07:38 +02:00
Rainer Gerhards
2314794c5a testbench: add tests for imuxsock system log socket
We do not exectute them as root, but we assign a special name. This
is very close to the "real thing" but permits us to execute the
tests as part of CI platforms.
2016-02-20 11:16:26 +01:00