14 Commits

Author SHA1 Message Date
Rainer Gerhards
6be13dc092
devel tools: show stalled tests from "make check"
CI systems cancel out runs that are stalled. Unfortunately, it is very
hard to find the test that caused the stall. This commit extends the
toolset to detect logs without a matching .trs file, which is a strong
indication of an aborted test.

This alos modernizes some tests in order to remove sample *.log files
which would otherwise always clutter log output.
2020-01-24 18:45:12 +01:00
Rainer Gerhards
4640680c54
testbench: fix some bash nits and test modernization
nits detected by shellcheck, lead to some additional improvements
2019-01-17 12:17:45 +01:00
Rainer Gerhards
69ef6e329b fix bad bash coding style and disable shellcheck false positives
Also now permit interactivly running tests without explicitly setting
$srcdir. This now works if we are inside ./tests and fails, as before,
when we are in a different directory.

Detected by shellcheck via CodeFactor.io
2018-10-23 13:27:37 +02:00
Rainer Gerhards
ca1af1b459
cleanup: shellcheck-found minor issues 2018-10-19 12:55:59 +02:00
Rainer Gerhards
a43a03f17e
testbench: make more test file names dynamic
This is required to support parallel test runs.

Among others, make thise files dynamic:
* test-spool
* rsyslog.input
* rsyslog.out*.log
* tmp.in

Also:
* convert presort test statement to function
* cleanup imfile truncation test
* cleanup imfile-growing-file-id test
  some cruft was left due to copy and paste error
* serialize mysql tests
2018-08-29 10:46:32 +02:00
Rainer Gerhards
8ea166d89d
testbench: fix some hardcoded names (#2895)
* testbench: fix some hardcoded names

This is prework to make parallel execution of tests possible.
2018-08-01 12:52:17 +02:00
Florian Riedl
61bec55a55 Test refactor part 4 2018-07-24 17:16:50 +02:00
Rainer Gerhards
2ba3c8ddde
testbench: modernize testbench plumbing
changes some of the test commands to use bash functions
includes some small bug fixes to tests where bugs were
previously not seen due to different plumbing.
2018-07-23 17:26:34 +02:00
PascalWithopf
bd8a1b8136 freeBSD: disable tests that are not working
FreeBSD is not able to run all tests, therefore all tests that can't be run will be disabled.
2017-10-27 12:18:59 +02:00
PascalWithopf
1628ef2a37 testbench: workaround for solaris 2017-04-13 14:07:38 +02:00
df3d4a3922 test-suite: Added !#/bin/bash into all test scripts.
Most of the tests will not work in other default shells like
on Freebsd or Solaris. So we make /bin/bash default now.
2015-07-30 15:38:17 +00:00
be940cf970 testbench: made work on FreeBSD
bash "source" extension is not supported in FreeBSD default shell"
2015-07-15 09:33:31 +00:00
Rainer Gerhards
bf14ecaf14 testbench: provide better diagnostics for failing test 2015-03-03 09:13:19 +01:00
Rainer Gerhards
bbb793d140 testbench: improve imuxsock coverage
so far, all test required root privileges, which made testing
quite complicated and resulted in no testing of this module
on the testbench machines at all. Now we can also run without
root privileges.

To support the new tests, test tools were also improved.
2014-12-04 12:24:43 +01:00