428 Commits

Author SHA1 Message Date
598eec659e tcpflood: Added support setting OpenSSL command parameters.
Also added a test based on imtcp-tls-ossl-basic.sh which tests
the new -k parameter with tcpflood called:
imtcp-tls-ossl-basic-tlscommands.sh

Fixed OpenSSL error reporting in tcpflood which was running into
a loop when OpenSSL error stack was printed out.
2019-04-12 12:45:20 +02:00
Rainer Gerhards
3f46487a79 testbench plumbing: remove left-over debug output 2019-04-11 13:18:04 +02:00
Rainer Gerhards
fe71d5bbad
testbench: better info if core file is found during test 2019-04-05 15:38:01 +02:00
Rainer Gerhards
3ccc8fc322
testbench: bump zookeeper version
The version used so far is no longer available.
2019-04-02 14:59:48 +02:00
Rainer Gerhards
2ac6c2935f testbench bugfix: es-basic test did not work correctly
when I made adjustments to prevent raciness, I overlooked that one
function, as-was, was not suitable for that.
2019-04-01 18:40:21 +02:00
Rainer Gerhards
6699980f57
testbench: bump kafka version
old version is no longer available; in general it is best to test with current one
2019-03-28 11:35:45 +01:00
Rainer Gerhards
ee77f27db0
imfile bugfix: file reader could get stuck
State file handling was invalid. When a file was moved and re-created
rsyslog could use the file_id if the new file to write the old files'
state file. This could make the file reader stuck until it reached the
previous offset. Depending on file sizes this could never happen AND
would cause large message loss. This situation was timing dependent
(a race) and most frequently occurred under log rotation. In polling
mode the bug was less likely, but could also occur.

closes: https://github.com/rsyslog/rsyslog/issues/3465
closes: https://github.com/rsyslog/rsyslog/issues/3468
2019-03-02 12:29:21 +01:00
Rainer Gerhards
ee0f485d21
Merge pull request #3430 from alorbach/issue3413
tls support: Added support for certless communcation
2019-03-01 11:53:36 +01:00
Rainer Gerhards
fddfec1349
Merge pull request #3509 from rgerhards/tb-modernize2
testbench: make shutdown more reliable
2019-02-25 12:35:24 +01:00
Rainer Gerhards
5d9560b6f0
testbench: make shutdown more reliable
we bind the shutdown timeout to the general MAX RUN timeout
also modernize testbench a bit more
2019-02-25 08:34:07 +01:00
Rainer Gerhards
7314c7e1fd
EXPERIMENTAL: reduce runtime to make visible where we have runtime issues
testbench: cleanup, including fix of false positives

some environments have faulty components; also some tests failed simply because
their runtime *is* far longer than supported by default. Also re-instantiated
some "lost" tests and done some general cleanup.
2019-02-23 10:57:50 +01:00
Rainer Gerhards
1e7c7c645d
testbench: increase TB_TEST_MAX_RUNTIME
some tests need an extra bit, and we go as high as sounds safe in
regard to CI integration.
2019-02-21 19:16:32 +01:00
Rainer Gerhards
9016780a8a
testbench: bind startup timeout to general runtime timeout
The old method via startup timeout was less reliable. We now use time-based
runtime method. This PR fixes all startups, but leaves some shutdown
scenarios in previous state.

This also makes the test more reliable on slow machines as the max runtime
timeout is more secure to check. We had some tests which required extended
startup time (but not overall runtime) which failed due to too-short
startup timeout.
2019-02-21 14:15:10 +01:00
Rainer Gerhards
092b89d387
Merge pull request #3466 from rgerhards/i3451
omrelp: add capability to specify tlslib for librelp
2019-02-15 12:06:39 +01:00
Rainer Gerhards
5a418daf7a
imrelp: add capability to specify tlslib for librelp
see also https://github.com/rsyslog/rsyslog/issues/3451
2019-02-14 12:58:43 +01:00
Gabriel Intrator
c8171a970c omhttp: updates and improvements (#3423)
omhttp:  basically a rewrite with large feature enhancements
2019-02-14 10:51:04 +01:00
Rainer Gerhards
367b4d1c59
testbench: fix imjournal tests; add imjournal valgrind test
see also https://github.com/rsyslog/rsyslog/issues/3433
2019-01-24 14:26:14 +01:00
Rainer Gerhards
2c89805423
Merge pull request #3411 from rgerhards/i495
queue: add support for minimum batch sizes
2019-01-21 09:08:41 +01:00
Rainer Gerhards
8c8e1e92d0
queue: add support for minimum batch sizes
closes https://github.com/rsyslog/rsyslog/issues/495
2019-01-18 17:34:55 +01:00
Rainer Gerhards
4640680c54
testbench: fix some bash nits and test modernization
nits detected by shellcheck, lead to some additional improvements
2019-01-17 12:17:45 +01:00
Rainer Gerhards
172fd820f3 testbench: some debug aid for wait_content() failures
... especially as we are bugged by unexplainable failures in an
ElasticSearch test. But looks generally useful.
2019-01-15 11:07:58 +01:00
Rainer Gerhards
320be30e8e
testbench: increase main queue enq timeout (for slow machines) 2019-01-07 09:39:59 +01:00
Rainer Gerhards
6cb60302c5
testbench: improve robustness against slow CI, gen. improvements
* add an overall timeout value for tests - if running longer,
  testbench framework tries to FAIL and end test. Note that
  this is not bullet-proof and not intended to be so.
* guard against hanging rsyslog instances via a new imdiag
  feature to abort after n number of seconds; among others,
  this guards as against timeout-cancel in CI, which is always
  pretty hard to diagnose - now we see these errors in test-suite.log
* fix a bug in tcp zip test, which actually did not use zip mode
* experimnentalls add debug output to better understand
  shutdown_when_empty operation; goal is to improve understanding
  and then remove that code again.
* improve shutdown predicate for a couple of tests
* made travis run make check with two parallel threads, for which
  we seem ready now. Nevertheless, it's still experimental and we
  may roll this back if required.
2018-12-28 13:03:57 +01:00
Rainer Gerhards
8dee9b7e50
Merge pull request #3368 from rgerhards/tb2021-cosmetic
testbench: make some elasticsearch tests more robust f/ slow machines
2018-12-21 20:02:51 +01:00
Rainer Gerhards
ffaac65641
testbench: make some elasticsearch tests more robust f/ slow machines 2018-12-21 17:12:21 +01:00
Rainer Gerhards
3ba5a77455
testbench: make more robust against slow CI env; modernize tests 2018-12-20 15:40:40 +01:00
Rainer Gerhards
e2b87769f1
global object: add ability to set action queue timeout defaults
while this is useful for users as well, we have done it so
that we can handle slow CI systems during CI runs. It is also
required for massively parallel testing, which makes each
individual test rather slow.

With the new settings, the testbench framework can now set
longer timeouts by defaults. Also updated framework accordingly.
2018-12-20 13:56:30 +01:00
Rainer Gerhards
e92770e75d
Merge pull request #3358 from rgerhards/tb1219a
testbench: make some more test more robust against slow CI machines
2018-12-19 17:03:43 +01:00
Rainer Gerhards
907a87ce19
Merge pull request #3332 from rgerhards/tb-complex1
testbench: make complex1 test more robust on slow test machines
2018-12-19 14:42:27 +01:00
Rainer Gerhards
ae06bcce0b
testbench: make some more test more robust against slow CI machines
also fix an issue with tests that use non-standard plumbing
2018-12-19 13:04:41 +01:00
Rainer Gerhards
cc9cc2cc79
testbench: make complex1 test more robust on slow test machines 2018-12-19 12:12:49 +01:00
Rainer Gerhards
f60775def6
Merge pull request #3353 from rgerhards/nitfixes2
some nitfixes and sligth testbench modernization
2018-12-19 08:29:24 +01:00
Rainer Gerhards
0494037aa2
some nitfixes and sligth testbench modernization 2018-12-18 18:12:29 +01:00
Rainer Gerhards
40f8db2bf3
testbench: add tests for parser.EscapeControlCharacterTab global option
changing one test from legacy style to current; still retain related
test in legacy style albeit not strictly ncessary.

see also https://github.com/rsyslog/rsyslog/issues/552
2018-12-16 11:44:03 +01:00
Rainer Gerhards
012d18a2de
testbench: harden some tests against races
also improve test code while we were at it...
2018-11-30 15:00:26 +01:00
Rainer Gerhards
76ed560252
Merge pull request #3308 from rgerhards/ossl-tests
testbench: make some openssl tests more reliable
2018-11-30 11:24:44 +01:00
Rainer Gerhards
d414a50b6a
testbench: replace getpid command by modern alternative 2018-11-22 19:25:38 +01:00
Rainer Gerhards
ee8581bd1c
testbench: do not cancel uxsockrcvr on test init
this does not work with parallel builds; replaced by
timing haning uxsockrcvr instances out.
2018-11-22 19:17:56 +01:00
Rainer Gerhards
834cf1334f
testbench: make some openssl tests more reliable
They now wait for the output file to have the execpected number of lines
before rsyslog is shutdown. From past experience we know that the
shutdown "queue empty detection" is not 100% reliable on very slow
machines/environments.
2018-11-20 06:54:40 +01:00
Rainer Gerhards
ac652d1fba
Merge pull request #3289 from rgerhards/tb1113
testbench: some cleanup and improvements
2018-11-13 17:54:11 +01:00
Rainer Gerhards
de0f43e8f8
testbench: some cleanup and improvements
based on shellcheck reports
2018-11-13 12:30:27 +01:00
Rainer Gerhards
db7000d958
Merge pull request #3288 from rgerhards/tb-kafka1112b
testbench: improve broken kafka broker detection
2018-11-13 08:26:07 +01:00
Rainer Gerhards
3e16b2441b
Merge pull request #3285 from rgerhards/tb-es-bulk-retry
minor testbench improvements
2018-11-12 17:54:47 +01:00
Rainer Gerhards
cf764d86f5
testbench: improve broken kafka broker detection
closes https://github.com/rsyslog/rsyslog/issues/3225
2018-11-12 17:53:20 +01:00
Rainer Gerhards
feb53cbf0c
Merge pull request #3283 from rgerhards/tb-nitfixes
testbench: fix core file handling when multiple core files exist
2018-11-12 17:35:41 +01:00
Rainer Gerhards
04dbe6e7c6
testbench: failure reporting can break make distcheck
... due to the fact that it stores the servers result page.

We could avoid this by using curl (which is better for this kind of
job), but curl is not always present whereas wget is requried for
testbench in any case. So we just instruct wget to discard the
server response.
2018-11-12 13:36:58 +01:00
Rainer Gerhards
04f792de8d
testbench: wait function needs to support slow machines 2018-11-12 13:34:02 +01:00
Rainer Gerhards
c1005aa472
testbench: "fix" shellcheck false positives 2018-11-12 11:59:25 +01:00
Rainer Gerhards
41a54d9031
testbench: fix core file handling when multiple core files exist
This is primarily a cosmetic fix, as multiple core files should never
exist. The only exception might be parallel builds, but in this case
the whole concept does not work correctly (we may probably see into
that when we finally support parallel builds, which we do not yet).

detected by shellcheck
2018-11-12 11:54:04 +01:00
Rainer Gerhards
6ec3bbe0fe
testbench: add a bit time-tracking to testbench runs
primary cosmetic (for delveoper's curiosity), plus a fix for where
printf was incorrectly called (which also did not cause real harm)
2018-11-11 17:45:41 +01:00