12 Commits

Author SHA1 Message Date
Rainer Gerhards
3860122f41
testbench: improve speed of elasticsearch tests
we avoid unnecessary ElasticSearch restarts now. This also helps with flakes
on slow CI machines.
2020-01-01 12:23:50 +01:00
Rainer Gerhards
6cb60302c5
testbench: improve robustness against slow CI, gen. improvements
* add an overall timeout value for tests - if running longer,
  testbench framework tries to FAIL and end test. Note that
  this is not bullet-proof and not intended to be so.
* guard against hanging rsyslog instances via a new imdiag
  feature to abort after n number of seconds; among others,
  this guards as against timeout-cancel in CI, which is always
  pretty hard to diagnose - now we see these errors in test-suite.log
* fix a bug in tcp zip test, which actually did not use zip mode
* experimnentalls add debug output to better understand
  shutdown_when_empty operation; goal is to improve understanding
  and then remove that code again.
* improve shutdown predicate for a couple of tests
* made travis run make check with two parallel threads, for which
  we seem ready now. Nevertheless, it's still experimental and we
  may roll this back if required.
2018-12-28 13:03:57 +01:00
Rainer Gerhards
e91917647f
testbench: make tests more robust against races 2018-11-30 18:54:07 +01:00
Rainer Gerhards
68d203e88b
improvements to elasticsearch tests and framework (#3264)
* testbench: re-structure elasticsearch framework
2018-11-08 15:05:08 +01:00
Rainer Gerhards
f409daa911
testbench: modernize elasticsearch tests 2018-11-08 09:59:23 +01:00
Rainer Gerhards
69ef6e329b fix bad bash coding style and disable shellcheck false positives
Also now permit interactivly running tests without explicitly setting
$srcdir. This now works if we are inside ./tests and fails, as before,
when we are in a different directory.

Detected by shellcheck via CodeFactor.io
2018-10-23 13:27:37 +02:00
Rainer Gerhards
a45f3af81d squash: wait until full startup so that imdiag.port exists 2018-09-05 09:21:42 +02:00
Rainer Gerhards
b5a385a13d testbench: modernize plumbing
another set of changes for testbench modernization
2018-09-02 17:29:39 +02:00
Rainer Gerhards
5a7d6009c7
testbench: some minor improvements
- DEAD_PORT now uses unassigned IANA port unlike to be used on the system
  (dynamic port querying is racy and we had at least once an issue, so we
  can remove ambiguity here easily)
- replace some diag.sh commands by bash functions
2018-08-19 08:35:19 +02:00
Rainer Gerhards
2ba3c8ddde
testbench: modernize testbench plumbing
changes some of the test commands to use bash functions
includes some small bug fixes to tests where bugs were
previously not seen due to different plumbing.
2018-07-23 17:26:34 +02:00
Rainer Gerhards
9cf9f2e8b7 testbench: change elasticsearch tests to use new plumbing
This makes the ES tests more universally available (they should now
also support running in containers). It also simplifies the tests
as fewer support files are needed.
2018-06-18 17:12:08 +02:00
Rainer Gerhards
2f76d61821 testbench: add threading correctness dynamic tests
utilizing the valgrind helgrind debugger

closes https://github.com/rsyslog/rsyslog/issues/1971
see also https://github.com/rsyslog/rsyslog/issues/2012
2017-11-10 19:03:01 +01:00