16 Commits

Author SHA1 Message Date
Rainer Gerhards
19334aa910
testbench: modernize "wait-file-lines" functionality
also some small other enhancements
2018-11-05 14:12:02 +01:00
Rainer Gerhards
07bd6a27fd
testbench: keep kafka/zookeeper running between tests 2018-10-28 14:24:46 +01:00
Rainer Gerhards
16b087ab10
Merge pull request #3198 from rgerhards/tb-flacky-tests
testbench: introduce concept of "unreliable" tests
2018-10-27 17:37:56 +02:00
Rainer Gerhards
8ffcb770f6
experimental: add pstats data to omkafka test 2018-10-27 15:20:42 +02:00
Rainer Gerhards
3b0c753842
testbench: introduce concept of "unreliable" tests
This permits to flag some tests as being unreliable. If done so, CI
can treat them specially. This is meant to get rid of time-consuming
issues with known problematic tests, but still retain the ability to
gather trouble-shooting information. Later commits may extend the
functionality.
2018-10-26 17:59:39 +02:00
Rainer Gerhards
a9b47e00bf
testbench: increase omkafaka.sh error timeout 2018-10-24 10:43:38 +02:00
Rainer Gerhards
33f72c53b3
Merge pull request #3166 from rgerhards/tb-omkafka
testbench: try to make omkafka test more stable
2018-10-24 08:49:55 +02:00
Rainer Gerhards
edc54d923f
testbench: try to make omkafka test more stable
The test often misses messages. One idea is that rsyslog is actually
terminated too early, and thus messages are missing. To proove that idea,
we now explicitely wait for all messages to be processed.

see also https://github.com/rsyslog/rsyslog/issues/3057
2018-10-23 17:25:40 +02:00
Rainer Gerhards
69ef6e329b fix bad bash coding style and disable shellcheck false positives
Also now permit interactivly running tests without explicitly setting
$srcdir. This now works if we are inside ./tests and fails, as before,
when we are in a different directory.

Detected by shellcheck via CodeFactor.io
2018-10-23 13:27:37 +02:00
Rainer Gerhards
2e1d2de2fc
fix bug in my previous commit
as the kafka tests failed so frequently, I overlooked that I
actually broken one...
2018-09-30 23:05:28 +02:00
Rainer Gerhards
650ec84c56
testbench: detect kafka broker failure and skip test if so
Nothing in our code has to do with the failure...

see also https://github.com/rsyslog/rsyslog/issues/3088
2018-09-30 08:55:15 +02:00
b08a8e2b51 testbench: Kafka plumbing
- Removed all sleeps where possible.
- Moved all kafka start/stop/download logic into functions.
- Moved kafka/zookeeper stop into error_exit and exit_test.
- Kafka/Zookeeper cleanup only done on success now.
- Kafka/Zookeeper logfiles automatically dumped on error_exit only now.
- Added cleanup for Kafka/Zookeeper instances into CI/buildbot_cleanup.sh
2018-09-19 09:14:42 +02:00
Rainer Gerhards
74207603ad
testbench: remove imtcp in kafka test where not strictly needed
This method currently has some race associated with it, also it is
really not required and the injectmsg method is superior.

Also fix imdiag's new $imdiagInjectDelayMode config directive. While
it was added, it was forgotten to actually apply the value.
We are not doing a separate commit as this is thightly coupled into
our testing here (which also as a side-effect tests the new imdiag
functionality).
2018-09-13 14:25:17 +02:00
847d4223ef testbench: Incremented input timeout to 60000 because kafka tests may fail on load otherwise.
Also fixed minor configuration and syntax issues.
Moved test init in kafka tests as far as possible to the top.
2018-09-07 11:52:57 +02:00
0d8f02b87e omkafka: When Timestamp was NULL, wrong dynamic timestamp was used.
Setting timestamp to 0 now lets kafka handle this.
Also added "RD_KAFKA_V_KEY(NULL,0) if no key is configured.

testbench: Changed kafka server configuration "log.retention.hours"
property to 5000 which avoids that the log cleaner is deleting our
records before they can be processed.
2018-09-06 09:59:45 +02:00
9d0933bccf testbench: Added new kafka tests using kafkacat for better debugging.
Fixed some issues with sndrcv kafka tests.
Generating kafka topics dynamically now it kafka tests.

Limited messagecount in some tests to 50000 for now.
2018-09-05 11:55:33 +02:00