2718 Commits

Author	SHA1	Message	Date
jwslater0823	343a0853a0	testbench: modify es_response_get_msgnum.py for python3 ... python3 does not like mixing spaces and tabs for indentation, so we get rid of the tab before print().	2020-02-15 16:34:51 -08:00
Andre lorbach	f4aa6473d8	testbench: set max extra data length for tcpflood from 256 to 512KB. ... Added a imrelp test for big messages (256KB). see also: https://github.com/rsyslog/rsyslog/issues/4158	2020-02-11 18:01:56 +01:00
Rainer Gerhards	0603e3ac86	testbench: add random data to test_id ... We use the test_id to generate unique files during parallel runs. So far we used a combination of ms-based timestamp and hash of test name. Practice shows that under some circumstances the generated ids are not unique and thus test get file conflicts and false positives. This is now changed so that the test_id we add 4 bytes of random data to the test ID. This is hopefully sufficient to make the IDs of test runing in parallel unique.	2020-02-10 18:11:58 +01:00
Rainer Gerhards	7c2eaa8f2e	build system: change --enable-imfile-tests default to "yes" ... This was accidentally set to "no". Test for imfile should by default run when imfile is enabled. We also temporarily disable the failing tests - this makes it posible to run the remaining tests during CI and prevent future errors. That is better than nothing. Tests are to be re-enabled when the imfile bug mentioned below is fixed. see also https://github.com/rsyslog/rsyslog/issues/4120 Signed-off-by: Rainer Gerhards <rgerhards@adiscon.com>	2020-01-30 09:36:35 +01:00
Rainer Gerhards	05180a6b40	testbench: add suppression for pselect() valgrind false positive ... we are pretty sure this is a false positive see also https://github.com/rsyslog/rsyslog/issues/4143	2020-01-29 16:29:35 +01:00
Rainer Gerhards	ac95688fd5	build system: add option --enable-gnutls-tests ... This enables us to build GNUtls support but not necessarily test it in CI. This is useful for some specialised subcomponent test.	2020-01-26 16:28:18 +01:00
Rainer Gerhards	e16ea90bb6	Merge pull request #4087 from rgerhards/tb-loadbalance ... testbench: new test for loadbalancing via global variables	2020-01-26 13:11:08 +01:00
Rainer Gerhards	6be13dc092	devel tools: show stalled tests from "make check" ... CI systems cancel out runs that are stalled. Unfortunately, it is very hard to find the test that caused the stall. This commit extends the toolset to detect logs without a matching .trs file, which is a strong indication of an aborted test. This alos modernizes some tests in order to remove sample *.log files which would otherwise always clutter log output.	2020-01-24 18:45:12 +01:00
Rainer Gerhards	63145387cb	testbench: modernize and make more robust ... This also modernizes the testbench framework	2020-01-23 18:52:48 +01:00
Rainer Gerhards	1a4351718d	Merge pull request #4148 from rgerhards/i3853 ... testbench: fix final issues for python 3 transition	2020-01-23 16:21:16 +01:00
Rainer Gerhards	618f743299	testbench: fix final issues for python 3 transition ... Thanks to Michael Biebl for his help on this issue. This patch also contains some slight test modernization and a "name fix" for a non-valgrind test. closes https://github.com/rsyslog/rsyslog/issues/3853	2020-01-23 12:38:03 +01:00
Rainer Gerhards	148c2767e7	testbench: further improvements ... make more robust and remove a potentially enternal loop which could lead to abort in CI system without error indication.	2020-01-23 12:06:36 +01:00
Rainer Gerhards	46b15e8733	testbench: modernize and make more robust ... also fixing some nits, like too verbose output (which may cause buildbot to abort)	2020-01-22 14:33:19 +01:00
Rainer Gerhards	4219c65cb6	testbench: new test for loadbalancing via global variables ... This is a useful use case which was so far not covered by any tests.	2020-01-20 12:48:06 +01:00
Rainer Gerhards	4c99ac090c	chkseq testbench tool bugfix: -i option did not work for values > 1	2020-01-20 11:49:39 +01:00
Rainer Gerhards	e00580534b	core bugfix: potential race during HUP ... when rsyslog is HUPed immediately after startup and before it is fully initialized, there is a potential race with the list of loaded modules. This patch ensures no bad things can happen in that case. Detected by LLVM TSAN, not seen in practice. Signed-off-by: Rainer Gerhards <rgerhards@adiscon.com>	2020-01-20 08:22:15 +01:00
Rainer Gerhards	58dfe006a8	testbench: improve tests ... modernize them, reduce robustness against slow machines, provide some test framework functional enhancements and optimizie some tests	2020-01-19 16:09:44 +01:00
Rainer Gerhards	3681b4d414	Merge pull request #4112 from rgerhards/tb-robust6 ... testbench: make tests more robust against slow machines	2020-01-12 14:09:12 +01:00
Rainer Gerhards	636c2d3c0a	Merge pull request #4113 from rgerhards/tb-robust7 ... testbench: modernize tests and make more robust in regard to timing	2020-01-12 14:04:07 +01:00
Rainer Gerhards	f12c54cb2c	Merge pull request #4107 from rgerhards/i4098 ... omfwd: parameter streamdriver.permitexpiredcerts did not work	2020-01-12 12:55:08 +01:00
Rainer Gerhards	a95bce2835	testbench: modernize tests and make more robust in regard to timing	2020-01-12 12:50:27 +01:00
Rainer Gerhards	e73c0bd136	testbench: make tests more robust against slow machines	2020-01-12 11:16:54 +01:00
Rainer Gerhards	8e4a6f4836	testbench: modernize some tests ... This also makes port use more reliable.	2020-01-11 16:30:26 +01:00
Rainer Gerhards	80b3fc65d5	omfwd: parameter streamdriver.permitexpiredcerts did not work ... This commit fixes the issue and adds tests to ensure the parameter is understood closes https://github.com/rsyslog/rsyslog/issues/4098	2020-01-11 16:16:03 +01:00
Rainer Gerhards	fa77d6d30d	Merge pull request #4110 from rgerhards/tb-robust5 ... testbench: modernize some tests	2020-01-11 16:02:49 +01:00
Rainer Gerhards	3ca969fae8	Merge pull request #4106 from rgerhards/tb-ci-runner-test ... CI: add script to do a full CI run	2020-01-11 16:01:38 +01:00
Rainer Gerhards	0845ff8e02	CI: add script to do a full CI run ... The core ID is to use this script together with pretty generic buildbot workers. This provides a simple way to load-balance across the worker pool.	2020-01-11 12:10:48 +01:00
Rainer Gerhards	0004185c48	testbench: modernize some tests ... also make more robust against slow testbench machines	2020-01-10 10:52:06 +01:00
Rainer Gerhards	8dbb33cd03	testbench: fix races in old-style tests ... these were introduced with commit fcffb063e just recently	2020-01-08 16:07:02 +01:00
Rainer Gerhards	6f74f7e7b4	Merge pull request #4091 from alorbach/pr-issue-4035 ... ossl tls: Added support to configure certificate verify depth	2020-01-08 15:44:57 +01:00
Rainer Gerhards	52b609869d	Merge pull request #4093 from rgerhards/tb-q-shutdown-to ... testbench: increase main msg queue default shutdown timeout	2020-01-08 15:44:33 +01:00
Rainer Gerhards	97ab992f4f	Merge pull request #4103 from rgerhards/imtcp-legacy-listenportfile ... imtcp: add legacy directive $inputtcpserverlistenportfile	2020-01-08 15:44:16 +01:00
Andre lorbach	fcffb063e3	tls: Added support to configure certificate verify depth ... Support added in omfwd as instance parameter: streamdriver.TlsVerifyDepth Support added in imtcp as module parameter: streamdriver.TlsVerifyDepth Can be 2 or higher. Support added into ossl driver Support added into gtls driver Added testcases for both drivers. Parameter streamdriver.TlsVerifyDepth closes: https://github.com/rsyslog/rsyslog/issues/4035	2020-01-08 11:40:14 +01:00
Rainer Gerhards	2377bfa0e7	imtcp: add legacy directive $inputtcpserverlistenportfile ... This is added for testbench use - we need it to harden tests that need to test legacy syntax. The new directive is NOT intended for users. Thus it is intentionally NOT DOCUMENTED.	2020-01-08 11:38:20 +01:00
Rainer Gerhards	dffb2bb8f7	testbench: modernize tests ... also make them more robust against slow testbench machines	2020-01-08 10:22:29 +01:00
Rainer Gerhards	f2560d5229	Merge pull request #4090 from rgerhards/tb-robust2 ... testbench: harden two tests against slow testbench machines	2020-01-08 09:22:06 +01:00
Rainer Gerhards	73941eaad2	Merge pull request #4094 from rgerhards/tb-timeout ... testbench: do not create hanging tool instances	2020-01-08 09:20:52 +01:00
Rainer Gerhards	77ee19d9b0	testbench: increase main msg queue default shutdown timeout ... this is necessary for very slow test environments	2020-01-08 08:53:36 +01:00
Rainer Gerhards	a03855765e	Merge pull request #4096 from rgerhards/tb-kafkacache ... testbench: use local kafka download cache if present	2020-01-07 16:33:40 +01:00
Rainer Gerhards	bc71ab0738	testbench: use local kafka download cache if present	2020-01-07 11:13:17 +01:00
Rainer Gerhards	c8461990f6	testbench: do not create hanging tool instances ... the omhttp test server hangs indefinitely if tests requiring it fail. This is relevant if the environment ist not destructed after CI run (the buildbot CI system does not do this on VMs). To guard against this, we have added a timeout of 30 minutes to ensure the tool is terminated.	2020-01-06 17:05:12 +01:00
Rainer Gerhards	92e0a75e99	testbench: harden two tests against slow testbench machines	2020-01-06 12:53:00 +01:00
Rainer Gerhards	77180c9b08	testbench: make imdocker tests more robust in regard to timing ... some have problems on heavily loaded (CI) machines. This commit solves that problem.	2020-01-06 12:52:18 +01:00
Rainer Gerhards	8be4e37df6	testbench: modernize some tests and make more robust ... slow test machines are now better handled	2020-01-03 11:45:55 +01:00
Rainer Gerhards	58e49ae07b	testbench cleanup: remove debug info ... mysqld-start script always did an SKIP, so that we could check it's outcome. This is a left-over from previous debugging. Thus removing it.	2020-01-02 10:38:52 +01:00
Rainer Gerhards	3860122f41	testbench: improve speed of elasticsearch tests ... we avoid unnecessary ElasticSearch restarts now. This also helps with flakes on slow CI machines.	2020-01-01 12:23:50 +01:00
Rainer Gerhards	879fea33ff	testbench: rough fix for clickhouse 2019 test data problem ... not a real fix, but to get us going: clickhouse test had hardcoded year; needs to be removed soon. Right now, just pusing it to 2020.	2020-01-01 11:08:45 +01:00
Rainer Gerhards	4d69817808	config system: emit proper error message on $ in double-quoted string ... closes https://github.com/rsyslog/rsyslog/issues/2869	2019-12-30 17:39:04 +01:00
Rainer Gerhards	394232f3a0	testbench: modernize some tests	2019-12-27 14:14:54 +01:00
Josh Soref	af19128573	fix spelling errors in testbench	2019-12-27 13:57:25 +01:00