2196 Commits

Author SHA1 Message Date
Rainer Gerhards
3692b9862a
CI: add PR validation in regard to commit structure
This adds the check script. It is up to CI to use it or not.
2019-03-03 14:07:48 +01:00
Rainer Gerhards
ee77f27db0
imfile bugfix: file reader could get stuck
State file handling was invalid. When a file was moved and re-created
rsyslog could use the file_id if the new file to write the old files'
state file. This could make the file reader stuck until it reached the
previous offset. Depending on file sizes this could never happen AND
would cause large message loss. This situation was timing dependent
(a race) and most frequently occurred under log rotation. In polling
mode the bug was less likely, but could also occur.

closes: https://github.com/rsyslog/rsyslog/issues/3465
closes: https://github.com/rsyslog/rsyslog/issues/3468
2019-03-02 12:29:21 +01:00
Ludo Brands
4825f685d0 omkafka: add support for dynamic keys 2019-03-01 12:09:32 +01:00
Rainer Gerhards
ee0f485d21
Merge pull request #3430 from alorbach/issue3413
tls support: Added support for certless communcation
2019-03-01 11:53:36 +01:00
Rainer Gerhards
9d33fafb48
Merge pull request #3508 from rgerhards/tb-q-test
testbench improvements
2019-03-01 11:51:41 +01:00
Rainer Gerhards
8ea65859f2
Merge pull request #3510 from rgerhards/tb-2gb-tests
testbench bugfix: long-running tests had too low runtime allowance
2019-03-01 11:50:12 +01:00
Rainer Gerhards
25151e5009
testbench: queue_minbatch does not work on solaris
most probably an issue with atomic ops - disabling on Solaris for now
2019-02-27 10:58:53 +01:00
Rainer Gerhards
fddfec1349
Merge pull request #3509 from rgerhards/tb-modernize2
testbench: make shutdown more reliable
2019-02-25 12:35:24 +01:00
Rainer Gerhards
5d9560b6f0
testbench: make shutdown more reliable
we bind the shutdown timeout to the general MAX RUN timeout
also modernize testbench a bit more
2019-02-25 08:34:07 +01:00
Rainer Gerhards
7314c7e1fd
EXPERIMENTAL: reduce runtime to make visible where we have runtime issues
testbench: cleanup, including fix of false positives

some environments have faulty components; also some tests failed simply because
their runtime *is* far longer than supported by default. Also re-instantiated
some "lost" tests and done some general cleanup.
2019-02-23 10:57:50 +01:00
Rainer Gerhards
e36723baba
testbench bugfix: long-running tests had too low runtime allowance
closes https://github.com/rsyslog/rsyslog/issues/3493
2019-02-22 19:11:14 +01:00
Rainer Gerhards
19671a1382
Merge pull request #3501 from rgerhards/tb-timeoutguard
testbench: increase TB_TEST_MAX_RUNTIME
2019-02-22 18:59:06 +01:00
Rainer Gerhards
dbfc8ebbbb
Merge pull request #3506 from rgerhards/tb-nitfix
testbench: nitfix
2019-02-22 18:58:49 +01:00
Rainer Gerhards
f3c0f45ce1
testbench: modernize test 2019-02-22 18:09:18 +01:00
Rainer Gerhards
991a450605
testbench: improve queue test
we also try to harden it against very slow machines - not sure if
the method really works well. Practice will show.
2019-02-22 18:02:12 +01:00
Rainer Gerhards
316322f7a1 testbench: nitfix 2019-02-22 16:23:22 +01:00
Rainer Gerhards
b53c39ea53
testbench: harden long-running tests against slow CI environment
while doing so, alos modernize tests
2019-02-22 16:01:00 +01:00
Rainer Gerhards
6fb30669a5
testbench: fix daqueue-dirty-shutdown test
This test occasionally failed with left-over spool files. As far as we
have analyzed, this is due to the use of an invalid shutdown timeout
(very short) in the second phase of the test. It looks like this is
actually a copy&paste error from phase one. Behaviour of rsyslog was
correct, but the test itself created a false positive.

We have corrected the timeout now and also modernized the test
a bit.

closes https://github.com/rsyslog/rsyslog/issues/2122
2019-02-22 09:59:23 +01:00
Rainer Gerhards
1e7c7c645d
testbench: increase TB_TEST_MAX_RUNTIME
some tests need an extra bit, and we go as high as sounds safe in
regard to CI integration.
2019-02-21 19:16:32 +01:00
9c60ae361e testbench: reorganized testcases for server/client certless comm
- Corrected ANON Cipher handling in ossl / gtls driver.
- removed error when no CA is configured for ANON Mode in gtls dirver.
- Set GNUTLS Debug level to 2, so we see more informations about gnutls errors
  in rsyslog debug mode.
- fixed tcpdump parameters not using TLS in manytcp-too-few-tls-vg.sh
- fixed minor memory leak in shutdown destructor of ossl tls driver.
2019-02-21 17:43:35 +01:00
d58a4045aa testbench: Added new tests to check certless communication gtls/ossl
closes: https://github.com/rsyslog/rsyslog/issues/3415
closes: https://github.com/rsyslog/rsyslog/issues/3413
2019-02-21 16:47:25 +01:00
0021070710 tls support: Implemented anon cipher support for openssl driver
When no cert/key is configured, we specificially allow ANON ciphers.
Note that anon ciphers only can be enabled when authmode is set to Anon.

See: https://github.com/rsyslog/rsyslog/issues/3415
2019-02-21 16:47:25 +01:00
7cc4fd697c tls support: Implemented anon cipher support for gtls driver
When no cert/key is configured, we specificially allow ANON ciphers
(ANON-DH). We could also allow ANON-ECDH if necessary, but has been commented our
for now.

See: https://github.com/rsyslog/rsyslog/issues/3415
See: https://github.com/rsyslog/rsyslog/issues/3413
2019-02-21 16:47:25 +01:00
Rainer Gerhards
9016780a8a
testbench: bind startup timeout to general runtime timeout
The old method via startup timeout was less reliable. We now use time-based
runtime method. This PR fixes all startups, but leaves some shutdown
scenarios in previous state.

This also makes the test more reliable on slow machines as the max runtime
timeout is more secure to check. We had some tests which required extended
startup time (but not overall runtime) which failed due to too-short
startup timeout.
2019-02-21 14:15:10 +01:00
Rainer Gerhards
a68e8eff1b
Merge pull request #3494 from rgerhards/minitcpsrv
testbench tool minitcpsrvr: inform of regular shutdown
2019-02-21 08:32:18 +01:00
Rainer Gerhards
39d9da8200
Merge pull request #3495 from rgerhards/tb-imfile-symlink
testbench: refactor imfile-symlink test for robustness and simplicity
2019-02-21 08:32:06 +01:00
Rainer Gerhards
1cc6c242f5
testbench: refactor imfile-symlink test for robustness and simplicity
We hope this solves the pretty frequent false positives this test
generates.
2019-02-20 18:33:51 +01:00
Rainer Gerhards
d3138208ac
testbench tool minitcpsrvr: inform of regular shutdown
We need this in order to help debug cases where minitcpsrvr seem to
have force-terminated before it was finished (on slow machines).
2019-02-20 18:03:23 +01:00
Rainer Gerhards
7e8fa7f96d
Merge pull request #3491 from rgerhards/tb-timeouts
testbench: modernize test and hopefully make more robust on slow CI
2019-02-20 17:59:01 +01:00
Rainer Gerhards
0be7df4f91
testbench: modernize test and hopefully make more robust on slow CI 2019-02-20 15:43:20 +01:00
Rainer Gerhards
0b521d5d84
Merge pull request #3490 from rgerhards/tb-dbi-timeout
testbench: increase explicit enqueue timeout for slow CI systems
2019-02-20 15:14:04 +01:00
Rainer Gerhards
5bdb1018e2
Merge pull request #3486 from rgerhards/clickhouse-dflt-tpl
testbench: add test for omclickhouse with default template
2019-02-20 15:09:24 +01:00
Rainer Gerhards
3332e0b4fc
testbench: increase explicit enqueue timeout for slow CI systems 2019-02-20 14:14:04 +01:00
Rainer Gerhards
6b9e631921
testbench: add test for omclickhouse with default template 2019-02-19 17:48:21 +01:00
Rainer Gerhards
72982ed3f8
testbench: increase timeout for test + better to exp reporting 2019-02-18 19:22:13 +01:00
Rainer Gerhards
260b3afca7
Merge pull request #3453 from PascalWithopf/i-2611
tcpflood: add new transport option relp-tls
2019-02-18 09:28:35 +01:00
Jan Gerhards
5d339bbbd4 fix legacy format
detected by CodeFactor
2019-02-16 19:19:56 +01:00
PascalWithopf
3afa167d6f
tcpflood: add new transport option relp-tls
Tcpflood can now send messages via relp with tls support.
A test was added aswell.

closes https://github.com/rsyslog/rsyslog/issues/3448
2019-02-16 11:03:56 +01:00
Rainer Gerhards
092b89d387
Merge pull request #3466 from rgerhards/i3451
omrelp: add capability to specify tlslib for librelp
2019-02-15 12:06:39 +01:00
Rainer Gerhards
065a367f53
testbench: slight relp test improvements 2019-02-14 17:33:46 +01:00
Rainer Gerhards
80c2d33692
omrelp: add capability to specify tlslib for librelp
closes https://github.com/rsyslog/rsyslog/issues/3451
2019-02-14 17:30:37 +01:00
Rainer Gerhards
5a418daf7a
imrelp: add capability to specify tlslib for librelp
see also https://github.com/rsyslog/rsyslog/issues/3451
2019-02-14 12:58:43 +01:00
Gabriel Intrator
c8171a970c omhttp: updates and improvements (#3423)
omhttp:  basically a rewrite with large feature enhancements
2019-02-14 10:51:04 +01:00
Rainer Gerhards
527f19c56a Merge branch 'legacyFormat_imuxsock' of https://github.com/jgerhards/rsyslog 2019-02-10 16:42:25 +01:00
Jan Gerhards
051a9517ee fix legacy shell expression
detected by CodeFactor
2019-02-07 18:19:12 +01:00
Jan Gerhards
db50310dd6 fix legacy shell command
detected by CodeFactor
2019-02-07 18:14:50 +01:00
Rainer Gerhards
992ddc8c51
Merge pull request #3449 from rgerhards/tb-mmdb
testbench: mmdb valgrind tests failed is srcdir env was not set
2019-02-01 17:47:32 +01:00
Jan Gerhards
234bee2e7a fix deprecated bash expression
detected by codefactor
2019-01-31 18:18:06 +01:00
Rainer Gerhards
12ab63ba59
testbench: mmdb valgrind tests failed is srcdir env was not set 2019-01-28 16:11:05 +01:00
Jan Gerhards
c4ee2686f9 fix deprecated bash expression
detected by codefactor
2019-01-26 16:54:02 +01:00