2196 Commits

Author SHA1 Message Date
Rainer Gerhards
d75533fa69
Merge pull request #3809 from rgerhards/test3796
testbench: add tests for omelasticsearch error configs
2019-08-14 16:58:18 +02:00
Rainer Gerhards
721b2372b3
Merge pull request #3819 from rgerhards/tb-es-reduce_restart
testbench: add test for imuxsock legacy format
2019-08-14 16:16:42 +02:00
Rainer Gerhards
4816262912
Merge pull request #3821 from rgerhards/tb-gzipwr_large
testbench: make gzipwr_large test more reliable and improve plumbing
2019-08-14 14:44:42 +02:00
Rainer Gerhards
bc0efab9eb
testbench: improve testbench plumbing for gzip and fail cases
We have added new capabilities to the testbench plumbing to automatically
deal with gzip-compressed files. This also permits to use the wait_seq_check
function to work for gzip tests as well. The known-timing-sensitive
gzipwr_large test now makes use of the new capabilities. This enables us
to more reliably detect when we can savely shutdown the tested instance.

This commit also adds an ability to "abort" the full testbench run on
first test failure. This is especially useful during CI.
2019-08-14 12:57:49 +02:00
Rainer Gerhards
628631cd10
Merge pull request #3813 from rgerhards/tb-imptcp2
testbench imptcp: make port use more reliable
2019-08-14 12:51:14 +02:00
Rainer Gerhards
afdce50957
Merge pull request #3814 from rgerhards/tb-nitfixes
testbench: remove debug output; lessen kafaka tests output
2019-08-14 10:57:59 +02:00
Rainer Gerhards
b600203e0c
testbench: add test for imuxsock legacy format
This was never tested. Ensures we don't accidently break existing
configurations.
2019-08-13 18:16:19 +02:00
Rainer Gerhards
9699d1adf3
Merge pull request #3815 from rgerhards/tb-sndrcv-current
testbench: update sndrcv test to newest standard
2019-08-13 16:11:36 +02:00
Rainer Gerhards
fdf61606cf
testbench: add tests for omelasticsearch error configs
These test test errors described in
   https://github.com/rsyslog/rsyslog/pull/3796
2019-08-13 14:23:53 +02:00
Rainer Gerhards
ad5285f30e
testbench imptcp: make port use more reliable
also modernize some tests a bit
2019-08-13 13:28:06 +02:00
Rainer Gerhards
e3ebedd937
testbench: increase runtime for know-problematic test
this test often failed "unexpectedly" when the CI system is very
busy - assuming it just had insufficient time.
2019-08-13 10:03:39 +02:00
Rainer Gerhards
e8b9476d0c
testbench: update sndrcv test to newest standard
this makes the test more reliable in regard to port use. This is also
a model-commit which can be used to update other tests and base new
tests on it.
2019-08-13 09:46:20 +02:00
Rainer Gerhards
63d4726f7c
testbench: remove debug output; lessen kafaka tests output
the kafka tests generate a wealth of usually-unneeded output which
clutters the CI logs and makes them almost unusable.
2019-08-13 08:27:56 +02:00
Rainer Gerhards
5b720473c1
imptcp bugfix: port="0" parameter did not work as expected
when multiple interfaces and/or protocols could be bound, each of
them used a different listener ports were assigned. While this is
basically correct, it makes things unusable, especially as
listenPortFileName will only contain the port number used for
the latest listener.

This patch now follows the model of nsd_ptcp.c to assign only
the first port randomly and then use that port consistently.
2019-08-12 13:29:07 +02:00
Rainer Gerhards
db687cfc09
Merge pull request #3782 from rgerhards/i3756-testing
testbench: add multithreading tests with omfile async io/zip writing
2019-08-10 13:06:20 +02:00
Rainer Gerhards
130397b950
Merge pull request #3797 from rgerhards/tbsan-imptcp
imptcp bugfix: received bytes counter improperly maintained
2019-08-10 11:14:14 +02:00
Rainer Gerhards
b9a5e95cb2
Merge pull request #3803 from rgerhards/travis-fix
travis: libmongoc-dev does not install all needed
2019-08-09 13:05:02 +02:00
Rainer Gerhards
cfebaed413
travis: libmongoc-dev does not install all needed
there seem to be packaging changes in ubuntu or some other repos
we use on travis. This should fix the issue.
2019-08-09 12:33:20 +02:00
Rainer Gerhards
2ba1484a95
imptcp bugfix: received bytes counter improperly maintained
imptcp counts the number of bytes received. However, receives
happen on different worker thread. The access to the counter
was not synchronized, which can cause loss of updates. Also,
thread debuggers validly flag this as an error, which creates
problems under CI.

This commit fixes the situation via atomic operations and
falls back to mutex calls if they are not available.

Detected by LLVM thread sanitizer.

closes https://github.com/rsyslog/rsyslog/issues/3798
2019-08-09 10:39:57 +02:00
Rainer Gerhards
06ff736be8
Merge pull request #3788 from alorbach/imkafka-i3765
testbench: Added imkafka test with two rsyslog instances same consumergroup
2019-08-07 08:42:39 +02:00
Rainer Gerhards
36d2fe9c4c
Merge pull request #3793 from rgerhards/tb-omusrmsg
testbench: add basic tests for omusrmsg
2019-08-07 08:32:24 +02:00
Rainer Gerhards
c136aa899b
Merge pull request #3790 from rgerhards/tb-tsan
testbench: add thread analyzer blacklist
2019-08-05 18:39:33 +02:00
Rainer Gerhards
9eefc321b7
testbench: add thread analyzer blacklist
important step to get us started - in the future we will try to reduce
blacklisted parts
2019-08-05 14:41:46 +02:00
Rainer Gerhards
d814a0662b
testbench: add basic tests for omusrmsg 2019-08-05 09:27:48 +02:00
Rainer Gerhards
66d9e3b638
Merge pull request #3773 from n2yen/omhttp-enable-checkpath
Enable checkpath option in omhttp
2019-08-05 09:01:37 +02:00
Rainer Gerhards
e445501886
Merge pull request #3789 from rgerhards/tb-fix-impstats-use
testbench bugfix: some tests were executed when req module was missing
2019-08-05 08:30:20 +02:00
Rainer Gerhards
1bdf64722b
testbench bugfix: some tests were executed when req module was missing
In actual case if --enable-impstats was not given some other tests
failed.
2019-08-02 15:58:15 +02:00
Rainer Gerhards
545242d6f6
Merge pull request #3785 from rgerhards/tb-omfile-module-param
testbench: add test for omfile module parameters
2019-08-02 14:41:50 +02:00
feea8bd28d testbench: new imkafka test, 2 x rsyslog instances same consumergroup
First results showed that both instances get approx the same amount of messages, so the load
is load balanced through consumers in the consumergroup "rsysloggroup".

closes: https://github.com/rsyslog/rsyslog/issues/3765
2019-08-02 12:42:33 +02:00
Rainer Gerhards
26047bff3e
testbench: add multithreading tests with omfile async io/zip writing
see also https://github.com/rsyslog/rsyslog/issues/3772
2019-08-02 10:19:59 +02:00
Rainer Gerhards
182e5f25d5
testbench: add test for outchannel functionality 2019-08-02 10:02:02 +02:00
Rainer Gerhards
ece65a7a2f
testbench: add test for omfile module parameters
in this case "template" param is checked
2019-08-02 09:13:58 +02:00
Rainer Gerhards
2bd0505f04
Merge pull request #3774 from rgerhards/tb-modernize-nit
testbench: modernize test
2019-08-01 08:38:52 +02:00
Rainer Gerhards
799f3a111e
testbench: add some more tests for HUP handling 2019-07-31 10:41:05 +02:00
Rainer Gerhards
cdb5e8230c
testbench: add test for imrelp HUP handling
see also https://github.com/rsyslog/rsyslog/issues/3760
2019-07-30 12:12:51 +02:00
Rainer Gerhards
8df878be7b
testbench: modernize test 2019-07-30 09:00:01 +02:00
Nelson Yen
12ba857bdf Enable checkpath option in omhttp
omhttp, 'checkpath' option, was not configurable in the past.
- add 'checkpath' to the cnfparamdescr table.
- fix issue with checkpath passing extra garbage characters in string.
- add 'checkpath' into unit test - omhttp-retry.sh
2019-07-29 09:03:23 -07:00
major
43d7365f20 mmdarwin: add new module
This is a contributed module.
2019-07-24 13:30:09 +02:00
Rainer Gerhards
2b58c634f2
core/action: special handling for suspending action via ext file
We try to reduce potential problems during transaction commit be ensuring
that the action is only tried to be suspended at begin of transaction.
This also simplifies the code a bit and also reduces performance
impact of that "suspension via external state file" feature.
2019-07-22 16:25:55 +02:00
Rainer Gerhards
8c54ab7316
Merge pull request #3754 from rgerhards/imtcp-port-0
imtcp: enable listenPortFileName parameter
2019-07-19 09:53:12 +02:00
Rainer Gerhards
340c481d73
core/action: no error file written if act suspended on TX commit
when an action was already disabled while the action was tried to be
committed, no error file was written. Note that this state is highly
unlikely to happen. Most probably, it can only happen if parameter
action.externalstate.file is used.
2019-07-18 10:27:42 +02:00
Rainer Gerhards
7cb4cdfab7
imtcp: enable listenPortFileName parameter
this parameter was added, but it had no effect as it was not
passed down to the driver layer. This has been fixed. That also
now enables us to use dynamically-assigned port, which are
very useful for further testbench stabilization. Quite some
false positives occurred because the pre-selected port was
already in use again when rsyslog started.
2019-07-18 10:05:00 +02:00
Rainer Gerhards
e8320b77e4
function bugfix: "ipv42num" misspelled as "ip42mum" (without "v")
To fix the issue but keep compatible with existing deployments
both function names are now supported.

closes https://github.com/rsyslog/rsyslog/issues/3676
2019-07-02 16:19:17 +02:00
Rainer Gerhards
b4fea96907
Merge pull request #3672 from rgerhards/i3667-test
testbench: test for leading space issue in RFC 5424 parser
2019-07-01 09:13:25 +02:00
Rainer Gerhards
074bd807f8
testbench: fix clickhouse test
message checked was depending on clickhouse version; newer versions
emit differnet message. We are still dependent on clickhouse, but
hopefully now on a much more stable part of the message.
2019-06-30 11:12:11 +02:00
Rainer Gerhards
7a0fe5ac4f
testbench: check MsgDup() properly duplicates all properties
see also https://github.com/rsyslog/rsyslog/issues/3716
2019-06-26 16:45:55 +02:00
Rainer Gerhards
3836859af0
testbench framework: use ip tool instead of outdated ifconfig
The framework now first checks if "ip" is available and falls back
to "ifconfig" only if this is not the case.

Thanks to Michael Biebl for the suggestion.

closes https://github.com/rsyslog/rsyslog/issues/3682
2019-06-24 15:43:37 +02:00
Rainer Gerhards
d433ee83e8
testbench: add omfile tests based on real-world issue
see also https://github.com/rsyslog/rsyslog/issues/3686
2019-06-24 09:57:54 +02:00
Rainer Gerhards
12a7a4809e
testbench: test for leading space issue in RFC 5424 parser
see also https://github.com/rsyslog/rsyslog/pull/3671
see also https://github.com/rsyslog/rsyslog/pull/3667
2019-06-18 14:43:19 +02:00
Rainer Gerhards
b43ee45a03
testbench: fix tests affected by commit 8791323c92039
commit 8791323c92039 fixed invalid handling of first space in MSG.
This broke some test, but was not detected at the time of its merge.
This is now fixed with this follow-up commit.
2019-06-17 13:18:23 +02:00