649 Commits

Author SHA1 Message Date
Rainer Gerhards
dfe89f29e0
Merge pull request #2071 from rgerhards/es-testbench-additions
testbench: improvements in elasticsearch testing
2017-11-24 10:43:15 +01:00
Rainer Gerhards
a811fb8fb7 testbench: add basic test for omelasticsearch with ES 6.0 2017-11-21 15:29:48 +01:00
Rainer Gerhards
1f859e7ad6 testbench/kafka: add valgrind test for kafka
Note: we need to add a supression file for a memory leak that looks
like it is caused by librdkafka.
See https://github.com/edenhill/librdkafka/issues/1536
for more details.

Once this issue is finally resolved, we should revisit the approach taken.

closes https://github.com/rsyslog/rsyslog/issues/2050
2017-11-21 13:12:29 +01:00
Rainer Gerhards
fb621b7bc7
Merge pull request #1393 from artbristol/tls-client-sni
Support SNI when connecting as a client
2017-11-14 10:40:40 +01:00
Rainer Gerhards
5b4192519a omelasticsearch: fix memory leak and potential misadressing
Commit 96b5fce introduced regressions, leading to potential misadressing
and a very probable memory leak. This commit fixes the issues and
hardens the module to better detect some error cases in the
future.

It also adds valgrind-based testbench tests which ensure that no
pointer errors exist. If they had been in place, the regressions
would never have been undetected.

Note that commit 96b5fce was introduced in 8.23.0 on Nov, 15th 2016.

Many thanks to Yaroslav Bo for alerting me on the root problem and
providing a very good analysis and guidance.

see also https://github.com/rsyslog/rsyslog/issues/1906
closes https://github.com/rsyslog/rsyslog/issues/1962
see also https://github.com/rsyslog/rsyslog/issues/1964
2017-11-12 12:12:32 +01:00
Rainer Gerhards
bd30e9c8ea
Merge pull request #2014 from rgerhards/i-1822bis
core/msg: fix segfault in MsgSetPropsViaJSON
2017-11-11 14:29:30 +01:00
Rainer Gerhards
67260eee4a testbench: add tests for segfault in MsgSetPropsViaJSON
Test for the root problem fixed in previous commit.

See also https://github.com/rsyslog/rsyslog/issues/1822
2017-11-11 10:24:45 +01:00
Rainer Gerhards
041f1c8f2e
Merge pull request #1990 from rgerhards/testbench-threaddebug
testbench: add threading correctness dynamic tests
2017-11-11 10:13:59 +01:00
Rainer Gerhards
2f76d61821 testbench: add threading correctness dynamic tests
utilizing the valgrind helgrind debugger

closes https://github.com/rsyslog/rsyslog/issues/1971
see also https://github.com/rsyslog/rsyslog/issues/2012
2017-11-10 19:03:01 +01:00
Rainer Gerhards
d413df23d2 testbench: add valgrind-test for imjournal 2017-11-10 14:13:09 +01:00
Rainer Gerhards
d65dc24616
Merge pull request #1925 from mrworkman/rscript-parse-time
Add RainerScript parse_time() function to convert date/time strings to UNIX time.
2017-11-08 08:38:56 +01:00
Stephen Workman
b2e7c05263 Add parse_time() RainerScript function. 2017-11-06 13:01:00 -05:00
Jan Gerhards
ed1bfe36db mmanon: add support for IPv6 wih embedded IPv4 2017-11-05 17:53:15 +01:00
Art O Cathain
7f7784f5f1 Revert accidental whitespace changes 2017-11-05 16:40:33 +00:00
Art O Cathain
ba0436eb63 Merge remote-tracking branch 'origin/master' into tls-client-sni
# Conflicts:
#	tests/Makefile.am
2017-11-05 14:55:57 +00:00
Rainer Gerhards
bf9fd03639 testbench: implement basic test for imjournal
this ensures that the module is at least loading and doing
part of its work.

see also https://github.com/rsyslog/rsyslog/issues/1895
closes https://github.com/rsyslog/rsyslog/issues/164
2017-10-26 08:47:29 +02:00
PascalWithopf
03a5c4332b omrelp: add test for certificate check
Test checks that there is no Segmentation Fault when a certificate cannot be accessed.
2017-10-25 11:48:13 +02:00
Rainer Gerhards
f4f53b06eb Merge pull request #1859 from rgerhards/i-1832
omfile: hande file open error via SUSPEND mode
2017-10-19 13:34:39 +02:00
Rainer Gerhards
75ed9c0955 omfile: hande file open error via SUSPEND mode
For a while, this lead to suspension as the data error was
not detected by the rule engine. This has changed with fixes
in 8.30.0. I asked users what they prefer (and expect) and
everyone meant it should still be handled via suspension. See
github tracker below for more details.

closes https://github.com/rsyslog/rsyslog/issues/1832
2017-10-18 11:34:07 +02:00
Rainer Gerhards
4b564e760a testbench: add test for nested ruleset termination
see also https://github.com/rsyslog/rsyslog/issues/1122
2017-10-18 11:08:42 +02:00
Rainer Gerhards
78da65a19a Merge pull request #1814 from mrworkman/rscript-format-time
WIP: Add RainerScript format_time() funcion to format UNIX timestamps.
2017-10-16 10:05:09 +02:00
Rainer Gerhards
0017262e2c testbench: add test for DATAFAIL handling in action object 2017-10-12 13:26:10 +02:00
Rainer Gerhards
c30a882b59 testbench: remove inconsistent omfile test
see also https://github.com/rsyslog/rsyslog/issues/1832
2017-10-12 13:26:10 +02:00
Stephen Workman
8391e0fdf1 Initial testing of format_time(). 2017-10-04 13:04:44 -04:00
Rainer Gerhards
3d1007ab70 Merge pull request #1803 from rgerhards/i-120
omrelp: fix segfault when rebindinterval parameter is used
2017-10-04 08:30:04 +02:00
Rainer Gerhards
50d10a6113 testbench: add test for omrelp rebind interval paramter 2017-09-29 11:37:38 +02:00
Thomas Deutschmann
023707617c
testbench: Run mmnormalize tests only when mmnormalize module was actually enabled
This commit fixes a regression caused by commit 835e645b73babf1290b691ef2ef137da206f6eff
and will restore the removed if nesting necessary to run mmnormalize tests
only when mmnormalize module was actually enabled.

Bug: https://bugs.gentoo.org/631246
2017-09-24 19:20:08 +02:00
Jan Gerhards
f9ba3dbe52 mmanon: add support for ipv6
see also https://github.com/rsyslog/rsyslog/issues/1723
closes https://github.com/rsyslog/rsyslog/issues/1614
2017-09-02 11:53:57 +02:00
Jan Gerhards
21d64f3e8a mmanon: rewrite ipv4-anonymization
for more information, see https://github.com/rsyslog/rsyslog/issues/1723

closes https://github.com/rsyslog/rsyslog/issues/1717
closes https://github.com/rsyslog/rsyslog/issues/1720
2017-08-24 10:48:34 +02:00
Rainer Gerhards
1e07622112 Merge pull request #1712 from jgerhards/trim
Rainerscript: add ltrim and rtrim functions
2017-08-21 14:34:47 +02:00
Jan Gerhards
994561f8bf testbench: add test for ltrim and rtrim functions 2017-08-14 14:31:15 +02:00
Rainer Gerhards
cbd00f8e2d Merge pull request #1707 from PascalWithopf/i-1093
omfwd, imtcp: add possibility to use priority string
2017-08-08 16:48:02 +02:00
PascalWithopf
717092d93e gnutls: add possibility to use priority string 2017-08-08 14:57:15 +02:00
Rainer Gerhards
e2d08a4d71 Merge pull request #1693 from alorbach/imfile-i1672
imfile: Fixed wildcard detection issue on path wildcards
2017-08-01 17:31:16 +02:00
Rainer Gerhards
96d11c43b2 Merge pull request #1465 from PascalWithopf/pmnormalize
pmnormalize: new parser module
2017-08-01 17:12:29 +02:00
8f2be648cd imfile: Fixed wildcard detection issue on path wildcards
Wildcards mode was not properly detected when wildcards
were only used in a directory name on startup.
This caused imfile not to create a propper dynamic filewatch.

Closes: https://github.com/rsyslog/rsyslog/issues/1672
2017-07-25 15:42:06 +02:00
Rainer Gerhards
025ed2a933 impstats bugfix: impstats does not handle HUP
If the parameter "log.file" is specified, impstats writes its own
log file. However, HUP is not handled for this file, which makes
the functionality unusable with log rotation. It is also counter-
intuitive for users.

This patch enables correct HUP processing. As a sideline, it also
introduces a generic HUP processing framework for non-action type
of loadable modules.

closes https://github.com/rsyslog/rsyslog/issues/1662
closes https://github.com/rsyslog/rsyslog/issues/1663
2017-07-20 14:22:19 +02:00
Rainer Gerhards
40bf7eab1f Merge pull request #1673 from rgerhards/i-1573
core bugfix: segfault after configuration errors
2017-07-19 15:05:50 +02:00
Rainer Gerhards
b1d9cb4452 Merge pull request #1674 from PascalWithopf/i-477
imklog: Fix permitnonkernelfacility not working
2017-07-19 14:54:45 +02:00
PascalWithopf
d4cc699129 pmnormalize: add new parser module pmnormalize 2017-07-19 08:58:20 +02:00
PascalWithopf
399f6023fd imklog: test for parameter permitnonkernelfacility 2017-07-18 15:26:47 +02:00
Rainer Gerhards
cbcc9a6d20 testbench: add test for very early startup messages
... and failures of getaddrinfo() when obtaining hostname.

This requires a number of testing LD_PRELOD libraries, which just
simulate system error. The actual test is rather small.

see also https://github.com/rsyslog/rsyslog/issues/1573
2017-07-18 14:50:09 +02:00
Rainer Gerhards
231ab1d1cb Merge pull request #1669 from jgerhards/newdelimiter
imptcp: add parameter "multiline"
2017-07-18 14:45:04 +02:00
Jan Gerhards
250957d120 imptcp: add parameter "multiline"
experimental new functionality: modify octet-stuffed framing to
heuristically detect embedded newlines
2017-07-16 13:00:00 +02:00
Rainer Gerhards
d9979cef22 testbench: add test for known message-garbling case
see also https://github.com/rsyslog/rsyslog/issues/1658
2017-07-12 08:29:06 +02:00
Rainer Gerhards
b5096fa6ee ksi subsystem: remove no longer needed code
The KSI subsystem has been replaced by a newer Guardtime-provided
subsystem. Note that the old KSI subsystem does no longer work
to to Guardtime backend changes.

Libgt still continous to work.

closes https://github.com/rsyslog/rsyslog/issues/1590
2017-07-03 08:12:03 +02:00
f19ead2551 imfile: Added test for dynamic renamed files (wildcard)
Added check for IN_MOVED_TO in in_handleDirEvent. Statefilename and
event cookie are saved in IN_MOVE_FROM event in a linkedlist now,
so the statefile can be renamed to a new name in IN_MOVED_TO event.

Closes https://github.com/rsyslog/rsyslog/issues/1417
2017-06-23 11:21:28 +02:00
Rainer Gerhards
d060be7920 Merge pull request #1609 from alorbach/kafka-extension-omkafka
Kafka extension omkafka
2017-06-21 08:16:53 +02:00
8ecf0aeb34 kafka: Added option enable static linking of librdkafa (disabled by default).
Also saving failed msgs now when kafka produce fails. No message loss should
be possible anymore.

Also removed old kafka tests and readded new kafka tests.
If kafka instances cannot be started (happens from time to time when
kafka/zookepper sync fails), tests will be skipped instead of failing.

Closes https://github.com/rsyslog/rsyslog/issues/1559
Closes https://github.com/rsyslog/rsyslog/issues/1584
Closes https://github.com/rsyslog/rsyslog/issues/1515
May fix https://github.com/rsyslog/rsyslog/issues/1230
Closes https://github.com/rsyslog/rsyslog/issues/1052
2017-06-19 17:14:35 +02:00
Shane Lawrence
ed5ea46a65 Fix mangled pmsnare messages when tabs not escaped. 2017-06-05 11:44:11 -04:00