12442 Commits

Author SHA1 Message Date
Rainer Gerhards
bd71022727 omongodb: use array-mode config interface where it makes sense 2018-06-25 09:57:52 +02:00
Hugo Soszynski
1b5f226693 Correcting line length 2018-06-25 09:57:52 +02:00
Hugo Soszynski
08ca400489 Added new directive to the README 2018-06-25 09:57:52 +02:00
Hugo Soszynski
0b2a79d8d8 Added new configuration option "allowed_error_codes".
The behavior of ommongodb was for a long time to abort on MongoDB insertion error; keeping this behavior, I wanted to add the possibility to ignore some error code that may be allowed in some configuration (ex. 11000 DuplicateKey in case of collection containing a unique filed).
The directive arguments MUST be in the following format (handling a maximum of 256 codes): "11000,...,17,64"
2018-06-25 09:57:52 +02:00
Rainer Gerhards
9411a6e5b6
Merge pull request #2788 from jgerhards/errmsg-mmnormalize
mmnormalize: use new errmsg interface
2018-06-23 10:55:57 +02:00
Rainer Gerhards
98d944bc55
Merge pull request #2785 from alorbach/openssl-fixes
openssl: fixed coverty issues
2018-06-22 19:01:25 +02:00
341e6a3f70 openssl: fixed coverty issues 190592, 190593, 190594 2018-06-22 14:40:08 +02:00
Rainer Gerhards
7620caeb29 maintain ChangeLog 2018-06-22 11:21:30 +02:00
Rainer Gerhards
978cca35a7
Merge pull request #2405 from rgerhards/testbench-improve
some testbench improvements
2018-06-22 11:18:35 +02:00
Jan Gerhards
8cd04da2c4 mmnormalize: use new errmsg interface
see also https://github.com/rsyslog/rsyslog/issues/1684
2018-06-21 17:21:21 +02:00
Rainer Gerhards
9cf9f2e8b7 testbench: change elasticsearch tests to use new plumbing
This makes the ES tests more universally available (they should now
also support running in containers). It also simplifies the tests
as fewer support files are needed.
2018-06-18 17:12:08 +02:00
Rainer Gerhards
32a4f35d26
Merge pull request #2779 from rgerhards/travis-openssl
travis: add checks for openssl drivers
2018-06-18 11:16:36 +02:00
Rainer Gerhards
8d49eb61d4 testbench: run test that require IPv6 stack only when available
First test was introduced in openssl work; failed when no IPv6 was
present.  Now it skips.
2018-06-18 09:34:03 +02:00
Rainer Gerhards
4816291576 openssl subsystem: fix build issue 2018-06-17 14:37:42 +02:00
Rainer Gerhards
31ce76d135 travis: add checks for openssl drivers 2018-06-17 14:35:43 +02:00
Rainer Gerhards
358f4c0a62
Merge pull request #2781 from jgerhards/errmsg-nsd_ossl
nsd_ossl: use new errmsg interface
2018-06-17 14:34:18 +02:00
Jan Gerhards
8b5692a26a nsd_ossl: use new errmsg interface
see also https://github.com/rsyslog/rsyslog/issues/1684
2018-06-17 12:43:09 +02:00
Rainer Gerhards
471a116830
Merge pull request #2777 from rgerhards/nsd-gtls-misadressing
nds_gtls: fix regression that could lead to attack (never released)
2018-06-15 08:48:21 +02:00
Rainer Gerhards
9da5eb8cd6 devtools: permit to override default container 2018-06-14 15:15:53 +02:00
Rainer Gerhards
63ad5ecf6d nds_gtls: fix regression that could lead to attack (never released version)
Commit 7589f42e45888b83f5c2a0d788896d41e6a6a598 introduced support
for loading certificate chains. Unfortunatley the max number of permitted
certificates was miscalculated and so a certificate chain with more than
10 certificates could lead to a buffer overrun. This patch corrects this.

Note that the commit was merged just yesterday and there was no release
with the affected code.

Also, this commit adds  GNUTLS_X509_CRT_LIST_IMPORT_FAIL_IF_EXCEED to
ensure the certificate export will fail with an error message if the
certificate list contains too many certificates. Thx to Arne Nordmark
for suggesting that option.
2018-06-14 14:19:22 +02:00
Rainer Gerhards
6442c85194
Merge pull request #2778 from sjvs/update-lgtm.yml-libfastjson
Update lgtm.yml for LGTM.com analysis (with more recent libfastjson-dev)
2018-06-14 14:17:06 +02:00
Bas van Schaik
556f87aa28 try installing tcl-dev for --enable-omtcl 2018-06-14 12:35:46 +01:00
Bas van Schaik
556227411b Try --enable-mmgrok --enable-omtcl as well 2018-06-14 12:26:24 +01:00
Bas van Schaik
1e8b463b24 enable openssl 2018-06-14 12:17:04 +01:00
Bas van Schaik
404587ce17 enable some more configure options to see whether they work 2018-06-14 12:06:47 +01:00
Bas van Schaik
153be3e911 LGTM.com upgraded to Ubuntu 18.04 (with more recent libfastjson-dev) 2018-06-14 12:00:35 +01:00
Rainer Gerhards
171c5ebb61 maintain ChangeLog 2018-06-14 11:32:25 +02:00
Rainer Gerhards
82c5762b53
Merge pull request #2724 from rgerhards/i2464
imfile bugfix: if freshStartTail is set some initial file lines missing
2018-06-14 11:17:18 +02:00
Rainer Gerhards
6ef71a3364 maintain ChangeLog 2018-06-14 09:21:12 +02:00
Rainer Gerhards
10e99bdf20
Merge pull request #2733 from richm/omelasticsearch-bulk-retry
omelasticsearch: write op types; bulk rejection retries
2018-06-14 09:04:49 +02:00
Rich Megginson
6d4635efbb omelasticsearch: write op types; bulk rejection retries
Add support for a 'create' write operation type in addition to
the default 'index'.  Using create allows specifying a unique id
for each record, and allows duplicate document detection.

Add support for checking each record returned in a bulk index
request response.  Allow specifying a ruleset to send each failed
record to.  Add a local variable `omes` which contains the
information in the error response, so that users can control how
to handle responses e.g. retry, or send to an error file.

Add support for response stats - count successes, duplicates, and
different types of failures.

Add testing for bulk index rejections.
2018-06-13 09:48:23 -06:00
Rainer Gerhards
779c70718d
Merge pull request #2763 from rgerhards/i2762
gnutls driver: support intermediate certificates
2018-06-13 17:34:49 +02:00
Rainer Gerhards
8cebaebaf3 require inotify for tests that need it 2018-06-13 14:57:09 +02:00
Rainer Gerhards
0d765f194a fix build issues
these were introduced in 7589f42e45888b83f5c2a0d788896d41e6a6a598
2018-06-13 14:17:56 +02:00
Arne Nordmark
ec9c22df6e gnutls driver: support intermediate certificates
this is necessary for certificate chains

closes https://github.com/rsyslog/rsyslog/issues/2762
2018-06-13 14:16:52 +02:00
Rainer Gerhards
29926740f3 maintain ChangeLog 2018-06-13 14:16:35 +02:00
2f30c4270a add openssl TLS driver (#2761)
add openssl TLS driver

Also fixes some nits in existing testbench tests (e.g. expired test certs) and extend tcpflood to support openssl as well.

closes: https://github.com/rsyslog/rsyslog/issues/1390
closes: https://github.com/rsyslog/rsyslog/issues/1840
closes: https://github.com/rsyslog/rsyslog/issues/1352
closes: https://github.com/rsyslog/rsyslog/issues/1702
closes: https://github.com/rsyslog/rsyslog/issues/2547
2018-06-13 13:20:23 +02:00
Rainer Gerhards
55ab00c813
Merge pull request #2769 from jgerhards/errmsg-imkafa
imkafka: use new errmsg interface
2018-06-13 12:39:30 +02:00
Rainer Gerhards
44448b0a80 maintain ChangeLog 2018-06-12 18:41:05 +02:00
Rainer Gerhards
495c6bf93d
Merge pull request #2751 from jsiwrk/feature/omprog_simplify_skeleton
omprog: simplify 'plugin-with-feedback.py' example
2018-06-12 18:39:49 +02:00
Rainer Gerhards
5b78d5c6ee
Merge pull request #2764 from richm/mmkubernetes-use-version-2
use version=2 in mmkubernetes rulebase files
2018-06-12 18:35:58 +02:00
Jan Gerhards
0be9aab994 imkafka: use new errmsg interface
see also https://github.com/rsyslog/rsyslog/issues/1684
2018-06-12 15:01:56 +02:00
Rainer Gerhards
ce01365296 maintain ChangeLog 2018-06-12 14:42:29 +02:00
Rainer Gerhards
03636846ba
Merge pull request #2727 from rgerhards/imfile-fix-double-free
imfile bugfix: double-free on module shutdown
2018-06-12 14:41:08 +02:00
Rainer Gerhards
63873f08ee maintain ChangeLog 2018-06-11 19:13:13 +02:00
Rainer Gerhards
ef376a007b
Merge pull request #2767 from rgerhards/i2760
core: fix message loss on target unavailibility during shutdown
2018-06-11 19:11:36 +02:00
Rainer Gerhards
59627f23be core: fix message loss on target unavailibility during shutdown
Triggering condition:
- action queue in disk mode (or DA)
- batch is being processed by failed action in retry mode
- rsyslog is shut down without resuming action

In these cases messages may be lost by not properly writing them
back to the disk queue.

closes https://github.com/rsyslog/rsyslog/issues/2760
2018-06-11 13:25:32 +02:00
Rainer Gerhards
1e378c8e25 maintain ChangeLog 2018-06-11 13:23:51 +02:00
Rainer Gerhards
ae8580e7f5
Merge pull request #2755 from rgerhards/i2742
core: misadressing when writing disk queue files
2018-06-11 13:21:10 +02:00
Rainer Gerhards
1ffa0acc96 testbench: add suppressions for valgrind false positives on CentOS 6
Added them after intensive checking that these are indeed false positives.
Among other, checks via TSAN as well as intensive manual debugging of that
issue. Also, no other platform shows the issues. So I conclude that it is
safe to suppress it.
2018-06-11 10:47:17 +02:00