1050 Commits

Author SHA1 Message Date
Rainer Gerhards
1813e7cc40 maintain ChangeLog 2017-10-18 08:03:49 +02:00
Rainer Gerhards
b53c48a910 prepare for 8.30.0 release 2017-10-16 13:44:44 +02:00
Rainer Gerhards
ad040017e8 Merge pull request #1807 from rgerhards/case-sensitive
handle (JSON) variables in case-insensitive way
2017-10-16 11:09:56 +02:00
Rainer Gerhards
6fe8153be9 handle (JSON) variables in case-insensitive way
The variable system inside rsyslog is JSON based (for easy consumption
of JSON input, the prime source of structured data). In JSON, keys
("variable names") are case-sensitive. This causes constant problems
inside rsyslog configurations. A major nit is that case-insensitivity
option inside templates (even if turned on) does not work with JSON
keys because they of inner workings*1.

It is much more natural to treat keys in a case-INsensitive way (e.g.
"$!Key" and "$!key" are the same). We do not expect any real problems
out of this, as key names only differing in case is highly unlikely.
However, as it is possible we provide a way to enable case-sensitivity
via the global(variables.casesensitve="on") global config object.

Note that the default is to do case-insensitive matches. The reason
is that this is the right thing to do in almost all cases, and we do
not envision any problems at all in existing deployments.

*1 Note: case-insensitivity in rsyslog is achieved by converting all
names to lower case. So that the higher speed of strcmp() can be used.
The template option does actually that, convert the template keys to
lower case. Unfortunately, this does not work with JSON, as JSON keys
are NOT converted to lower case.

closes https://github.com/rsyslog/rsyslog/issues/1805
2017-10-13 09:39:56 +02:00
Michael Biebl
775705e1d9 configure: move message modification modules to right spot in summary
closes https://github.com/rsyslog/rsyslog/issues/1648
2017-10-05 13:03:08 +02:00
Jiri Vymazal
83388eabe9 enabling falback to older systemd version without restart-less
persistent journal switch
2017-09-07 12:19:18 +02:00
Jiri Vymazal
92ac8016e4 Made switching to persistent journal in runtime possible,
now you can continue logging after switch to persistent
journal without need to restart rsyslog service.
Bumped correspondidng systemd version dependency.
2017-09-05 14:12:31 +02:00
Rainer Gerhards
5ffa5114a1 bump version for next release cycle 2017-08-08 17:15:55 +02:00
Rainer Gerhards
c4ba96f621 prepare for 8.29.0 release 2017-08-08 14:39:34 +02:00
Rainer Gerhards
96d11c43b2 Merge pull request #1465 from PascalWithopf/pmnormalize
pmnormalize: new parser module
2017-08-01 17:12:29 +02:00
Rainer Gerhards
cf2197d740 testbench bugfix: hang in tests if omstdout is not present
Many tests depend on omstdout. Given the fact that omstdout
is really only useful for the testbench (at least that's the intent),
we now require --enable-omstdout if --enable-testbench is given.

The alternative would have been to disable all those tests that
need it, which would have lead to considerable less testbench
coverage.

closes https://github.com/rsyslog/rsyslog/issues/1649
2017-07-20 14:31:08 +02:00
PascalWithopf
d4cc699129 pmnormalize: add new parser module pmnormalize 2017-07-19 08:58:20 +02:00
Rainer Gerhards
b5096fa6ee ksi subsystem: remove no longer needed code
The KSI subsystem has been replaced by a newer Guardtime-provided
subsystem. Note that the old KSI subsystem does no longer work
to to Guardtime backend changes.

Libgt still continous to work.

closes https://github.com/rsyslog/rsyslog/issues/1590
2017-07-03 08:12:03 +02:00
Rainer Gerhards
e9617cf5f2 bump version number for new development cycle 2017-06-27 16:07:28 +02:00
Rainer Gerhards
5f91d47283 prepare for 8.28.0 release 2017-06-27 15:40:40 +02:00
Rainer Gerhards
d060be7920 Merge pull request #1609 from alorbach/kafka-extension-omkafka
Kafka extension omkafka
2017-06-21 08:16:53 +02:00
8ecf0aeb34 kafka: Added option enable static linking of librdkafa (disabled by default).
Also saving failed msgs now when kafka produce fails. No message loss should
be possible anymore.

Also removed old kafka tests and readded new kafka tests.
If kafka instances cannot be started (happens from time to time when
kafka/zookepper sync fails), tests will be skipped instead of failing.

Closes https://github.com/rsyslog/rsyslog/issues/1559
Closes https://github.com/rsyslog/rsyslog/issues/1584
Closes https://github.com/rsyslog/rsyslog/issues/1515
May fix https://github.com/rsyslog/rsyslog/issues/1230
Closes https://github.com/rsyslog/rsyslog/issues/1052
2017-06-19 17:14:35 +02:00
732d0e21a7 omkafka: Enhanced support to detect kafka broker problems.
Also fixed tryresume and doAction handling when action is
in suspend state.

Calling for Callbacks more often.

Adjusted kafka fail test settings.

diag.sh script detects of kafka server comes up proberly

Added liblz4 to dependencies for omkafka/imkafka needed
for static linking.

This addresses the omkafka queue problem from issue:
https://github.com/rsyslog/rsyslog/issues/1052
Yet it does not fully solve the message problem yet,
but I am working on this.
2017-06-08 15:35:45 +02:00
Allan Park
f11a911add bugfix build system: add libksi only to those binaries that need it
Previously, libksi was added to all binaries when --enable-ksi-ls12
was activated.

closes https://github.com/rsyslog/rsyslog/issues/1600
2017-06-04 11:30:41 +02:00
Rainer Gerhards
97f1c3f67f Merge pull request #1589 from rgerhards/mmdb-enh
mmdblookup: enhancements and fixes
2017-06-01 14:26:28 +02:00
Rainer Gerhards
aecdbdf360 mmdblookup: upgrade from contrib module to fully supported one 2017-05-31 13:43:05 +02:00
Nate Brown
b323f53ca7 relp version bump 2017-05-30 20:44:21 -07:00
Rainer Gerhards
24780ef71d Merge pull request #1569 from rgerhards/nitfixes
cosmetic: build system still used JSON_C name
2017-05-19 10:17:33 +02:00
Thomas Deutschmann
15e2e8fc70
configure: imkafka: Only check for rdkafka library when package config check has failed 2017-05-17 23:56:03 +02:00
Thomas Deutschmann
a2d61589ae
configure: omkafka: Check for rdkafka package config first
We are currently only checking for librdkafka package config file but
the file was renamed to rdkafka long time ago.

This commit will make sure that we check for the current pc file first,
check for old name second and fall back to the library check as last
resort.
2017-05-17 23:49:03 +02:00
Rainer Gerhards
3ac9051b12 cosmetic: build system still used JSON_C name
... but used it for libfastjson. This was a left-over when we
could use both json-c and libfastjson. As github user hdatma
pointed out, this was confusing to users. This has now been
changed to LIBFASTJSON. No functional changes.
2017-05-16 11:05:57 +02:00
Rainer Gerhards
2bd07153bf bump version mumber for next dev cycle 2017-05-16 10:44:50 +02:00
Rainer Gerhards
063f4701e3 prepare for 8.27.0 release and merge branch 'master' into v8-stable 2017-05-15 11:44:03 +02:00
Rainer Gerhards
7b6f76f4b9 Merge pull request #1554 from rgerhards/osx
make rsyslog build on osx
2017-05-15 11:27:56 +02:00
Rainer Gerhards
470c7be57c build system adaptions for osx 2017-05-15 10:22:20 +02:00
Rainer Gerhards
caff8cf37b travis: add testing on osx 2017-05-15 09:05:00 +02:00
Rainer Gerhards
a744313570 Merge pull request #1558 from alorbach/kafka-extension
imkafka input module extension
2017-05-12 15:20:32 +02:00
a4614d78cf imkafka: Code cleanup and makefile corrections
Added --enable-omkafka back and added --enable-imkafka to configure
options. Only if both are enabled, kafka tests can be used and run.

testbench: replaced old kafka tests with new ones using imkafka/omkafka

imkafka: Added support to custom parameters from confParam

confParam works simular like in omkafka and can be used to set
custom parameters.

testbench: Added missing new kafka testfile
2017-05-12 14:23:37 +02:00
Allan Park
263c18fc0c Added new module: KSI log signing ver. 1.2 (lmsig_ksi_ls12) 2017-05-11 16:50:41 +00:00
f5438bdea2 imkafka: Initial version if imkafka added
Basic features need to be added now.

testbench: Added kafka test with multi kafka instances

All kafka instances are connected to one zookeeper instance.
Diag script has been adjusted to propper start/stop single
kafka instances.

autotools: Added version check for librdkafka to be higher than 0.9.1
2017-05-09 11:15:20 +02:00
Rainer Gerhards
9f95005ebf Merge pull request #1511 from PascalWithopf/solaris
workaround for solaris testbench
2017-04-13 16:20:55 +02:00
Rainer Gerhards
8d67c03d45 solaris: fix coding issues 2017-04-11 10:18:42 +02:00
Rainer Gerhards
925b1ba094 build: solaris sunstudio compiler requires different pthread handling 2017-04-10 10:33:58 +02:00
Rainer Gerhards
684d8852c5 build: do not use GCC-specific functions for non-GCC compatible compilers 2017-04-10 09:16:42 +02:00
Rainer Gerhards
b26c2a210c bump version numbers for next development cycle 2017-04-04 10:14:06 +02:00
Rainer Gerhards
29cf17d118 Merge branch 'master' into v8-stable 2017-04-03 09:11:06 +02:00
Rainer Gerhards
344715d402 Merge pull request #1458 from BastianStender/network_namespaces
omfwd: add support for network namespaces
2017-04-02 10:43:04 +02:00
Pascal Withopf
0de9a5bcd7 mmnormalize: add possibility to get rule from array 2017-03-31 09:30:09 +02:00
Bastian Stender
df17a40c7f omfwd: add support for network namespaces
Network namespaces are part of the linux kernel since v2.6.24. This
enables forwarding output into a configurable network namespace. E.g.,

action(type="omfwd" networknamespace="my_ns" target="192.168.1.23"
port="10514")

Signed-off-by: Bastian Stender <bst@pengutronix.de>
2017-03-20 14:30:57 +01:00
Rainer Gerhards
2655368367 bump version number for next development cycle 2017-02-23 13:10:04 +01:00
Rainer Gerhards
f19c678b02 prepare for 8.25.0 release 2017-02-21 14:56:01 +01:00
Rainer Gerhards
1aafa2c4d8 bump version number for new release cycle 2017-01-10 19:04:15 +01:00
Rainer Gerhards
2c9d613d29 prepare for 8.24.0 release 2017-01-10 10:09:31 +01:00
Rainer Gerhards
b583093fea Merge pull request #1099 from chenryn/master
new maxminddb lookup message modify plugin
2016-12-23 09:39:10 +01:00
Pascal Withopf
af6f07df1b pmnull: add null parser module
closes https://github.com/rsyslog/rsyslog/issues/1275
2016-12-09 14:59:30 +01:00