14971 Commits

Author SHA1 Message Date
Rainer Gerhards
e8ccaa8adc
Merge pull request #4622 from rgerhards/fix-typo
fix typo in error message
2021-07-01 12:33:19 +02:00
Rainer Gerhards
0df769e2dc
fix typo in error message 2021-07-01 11:35:46 +02:00
Kevin Guillemot
cf0a6386d3 OMMONGODB :: Fixes
- Fix Segmentation fault when server is down
 - Add server connexion check while resuming
2021-06-30 17:39:13 +02:00
Nelson Yen
80e4ce1769 mmkubernetes fix for apiserver error handling
submit on behalf of @abwaheed
- Added graceful handling of apiserver errors with unexpected responses,
  i.e., anything other than 200, 404, or 429. Idea is that apiserver
  transient error state will recover. We don't want mmkubernetes to miss
  metadata resolution for containers that don't have cached metadata.
  During these transient error states, mmkubernetes will provide basic
  container file path based resolution of namespace and pod metadata for
  new pods whose metadata is not yet cached. After this error state
  recovers, mmkubernetes is expected to resume its metadata resolution as
  expected.
- Added a unit test case for apiserver return 500 with changes to mock server
-  Fixed existing unit test that was failing due to missing expected results file
-  Added mmkubernetes unit tests to testbench
2021-06-29 18:14:25 -07:00
Rainer Gerhards
0bdb91f132
maintain ChangeLog 2021-06-28 14:54:41 +02:00
Rainer Gerhards
9f10cb02b1
Merge pull request #4611 from n2yen/dev-omkafka
omkafka - use rd_kafka_purge to drain librdkafka queues during HUP and improve kafka instance visibility.
2021-06-28 14:43:44 +02:00
Rainer Gerhards
7f0c2e3a82
Merge pull request #4614 from rgerhards/fix-test
testbench: simplify test
2021-06-24 16:02:09 +02:00
Rainer Gerhards
cb686e96b8
testbench: simplify test
make easier to understand and less verbose
2021-06-24 14:46:11 +02:00
Nelson Yen
4611c25128
omkafka updates
- drain librdkafka queues and retry later during rsyslog restart or hup.
- add statsname on per kafka instance for better visibility

- omkafka - count errors related ssl as "errors_ssl"
2021-06-23 10:50:13 -07:00
Rainer Gerhards
239feb2afb
maintain ChangeLog 2021-06-23 09:56:55 +02:00
Rainer Gerhards
b78fdde38a
Merge pull request #4407 from alorbach/pr-issue-4406
testbench: Add testcase for librelp EINPROGRESS issue
2021-06-23 09:36:50 +02:00
Rainer Gerhards
4b39586d24
Merge pull request #4575 from alorbach/pr-issue-4567
omhttp: Fix dynrestpath param in batch mode
2021-06-23 09:28:45 +02:00
Rainer Gerhards
e3d6c51c00
Merge pull request #4607 from rgerhards/no-travis
CI: disable Travis CI for the time being
2021-06-23 09:28:04 +02:00
Nelson Yen
91a2049877
percentile module to track percentile metrics via impstats
Brief overview:
TO configure tracking percentile metrics in rainerscript:
User would need to define:
  - which percentile to track, such as [p50, p99, etc.]
  - window size - note, this correlates directly with memory usage to
  track the percentiles.

To track a value, user would call built-in function `percentile_observe()` in their configurations to
record an integer value, and percentile metrics would be emitted every
impstats interval.
2021-06-23 00:14:39 -07:00
Rainer Gerhards
837a4c813a
CI: disable Travis CI for the time being
The Travis definitions and environments are heavily outdated. Also,
Travis is doing changes to their systems.

This is a good time to disable Travis builds, as everything is
covered by other CI runs as well. We need to reconsider if we
update Travis or keep working within the bounds of the rest of
the CI system. In other words: is Travis still worth it?
2021-06-17 09:55:38 +02:00
Rainer Gerhards
96895a2a0f
maintain ChangeLog 2021-06-17 09:54:01 +02:00
Rainer Gerhards
1aa1979179
Merge pull request #4605 from rgerhards/i4384
add predefined template RSYSLOG_SyslogRFC5424Format
2021-06-17 09:49:06 +02:00
Rainer Gerhards
e6a730f1bb
Merge pull request #4601 from rgerhards/fix-sender-stats
bugfix: _sender_stats reports integer counter as string
2021-06-17 09:40:39 +02:00
bda68f999d omhttp: Fix dynrestpath param in batch mode
When batchmode was used, the templates could not be used to
expand dynrestpath. We are now storing the restpath param
within the batch data if we are in batch mode.

- testbench: Added tests for omhttp dynrestpath param
  Testing setting the restpath by template - one with batch mode
  and one without batch mode
- When we are in batch mode, and the restpath value changes, the
  batch is submitted and reinitialized

closes: https://github.com/rsyslog/rsyslog/issues/4567
2021-06-16 11:43:08 +02:00
6e2a79376f testbench: Add testcase for librelp EINPROGRESS issue
closes: https://github.com/rsyslog/rsyslog/issues/4406
See also: https://github.com/rsyslog/librelp/issues/207
2021-06-16 09:40:29 +02:00
Rainer Gerhards
c5307338fc
bump version number for next schedule release cycle 2021-06-15 15:02:46 +02:00
Rainer Gerhards
29b1493cb7
add predefined template RSYSLOG_SyslogRFC5424Format
This is essentially the same as RSYSLOG_SyslogProtocol23Format with
a better name and a fix to remove the unnecessary LF at the end of
the message.

The different name also enables us to fix the LF issue without
any concern about backwards compatibility.

closes https://github.com/rsyslog/rsyslog/issues/4384
2021-06-14 13:54:32 +02:00
Rainer Gerhards
7fb25a2306
bugfix: _sender_stats reports integer counter as string 2021-06-14 13:10:31 +02:00
Rainer Gerhards
d01113948e
prepare for 8.2106.0 scheduled release v8.2106.0 2021-06-14 11:27:43 +02:00
Rainer Gerhards
929bcb9f17
maintain ChangeLog 2021-06-14 11:17:55 +02:00
Rainer Gerhards
1223026957
Merge pull request #4600 from rgerhards/i4598
new global option "parser.supportCompressionExtension"
2021-06-14 09:25:18 +02:00
Rainer Gerhards
50da918ae0
new global option "parser.supportCompressionExtension"
This permits to turn off rsyslog's single-message compression extension
when it interferes with non-syslog message processing (the parser
subsystem expects syslog messages, not generic text)

closes https://github.com/rsyslog/rsyslog/issues/4598
2021-06-09 14:05:44 +02:00
Rainer Gerhards
1361a4c256
maintain ChangeLog 2021-05-12 11:13:29 +02:00
Rainer Gerhards
1690814da8
Merge pull request #4589 from rgerhards/imtcp-more-input-params
imtcp: add more override config params to input()
2021-05-12 11:02:27 +02:00
Rainer Gerhards
8d48ecf10a
imtcp: add more override config params to input() 2021-05-10 12:30:17 +02:00
Rainer Gerhards
091036fe64
maintain ChangeLog 2021-05-06 12:33:00 +02:00
Rainer Gerhards
330a0f1684
Merge pull request #4585 from rgerhards/i3727-s3
imtcp: add stream driver parameter to input() configuration
2021-05-06 11:04:04 +02:00
Rainer Gerhards
a08591be5d
imtcp: add stream driver parameter to input() configuration
This permits to have different inputs use different stream drivers
and stream driver parameters.

closes https://github.com/rsyslog/rsyslog/issues/3727
2021-05-05 12:57:09 +02:00
Rainer Gerhards
6479373824
Merge pull request #4582 from rgerhards/i3727-s2-imtcp-global-wpool
imtcp refactoring w/ global worker pool
2021-04-27 14:05:32 +02:00
Rainer Gerhards
89be1d86d5
imtcp: permit to run multiple inputs in parallel
Previously, a single server was used to run all imtcp inputs. This
had a couple of drawsbacks. First and foremost, we could not use
different stream drivers in the varios inputs. This patch now
provides a baseline to do that, but does still not implement the
capability (in this sense it is a staging patch).

Secondly, we now ensure that each input has at least one exclusive
thread for processing, untangling the performance of multiple
inputs from each other.

This is part of the patch series to enable different driver
configurations for imtcp.

see also: https://github.com/rsyslog/rsyslog/issues/3727
2021-04-27 12:30:28 +02:00
Rainer Gerhards
14b159b10d
maintain ChangeLog 2021-04-27 12:13:58 +02:00
Rainer Gerhards
352a1683c4
Merge pull request #4584 from rgerhards/tcpsrv-fix
tcpsrv bugfix: potential sluggishnes and hang on shutdown
2021-04-27 12:12:55 +02:00
Rainer Gerhards
b160813f82
tcpsrv bugfix: potential sluggishnes and hang on shutdown
tcpsrv is used by multiple other modules (imtcp, imdiag, imgssapi, and,
in theory, also others - even ones we do not know about). However, the
internal synchornization did not properly take multiple tcpsrv users
in consideration.

As such, a single user could hang under some circumstances. This was
caused by improperly awaking all users from a pthread condition wait.
That in turn could lead to some sluggish behaviour and, in rare cases,
a hang at shutdown.

Note: it was highly unlikely to experience real problems with the
officially provided modules.

This patch corrects the situation.
2021-04-27 08:31:24 +02:00
Rainer Gerhards
a3323465c3
Merge pull request #4581 from rgerhards/i3727-refactor2
further refactoring of tcpsrv parameter passing
2021-04-26 09:57:51 +02:00
Rainer Gerhards
3470728d44
further refactoring of tcpsrv parameter passing
Some further stream-lining and cleanup of paramter passing. This
levels ground for more substantial changes to the imtcp/tcpsrv
interaction.

see also https://github.com/rsyslog/rsyslog/issues/3727#issuecomment-525705318
2021-04-26 09:05:01 +02:00
Rainer Gerhards
7f92f6ff4f
maintain ChangeLog 2021-04-22 09:39:29 +02:00
Rainer Gerhards
1aa210a37e
Merge pull request #4441 from rgerhards/i3727
phase 1: consolidate current imtcp input params in a single structure
2021-04-22 09:37:53 +02:00
Rainer Gerhards
fade5d200e
maintain ChangeLog 2021-04-22 09:20:30 +02:00
Rainer Gerhards
b1558d2265
bump version for next release number 2021-04-22 09:19:32 +02:00
Rainer Gerhards
c50bc2946b
Merge pull request #4574 from rgerhards/i4429
add case-insensitive regex functionality
2021-04-22 09:16:54 +02:00
Rainer Gerhards
926e207575
phase 1: consolidate current imtcp input params in a single structure
see also https://github.com/rsyslog/rsyslog/issues/3727
2021-04-22 08:44:55 +02:00
Rainer Gerhards
39896ca622
config script: add re_match_i() and re_extract_i() functions
This provides case-insensitive regex functionality.

closes https://github.com/rsyslog/rsyslog/issues/4429
2021-04-21 12:23:46 +02:00
Rainer Gerhards
47ad3727e4
build: do not build fmunflatten by default v8.2104.0 2021-04-19 12:01:07 +02:00
Rainer Gerhards
f8bc6196a5
prepare for 8.2104.0 scheduled stable 2021-04-19 11:12:53 +02:00
Rainer Gerhards
246c527918
maintain ChangeLog 2021-04-19 10:46:21 +02:00