19292 Commits

Author SHA1 Message Date
Ulrike Gerhards
fdc50a32c4
refactor rsyslog parameter documentation mmutf8fix 2025-09-16 11:36:23 +02:00
Rainer Gerhards
bc25eea171
maintain ChangeLog 2025-09-15 17:25:23 +02:00
Rainer Gerhards
4341365d1f
Merge pull request #6117 from alorbach/cursor/investigate-and-resolve-rsyslog-issue-5627-c0ec
PR Summary: Handle TLS 1.3 KeyUpdate during send in ossl/gtls
2025-09-15 17:22:18 +02:00
Rainer Gerhards
dc1bad1a8c
Merge pull request #6138 from rgerhards/do
docs/getting_started: add AI assistants page
2025-09-15 15:17:57 +02:00
Rainer Gerhards
4cb9c793bf
docs/getting_started: add AI assistants page
Improve discoverability of rsyslog-specific AI helpers for users and
contributors. This supports onboarding and troubleshooting and aligns
with the project's AI-first strategy.

Impact: docs-only; adds a new page under Getting Started navigation.
2025-09-15 15:11:25 +02:00
Rainer Gerhards
5e2ca5a119
dev container: do not work-around libgcrypt dev interface change
there was "workaround" introduced in the container which prevented
to detect some issues in libgrypt-related code. This was probably done
to get newer version in dev env without the need to adapt code to
broken libgrypt API level in new version.

That prevented issues in https://github.com/rsyslog/rsyslog/pull/5406
to be deteced.
2025-09-15 12:13:51 +02:00
Rainer Gerhards
56afd10818
Merge pull request #6135 from rgerhards/doc-beginner
doc: new beginner tutorials
2025-09-15 10:38:29 +02:00
Rainer Gerhards
6dbdd0fcdd
doc: new beginner tutorials
We are redesigning the new user onboarding doc. This commit
provides very first experience documentation. Some is duplicate
content to the previous version, which we keep for now.

A cleanup will follow later. We want to gain some feedback first.
Thus the early merge.
2025-09-15 10:20:25 +02:00
Cursor Agent
78541ffaf5 tls: process TLS 1.3 KeyUpdate during send (ossl/gtls)
Handle post-handshake KeyUpdate by driving a minimal non-blocking read when the
TLS library requests READ during Send(). This prevents stalls when servers send
TLS 1.3 KeyUpdate and aligns behavior with RFC 8446 §4.6.3.

- nsd_ossl.c: SSL_ERROR_WANT_READ => small SSL_read(), then retry write
- nsd_gtls.c: E_AGAIN/E_INTERRUPTED with READ direction => small gnutls_record_recv(), then retry write

Backward-compatible and only active when the TLS stack signals a need to read.

closes: https://github.com/rsyslog/rsyslog/issues/5627
2025-09-15 09:52:40 +02:00
Rainer Gerhards
57c90287e3
Merge pull request #6121 from billie-alsup/dev/balsup/netns_socket
net: Add NetworkNamespace APIs
2025-09-13 14:19:34 +02:00
Ulrike Gerhards
a8077c1295
Codex/refactor rsyslog parameter documentation for mmtaghostname 2025-09-13 14:03:59 +02:00
Rainer Gerhards
6742c65180
Merge pull request #6130 from rgerhards/errmsg-doxygen
core: add doxygen comments to errmsg object
2025-09-13 13:52:32 +02:00
Rainer Gerhards
5c34ebb5e9
Merge pull request #6132 from rgerhards/codex/update-documentation-for-regex-type-lookup-tables
doc: describe regex lookup table type
2025-09-13 13:12:07 +02:00
Rainer Gerhards
10a728eaa4
core: add doxygen comments to errmsg object
most importantly, header file now includes comments that enable
tooltip-like behaviour in IDEs. Also includes antipaterns, which
is useful for developers and hopefully also for AI to detect
them e.g. in code reviews (and get it right in AI-generated code).
2025-09-13 10:27:30 +02:00
Rainer Gerhards
0c3529359e doc: describe regex lookup table type
Add reference for regex lookup tables. Describe POSIX regex support, first-match semantics, performance drawbacks, and overlapping pattern caution. Include sample table and fix minor wording.

AI-Agent: ChatGPT-4o
2025-09-13 08:34:30 +02:00
Billie Alsup
c78c587caf net: Add NetworkNamespace APIs
This moves NetworkNamespace functionality into
the net module. This allows the same code to
be reused across multiple tools and plugins.
The first usage is with omfwd, which is changed
to use the common net implementation.  Note
the net implementation is based on the original
omfwd implementation.  Subsequent PRs will be
opened for integrating this into omuxsock and
imtcp.

The original test case tcp_forwarding_ns_tpl.sh
was broken due to use of single quotes rather
than double quotes, thus preventing the proper
port number argument to be passed to the
listener.  Note this test must be run as
root.

Development has occurred across Fedora41 and
Fedora42, which uses glibc 2.40 and glibc2.41
respectively.  The valgrind suppressions are
updated to handle new glibc issues
accordingly.

Four new functions are callable through the
net module. These allow one to save a handle
to the current namespace, switch to a new
namespace by name, and restore the namespace
from the saved handle.  A fourth higher
level wrapper is used to open a socket in
a named network namespace, and handles the
invocation of the lower level functions.
Ideally this would be the only public
function, however it simplifies integration
into imtcp in the future (which doesn't
directly open sockets).  This may change
in the future as network namespaces are
integrated into more modules and plugins.

Signed-off-by: Billie Alsup <balsup@cisco.com>
2025-09-12 08:48:31 -07:00
Rainer Gerhards
4342184267
maintain ChangeLog 2025-09-12 15:42:22 +02:00
Rainer Gerhards
24d705eafe
Merge pull request #6129 from rgerhards/docker-fix-collector
docker: fix collector, udp and tcp could not be enabled individually
2025-09-12 15:41:01 +02:00
Rainer Gerhards
769e4c1998
docker: fix collector, udp and tcp could not be enabled individually
If either one was disabled, so was the other one as well.
2025-09-12 15:38:09 +02:00
Rainer Gerhards
bd51ec69da
Merge pull request #6128 from rgerhards/doc-container-collector
doc: better doc for rsyslog collector container
2025-09-12 15:34:34 +02:00
Rainer Gerhards
b9f6596568
doc: better doc for rsyslog collector container
among others, includes now also an example docker compose definition
2025-09-12 15:28:17 +02:00
Rainer Gerhards
d8659e21a0
doc: document compactjsonstring global option (#6127) 2025-09-12 15:28:04 +02:00
Rainer Gerhards
6091244efa
Merge pull request #6125 from rgerhards/docker-enh
docker: enhancements to debian sid and ubuntu 24.04 dev container
2025-09-12 13:13:14 +02:00
Rainer Gerhards
f8873814e8
docker: enhancements to debian sid and ubuntu 24.04 dev container
permit to build and test more modules; be more consistent

Overall helps improve CI quality.
2025-09-12 13:07:14 +02:00
Rainer Gerhards
d2e08849fe
Merge pull request #6124 from rgerhards/fix-logctl
logctl tool: fix mongoc.h include location
2025-09-12 13:03:47 +02:00
Rainer Gerhards
0b4dd2943c
logctl tool: fix mongoc.h include location 2025-09-12 11:26:28 +02:00
Rainer Gerhards
56185d2fa8
Merge pull request #6123 from rgerhards/docker-collector-relp
docker: add relp listener to rsyslog "collector"
2025-09-12 11:19:06 +02:00
Rainer Gerhards
d96db7cfe1
Merge pull request #6122 from rgerhards/ci-journal
CI: fix imjournal build
2025-09-12 11:17:49 +02:00
Rainer Gerhards
f8177f2186
docker: add relp listener to rsyslog "collector"
closes: https://github.com/rsyslog/rsyslog/issues/6118
2025-09-12 11:04:20 +02:00
Rainer Gerhards
eb1cca883c
CI: fix imjournal build 2025-09-12 10:03:31 +02:00
8f6d554af8
docs: fix doc build instructions (Sphinx 4.5+, main, monorepo) (#6114)
Also some other fixes, like invalid URLs.
2025-09-12 09:47:03 +02:00
Ulrike Gerhards
341f5a39e7
refactor rsyslog module parameter documentation for mmsnmptrapd
* mmsnmptrapd: split parameter docs into reference pages
2025-09-11 18:07:23 +02:00
Rainer Gerhards
db68b34e40
maintain ChangeLog 2025-09-11 08:58:23 +02:00
Rainer Gerhards
71dd1fc18e
Merge pull request #5958 from mbiebl/mongoc2
Various mongo-c-driver v2 related fixes for ommongodb
2025-09-11 08:56:25 +02:00
Rainer Gerhards
6847a49ec0
Merge pull request #6111 from rgerhards/PR-2925
core: add setting to permit compact json format
2025-09-10 18:26:32 +02:00
Rainer Gerhards
0dd0e3c4fd
Merge pull request #6116 from rgerhards/docker-dev-deb13
docker: update Debian 13 build to inlcude more modules
2025-09-10 18:22:19 +02:00
Rainer Gerhards
87af201406
doc: improg had a strangely worded limitation listed - corrected (#6115)
The doc basically said C stdio and select() are not compatible. This of
course is invalid. It is stdio buffering what can cause issues
with the module. Provided better advise now.
2025-09-10 18:18:59 +02:00
Rainer Gerhards
bcadef92aa
docker: update Debian 13 build to inlcude more modules
Some module which could have been built on this platform were not
enabled, namely: ommongodb, omclickhouse, imkmsg, mmdblookup

see also:https://github.com/rsyslog/rsyslog/issues/5566
2025-09-10 18:14:45 +02:00
Michael Biebl
5113d43bfb ommongodb: fix compilation of SSL/TLS support
The change in #2950 introduced

AC_CHECK_FUNCS(mongoc_client_set_ssl_opts,,)

This check always returns "no", so SSL/TLS support was always disabled
even if mongo-c-driver had been built with SSL/TLS support. So while it
fixed the build failure it meant that this specific code in ommongodb
was no longer enabled.

Instead, use the define that is provided by mongo-config.h:

/*
 * MONGOC_ENABLE_SSL is set from configure to determine if we are
 * compiled with any SSL support.
 */
2025-09-10 15:35:09 +02:00
Michael Biebl
2d6de51797 ommongodb: add support for mongo-c-driver v2
Update pkg-config check for v2 of mongo-c-driver

The name of the pkg-config file has changed from libmongoc-1.0.pc to
mongoc2.pc. First try the new version and keep the old version as
fallback.

In version 1.13.0, the headers were re-organized and the preferred way
of including the headers are <mongoc/mongo.h> and <bson/bson.h>.
Forwarding headers to keep backwards compatibility were introduced that
have been removed in v2.

To support building on CentOS 7 and Ubuntu 18, which ship versions older
than 1.13.0, keep using the old include names for v1 and use the new
include names for v2.

Once the minimum version of mongo-c-driver is bumped to >= 1.13.0, this
fallback can be dropped.
2025-09-10 15:35:08 +02:00
Rainer Gerhards
a95db771bf
improve original patch 2025-09-10 14:46:48 +02:00
zhuyan
59235f8396
core: add setting to permit compact json format
Adds the ability to remove unnecessary spaces from genrated json
to conserve space, e.g. on disk.

Maintainer edit: this replaces orginal PR which was too hard to
  rebase. This was caused by too-slow reaction of the rsyslog team.

see also: https://github.com/rsyslog/rsyslog/pull/2925
  (this is the original PR)

closes: https://github.com/rsyslog/rsyslog/issues/2913
2025-09-10 14:42:48 +02:00
Rainer Gerhards
565d4f9eb0
maintain ChangeLog 2025-09-10 14:10:11 +02:00
Rainer Gerhards
06bd33f8f9
Merge pull request #6075 from alorbach/cursor/add-github-pages-deployment-to-doc-build-workflow-e4b4
CI: Add Sphinx docs PR previews via GitHub Actions Pages
2025-09-10 13:56:30 +02:00
Rainer Gerhards
5b3bb6ee01
Update doc/README.md
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-09-10 12:56:29 +02:00
Rainer Gerhards
79d98b672e
Merge pull request #6070 from alorbach/cursor/implement-batching-and-performance-improvements-48ac
Implement omhttp batching and performance improvements
2025-09-10 12:31:12 +02:00
Rainer Gerhards
24972ca011
Merge pull request #6080 from rgerhards/PR-base64
config script: add b64_decode function
2025-09-09 17:25:56 +02:00
Kevin Guillemot
bb6d7ba5e2
config script: add b64_decode function
This PR provides a new Rainerscript function: b64_decode.

This function is based on RFC4648.
2025-09-09 15:47:11 +02:00
Rainer Gerhards
c0bc827843
Merge pull request #6108 from rgerhards/ci-cleanup
CI remove old kafka codecov builder now the new one is present
2025-09-09 15:25:18 +02:00
Rainer Gerhards
5462bca5fe
CI: remove Ubuntu 18 due to EOL
We also do no longer build packages for it due to being EOL.
2025-09-09 15:22:44 +02:00