rsyslog/tests/yaml-imfile-basic.sh
Rainer Gerhards e8fa2034fe feat: add YAML as an alternative configuration format
rsyslog now accepts .yaml / .yml files as a full alternative to
RainerScript configuration.  Whenever a .yaml or .yml file is
referenced (e.g. via $IncludeConfig or as the main config), it is
routed through the new yamlconf loader instead of the bison/flex
parser.  RainerScript and YAML configurations may coexist.

Supported top-level sections
  global:          global settings
  main_queue:      main queue settings
  modules:         module loading (load:, params:)
  inputs:          input objects  templates:       string, subtree, plugin, and list templates
                   (including all property/constant modifiers)
  rulesets:        rulesets with optional script: block (raw
                   RainerScript), filter/action shortcut (if:/then:),
                   and the full statements: block:
                     action:, set:, unset:, call:, call_indirect:,
                     foreach:, if:, stop:, continue:,
                     reload_lookup_table:
  outputs:         output objects (top-level convenience alias)
  include:         recursive includes (.yaml processed immediately;
                   .conf files pushed to LIFO stack in reverse order
                   for correct document-order processing)

Implementation notes
  - Thin front-end over existing cnfobj/nvlst/cnfDoObj() machinery;
    all parameter validation happens downstream unchanged.
  - Script blocks synthesised as RainerScript strings and injected via
    cnfAddConfigBuffer() (requires two trailing NUL bytes).
  - YAML -> YAML includes are synchronous recursive calls;
    YAML -> .conf includes use the flex buffer stack.
  - Mixed include lists (.yaml + .conf) emit a warning because strict
    document order cannot be preserved across the two mechanisms.
  - Built conditionally: --with-libyaml / HAVE_LIBYAML.

Tests
  19 new shell tests cover: basic config, modules, inputs, templates
  (string/subtree/list with modifiers), rulesets with script/filter/
  statements blocks, stop/continue, set/unset, foreach, call,
  call_indirect, reload_lookup_table, includes, error handling.

Documentation
  doc/source/configuration/yaml_config.rst  (new reference page)
  Inline comments in yamlconf.c explain all invariants and non-obvious
  design choices (es_getBufAddr non-null-termination, LIFO stack
  ordering, cnfAddConfigBuffer double-NUL requirement, etc.)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-03-27 09:41:37 +01:00

51 lines
1.2 KiB
Bash
Executable File

#!/bin/bash
# Tests imfile input configured via YAML.
# Uses inputfilegen to produce messages into a watched file; imfile reads
# them and routes through a YAML-defined ruleset to the output file.
# Mirrors imfile-basic.sh using YAML configuration.
#
# Added 2025, released under ASL 2.0
. ${srcdir:=.}/diag.sh init
require_plugin imfile
export NUMMESSAGES=1000
export QUEUE_EMPTY_CHECK_FUNC=wait_file_lines
generate_conf
add_conf '
include(file="'${RSYSLOG_DYNNAME}'.yaml")
'
cat > "${RSYSLOG_DYNNAME}.yaml" << 'YAMLEOF'
modules:
- load: "../plugins/imfile/.libs/imfile"
templates:
- name: outfmt
type: string
string: "%msg:F,58:2%\n"
inputs:
- type: imfile
file: "./RSYSLOG_DYNNAME.input"
tag: "file:"
ruleset: "main"
rulesets:
- name: main
script: |
if $msg contains "msgnum:" then
action(type="omfile" file="${RSYSLOG_OUT_LOG}" template="outfmt")
YAMLEOF
sed -i \
-e "s|RSYSLOG_DYNNAME|${RSYSLOG_DYNNAME}|g" \
-e "s|\${RSYSLOG_OUT_LOG}|${RSYSLOG_OUT_LOG}|g" \
"${RSYSLOG_DYNNAME}.yaml"
touch "${RSYSLOG_DYNNAME}.input"
startup
./inputfilegen -m $NUMMESSAGES >> "${RSYSLOG_DYNNAME}.input"
wait_file_lines
shutdown_when_empty
wait_shutdown
seq_check
exit_test