mirror of https://github.com/rsyslog/rsyslog.git synced 2025-12-20 12:00:43 +01:00

History

Rainer Gerhards a4c7f2ac81 module-template framework: avoid compiler warning in some legal cases

the finalize_it: label is required, but not always used, which each
time results in a compiler warning that needs to be worked around.
Now this is fixed once and for all for gcc and clang - the others
will probably not complain in any case. Great solution until something
comes up that makes us need a revision.

2017-11-22 11:08:34 +01:00

Makefile.am

cosmetic: build system still used JSON_C name

2017-05-16 11:05:57 +02:00

omhttpfs.c

module-template framework: avoid compiler warning in some legal cases

2017-11-22 11:08:34 +01:00

README.md

add testing envrionment

2014-12-12 18:07:57 +08:00

README.md

OmHTTPFS

Author: sskaje (sskaje@gmail.com, http://sskaje.me/)

OmHTTPFS is an Rsyslog plugin writting data to HDS via Hadoop HDFS over HTTP.

Hadoop HDFS over HTTP

Official site: Hadoop HDFS over HTTP

HTTPFS is not well documented. I tried to read its source and write an intro with examples, until I found Administering the file system by using HttpFS REST APIs by IBM.

OmHDFS for Rsyslog

Rsyslog provides a plugin named omHDFS which requires lots of work compiling and configuring, and it's not that usable. Here is what I tried before writting this omhttpfs: Build omhdfs for Rsyslog.

Rsyslog config

Legacy config NOT supported.

Example:

module(load="omhttpfs")
template(name="hdfs_tmp_file" type="string" string="/tmp/%$YEAR%/test.log")
template(name="hdfs_tmp_filecontent" type="string" string="%$YEAR%-%$MONTH%-%$DAY% %MSG% ==\n")
local4.*    action(type="omhttpfs" host="10.1.1.161" port="14000" https="off" file="hdfs_tmp_file" isDynFile="on")
local5.*    action(type="omhttpfs" host="10.1.1.161" port="14000" https="off" file="hdfs_tmp_file" isDynFile="on" template="hdfs_tmp_filecontent")

Tested with CDH 5.2.0 + Rsyslog 8.6.0 on CentOS 7

# EOF