mirror of https://github.com/rsyslog/rsyslog.git synced 2025-12-17 09:20:41 +01:00

History

Rainer Gerhards 4f8cfcbb54

We did not totally fix all that we would like to see changed, but we
fixed it so that it permits us to finally run the style checker on all
files.

Needs some little manual fixup PR to follow.

2018-08-02 15:21:22 +02:00

Makefile.am

cosmetic: build system still used JSON_C name

2017-05-16 11:05:57 +02:00

omhttpfs.c

codestyle fix - rough way

2018-08-02 15:21:22 +02:00

README.md

add testing envrionment

2014-12-12 18:07:57 +08:00

README.md

OmHTTPFS

Author: sskaje (sskaje@gmail.com, http://sskaje.me/)

OmHTTPFS is an Rsyslog plugin writting data to HDS via Hadoop HDFS over HTTP.

Hadoop HDFS over HTTP

Official site: Hadoop HDFS over HTTP

HTTPFS is not well documented. I tried to read its source and write an intro with examples, until I found Administering the file system by using HttpFS REST APIs by IBM.

OmHDFS for Rsyslog

Rsyslog provides a plugin named omHDFS which requires lots of work compiling and configuring, and it's not that usable. Here is what I tried before writting this omhttpfs: Build omhdfs for Rsyslog.

Rsyslog config

Legacy config NOT supported.

Example:

module(load="omhttpfs")
template(name="hdfs_tmp_file" type="string" string="/tmp/%$YEAR%/test.log")
template(name="hdfs_tmp_filecontent" type="string" string="%$YEAR%-%$MONTH%-%$DAY% %MSG% ==\n")
local4.*    action(type="omhttpfs" host="10.1.1.161" port="14000" https="off" file="hdfs_tmp_file" isDynFile="on")
local5.*    action(type="omhttpfs" host="10.1.1.161" port="14000" https="off" file="hdfs_tmp_file" isDynFile="on" template="hdfs_tmp_filecontent")

Tested with CDH 5.2.0 + Rsyslog 8.6.0 on CentOS 7

# EOF