kafka InfluxDB Service

kafka InfluxDB connector

High performance Kafka to InfluxDB connector. Supportslogstash message formats.

Kafka will serve as a buffer for your logs data during high load.

This component can scale horizontally on platforms like Mesos.

Technology stack

• Spring Boot 2.0.0
• Reactor Kafka

Features

Run

use ./gradlew instead of gradle if you didn't installed gradle

gradle kafka-influxdb-service:bootRun
# add new tags
INFLUXDB_TAGS=HOSTNAME,app,level,level_value gradle kafka-influxdb-service:bootRun
# run with `docker` profile. 
SPRING_PROFILES_ACTIVE=docker gradle kafka-influxdb-service:bootRun

Test

gradle kafka-influxdb-service:test

Build

gradle kafka-influxdb-service:build
# skip test
gradle kafka-influxdb-service:build -x test 
# build docker image
gradle kafka-influxdb-service:docker -x test 

Deploy

deploying app to Cloud

# tag and puch to cassandra-data-service
docker login
docker push

Verify

Access InfluxDB URL:

http://localhost:8083/

select * from logs where time > now() - 1m order by time desc limit 10;