Summary
FluentD is a CNCF-graduated open-source log collector that decouples log collection from log storage by providing a unified logging layer with hundreds of input and output plugins.
What is FluentD?
FluentD acts as a central routing hub for log data. Agents running on each node or container collect log streams and forward them to a FluentD aggregator, which parses, filters, buffers, and routes the data to one or more backends — Elasticsearch, S3, Kafka, Loki, or cloud logging services.
Its plugin architecture (over 1,000 community plugins) means FluentD can read from nearly any source — Docker, syslog, application logs, Kubernetes pod logs — and write to nearly any destination. Fluent Bit is a lightweight sibling project optimized for resource-constrained environments like embedded systems and edge nodes.
In Kubernetes environments, FluentD is commonly deployed as a DaemonSet to collect logs from all pods on every node, making it the de facto standard for container log forwarding. Both CNCF projects ensure vendor neutrality.
Why is FluentD relevant?
- Unified logging layer: Decouples application logging from the choice of storage backend
- Kubernetes-native: DaemonSet deployment pattern integrates seamlessly with container orchestration
- Reliability: Built-in buffering prevents log loss during backend outages
- Flexibility: Route the same log stream to multiple destinations simultaneously