Skip to content
This repository has been archived by the owner on Dec 17, 2021. It is now read-only.

Latest commit

 

History

History
18 lines (11 loc) · 788 Bytes

File metadata and controls

18 lines (11 loc) · 788 Bytes
description
Data processing with reliability

Buffer

Previously defined in the Buffering concept section, the buffer phase in the pipeline aims to provide a unified and persistent mechanism to store your data, either using the primary in-memory model or using the filesystem based mode.

The buffer phase already contains the data in an immutable state, meaning, no other filter can be applied.

{% hint style="info" %} Note that buffered data is not raw text, it's in Fluent Bit's internal binary representation. {% endhint %}

Fluent Bit offers a buffering mechanism in the file system that acts as a backup system to avoid data loss in case of system failures.