Filter, reshape, and redact logs before export with Transformers

What happened

Logpush now supports Transformers, allowing teams to filter, redact, and reshape log streams using SQL before export. Powered by Apache DataFusion and Apache Arrow, Transformers apply those changes directly to log data before it reaches the destination.

Logpush delivers logs in batches as quickly as possible, enabling Cloudflare to provide information almost in real time. Observability teams use Logpush to export Cloudflare logs to security information and event management systems (SIEMs), analytics platforms, and object storage.

Today, this often requires a separate processing service that teams must deploy, scale, monitor, and maintain. For example, a team that collects logs from multiple CDNs (a network of servers that delivers content from near the user) can add a static provider field to normalize records before they reach its analytics platform.

Key facts

• Logpush now — support: Transformers, allowing teams to filter, redact, and reshape log streams using SQL before export
• Today, this often — requires: a separate processing service that teams must deploy, scale, monitor, and maintain