Apache NiFi
Visual data-flow automation
What it does
NiFi connects processors into data flows and provides queues, backpressure controls, and provenance tracking through its management interface.
When to use it
For files, messages, and APIs, follow a flowfile through the graph to examine transformations, routing decisions, and failure queues.