SINKS.md

Sinks

If a message cannot be sunk, it will error immediately, and the message fail completely. This error bubbles up to to the source, and therefore will be retries as per the source's configuration.

Database

Consumes messages from a database by periodically running SQL queries.

HTTP

Makes a HTTP request.

Example

Log

Logs the message.

Example

Kafka

Writes messages to a Kafka topic.

Example

NATS Streaming (STAN)

Writes messages to a NATS streaming subject.

Example

NATS JetStream

Writes messages to a NATS JetStream subject.

Example

S3

Writes files to a S3 bucket.

Volume

Writes files to a volume:

• Storage Volumes e.g. NFS, Azure File, Config Map, Secret
• Container Storage Interface (CSI) Drivers e.g. AWS EBS, Google Cloud Storage
• S3 (not production ready)

This is an esoteric sink. The container writes a file in /var/run/argo-dataflow/sinks/{sinkName}/, and return an empty message.