Upstash Kafka

This service is in private beta, available in select regions. Write to extensions@fly.io to request access for your Fly.io organization.

Upstash Kafka is a fully-managed, pay-as-you-go Kafka service hosted on Fly.io infrastructure.

Create and manage a Kafka cluster

Creating and managing clusters happens exclusively via the Fly CLI. Install it, then signup for a Fly account.

Create and get status of a Kafka cluster

flyctl ext kafka create
? Select Organization: fly-apps (fly-apps)
? Choose a name, use the default, or leave blank to generate one: my-kafka-cluster
? Choose a primary region (can't be changed later) Madrid, Spain (mad)

Your Upstash cluster (my-kafka-cluster) in iad is ready.

Set the following secrets on your target app.

KAFKA_PASSWORD: MThl0io456uil345u-jkh34-kuj
KAFKA_USERNAME: Y02kghq4ka345uj0-kl340hkl23
TCP_ENDPOINT: my-kafka-cluster-kafka.upstash.io:9092

The Upstash web console

To view more details about your cluster, including usage, run:

flyctl ext kafka dashboard -o <org_name>

List your clusters and view status

Get a list of all of your Kafka clusters.

flyctl ext kafka list
NAME                ORG             PRIMARY REGION
late-waterfall-1133 fly-apps        mad

Fetch status for a cluster:

fly ext kafka status late-waterfall-1133
RStatus
  Name   = late-waterfall-1133
  Status = created

Using your Kafka cluster

To start using your cluster, you can create Kafka topics via the Upstash console or through a Kafka client connecting from your Fly.io organization.

Check Upstash documentation on creating a topic, producing messages and consuming messages.

Delete a Kafka cluster

Deleting a Kafka cluster can’t be undone. Be careful!

fly ext kafka destroy my-cluster
Your Kafka cluster my-cluster was deleted

What you should know

Once provisioned, the cluster primary region cannot be changed.

Your Upstash Kafka is accessible only via a private IPv6 address restricted to your Fly.io organization’s network.

To ensure low latency connections, provision your cluster in the same region as your application.

Pricing

Upstash Kafka clusters are billed by usage on a pay-as-you-go basis. Check the official Upstash Pricing page for details.

Your usage is visible on your current Fly.io bill, and updated periodically through the day. See detailed cluster usage details in the Upstash web console.