Message Queue & Streaming
Basic Auth
Apache Kafka REST API
Distributed event streaming platform for real-time data
Apache Kafka is a distributed streaming platform used for building real-time data pipelines and streaming applications. It enables high-throughput, fault-tolerant publish-subscribe messaging with persistent storage, allowing organizations to process and analyze event streams at scale. Developers use Kafka for event sourcing, log aggregation, real-time analytics, and microservices communication.
Base URL
https://kafka-rest-proxy.example.com/v3
API Endpoints
| Method | Endpoint | Description |
|---|---|---|
| GET | /clusters | List all Kafka clusters available in the environment |
| GET | /clusters/{cluster_id}/topics | Get all topics in a specific Kafka cluster |
| POST | /clusters/{cluster_id}/topics | Create a new topic with specified partitions and replication factor |
| GET | /clusters/{cluster_id}/topics/{topic_name} | Get detailed configuration and metadata for a specific topic |
| DELETE | /clusters/{cluster_id}/topics/{topic_name} | Delete a topic and all its data from the cluster |
| POST | /clusters/{cluster_id}/topics/{topic_name}/records | Produce a message record to a specific topic partition |
| GET | /clusters/{cluster_id}/topics/{topic_name}/partitions | List all partitions for a specific topic |
| GET | /clusters/{cluster_id}/consumer-groups | List all consumer groups registered in the cluster |
| GET | /clusters/{cluster_id}/consumer-groups/{group_id} | Get detailed information about a specific consumer group |
| GET | /clusters/{cluster_id}/consumer-groups/{group_id}/consumers | List all active consumers in a consumer group |
| GET | /clusters/{cluster_id}/brokers | List all broker nodes in the Kafka cluster |
| GET | /clusters/{cluster_id}/brokers/{broker_id} | Get detailed configuration and status for a specific broker |
| POST | /consumers/{group_id} | Create a new consumer instance in a consumer group |
| GET | /consumers/{group_id}/instances/{instance_id}/records | Consume records from subscribed topics for a consumer instance |
| POST | /consumers/{group_id}/instances/{instance_id}/subscription | Subscribe a consumer instance to one or more topics |
Code Examples
# Produce a message to a topic
curl -X POST https://kafka-rest-proxy.example.com/v3/clusters/cluster-1/topics/orders/records \
-H 'Content-Type: application/json' \
-u username:password \
-d '{
"partition_id": 0,
"value": {
"type": "JSON",
"data": {
"order_id": "12345",
"customer": "john@example.com",
"total": 99.99
}
},
"key": {
"type": "STRING",
"data": "order-12345"
}
}'
Connect Apache Kafka to AI
Deploy a Apache Kafka MCP server on IOX Cloud and connect it to Claude, ChatGPT, Cursor, or any AI client. Your AI assistant gets direct access to Apache Kafka through these tools:
kafka_produce_message
Produce messages to Kafka topics with automatic serialization and partitioning support
kafka_consume_messages
Consume and process messages from Kafka topics with configurable consumer groups and offset management
kafka_list_topics
Discover and list all available Kafka topics across clusters with metadata including partition counts and replication factors
kafka_create_topic
Create new Kafka topics with custom partition counts, replication factors, and configuration settings
kafka_monitor_consumer_lag
Monitor consumer group lag and offset positions to identify processing bottlenecks and ensure data freshness
Deploy in 60 seconds
Describe what you need, AI generates the code, and IOX deploys it globally.
Deploy Apache Kafka MCP Server →