ItdaStreamKafka-Compatible Interface · Tiered Storage · Real-time Iceberg Streaming
ItdaStream Key Features
Overcoming Kafka limitations by separating compute and storage for unlimited retention and lower cost — and landing topic messages into an Iceberg lakehouse in real time, exactly-once.
Kafka Protocol Compatibility
Existing Kafka clients and tools work without code changes, including consumer groups and idempotent and transactional producers.
Compute-Storage Separation
Stateless brokers acknowledge from memory and local staging, then flush to S3 asynchronously. Retention is no longer bound by local disk size.
Scale Without Rebalancing
Brokers own no data, so adding a node is just starting it. Drain takes a broker out of rotation without failing client requests.
No-Code Iceberg Sinks
Pick a topic and an Iceberg table and JSON or Avro messages land automatically, with ingestion-time partitioning and upsert keys.
Iceberg Lakehouse Ingestion
Each checkpoint commits data and source offsets atomically in one Iceberg snapshot. WAP branches let you stage, validate, then publish.
Built-in Stream Processing
Brokers run streaming jobs with no separate cluster. Define transforms with the SDK and write to Iceberg, Kafka, JDBC, Elasticsearch and more.
Schema Registry
Register schemas in the built-in schema registry and decode Avro messages into typed table columns.
Enterprise Security
Built-in KMS envelope encryption (AES-256-GCM) with key rotation, topic-level IAM policies, TLS, and SSO via OIDC, SAML and LDAP.
High Availability and Operations
ZooKeeper leader election handles failover. An admin console, Prometheus metrics and S3 backup cover day-to-day operations.
Key Use Cases
Large-scale Log Aggregation
Cost-effectively store and query terabytes of logs for the long term.
Event-driven Microservices
Handle MSA events based on standard Kafka APIs with minimal operational overhead.
Real-time Lakehouse Ingestion
Land topic JSON/Avro messages into Iceberg tables exactly-once with no-code setup — auto-partitioned by time and ready for immediate analytics.
Data Lake Integration
Directly accumulate and analyze real-time events into S3 data lakes.
Cloud Native Migration
Seamlessly transition legacy Kafka infrastructure to elastic cloud environments.
Considering ItdaStream for your infrastructure?
Kafka API Compatible. S3 Tiered Storage. Unlimited Retention.
Innovate with the next-generation distributed streaming platform that enables cost savings and unlimited scalability.