What is Apache Samza?
Apache Samza is a distributed stream processing framework that enables the construction of stateful applications. These applications can process data in real-time from various sources, including Apache Kafka. It's designed for high performance, providing low latencies and high throughput for instant data analysis.
Samza is horizontally scalable, capable of scaling to several terabytes of state with features such as incremental checkpoints and host-affinity. The framework offers flexible deployment options, allowing it to run on YARN, Kubernetes, or as a standalone library. It is built on a pluggable architecture which gives ability to run the same code to process both batch and streaming data.
Features
- High performance: Provides extremely low latencies and high throughput to analyze your data instantly.
- Horizontally scalable: Scales to several terabytes of state with features like incremental checkpoints and host-affinity.
- Easy to Operate: Samza is easy to operate with flexible deployment options - YARN, Kubernetes or standalone.
- Powerful APIs: Rich APIs to build your applications: Choose from low-level , Streams DSL , Samza SQL and Apache BEAM APIs.
- Write once, Run Anywhere: Ability to run the same code to process both batch and streaming data.
- Pluggable architecture: Integrates with several sources including Kafka, HDFS, AWS Kinesis, Azure Eventhubs, K-V stores and ElasticSearch.
Use Cases
- Real-time data processing
- Building stateful applications
- Processing data from Apache Kafka
- Batch data processing
- Streaming data processing
