Python Developer with Flink engineer specializing in building high-performance, real‑time data processing applications.
Core Responsibilities
- Design, develop, and maintain real‑time and batch data processing pipelines using Apache Flink.
- Build Flink applications in Python using the Table/SQL API and DataStream API.
- Connect Flink with event‑streaming platforms like Kafka, integrating with databases such as Redis, MongoDB, and cloud services (AWS, Azure).
- Tune streaming jobs for low latency and high throughput, manage state, checkpointing, and ensure exactly‑once processing guarantees.
- Collaborate with data scientists and engineers to translate analytic requirements into scalable production‑grade code.
Required Technical Skills
- Deep knowledge of Python (PEP8, asynchronous services, data structures).
- Robust understanding of Flink concepts such as event‑time semantics, watermarks, and windowing strategies.
- Experience with orchestration tools (Airflow).
- Containerization using Docker.
- Monitoring with Grafana.
- Familiarity with Amazon Flink #J- *-Ljbffr