Data Engineer

We are looking for a Senior Data Engineer to join our data platform team and help design, build, and optimize scalable, high-performance data pipelines and systems. You’ll play a critical role in shaping our data architecture and enabling data-driven decision-making across the company.
You will work with a modern data stack including Kafka, ClickHouse, Apache Spark, Python, Airflow, and Kubernetes, building robust batch and streaming pipelines to power analytics, reporting, and real-time applications.

Responsibilities:
Design and implement scalable data pipelines for both batch and real-time processing using Apache Kafka, Spark, and Airflow.
Build and maintain high-performance OLAP stores using ClickHouse.
Develop robust and reusable data ingestion frameworks and ETL jobs in Python.
Orchestrate workflows and manage pipeline dependencies with Apache Airflow.
Deploy, monitor, and maintain data infrastructure in Kubernetes environments.
Collaborate with data scientists, analysts, and software engineers to deliver reliable data products.
Optimize performance and cost efficiency of data systems and pipelines.
Ensure data quality, integrity, and governance practices are embedded into all data solutions.
Lead design reviews and mentor junior engineers on best practices in data engineering.

Requirements:
3+ years of experience in data engineering, with a strong focus on distributed systems and data pipelines.
Expertise in streaming architectures using Apache Kafka.
Deep understanding of ClickHouse and experience designing performant OLAP schemas.
Proficiency in Python and Spark, especially for data manipulation and pipeline development.
Solid experience building and scheduling workflows with Apache Airflow.
Strong experience with Apache Spark (batch or structured streaming).
Hands-on experience deploying and managing data applications in Kubernetes.
Solid knowledge of CI/CD, Git, and DevOps practices.
Strong problem-solving skills and the ability to work independently or as part of a team.

Experience designing and developing scalable APIs, especially using Python and FastAPI.