Data Engineer

Job Title: Data Engineer
Location: On-site
Type: [Full-time / Contract]
Experience Level: Senior-Mid
Industry: FinTech

About the Role:
We are looking for a Senior Data Engineer to join our data platform team and help design, build, and optimize scalable, high-performance data pipelines and systems. You’ll play a critical role in shaping our data architecture and enabling data-driven decision-making across the company.
You will work with a modern data stack including Kafka, ClickHouse, Apache Spark, Python, Airflow, and Kubernetes, building robust batch and streaming pipelines to power analytics, reporting, and real-time applications.

Responsibilities:
Design and implement scalable data pipelines for both batch and real-time processing using Apache Kafka, Spark, and Airflow.
Build and maintain high-performance OLAP stores using ClickHouse.
Develop robust and reusable data ingestion frameworks and ETL jobs in Python.
Orchestrate workflows and manage pipeline dependencies with Apache Airflow.
Deploy, monitor, and maintain data infrastructure in Kubernetes environments.
Collaborate with data scientists, analysts, and software engineers to deliver reliable data products.
Optimize performance and cost efficiency of data systems and pipelines.
Ensure data quality, integrity, and governance practices are embedded into all data solutions.
Lead design reviews and mentor junior engineers on best practices in data engineering.

Requirements:
3+ years of experience in data engineering, with a strong focus on distributed systems and data pipelines.
Expertise in streaming architectures using Apache Kafka.
Deep understanding of ClickHouse and experience designing performant OLAP schemas.
Proficiency in Python and Spark, especially for data manipulation and pipeline development.
Solid experience building and scheduling workflows with Apache Airflow.
Strong experience with Apache Spark (batch or structured streaming).
Hands-on experience deploying and managing data applications in Kubernetes.
Solid knowledge of CI/CD, Git, and DevOps practices.
Strong problem-solving skills and the ability to work independently or as part of a team.

Experience designing and developing scalable APIs, especially using Python and FastAPI.

Nice to Have:
Experience with schema evolution tools (e.g., Schema Registry, Avro, Protobuf).
Background in event-driven architectures and CDC (Change Data Capture).
Experience in performance tuning and monitoring large-scale systems.

Why Join Us:
Work with a modern data stack on challenging real-time and large-scale problems.

Have ownership over architectural decisions and influence the future of our data platform.
Collaborate with a talented, cross-functional team in a fast-paced environment.