جاباما
جاباما

Data Engineer

Tehran/Sadeghieh
Full Time
Saturday - Wednesday
-
Loan -Bonus -Commision -Military Service Option -Health insurance -Recreational accommodation -Flexible working hours -Learning stipends -Game room -Purchasing coupon -Lunch -Snacks -Gym facilities -Resting space -Recreational and tourism facilities -Breakfast -Employee stock ownership -Occasional packages and gifts

این فرصت شغلی چقدر برای من مناسب است؟

51 - 200 employees
Internet Provider / E-commerce / Online Services
Iranian company dealing only with Iranian entities
1395
Privately held
توضیحات بیشتر

key Requirements

3 years experience in similar position
Python - Intermediate
T-SQL - Intermediate
Apache Kafka - Intermediate
Apache Spark - Basic
Docker - Basic
Kubernetes - Basic
Apache Airflow - Intermediate

Job Description

We are a technology-driven travel and accommodation marketplace connecting travelers with accommodation providers. Our platform processes large volumes of data from accommodation listings, user interactions, searches, reservations, and transactions to support business operations and data-driven decision-making.

About the Role:
We are looking for a Mid-Level Data Engineer to help develop, maintain, and improve our data platform. Our Data Engineering team owns the entire data platform lifecycle, from building data pipelines to deploying, operating, and maintaining distributed infrastructure. In this role, you will primarily focus on developing reliable and scalable data pipelines while gradually gaining hands-on experience with distributed systems and DataOps practices.

Key Responsibilities:
  1. Design, develop, and maintain reliable batch and streaming data pipelines using Python, SQL, and Apache Spark.
  2. Build and maintain data orchestration workflows using Apache Airflow.
  3. Develop and support data ingestion pipelines using Apache Kafka and Schema Registry.
  4. Design and optimize analytical datasets, data models, and SQL queries in ClickHouse.
  5. Work with distributed storage systems such as HDFS.
  6. Implement data quality checks, monitoring, error handling, and recovery mechanisms.
  7. Troubleshoot pipeline failures, data inconsistencies, and performance bottlenecks.
  8. Participate in deploying, monitoring, and maintaining distributed data infrastructure, including containerized services using Docker and Kubernetes.
  9. Collaborate with engineers and analysts, participate in code reviews, and follow software engineering best practices.
Required Qualifications:
  • 1–3 years of professional experience as a Data Engineer.
  • Strong hands-on experience with Python, including writing clean, modular, testable, and maintainable code.
  • Strong hands-on experience with SQL, including complex queries, joins, aggregations, and query optimization.
  • Hands-on experience with Apache Airflow, including developing, scheduling, and troubleshooting DAGs.
  • Practical experience with at least one OLTP database, such as PostgreSQL, MySQL, or SQL Server.
  • Hands-on experience with Linux, including command-line tools, shell scripting, process management, and troubleshooting.
  • Proven experience designing, developing, and maintaining production ETL/ELT pipelines.
  • Good understanding of batch and streaming data processing concepts.
  • Solid understanding of distributed systems fundamentals, including partitioning, replication, scalability, and fault tolerance.
  • Understanding of Docker, Kubernetes, and containerization concepts.
  • Experience with Git and software engineering best practices.
  • Strong troubleshooting and problem-solving skills, with an interest in DataOps and infrastructure operations.
Nice to Have
  • Hands-on experience developing pipelines using Apache Spark or Kafka.
  • Experience with ClickHouse or other column-oriented analytical databases.
  • Experience with HDFS, Kafka Schema Registry, Avro, or Protobuf.
  • Practical experience with Docker, Kubernetes, or distributed data services.
  • Exposure to cluster configuration, monitoring, troubleshooting, or performance optimization.
  • Experience with CI/CD, automated testing, and observability practices.
  • Experience working with large-scale transactional or event-driven datasets.

Job Requirements

Age
25 - 35 Years Old
Gender
Men / Women
Software
Python| Intermediate T-SQL| Intermediate Apache Spark| Basic Apache Airflow| Intermediate Apache Kafka| Intermediate Docker| Basic Kubernetes| Basic

ارسال رزومه برای جاباما

گزارش مشکل یا تخلف آگهی