At Okala, we are changing the game in the Fast-Moving Consumer Goods (FMCG) sector, creating a new online grocery shopping experience for Iranians. Our Data team collaborates to make it happen. We have an exciting opportunity for you to join us as a crucial part of our team as a Senior Data Engineer .
Responsibilities :
- Data Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines and ETL processes.
- Collaboration: Work closely with data analysts, data scientists, and software engineers to gather data requirements, ensuring data integrity and quality.
- Stream Processing: Utilize frameworks like PySpark for efficient real-time data processing.
- Big Data Handling: Implement and optimize big data frameworks, such as Hadoop, to manage large volumes of data effectively.
- Distributed Systems: Employ message brokers like Kafka for data transportation and processing in distributed environments.
- Database Management: Develop and maintain data models and database schemas to meet business needs.
- Database Technologies:
- Experience with both SQL (Click House, SQL Server) and NoSQL databases (MongoDB, Redis) for structured, unstructured, and semi-structured data management.
- Proficiency in containerization and orchestration tools like Docker and Kubernetes.
- Programming & Problem Solving: Apply strong Python or Scala skills and analytical abilities to solve complex data challenges.
- Communication & Collaboration: Demonstrate excellent communication and teamwork skills.
Requirements :
- Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
- Experience: Proven track record as a Data Engineer or in a similar role.
- Programming Skills: Proficiency in Python or Scala.
- Frameworks & Tools:
- Experience with stream processing frameworks, notably PySpark.
- Familiarity with message brokers such as Kafka and RabbitMQ.
- Knowledge of SQL databases, specifically Click House and SQL Server.
- Experience with NoSQL databases (e.g., MongoDB, Redis) and object storage solutions like Minio.
- Proficiency in containerization and orchestration technologies, including Docker and Kubernetes.
- Analytical Skills: Strong problem-solving abilities and analytical thinking.
- Soft Skills: Excellent communication and collaboration skills.
- Additional Skills:
- Some experience with job orchestration tools, such as Apache Airflow.
- Familiarity with data integration tools like Microsoft SSIS and Apache Nifi.
Benefits:
Join our friendly and dynamic team and enjoy a range of perks, such as:
- Weekly social events (Cinema Night and Mafia Night)
- Professional development opportunities
- Free breakfast every day
- Birthday and anniversary gifts and surprises
- Lunch and snack subsidies
- Transportation budget
- On-site medical care
- Comprehensive health insurance
- Parking space
- Seasonal and special charges and discounts from Okala