Job Description:
We are seeking a talented and motivated Data Engineer to join our data team. In this role, you will be instrumental in building and maintaining robust data pipelines and infrastructure that support our data-driven initiatives. The ideal candidate will have a strong background in data engineering and familiarity with AI and machine learning concepts.
Responsibilities:
- Design, build, and maintain scalable data pipelines and workflows for ingesting, transforming, and storing large volumes of data.
- Develop and manage data warehouses and data lakes to facilitate data analysis and reporting.
- Collaborate closely with data analysts and data scientists to understand their data requirements and provide them with the necessary datasets and tools.
- Monitor and optimize the performance of our data systems to ensure efficient and reliable data processing.
- Develop and tune data pipelines using technologies such as Apache Kafka, Apache Spark, Apache Airflow, HDFS, ClickHouse, and Hive.
- Stay current with industry trends and advancements in data engineering, AI, and machine learning, and bring innovative ideas and techniques to the team.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Strong programming skills in Python.
- Experience with big data processing frameworks (e.g., Hadoop, Spark).
- Familiarity with Apache Kafka, Apache Spark, Apache Airflow, HDFS, ClickHouse, Hive, and other relevant big data tools.
- Knowledge of SQL and experience with both relational and non-relational databases, including graph databases.
- Familiarity with AI and machine learning concepts and their application in data engineering.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration ability
Benefits of working with us:
- Friendly work environment
- Balance in work and life
- The possibility of career development
- Team building program
- Seasonal courses
- Game and rest room
- Supplementary insurance
- Breakfast and snacks
- Occasional gifts
- Floating working hours