Job Description:
Seeking experienced Data Engineer to join our team, focusing on expanding and optimizing data ingestion pipelines. Responsibilities include supporting data scientists, BI, and ensuring stable data infrastructure. Ideal candidate is proactive, self-motivated, and excited about optimizing Digitoon’s data architecture for future.
 
Responsibilities:

1.      Developing ETL routines in order to populate databases from sources and also data aggregations
2.      Identifying, designing, and implementing internal process improvements;  such as automating manual processes, optimizing data delivery, re-designing infrastructure

Troubleshooting data issues within and across the business and presents solutions to these issues.
Leading innovation through exploration, bench-marking, making recommendations, and implementing big data technologies for platforms.
Performing data updates, indexing, and maintenance in the application database.
 
Requirements:

Big data tools; such as Hadoop (HDFS), Spark, Kafka, etc.
2.      Relational SQL and No-SQL databases, including MySQL, Clickhouse and Redis.
3.      Data pipeline and workflow management tools: Airflow
4.      Stream-processing systems: Storm, Spark-Streaming, etc
5.      Scripting languages: Python, Bash Script
6.      Familiarity with Linux, Git,
7.      Familiarity with Elasticsearch, Logstash, Kibana
8.      Familiarity with containerization and orchestration tools (Docker)


Soft Skills:

1.      Team player
2.      Documentation
3.      Strong communication skills
4.      Time management (planning)
5.      Excellent problem-solving and analytical skills
 

Nice to Have:

1.      Familiarity with Metabase/Superset
2.      Familiarity with Data Warehousing concepts