We are seeking a highly skilled Data Engineer to design, build, and optimize enterprise data platforms and large-scale data processing solutions. The successful candidate will be responsible for developing data ingestion pipelines, data warehouses, data lakes, and real-time processing frameworks that support business intelligence, analytics, operational reporting, and advanced data-driven applications. The ideal candidate should have strong expertise in database technologies, ETL/ELT processes, distributed systems, data integration, and cloud-native or on-premises data architectures.
Key Responsibilities:
- Design and implement scalable data platforms, architectures, and data models for operational and analytical workloads.
- Develop and maintain batch and real-time data pipelines, ETL/ELT processes, and data integration solutions.
- Manage and optimize data warehouses, data lakes, and large-scale data processing environments.
- Ensure data quality, governance, security, lineage, and compliance standards.
- Develop streaming and event-driven data solutions for near real-time processing.
- Optimize database performance, SQL queries, storage, and data workflows.
- Collaborate with BI, analytics, application, and infrastructure teams to deliver reliable data services.
- Support reporting, analytics, machine learning, and operational systems while contributing to technical standards and best practices.
Requirements:
- Bachelor's or Master's degree in Computer Science, Software Engineering, Data Engineering, Information Systems, Mathematics, Statistics, or a related field.
- Minimum 5 years of experience in Data Engineering or similar roles.
- Proven experience in designing and implementing enterprise data platforms and large-scale data processing solutions.
- Strong expertise in SQL, database systems, and ETL/ELT development.
- Proficiency in Python, Java, Scala, or similar programming languages.
- Hands-on experience with relational databases (Oracle, PostgreSQL, SQL Server, MySQL).
- Experience with big data technologies such as Apache Spark, Kafka, Hadoop, and analytical databases (e.g., ClickHouse).
- Knowledge of data modeling, REST APIs, data integration, Docker, Kubernetes, CI/CD, and DevOps practices.
- Understanding of data governance, security, and privacy principles.
Preferred Competencies:
- Strong analytical and problem-solving skills.
- Excellent communication and technical documentation abilities.
- Ability to work independently and collaboratively in cross-functional teams.
- Experience working in mission-critical, high-volume production environments.
- Commitment to continuous learning and technical excellence.