Data Engineer Data Warehouse / Lakehouse

Global Solutions - GS Om...

Job Title: Data Engineer Data Warehouse / Lakehouse

Location: Onsite / Offshore - Muscat , Oman
Employment Type: Contract (FTE)
Department: Data & Analytics / Engineering

Job Summary

We are seeking a motivated Data Engineer to join our Data & Analytics team and contribute to the development of our Data Lakehouse platform. In this role, you will build and maintain scalable data pipelines and storage solutions that unify the flexibility of data lakes with the performance of data warehouses.

Your responsibilities include building the platform brick by brick, adhering to project templates, following best practices, and ensuring optimization and performance at every stage of development. This role is critical for integrating data streams, building data cleansing, processing, and validation pipelines, and ultimately supporting business intelligence and AI initiatives across the organization.

Key Responsibilities

• Build data ingestion pipelines from structured and unstructured sources into the Lakehouse.
• Develop and maintain ETL/ELT workflows using tools such as Apache Spark, dbt, SQL, Shell scripts, and Python.
• Work on Data Lakehouse platforms (Trino, MPP systems, Apache Iceberg, Apache Hudi, or similar) and Data Warehouse platforms (Greenplum, Teradata, Netezza, or similar) with hands-on experience.
• Ensure data quality, lineage, and governance using tools like Datahub, Apache Atlas, Great Expectations, or Unity Catalog.
• Collaborate with data scientists, analysts, and business stakeholders to deliver clean, curated, and timely datasets.
• Optimize data storage and query performance using partitioning, caching, and indexing strategies.
• Ensure data security and access control across the development Lakehouse environment.
• Participate in UAT and troubleshoot pipelines to ensure accuracy and reliability.

Required Skills & Qualifications

• Bachelor s or Master s degree in Computer Science, Engineering, or a related field.
• 3 5 years of experience in data engineering or big data development.
• Proficiency in SQL, PSQL, Shell Scripting, Python, and Spark (PySpark or Scala).
• Hands-on experience with cloud and on-prem data platforms and data lakehouse tools like Airflow, Greenplum, SQL/Postgres, bulk load utilities, Apache Iceberg, MPP engines, etc.
• Strong understanding of data modeling (dimensional and normalized), data warehousing, and streaming data (Kafka, ActiveMQ, etc.).
• Familiarity with CI/CD pipelines, version control (Git), and infrastructure-as-code (Terraform, CloudFormation).

Preferred Qualifications

• Experience with real-time data processing (Structured Streaming, Flink).
• Certifications in relevant data engineering technologies.