Job Details
Experience Needed:
Career Level:
Education Level:
Salary:
Job Categories:
Skills And Tools:
Job Description
Job Description:
This is an exciting opportunity for a seasoned Data Engineer who is familiar with Microsoft Azure technologies (Data Factory, Data Lake Storage) and who will be tasked to take the data of one of the largest retail groups in Saudi Arabia to the cloud.
Responsibilities:
- Set up the Azure Cloud environment and lakehouse infrastructure.
- Migrate Data from in-prem servers to the Cloud
- Design, build and maintain scalable data pipelines and ETL processes using Azure Synapse, PySpark and Databricks
- Troubleshoot and resolve issues related to data ingestion, processing and storage
- Set up data pipelines, run ELT (Extract-Load-Transform) to copy data, and set up Change Data Capture (CDC) tasks.
- Conduct DevOps/DataOps to verify data pipelines and data quality.
- Train and handover to the Data infrastructure team
Job Requirements
Requirements:
- Minimum of 6 years of experience in Azure data engineering, including expertise in Azure Synapse, PySpark, Databricks and Python
- Strong problem-solving and analytical skills, with attention to detail and ability to troubleshoot complex issues
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment
- Willingness to relocate to Saudi Arabia for a few months
What we offer:
- Competitive Salary
- Facilitate Relocation: Visa, flights, and expenses
- Accommodation throughout the project duration in Riyadh
- A flight home every 3 months