YK
Yehya Khaled Khurkhash
Mid-Level Data Engineer at ShopBrain
New Cairo, Cairo, EgyptWork Experience
Mid-Level Data EngineerFull Time
ShopBrain
Jan 2024 - Present -1 yr, 6 months
Egypt , Cairo
- Job Details:• Collaborated with downstream data consumers to understand requirements and assessed available data sources for relevance. • Designed, built, and managed a robust data platform on Azure Synapse Analytics to serve large-scale data to machine learning engineers and business users. • Engineered and implemented data warehouse models following Ralph Kimball’s methodology and utilized Erwin Modeler for efficient modeling. • Designed and implemented high-performance ETL pipelines using SSIS, Azure Synapse Pipelines, and Python then developed a notification system using Azure Logic Apps and Slack. • Transformed and standardized NoSQL data stored in MongoDB into a structured, tabular format for storage in Azure SQL Server. • Ensured data integrity and cleanliness through data quality checks and cleansing procedures, employing SQL, Python, and Synapse Data Flows. • Evaluated and selected appropriate tools and services to meet the demands of diverse data engineering tasks. • Facilitated secure access to the data platform for external partners while implementing robust security measures to secure sensitive information. • Developed Power BI reports for the top management and our partners.
Data & AI EngineerFull Time
- Job Details:• Worked on 2 mega analytics projects with the Central Agency for Public Mobilization and Statistics (CAPMAS) and National Population Council (NPC). • Gathered business requirements and evaluated the available data sources. • Conducted exploratory data analysis and cleansing using Python, SSIS, and SQL. • Developed data warehouse models using Ralph Kimball’s approach and Erwin Modeler. • Designed and built high-performance ETL pipelines using SSIS and Azure Data Factory. • Built semantic models using SSAS and reporting layer using Power BI. • Developed machine learning models for time series forecasting and integrated the models into the data pipeline using Python, SqlAlchemy, Pandas, and Scikit-Learn. • Prepared workshops for Microsoft and GBG partners on Azure modern data warehouse.
Education
Technical Diploma in Business Intelligence
Information Technology Institute (ITI)Jan 2022 - Jan 2022 - 0 Month
Bachelor’s Degree in Aerospace Engineering in Aerospace Engineering
Zagazig University (ZU)Jan 2016 - Jan 2021 - 5 yr
Activities
PR & Partnerships Lead at NASA Space Apps Cairo
Volunteering
Apr 2023 - Oct 2023 -6 months
Chairman at IEEE ZSB
Volunteering
Sep 2019 - Oct 2020 -1 yr, 1 month
Achievements
1st Place Winner, Graduation Projects Competition, Port Said Engineering Day 2021
Skills
- Microsoft SQL Server
- Transact-SQL
- SQL Server Integration Services
- SQL Server Analysis Services
- Microsoft Power BI
- Python
- ETL
- Data Integration
- Data Warehouse
- Microsoft Azure
View More
Languages
Arabic
FluentEnglish
Advanced