Umar Shaikh

Data Engineer at Aria Aerotech Pvt Ltd.

Aria Aerotech Pvt Ltd.

Aug 2023 - Present -2 yrs, 1 month

Job Details:Developed an ETL pipeline to fetch data from PostgreSQL, convert it to CSV, store it in GCS, and load it into BigQuery, reducing data processing time by 40%. Ensured data integrity by implementing automated validation and logging mechanisms, improving data accuracy by 99%. Optimized pipeline execution, reducing processing time and improving system reliability by 35%. Designed Airflow DAGs to automate data pipeline execution and monitoring, reducing manual intervention by 60%. Integrated error handling and alerting mechanisms to notify stakeholders of failures, decreasing downtime by 45%. Designed and implemented a 100% automated pipeline for extracting, translating, and storing text from PDFs in Google Cloud Storage (GCS), increasing processing speed by 50%, optimizing resource usage by 30%, and reducing manual workload by 70%.

Aria Aerotech Pvt Ltd.

Jul 2022 - Jul 2023 -1 yr

Job Details:Performed regular task checking on the sprint board, ensuring 95% project alignment and improving workflow efficiency by 30%. Developed PySpark programs for data extraction from Google Cloud Storage (GCS), contributing to a 35% reduction in processing time. Developed programs for data partitioning, optimizing processing efficiency by 40% and improving resource utilization by 30%. Automated manual processes using Dataproc workflows, achieving a 30% increase in efficiency. Managed log files to improve traceability and debugging efficiency by approximately 50-70%.

Bachelor's Degree in Computer Science and Engineering
Marathwada Institute of Technology
Jan 2023