DM
Dhiraj Mishra
Associate Technical Architect - Data at Quantiphi
Mumbai, IndiaWork Experience
Associate Technical Architect - Data
Quantiphi
Jul 2023 - Present -2 yrs, 1 month
India
- Job Details:Designed and implemented a scalable near real-time streaming platform on AWS using Postgres RDS, DMS, Kinesis Data Streams, Lambda, and Redshift for a sporting client. Identified and mitigated various system bottlenecks, created a staging layer, migrated over 200 GB of raw data using AWS Glue, developed an automated incremental data loading script, created comprehensive reports, improved Spark job performance, and led a team of data engineers.
Blenheim Chalcot
May 2023 - Jul 2023 -2 months
India
- Job Details:Worked on building business using generative AI like ChatGPT v4, DALL-E.
Senior Software Developer - Data
Synechron
Dec 2022 - May 2023 -5 months
India
- Job Details:Setting up an AWS Lambda function to retrieve files uploaded to S3 and perform data validation and completeness check, creating Lambda functions to move data from raw to lake layer.
Deloitte USI
Jul 2021 - Dec 2022 -1 yr, 5 months
India
- Job Details:Worked for a finance project to build AWS pipelines to load data from multiple source systems using Kinesis Data Firehouse, S3, EMR on EKS, Lambda, DynamoDB.
Education
Bachelor's Degree in Machine Learning & AI
I.I.I.T BangaloreJan 2019 - Jan 2020 - 1 Year
Bachelor's Degree in Electronics and Telecommunication
K.J. Somaiya College of EngineeringJan 2013 - Jan 2017 - 4 yr