Rajasekar Kaliyannan

Data Engineer

• Job Details:Designed and optimized Spark jobs for ETL workflows, handling data transformation and aggregation for downstream analytics. Built efficient batch processing workflows to aggregate and transform data from multiple sources using Apache Spark. Designed and deployed cloud-based data pipelines that integrate scalable storage solutions, serverless computing for ETL which significantly improved processing time and reduced operational overhead.

Senior Software Engineer - PySpark Developer

• Job Details:Experience in working with AWS application, which includes services like Glue, RDS, S3, SNS, CloudWatch, Athena and the programming languages including Java and Python. Creating AWS Glue jobs to fetch the data from MySQL database server to S3 and experience using crawlers. Experience in ETL creation involving data cleansing, data transformation and optimization of the workflows. Experience with data warehouse and data lake architectures, data modeling techniques, and tools.