Job DescriptionJob Summary:The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices.Duties And ResponsibilitiesOptimize and enhance data processing performance by identifying and resolving performance issuesDevelop, implement & test scripts and programs in Python to automate data processing and analysis tasksUtilize complex SQL for data extraction, manipulation, transformation, loading, optimizing performance and efficiencyDesign, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharingCollaborate with other teams such as business intelligence, applications, and consultants, to understand and meet client’s data needs and challengesPerform data analysis and profiling to identify data quality issues anomalies and opportunities for improvementParticipate in managing and monitoring data security and access anomaliesDocument and keep up to date procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutionsRequirements And QualificationsMust have from 4 - 8 years of experience in data engineeringCloud computing platforms: AWS/Azure/GCPExperience in data integration (ETL/ELT) development using Python, PySpark, and SparkSQLData warehouse technologies: Redshift/Snowflake/BigQueryData lake technologies: Hadoop, Spark, and HiveOrchestration: Airflow/Control-M/(Any Orchestration tool)Machine learning frameworks: TensorFlow, PyTorch, and sci-kit-learnExcellent problem-solving and analytical skillsStrong communication and interpersonal skillsExcellent English communicationRecruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available here.