Senior Data Engineer
Worex -
Maadi, CairoPosted 2 years ago14Applicants for2 open positions
- 4Viewed
- 2In Consideration
- 0Not Selected
Job Details
Experience Needed:
Career Level:
Education Level:
Salary:
Job Categories:
Skills And Tools:
Job Description
- New data integrations, DataOps, troubleshooting & automation & Teradata migration and transformations
- Create and maintain, with the team, an optimal data pipeline architecture.
- Build, deploy, and maintain distributed data analytics systems using Hadoop/Spark, Python, Java , Go , Scala, and C/C++
- Assemble large, complex data sets that meet functional / non-functional requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal loading of data from a wide variety of data sources using SQL and big data technologies.
- Work with stakeholders including the Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Identify gaps and improve the platform’s quality, robustness, and speed
- Meet customer requirements in terms of availability, reliability, functionality, and performance
Job Requirements
- Results-oriented, determined and having a self-driven attitude
- Deep Understanding of CS (Data Structure , Algorithms , Data Sterilization , Discreate Mathematics , CLI , Shell Scripting , networking, and corn jobs )
- Proven Experience in programming languages like (Java , Python , Scala)
- Deep understanding of relational and non-relational databases
- Basics understanding and implementing Machine Learning (TensorFlow, Spark MiLB)
- Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets. In both batch and real-time data integration.
