Senior Big data Engineer

TPAY -
New Cairo, CairoPosted 6 years ago

17Applicants for1 open position

Job Details

Experience Needed:

Career Level:

Education Level:

Salary:

Job Categories:

A big data engineer builds large-scale data processing systems, is an expert in data warehousing solutions and should be able to work with the latest (NoSQL) database technologies

Job Description:

Implement/Optimize ETLs to: Capture, cleanse, and augment data from different sources.
Design and implement a data hub/store to store all the cleansed and organized data.
Continuous maintenance of data integrity and consistency of the data store, such as DWH.
Implement and execute data archiving strategy.
Provide a fast/secure way to access data hub to cater for other analytics purposes.

Knows how to capture, process, store and access data (ETL), aware of ETL tools such as Talend, Datastage, etc…
Familiar with DWH, Apache Hadoop, Apache Spark, NoSQL Databases, Machine Learning and Data Mining, Statistical and Quantitative Analysis, SQL, Data Visualization.
Scripting languages and General Purpose Programming Languages, of both traditional and big data.
Data integration and cleansing
Problem solving.
Performance optimization of a data workflow