Job Details
Experience Needed:
Career Level:
Education Level:
Salary:
Job Categories:
Skills And Tools:
Job Description
As a data engineer, you will independently and as part of a team:
- Prepare analytic datasets including numerical as well as string features
- Do exploratory data analysis
- Configure and administrate Hadoop and Kubernetes cluster
- Productionize AI models (Analytics Ops / Dev Ops)
Job Requirements
Minimum skillset:
- M.Sc. or equivalent working experience in software engineering, data engineering, or data science
- Good SQL foundation
- Expert level in PySpark
- Expert level in MLlib
- Expert level in Python including Numpy, Pandas, Scikit-learn
- Expert level in Dockers and Kubernetes
- Intermediate Hadoop administration skills
- Intermediate Linux shell scripting skills
- Familiar with AirFlow
Ideal skillset:
- NLP experience.
- Familiar with PowerBI.
- (In addition to the minimum skillset)