Big Data Engineer -
Careem -
Dubai, United Arab EmiratesPosted 5 years ago12People have clicked1 open position
Job Details
Experience Needed:
Career Level:
Education Level:
Salary:
Job Categories:
Skills And Tools:
Job Description
As a Big Data Engineer at Careem, you’ll be part of a team that builds solutions and tools to enable, organize and process large amounts of data. You will be working with batch and real-time technologies such as Hadoop, Hive, Spark, Spark streaming, Kafka, Cloud computing, and storage to help Careem becoming a data-driven company.
Some of the problems the team is working on are: building a tool to enable business areas to create real-time metrics, automating jobs and pipelines and delivering fast and reliable software.
Job Requirements
Essential:
- 3+ years hands-on experience in Object-Oriented programming and data structures algorithms
- Proficient in languages such as Java, Scala or Python
- 2+ years of experience working with big data technologies like Spark and/or Kafka
- Ability to break down larger problems into smaller ones
- Ability to craft object-oriented models and design data structures
- Understanding of distributed processing tools such as Hadoop/Map Reduce
Desirable:
- Experience with real-time streaming technologies like Kafka streaming/Spark Streaming/Flink
- Working knowledge of containerization (Docker), and supporting technologies
- Experience with orchestration and build tools such as Airflow, SBT, and Maven
- Exposure to AWS data services and technologies (EC2, S3, EMR, Kinesis, Lambda, Glue, Data Pipeline, DynamoDB)
- Knowledge of Relational Databases
- Understanding of the Elastic Search