Innovation Hub I Senior Cloud Data Platform Engineer, Cairo, Egypt

Senior Cloud Data Platform Engineer, Cairo, EgyptConnect to your career at DeloitteDeloitte drives progress. Using our vast range of expertise, that covers audit, risk advisory, and consulting services across tax, legal, business, technology, and corporate finance, we help our clients’ become leaders wherever they choose to compete. To do this, we invest in outstanding people. We build teams of future thinkers, with diverse talents and backgrounds, and empower them all to reach for and achieve more.What brings us all together at Deloitte? It’s how we approach the thousands of decisions we make every day. How we behave, our beliefs and our attitudes. In other words: our values. Whatever we do, wherever we are in the world, we lead the way, serve with integrity, take care of each other, foster inclusion, and collaborate for measurable impact. These five shared values lead every decision we make and action we take, guiding us to deliver impact how and where it matters most.Connect to your opportunityOur people work in a variety of projects to solve clients' toughest data problems by combining industry experience, consulting, and analytical skills to create a lasting impact. Our projects and clients vary greatly, and your responsibilities will differ based on your level of experience/skillset and the focus of the client engagement, your role is likely to include some or all the following:Placing a focus upon exceeding client expectations and delivering against our continuous improvement goals, taking a client problem, and turning it into a technical solutionData Ingestion: Design, implement, and manage data ingestion pipelines to collect and ingest data from various sources into the cloud data platform. This might involve using tools like Apache Kafka, AWS Kinesis, or Azure Event Hubs.Data Transformation: Develop and maintain data transformation processes to clean, enrich, and structure data for analytics and reporting purposes. This often involves using ETL (Extract, Transform, Load) tools or scripting languages like Python.Data Integration: Integrate different data sources and systems to ensure data consistency and accessibility. This may involve setting up data connectors or APIs.Data Security: Implement and enforce data security measures, including encryption, access controls, and compliance with data privacy regulations such as GDPR or HIPAA.Performance Tuning: Monitor and optimize the performance of the cloud data platform to ensure efficient data processing and query performance. This may involve adjusting configurations, indexing, and caching.Automation and Orchestration: Create and maintain automation scripts and workflows to manage data pipelines, backups, and routine tasks. Infrastructure as Code (IAC) tools like Terraform or AWS CloudFormation may be used.Monitoring and Alerting: Set up monitoring and alerting systems to proactively identify and address issues with data pipelines, platform health, and data quality. Tools like Prometheus, Grafana, or cloud-native monitoring solutions can be employed.Documentation and Collaboration: Document data platform architecture, processes, and best practices. Collaborate with data engineers, data scientists, and other stakeholders to understand their requirements and ensure the data platform meets their needs.Connect to your skills and professional experienceAs a Senior Cloud Data Platform Engineer, you will have the following responsibilities:Lead a small team of data platform engineers in the design, development, and implementation of data engineering solutions.Gather requirements from stakeholders and translate them into technical specifications.Design and implement data pipelines to collect, transform, and load data into data warehouses and data lakes.Maintain and optimize data systems to ensure high availability and performance.Work with other engineering teams to integrate data engineering solutions with other systems.Stay up to date on the latest data engineering technologies and trends.Assists with the data platform blueprint and design, encompassing the relevant data platform components.Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.High degree of (hands-on) technical guidance & vision with broad subject matter expertise in cloud, data and security technologies, specifically AWS, Azure, GCP, Oracle, and SIEM platforms (Splunk ES and Sentinel)Experience with TerraformExtensive experience and expertise across the Splunk platform, its architecture and distributed components including premium apps (ITSI, Enterprise Security, Phantom, etc…)Experience with data streaming technologiesExperience of agile methodologies and associated toolsets and code repositoriesCoding experience using languages such as Python and/or BashExperience working with CI/CD, Infrastructure-as-Code, and other automation toolsStrong collaboration and stakeholder engagement skillsSelf-motivated and organised personHigh level of attention to detail, the ability to think architecturally at ‘big picture’ and able to translate this into practical implementationExcellent ability to execute where information is ambiguous, utilising professionalism, experience and prior knowledgeExcellent analytical and problem-solving skillsStrong interpersonal skills: role will require engagement with a varied and senior stakeholder baseDocumentation skills in order to provide high quality documentation for internal customers and technical teamsOpenness to learning and managing new technologies as business requirements changeAbility to work in 24X7 support and shifted working hours projects.Desirable:Familiar with industry big data platform stack like Databricks, Spark, Hadoop, Flink, Airflow, MPP Database, etc.Cloud certified with experienceRequired strong technical skills and demonstrated experience in each of the following areas:Excellent communication (written and oral) and interpersonal skillsDeliver right solution architecture, automation and technology choices starting from experimentation and proof of concept phases of new analytical modelsDemonstrated teamwork and collaboration in a professional settingFlexible and willingness to work on different projects and programming6 - 10 years of experienceConnect to your service line - ConsultingDistinctive thinking, deep expertise, and collaborative working. That’s what connects us. That’s what makes us Deloitte. If you want to help solve some of the biggest challenges around, join us. Together, we’ll make an impact that matters.Personal independenceRegulation and controls are standard practice in our industry and Deloitte is no exception. These controls provide important legal protection for both you and the firm. We are subject to several audit regulations, one of which requires that certain colleagues abide by specific personal independence constraints. This can mean that you and your "Immediate Family Members" are not permitted to hold certain financial interests (shares, funds, bonds etc.) with audit clients of the firm. The recruitment team will provide further detail as you progress through the recruitment process.Connect to your Industry“What attracted me to Deloitte were the endless opportunities and the collective experience of other like-minded individuals. Deloitte’s clients include many of the world’s largest organisations; I wanted to be part of a team that made a difference that I could be proud of."-Dan, ConsultingConnect with your colleaguesLocation: Cairo. EgyptYour Work, Your Way: We call our hybrid working vision Deloitte Works. And it does. We trust you to make the right choices around where, when, and how you work. You’ll be able to make decisions about how you work best, to be collaborative, learn from colleagues, share your experiences, build the relationships that will fuel your career and prioritise your wellbeing. Having great conversations with your team and your leadership paves the way for great collaborative ways of working.Connect to your agile working optionsYour Work, Your Way: We call our hybrid working vision Deloitte Works. And it does. We trust you to make the right choices around where, when, and how you work. You’ll be able to make decisions about how you work best, to be collaborative, learn from colleagues, share your experiences, build the relationships that will fuel your career and prioritise your wellbeing. Having great conversations with your team and your leadership paves the way for great collaborative ways of workingOur commitment to youMaking an impact is more than just what we do: it’s why we’re here. So we work hard to create an environment where you can experience a purpose you believe in, the freedom to be you, and the capacity to go further than ever before.We want you. The true you. Your own strengths, perspective, and personality. So, we’re nurturing a culture where everyone belongs, feels supported and heard, and is empowered to make a valuable, personal contribution. You can be sure we’ll take your wellbeing seriously, too. Because it’s only when you’re comfortable and at your best that you can make the kind of impact you, and we, live for.Your expertise is our capability, so we’ll make sure it never stops growing. Whether it’s from the complex work you do, or the people you collaborate with, you’ll learn every day. Through world-class development, you’ll gain invaluable technical and personal skills. Whatever your level, you’ll learn how to lead.Connect to your next step A career at Deloitte is an opportunity to develop in any direction you choose. Join us and you’ll experience a purpose you can believe in and an impact you can see. You’ll be free to bring your true self to work every day. And you’ll never stop growing, whatever your level.