Lead Data Engineer / Architect (all genders)

<p><span style="font-family:verdana, geneva, sans-serif"><strong>Your role:</strong></span></p><p><span style="font-family:verdana, geneva, sans-serif">We are seeking a highly skilled Lead Data Engineer / Data Architect with a strong developer background to design, build, and operate our Security Data Platform. This role will focus on end-to-end data management, design and architect analyzation, ingestion, normalization, storage, processing, and serving the solutions.

The primary emphasis will be on Security Data and Observability Data, serving as the foundation for fraud and threat detection, detection engineering, and response through different types algorithms and machine learning approaches. Additionally, the platform will provide observability for the entire application landscape, facilitating troubleshooting and reporting.</span></p><p> </p><p><span style="font-family:verdana, geneva, sans-serif"><strong>Key Responsibilities:</strong></span></p><ul type="disc"><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Lead a team of engineers and developers in the implementation of the Data Platform.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Design and architect data ingestion, normalization, storage, processing, and serving solutions.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Ensure the Data Platform supports observability across the application landscape.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Collaborate with cross-functional teams to gather requirements and deliver effective data solutions.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Monitor and optimize platform performance, scalability, and security.</span></li></ul><p><span style="font-family:verdana, geneva, sans-serif"><strong> </strong></span></p><p><span style="font-family:verdana, geneva, sans-serif"><strong>Who you are:</strong></span></p><ul type="disc"><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Bachelor's or master’s degree in computer science, Data Engineering, or a related field.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Demonstrated experience in designing and implementing large-scale data platforms. (Expertise in programming languages such as Java and Python is a plus)</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Proven experience with Kubernetes for container orchestration.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Strong knowledge of Apache Kafka for real-time data streaming and experience with Apache Flink for stream processing.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Experience with analytical databases (e.g.

OLAP) and Massively Parallel Processing MPP architectures, especially in the context of optimization and performance tuning </span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Familiarity with lakehouse architectures (e.g. Apache Iceberg) - Experience with MLOps and ML model delivery pipelines</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Knowledge of Elasticsearch to support migration to alternative solutions</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Excellent leadership and team management skills, Project Management skills is a plus</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Strong analytical and problem-solving skills and ability to work collaboratively in a fast-paced environment.</span></li><li style="font-family:verdana, geneva, sans-serif"><span style="font-family:verdana, geneva, sans-serif">Hands-on experience in projects using or applying machine learning</span></li></ul><p> </p><p><span style="font-family:verdana, geneva, sans-serif"><strong>Our Tech Stack</strong></span></p><p><span style="font-family:verdana, geneva, sans-serif">Kubernetes, Apache Kafka, Apache Flink, Java, Python, TypeScript, Postgres, Apache Doris, Grafana.</span></p><p> </p><p><span style="font-family:verdana, geneva, sans-serif;font-size:10.0pt">Job Evaluation: Expert 3</span></p><p><span style="font-family:verdana, geneva, sans-serif;font-size:10.0pt">Department: EF-DS-TITJ Identity & Access Management</span></p>