TL;DR

Senior Software Engineer, Data Query Platform (Java, Spark): Building and optimizing hyper-scale data lake systems for an AI-native cybersecurity platform with an accent on foundational processing, scalable pipelines, and data storage. Focus on designing, developing, and maintaining ultra-high-scale data platforms that process petabytes of data for analytics, machine learning, and threat hunting.

Location: Hybrid in London, United Kingdom

Company

CrowdStrike is a global leader in cybersecurity, protecting organizations with the world's most advanced AI-native platform.

What you will do

  • Write highly fault-tolerant Java code within Apache Spark to produce platform products used by customers to query event pipelines.
  • Design, develop, and maintain ultra-high-scale data platforms that process petabytes of data.
  • Participate in technical reviews to develop new features and enhance system stability.
  • Continually improve the efficiency and reduce latency of high-performance services.
  • Research and implement new ways for both internal and external stakeholders to query data efficiently and extract results.

Requirements

  • 10+ years of experience combined between backend/cloud development and data platform engineering roles.
  • 5+ years of experience building data platform products or features with Apache Spark, Flink, Iceberg, or comparable tools.
  • 5+ years of experience programming with Java, Scala, or Kotlin.
  • Proven experience owning robust feature/product design end to end, especially with vaguely defined problem statements.
  • Proven expertise with algorithms, distributed systems design, and the software development lifecycle.
  • Experience building large-scale data/event pipelines.
  • Expertise designing solutions with relational SQL and NoSQL databases, including Postgres/MySQL, Cassandra, DynamoDB.
  • Good test-driven development discipline.
  • Reasonable proficiency with Linux administration tools.
  • Proven ability to work effectively with remote teams.

Nice to have

  • Go
  • Pinot or other time-series/OLAP-style database
  • Iceberg
  • Kubernetes
  • Jenkins
  • Parquet
  • Protocol Buffers/GRPC

Culture & Benefits

  • Market leader in compensation and equity awards.
  • Comprehensive physical and mental wellness programs.
  • Competitive vacation and holidays for recharge.
  • Paid parental and adoption leaves.
  • Professional development opportunities for all employees.
  • Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections.
  • Vibrant office culture with world-class amenities.
  • Great Place to Work Certified™ across the globe.