TL;DR
Data Engineer (Fintech): Building and optimizing scalable, near real-time data streaming pipelines for banking systems with an accent on Kafka, Databricks, and CDC integration. Focus on designing low-latency event processing, ensuring exactly-once delivery guarantees, and implementing robust data quality frameworks.
Location: Must be based in Europe (specific countries listed). Flexible work format (Remote, Hybrid, or Onsite).
Salary: €3,425–€5,400 per month (gross).
Company
Andersen is an international software development company providing IT solutions for global leaders in fintech, retail, and healthcare.
What you will do
- Design and implement Kafka-based real-time event streaming pipelines.
- Develop CDC pipelines using Debezium or Azure Database CDC.
- Build Databricks Structured Streaming jobs for feature computation and customer insights.
- Optimize streaming throughput, latency, and resource utilization on AKS/Databricks.
- Integrate streaming outputs with downstream ML feature stores.
- Ensure data quality and lineage capture within pipeline artifacts.
Requirements
- Minimum 5+ years of data engineering experience with 3+ years in streaming systems.
- Expert proficiency with Apache Kafka, Confluent, or Azure Event Hubs.
- Hands-on experience with Databricks Structured Streaming and Delta Live Tables.
- Strong knowledge of CDC patterns and stream processing optimization.
- Proficiency in PySpark, Python, and Scala.
- English proficiency: Upper-Intermediate (B2) or higher.
Nice to have
- Confluent Certified Developer certification.
- Experience with Apache Flink or Spark on Kubernetes.
- Domain knowledge of banking transaction data models.
Culture & Benefits
- Full flexibility between remote, office, or hybrid work.
- Professional growth through mentoring, adaptation programs, and corporate training.
- Certification compensation (AWS, PMP, etc.) and English courses.
- Private health insurance and sports activity compensation.
- Annual bonus potential and referral program.
- Active corporate life with regular team events and snacks.
