Skip to main content
Back to jobs

Market Data Engineer (Domain Trading Expertise Required)

External
Bhft logoBhft · Barcelona, Spain
Full-timeRemote1w ago
AirflowApacheArgoCDAWSCI/CDdbt
Cover LetterConnect

Prepare for this interview

Elite

AI-generated questions, company research, and talking points tailored to this role

Responsibilities

  • Reliability & Observability. Embed monitoring, alerting, SLAs/SLOs, and CI/CD across capture and pipeline layers on Kubernetes (EKS). Own data-quality dashboards and incident runbooks for the capture fleet.
  • Collaboration. Partner with Quant Research, Data Science, Backend, and DevOps to translate requirements into platform capabilities and champion market-data engineering best practices.
  • 5+ years building production-grade data systems, with proven expertise architecting and launching data lakes / lakehouses from scratch.
  • Hands-on experience with Apache Iceberg (or comparable table formats - Delta / Hudi): partitioning, schema evolution, snapshots, compaction, and catalog operations; familiarity with Apache Arrow for zero-copy, columnar in-memory interchange.
  • Experience with market data and/or network packet capture - decoding pcap, exchange feed protocols (ITCH, FIX/FAST, multicast UDP), order-book reconstruction, and time-series at scale (strong plus; willingness to learn required).
  • Experience normalizing market data from multiple vendors - e.g. OneTick, Refinitiv/Reuters, Bloomberg, ICE - into a unified schema and symbology (strong plus).
  • Expert-level Python (incl. Polars and/or PySpark); Rust a strong plus (relevant for high-performance capture/decoding).
  • Modern orchestration (Airflow) and distributed processing (Apache Spark).
  • Advanced SQL: complex aggregations, window functions, query optimization, partition pruning.
  • Solid fundamentals in Linux, containerization (Docker, Kubernetes / EKS), and cloud object storage (AWS S3).
  • DevOps & observability: CI/CD, infrastructure-as-code (Terraform), GitOps (ArgoCD), and metrics/dashboards/alerting (Grafana, Prometheus).
  • Strong grasp of structured + unstructured / binary data, and storage optimization - partitioning, compression, cost management.
  • English fluency for documentation and collaboration in an international team.

Benefits

Work in a modern IT company - no bureaucracy or legacy systems.Real opportunities for professional growth and to make your mark.Fully remote work from anywhere in the world, on a flexible schedule.Compensation for health insurance, sports, professional development, and more.Health insuranceRemote work optionsFlexible schedule

Additional Information

The Data Engineering team is responsible for designing, building, and maintaining the Market Data Platform - a lakehouse infrastructure spanning the full path from raw exchange feeds to reliable, petabyte-scale data for research, backtesting, and real-time trading.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at Bhft? Share your experience

Interested in this role?

Apply on the company's website.

Cover LetterConnect