Job Description
Senior Data Engineer | Outside IR35 Contract | Databricks
Are you a senior data engineer who builds pipelines, not just transforms data within them?
This is a contract role for someone who wants genuine ownership of a modern data platform - not ticket-taker work, but real engineering: designing pipelines, refactoring architecture, and shaping how a Databricks-first platform evolves in a regulated financial services environment.
What you'll be doing
- Building and refactoring data pipelines in Databricks (this is the core platform — Synapse is out)
- Designing ETL/ELT processes and medallion architecture (bronze → silver → gold)
- Contributing to data warehouse design using dimensional modelling
- Working across the full Azure data stack — ADF, ADLS, and beyond
- Collaborating with analysts and architects to solve real business problems
- Helping build team resilience and engineering capability
What the tech stack looks like
- Databricks (primary — strong experience essential)
- Azure Data Factory
- Azure Data Lake Storage
- PySpark / Spark SQL
- CI/CD with Azure DevOps
- Dimensional modelling / Kimball methodology
What you'll need
- Strong, demonstrable Databricks experience - hands-on, not theoretical
- Proven pipeline development skills - you set up pipelines, you don't just work inside them
- Experience with PySpark / Spark SQL
- Background in medallion architecture and data warehouse design
- Comfortable in an Agile, CI/CD environment
- Financial services experience
Why this one is worth a look
This isn't a body-shop contract. You'll be joining at a senior level, working on a platform that's actively evolving, with real scope to influence technical decisions. The team is moving away from legacy tooling and leaning into Databricks — so if that's where your strengths are, you'll be in your element from day one.
If this sounds like your next move, drop me a message or apply with your CV and day rate expectations.