Senior Data Engineer - Sought by Leading Commodities firm - Permanent - Hybrid - London
Salary - Up to 135K + 20-30% Bonus
About the role - We're looking for an experienced Data Engineer for the Surveillance IT team to develop ingestion pipelines and frameworks across the application portfolio, supporting Trade Surveillance analysts with strategy and decision-making. You should be experienced in a data engineering role demonstrating a strong track record of designing, building, and maintaining data pipelines and data architectures.
Required Skills -
- Proficiency in Python, Pyspark, SQL for data manipulation and querying.
- Experience with containerisation technologies, specifically Kubernetes and Docker.
- Proven experience in designing and implementing data pipelines, working with big data technologies and architectures.
- Proven experience of Financial Services - trade and financial concepts, particularly in relation to market data.
Desired Skills -
- Experience working with Cloud Services, Familiarity with trade surveillance systems and methodologies.
- Understanding of operations or trading in the commodities context, particularly in Oil, Gas, Shipping, and related activities.
