Job Search

Data Engineer

Defence Division
Contract/Interim
01782203040
£450 - £460 per day + inside IR35
Yorkshire
258
04-02-2026 01:11 PM
**3 days a week onsite in Sheffield**
* Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale.
* Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services for transformation and enrichment.
* Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs across the stream layer.
* Integrate processed telemetry into Splunk for visualization, dashboards, alerting, and analytics to achieve Observability Level 4 (proactive insights).
* Implement schema management (Avro/Protobuf), governance, and versioning for telemetry events.
* Build automated validation, replay, and backfill mechanisms for data reliability and recovery.
* Instrument services with OpenTelemetry; standardize tracing, metrics, and structured logging across platforms.
* Use LLMs to enhance observability capabilities (e.g., query assistance, anomaly summarization, runbook generation).
* Collaborate with platform, SRE, and application teams to integrate telemetry, alerts, and SLOs.
* Ensure security, compliance, and best practices for data pipelines and observability platforms.
* Document data flows, schemas, dashboards, and operational runbooks.
Required Skills:
* Hands-on experience building streaming data pipelines with Kafka (producers/consumers, schema registry, Kafka Connect/KSQL/KStream).
* Proficiency with OpenShift/Kubernetes telemetry (OpenTelemetry, Prometheus) and CLI tooling.
* Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM), building dashboards and alerting.
* Strong data engineering skills in Python (or similar) for ETL/ELT, enrichment, and validation.
* Knowledge of event schemas (Avro/Protobuf/JSON), contracts, and backward/forward compatibility.
* Familiarity with observability standards and practices; ability to drive toward Level 4 maturity (proactive monitoring, automated insights).
* Understanding of hybrid cloud and multi-cluster telemetry patterns.


LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.

Can't find the job you're looking for?

Complete this short form & submit your CV then we will do the rest.

To get alerts on jobs, go here

(Permitted file size is 5Mb and file types are: doc, docx, txt, pdf, rtf, xls)

Attach CV*