SC cleared technical architect
* Stakeholder engagement, requirements gathering, and collaboration with the current Data/Analytics Engineer to assess integration into the product roadmap.
* Working within Agile (Scrum) workflows, including ticket definition, allocation, and contributing to the Corporate Roadmap.
* Low-level design and build, ensuring best practices for reusable pipelines and data models.
* Leveraging an appropriate technology stack to build high performance, reusable, self service pipelines for automating Extract Load configurations.
* Defining infrastructure for data pipelines using AWS technologies (e.g., S3, Glue, Athena).
* Casting, cleaning, testing, and modelling loaded data using dbt, following a Kimball Dimensional Model architecture.
* Migrating extract/load pipelines from Airflow infrastructure, including defining a robust testing approach.
* Re architecting pipelines from ETL to ELT, leveraging dbt for dimensional modelling and transformation.
* Working with Data Engineers to deliver a generic, reusable approach to extracting data from source systems (specifically web app data using PlayWright), including Finance and HR datasets.
* Loading data from S3 to Athena using the dlt Python package.
Ensuring strong testing practices, documentation, and simple developer workflows for all the above
Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.
Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.
