Systems Architecture - AWS data engineer
Job Description
Location: UK - Will require travel to customer site as and when required (Belfast)
Job Summary: We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing, and managing data architecture solutions for our customers, with a strong emphasis on Cloud technologies (Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques.
Key Responsibilities
-Data Ingestion and Extraction: Design and implement efficient data ingestion pipelines to and from databases and file storage services.
-Data Transformation and Cleaning: Transform and clean raw data to ensure data quality and consistency.
-Data Pipelines: Build, maintain, and optimise data pipelines to automate data flows and enable real-time data processing.
-Data Quality Assurance: Monitor data quality and implement measures to ensure data accuracy and completeness.
-Database Administration: Manage and maintain databases (e.g., SQL, NoSQL) to ensure optimal performance and security.
-Cloud Infrastructure: Deploy and manage data infrastructure on cloud platforms - Primarily AWS
-Collaboration: Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.
Key Skills
-Strong proficiency in SQL, Python, and Spark. Experience with metadata-driven ETL/ELT.
-Experience with AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight
-Version Control (Gitlab) and CI/CD
-Familiar with security and networking principles, especially in an AWS deployment.
-Understanding and experience handling both structured and unstructured data.
-AWS focused with working experience and/or relevant certifications such as AWS Certified Data Engineer.
-Experience with complex data migrations.
-Strong problem-solving and analytical skills.
-Excellent communication and collaboration skills.
-Understanding of Infrastructure as Code
-Understanding of GIS data models
LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.
Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.
