A DV-cleared Data Engineer is required to support an Agile development project which is building bespoke algorithms and applications for a Defence customer. In this role, you will be expected to design, build and integrate data from various resources to enable a team of data scientists to rapidly leverage those data sets. Proactive in your approach, you will be able to deliver to with minimal supervision, with the below skills:-
a. Creating, managing & monitoring data flows with Apache NiFi
b. Extending Apache Nifi using scripts (e.g. Groovy, Python)
c. Hadoop data loading
a. Apache NiFi extensibility via writing custom processors
b. Apache NiFi administration and security
c. Web scraping, including the use of REST APIs, PKI authentication & interaction with SharePoint and RSS Feeds
d. Python, including experience of GDAL, NumPy, Scipy
e. Apache Kafka usage, configuration and optimisation
f. ElasticSearch data loading & optimisation
g. PostgreSQL & PostGIS usage, configuration and administration
h. Experience with large scale geospatial data handling, especially GeoMesa on Accumulo
i. Experience working with satellite imagery formats
Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 18 weeks.
LA International Computer Consultants Ltd is an HMG Approved Consultancy and operates as an IT & Engineering Consultancy or as an Employment Business & Agency, depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, we welcome applications from all sections of the community and from people with diverse experience and backgrounds.
Award Winning LA International Computer Consultants Ltd (Recruiter Awards for Excellence - Best IT, Best Public Sector & Gold Awards) and the most prestigious award that any business can receive The Queens Award for Enterprise: International Trade 2015.