***SC CLEARED***
Data Engineer
3-6 Month contract initially + Extensions
Based: Remote, possibly 1 day per month onsite in Newcastle upon Tyne.
Market Rates via Umbrella
We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a difference. We have a great opportunity for a number of Data Engineers on a long term program of work.
Key Responsibilities:
Listen to the needs of technical and business stakeholders, and interpret them
* effectively manage stakeholder expectations
* manage active and reactive communication
* support or host difficult discussions within the team or with diverse senior stakeholders
* understand and help teams to apply a range of techniques for data profiling
* source system analysis from a complex single source
* bring multiple data sources together in a conformed model for analysis
* establish enterprise-scale data integration procedures across the data development life cycle, and ensure that teams adhere to them
* manage resources to ensure that data services work effectively at an enterprise level
* identify areas of innovation in data tools and techniques, and recognise appropriate timing for adoption
* establish standards, keep them up to date and ensure adherence to them
* keep abreast of best practice in industry and across government
* understand the concepts and principles of data modelling and can produce relevant data models
* work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations
* design the method to categorise data models within an organisation
* design an appropriate metadata repository and present changes to existing metadata repositories
* understand a range of tools for storing and working with metadata
* provide oversight and advice to more inexperienced members of the team
* ensure that the most appropriate actions are taken to resolve problems as they occur
* co-ordinate teams to resolve problems and to implement solutions and preventative measures
* use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations
* collaborate with others to review specifications where appropriate
* show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape
* review requirements and specifications, and define test conditions
* identify issues and risks associated with work
* analyse and report test activities and results.
Key Technical Skills & Experience:
* AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure
* Terraform
* Databricks
* Kafka
* Data Lake, Warehouse, Lakehouse architecture and design
* Python/Pyspark
* Data platforms and notebooks: Jupyter, Databricks, Azure
* Gitlab: repository and CI/CD
* Java (Spring Boot) experience is a plus
This is an excellent opportunity on a great project of work, If you are looking for your next exciting opportunity, apply now for your CV to reach me directly, we will respond as soon as possible.
Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.
Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.
