Data Engineer
S3 7UF
Job Number
46863
Posted
17th Sep 2021 : 3:12 pm
Job Status
Live
Job Type
Full time
Duration
6 Months
Pay Type
Inside IR35
Pay Rate
600.00
Payment Method
Daily
Contact
Surita Dadral
Contact details
0203 356 4949, admin@121.uk.com
Job Description
The public sector client is looking to recruit a Data Engineer for a 6 month temporary contract, which is based in Newcastle. The successful candidate will be able to work remotely in the first instance, however, once the restrictions ease, you will be office based.
What you will do: Data Engineers are responsible for the creation and maintenance of analytics infrastructure, providing the foundations for data needs. Data Engineers are responsible for developing, constructing, maintenance and testing of architectures, such as databases and large-scale processing systems, implementing data flows to connect operational systems, and writing and executing ETL scripts and codes
The successful candidate will have a valid SC Clearance.
Please Note: This assignment sits inside IR35.
About the Rates of Pay: The higher pay rate advertised in our job advert/s will always be the highest Ltd or Umbrella Company pay rate that the client is willing to pay up to and the lower pay rate advertised in our job advert/s will always be the highest PAYE pay rate, that the client is willing to pay up to, unless otherwise specified. If the PAYE rate is not indicated in the job advert then please contact us for confirmation of the PAYE daily pay rate.
Essential Skills & Experience
• Programming & build
Designs, develops. codes, tests, corrects and documents simple programs or scripts under the direction of others.
• Technical breadth
Understands core technical concepts related to their role and is able to apply them
• Working Together
Encourage joined up team work within own team and across other groups. Establish professional relationships with a range of stakeholders. Collaborate with these to share information, resources and support. Invest time to develop a common focus and genuine positive team spirit where colleagues feel valued and respect one another
• Making Effective Decisions
Understand own level of responsibility and empower others to make decisions where appropriate. Analyse and use a range of relevant, credible information from internal and external sources to support decisions. Invite challenge and where appropriate involve others in decision making.
Key Tasks & Deliverables
As a Data Engineer, you are responsible for developing accurate, efficient data solutions which meet customer needs to agreed timescales.
You ensure the stability, robustness and resilience of the products you design and build, and are in a position to effect changes to those products where necessary.
As a Data Engineer you support continuous improvement of standards and provide leadership to develop Associate Data Engineers, providing technical guidance alongside other data engineering functions for customers:
Key Responsibilities:
1. Translate business requirements to ensure they are clear and robust, and can be transformed into reusable production ready code and / or effective data models;
2. Define version control mechanisms and strategies for the source code of products;
3. Support Quality Assurance colleagues and Data Managers responsible for the day to day testing and live running of data products and services;
4. Shape solutions in a fit for purpose way; following the agreed principles and contribute to the overall Data Engineer Development lifecycle;
5. Perform data profiling and quality measurements;
6. Designing and developing reusable metadata libraries;
7. Owning the stability of new products designed, including the on-going robustness, resilience and stability of these products;
8. Identifying, managing and resolving issues preventing the delivery or continuous development of products; and
9. Supporting the growth of the team, by keeping abreast of market and industry trends, and sharing knowledge and experience with the rest of the team.
Qualifications, Training & Certificates
Minimum Requirement:
• Experience of Informatica or comparable ETL software
• Experience of one or more programming languages (SQL, PL\SQL, Python, Scala)
• Experience of developing data solutions on Oracle, Cloudera or Horton Works platforms.
• Experience of Erwin or comparable data modelling software
• Experience of developing data solutions using cloud native services for collection, storage, processing, analysis, visualisation and security of data
• Experience of working for a government dept
• AWS / Hybrid Cloud technologies would be advantageous