Apply for this job now

Data Engineer

Location
Surrey
Salary
£55,000 to £65,000
Job Type
Permanent
Posted
8 Sep 2022
Role: Data Engineer Salary: £55-65k Work Style: Hybrid Sponsorship: Not provided Specialising in the insurance sector, my client uses advanced technology and data insight services to better monetise data in insurance businesses. Due to succesful year on year growth, they are now looking for a Data Engineer to join their growing tech team. This will be a hybrid role where you will be required to be onsite at least 8 days a month (2 days a week). Please see an overview of the responsibilities and requirements below. Duties and Responsibilities include: Building data pipelines from the ground up, from various data sources (S3, RDS, external sources) to get data into our datalake and cleaned, formatted and performantly available in our data warehouse. Manage large scale batch and streaming data pipelines in AWS cloud environments Create vital tools and infrastructure to monitor and understand the data flow outputs and performance. Maintaining the data models in the data warehouse to support Data Science, Analysis and wider product requirements. Proactively deploy improvements to system architecture and / or object library to improve efficiency / security / of owned systems. Assist in ad-hoc data queries and data-related architecture across wider products. Work closely with data scientists, ML engineers and analytics team to speed up delivery of cloud data services. As a Data Engineer within this team you'll be working mainly with the following: Python, PostgreSQL, AWS tools (Redshift, Glue, Athena ), PySpark. Develop new systems and tools to enable the teams to consume and understand data more intuitively Requirements for this position: Technical Degree in Stem Subject or equivalent on the job experience Experience building modern Datalakes and Data Warehouse Experience in working with large data sets with real-time streaming applications Experience in relational database (PostgreSQL, Redshift) Experience in AWS Cloud Services (S3, Glue, Athena, Redshift ) Some experience writing Infrastructure-As-Code (e.g. Terraform) Strong experience in SQL and Python Experience in ETL and related practices Good Experience in Apache Spark (Pyspark, spark streaming is a plus) Experience with modern software engineering practices (CI/CD, Testing, Version Control ) Personal Skills Strong communication and organisation skills with the ability to operate in a team with mixed disciplines Able to communicate clearly at all levels of the business Initiative to drive projects to fruition and demonstrate ability to innovate within the project framework Analytical and inquisitive, with excellent attention to detail Keen interest in emerging technologies and practices What if you're a partial fit? We prioritise grit, positivity, and drive for growth, and encourage you to apply even if your experience doesn't exactly match this job description If this company sounds like a great fit for you, please APPLY and get in touch immediately with Milan on (phone number removed) or email milan . . co . uk to discuss interview availability. Established in Didsbury, ITECCO has grown to become one of the UK's most successful and fastest growing IT recruitment companies in the UK
Apply for this job now

Details

  • Job Reference: 707261472-2
  • Date Posted: 8 September 2022
  • Recruiter: ITECCO Limited
    ITECCO Limited
  • Location: Surrey
  • Salary: £55,000 to £65,000
  • Bonus/Benefits: Hybrid, Bonus, Pension
  • Sector: I.T. & Communications
  • Job Type: Permanent