Data Quality Engineer

Job Description

Data driven automation and decision making has never been more important to BT. We re creating the best personal experiences for our customers to help them stay connected, and that mission is all underpinned by high quality, low latency data. This role will play a critical part in the creation and be part of BT Digital build data pipelines, data systems and the data products built on top.As part of a team of highly skilled data engineers, you will create and maintain our logical data models, integrating data from multiple data sources into a central cloud repository. You will apply data cleansing and data standardisation rules, providing clear documentation of the business rules embedded in the system, with the potential of solving data quality issues through your team. You will work closely with the wider team to understand what the data journey needs to look like and work closely with the Data Architect team, Data scientists and AI team to develop our products and services. You will write and maintain data engineering user documentation to provide transparency and maintain the knowledge base within the team.Youll have the following responsibilities
• Applies specialist data expertise to develop and advise approach on a range of complex, high impact and data solutions a services
• Assures data availability and quality in Digital and across all CFUs for BT
• Helps to resolve technical problems
• Proactively identifies new potential data sources and assess feasibility of ingesting
• Develops tangible and ongoing standardisation, simplification and efficiency of engineering processes, reviewing and revising continuous improvement opportunities
• Assures a high quality and comprehensive data flow and manage a team that provides a consumption layer where the business has access to all the data it needs
• Ensures all data is compliant
• Ensures that all data acquired is fully described/understood and communicated using appropriate tools
• Productionise any tactical data feeds, including documentation
Youll have the following skills & experience
• Implements the strategy for Data Quality, and data quality aligned to the overall Base Management and Data strategy
• Applies specialist data expertise to develop and advise approach on a range of complex, high impact and data solutions a service
• Coordinates the data solutions and data quality plan within the team
• Drives data availability and quality standards, tools, and frameworks in
• Consumer and across our systems
• Coaches and works together with members of the Data Engineering team
• Resolves critical technical problems at the team or department level
• Drives tangible and ongoing standardisation, simplification, and efficiency of engineering processes, reviewing, and revising continuous improvement opportunities.
• Ensures a high quality and monitory data flow jobs and manage a team that provides a consumption layer where the business has access to all the data it needs
• Sound awareness of Data Management best practice, including data lifecycle management
• Extensive skills in SQL, quality tools both at production grade and at analytical level, gained through intensive application in a commercial business environment
• Can deliver complex big data solutions with structured and unstructured data
• Excellent oral and written communication skills for all levels of an organisation
• Collaborate to identify how work activities across the teams are related and highlight inefficiencies. You help to remove barriers and find the resources or support needed to improve processes
• Some knowledge of Cloud Computing patterns, workflows and services; and how they relate to a big data platform.
• Advanced math skills (linear algebra, Baysesian statistics, group theory)
• Background in machine learning & software engineering frameworks such as TensorFlow or Keras
• Desirable skills & experience
• Experience in the big data domain and cloud technologies (AWS, GCP)
• Experience with cloud technologies (AWS, GCP)
• Experience in a story-driven, agile environment.
• Migration expertise from on premise technologies to cloud based warehouse technologies. (i.e. GCP-BigQuery etc)
• Experienced in deploying data solutions and cloud infrastructure via CI/CD pipelines
• Experienced in understanding Infrastructure as Code (Terraform / Cloudformation etc)
• Knowledge of Docker/Kubernetes, and how these can be used to simplify deployments.
• Experience of building large scale data pipelines on at least one Cloud Platform (GCP and AWS preferred)
Benefits
• Along with the great development and networking building opportunities you will also enjoy
• A target bonus of up to 10%
• Pension contributions
• Share save scheme
• Access to exclusive staff products and savings
About BTBT has a key role in British society, fostering change and leading technology innovation. From delivering the Olympics, to supporting the emergency services, to investing more into research than any other UK technology company, we take pride in everything we do - and in the people who work here.Were now a global company operating at the forefront of the information age, employing 90,000 people in 180 countries. And were on a mission. Guided by our core values of Personal, Simple and Brilliant our goal is to help customers, communities and businesses overcome barriers and release their potential.So, if youre interested in the power of potential, why not join us today and release yours You can read more here about what its like to work at BTHow to ApplyIts easy to apply online; you just need a copy of your up-to-date CV and to follow the step-by step process. Dont worry if you need to make changes - youll have the opportunity to review and edit your work on the final page. We look forward to receiving your application, *.

Keyskills :
qualitybig datainspectioncalibrationdata flowquality controliso