Senior Data Engineer - Corportate Quality

Job Description

Job Description SummaryThe Data Engineer is an expert in using cloud computing, storage, big data tools and technologies to connect to varaitiy of sources, convert raw data into data models and as well as creating, evaluating and implementing data application and engineering solutions. This includes ETL, data transformation and preparation, data structuring, data architecture and and software development related to data solutions and products.The Data Engineer designs, develops and achieves discipline strategy in alignment with functional and non functional requirements and key business objectives. Data scientists will work with the Data Scientist to design data sets, data models and key metrics their Quality System Element requirements.Primary Responsibilities:In accordance with all applicable Job DescriptionPrimary Responsibilities:In accordance with all applicable local laws/regulations and Corporate BD, procedures and guidelines, this position is responsible for:

• Understand business problems and design end-to-end data engineering solutions
• Collaborate across the Data and Analytics function to understand data, IT and business constraints
• Design scalable, flexible and pattern based approach to build data engineering solutions
• Collaborate with developers to implement and deploy scalable visualization solutions
• Establish best practices and maintain all compliance requirements
• Establish the monitoring of data models in production
• Lead agile approach to initiatives and launches
• Apply strong expertise in data engineering to design, prototype, and build the next-generation analytics engines and data services
• Actively network on a regular basis with domain experts to better understand the business mechanics that generated the data
• Train and coach other business and IT staff on basic data engineering principles and techniques
• Actively network on a regular basis with internal and external partners
• Promote collaboration and knowledge exchange with other data science teams within and outside the organization
• Provide thought leadership by researching best practices, conducting experiments, and collaborating with industry leaders
• Work closely with functions across BDX to implement models and monitor outcomes
• Develop processes and tools to monitor and analyze model performance and data accuracy

Supervision and Budgetary Responsibility:

• N/A

Education and Experience:

• Requires a minimum of a BS/MS degree in applied Computer Science, Data engineering or other relevant discipline. Graduate degree preferred.
• Five-plus (5) years of relevant work experience in data science (Job Group 2)
• Ten Plus (10) years of relevant work experience in big data and cloud computing (Job Group -3)
• Experience in a pharmaceutical, medical device or other regulated field prefered
• Advanced data modeling techniques and concepts and experience with building data applications, data services, data warehousing, data modeling and data processing pipelines.
• Knowledge of programing languages to leverage parallel computing and manipulate data from large data sets
• Ability to quickly develop extensive domain knowledge in various topics
• Experience with a variety of data architecture patterns, integration patterns and their real-world advantages/drawbacks.
• English working proficiency and communication skills (verbal and written)
• Experience presenting data architecture and analysis to upper management.
• Technical Skills:
  • Programing proficiency in Java, .Net, Scala, Kafka, NiFi, Spark, Python, HQL, DataBricks, SPARQL.
  • Knowledge of Hadoop, big data architecture, experience of building solutions on Azure, AWS, GCP, Multi-threaded data processing on CPU and GPU architectures.
  • Experience of Programming Languages such as .Net and/or Java (Scripting), Shell scripting, API and Webservices.
  • Experience of working with Neo4J, RDF, Triplestore and Graph databases.
• Travel may be required on a limited basis - less than 20%.

Primary Work LocationIND Bangalore - Technology Campus Additional LocationsWork Shift,

Keyskills :
content managementemailsqlanalyticsapachebig datakey metricsdata modelsdata sciencedata modelingdata servicesdata solutionsquality systemcloud computing