skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Data Engineer

4.00 to 5.00 Years   Mumbai City   24 Sep, 2021
ONQANET TECHNOLOGIES PVT LTD
Job LocationMumbai City
EducationNot Mentioned
SalaryNot Disclosed
IndustryMedia / Dotcom / Entertainment
Functional AreaDBA / Datawarehousing
EmploymentTypeFull-time

Job Description

ABOUT THIS JOBThink about the billions of purchases that consumers make every single day around the world. Imagine trying to make sense of the trillions of data points that represent these purchases. From a family doing online shopping for household essentials to a quick run to the supermarket, NielsenIQ is measuring the entire consumer path to purchase. NielsenIQ is a multinational company working with the world s largest brands across the world to inform them on where and how their best customers are shopping. The challenge is that this is a moving target and a complex problem. The commerce landscape is shifting today from brick and mortar to online shopping - and only NielsenIQ has the span of data to make sense of what drives a consumer to make their purchases.We are looking for experienced and passionate people to join our team.KEY RESPONSIBILITIES

  • Extracting data from various data sources
  • Building data and the data pipeline architecture, as well as optimizing data flow across the platform
  • Data sources include: Social media (Text, image, network), Web scraping, Web analytics and search data, Mobile usage data, Sales and enterprise data, Spatial/Location, Survey data
  • Data type structured, unstructured, multilingual, network
  • Storage and retrieval of data from data warehouses/ data lake and different kind of databases
  • Transformation and integration of data to make it consumable for processing and analysis
  • Management of metadata
  • Ensuring quality and validation for the entire data flow
  • Setup, installation and management of various software/ platforms used in the data architecture
  • Enable automation of the various components of data flow
  • Managing vendors on various components for enabling the data flow
  • Document and present findings and recommendations on methodology in a structured way to various stakeholder or partnering teams.
  • Work closely with the other teams to convert those POC into fully scalable products.
  • Active and effective collaboration with other project team members (Commercial, delivery and product)
  • Work in a multi-disciplinary environment with specialists in machine learning, engineering and design
A LITTLE BIT ABOUT YOUSo where do you fit here In NielsenIQ, we process over 250 terabytes of data every single day, manage it in the latest cloud technology, and build best-in-class analytical tools to add transparency and efficiency to the consumer goods market at a scale that no other company is able to achieve. We re looking for passionate, analytical, innovative Data Engineers who want to figure out how to measure things in a complex world. If you have a passion for building top-notch, scalable products we re looking for you to join us.QUALIFICATIONS
  • 4-5 yrs experience as data engineer
  • Managed data from various types of data sources: 1. Social media (Text, image, network), 2.Web scraping,
  • Good understanding of SQL
  • Exposure to working with multiple database/ storage types SQL, No-SQL, File based, Graphdb
  • Exposure to working with Data Warehousing/Big Data stack: Snowflake, Hadoop and MapReduce, Hive and PIG, Apache Spark, Kafka, Elastic search
  • Understanding of data pipeline and workflow management tools: Azkaban, Luigi, Airflow
  • Exposure to data preparation, management for analytics especially for ML/ AI related work
  • Exposure to working with cloud services: Azure, AWS - EC2, EMR, RDS, Redshift
  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
WE OFFER:
  • Being part of a new growing team with the ability to design best practises, ways of working etc.
  • Possibility of working with professionals in the multicultural environment.
Practical experience in the application of advanced analytics.,

Keyskills :
sqljavadata warehousinginformaticapythondata flowapache sparkweb scrapingweb analyticsconsumer goodsenterprise datamachine learningdata preparationworkflow managementawsemrpig

APPLY NOW

Data Engineer Related Jobs

© 2020 Skillindia All Rights Reserved