skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Data Engineer

5.00 to 7.00 Years   Bangalore   07 Apr, 2021
Schneider Electric
Job LocationBangalore
EducationNot Mentioned
SalaryNot Disclosed
IndustryManufacturing
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

We are looking for a savvy Data Engineer to join our growing team of AI and machine learning experts. You will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software engineers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. Responsibilities

  • Create and maintain optimal data pipeline architecture; assemble large, complex data sets that meet functional / non-functional requirements
  • Design and build production data pipelines from ingestion to consumption within a big data architecture for data transfer and processing
  • Build the necessary datamarts, data warehouse required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
  • Create necessary preprocessing and postprocessing for structured, semi-structured and unstructured data for training/ retraining and inference ingestions as required; feature extraction, standardization and normalization
  • Storing, cataloging, documenting and making reusable feature available for ML consumption (training, testing and prediction)
  • Support both batch and real-time paradigms as required for all data pipelines
  • Create data visualization and business intelligence tools for stakeholders and data scientists for necessary business/ solution insights
  • Collaborate with data scientists to ensure success of all machine learning and AI projects
  • Identify, design, and implement internal process improvements: automating manual data processes, optimizing data delivery, etc.
  • Ensure our data is separated and secure across national boundaries through multiple data centers and AWS regions
Requirements and Skills
  • You should have a bachelors or master s degree in computer science, Information Technology or other quantitative fields
  • You should have at least 5 years working as a data engineer in supporting large data transformation initiatives related to machine learning, with experience in building and optimizing big data pipelines and data sets
  • Strong analytic skills related to working with unstructured datasets.
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift and familiarity with various log formats from AWS.
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Python, Java, C++, etc.
,

Keyskills :
sqljavadata warehousinginformaticapythonputting the customer firstbusiness intelligence toolsbig datadata flowcomputer sciencemachine learning

APPLY NOW

Data Engineer Related Jobs

© 2020 Skillindia All Rights Reserved