skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Data Engineer - ETL/ Python/ Big Data

8.00 to 13.00 Years   Chennai   15 Aug, 2023
BOYEN HADDIN CONSULTING AND TECHNOLOGY PRIVATE LIMITED
Job LocationChennai
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT Services & Consulting
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

    The Data Engineer is responsible for execution and management of data delivery, data transformation, and data processing in alignment with the global IT architecture. The Data Engineer works with Subject matter experts, data architects, and data analysts to develop an efficient, scalable, automated and robust data pipleline from source to front end application. Responsibilities - Work with subject matter experts to perform data profiling activities to understand source data - Develop technical requirements and source to target data mapping for processing data from source to target - Develop data pipeline to populate Analytical data stores in alignement with the data architects design - Deliver data in an optimized form for the development of visualization/reports/dashboards to present business insights Requirements : - Bachelor or MS degree in Computer Science, Engineering, Information Systems, Information Technology or equivalent experience - Minimum 4 years of experience with SQL - Strong experience in working with both OLTP/OLAP models for both data extraction and ingestion - Solid ETL skills for high performance data loading ( AWS Glue/ AWS EMR/ Apache Spark preferred) - Experience with Python programming (Experience in test driven development preferred) - Experience in AWS Lambda - Experience with workflow automation (python / Apache Airfolow preferred) - Experience with data profiling and data quality assessment using AWS tool set - Strong experience with database design and data architecture (ie. Snowflake, AWS Redshift, AWS Dynamo, Oracle SQL) - Strong experience with Git source code control and demonstration of different branching strategies - Strong experience in data curation/aggregation/preparation for use in a Vizualization tool (ie. Tableau, PowerBI, Quicksight) - Experience and understanding of big data compute frameworks (ie. Apache Spark preferred) Preferred Skills : - Experience with high volume processing, performance tuning, and optimization - Strong understanding of database engineering best practices and software design - Excellent written/documentation and verbal communication skills - Ability to exercise sound judgment and to work effectively given general guidance and direction - The ability to thrive in a collaborative team environment; the right candidate is someone who is willing to take on projects and challenges with the ability to be flexible with change Skills Experience / Proficiency : Business Intelligence - 2 Years Data Warehousing - Healthcare 3 years ETL - 3 years Role: Database Architect / Designer Industry Type: IT Services & Consulting Department: Engineering - Software & QA Employment Type: Full Time, Permanent Role Category: DBA / Data warehousing

Keyskills :
data integrationdata engineering

APPLY NOW

Data Engineer - ETL/ Python/ Big Data Related Jobs

© 2020 Skillindia All Rights Reserved