skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Lead Developer (Data Integration)

2.00 to 5.00 Years   Bangalore   28 Mar, 2023
Schneider Electric
Job LocationBangalore
EducationNot Mentioned
SalaryNot Disclosed
IndustryManufacturing
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

    *Position: Lead Developer (Data Integration) Job Description Required Skill Set:Must Have -
    1. Expertise and hands-on experience on Python/Node JS/Java
    2. Expertise knowledge ETL and Tools - SparkQL/Spark (PySpark) Dataframe / AWS Glue/ Snowflake
    3. Good knowledge of SQL, NoSQL (DynamoDB, Cassandra etc.)
    4. AWS Compute and Database (AWS Lambda, API Gateways SQS, Step Functions, RDS, S3)
    5. Able to write basic queries
    Good to Have
    1. Versioning tool GIT
    2. Good knowledge of Agile Development
    3. Experience in developing data pipelines to transform, aggregate and or process data
    4. Experience in Data Lake, Databricks, Data Mart
    5. Understanding of Analytics and Machine Learning
    6. Experience in CI / CD principles (Jenkins/GitHub actions/any other equivalent)
    7. Experience in preparing design documents
    8. Awareness of design principles, design patterns, performance parameters like memory / CPU utilization, profiling, connection pooling, multi-threading
    Responsibilities:
    1. Work closely with Architects, Project Manager, Business Analyst
    2. Working on Coding, Unit Testing, Test case development, Integration testing, Performance testing, Troubleshooting & Bug fixing
    3. Document use cases, flow chart, sequence diagrams, class diagrams
    4. Work with distributed Team following Agile methodologies
    5. Develop, build data engineering pipelines using Scala/PySpark in AWS using services like EKS, Lambda, S3, Glue, Step Functions
    6. Build ingestion as a service using the AWS Native and PySpark to facilitate the data gravity shift from on-premises to the cloud through migration of data assets and workloads to the cloud
    7. Build components in the data engineering following Test Data Driven development practices
    8. SQL skills for data profiling and analysis, and ability to reverse engineer existing databases with minimal assistance
    9. Support data requests/projects and helps to interpret data sets
    1. Perform ad-hoc data/process analysis as needed
    ,

Keyskills :
javascriptmysqljavasql serverapitest datause casesunit testingdata profilingdesign patternsdata engineeringsequence diagramsperformance testing

APPLY NOW

Lead Developer (Data Integration) Related Jobs

© 2020 Skillindia All Rights Reserved