skillindiajobs
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Senior Data Engineer

4.00 to 8.00 Years   Mumbai City   10 Jul, 2023
Job LocationMumbai City
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT - Software
Functional AreaApplication Programming / Maintenance
EmploymentTypeFull-time

Job Description

    Job Title: Senior Data EngineerWe are seeking a highly experienced Senior Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining a multi-tenant data stack that efficiently ingests, stores, and retrieves data for our clients. The successful candidate should have extensive experience in data modeling, ETL processes, data warehousing, and building data pipelines. In this role, you will lead a team of data engineers and work closely with data scientists and software engineers to ensure that data is collected, processed, and analyzed efficiently and accurately.Responsibilities:
    • Lead the design, development, and optimization of a multi-tenant data stack using managed stacks and services like AWS
    • Design and implement scalable data models, ETL processes, and data pipelines using AWS services like Glue, Kinesis, and Lambda
    • Develop and maintain data warehousing solutions using AWS services like Redshift, Snowflake, or BigQuery
    • Implement efficient data ingestion techniques using technologies like Apache Kafka or AWS Kinesis
    • Implement efficient data storage and retrieval techniques using technologies like S3, Parquet, and Protobuf
    • Develop and maintain automated testing frameworks to ensure data quality and accuracy
    • Develop and maintain data visualization dashboards and reports using AWS services like QuickSight or Tableau Server
    • Monitor system performance and troubleshoot issues using AWS services like CloudWatch or X-Ray
    • Continuously improve processes and systems to increase efficiency and scalability
    • Lead and mentor a team of data engineers
    Requirements:
    • Bachelors degree in Computer Science, Mathematics, or a related field
    • At least 7 years of experience in data engineering or a related field
    • Proven experience leading a team of data engineers
    • Extensive experience with data modeling, ETL processes, and data pipelines using AWS managed services like Glue, Kinesis, and Lambda
    • Extensive experience with data warehousing solutions using AWS managed services like Redshift, Snowflake, or BigQuery
    • Strong programming skills in Python, SQL, and ETL tools such as Apache Spark, Apache NiFi, and Airflow
    • Experience with data visualization tools such as AWS QuickSight or Tableau Server
    • Knowledge of database systems such as PostgreSQL, MySQL, and Oracle
    • Familiarity with distributed computing systems such as Hadoop and Spark
    • Strong problem-solving and analytical skills
    • Ability to work independently and in a team environment
    • Excellent written and verbal communication skills
    • Strong attention to detail and ability to multi-task
    If you are a highly experienced Senior Data Engineer with a proven track record of designing, developing, and maintaining a multi-tenant data stack with efficient ingestion, storage, and retrieval using AWS managed stacks and services, and leading a team of data engineers, we encourage you to apply for this exciting opportunity.

Keyskills :
apache sparkpythonmysqletlawshadooppostgresqlspark

Senior Data Engineer Related Jobs

© 2020 Skillindia All Rights Reserved