skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Senior Data Engineer (Python, Apache Spark, Apache Airflow)

1.00 to 6.00 Years   Bangalore, Chennai, Noida, Hyderabad, Kolkata, Gurugram, Pune, Mumbai City, Delhi   07 Sep, 2021
Krezig Consultants LLP
Job LocationBangalore, Chennai, Noida, Hyderabad, Kolkata, Gurugram, Pune, Mumbai City, Delhi
EducationNot Mentioned
SalaryRs 5 - 10 Lakh/Yr
IndustryIT - Software
Functional AreaGeneral / Other Software,Embedded / System Software
EmploymentTypeFull-time

Job Description

We are Hiring ForSenior Data Engineer(Python, Apache Spark, Apache Airflow)Designation-Senior Data EngineerLocation- Mumbai( work from home)Salary- Upto 10LPACall Or Whatsapp Shubh - 8287237483Requirements:

    • Experience in visualizing data from various tasks in the data pipeline using Apache Zeppelin/Plotly or any other visualization library.
    • Experience in implementing pluggable framework for large scale batch data pipeline (e.g. ETL)
    • Process Logging, Error detection, log monitoring, and batch error recovery
    • Expert level experience in Data Pipeline Orchestration using Apache Airflow for large scale production deployment
    • Implementation of custom Airflow Operators, Hooks and Sensors
    • Airflow log management and log monitoring using ELK/Grafana
    • Scalable Elastic deployment architecture and solution for Apache Airflow on the Kubernetes cluster
    • Containerization of DAGs
  • Git Hub Integration
If interested thenCall Or Whatsapp Shubh - 8287237483

Keyskills :
javaapache sparkkubernetespythonsqlgrafanapysparkhdfs/apache arrow/parquetapache airflowplotlyelkapache athenaaws emrec2spark sql

APPLY NOW

Senior Data Engineer (Python, Apache Spark, Apache Airflow) Related Jobs

© 2020 Skillindia All Rights Reserved