skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

pyspark developer

6.00 to 11.00 Years   Noida   26 Mar, 2024
CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
Job LocationNoida
EducationNot Mentioned
SalaryRs 10 - 22 Lakh/Yr
IndustryIT Services & Consulting
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

    Job Title: Big Data Engineer (PySpark Developer)We are seeking a highly skilled Big Data Engineer with expertise in PySpark to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure, as well as optimizing data processing pipelines. The ideal candidate will have a strong background in Python, PySpark, and big data technologies, along with experience in building scalable and efficient data pipelines.Responsibilities:
    1. Designing, implementing, and maintaining big data pipelines using PySpark.
    2. Developing and optimizing ETL processes to ingest, process, and transform large volumes of data.
    3. Collaborating with data scientists and analysts to understand their requirements and translate them into technical solutions.
    4. Performance tuning of Spark jobs to improve efficiency and reduce processing time.
    5. Troubleshooting and debugging issues in data pipelines and Spark applications.
    6. Working with cross-functional teams to integrate new data sources and ensure data quality and integrity.
    7. Implementing monitoring and alerting solutions to ensure the reliability and availability of data pipelines.
    8. Staying up-to-date with the latest advancements in big data technologies and recommending improvements to existing systems.

Keyskills :
datapythonpyspark

APPLY NOW

pyspark developer Related Jobs

© 2020 Skillindia All Rights Reserved