skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Senior Data Engineer

7.00 to 11.00 Years   Chennai   24 Apr, 2024
MARICI Solutions GmbH
Job LocationChennai
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT Services & Consulting
Functional AreaNot Mentioned
EmploymentTypeFull-time

Job Description

    Job DescriptionThis is a remote position.We are seeking a highly skilled Senior Spark Engineer with expertise in Python, Spark, Databricks, and AWS to join our dynamic team. The ideal candidate will possess a deep understanding of Spark architecture and be proficient in fine-tuning Spark jobs for optimal performance. Additionally, strong knowledge of software engineering best practices, DevOps principles including CI/CD pipelines, Kubernetes, and either Jenkins, Airflow, or SageMaker, is essential for this role. Experience in MLOps is desirable but not mandatory.Requirements Proficiency in Spark, Python, Databricks, and AWS services. 7-10 years of experience Lead the design, development, and implementation of Spark-based solutions for complex data processing tasks. Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. Implement best practices in software engineering, DevOps, and MLOps methodologies. Design. and maintain data pipelines for efficient data processing and analysis. Perform data modeling and schema design to support business requirements. Mentor junior team members and provide technical guidance as needed. Stay updated with the latest advancements in Spark, Python, and related technologies, and advocate for their adoption when appropriate. Bachelors degree in Computer Science, Engineering, or a related field. Masters degree preferred. Strong understanding of software engineering principles and best practices. Hands-on experience with DevOps tools and practices including CI/CD pipelines, Kubernetes, and either Jenkins, Airflow, or SageMaker. Experience with MLOps practices is a plus. Solid understanding of data engineering concepts and data modeling techniques. Excellent problem-solving skills and attention to detail. Ability to work independently and lead tasks effectively. Strong communication and interpersonal skills.RequirementsProficiency in Spark, Python, Databricks, and AWS services. 7-10 years of experience Lead the design, development, and implementation of Spark-based solutions for complex data processing tasks. Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. Implement best practices in software engineering, DevOps, and MLOps methodologies. Design and maintain data pipelines for efficient data processing and analysis. Perform data modeling and schema design to support business requirements. Mentor junior team members and provide technical guidance as needed. Stay updated with the latest advancements in Spark, Python, and related technologies, and advocate for their adoption when appropriate. Bachelors degree in Computer Science, Engineering, or a related field. Masters degree preferred. Strong understanding of software engineering principles and best practices. Hands-on experience with DevOps tools and practices including CI/CD pipelines, Kubernetes, and either Jenkins, Airflow, or SageMaker. Experience with MLOps practices is a plus. Solid understanding of data engineering concepts and data modeling techniques. Excellent problem-solving skills and attention to detail. Ability to work independently and lead tasks effectively. Strong communication and interpersonal skills,

Keyskills :
SparkPythonAWSKubernetesJenkinsAirflowDatabricksCICD pipelinesSageMaker

APPLY NOW

Senior Data Engineer Related Jobs

© 2020 Skillindia All Rights Reserved