apply now Sr. Big Data Engineer

Job Description

Job Opening Details back to list Reference Code: BJ02918 Job Title: Sr. Big Data Engineer - Pranay/Akshit -- Merlin (Ankita) Category: As Senior Data Engineer for Automotive Business (m/f/d) you will actively shape the design and development of advanced analytics systems based on Big Data technologies. You will directly support our customers in the design of use cases and their technical implementation. Technologically, you work in the Apache Opensource toolstack with its large amount of tools and extensions. The main focus of your work will be in the areas of data engineering. In the related fields of Data Analytics and Data Science, you have a secure basic knowledge to work effectively with your colleagues specialized in this field. Activities include both the design of SW architectures and their implementation and transfer into operation. This includes, but is not limited to, the following activities: Development of customer use cases Implementation of customer projects with OpenSource SW components and commercial analysis software Implementation of data pipelines, monitoring and performance optimization in the context of product development or customer projects Design, technical architecture and implementation of Big Data solutions: End-to-end from brainstorming and proof of concept to production and continuous improvement. Analyze and extract business-critical insights from a variety of data sources, whether structured or unstructured Support of the sales during customer meetings and processing of customer-specific requirements Your profile You are an experienced Software Engineer with Focus on Automotive Business who can guide and inspire others. With drive and initiative, you tackle new challenges in the team, drive existing projects forward based on your own experience and develop an overall vision. You convince others with your personal appearance and have fun and experience in customer-oriented work. You have a Bachelors or Masters degree in Computer Science, Mathematics, Business Information Systems, or similar and more than 8+ years of professional experience. You have experience and competence to design and develop data driven systems based on the technology stack. You evaluate and configure SW components, design and develop algorithms for customer solutions. You have extensive experience with various Apache Hadoop distributions (e.g. Cloudera, MapR) as well as the corresponding cloud hyperscaler variants (Azure, AWS, GCP). Your knowledge includes: Automotive data engineering Deep knowledge of overall automotive communication bus systems and data loggers advanced knowledge in Autosar and Flexray descriptions of ECUs communication protocols Handling of unstructured data Handling of deeply nested, non-columnar binary data structures Advanced knowledge of related software frameworks i.E. Google Protobuf Test and Verification Strategies Data Ingest Pipelines Software Architecture for data ingest pipelines Very Advanced coding skills in Scala + Java, Spark Framework using RDDs Memory and Runtime optimization for massive parallel processing algorithms Other Knowledge of privacy and security challenges and solutions in loT and data analytics. Visionary thinking in translating business requirements into technological concepts and thinking ahead of new technologies Willingness to travel and enjoy working with customers directly on site Experience in visualization, communication and presentation of data and analytical results Very well written and verbal communication skills in the English language Key Skills: As Senior Data Engineer for Automotive Business (m/f/d) you will actively shape the design and development of advanced analytics systems based on Big Data technologies. You will directly support our customers in the design of use cases and their technical implementation. Technologically, you work in the Apache Opensource toolstack with its large amount of tools and extensions. The main focus of your work will be in the areas of data engineering. In the related fields of Data Analytics and Data Science, you have a secure basic knowledge to work effectively with your colleagues specialized in this field. Activities include both the design of SW architectures and their implementation and transfer into operation. This includes, but is not limited to, the following activities: Development of customer use cases Implementation of customer projects with OpenSource SW components and commercial analysis software Implementation of data pipelines, monitoring and performance optimization in the context of product development or customer projects Design, technical architecture and implementation of Big Data solutions: End-to-end from brainstorming and proof of concept to production and continuous improvement. Analyze and extract business-critical insights from a variety of data sources, whether structured or unstructured Support of the sales during customer meetings and processing of customer-specific requirements Your profile You are an experienced Software Engineer with Focus on Automotive Business who can guide and inspire others. With drive and initiative, you tackle new challenges in the team, drive existing projects forward based on your own experience and develop an overall vision. You convince others with your personal appearance and have fun and experience in customer-oriented work. You have a Bachelors or Masters degree in Computer Science, Mathematics, Business Information Systems, or similar and more than 8+ years of professional experience. You have experience and competence to design and develop data driven systems based on the technology stack. You evaluate and configure SW components, design and develop algorithms for customer solutions. You have extensive experience with various Apache Hadoop distributions (e.g. Cloudera, MapR) as well as the corresponding cloud hyperscaler variants (Azure, AWS, GCP). Your knowledge includes: Automotive data engineering Deep knowledge of overall automotive communication bus systems and data loggers advanced knowledge in Autosar and Flexray descriptions of ECUs communication protocols Handling of unstructured data Handling of deeply nested, non-columnar binary data structures Advanced knowledge of related software frameworks i.E. Google Protobuf Test and Verification Strategies Data Ingest Pipelines Software Architecture for data ingest pipelines Very Advanced coding skills in Scala + Java, Spark Framework using RDDs Memory and Runtime optimization for massive parallel processing algorithms Other Knowledge of privacy and security challenges and solutions in loT and data analytics. Visionary thinking in translating business requirements into technological concepts and thinking ahead of new technologies Willingness to travel and enjoy working with customers directly on site Experience in visualization, communication and presentation of data and analytical results Very well written and verbal communication skills in the English language Location: Chennai Required Experience: 8-10 yrs Positions: 1 Contact Person: Balaji Email ID: hidden_email Qualification:,

Keyskills :
big datahadoopapache webserverproof of conceptjava