Backup Requisition - Data Engineer (ID 006RC1)

Job Description

*DATA ENGINEER Description:We are looking for a enthusiastic data engineer to support the big data engineering team building and improving Intel DS by connecting new sources to enrich the data scope of the platform, Design and develop new features based on consumer application requests to ingest data in the different layers of Intel DS. Automate the integration and delivery of data objects and data pipelines. Responsibilities:
• Prepare data and make it available in an efficient and optimized format for consumer analytics, BI, or data science applications.
• It requires to work with current technologies used by IntelDS and in particular Spark, Presto, Hive and RedShift on AWS environment.
• Design and develop new data ingestion patterns into IntelDS raw and/or unified data layers based on the requirements and needs for connecting new data sources or for building new data objects. Working in ingestion patterns allow to automate the data pipelines.
• Participate to and apply DevSecOps practices by automating the integration and delivery of data pipelines in a cloud environment. This can include the design and implementation of end-to-end data integration tests and/or CI/CD pipelines.
• Analyse existing data models, identify, and implement performance optimizations for data ingestion and data consumption. The objective is to accelerate data availability within the platform and to consumer applications. Target technologies are Apache Spark, Apache Presto and RedShift.
• Support client applications in connecting and consuming data from the platform, and ensure they follow our guidelines and best practices.
• Participate in the monitoring of the platform and debugging of detected issues and bugs.
Skills/ Experience:
• At least 5 years experience in software development with minimum of 3 years as data engineer/architect with proven experience on Big Data and Data Lakes on AWS.
• Advanced user for these key technologies:
  • Programming language: Python
  • Big Data: Spark, Hive, Presto
  • AWS: S3, EMR, RedShift, Automation (Cloud Formation)
• Exposure to Extract, Transform & Load (ETL) tools like Informatica etc.
Benefits
• We seek out and reward people for putting the customer first, being disruptive to the status quo, embracing different perspectives, continuously learning, and acting like owners. We want our employees to reflect the diversity of the communities in which we operate. We welcome people as they are, creating an inclusive culture where all forms of diversity are a real value for the company. We re looking for people with a passion for success on the job and beyond.
• Competitive salary according to the experience.
• Training plan and access to our training platform where you can develop your professional and personal skills.
• SEvoluciona policies work-life balance, flexitime.
• Flexible compensation plan restaurant tickets, health and life insurance, etc.
, *DATA ENGINEER Description:We are looking for a enthusiastic data engineer to support the big data engineering team building and improving Intel DS by connecting new sources to enrich the data scope of the platform, Design and develop new features based on consumer application requests to ingest data in the different layers of Intel DS. Automate the integration and delivery of data objects and data pipelines. Responsibilities:
• Prepare data and make it available in an efficient and optimized format for consumer analytics, BI, or data science applications.
• It requires to work with current technologies used by IntelDS and in particular Spark, Presto, Hive and RedShift on AWS environment.
• Design and develop new data ingestion patterns into IntelDS raw and/or unified data layers based on the requirements and needs for connecting new data sources or for building new data objects. Working in ingestion patterns allow to automate the data pipelines.
• Participate to and apply DevSecOps practices by automating the integration and delivery of data pipelines in a cloud environment. This can include the design and implementation of end-to-end data integration tests and/or CI/CD pipelines.
• Analyse existing data models, identify, and implement performance optimizations for data ingestion and data consumption. The objective is to accelerate data availability within the platform and to consumer applications. Target technologies are Apache Spark, Apache Presto and RedShift.
• Support client applications in connecting and consuming data from the platform, and ensure they follow our guidelines and best practices.
• Participate in the monitoring of the platform and debugging of detected issues and bugs.
Skills/ Experience:
• At least 5 years experience in software development with minimum of 3 years as data engineer/architect with proven experience on Big Data and Data Lakes on AWS.
• Advanced user for these key technologies:
  • Programming language: Python
  • Big Data: Spark, Hive, Presto
  • AWS: S3, EMR, RedShift, Automation (Cloud Formation)
• Exposure to Extract, Transform & Load (ETL) tools like Informatica etc.
Benefits
• We seek out and reward people for putting the customer first, being disruptive to the status quo, embracing different perspectives, continuously learning, and acting like owners. We want our employees to reflect the diversity of the communities in which we operate. We welcome people as they are, creating an inclusive culture where all forms of diversity are a real value for the company. We re looking for people with a passion for success on the job and beyond.
• Competitive salary according to the experience.
• Training plan and access to our training platform where you can develop your professional and personal skills.
• SEvoluciona policies work-life balance, flexitime.
• Flexible compensation plan restaurant tickets, health and life insurance, etc.

Keyskills :
sqljavadata warehousinginformaticapythonputting the customer firstbig datadata modelsdata scienceapache sparkdata integrationdata engineeringsoftware developmentawsemrhive