Apply for-VP-Data Engineer

Job Description

The objective for our Public Cloud Data Platform Software Engineering teams is to design and build the multiple data lake and analytics data platform components required to easily ingest all types of data from publishers using streaming technologies, securely store this data in different formats, curate this data when needed, integrate data management controls, and make this data easily accessible to all types of consumers in big data analytics, machine learning, and artificial intelligence.This AWS Data Engineer will be responsible for collaborating together with other AWS software engineers to design, code, test and deliver into production multiple data lake and analytics platform components into the AWS public cloud. This individual will be expected to work with other CCB Software and Data Engineering teams within the firm to collaborate, align and implement software engineering best practices. Specific Roles and Responsibilities:
• Design, code, test, and deliver data platform software capabilities in the AWS cloud
• Collaborate on design innovation and develop engineering capabilities for advanced big data and analytics
• Code, test, and deploy micro-services based software capabilities for big data and analytics in the AWS cloud
• Seek to continuously develop deep AWS engineering skills that optimizes code quality and performance
• Collaborate on data engineering coding principles, standards, designs, frameworks, and chaos testing
• Excellent verbal and written communication skills for expressing technical software requirements and designs
This software engineering role has the responsibility for the delivery of technology for systems globally. The candidate will work closely with regional and global teams to deliver high quality technology services and projects on time, in scope, and within budget. Technical/Domain Skills:
• 14+ years of work experience in hands-on software development and data engineering
• Strong Hands on Shell Scripting and UNIX
• Demonstrated Big Data and hands on data migration expertise as a software engineer
• Hands-on experience with one or more AWS data lake technologies:
  • Data Lake: AWS Lake Formation, AWS Glue, AWS Step Function, AWS Lambda
  • Data Movement: AWS CLI, Python API, Spark, Python Boto3
  • Data Analytics: AWS Athena, S3 Select, EMR, Redshift
  • Compute/Storage: AWS S3, AWS EC2
• Working experience in one or more Big Data platform technologies: HDFS, Hive, Yarn, Spark, Sqoop
• Knowledge of at least one scheduling tool, Control-M Preferred
• Working experience in one or more of the following languages: Python(Preferred),Java/Scala(Good to Have)
• Knowledge and experience with testing, releasing, and CI/CD pipeline deployments into AWS using:
  • Tools: Bitbucket/Git, Jenkins, ServiceNow
  • Log Trace: AWS CloudWatch, Splunk
• Knowledge of Agile development methodologies, processes, and procedures
• Preferable to have AWS Certification
Software Engineering Required Capabilities This role requires a wide variety of strengths and capabilities, including:
• BS/BA degree or equivalent experience
• Advanced knowledge of application, data and infrastructure architecture disciplines
• Understanding of architecture and design across all systems
• Working proficiency in developmental toolsets
• Knowledge of industry wide technology trends and best practices
• Ability to work in large, collaborative teams to achieve organizational goals, and passionate about building an innovative culture
• Proficiency in one or more modern programming languages
Understanding of software skills such as business analysis, development, maintenance and software improvement,

Keyskills :
sqljavadata warehousinginformaticapythonbig data analyticsbig datadata analyticsdata migrationshell scriptingdata management