skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

AWS Big Data Engineer-Bank

3.00 to 6.00 Years   Mumbai City   03 Jul, 2021
PREMIER CONSULTANTS
Job LocationMumbai City
EducationNot Mentioned
SalaryNot Disclosed
IndustryBanking / Financial Services
Functional AreaApplication Programming / Maintenance
EmploymentTypeFull-time

Job Description

Job descriptionJob Opening for Big Data Engineer with Leading Pvt Sector BankRoles and Responsibilities

  • Defining architecture for the use case using AWS components
  • End to end real time, near real time and batch use case development &deployment in UAT and Production environment
  • Scheduling of ingestion jobs using Sqoop or similar tool
  • Identify the issues for the scheduled jobs and rectify for timely and smooth execution
  • Code debugging and optimization to meet desired objective and SLA
  • Integration of data from multiple data sources for data ingestion in batch and real time
  • Processing of large structured and unstructured data
  • Developing application using build tool to deploy in production
  • Downstream integration for real time and batch use cases with delivery API
Desired Candidate Profile
  • BE/B-Tech/Master degree with at least3-4 years of experience as a AWS Big Data Engineer / Developer
  • Architecture designing experience for the use case development (mainly using AWS components) including end system integration details
  • Experience with AWS cloud data lake for development of real-time or near real-time use cases
  • Experience with Pyspark,Scala, Python & R (Spark/ Pyspark is mandatory)
  • Experience with messaging systems such as Kafka/Kinesis for real time data ingestion and processing
  • Experience with cloud components especially EMR, S3, Lamda, Glue, Athena, Sagemaker, Kinesis/Kafka, DynamoDB, Cloudwatch, EC2 etc.
  • Should have very good knowledge of Hadoop, MapReduce & HDFS
  • Should have experience with Spark, Spark ML, Spark Data Frame, RDD etc.
  • Experience with building stream-processing systems using solutions such as Spark-Streaming
  • Experience with NoSQL databases, such as DynamoDB, MongoDB etc
  • Knowledge of various ETL techniques and frameworks such as Flume
  • Experience with build tool- Eclipse, SBT etc.

Keyskills :
hiveunstructured datause casesapache webserverhadoopapiawsetlsbtoptimization strategiesjavabig datasystem integrationuse case

APPLY NOW

AWS Big Data Engineer-Bank Related Jobs

© 2020 Skillindia All Rights Reserved