skillindiajobs
Register for Job
Hyderabad Jobs
Banglore Jobs
Chennai Jobs
Delhi Jobs
Ahmedabad Jobs
Mumbai Jobs
Pune Jobs
Vijayawada Jobs
Gurgaon Jobs
Noida Jobs
Oil & Gas Jobs
Banking Jobs
Construction Jobs
Top Management Jobs
IT - Software Jobs
Medical Healthcare Jobs
Purchase / Logistics Jobs
Sales
Ajax Jobs
Designing Jobs
ASP .NET Jobs
Java Jobs
MySQL Jobs
Sap hr Jobs
Software Testing Jobs
Html Jobs
IT Jobs
Logistics Jobs
Customer Service Jobs
Airport Jobs
Banking Jobs
Driver Jobs
Part Time Jobs
Civil Engineering Jobs
Accountant Jobs
Safety Officer Jobs
Nursing Jobs
Civil Engineering Jobs
Hospitality Jobs
Part Time Jobs
Security Jobs
Finance Jobs
Marketing Jobs
Shipping Jobs
Real Estate Jobs
Telecom Jobs

Big Data Developer

5.00 to 10.00 Years   Mumbai City   19 Jun, 2023
PROVANCE BUSINESS CONSULTING PVT LTD
Job LocationMumbai City
EducationNot Mentioned
SalaryNot Disclosed
IndustryIT - Software
Functional AreaGeneral / Other Software
EmploymentTypeFull-time

Job Description

    Job Description SummaryPRINCIPAL ACCOUNTABILITIESShould be able to understand the application requirement. Responsible for application design and development in Big data technologies(Scala, Spark, Hive). Handle complete unit testing of the component or application. Support testing and UAT phases and resolve issues identified. Implement the application in production and complete post production checks.KNOWLEDGE AND EXPERIENCEResponsibilities: 5-10 years of development experience in object oriented applications with 2-4 years of experience in Scala.1.In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker, executor cores and memory params.2.Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must3.Hands on experience in Spark and Spark Streaming creating RDDs, applying operations -Transformation and Actions.4.Experience in code optimize to fine tune the applications.5.Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python6.Experienced with streaming work flow operations.7.Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently.8.Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.9.Strong database, SQL, ETL and data analysis skills.10.Knowledge in Maintaining the Log and Audit information in Hive/SQL tables, Experienced in providing Logging, Error Handling11.Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.12.Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.13.Experienced Scheduling jobs using Airflow/ESP.14.Experienced in developing scripts for doing transformations using Scala.15.Involved in developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.

Keyskills :
big datahivespark

APPLY NOW

Big Data Developer Related Jobs

© 2020 Skillindia All Rights Reserved