Data Engineering - Technical Lead

Job Description

Data Engineering Technical LeadAbout Us:Paytm is India s leading digital payments and financial services company, which is focused on drivingconsumers and merchants to its platform by offering them a variety of payment use cases. Paytmprovides consumers with services like utility payments and money transfers, while empowering themto pay via Paytm Payment Instruments (PPI) like Paytm Wallet, Paytm UPI, Paytm Payments BankNetbanking, Paytm FASTag and Paytm Postpaid - Buy Now, Pay Later. To merchants, Paytm offersacquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation isdone through PPI and also other banks financial instruments. To further enhance merchantsbusiness, Paytm offers merchants commerce services through advertising and Paytm Mini app store.Operating on this platform leverage, the company then offers credit services such as merchant loans,personal loans and BNPL, sourced by its financial partners.About the Role: This position requires someone to work on complex technical projects and closelywork with peers in an innovative and fast-paced environment. For this role, we require someone witha strong product design sense & specialized in Hadoop and Spark technologies.Requirements:Minimum 6-8 years of experience in Big Data technologies.The position Grow our analytics capabilities with faster, more reliable tools, handling petabytesof data every day.Brainstorm and create new platforms that can help in our quest to make available to cluster users in allshapes and forms, with low latency and horizontal scalability.Make changes to our diagnosing any problems across the entire technical stack.Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.Develop complex and efficient functions to transform raw data sources into powerful, reliablecomponents of our data lake.Design & implement new components and various emerging technologies in Hadoop Eco- System,and successful execution of various projects.Be a brand ambassador for Paytm Stay Hungry, Stay Humble, Stay Relevant!Skills that will help you succeed in this role:Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.Excellent programming/debugging skills in Python/Scala.Experience with AWS services such as S3, EMR, Glue, Athena etc.Experience with Kafka.Experience with SQL.Experience with Jira, bitbucket, Jenkins.Experience with any scripting language such as Python, Bash etc.Good to have experience of working with noSQL databases like Hbase, Cassandra.Good to have hands-on programming experience with multithreaded applications.Good to have experience in developing streaming applications e.g. Spark Streaming, Flink, Storm,etc.Why join usBecause you get an opportunity to make a difference, and have a great time doing that.You are challenged and encouraged here to do stuff that is meaningful for you and for thosewe serve.You should work with us if you think seriously about what technology can do for people.We are successful, and our successes are rooted in our peoples collective energy andunwavering focus on the customer, and thats how it will always be.Compensation:If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users,21 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratizecredit for deserving consumers & merchants and we are committed to it. India s largest digitallending story is brewing here. It s your opportunity to be a part of the story!,

Keyskills :
sqledcproduct designcustomer relationssql serverfinancial servicesbig datalow latencyjava