Senior Data Engineer

Job Description

As a Senior Data Engineer, your main goal is to be one step ahead of data scientists and analysts. You will support them by providing infrastructure and tools they can use to deliver end-to-end solutions to business problems that can be developed rapidly and maintained easily. This is more than building and maintaining ETL pipelines. We need innovation, creativity, and solutions that will have a significant impact on our velocity. We, in turn, will give you autonomy and freedom to turn your ideas into reality.This is a remote position that can be done from anywhere. Due to the remote nature of this role, we are unable to provide visa sponsorship. Resumes and communication must be submitted in English.Responsibilities:
• Build scalable, highly performant infrastructure for delivering clear business insights from a variety of raw data sources.
• Develop batch & real-time analytical solutions, prototypes, and proofs of concept for selected solutions.
• Build frameworks and tools to empower our data scientists and analysts.
• Implement complex analytical projects with a focus on collecting, managing, analyzing, and visualizing data.
• Be in constant communication with team members and other relevant parties and convey results efficiently and clearly.
In the first week, expect to:
• Meet mentors that will help you during your onboarding month.
• Start participating in company-wide training sessions.
• Setup your local environment and become familiar with our tech stack.
In the first month, expect to:
• Build your first Pull Request and have it deployed to production.
• Learn about the technology that powers Toptal - the services, patterns, and libraries we use and develop.
• Have a good understanding of Toptal s business.
• Develop a deeper understanding of our technology, processes, and product pipeline.
In the first three months, expect to:
• Have strong knowledge of Toptal s business.
• Actively supply software planning, development, and maintenance.
• Be ready to propose and implement improvements to Toptal s processes and codebase.
• Deliver value in a regular cadence.
• Get comfortable in your daily work within your team.
In the first six months, expect to:
• Lead technical initiatives on our team.
• Drive improvements to the codebase and processes.
• Contribute to planning and executing multi-sprint initiatives inside your team.
• Be able to not only solve complex problems, but also consider multiple solutions, weigh them and decide on the best course of action.
• Proactively identify technical debt and product areas that require attention or improvements and suggest improvements in our technology stack.
In the first year, expect to:
• Have a detailed understanding of Toptal s business, collaboration rituals, processes, performance, and future work.
• Determine what your career path looks like at Toptal.
• Mentor Toptal s new team members.
• Meet your team in person during an off-site.
• Give and receive 360 feedback in a yearly review cycle.
Requirements:
• Working experience with Python and Pandas.
• Experience with SQL.
• Familiarity with the basic principles of distributed computing and data modeling.
• Extensive experience with object-oriented design and coding and testing patterns, including experience with engineering software platforms and data infrastructures.
• Working experience with Airflow and Luigi is a big plus.
• Working experience with Scala is a plus.
• Familiarity with Google Cloud Platform (e.g. GCS and BigQuery) is a plus.
• Working experience with Dimensional Modeling.
• Outstanding communication and interpersonal skills.
• Be excited about collaborating daily with your team and other groups while working via a distributed model.
• Be eager to help your teammates, share your knowledge with them, and learn from them.
• Be open to receiving constructive feedback.
• You must be a world-class individual contributor to thrive at Toptal. You will not be here just to tell other people what to do.
,

Keyskills :
google cloud platform360 feedbacksoftware planningapacheanalyticsvirtual teams