Senior Data Engineer

Job Description

Atlassian is looking for a Senior Data Engineer to join our Data Engineering Team and build world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker who is passionate about building systems at scale. You will enable a world-class engineering practice, drive the approach with which we use data, develop backend systems and data models to serve the needs of insights, and play an active role in building Atlassian s data-driven culture. You love thinking about the ways the business can consume data and then figuring out how to build it.On a typical day, you may be consulted on the Information Architecture of our Data Lake and help design and/or optimize the event collection infrastructure. You will be working with different stakeholders to understand the business needs and architect/build the data models, data acquisition/ingestion processes and data applications that can help address business needs. You have got industry experience working with large scale, high-performance data processing systems (batch and/or streaming) with a Streaming First mindset to drive Atlassian s business growth and improve the product experience. Constantly striving to optimize the data pipelines/infrastructure with the goal of providing data with quality and trust. As the data domain expert, you will be partnering with our Technology Team, Global Analytical Team, and Data Scientists across various initiatives.Youll own a problem end-to-end, so those skills will come in handy not just to collect, extract, and clean the data, but also to understand the systems that generated it, and automate your analyses and reporting. On an ongoing basis, youll be responsible for improving the data by adding new sources, coding business rules, and producing new metrics that support the business. Requirements will be vague, and Iterations will be rapid. You will need to be nimble and take smart risks. Industry professional with a mindset of continued development of data products & digital innovation to meet evolving stakeholder/customer needs in months and years to come.More about youAs a Sr. Data Engineer, you will have the opportunity to apply your strong technical experience to building analytics data models that support a broad range of analytical requirements across the company. You will work with extended teams to evolve solutions continuously as business processes and requirements change. You enjoy working in a fast-paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code.On your first day, well expect you to have:
• A BS in Computer Science or equivalent experience with 5+ years professional experience as a Sr. Data Engineer or in a similar role.
• Strong programming skills using Python & Java (good to have).
• Experience in designing data models for optimal storage and retrieval to meet critical product and business requirements.
• Experience building scalable data pipelines using Spark leveraging Airflow scheduler/executor framework or similar scheduling tools.
• Experience working in a technical environment with cutting-edge technologies like AWS data services (Redshift, Athena, EMR) or similar Apache projects (Spark, Flink, Hive, Kafka).
• Ability to understand and influence logging to support our data flow, architecting logging framework & best practices where needed.
• Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
• You re well versed in modern software development practices (Agile, TDD, CICD) and how they can apply to data engineering.
• Improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues.
• Working knowledge of relational databases and query authoring (SQL).
We d be super excited if you have:
• Experience with ML engineering.
• Followed a Kappa architecture with any of your previous deployments
• Experience working with SaaS companies.
• Domain knowledge of Order Management, Entitlement, Billing, Financial, and People systems.
,

Keyskills :
content managementemailsqlanalyticsapachedata flowdata domaindata models