Senior Software Engineering Manager DevOps (Azure Big Data)

Job Description

Do you have experience on DevOps platforms and processes Do you enjoy writing and improving backend services Have you led an engineering team before We are looking for a Lead Software Engineer to help us drive the strategy for improvements for the Azure Big Data Build & Release team.If you have experience in one or more of these platforms, we are interested in talking with you: Azure DevOps, BigTop, Maven, Gradle, TeamCity, JIRA, Trello, GitHub, NuGet, Npm, and others.Azure Big Data teams (Azure HDInsight, Azure Stream Analytics and Cosmos) present exciting challenges in technologies such as big-data, cloud, distributed computing, artificial intelligence, storage and open-source. We build reliable, highly scalable and highly performing distributed systems for data analytics on Azure. Azure HDInsight is one of the fastest growing Azure services that offers popular open source technologies, such as Spark, Hadoop, Kafka, HBase and many others in a form that is easy for customers to use. We work with various open-source technologies including Spark, Hadoop, Yarn, etc. and make contributions to these technologies. We are running one of the world s largest Big Data cluster which has more than 25,000 machines, stored more than 10,000PB data and run tens of thousands of jobs everyday across search, ads, Office, Xbox, etc. Azure Stream Analytics is an event-processing engine that allows users to examine high volumes streaming data at scale. We are supporting massively parallel complex streaming processing in Azure.Your job will be to lead a team of engineers to develop, maintain and improve our DevOps & Test Collateral platform. You will be collaborating with other engineers in the Big Data team to prioritize work and improvements to our CI/CD pipelines, build infrastructure, test collateral etc. You and your team will be responsible for the development and upkeep of a best in class Build, QA and Release system, constantly improving its capabilities, efficiency and availability as well as ensuring it meets the compliance and security requirements.The Azure Big Data Build & Release Engineering team is constantly striving to modernize and improve our CI/CD infrastructure, allowing engineering teams to improve the productivity of the development cycle. The team s goal is to leverage the best in class CI/CD, packaging and deployment tools, both open source and internal to build a first class build and release infrastructure for the Azure Big Data productsAs the Engineering Lead on a highly motivated and agile team you will get an opportunity to work with the latest and greatest the Open Source eco system has to offer.

• Engage and collaborate with development teams to optimize build solutions.
• Help drive the adoption of emerging cloud-based Azure Dev Ops tools and technologies.
• Ensure automated build, QA and deployment pipelines are compliant, secure and run flawlessly.
• Develop and maintain documentation of the build and deployment processes.
• Develop and improve our test collateral and its execution.
• Team building - help hire qualified and motivated engineers to build a strong engineering team

,

• Bachelors degree in Computer Science, related degree, or equivalent experience.
• 5+ years relevant work experience.
• 1-2 years of experience in managing DevOps/Build Engineers/SRE teams
• Hands on knowledge of distributed version control systems (DVCS) such as Git.
• Hands on experience in using tools such as Git, Jenkins, Jira, Make, Maven.
• Proficiency in scripting language such as Powershell, Python and Bash.
• Experience in Linux development environments is a preferred.
• Experience with build management applications such as Maven, and BigTop.
• Experience in hiring, building and managing high throughput teams.

PLUSES:

• Experience with building or CI/CD pipelines of Apache projects such as Apache Spark, Hadoop, Hive, Presto etc
• Proven track record of hiring and building engineering teams
• Ability to handle and prioritize requirements in a fast paced environment

These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form .Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

Keyskills :
data analyticshigh throughputbuild managementopen sourceartificial intelligencebig datacomputer sciencedistributed systemsrelease engineeringbuilding engineeringversion controllinux developmentapache spark