Senior Data Engineer

Job Description

At phData, we build platforms exclusively for data and machine learning. Our services and software are used by the worlds largest companies to solve their hardest problems.Our work is challenging and our standards are high, but youll be set up for success with tooling, training, and colleagues who are among the brightest minds in the field. You will be working with the latest cloud-native and distributed data platforms on the market. Since the data and machine learning industry changes quickly, you have the opportunity to continuously learn. Our strategy is to remain innovative and cutting edge, while also ensuring our work is practical and unlocks real business value for our customers.While were growing extremely fast, we maintain a casual, small business work environment. We hire top performers and allow them the autonomy to deliver results. Our award winning workplace fosters learning, creativity and teamwork.
• Best Places to Work (2017, 2018, 2019, 2020, 2021)
• Inc. 5000 Fastest Growing US Companies (2019, 2020, 2021)
• Snowflake Elite Partner
• Snowflake Emerging Partner of the Year 2020
• Cloudera Partner of the Year 2020
Were looking for Sr. Data Engineers to serve as key technical leaders helping customers gain tangible value from their data. This may be the perfect opportunity if you have.
• At least 4+ years experience as a Software Engineer, Data Engineer or Data Analyst
• Programming Expertise in Java, Python, Scala, or another modern programming language like Kotlin, C#, NodeJS, Rust
• Strong working knowledge of SQL and the ability to write, debug, and optimize SQL queries
As well as some or all of the following:
• Production experience in core data platforms: Snowflake, Databricks, AWS, Azure, GCP, Hadoop
• Cloud and Distributed Data Storage (HDFS, S3, ADLS, GCS, Kudu, Elasticsearch/Solr, Cassandra or other NoSQL storage systems)
• Data integration technologies: Spark, Kafka, eventing/streaming, StreamSets, NiFi, AWS Data Migration Services, Azure Data Factory, Google DataProc
• Multiple data sources (e.g. queues, relational databases, files, search)
• Complete software development lifecycle experience including design, documentation, implementation, testing, and deployment
• Automated data transformation and data curation: spark, spark streaming, automated pipelines
You might also have.
• Relevant side projects (e.g., contributions to an open source technology stack)
• 4-year Bachelors degree in Computer Science or a related field
And you enjoy.
• Designing and implementing data solutions best-suited to deliver on our customer needs and use cases from streaming, to data lakes, to analytics, and beyond across a progressively evolving technical stack.
• Providing thought leadership by recommending the right technologies and solutions for a given use case, from the application layer to infrastructure; and they have the team leadership and coding skills (e.g. Python, Java, and Scala) to get their solutions into production and to help ensure performance, security, scalability, and robust data integration.
And y ou re exceptional at..
• Thinking independently and seeing the big picture
• Translating customer needs into solutions
• Confidently standing behind your recommendations
• Exploring new technologies in an effort to always grow and uncover better ways to solve problems (for instance: automating all the things)
• Explaining your technical decisions, both internally and externally
• Smiling in the face of complex problems
• Collaborating and helping your fellow data engineers learn and grow
• Working seamlessly across a variety of technical stacks, including Cloudera, Databricks, Snowflake & AWS
And if you re joining as a Solution Architect, you have.
• 8+ years of total experience
• Client-facing written and verbal communication skills and experience
• Proven experience as a technical team lead, and/or mentorship of other engineers
• Ability to develop end-to-end technical solutions
• Create and deliver detailed presentations
• Detailed solution documentation (e.g. sequence diagrams, class hierarchies, logical system views, etc.)
Behavioral Requirement
• Demonstrated ability to work independently as well as with team and customer/client stakeholders
• Strong verbal/written communication and documentation (project/process/product as applicable) skills.
• Collaborative Team Player with in-house team as well as hybrid team where there are members from client side, vendor side as well as in-house resources
• Excellent organizational and time management skills
• Ability to work to deadlines
• Exceptional eye for detail
• Passion for learning and ability to adapt to new technologies
Qualifications Requirements
• BE/BTech in computer science Or MCA with sound industry experience
• A minimum of 6 years experience in hands-on development
• Experience in Java, Scala or Python (Production level coding)
• Experience in a cloud-based environment with PaaS & IaaS
• Work iteratively in a team with continuous collaboration
,

Keyskills :
use caseteam leadershipanalyticsapachesqlcore dataemail