Responsibilities
Since H-E-B Digital Technology's inception, we've been investing heavily in our customers' digital experience, reinventing how they find inspiration from food, make food decisions, and ultimately get food into their homes. This is an exciting time to join H-E-B Digital-we're using the best available technologies to deliver modern, engaging, reliable, and scalable experiences to meet the needs of our growing audience.
As a Senior Data Engineer, you'll use an advanced analytical, data-driven approach to drive a deep understanding of our fast-changing business and answer real world questions. You'll work with stakeholders to develop a clear understanding of data and data infrastructure needs, resolve complex data-related technical issues, and ensure optimal data design and efficiency.
Once you're eligible, you'll become an Owner in the company, so we're looking for commitment, hard work, and focus on quality and Customer service. 'Partner-owned' means our most important resources--People--drive the innovation, growth, and success that make H-E-B The Greatest Omnichannel Retailing Company.
Do you have a:
HEART FOR PEOPLE... you're willing to facilitate solutions with multiple engineers, provide upward communication, and mentor others?
HEAD FOR BUSINESS... you consistently demonstrate and uphold the standards of coding, infrastructure, and process?
PASSION FOR RESULTS... you're capable of high-velocity contributions in multiple technical domains?
What is the work?
- Architecting, designing, prototyping, testing, and deploying comprehensive end to end data pipelines, marrying data from disparate source systems and serving production grade data sets to analytic consumers
- Performing data validation and code review for data engineer peers
- Interfacing with many types of data sources, including traditional relational databases, NoSQL, and APIs
- Providing production support for pipelines to maintain high uptime and meet SLAs
- Collaborating with Product, Data Science, Business Intelligence, and other stakeholders to collect requirements and provide feedback on data needs
- Mentoring and engaging with junior engineers to provide technical guidance and career development
- Developing automated testing suites for data integrity and pipeline stability
- Modeling enterprise scale datasets of core objects in the HEB Supply Chain space
- Producing documentation, including data dictionaries and runbooks, around the pipelines and datasets created
- Investigating future technologies in the data space which can provide value to the HEB Digital organization
- Maintaining, optimizing, and deploying machine learning models to support Supply Chain initiatives
What is your background?
- A related degree or comparable formal training, certification, or work experience
- 5+ years of experience related to data engineering
- Experience in Lean Startup or Agile development methodologies
- Experience working in large scale infrastructure, large data sets, and mission critical SLAs
Do you have what it takes to be an H-E-B Senior Data Engineer?
- Advanced proficiency with Python and SQL
- Understanding of modern big data/data lake architecture and concepts
- Understanding and experience with Massively Parallel Processing (MPP) frameworks, such as Apache Spark or Amazon Athena
- Knowledge of DAG/Job pipeline schedulers such as Airflow or Argo Workflows
- Familiarity with CI/CD processes and tooling such as Argo CI, Gitlab CI, or Jenkins
- Experience working with Data Warehouses such as Teradata, AWS Redshift, or Google BigQuery
- Advanced knowledge of Agile software delivery standards
- Knowledge of business intelligence, analytics and reporting, and application integration
- Strong working understanding of data modelling best practices and guidelines for various data and analytic platforms
- Strong working understanding of coding standards and design principles / patterns
- Strong prioritization skills
- Strong verbal / written communication and data presentation skills
- Ability to deliver on ambiguous projects with incomplete information
- Ability / willingness to learn new technologies as they emerge
- Ability to calmly work under pressure
- Ability to work a flexible schedule as needed
- Ability to collaborate across multiple work locations
- Ability to work within a team, and willingness to take feedback from peers and mentors
JDENGINEERING