Responsibilities
Company Name: H-E-B, LP
Job Location: 2416 E 6th Street, Austin, TX 78702. Employer will allow remote/telecommuting throughout the U.S.
Job title: Data Engineer II
Education: Bachelor's degree in Computer Science or related.
SOC Code: 15-1243
SOC Occupation Title: Database Architects
Duration: Regular Hire
Work week: Full-time
Supervision Experience Required: No
Travel Required: No
Experience: 3 years of Data engineering or related. Employer will accept applicants with any suitable combination of education, training, or experience. Requires skills and experience to involve:
- Experienced in designing and developing ETL data pipelines using Databricks, Spark, Informatica, Tibco, Kafka, and Argo.
- Proficiency with Oracle, PostgreSQL, and Teradata.
- Familiarity with Linux, AWS, GCP, Azure, Python, Docker, Terraform, and Kubernetes.
- Proficiency with GITlabs, JIRA, and Confluence.
- Working knowledge of computer science fundamentals including data structures, algorithms, design patterns, and data modeling.
Job duties: The Data Engineer II position will Designs, builds, and maintains systems that collects, store and analyzes data at scale. This data is used to answer and solved complicated business, marketing, and retargeting problems. Builds data pipelines and infrastructure, ensures data quality and governance . Collaborate with teams from Marketing, Sales, Finance, Wellness, Pharmacy, Nutritional Services, Engineering, and Data Science to gather business requirements. Document data flows from source to target systems and models data for warehousing and reporting based on these requirements. Create documentation for new data models and processes. Responsible for extracting, transforming, and loading (ETL) data using batch or real-time systems, and leverages and improves the ETL system. Test, deploy, and schedule new ETL processes using Python, Argo, SQL ,Kubernetes, AWS or other cloud based technologies , working with teams to ensure they meet business needs. Provides product support for ETL processes and the data warehouse, focusing on improving the reliability and performance of problematic processes. Analyzes data in the warehouse to ensure its accuracy and quality and modifies programs as needed to meet customer requirements. Verifies the structure and quality of warehouse data, maps data between source systems, data warehouses, and data marts, and develops data extraction procedures from other systems like administration, billing, or claims. Design and implement warehouse database structures and coordinates troubleshooting support for data warehouses. Create supporting documentation, such as metadata, entity relationship diagrams, and business process flow diagrams, and reviews designs, codes, test plans, and documentation for quality. Create test plans, files, and scripts for data warehouse testing, from unit to integration testing, and implements business rules using stored procedures, middleware, or other technologies.
