Data Engineer (AWS Cloud)

NOTE: This is a full-time employment opportunity (No C2C, subcontractor or 1099 engagements, please.) The candidate MUST be a U.S. Citizen or Permanent Resident and must be able to complete/pass/hold a public trust investigation. This is a remote opportunity; candidate must be based in the United States; ET time zone work schedule.

Daily Responsibilities 

• Play a critical role in ingesting, transforming, and managing data using AWS Cloud Services and Python programming.  
• Work directly with senior data engineers and product owners to deliver data products in a collaborative and agile environment.
• Work closely with business analysts, data scientists, and other stakeholders to understand data requirements and deliver data solutions that meet business needs. 
• Work with on-prem database and warehouse solutions such as Oracle or SQL Server or cloud-based solutions. 
• Collaborate on data engineering coding principles, standards, designs, frameworks, and chaos testing. 
• Develop data engineering solutions using Python and/or Java. 
• Continuously develop deep AWS engineering skills that optimize code quality and performance. 
• Build data pipelines and other custom automated solutions to speed the ingestion, analysis, and visualization of large volumes of data. 
• Develop data transformation pipelines to clean, enrich, and structure the ingested data for storage in AWS Redshift platform services and storage services.  
• Integrate data from disparate sources to enable seamless data access and analysis within the data management environment. 
• Design and maintain data models within and implement data quality checks and validation processes to ensure data accuracy and integrity. 
• Ensure data security and compliance with government regulations and industry standards. 
• Optimize data pipelines and queries for efficient data processing and retrieval. 
• Participate in Agile development sprints (2-week cycles) including design, development, unit testing and peer review.  
• Provide domain expertise for user stories, including descriptions, acceptance criteria and pointing. 
• Prepare comprehensive documentation for data pipelines, data models, and data processes.

• Must be a U.S. Citizen or Permanent Resident, as mandated by our government client.  
• Must be able to complete/pass/hold a public trust investigation.
• 7+ years’ experience in data engineering, with a focus on data integration, data transformation, and data warehousing. 
• 7+ years of cloud development (AWS Cloud) experience for data processing including experience doing ETL processes. 
• 7+ years in a technical management capacity for a large enterprise with a high performing technical team. 
• 7+ years’ experience with AWS Glue, AWS Data Brew, NoSQL server, SQL Server query experience, AWS Informatica for Relational Database Service (RDS) and the cloud. 
• 7+ years’ experience in designing and developing data pipelines for data Ingestion or transformation using AWS technologies. 
• Able to integrate code into a cloud production environment. 
• Must be able to collaborate with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS Glue and/or Informatica for big data technologies.   
• Experience in Python programming experience. 
• Familiarity with data integration patterns and best practices. 
• Experience with data cleansing, profiling, and domain-specific data quality assessment. 
• Experience working in an agile development environment, with an understanding of agile principles and practices. 
• Experience working in code repositories (i.e., GitHub) to support CI/CD. 
• Excellent verbal and written communication skills for expressing technical software requirements and designs. 
• Strong understanding of AWS Data Lake, data warehouse, and experience with data modeling is a PLUS.  
• Knowledge of oil and gas industry data, processes, and related data challenges is a PLUS. 
• Familiarity with big data technologies and distributed computing frameworks (e.g., Hadoop, Spark) is a PLUS. 
• Relevant certifications in AWS data services or data engineering is a PLUS. 
• Experience with data visualization tools such as Power BI or Tableau is a PLUS. 
• Have an understanding of data governance principles and their application in data engineering projects is a PLUS. 

Our Comprehensive Benefits Package Includes:

• 401(k) Retirement Plan (Employer Match)
• Health Insurance Plans (Medical, Rx, Dental, and Vision – Open Access)
• Long Term and Short-Term Disability (Company Paid Benefit)
• Life Insurance (Company Paid Benefit)
• Employee Assistance Program (EAP)
• Generous Paid Time Off (PTO)
• Paid Holidays
• Health Care and Dependent Care Flexible Spending Accounts (FSA)
• Voluntary Life and AD&D Insurance
• Discount Programs for Consumer Products and Wellness Services

Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs. The annual salary range for this position is $109,463 – $135,100.