Data Engineer

Requisition Id 15212 

­­Overview:  

We’re hiring a Data Engineer to provide support for Cybersecurity Research and Operational Data Research. You will have the opportunity to work on some of the most ambitious and impactful research.

This position will work with both sponsors and research users to deliver and maintain data pipelines including ETL and reporting workflows as well as data management and data lifecycles. As a Data Engineer, you should be comfortable across several technologies including  Spark/Pyspark, SQL, Python, containers, Pandas, and source control in -low, moderate, and high security environments.

This position resides in the Emerging Technologies & Computing group in the Research Computing division, in the Information Technology Services Directorate at Oak Ridge National Laboratory (ORNL).

Major Duties/Responsibilities: 

• Develop high-scale, robust data warehouses, and data lakes with special focus on the state-of-the-art solutions.
• Collaborate with research teams to understand data needs, and providing subject matter expertise to research teams, and other team members about the data models, query optimizations, and schema interpretation.
• Design, build, and launch new data/study marts for the national research programs.
• Design, build and launch new data quality, data extraction, transformation and loading processes.
• Design and develop architectures for intake, curation, organization, and dissemination of data in support of data science and related subject areas.
• Design and develop high-performance database architectures.
• Research and evaluate state-of-the-art data and information management technologies.
• Work on a variety of data assignments; collaborate with scientists and engineers and expect to produce reliable data products and systems.
• Deliver ORNL’s mission by aligning behaviors, priorities, and interactions with our core values of Impact, Integrity, Teamwork, Safety, and Service. Promote equal opportunity by fostering a respectful workplace – in how we treat one another, work together, and measure success.
  
  

Basic Qualifications:

• A BS degree in computer science, computer engineering, information technology, information systems, science, engineering, business, or a related field of study and up to two (2) years of aligned professional experience in data engineering is required for consideration.
• Proven experience with integrating large web scraping structured and unstructured data using a medallion architecture.
• Experience with Airflow, Dremio, Apache Iceberg and other data lake technologies.

Preferred Qualifications:

• Experience with building and maintaining sophisticated systems related to coordinating and managing internships at a national laboratory.
• Proven experience with collecting, organizing, storing, and preparing data analysis
• Ability to conduct tasks independently and communicate effectively with team members and partners.

Special Requirements: 

• Visa sponsorship is not available for this position.

• This position requires the ability to obtain and maintain clearance from the Department of Energy. As such, this position is a Workplace Substance Abuse (WSAP) testing designated position. WSAP positions require passing a pre-placement drug test and participation in an ongoing random drug testing program.

About ORNL:

As a U.S. Department of Energy (DOE) Office of Science national laboratory, ORNL has an impressive 80-year legacy of addressing the nation’s most pressing challenges. Our team is made up of over 7,000 dedicated and innovative individuals! Our goal is to create an environment where a variety of perspectives and backgrounds are valued, ensuring ORNL is known as a top choice for employment. These principles are essential for supporting our broader mission to drive scientific breakthroughs and translate them into solutions for energy, environmental, and security challenges facing the nation.

ORNL offers competitive pay and benefits programs to attract and retain individuals who demonstrate exceptional work behaviors. The laboratory provides a range of employee benefits, including medical and retirement plans and flexible work hours, to support the well-being of you and your family.

Employee amenities such as on-site fitness, banking, and cafeteria facilities are also available for added convenience.

Other benefits include the following: Prescription Drug Plan, Dental Plan, Vision Plan, 401(k) Retirement Plan, Contributory Pension Plan, Life Insurance, Disability Benefits, Generous Vacation and Holidays, Parental Leave, Legal Insurance with Identity Theft Protection, Employee Assistance Plan, Flexible Spending Accounts, Health Savings Accounts, Wellness Programs, Educational Assistance, Relocation Assistance, and Employee Discounts.

If you have difficulty using the online application system or need an accommodation to apply due to a disability, please email: ORNLRecruiting@ornl.gov.

#LI-CS1

This position will remain open for a minimum of 5 days after which it will close when a qualified candidate is identified and/or hired.

We accept Word (.doc, .docx), Adobe (unsecured .pdf), Rich Text Format (.rtf), and HTML (.htm, .html) up to 5MB in size. Resumes from third party vendors will not be accepted; these resumes will be deleted and the candidates submitted will not be considered for employment.

If you have trouble applying for a position, please email ORNLRecruiting@ornl.gov.

ORNL is an equal opportunity employer. All qualified applicants, including individuals with disabilities and protected veterans, are encouraged to apply.  UT-Battelle is an E-Verify employer.