Data Engineer

DAn Solutions • Full-time • Annapolis Junction, Maryland, United States • $102.62k - $149.25k / year • 2m ago

REQUIRES AN ACTIVE/EXISTING TS/SCI WITH POLYGRAPH - NO REMOTE WORK

As a Data Engineer/Integrator on the Program your role entails collaborating closely with a team of developers to fulfill data integration requirements. This involves writing and maintaining code using an Extract-Transform-Load (ETL) platform to ensure data is transformed into suitable formats as defined by IC ITE initiatives. You will interface with external teams and systems, employing various protocols including HTML and SFTP to collect data efficiently. Additionally, your responsibilities include enhancing the ETL platform by adding features aimed at shortening timelines for future data integration efforts. Beyond coding tasks, you'll develop and maintain software, ensuring seamless integration into a fully functional system. Collaboration with external teams will be necessary to validate data ingest processes. Finally, you'll be responsible for providing comprehensive documentation covering system architecture, development, and any enhancements made throughout the process.

EDUCATION &EXPERIENCE REQUIREMENTS

EducationExperience Requirements:

5 + years of professional experience with a Bachelor's degree or equivalent
3+ years of professional experience with a Master's degree or equivalent
10+ years of professional experience
Additional experience will be considered in lieu of a degree

REQUIRED QUALIFICATIONS Active TS/SCI with CI Polygraph Specialization using the Databricks platform for building, deploying, and managing data and AI solutions Experience building ETL pipelines, managing data pipelines, and working with large datasets using tools like Spark, Python, and SQL Experience with technologies like Delta Lake, Delta Live Tables, and Databricks Workflows Familiarity with Advana
DESIRED QUALIFICATIONS
Experience collaborating with data scientists. Strong Python programming skills Solid SQL knowledge for querying and data manipulation Coud platform experience, such as AWS, Azure, etc.

Never Miss a New Opportunity

Subscribe and get the latest jobs directly to your inbox

Get a

Obviant • Full-time • Arlington, Virginia, United States • 1w ago

Data Engineering

1w ago

Apply