*This position is contingent upon contract award and funding availability*
Location: Washington, DC (Hybrid)
Clearance: Active Secret
Employment Type: Full-time- On site.
Responsibilities
- Build, test, and orchestrate data pipelines in Databricks.
- Design and optimize data structures, schemas, and ETL processes.
- Translate business use cases into SQL queries, reports, and dashboards.
- Manage database objects in development environments without impacting production.
- Automate workflows using Databricks Workflows or the Jobs API.
- Integrate code into GitHub/GitLab and support CI/CD practices.
- Diagnose data gaps/quality issues and design test cases for validation.
- Collaborate with developers and analysts to synchronize code and ensure reliability.
Qualifications
- Active Secret clearance (required).
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
- 7+ years of professional experience in data engineering.
- Expert-level proficiency in Databricks, Apache Spark, and SQL.
- Experience with Kafka, Airflow, or AWS Glue for ETL.
- Proficiency in CI/CD pipelines and GitHub/GitLab version control.
- Knowledge of cloud platforms (AWS, Azure, GCP).
- Excellent problem-solving, debugging, and collaboration skills.
How to Apply:
Interested candidates should submit their resume highlighting relevant experience and qualifications to careers@stockgroupanalytics.com
