Connsci is seeking a skilled Data Engineer to support the building of an anomaly detection platform for a large government customer. This role will design, build, and manage data pipelines that integrate financial and procurement systems. The Data Engineer will ensure that data ingestion, transformation, and storage processes are reliable, secure, and compliant with state and federal standards.
Key Responsibilities:
-
Design and maintain secure data ingestion pipelines using Azure Data Factory, API Management, and SFTP
-
Develop ETL/ELT workflows in Azure Databricks to cleanse, transform, and normalize data across multiple systems
-
Implement data quality checks (e.g., Great Expectations) to validate completeness, accuracy, and timeliness.
-
Manage data storage in Azure Data Lake Storage Gen2 (bronze/silver/gold architecture) with evidentiary controls (immutability, hashing, lineage).
-
Collaborate with Sr. Data Scientists to operationalize anomaly detection rules and risk scoring models.
-
Optimize pipelines for performance, scalability, and cost efficiency across DEV, TEST, POC, PROD environments.
-
Apply security best practices in alignment with NIST SP 800-53/171
-
Troubleshoot pipeline failures, monitor jobs, and ensure compliance reporting readiness.
Basic Qualifications:
-
Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
-
At least 5 years of experience in data engineering or ETL development
-
At least 2 years of experience with Azure cloud services to include experience with Data Factory, Databricks, ADLS, Synapse/SQL, or similar
-
At least 2 years of experience with data modeling and transformation using SQL and PySpark
Preferred Qualifications:
-
7+ years of experience in data engineering or ETL development in government or other highly regulated industries
-
Familiarity with data governance, compliance, and security frameworks (HIPAA, PII, FERPA, CJIS)
-
Experience supporting multi-environment deployments and collaborating in cross-functional teams
Location: This role will be able to work remotely but preference will be given to candidates who are located in the same region as a Connsci office (DC Metro or Florida).
About Connsci
At Connsci, our mission is to be a trusted strategic partner for our clients, helping them achieve impactful results by addressing mission-critical issues that affect their bottom line. We recognize the importance of customizing our services to best fit our clients' needs and understanding what it takes to propel their organizations forward. By implementing industry-leading best practices and leveraging our multifaceted experience and expertise, we deliver services that are essential for any organization aiming to reach its goals.
What You Can Expect:
-
Collaboration and Innovation: Work in an environment where collaboration and innovation are key. You'll have the opportunity to contribute to projects that make a real difference for our clients.
-
Professional Growth: Be part of a team that values professional development. We offer opportunities for growth and advancement, allowing you to enhance your skills and career.
-
Impactful Work: Engage in meaningful work that addresses mission-critical issues and supports organizations in achieving their goals.
By joining Connsci, you'll become part of a dedicated team that is committed to delivering strategic, impactful solutions tailored to our clients' unique needs, enabling them to achieve their goals with confidence and efficiency. If you're passionate about cybersecurity and IT services, and eager to contribute to a dynamic team, we encourage you to explore opportunities with us.
At this time, Connsci will not sponsor a new applicant for employment authorization for this position.
Connsci is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.
This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. Connsci makes hiring decisions based solely on qualifications, merit, and business needs at the time.
