We are seeking a highly skilled Senior Data Architect / Data Engineer to join our data team and drive the development, maintenance, and optimization of our Azure-based data platform. This role will focus on leveraging Azure Synapse Analytics, Azure Data Lake, and Apache Spark to build scalable, secure, and high-performance data solutions. The ideal candidate will have deep expertise in data architecture, data engineering, data modeling, SQL and multiple programming languages (e.g., Python, Scala etc.) along with a strong background in Dev Op’s and a proven ability to lead complex data initiatives.

ESSENTIAL JOB FUNCTIONS:

Data Pipeline Development: Build and maintain efficient, secure, and reliable ELT pipelines using Azure Synapse Analytics and Apache Spark.

Data Modeling and Warehousing: Develop and optimize data models (e.g., star schemas, snowflake schemas) for data warehousing and analytics, ensuring performance, scalability, and maintainability within Azure Synapse analytics.

Data Governance and Security: Implement data governance frameworks, including data quality, lineage, and cataloging, using Azure Purview or similar tools. Ensure compliance with security standards and data privacy regulations (e.g., GDPR, CCPA).

Dev Ops: Take ownership of existing Azure Dev Ops pipelines, source code repositories and branching strategies and produce new artefacts when required. Be responsible for managing all Azure EDW resources using infrastructure as code tooling.

Performance Tuning: Monitor and optimize the performance of Azure Synapse Analytics, Data Lake, Spark jobs and on-premise SQL Servers including query optimization, partitioning, and indexing strategies.

Integration and Collaboration: Collaborate with cross-functional teams (e.g., business analysts, report and application developers) to integrate Azure data solutions with other systems, including APIs, third-party tools, and business applications. Provide guidance and mentorship for other less experienced team members.

Innovation and Strategy: Stay abreast of emerging Azure data technologies, Apache Spark advancements, and industry trends, recommending and implementing innovative solutions to enhance the data platform.

QUALIFICATIONS

Bachelor's degree in computer science, Data Science, Information Technology, or a related field (or equivalent work experience).

7+ years of experience in data architecture, data engineering, or related roles, with at least 3 years focused on Azure cloud platforms.

Extensive hands-on experience with Azure Synapse Analytics, Azure Data Lake (Gen2), SQL Server and Apache Spark.

Proven track record of designing and implementing large-scale data solutions in a cloud environment.

Strong background in Dev Op’s culture with a deep understanding of source control and infrastructure as code.

Microsoft certifications in Azure data technologies (e.g., Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect Expert).

Familiarity with Power BI or other visualization tools for reporting and dashboard development.

Experience with containerization and orchestration tools like Docker and Kubernetes in Azure (e.g., AKS).

TECHNICAL SKILLS:

Expertise in Azure data services, including Azure Synapse Analytics / Azure Data Factory and Azure Data Lake Storage.

Strong proficiency in Apache Spark for big data processing, including Spark SQL, DataFrames, and RDDs, preferably using PySpark.

Expert level in writing efficient SQL statements in several different database technologies.

Experience working with other Azure resources such as API management, Logic Apps or Event Grid.

Advanced knowledge of object-functional scripting languages, particularly Python, for data processing, transformation, and automation.

Extensive experience in data warehousing concepts, including dimensional modeling, ETL/ELT processes, and data integration.

Expertise in data modeling techniques (e.g., Kimball, Inmon) and tools (e.g., ERwin, PowerDesigner) for designing data warehouses and lakes.

Strong proficiency in SQL and T-SQL for querying, optimizing, and managing data in both Azure and on-premise environments.

Familiarity with data integration patterns, including CDC, real-time streaming and batch processing.

Knowledge of data governance tools like Azure Purview or Collibra.

Highly experienced with DevOps methodologies and flows using Azure DevOps or similar and a deep understanding of source control and branching strategies using tools such as Git.

Experienced in maintaining cloud-based resources using IAC tools such as Terraform or Bicep.

Base range for this role is $130,000 - $150,000. Pay is determined by various factors, including but not limited to: relevant experience, skill set, qualifications, and other business and organizational needs. Please note that compensation ranges may differ for candidates in other locations. For more information about the perks and benefits of working at Interface, please check out our careers page.

We are not accepting candidates submitted through third-party agencies or C2C. This position is only open to candidates authorized to work in the United States on a full-time basis. At this time, we are unable to provide visa sponsorship.

Interface Systems is an Equal Employment Opportunity employer - all qualified applicants/employees will receive consideration for employment without regard to that individual’s age, race, color, religion or creed, national origin or ancestry, sex (including pregnancy), sexual orientation, gender, gender identity, physical or mental disability, veteran status, genetic information, ethnicity, citizenship, or any other characteristic protected by law. Such action shall include, but not be limited to the following: Employment, upgrading, demotion, or transfer, recruitment, or recruitment advertising; layoff or termination; for rates of pay or other forms of compensation; and selection for training, including apprenticeship.

If you need assistance or an accommodation in completing this application or during any phase of the interview process due to a disability, please contact us at recruiting@interfacesys.com. Any information will be treated as confidential and only used for the purpose of determining an appropriate accommodation as part of the recruiting process.

Interface Security Systems LLC jobs

Data Engineer Senior Manager

Never Miss a New Opportunity