Data Engineer (Databricks)

Paradigm Technology • Contract • Remote (Columbia, South Carolina Metropolitan Area, US) • 4d ago

Position: Data Engineer (Databricks)

Location: Moncks Corner, SC (REMOTE)

About Paradigm – Intelligence Amplified

Paradigm is a strategic consulting firm that turns vision into tangible results. For over 30 years, we've helped Fortune 500 and high-growth organizations accelerate business outcomes across data, cloud, and AI. From strategy through execution, we empower clients to make smarter decisions, move faster, and maximize return on their technology investments. What sets us apart isn't just what we do, it's how we do it. Driven by a clear mission and values rooted in integrity, excellence, and collaboration, we deliver work that creates lasting impact. At Paradigm, your ideas are heard, your growth is prioritized, your contributions make a difference.

Summary:

We are seeking a highly skilled Data Engineer to join our team and help design, build, and optimize data pipelines and workflows using Databricks and related technologies
The ideal candidate will have strong experience in Data Engineering, Cloud-based platforms, and modern Data Architecture practices
This position is Remote, with occasional travel to Moncks Corner, SC

Responsibilities:

Design, develop, and maintain Databricks Delta Live Tables (DLT) pipelines for efficient data ingestion and transformation
Implement and manage Databricks Asset Bundles for deployment and version control
Develop scalable data processing solutions using PySpark and Python
Write optimized SQL queries and manage data integration with Microsoft SQL Server
Collaborate with data scientists, analysts, and business stakeholders to deliver reliable and high-quality data solutions
Ensure data quality, security, and compliance across all workflows
Monitor and troubleshoot data pipelines for performance and reliability

Required Qualifications:

5+ years of experience in Data Engineering or a related field
Hands-on experience with Databricks, including Delta Live Tables (DLT) pipelines and Asset Bundles
Strong proficiency in PySpark, Python, and SQL
Experience with Microsoft SQL Server and relational database concepts
Familiarity with CI/CD practices and Version Control (Git)
Knowledge of Data Modeling, ETL processes, and Data Governance best practices
Excellent problem-solving skills and ability to work in a collaborative environment
Bachelor’s Degree in Information Management, Data Science, Computer Science, Business, or related field is preferred
Utilities/Energy/Government industry experience is preferred
Experience in Management Consulting is preferred
Databricks Certifications are preferred

Why Join Paradigm

At Paradigm, integrity drives innovation. You'll collaborate with curious, dedicated teammates, solving complex problems and unlocking immense data value for leading organizations. If you seek a place where your voice is heard, growth is supported, and your work creates lasting business value, you belong at Paradigm.

Learn more at https://pt-corp.com/

Policy Disclosure:

Paradigm maintains a strict drug-free workplace policy. All offers of employment are contingent upon successfully passing a standard 5-panel drug screen. Please note that a positive test result for any prohibited substance, including marijuana, will result in disqualification from employment, regardless of state laws permitting its use. This policy applies consistently across all positions and locations.