Data Engineer

Emerald • Full-time • San Juan Capistrano, CA, US • $130k - $150k / year • 3h ago

We are seeking a highly motivated and technically proficient Data Engineer to join our growing data and analytics team. This role involves designing, developing, and optimizing scalable data pipelines and integrations across various cloud-based and third-party platforms. The ideal candidate will have hands-on experience with Databricks, Apache Spark, PySpark, and cloud computing, along with strong problem-solving skills and a solid understanding of data architecture and integration best practices.

This position is based out of our San Juan Capistrano office on a hybrid basis.

Key Responsibilities

Develop and optimize data pipelines and workflows using Databricks, Apache Spark, PySpark, and cloud-native services.
Integrate data from internal systems and external platforms such as HubSpot, Salesforce, and other CRM systems via APIs.
Implement cloud-based data architectures following data mesh principles and best practices.
Collaborate on data modeling, transformation, and quality assurance for analytics and reporting purposes.
Build and maintain APIs; use Postman and Swagger for testing and documentation.
Write efficient and modular code in Python and leverage SQL for data processing.
Follow SDLC best practices including version control, CI/CD, and code reviews.
Ensure data security, integrity, and governance across the full data lifecycle.
Use AWS (or similar platforms like Azure or GCP) for compute, storage, and orchestration services.
Work closely with cross-functional teams using Agile/Scrum methodologies.

Required Skills And Qualifications

5+ years of experience in data engineering, software development, or a related role.
Strong hands-on experience with:
- Databricks, Apache Spark, PySpark
- SQL and cloud-native or relational databases
- Python programming for data integration and processing
API development and integration experience with Postman, Swagger, REST APIs
Proficiency in working with AWS Cloud or similar platforms (S3, Lambda, AppFlow, etc.)
Strong understanding of data pipelines, ETL/ELT, and data architecture principles
Experience integrating data from platforms like Salesforce, HubSpot, or similar CRMs
Strong problem-solving skills and ability to work in fast-paced environments
Excellent communication and collaboration skills

Preferred Qualifications

Bachelor’s degree in computer science, Data Engineering, or a related technical field
Experience with Delta Lake, Databricks DLT (Delta Live Tables), and Unity Catalog
Familiarity with data governance, data cataloging, and access control mechanisms
Experience with GitHub, Jira, and Confluence for code management and team collaboration
Expertise in Scrum methodology and Agile team environments
Familiarity with data orchestration and transformation tools such as dbt or Airflow
Experience with event-driven architectures and real-time data (e.g., Kafka)
Certifications in Databricks, AWS, or other cloud platforms (a plus)

About Emerald

Emerald Holding, Inc. (NYSE: EEX) is the largest U.S.-based B2B event organizer, empowering businesses to succeed year-round by expanding meaningful connections, developing influential content, and delivering powerful commerce-driven solutions. As the owner and operator of a curated portfolio of B2B events spanning trade shows, conferences, B2C showcases and a scaled hosted buyer platform, Emerald delivers dynamic solutions across leading industries through its robust content and e-commerce marketplace. Emerald is a trusted partner for its thousands of customers, predominantly small and medium-sized businesses, playing a pivotal role in driving year-round commerce through streamlined buying, selling, and networking opportunities. Powered by an experienced team, Emerald is fostering meaningful engagement and delivering unparalleled market access with a commitment to driving business growth 365 days a year.

Join Us at Emerald

At Emerald, we are dedicated to building a workplace where everyone feels valued and included. We actively seek out diverse talent and fresh perspectives, embracing a wide range of professional backgrounds and experiences. Our skills-based hiring approach focuses on capabilities and potential. Over 90% of our roles don’t require a college degree, except for specialized fields like legal, finance, and accounting.

Come grow with us!

Compensation & Benefits

Target Compensation: $130,000-150,000

Please note that this range reflects a reasonable estimate of the target compensation for this position. This range may ultimately vary based on a candidate’s qualifications and may be higher where required by applicable law.

We offer a competitive benefits package designed to strengthen our employees’ physical and mental health, including unlimited vacation for exempt employees, 401(k) plan with a company match, medical/dental/vision coverage, parental and caregiver leave, dependent, commuter and FSA benefits, professional development programs, and mental wellness tools such as weekly guided meditation programs.

If you need accommodation in our application process or have questions about our posted salary range, please email our Talent Acquisition team at Careers@Emerald . com.