Experience: 5 - 14 Years

Mandatory Requirement

Media and Entertainment, Solution Selling, Practice Development

5+ years of data engineering experience - Core technical foundation
Strong data modeling expertise including dimensional modeling and normalization principles
Advanced SQL performance tuning skills - critical for optimization
Strategic analytical thinking with ability to interpret market and consumer data

Role Overview

The Sr. Data Engineer will contribute to the Company’s success by partnering with business, analytics, and infrastructure teams to design and build data pipelines to facilitate measuring various KPIs and metrics. Collaborating across disciplines, they will identify internal and external data sources, design table structures, define ETL strategy, and implement automated data quality checks.

Must-have Skills

Complex or advanced SQL queries
Python
Spark
Snowflake
Databricks
Airflow or Prefect
Experience with at least one cloud platform (AWS, Azure, or GCP)

Nice-to-have Skills

Experience working with Kafka
Familiarity with tools like Datorama, Improvado, or FiveTran for integrating, harmonizing, and visualizing data
Familiarity with CI/CD tools (e.g., Jenkins, GitHub Actions) and Docker containers
Exposure to monitoring tools like Datadog

Responsibilities

Partner with technical and non-technical colleagues to understand data and reporting requirements
Work with engineering teams to collect required data from internal and external systems
Design table structures and define ETL pipelines to build performant, reliable, and scalable data solutions
Develop automated data quality checks
Develop and maintain ETL routines using orchestration tools such as Airflow
Implement database deployments using tools like SchemaChange
Perform ad hoc analysis and SQL/ETL tuning as necessary

Basic Qualifications

5+ years of relevant data engineering experience
Strong understanding of data modeling principles including dimensional modeling and data normalization
Good understanding of SQL engines and advanced performance tuning
Ability to think strategically and analyze market and consumer information
Strong written and verbal communication skills
Excellent conceptual and analytical reasoning competencies
Comfortable working in a fast-paced and highly collaborative environment
Familiarity with Agile Scrum principles and ceremonies

Preferred Qualifications

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
Strong analytical and problem-solving skills
Effective communication and teamwork abilities

Skills: sql,gcp,data engineering,python,azure,data,etl,aws

YO IT Group

Latest Jobs

Senior Data Engineer

Data Science/Analytics

Data Scientist