Jobs search

Data Engineer

Centraprise • Full-time • Remote (New York, United States, US) • 7h ago

Job Role: Data engineer

Job Type: W2 Contract

Location : Remote (Need locals to New York)

Job Description :

Responsibilities:

Develop batch and real-time data pipelines, and lead the integration of Marvel’s many 1st, 2nd, and 3rd party data sources, while working closely with other engineering services such as the personalization and testing teams.
Create data catalogs and validation routines to ensure quality and correctness of key operational datasets and metrics in real time.
Build integrations with organic and paid media platforms to effectively deliver data to support the optimization of various KPIs.
Partner with Data Architect to build data infrastructure that enables activation, attribution and segmentation capabilities across growth, retention and marketing objectives
Collaborate with lifecycle and product marketing teams to democratize insights that will drive subscriber engagement using data driven solutions.
Coach other engineers and BI team members on best practices and technical concepts of building large scale, robust and well governed data platforms.
Basic Qualifications:
Excellent communicator and collaborator, able to apply technical acumen to drive business outcomes.
A natural team player with a willingness and desire to engage in cross training in a small team environment.
4+ years in big data and/or data intensive projects in industry or academic/research settings
4+ years of deep experience developing in Python.
Expert Level SQL developer – with an emphasis on Redshift but capable across multiple other transactional databases such as PostgreSQL, MySQL, etc.
Significant experience developing with PySpark.
Experience engineering big-data solutions using technologies like Redshift, Spark, S3, DynamoDB, AWS SageMaker etc.
Demonstrated understanding of data engineering tools and practices, including platforms like Databricks, Snowflake, and Jenkins.
Experience with deploying and running AWS-based data solutions and comfortable deploying tools such as DynamoDB, Athena and Lambda.
Demonstrated experience applying Master Data Management including metadata management, data lineage, and the principles of data governance
Ability to deliver technical solutions in the face of challenging and evolving data conditions.
Preferred Qualifications:
Experience implementing marketing technology stacks including real-time messaging and attribution pipelines.
Experience leveraging CDPs (mParticle, Hightouch etc.) to create deterministic user profiles that can be leveraged across a variety of applications.
Experience integrating with ML platforms and experimentation frameworks.
Familiarity with front-end development frameworks and experience in full stack development a plus.
Familiarity with binary data serialization formats such as Parquet, Avro, and Thrift.