Data Engineer

Tror - AI for everyone • Full-time • Boston, MA, US • 4h ago

Job Title: Data Engineer

Location: Boston, MA(Hybrid)

Job Type: Contract

Client: State Street

Note: Need 10+ of experience resume and accepts only H1b visa

Responsibilities

Data Pipeline Development: Design and implement scalable data pipelines using Python, SQL, and PySpark to process large volumes of data efficiently.
AWS Infrastructure Management: Manage and optimize AWS services such as S3, Redshift, ECS, and Lambda to support data processing and storage needs.
Databricks Integration: Leverage Databricks to enhance data processing capabilities, including ETL (Extract, Transform, Load) processes and advanced analytics.
Performance Optimization: Continuously monitor and optimize data pipelines to ensure high performance and reliability.
Collaboration: Work closely with data scientists, analysts, and other engineers to understand data requirements and deliver solutions that meet business needs.
Security and Compliance: Ensure all data processing activities comply with security and data protection regulations.

Mandatory Skills

Should have 5+ years of experience as Data Engineer.
Proficiency in Python, SQL, and AWS services.
Extensive experience with PySpark for big data processing.
Understanding of AWS ECS and Lambda.
Familiarity with data warehousing solutions like Redshift or Snowflake.
Knowledge of data modeling, ETL processes, and data lakes.

Good To Have Skills

Exposure to Databricks for data processing and analytics. (This is a big plus)

Related Jobs

Azure Data Engineer

WissenPro LLC • Contract • Boston, Massachusetts, United States • $55 - $70 / hour • 4h ago

Data Engineering

4h ago

Data Analyst

Northern Bank • Full-time • Woburn, MA, US • 4h ago

Data Engineering

4h ago

Finance Graduate Program - Assistant Vice President | Boston, MA, USA

State Street Corporation • Full-time • Boston, MA, US • 4h ago

Data Engineering

4h ago

Data Engineer I

Ahold Delhaize USA • Internship • Quincy, MA, US • $79.28k - $118.92k / year • 1d ago

Data Engineering

1d ago

Senior Data Engineer

the LEGO Group • Full-time • Boston, MA, US • $100.91k - $151.36k / year • 1d ago

Data Engineering

1d ago

Technical Business Analyst | Burlington, MA, USA

State Street Corporation • Full-time • Burlington, MA, US • 1d ago

Data Engineering

1d ago

Data Engineer

InStride Health • Full-time • Remote (Boston, MA, US) • $115k - $135k / year • 2d ago

Data Engineering

2d ago

Data Engineer

SoTalent • Full-time • Remote (Boston, MA, US) • $239k - $273k / year • 2d ago

Data Engineering

2d ago

Data Engineer, Product Analytics

Meta • Full-time • Boston, MA, US • $145k - $204k / year • 2d ago

Data Engineering

2d ago

Analytics Engineer - REMOTE

Lensa • Full-time • Remote (Boston, MA, US) • $81k - $138k / year • 4d ago

Data Engineering

4d ago