Data Engineer

Saransh Inc • Full-time • Boston, MA, US • 1m ago

Brighton, MA (Onsite)

Long Term

Key Responsibilities

Design, develop, and implement end-to-end big data solutions across the enterprise.
Develop and maintain big data applications using Apache Spark, Scala, AWS Glue, AWS Lambda, SNS/SQS, and CloudWatch.
Build and optimize data pipelines, ensuring high performance, scalability, and reliability.
Collaborate with cross-functional teams to design and document integration and application technical designs.
Conduct peer reviews of functional and design documentation to maintain high-quality standards.
Develop, configure, and perform unit testing and code reviews to ensure coding best practices.
Troubleshoot and resolve complex issues during testing phases and identify root causes efficiently.
Perform performance testing and optimize system performance.
Manage and maintain SQL-based databases, preferably Amazon Redshift.
Utilize Snowflake for data warehousing (experience in Snowflake is an added advantage).
Implement ETL/ELT processes and ensure data quality across various systems.
Work with Git repositories and manage CI/CD deployment pipelines for continuous integration and delivery.
Provide production support, including troubleshooting and environment tuning.
Ensure adherence to best practices and technical standards throughout the project lifecycle.

Required Skills & Experience

6+ years of relevant experience in big data design and development.
Proficiency in Scala and/or Python for application development.
Strong expertise in Spark, AWS Glue, Lambda, SNS/SQS, and CloudWatch.
Hands-on experience with ETL/ELT frameworks and data integration.
Advanced knowledge of SQL, with experience in Redshift preferred.
Familiarity with Snowflake and cloud-based data solutions is advantageous.
Experience with CI/CD processes, Git, and production support in large-scale environments.

Never Miss a New Opportunity

Subscribe and get the latest jobs directly to your inbox

Get a

email of new

jobs

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Related Jobs

Senior Data Engineer, MGB Digital

Mass General Brigham • Full-time • Somerville, Massachusetts, United States • 2h ago

Data Engineering

2h ago

Data Engineer

indiGO Technologies • Full-time • Woburn, MA, US • $192k - $212k / year • 7h ago

Data Engineering

7h ago

Senior Software Engineer | Boston, MA, USA

Wellington Management Company, LLP • Full-time • Boston, MA, US • 7h ago

Data Engineering

7h ago

Software Engineering & Development, AVP | Boston, MA, USA

State Street Corporation • Full-time • Boston, MA, US • 7h ago

Data Engineering

7h ago

Senior Electrical Engineer-Data Centers/Healthcare

LVI Associates • Full-time • Boston, Massachusetts, United States • $140k - $175k / year • 1d ago

Data Engineering

1d ago

AWS Data Engineer

Cognizant • Full-time • Boston, Massachusetts, United States • $81k - $130k / year • 1d ago

Data Engineering

1d ago

Data Engineer

Raft • Full-time • Hanscom AFB, MA, US • $140k - $180k / year • 1d ago

Data Engineering

1d ago

Data Modeling Engineer

Biogen • Full-time • Cambridge, Massachusetts, United States • $83k - $102k / year • 2d ago

Data Engineering

2d ago

Data Engineer

ZapCom Solutions • Boston, Massachusetts, United States • $71.07k - $122.57k / year • 2d ago

Data Engineering

2d ago

Junior Azure Data Engineer

UniFirst Corporation • Full-time • Wilmington, MA, US • $68k - $85k / year • 2d ago

Data Engineering

2d ago