Jobs search

Data Engineer

EnIn Systems • Full-time • New Jersey, United States, US • 1d ago

Key Responsibilities:

Design, develop, and maintain ETL/ELT pipelines using AWS Glue and PySpark for large-scale data processing.
Integrate and manage data from multiple sources including AWS DynamoDB, relational databases, and APIs.
Implement data loading, transformation, and performance optimization in Snowflake.
Ensure high data quality, integrity, and security across all pipelines and storage solutions.
Monitor, troubleshoot, and optimize data workflows for performance and cost efficiency.
Collaborate with data analysts, data scientists, and business stakeholders to deliver reliable datasets for analytics and reporting.
Implement best practices in data modeling, metadata management, and schema design for analytics platforms.
Maintain documentation for data workflows, architecture, and business rules.

Required Skills & Qualifications:

Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
8 years of hands-on experience as a Data Engineer or in a similar role.
Strong experience with AWS Glue (job development, crawlers, triggers, job orchestration).
Proficiency in PySpark for distributed data processing.
Hands-on experience with AWS DynamoDB (data modeling, querying, performance tuning).
Expertise in Snowflake (SQL, performance optimization, Snowpipe, role-based access control).
Strong SQL skills for data querying, transformation, and aggregation.
Experience with AWS services such as S3, Lambda, IAM, and CloudWatch.
Knowledge of data governance, security, and compliance best practices.

Preferred Qualifications:

Experience with CI/CD for data pipelines using tools like GitLab, Jenkins, or AWS CodePipeline.
Knowledge of Python scripting for automation and data integration.
Familiarity with data lakehouse architectures and analytics platforms like AWS Athena or Redshift.
Exposure to real-time data streaming tools like Kinesis or Kafka.

Soft Skills:

Strong problem-solving and analytical abilities.
Excellent communication and teamwork skills.
Ability to work in a fast-paced and dynamic environment.

If you’d like, I can also make you a shorter, recruiter-friendly version of this JD so you can directly post it on job boards without making it too technical. That way it attracts just the right candidates.

Ask ChatGPT