Job Role: Data Engineer (Python, Pyspark)

Location : Auburn Hills, MI (5 days Onsite)

Full Time

1. Looking for a core Data Engineer with strong experience on Python & Pyspark.

2. Min 8+ years of experience is required, lead experience is not mandatory.

Technical Experience:

"1. Hands-on Data Engineering : Minimum 5+ years of practical experience building production-grade data pipelines using Python and PySpark.

2. Airflow Expertise: Proven track record of designing, deploying, and managing Airflow DAGs in enterprise environments.

3. CI/CD for Data Projects : Ability to build and maintain CI/CD pipelines for data engineering workflows, including automated testing and deployment**.

4. Cloud & Containers: Experience with containerization (Docker and cloud platforms (GCP) for data engineering workloads. Appreciation for twelve-factor design principles

5. Python Fluency : Ability to write object-oriented Python code manage dependencies, and follow industry best practices

6. Version Control: Proficiency with **Git** for source code management and collaboration (commits, branching, merging, GitHub/GitLab workflows).

7. Unix/Linux: Strong command-line skills** in Unix-like environments.

8. SQL : Solid understanding of SQL for data ingestion and analysis.

9. Collaborative Development : Comfortable with code reviews, pair programming and using remote collaboration tools effectively.

10. Engineering Mindset: Writes code with an eye for maintainability and testability; excited to build production-grade software

11. Education: Bachelor’s or graduate degree in Computer Science, Data Analytics or related field, or equivalent work experience."

NLB Services

Latest Jobs

Data Engineer (Python, Pyspark)