Job Category: Engineer

Job Type: Onsite

Job Location: Texas Westlake

Compensation: Depends on Experience

W2: W2-Contract Only; Kindly note that applications on a C2C basis will not be considered for this role.

Job Description

Job Description:

Data Engineer (Python & PySpark Focus)

We are seeking a highly motivated and experienced Data Engineer to join our team, focusing on building, optimizing, and deploying robust, scalable data solutions. The ideal candidate will possess deep expertise in Python and PySpark to drive complex data transformations and support high-volume, performance-critical simulation initiatives.

Key Responsibilities

Design, build, and maintain high-performance ETL/ELT data pipelines using Python and PySpark.
Apply expertise in Python’s data analysis libraries, including Pandas and NumPy, to perform complex data manipulation, cleansing, and transformation.
Develop and manage data processing jobs leveraging PySpark for distributed computing across large-scale datasets.
Implement DevOps practices and tooling (e.g., Docker, Jenkins, Terraform, CloudFormation) for the automated deployment and orchestration of Python applications and data pipelines.
Collaborate with data scientists and analysts to ensure data quality, availability, and consistency for advanced modeling and reporting.
Utilize AWS or other cloud services (e.g., S3, Glue, EMR, Snowflake) to architect and maintain cloud-based data ecosystems.
Write and optimize complex SQL queries for data extraction, integrity checks, and performance tuning.

Required Technical Skills

5+ years of experience in Data Engineering or a related technical field.
Expert-level proficiency in Python, including a strong command of core concepts and specialized data libraries (Pandas, NumPy).
Solid hands-on experience with PySpark for building scalable data workflows.
Strong background in DevOps principles and tools for deploying Python-based data applications (e.g., containerization, CI/CD).
Experience with cloud platforms (AWS strongly preferred) and associated data services (e.g., AWS Glue, S3, Lambda, Snowflake).
Advanced knowledge of SQL and experience with modern data warehousing and database performance tuning.
Familiarity with distributed data processing technologies (e.g., Apache Spark, Hadoop).

Apply Online

Your Name *

Your Phone Number *

Your Email Address *

Job Id *

JPS-4922

What is your current visa status? *

Select

Enter Other Valid Visa

W2 or C2C *

Select

Where are you currently located at? *

How many years of relevant experience you have? *

Do you require h1b sponsorship? *

Select

Upload Resume *

Choose a file

No file chosen.

Facebook X LinkedIn WhatsApp

JPS Tech Solutions

Latest Jobs

Data Engineer (Python & PySpark Focus)