Position Title: Bigdata Engineer

Location: Sunnyvale, CA

Duration: 12 + months Contract (Only W2)

Technical Hiring Criteria (Must Haves)

• Top 3 Required skills: Spark, Scala, Big Data

• Years of experience in each of the must-have skills: 8+ Years

• Any Certifications required: No

Any additional information you would like to share about the project specs/nature of work: NA

JD:

Designing, developing, and optimizing big data solutions using Apache Spark. Key responsibilities include creating scalable data pipelines, processing large datasets, collaborating with other teams, and troubleshooting performance issues. Qualifications often include a relevant degree, proficiency in programming languages like Scala or Python, and experience with distributed computing frameworks.

Responsibilities :

Design, develop, and optimize data processing pipelines and applications using Apache Spark.

Build scalable and efficient systems to handle large volumes of data.

Integrate and process data from various sources, ensuring data quality and reliability.

Optimize Spark jobs for performance and cost-efficiency.

Collaborate with data scientists, engineers, and other stakeholders to understand data requirements.

Monitor and troubleshoot performance issues within Spark applications.

Implement best practices for data security and compliance.

Develop and maintain ETL (Extract, Transform, Load) processes.

Write clean, efficient, and well-documented code.

Participate in code reviews and ensure code quality.

Stay updated with the latest trends in big data and Apache Spark.

Regards,

Hasan Choudhary (Lead Recruiter )

Tel – 908-279-1243

Fax - 732-909-2631

Email - hasan@ClifyX.com

URL: www.clifyx.com

ClifyX

Latest Jobs

Bigdata Engineer