Job Title: Big Data Engineer
Location: Columbus, OH
Type: W2 Contract/No C2C
Pay Rate:
Job Summary:
We are hiring a Big Data Engineer. You will build and optimize large-scale data systems. You will work with Spark, Hadoop, and cloud platforms.
Key Responsibilities:
Design and build big data pipelines using Spark and Hadoop
Tune Spark queries for performance
Write Spark SQL, streaming, and dataset APIs
Work with HDFS and Unix shell scripts
Build and support ETL/ELT processes
Integrate Spark with SQL Server and MongoDB
Use RDBMS like Oracle, MySQL, or SQL Server
Participate in Agile development teams
Required Qualifications:
7+ years in software engineering
3+ years with Spark and Hadoop
3+ years with Spark SQL and streaming
Strong skills in performance tuning Spark
Experience with cloud data platforms
Proficient in Unix shell scripting
3+ years with RDBMS and NoSQL databases
2+ years of Agile methodology
Preferred Skills:
Experience in enterprise-scale data environments
Familiar with cloud-native tools and solutions