Job Title: Data Engineer
Location: San Jose, CA 95131
Duration: Full Time
We are seeking a highly skilled Data Engineer with 4+ years of experience to join our data-driven team. The ideal candidate will have strong hands-on expertise in GCP technologies, BigQuery, SQL, and Spark, with proven experience in building and maintaining scalable data pipelines. Experience with Google Looker and data analysis on Hadoop/HDFS environments is essential. A background in Financial Accounting or Payments Industry will be considered a strong plus.
Key Responsibilities:
- Design, develop, and maintain efficient, scalable, and reliable data pipelines and ETL workflows.
- Extract, transform, and load data from a variety of structured and unstructured sources.
- Work with Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, and Dataflow.
- Develop analytical dashboards and data visualizations using Google Looker.
- Write efficient and optimized SQL and Spark queries for processing large datasets.
- Perform in-depth data analysis and validation to ensure accuracy and consistency across data sources.
- Collaborate cross-functionally with business, product, and engineering teams to define and deliver data solutions.
- Apply Python for data manipulation, automation, and implementation of object-oriented design patterns.
- Manage and optimize Unix-based systems to support enterprise-level data and web applications.
- Troubleshoot data issues, optimize performance, and ensure data security and governance compliance.
Required Skills and Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- 4+ years of industry experience in data engineering or related domains.
- Strong expertise in SQL, Spark, Hive, and data analysis on Hadoop/HDFS environments.
- Proficiency in GCP technologies including BigQuery.
- Hands-on experience with Google Looker.
- Solid understanding of Python and object-oriented programming principles.
- Familiarity with Unix/Linux systems and scripting.
- Ability to work independently and collaborate effectively across teams.
Preferred Qualifications:
- GCP Certification (Data Engineer or Cloud Architect).
- Exposure to Financial Accounting or Payments Industry domains.
- Experience in performance tuning and data optimization for large-scale systems.
