Who We Are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to Customers.
Job Description
Job Title : Snowflake Data Engineer
Job Type : W2
Experience : 5-10 Years
Location : Richmond, Virginia
Responsibilities
- A minimum of 5 years of experience in Data engineering.
- Strong programming experience with PySpark, Scala, and Python.
- Hands-on experience in Spark-based data processing on large datasets.
- Experience with distributed computing frameworks (e.g., Hadoop, Spark).
- Solid understanding of data warehousing concepts, data modeling, and ETL development.
- Experience with SQL and performance tuning for large-scale datasets.
- Familiarity with cloud platforms (AWS, Azure, GCP) and services like S3, EMR, Databricks, or equivalent.
- Good knowledge of version control systems like Git and CI/CD pipelines.
- Knowledge of Docker, Kubernetes, or similar container technologies.
- Experience working in Agile/Scrum environments.
- Design, develop, and maintain scalable ETL/ELT data pipelines using PySpark, Scala, and Python.
- Work with big data technologies and frameworks such as Hadoop, Spark, Hive, and Kafka.
- Develop, deploy, and maintain efficient data ingestion and transformation logic for structured and unstructured data.
- Optimize the performance of large-scale data processing applications.
- Collaborate with Data Scientists, Analysts, and Business Stakeholders to understand data requirements.
- Ensure data quality, data governance, and security standards are adhered to.
- Participate in code reviews and provide constructive feedback.
- Monitor pipeline health, performance, and proactively address issues.
Education
- Bachelor's degree in Computer Science or related field.
