Job Description
- 8-10 years of overall experience
- Strong proficiency in Python.
- Strong proficiency with Databricks and PySpark
- Strong proficiency with cloud platforms such as AWS, Azure, or GCP.
- Experience with data warehousing and data lake technologies.
- Experience with containerization technologies such as Docker and Kubernetes.
- Strong proficiency with CI/CD pipelines and DevOps practices.
- Strong understanding of data structures, algorithms, and software design principles.
- Understanding of the Software Development Life Cycle, including CI/CD and automation tools
- Strong experience with modern application development workflows and version control systems like GitHub and GitHub Actions.
- Ability to lead a technical group in solving problems and moving forward.
- Strong interpersonal and communication skills
Roles & Responsibilities
- Available to attend in-person technical and customer evaluation.
- This is a purely an onsite location role. Remote work is not an option.
- Flexibility to work with offshore teams which might involve late evening standups is required.
- Collaborate within and across agile teams to design, develop, validate, deliver, and support technical business solutions.
- Apply expertise in programming languages and frameworks such as python, pyspark, Databricks, Azure
- Create, implement and deploy data pipelines including orchestration using GitHub, GitHub Actions and Databricks Bundles and Jobs
- Ability to upskill and apply new skills rapidly as needed.
- Use Scrum/Agile methodologies and DevOps principles combined with the latest in internal and external technologies to deliver value to internal customers.
- Apply expertise in data engineering to make large, distributed data sets accessible and performant. Make recommendations for performance tuning and cost considerations.
- Encourage innovation, implementation of cutting-edge technologies, inclusion, outside-of-the-box thinking, teamwork, self-organization, and diversity.
- Escalate concerns to leadership, as needed, and work independently to remove roadblocks for the team.
- Drive continuous improvement to deliver solutions that are at the forefront of industry leading techniques while also adhering to best practices.
Salary Range-$100,000-$120,000 a year
