Overview

We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing and implementing data solutions to support our organization's analytical and operational needs.

Responsibilities

Design and implement ETL processes to ensure efficient data collection and integration from various sources.
Develop and maintain data warehouses, focusing on regulatory reporting and data modeling.
Utilize SQL and Python for data analysis and manipulation, ensuring data accuracy and accessibility.
Collaborate with cross-functional teams in an Agile environment to meet project deadlines and requirements.
Leverage AWS and Hadoop technologies to enhance data processing capabilities.

Qualification

Demonstrated expertise with a minimum of 4+ years of experience as data engineer or similar role
Advanced SQL skills and experience with relational and non-relational databases
Deep understanding of data warehousing concepts
Extensive experience with dbt (data modeling and transformation)
Expertise in Looker dashboard development and administration
Familiarity with cloud platforms (AWS, GCP, Azure)
Strong knowledge of Looker studio.
Strong knowledge of LookerML.
Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
Strong exposure to write ETL
Proven track record of designing and implementing data pipelines using dbt
Experience building and maintaining Looker dashboards and explores
Familiarity with data governance practices and data security protocols
Experience in Data collection from multiple sources and integrating based on business needs
Core Python, PySpark, Hadoop, MariaDB, SQL - good hands-on for query preparation, Automation skillset, JavaScript & JQuery, Banking/Regulatory reporting domain knowledge would be advantage
Familiarity with the AWS/GCP data engineering services
Knowledge of AWS services viz., S3, Lambda,, GLUE ETL, Athena, RDS, Redshift, EC2
Proficiency in the English language.

For more details you can watch the job details about the budget and exact tech stack, please watch the YouTube Video

Link: https://youtu.be/uOnQ86yfH9M?si=8jCB7bL51we5fk-V

Regards

Rajan Paul

You can reach me on WhatsApp(+918446316288)

Job Types: Full-time, Permanent

Pay: $126,401.00 - $137,434.00 per year

Benefits:

Health insurance

Compensation Package:

Yearly pay

Schedule:

Day shift

Work Location: Remote

Never Miss a New Opportunity

3Pillar Global jobs

Data Engineer