GCP DATA ENGINEER

Saransh Inc • Full-time • Nashville, TN, US • 6d ago

Senior Data Engineer With GCP

Long Term

Nashville, TN

Skillset Required.

Project is for Migration of SQL Server on Prem to PostgreSQL on GCP.

SQL Server
Stored Procedure,
SSIS
SSRS
PostgreSQL
Stored procedure
GCP Data services

PostgreSQL on GCP

Job Description

Need to Know:

SQL Server
- Intermediate level,
- Knowledge required: Tables, views, stored procedure, user functions)
- Why: Need to understand the source structure to be able to check in the target if the respective structure was created and the data was correct ingested
SSIS
- Junior leve (basic understanding is enough)
- Knowledge required: now how to use, open the packages and identify the stored procedures, database connections, and other dependencies.
- Why: to help Shannon map, design the new solution with cloud run jobs
PostgreSQL
- intermediate level.
- Knowledge required: tables, views, stored procedure, user functions
- Why: the client is using a tool called ISPIRER (MsSQL to PostgreSQL Migration Tool by Ispirer, Free Trial), the tool was suppose to migrate all objects from SQL Server to PostgreSQL. However, all item that face erros during the migration process will need to be done manually. Based on my tests until now this tool migrate tables and data perfectly but face some issues with stored procedures, views, user functions). At least 80% fof the job is done by the tool
Google Platform
- Basic to intermediate level
- Knowledge required: knows how to use the platform, find the services like cloud run, database instances etc.
- Why: the migration is to GCP platform.
Database management tools
- Intermediate level
- Knowledge required: know how to use PGAdmin, Dbeaver or any other tool to connect to the database and make any validation required

Nice to have

ISpirer
- Why: tool used by the client to migrate databases from onprem to cloud (will be used in other projects as well)
Programming like go/python
- Why: help Shannon if needed in the SSIS packages recreation
GCP Big Query
- Why: the client is moving into the direction to have bigquery as the source of true. I believe this project will have a phase 2 and this knowledge will be important.