Lead Data Engineer

FlightSafety International • Full-time • Columbus, Ohio, United States • $91.42k - $129.02k / year • 4d ago

About FlightSafety International

FlightSafety International is the world’s premier professional aviation training company and supplier of flight simulators, visual systems and displays to commercial, government and military organizations. The company provides training for pilots, technicians and other aviation professionals from 167 countries and independent territories. FlightSafety operates the world’s largest fleet of advanced full-flight simulators and award-winning maintenance training at Learning Centers and training locations in the United States, Canada, France and the United Kingdom.

Purpose of Position

The Lead Data Engineer is responsible for reviewing, analyzing, modifying, and developing applications for production Enterprise Resource Planning (ERP) and supporting applications. Additional responsibilities include mentoring other Data Engineers, assisting with the prioritization of daily workload based on organizational needs.

Tasks and Responsibilities

Serve as the subject matter expert for data replication tools (HVR and SQDR), ensuring the integrity, performance, and reliability of replication processes.
Design, build, and maintain scalable data pipelines across ADLS, ADF, and Databricks.
Develop, manage and monitor data pipeline to ensure timely and efficient data processing.
Integrate external data sources using REST APIs for automated and on-demand data extraction.
Contribute to the ongoing evolution of the analytics platform and integrated data model.
Identify gaps in the data architecture and drive continuous improvement and learning within the team.
Document data models, configurations, API specifications, and technical setups to ensure solution transparency and maintainability.
Implement data validation and cleansing processes to uphold data quality and integrity.
Collaborate cross-functionally to gather data requirements and deliver high-quality, reliable solutions.
Take ownership of tasks and deliverables, working independently with minimal oversight

Minimum Education

Bachelor's degree from an accredited institution or equivalent industry experience

Minimum Experience

Minimum 10 years of IT professional experience in data engineering field
Minimum 7 years of experience working/designing/optimizing on MS SQL, stored procedures, SSIS and relational databases and database design
Minimum 4 years of experience in creating legacy application logic and functionality into Azure Data Factory/Data Lake, SQL Database and SQL Datawarehouse environment.
Minimum 3 years of experience in working with dataflows in Azure Data Factory (ADF)
Minimum 3 years of experience in working with data extraction from REST API call and SFTP.
Minimum 3 years of experience in managing databases, Azure Data Platform services - Azure Data Lake (ADLS), Data factory (ADF), Databricks, SQL Server, Data Warehouse etc.
Minimum 2 years of experience in Azure Databricks and Delta files.
Experience with any data replication tools is a plus

Knowledge, Skills, Abilities

In-depth experience developing client/server applications and GUIs utilizing programming languages and tools in a Windows environment. Specifically, Microsoft SQL Server T-SQL programming language, Visual Basic .Net, SQL Server Reporting Services, Crystal Reports, VB Scripting, Microsoft C#, SQL Server Integration Services, ODBC, and ADO.NET
Strong working knowledge of Windows OS, Microsoft Office, and other Windows-based programs
Knowledge of UNIX is a plus
Proficient Windows usage skills
Required specific application experience customizing, administrating, and supporting the following programs: SQL Server and Syteline or Symix
Uses experience and sound judgment to plan and accomplish goals. Performs various complicated tasks in a fast-paced, production-critical support environment. A certain degree of creativity and latitude is expected
Strong written and verbal communications skills
Excellent organizational skills, including the ability to multi-task and prioritize workload

Physical Demands and Work Environment

The physical demands and work environment described here are representative of those that must be met and/or encountered by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is regularly required to use hands to finger, handle, or feel; reach with hands and arms; and communicate. The employee may be required to stand, walk, and sit. Specific vision abilities required by this job include the ability to view monitors, technical documents, and reference material. The employee must occasionally lift or move up to 25 pounds. The noise level in the work environment is usually low to moderate.

FlightSafety is an Equal Opportunity Employer/Vet/Disabled. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or disability.

Cybersecurity Notice: All official recruiting communication from FlightSafety International will come from an @flightsafety.com email address. FlightSafety International will never ask for personal or financial information through social media or third-party email providers.