On-site Role in Phoenix, AZ – US Citizenship or Green Card Required
IBS Software is a fast-growing global software company with 4,000 employees and a 27-year track record of innovation for the world’s leading travel brands. We provide a broad range of industry leading products and services that manage mission critical operations of airlines, airports, cruise lines, hospitality partners, tour operators and oil & gas companies. These products improve safety, revenue and workflow efficiency, while managing growth, and reducing operating costs. Certified as a Great Place to Work®, IBS Software has a culture built on the values of precision, commitment, passion, integrity and respect for the individual.
We are currently seeking an experienced, dynamic, organized, self-starter to join as Data Engineer for our Consulting and Digital Transformation (CDx) line of business. An AWS Data Engineer is responsible for designing, building, and maintaining robust and scalable data architectures leveraging Amazon Web Services (AWS). They play a vital role in transforming raw data into actionable insights, enabling data-driven decision-making within an organization.
Key responsibilities
- Lead the design and development of robust ETL/ELT data pipelines, ensuring efficient data ingestion, processing, and transformation from diverse sources into AWS data warehouses and data lakes. This includes designing and implementing solutions for batch and streaming data, handling various data formats like JSON, CSV, Parquet, and Avro.
- Architect, build, and optimize scalable data architectures, including data lakes (e.g., S3, Delta Lake, Iceberg) and data warehouses (e.g., Redshift, Snowflake) on AWS, ensuring optimal performance and data accessibility.
- Collaborate closely with data scientists, analysts, and other stakeholders to understand data requirements, design appropriate data models and schemas, and deliver tailored data solutions that enable data-driven decision-making.
- Implement advanced data quality and governance practices, ensuring data accuracy, consistency, and compliance with relevant regulations.
- Optimize data retrieval and develop dashboards and reports using various tools, leveraging deep understanding of data warehousing and analytics concepts.
- Mentor and guide junior data engineers, fostering a culture of technical excellence and continuous improvement within the team.
- Proactively identify and resolve operational issues, troubleshoot complex data pipeline failures, and implement evolutionary recommendations for system improvements.
Required experience and skills
- 6-8 years of hands-on experience as a Data Engineer, with a strong focus on AWS cloud services for data solutions.
- Expertise in designing, developing, optimizing, and troubleshooting complex data pipelines, leveraging AWS services like Glue, Lambda, EMR, S3, Redshift, Athena, Kinesis, Step Functions, DynamoDB, and Lake Formation.
- Proficiency in programming languages such as Python (including Py Spark) and SQL (including advanced SQL, PL/SQL, query tuning), with the ability to write and optimize complex queries and scripts for data manipulation and transformation.
- Experience with big data technologies like Apache Spark, Hadoop, Kafka, and potentially real-time streaming platforms like Kinesis or Flink.
- In-depth knowledge of data modeling techniques, including relational, dimensional (star schema, snowflake schema), and potentially graph databases, and schema design for data warehouses and data lakes.
- Experience with containerization technologies like Docker and Kubernetes for scalable deployments.
- Strong understanding of data security and compliance principles and best practices.
- Familiarity with DevOps practices for managing data infrastructure and CI/CD pipelines using tools like AWS Code Pipeline, Jenkins, or others.
- Demonstrated experience in supporting ML/AI projects, including deploying pipelines for feature engineering and model inference.
- Excellent problem-solving, analytical, and communication skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
- Experience with version control systems like Git.
Educational background and certifications
- Bachelor’s degree in Computer Science, Information Systems, or a related field is typically required or preferred.
- Master's degree preferred.
- AWS certifications such as the AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Associate can further demonstrate expertise.
Desired soft skills
- Strong communication and collaboration skills to interact with various stakeholders.
- Ability to mentor and support junior team members.
- Strong analytical and problem-solving skills, with a focus on data quality and operational efficiency.
- Ability to adapt and thrive in a fast-paced, agile environment
Work Authorization
Must be authorized to work in United States and hold a valid passport
Travel
This position requires frequent travel, up to 50%. Most travel is outside the local area and overnight. Some of the travel is international.
At IBS you can look forward to:
- Operating with the brightest minds in the hotel software industry
- Receiving global exposure
- Benefiting from continuous learning programs
- Performance-based career growth
- Competitive compensation that includes fixed compensation, and variable compensation based on achieving set sales goals, company paid employee benefits, vacation, sick and personal leave, company matched 401k
IBS is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans status or any other characteristic protected by law. IBS as an equal opportunity employer bases its hiring decisions on the business need and the best qualified candidates available, and does not discriminate in its employment decisions on the basis of any protected category. Candidates who are offered employment may be subject to a criminal record and other background checks as permitted or required by company policy or applicable law.