Join our dynamic team as a Data Engineer and become a vital driver of our data-driven initiatives! In this role, you will design, develop, and maintain robust data pipelines and architectures that empower insightful analytics and strategic decision-making. Your expertise will enable seamless integration of diverse data sources, ensuring high-quality, accessible data for stakeholders across the organization. If you thrive in a fast-paced environment and are passionate about transforming raw data into actionable intelligence, this is the opportunity for you to make a significant impact!
- Develop, implement, and optimize scalable ETL (Extract, Transform, Load) processes to facilitate efficient data flow across various platforms, including cloud environments like AWS and Azure Data Lake.
- Design and maintain data warehouses and data lakes, ensuring data integrity, security, and accessibility for analytics and reporting purposes.
- Build and manage large-scale big data solutions utilizing Hadoop, Spark, Apache Hive, and related technologies to handle high-volume, complex datasets.
- Collaborate with data scientists and analysts to support model training, data analysis, and visualization efforts, leveraging tools like Looker and SQL.
- Develop and maintain APIs, including RESTful services, to enable seamless data integration and access across systems.
- Utilize programming languages such as Python, Java, and Bash scripting to automate workflows, perform data processing, and troubleshoot issues.
- Design and implement database schemas and optimize database performance using Microsoft SQL Server, Oracle, and other relational database systems.
- Work within Agile development frameworks, participating in sprint planning, stand-ups, and collaborative problem-solving.
- Use Informatica and Talend for data integration tasks, ensuring efficient data movement and transformation.
- Conduct analysis, interpret data trends, and generate reports to support strategic initiatives and operational improvements.
- Maintain comprehensive documentation of data pipelines, architecture, and processes for transparency and future scalability.
- Stay current with emerging data technologies and best practices to continually enhance our data infrastructure.
- Proven experience as a Data Engineer or similar role, with a strong understanding of data architecture, pipeline development, and database design.
- Extensive hands-on experience with cloud platforms such as AWS and Azure, including services like AWS Glue, S3, and Azure Data Lake.
- Proficiency in programming languages including Python, Java, and Shell scripting (Bash), with a focus on automation and data processing.
- Deep knowledge of big data frameworks such as Hadoop, Spark, and Apache Hive for processing large datasets efficiently.
- Strong expertise in SQL, Microsoft SQL Server, Oracle, and data warehouse concepts to support complex queries and data modeling.
- Familiarity with ETL tools like Informatica, Talend, and data integration practices.
- Experience working with Looker or similar BI tools for data visualization and analytics.
- Knowledge of RESTful API development for data access and integration.
- Understanding of data modeling, database design, and data governance principles.
- Experience with model training and analytics to support data science initiatives.
- Excellent analysis skills, with the ability to interpret complex data and communicate insights effectively.
- Familiarity with shell scripting, Bash, and Linux/Unix environments for system automation.
- Strong collaboration skills within Agile teams, with a proactive approach to problem-solving and continuous improvement.
- Bachelor’s degree in Computer Science, Information Technology, or a related field; advanced certifications are a plus. Join us and leverage your technical expertise to build innovative data solutions that power our future! We are committed to fostering a vibrant, inclusive environment where your skills can thrive and your contributions are valued.
Job Type: Full-time
Pay: $58,900.34 - $70,933.74 per year
Benefits:
- Paid time off
- Relocation assistance
Work Location: Hybrid remote in Jacksonville, NC 28546