Company Description

The entire team at Luth Research take pride in hiring diverse individuals of all backgrounds. We believe what makes a top-notch employee is personality, attitude and work ethic combined with solid skills and experience.

For more than 40 years, Luth Research has been advancing next generation consumer intelligence with innovative market research approaches. From survey research to digital tracking, as well as qualitative and call center services, our commitment to innovation and technology is driving change in the market research industry. Luth Research seeks team members that model our Core Values: Passionate and Driven, Delivering Excellence, Embracing and Driving Change, Career Growth and Development, and Keeping it Fun. Together, our vision is to connect millions of minds and devices worldwide to inspire business decisions.

Job Description

The Senior Data Engineer will lead the design, development, and maintenance of robust ETL pipelines and data infrastructure to support the Data Engineering/Science team. This role involves managing large-scale data deliveries to clients, ensuring data reliability and performance in a Linux/Hadoop environment using technologies like Spark and Python, and monitoring SLAs for timely deliverables. Responsibilities include developing engineering and data science solutions, potentially utilizing LLMs and other tools, to transform unstructured data into structured feeds. The position offers potential for growth into a managerial role, including architecture planning, code reviews, and directing junior team members to drive scalable data solutions that enhance insights, efficiency, revenue, and profitability for clients in market research, finance, and brands across multiple verticals.

Qualifications

Essential Job Functions and Responsibilitie:

Design, implement, and maintain ETL pipelines and data processing workflows using Python, PySpark, and Hadoop in a Linux environment to ensure efficient transformation and delivery of large-scale data to clients.
Monitor data pipelines, troubleshoot issues, and ensure compliance with SLAs to maintain high availability, reliability, and performance of data systems.
Manage client deliveries of large-scale datasets, optimizing for scalability, security, and integration with Postgres databases.
Utilize LLMs and other relevant tools to transform unstructured data into structured, actionable feeds, enhancing pattern recognition and insights for client solutions.
Document work projects in JIRA, including tracking progress on assigned tasks and proposing/writing new tickets in collaboration with the team and management.
Support management in data architecture planning, including system design and optimization, to support long-term growth and innovation in data solutions.
Support management in conducting code reviews, providing technical guidance, and directing day-to-day activities of junior team members to foster team development and maintain code quality.
Collaborate with sales and other teams to identify growth opportunities and develop data-driven strategies for clients.
Any other tasks and projects as assigned by management.

Other Job Functions and Responsibilities:

Commitment: Expert knowledge of market research and data engineering and data science practices, dedicated to the goals of the company while leading and promoting a positive, collaborative culture to ensure strong team relationships, overall satisfaction, and profitability.
Accessibility: Must be able to access and function within areas key to productivity. Adequate manual dexterity to operate assigned and shared office equipment. Ability to travel on periodic overnight and extended stays and work extended hours when necessary.
Communications: Must speak clearly and fluently to communicate on a wide range of technical and business topics. Superior reading comprehension and grammatically correct written communication skills, including the ability to document complex data processes and architectures. Must have the ability to understand and respond intelligently to business and technical correspondence. Advanced interpersonal skills to persuade, manage conflict, debate, negotiate, and mentor junior team members. Response to pressure should be calm, reasonable, and solution oriented.
Technical: Must demonstrate expert proficiency in data engineering tools and environments, including Python, Spark (PySpark), Linux/Command Line, Hadoop, Postgres, and LLMs, as well as basic office software such as Microsoft Outlook, Excel, PowerPoint, and Word.
Judgment: Strong comprehension of job requirements and procedures. Can independently initiate, lead, and perform work assignments under minimal supervision that are broad, varied, and highly complex in nature. Employee must leverage educated, intuitive, and experienced judgment to make strategic decisions.
Flexibility: Must thrive in a dynamic environment with the ability to juggle and prioritize multiple, competing tasks and demands, seeking supervisory assistance only as needed for high-level alignment.
Analysis: Advanced mathematical and analytical aptitude; proficient in numeric calculations, statistical methods, and data modeling for accuracy in reports, pipelines, and tasks.
Organization: Superior organizational and time management skills sufficient to plan, execute, and accomplish assigned goals while overseeing team efforts.
Logic: Advanced deductive and inductive reasoning ability to apply general concepts to specific, real-world situations. Able to translate theoretical data engineering principles into practical business solutions. Employee must apply extensive experience, skills, and information to identify complex problems and architect strategic resolutions.
Work Ethics: Must be willing to work hard, be highly dependable and responsible, possess a positive attitude, and maintain a strong sense of honesty and integrity.
Core Values: Luth Research and its employees are committed to our Core Values; Passionate and Driven * Delivering Excellence * Embracing and Driving Change * Career Growth and Development * Sustaining a Connected Fulfilled Team.

Education, Experience & Skill:

Education:

BS or MS Degree in Computer Science, Data Engineering, or a related field, or equivalent work-related experience.

Specific Job Experience and Skills:

Pay range is from $80k - $95k (depending on experience)
3+ years of experience in data engineering, with proven expertise in building and managing ETL pipelines in large-scale environments.
Expert proficiency in Python for data scripting, processing, and automation.
Hands-on experience with Spark (PySpark) for distributed data processing.
Strong command of Linux/Command Line and Hadoop for data management and operations.
Proficiency in Postgres for database integration and querying.
Experience utilizing LLMs for data transformation, pattern recognition, and solution development.
Excellent problem-solving skills, creative thinking, and the ability to develop innovative data engineering and science solutions.
Familiarity with project management tools like JIRA for documentation, tracking, and ticket creation.

Shift Availability:

Flexible schedule with the ability to work some nights and weekends as needed for deliverables or issues.

Additional Information

All your information will be kept confidential according to EEO guidelines.

Luth Research

Latest Jobs

Senior Data Scientist