Data Engineer

Bluo Software LLC • Contract • Houston, TX, US • 1w ago

Job Title: Data Engineer (Copilot Studio & Agentforce)
Location: Houston, TX
Employment Type: Contract
Experience Level: 10+ years

About the Role

We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and PySpark, and hands-on experience integrating enterprise data with Copilot Studio and Agentforce (Salesforce AI Cloud).

The ideal candidate will design and maintain scalable data pipelines, support AI-driven analytics, and enable data accessibility for intelligent copilots that enhance decision-making across the organization.

Key Responsibilities

Data Engineering & Architecture

Design, develop, and optimize ETL/ELT pipelines using Databricks, Azure Data Factory, and SQL-based frameworks.
Build and manage data lakes, warehouses, and real-time data ingestion systems for structured and unstructured data.
Write efficient and maintainable Python and PySpark code for data processing and transformation at scale.
Implement best practices in data modeling, performance tuning, and cost optimization.
Ensure data quality, governance, lineage, and cataloging using modern tools and standards.

AI and Copilot Integration

Configure and extend Copilot Studio (Power Virtual Agents) for data-driven conversational workflows.
Develop custom connectors and data adapters to enable Copilot access to enterprise data sources.
Build prompt flows, plugins, and orchestrations to enhance Copilot’s contextual intelligence and automation.
Integrate Copilot Studio with Microsoft 365 Copilot, Power Platform, and Dynamics 365 for unified experiences.

Agentforce Integration

Integrate Agentforce (Salesforce AI Cloud) with enterprise data systems for analytics and AI automation.
Design data pipelines and APIs between Databricks and Salesforce Data Cloud.
Enable AI-driven forecasting, recommendations, and insights within Agentforce using existing data models.
Support AI agent orchestration between Copilot Studio and Agentforce for seamless data exchange.

Collaboration & Delivery

Collaborate with Data Scientists, AI Developers, and Business Analysts to deliver data and AI-driven solutions.
Participate in architecture reviews and contribute to design decisions on scalability, performance, and security.
Maintain comprehensive documentation of data pipelines, workflows, and integration frameworks.

Required Skills & Experience

10+ years of experience as a Data Engineer or Data Platform Developer.
Strong programming skills in Python and PySpark.
Hands-on experience with Databricks, Azure Data Factory, and SQL-based data warehousing solutions.
Proven experience in data modeling, ETL/ELT development, and data performance optimization.
Working knowledge of Copilot Studio (Power Virtual Agents), Power Automate, and Power Apps integration.
Experience integrating with Salesforce Data Cloud, Agentforce, or Einstein AI.
Familiarity with AI service integration (Azure OpenAI, Cognitive Services, or LLM-based tools).
Understanding of CI/CD practices for data pipelines and cloud security principles.

Preferred Qualifications

Microsoft Certified: Azure Data Engineer Associate (DP-203)
Microsoft Certified: Power Platform Solution Architect / Copilot Studio specialization
Salesforce Certified: Data Cloud Consultant or AI Associate
Experience in prompt engineering, AI orchestration, or semantic kernel integration.