Copilot Studio Engineer

About the Role

We are seeking a hands-on Copilot Studio Engineer to support, maintain, and optimize Microsoft Copilot agents and Power Platform solutions within a robust production environment. This critical role focuses on operational stability, advanced troubleshooting, and continuous improvement of existing AI-driven workflows, with strategic involvement in incremental enhancements and proof-of-concepts as required.

Key Responsibilities

• Copilot Studio Mastery: Support and maintain Copilot agents to ensure consistent, reliable behavior; manage updates to topics, prompts, and orchestration flows; and continuously tune agent responses based on real-world usage data and user feedback.
• Production Stability & Monitoring: Administer critical configurations including model selection, moderation policies, feedback settings, and telemetry. Ensure seamless stability across Dev, QA, UAT, and Production environments while supporting deployments, releases, and environment migrations.
• Troubleshooting Excellence: Proactively monitor and resolve production issues such as bot response inconsistencies, API failures, integration breakdowns, data retrieval gaps, and grounding inaccuracies. Perform deep root cause analysis using App Insights, logs, and telemetry tools to respond swiftly to incidents.
• Ecosystem Integration: Maintain robust integrations with Azure AI Search, Azure Functions, SharePoint, and various enterprise APIs. Troubleshoot complex issues related to data flow, indexing strategies, and retrieval accuracy within the Power Platform (Power Automate flows, Power Apps, Dataverse).

Required Skills & Experience

• Copilot Studio Expertise: Hands-on experience supporting Microsoft Copilot Studio in production environments is essential.
• Power Platform Proficiency: Strong ability to support and maintain Power Automate, Power Apps, and Dataverse components.
• Conversational AI Background: Proven track record of managing conversational AI or chatbot solutions live in production.
• Azure Familiarity: Solid understanding of Azure services, specifically Azure AI Search and Azure Functions.
• Mindset: Exceptional troubleshooting and debugging skills with a distinct support-oriented mindset.