Streaming Text from Copilot Studio to Teams - Power Platform Integration
Currently, I am working on implementing GenAI through Teams within my organization, and I have successfully launched two applications:
First App: This app facilitates a simple GPT-4 connection for 1-to-1 chat using Teams and Azure OpenAI. To develop this app, I made use of Azure OpenAI Services, CoPilot Studio, and Power Automate to manage elements such as chat history and session-based responses.
Second App: The second application involves an Azure Prompt Flow Endpoint that leverages the "Chat with your own data" service. Both these apps utilize Power Automate to establish a connection with the Language Model.
Challenges Faced
I have encountered two main challenges during this process:
1. Setting up the Azure ML endpoint. For detailed instructions, I referred to this KB article.
2. Adapting the requirements for CoPilot Studio and Power Automate to handle streamed texts. If anyone has experience in addressing these challenges, I would greatly appreciate your insights and suggestions.
Feature Requests
It has come to my attention that Copilot Studio currently does not support streamed messages within its existing framework. To address this critical need, I encourage individuals to submit feature requests outlining the business case through this link.
Collaborative Efforts
Sharing experiences and insights within the community has proven to be invaluable. By exchanging information on the setup involving Azure open AI, Azure Search, and utilizing multiple Azure open AI calls, significant progress has been achieved in resolving similar challenges.
Join me in exploring new dimensions of engagement within the Copilot Studio Community, as we prepare to unveil enhanced features in our Community Blogs and Forums from June onwards. Stay tuned for an enriched experience designed to foster innovation, creativity, and connection within the community.
