Breaking Down the Challenges of SSE Support on ApigeeX

Re: Server Sent Events(SSE) support on ApigeeX - Google Cloud ...

Share this topic LinkedIn Twitter Copy URL

Issue with Server Sent Events (SSE) on ApigeeX

Hello, We are currently proxying the Azure Open AI endpoints via ApigeeX. When streaming is enabled on the Open AI request, Azure sends the response as SSE with the content-type being text/event-stream. However, we have encountered a significant delay in the Wait Time (TTFB) which suggests that ApigeeX is buffering the response from Azure and sending all chunks at once instead of immediately forwarding the data to the client. Even after enabling both response and request streaming on both proxy and target endpoints, the issue persists. Has anyone successfully proxied a SSE target with Apigee?

Azure Wait time:

Apigee Wait Time:

Engagement with the Community

Hi @rajeevyes1, thank you for your question. Providing more details about your use case or challenges can help others offer better insights. We appreciate your engagement with the community and will monitor this discussion closely to ensure it receives attention. 😉

Hi @rajeevyes1 -- SSE is currently not supported. Please direct message me here, mentioning your company and including a link to this post. Thanks.

Hi @omidt, I have sent you a direct message.

Share this topic LinkedIn Twitter Copy URL