Building a streaming AI companion in your own API

We built a conversational AI companion in our API to help users plan hikes and find nature highlights. To keep credentials secure, we route Azure AI Foundry requests through our API, authenticating with managed identities. This approach also allows for better monitoring, validation, and resilience. We use OpenTelemetry traces, FluentValidation, and Polly retry pipelines to ensure a smooth user experience.