RAG as part of flow

I was wondering if someone has experience with real-life RAG flows.


A very simple scenario


User asks: Give me the top 5 takeaways "search phrase" (e.g. MS keynote)


The code behind it runs an Azure AI search and returns five relevant documents - that are passed via a prompt including the user's original question to the AI


The system answers with a text with the top 5 takeaways


And this is where most of examples on the internet end


How do you handle the following question from user:


Give me 5 more takeaways


If you ran azure search with this phrase, you will not for sure get anything relevant to the original question, or do you pass this question straight to AI where you include chat history, original question, original RAG and AI answer?


What are your experiences?


thanks