What is semantic routing for LLMs
Semantic routing is an approach used with AI agents. It is similar to a decision tree, and based on matching routes, it determines which action path to follow.
For a chatbot, routes can be defined as a set of questions, and with embeddings in a vector database, they can be matched accordingly.
This method is an effective way of routing questions to a specific knowledge base or other interactions, especially when combined with RAG or different LLMs.