- Tags:: [[Foundation models]]
# Evaluation
From [[Evaluate a RAG application]]:
![[Evaluate a rag application#^be63e8]]
From [Evaluation Metrics For Information Retrieval](https://amitness.com/posts/information-retrieval-evaluation):
- Order-unaware:
- Precision: amount of results that are relevant given the query.
- Recall: amount of relevant results retrieved of all relevant results.
- Order aware
# Multilanguage
For dense vectors we don't have to do anything (Foundation Models have already been trained on terms from different languages appearing together, so the embeddings are already capturing that). For sparse vectors (TF-IDF) there are some approaches:
[[2209.14281] Multilingual Search with Subword TF-IDF](https://arxiv.org/abs/2209.14281) already implemented [GitHub - artitw/text2text: Text2Text Language Modeling Toolkit](https://github.com/artitw/text2text).