Creators of the Ray Open Source Project Raise Capital to Define New Software Development Category and Bring First Commercial Offering to Market
Ray is a popular framework for distributed Python that can be paired with PyTorch to rapidly scale machine learning applications.
Huggingface Transformers recently added the Retrieval Augmented Generation (RAG) model, a new NLP architecture that leverages external documents (like Wikipedia) to augment its knowledge and achieve state of the art results on knowledge-intensive tasks. In this blog post, we introduce the integration of Ray, a library for building scalable applications, into the RAG contextual document retrieval mechanism. This speeds up retrieval calls by 2x and improves the scalability of RAG distributed fine-tuning.