Creators of the Ray Open Source Project Raise Capital to Define New Software Development Category and Bring First Commercial Offering to Market
A bold vision — to make distributed computing simple and accessible from anywhere. Open source model, with a developer-first mindset. A vibrant and rapidly growing community. And a stellar team, with a track record of building great technology to solve hard problems.
Ray is a popular framework for distributed Python that can be paired with PyTorch to rapidly scale machine learning applications.
Huggingface Transformers recently added the Retrieval Augmented Generation (RAG) model, a new NLP architecture that leverages external documents (like Wikipedia) to augment its knowledge and achieve state of the art results on knowledge-intensive tasks. In this blog post, we introduce the integration of Ray, a library for building scalable applications, into the RAG contextual document retrieval mechanism. This speeds up retrieval calls by 2x and improves the scalability of RAG distributed fine-tuning.