Audience

AI researchers needing a tool to leverage LLMs for advanced document reranking in information retrieval systems

About RankGPT

RankGPT is a Python toolkit designed to explore the use of generative Large Language Models (LLMs) like ChatGPT and GPT-4 for relevance ranking in Information Retrieval (IR). It introduces methods such as instructional permutation generation and a sliding window strategy to enable LLMs to effectively rerank documents. It supports various LLMs, including GPT-3.5, GPT-4, Claude, Cohere, and Llama2 via LiteLLM. RankGPT provides modules for retrieval, reranking, evaluation, and response analysis, facilitating end-to-end workflows. It includes a module for detailed analysis of input prompts and LLM responses, addressing reliability concerns with LLM APIs and non-deterministic behavior in Mixture-of-Experts (MoE) models. The toolkit supports various backends, including SGLang and TensorRT-LLM, and is compatible with a wide range of LLMs. RankGPT's Model Zoo includes models like LiT5 and MonoT5, hosted on Hugging Face.

Pricing

Starting Price:
Free
Free Version:
Free Version available.

Integrations

API:
Yes, RankGPT offers API access

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

Weiwei Sun
United States
github.com/sunnweiwei/RankGPT

Videos and Screen Captures

RankGPT Screenshot 1
Other Useful Business Software
MongoDB Atlas runs apps anywhere Icon
MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Start Free

Product Details

Platforms Supported
Cloud
Training
Documentation
Support
Online

RankGPT Frequently Asked Questions

Q: What kinds of users and organization types does RankGPT work with?
Q: What languages does RankGPT support in their product?
Q: What other applications or services does RankGPT integrate with?
Q: Does RankGPT have an API?
Q: What type of training does RankGPT provide?
Q: How much does RankGPT cost?

RankGPT Product Features