Highly optimized for fast inference strictly on NVIDIA GPUs using ExLlamaV2 backends. Hardware Requirements to Run a 33B Model

If you delete all of your shared links, no one can see the content inside them anymore. If you delete a link, you'll still have access to the thread in your AI Mode history. Learn more Can't delete the links right now. Try again later. You don't have any shared links yet.

: Large Language Models, 33B Parameters, Model Alignment, Unfiltered LLMs, Open Source AI.

Install Dependencies: Run pip install -r requirements.txt to install the necessary libraries.