2025/05/29
Pre-release
Pre-release
A pre-release for Blackwell (RTX 50 series) and Ada Lovelace (RTX 40 series) GPUs with triton installed.
The usage is the same as the current README.
Notes
-
You need to download 2 files (
.7z.001and.7z.002), then open the 001 file and extract it. You don't need to open the 002 file again. -
If you're upgrading from the previous version, copy/move your
HuggingFaceHubfolder to the new one. -
You may want to install the latest CUDA Toolkit (12.9) if possible. As a reminder, it's recommended to uninstall the older versions of CUDA Toolkit first, and only Libraries and Compilers are needed to install
Versions
- Python 3.12.10
- CUDA 12.8
- PyTorch 2.7.0