Open-source project unlocks hidden compute power in NVIDIA RTX graphics cards, RTX 4090 specific Tensor Core throughput doubles
An open-source project on GitHub unlocks rate limits on NVIDIA GeForce graphics cards for specific Tensor Core operations by modifying register configurations during the GPU boot phase; the RTX 4090's FP16 input, FP32 accumulate throughput rate rises from 165.6 TFLOPS to 331.6 TFLOPS. The RTX 3090 Ti, 3080, 3070, 3060, and RTX 2080 Ti also show gains of roughly 60% to 90%, with no need to flash the BIOS, and the original NVIDIA driver can run as usual. However, the actual cuBLAS matrix multiplication increase narrows to about 12% to 34%, and per-token generation speed shows no obvious change.
#English text is being prepared.#English text is being prepared.#English text is being prepared.

