Add final performance benchmarks + hosted inference link
Browse files
README.md
CHANGED
|
@@ -12,6 +12,9 @@ tags:
|
|
| 12 |
|
| 13 |
# MiniMax H3 ref2va β NVFP4 (ComfyUI-native)
|
| 14 |
|
|
|
|
|
|
|
|
|
|
| 15 |
NVFP4 quantization of the [MiniMax H3](https://huggingface.co/MiniMaxAI/MiniMax-H3)
|
| 16 |
**reference-to-video** DiT (`ref2va`), in ComfyUI's native quant layout β loads with
|
| 17 |
the stock `UNETLoader` on any Blackwell GPU (sm_120: RTX 5090 / RTX PRO 6000, and
|
|
@@ -57,8 +60,24 @@ the FP4 path runs emulated and is ~2.3Γ slower).
|
|
| 57 |
| **nvfp4_fpmm (this repo)** | 38.6 GB | β | 14.99 | ties bf16 on cu128, 42 % less VRAM |
|
| 58 |
| pruned int8_convrot (official) | 21.0 GB | β | 22.7 | pruned arch, W8A16 dequant path |
|
| 59 |
|
| 60 |
-
Stacking ComfyUI's `EasyCache` (threshold 0.
|
| 61 |
-
~1.4Γ
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
Same-seed visual quality of `nvfp4` vs bf16: no quantization artifacts observed
|
| 64 |
(trajectory divergence only β diffusion is chaotic under any weight
|
|
|
|
| 12 |
|
| 13 |
# MiniMax H3 ref2va β NVFP4 (ComfyUI-native)
|
| 14 |
|
| 15 |
+
> π **Use this model hosted (API + playground):**
|
| 16 |
+
> [modelslab.com/models/minimax/minimax-hailuo03-reference-to-video](https://modelslab.com/models/minimax/minimax-hailuo03-reference-to-video)
|
| 17 |
+
|
| 18 |
NVFP4 quantization of the [MiniMax H3](https://huggingface.co/MiniMaxAI/MiniMax-H3)
|
| 19 |
**reference-to-video** DiT (`ref2va`), in ComfyUI's native quant layout β loads with
|
| 20 |
the stock `UNETLoader` on any Blackwell GPU (sm_120: RTX 5090 / RTX PRO 6000, and
|
|
|
|
| 60 |
| **nvfp4_fpmm (this repo)** | 38.6 GB | β | 14.99 | ties bf16 on cu128, 42 % less VRAM |
|
| 61 |
| pruned int8_convrot (official) | 21.0 GB | β | 22.7 | pruned arch, W8A16 dequant path |
|
| 62 |
|
| 63 |
+
Stacking ComfyUI's `EasyCache` (threshold 0.2, quality-gated) cuts wall time a
|
| 64 |
+
further ~1.4Γ.
|
| 65 |
+
|
| 66 |
+
## End-to-end speed (full optimized stack)
|
| 67 |
+
|
| 68 |
+
600W RTX PRO 6000 Blackwell, `nvfp4` + cu130 + SageAttention +
|
| 69 |
+
fp16_accumulation + fused adaln/gate kernels + EasyCache 0.2, 20 steps,
|
| 70 |
+
1344Γ768 @ 24 fps with native stereo audio:
|
| 71 |
+
|
| 72 |
+
| Video length | Wall time | Notes |
|
| 73 |
+
|---|---|---|
|
| 74 |
+
| **15 s** (362 frames β the model's one-shot ceiling) | **8 min 07 s** | vs ~25 min on the stock template path (~3Γ) |
|
| 75 |
+
| **5 s** (124 frames) | **~2 min** (hot server) | measured through a production API |
|
| 76 |
+
| 15 s draft (16 steps @ 960Γ544) | ~3.5β4 min | preview tier |
|
| 77 |
+
|
| 78 |
+
Important: H3's trained range tops out at 362 frames (~15 s) β longer one-shot
|
| 79 |
+
generations collapse regardless of settings (verified empirically at 736
|
| 80 |
+
frames with multiple schedules/shifts).
|
| 81 |
|
| 82 |
Same-seed visual quality of `nvfp4` vs bf16: no quantization artifacts observed
|
| 83 |
(trajectory divergence only β diffusion is chaotic under any weight
|