comfyui
nvfp4
video
quantized
adhikjoshi commited on
Commit
daef8bc
Β·
verified Β·
1 Parent(s): a8b97d3

Add final performance benchmarks + hosted inference link

Browse files
Files changed (1) hide show
  1. README.md +21 -2
README.md CHANGED
@@ -12,6 +12,9 @@ tags:
12
 
13
  # MiniMax H3 ref2va β€” NVFP4 (ComfyUI-native)
14
 
 
 
 
15
  NVFP4 quantization of the [MiniMax H3](https://huggingface.co/MiniMaxAI/MiniMax-H3)
16
  **reference-to-video** DiT (`ref2va`), in ComfyUI's native quant layout β€” loads with
17
  the stock `UNETLoader` on any Blackwell GPU (sm_120: RTX 5090 / RTX PRO 6000, and
@@ -57,8 +60,24 @@ the FP4 path runs emulated and is ~2.3Γ— slower).
57
  | **nvfp4_fpmm (this repo)** | 38.6 GB | β€” | 14.99 | ties bf16 on cu128, 42 % less VRAM |
58
  | pruned int8_convrot (official) | 21.0 GB | β€” | 22.7 | pruned arch, W8A16 dequant path |
59
 
60
- Stacking ComfyUI's `EasyCache` (threshold 0.1) on top cuts wall time a further
61
- ~1.4Γ— with deviation within the pipeline's run-to-run variance.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
 
63
  Same-seed visual quality of `nvfp4` vs bf16: no quantization artifacts observed
64
  (trajectory divergence only β€” diffusion is chaotic under any weight
 
12
 
13
  # MiniMax H3 ref2va β€” NVFP4 (ComfyUI-native)
14
 
15
+ > πŸš€ **Use this model hosted (API + playground):**
16
+ > [modelslab.com/models/minimax/minimax-hailuo03-reference-to-video](https://modelslab.com/models/minimax/minimax-hailuo03-reference-to-video)
17
+
18
  NVFP4 quantization of the [MiniMax H3](https://huggingface.co/MiniMaxAI/MiniMax-H3)
19
  **reference-to-video** DiT (`ref2va`), in ComfyUI's native quant layout β€” loads with
20
  the stock `UNETLoader` on any Blackwell GPU (sm_120: RTX 5090 / RTX PRO 6000, and
 
60
  | **nvfp4_fpmm (this repo)** | 38.6 GB | β€” | 14.99 | ties bf16 on cu128, 42 % less VRAM |
61
  | pruned int8_convrot (official) | 21.0 GB | β€” | 22.7 | pruned arch, W8A16 dequant path |
62
 
63
+ Stacking ComfyUI's `EasyCache` (threshold 0.2, quality-gated) cuts wall time a
64
+ further ~1.4Γ—.
65
+
66
+ ## End-to-end speed (full optimized stack)
67
+
68
+ 600W RTX PRO 6000 Blackwell, `nvfp4` + cu130 + SageAttention +
69
+ fp16_accumulation + fused adaln/gate kernels + EasyCache 0.2, 20 steps,
70
+ 1344Γ—768 @ 24 fps with native stereo audio:
71
+
72
+ | Video length | Wall time | Notes |
73
+ |---|---|---|
74
+ | **15 s** (362 frames β€” the model's one-shot ceiling) | **8 min 07 s** | vs ~25 min on the stock template path (~3Γ—) |
75
+ | **5 s** (124 frames) | **~2 min** (hot server) | measured through a production API |
76
+ | 15 s draft (16 steps @ 960Γ—544) | ~3.5–4 min | preview tier |
77
+
78
+ Important: H3's trained range tops out at 362 frames (~15 s) β€” longer one-shot
79
+ generations collapse regardless of settings (verified empirically at 736
80
+ frames with multiple schedules/shifts).
81
 
82
  Same-seed visual quality of `nvfp4` vs bf16: no quantization artifacts observed
83
  (trajectory divergence only β€” diffusion is chaotic under any weight