[Update] ComfyUI-RMBG v3.3.0: Interactive Canvas studio node, VRMBG temporal video matting, FeyNoBg hair matting, YOLO26-seg, Florence-2 local offline rewrite, and native FP16
Hi everyone,
We just tagged v3.3.0 for ComfyUI-RMBG. Over the past few weeks, between investigating compatibility crashes on newer Transformers releases and trying to streamline multi-node matting and compositing setups, we ended up overhauling large parts of the repository.
1038lab/ComfyUI-RMBG
Rather than staggering these into separate small patches, we put everything into this release. It covers fixes for broken upstream dependencies, new dedicated video and fine-detail matting backbones, direct detection-to-matting plumbing, and an interactive compositing node on the graph.
Here is a breakdown of what was added, what changed, and why it is useful:
1. Canvas (RMBG): Interactive Multi-Layer Compositing Studio
Chaining multiple blend nodes, transform nodes, and mask combiners just to place cutouts over a background gets tedious quickly. We built an interactive staging node directly on the ComfyUI canvas:
- Interactive Stage Handles: Move, rotate, scale (aspect-locked via 4 corners), flip horizontally or vertically, and tune opacity directly on the visual stage.
- Dynamic Layer Expansion: Connect layer_1 through layer_5 and the node dynamically expands its inputs, with live thumbnail cards and hover-to-remove actions.
- True Alpha Transparency: When set to Alpha background, it outputs a clean 4-channel RGBA image without downstream nodes clipping transparent regions to solid black.
- Merged Foreground Mask: Automatically merges all active layer silhouettes into a single combined MASK output, ready for immediate downstream inpainting, relighting, or shadow generation.
Workflow： github.com/1038lab/ComfyUI-RMBG/blob/main/example…
2. VRMBG: Flicker-Free Video Background Removal (AILab_VRMBG)
Standard image matting nodes applied frame-by-frame on video sequences often produce noticeable edge jitter and strobing hair boundaries.
- We integrated BRIA AI's VRMBG-3.0 architecture, which uses autoregressive temporal state tracking conditioned on prior frame foreground features to keep edges coherent across motion.
- Added a chunked batch reset_state toggle, letting you process long video sequences in smaller batches without memory fragmentation or GPU driver timeouts (TDR).
- Fully offline: Place models manually in ComfyUI/models/RMBG/VRMBG-3.0/.
Workflow： github.com/1038lab/ComfyUI-RMBG/blob/main/example…
3. FeyNoBg: Ultra-Fine Matting for Hair, Glass, and Fur (AILab_FeyNoBg)
For challenging subjects where general-purpose segmenters struggle, we added FeyNoBg (based on a deepened 263M Swin-L backbone):
- Tailored specifically for complex dichotomous boundaries: wispy hair, animal fur, transparent glassware, lace, and motion-blurred edges without requiring manual trimaps.
- Features a built-in sub-pixel refinement toggle (refine_foreground) to eliminate residual halos and color fringing on fine borders.
4. Finegrain Box Segmenter: 1024px High-Definition Bounding Box Matting (AILab_FinegrainBoxSegment)
- Integrates the Swin-B MVANet architecture to perform high-resolution 1024px object cutouts driven by bounding box coordinates.
- Plugs directly into the new BBOX outputs from Florence-2 and YOLO for automated detection-to-matting workflows.
- Automatically falls back to full-image subject matting if no bounding box input is provided.
Workflow：github.com/1038lab/ComfyUI-RMBG/blob/main/example…
5. Florence-2: Native Local Rewrite & BBOX Output (AILab_Florence2)
- Native Local PyTorch Architecture: The previous implementation relied on Hugging Face remote code (trust_remote_code=True), which broke on recent transformers updates with AttributeError: forced_bos_token_id. We completely rewrote Florence-2 into a clean local PyTorch module. It runs 100 percent offline, eliminates remote script vulnerabilities, and avoids version locking.
- Complete Polygon Masks: Fixed the issue where complex polygon boundaries (such as car wheels and facial contours) were abruptly truncated mid-generation.
- Matplotlib Removed: Replaced external plotting dependencies with native tensor and image rendering, reducing installation footprint and preventing memory leaks.
- New BBOXES Output: Added a dedicated 4th output port (BBOXES) providing parsed coordinates for direct connection to Finegrain Box Segmenter.
- UI Polish: Placed prompt at the top for easier workflow chaining, simplified widget names, and added an unload_model toggle.
6. YOLO Segmentation Node Overhaul (AILab_Yolo)
- YOLO26-seg and YOLO11-seg Families: Upgraded to state-of-the-art YOLO26 and YOLO11 instance segmentation models (yolo26n-seg through yolo26x-seg, plus yolo11*-seg), with auto-downloading from 1038lab/YOLO.
- Native RGBA Cutouts: The primary IMAGE output now directly emits transparent cutouts (Alpha RGBA) or solid color backdrops (Color RGB), eliminating downstream Mask Applier helper nodes.
- Configurable Annotation Display: The ANNOTATED_IMAGE port supports flexible display modes (Mask & Box, Box Only, Mask Only, or None).
- Built-in Mask Refinement: Added edge feathering (mask_blur), boundary expansion/contraction (mask_offset), and mask inversion (invert_output).
- Collapsible Advanced Drawer: Foldable parameter drawer keeps the default node footprint minimal while keeping advanced thresholds accessible.
Workflow: github.com/1038lab/ComfyUI-RMBG/blob/main/example…
7. SAM3 Segmentation Enhancement (AILab_SAM3Segment)
- Added a dedicated 4th output BBOXES (BBOX format) that outputs detected bounding box coordinates ([[x1, y1, x2, y2], ...]), allowing SAM3 detections to feed directly into the Finegrain Box Segmenter or downstream cropping tools.
8. Native FP16 Inference & VRAM Optimization
- RMBG-2.0 Native FP16 on CUDA: Over 50 percent reduction in weights and activation VRAM, providing roughly 2x faster throughput using NVIDIA Tensor Cores.
- Batch Processing Stability: Implemented automatic intermediate VRAM clearing per batch chunk during video and long sequence background removal to prevent GPU driver timeouts (TDR).
- Numerical stability improvements across half-precision RMBG-2.0 and BiRefNet outputs to eliminate transparency artifacts.
9. General Bug Fixes and Stability
- Fixed Image Resize scaling factor calculation where scale_by was accidentally applied twice (#211).
- Hardened node loader exception handling so a single missing optional library will not crash the entire node pack (#217, #218, #220).
- Updated timm.models.layers imports to timm.layers across backbones to silence upstream deprecation warnings (#210).
How to Update & Documentation
You can update directly via ComfyUI Manager, or run git pull inside your custom_nodes/ComfyUI-RMBG directory.
- GitHub Repository: 1038lab/ComfyUI-RMBG
- Complete Changelog & Details: github.com/1038lab/ComfyUI-RMBG/blob/main/update.…
- Example workflows for the Canvas node, VRMBG video matting, and Florence-2 to Finegrain box workflows are included in the repository's example_workflows/ folder.
If you encounter any edge cases with specific video formats or layer setups, feel free to open an issue on GitHub. Hope this saves you some time in your daily workflows.
19 points · 1 comment
Mentions
切り抜いた素材を、ComfyUI内で配置したい人へ。 RMBG v3.3.0のCanvasは、複数素材の移動・拡大縮小・回転に対応。 切り抜きだけなら導入を急がず、合成までまとめたい時の候補に。 ※公式更新の整理。未実測／添付は説明図。 github.com/1038lab/ComfyUI-RMBG/blob/main/update.… t.co
[Update] ComfyUI-RMBG v3.3.0: Interactive Canvas studio node, VRMBG temporal video matting, FeyNoBg hair matting, YOLO26-seg, Florence-2 local offline rewrite, and native FP16 Hi everyone, We just tagged v3.3.0 for ComfyUI-RMBG. Over the past few weeks, between investigating compatibility crashes on newer Transformers releases and trying to streamline multi-node matting and compositing setups, we ended up overhauling large parts of the repository. 1038lab/ComfyUI-RMBG Rather than staggering these into separate small patches, we put everything into this release. It covers fixes for broken upstream dependencies, new dedicated video and fine-detail matting backbones, direct detection-to-matting plumbing, and an interactive compositing node on the graph. Here is a breakdown of what was added, what changed, and why it is useful: 1. Canvas (RMBG): Interactive Multi-Layer Compositing Studio Chaining multiple blend nodes, transform nodes, and mask combiners just to place cutouts over a background gets tedious quickly. We built an interactive staging node directly on the ComfyUI canvas: - Interactive Stage Handles: Move, rotate, scale (aspect-locked via 4 corners), flip horizontally or vertically, and tune opacity directly on the visual stage. - Dynamic Layer Expansion: Connect layer_1 through layer_5 and the node dynamically expands its inputs, with live thumbnail cards and hover-to-remove actions. - True Alpha Transparency: When set to Alpha background, it outputs a clean 4-channel RGBA image without downstream nodes clipping transparent regions to solid black. - Merged Foreground Mask: Automatically merges all active layer silhouettes into a single combined MASK output, ready for immediate downstream inpainting, relighting, or shadow generation. Workflow： github.com/1038lab/ComfyUI-RMBG/blob/main/example… 2. VRMBG: Flicker-Free Video Background Removal (AILab_VRMBG) Standard image matting nodes applied frame-by-frame on video sequences often produce noticeable edge jitter and strobing hair boundaries. - We integrated BRIA AI's VRMBG-3.0 architecture, which uses autoregressive temporal state tracking conditioned on prior frame foreground features to keep edges coherent across motion. - Added a chunked batch reset_state toggle, letting you process long video sequences in smaller batches without memory fragmentation or GPU driver timeouts (TDR). - Fully offline: Place models manually in ComfyUI/models/RMBG/VRMBG-3.0/. Workflow： github.com/1038lab/ComfyUI-RMBG/blob/main/example… 3. FeyNoBg: Ultra-Fine Matting for Hair, Glass, and Fur (AILab_FeyNoBg) For challenging subjects where general-purpose segmenters struggle, we added FeyNoBg (based on a deepened 263M Swin-L backbone): - Tailored specifically for complex dichotomous boundaries: wispy hair, animal fur, transparent glassware, lace, and motion-blurred edges without requiring manual trimaps. - Features a built-in sub-pixel refinement toggle (refine_foreground) to eliminate residual halos and color fringing on fine borders. 4. Finegrain Box Segmenter: 1024px High-Definition Bounding Box Matting (AILab_FinegrainBoxSegment) - Integrates the Swin-B MVANet architecture to perform high-resolution 1024px object cutouts driven by bounding box coordinates. - Plugs directly into the new BBOX outputs from Florence-2 and YOLO for automated detection-to-matting workflows. - Automatically falls back to full-image subject matting if no bounding box input is provided. Workflow：github.com/1038lab/ComfyUI-RMBG/blob/main/example… 5. Florence-2: Native Local Rewrite & BBOX Output (AILab_Florence2) - Native Local PyTorch Architecture: The previous implementation relied on Hugging Face remote code (trust_remote_code=True), which broke on recent transformers updates with AttributeError: forced_bos_token_id. We completely rewrote Florence-2 into a clean local PyTorch module. It runs 100 percent offline, eliminates remote script vulnerabilities, and avoids version locking. - Complete Polygon Masks: Fixed the issue where complex polygon boundaries (such as car wheels and facial contours) were abruptly truncated mid-generation. - Matplotlib Removed: Replaced external plotting dependencies with native tensor and image rendering, reducing installation footprint and preventing memory leaks. - New BBOXES Output: Added a dedicated 4th output port (BBOXES) providing parsed coordinates for direct connection to Finegrain Box Segmenter. - UI Polish: Placed prompt at the top for easier workflow chaining, simplified widget names, and added an unload_model toggle. 6. YOLO Segmentation Node Overhaul (AILab_Yolo) - YOLO26-seg and YOLO11-seg Families: Upgraded to state-of-the-art YOLO26 and YOLO11 instance segmentation models (yolo26n-seg through yolo26x-seg, plus yolo11*-seg), with auto-downloading from 1038lab/YOLO. - Native RGBA Cutouts: The primary IMAGE output now directly emits transparent cutouts (Alpha RGBA) or solid color backdrops (Color RGB), eliminating downstream Mask Applier helper nodes. - Configurable Annotation Display: The ANNOTATED_IMAGE port supports flexible display modes (Mask & Box, Box Only, Mask Only, or None). - Built-in Mask Refinement: Added edge feathering (mask_blur), boundary expansion/contraction (mask_offset), and mask inversion (invert_output). - Collapsible Advanced Drawer: Foldable parameter drawer keeps the default node footprint minimal while keeping advanced thresholds accessible. Workflow: github.com/1038lab/ComfyUI-RMBG/blob/main/example… 7. SAM3 Segmentation Enhancement (AILab_SAM3Segment) - Added a dedicated 4th output BBOXES (BBOX format) that outputs detected bounding box coordinates ([[x1, y1, x2, y2], ...]), allowing SAM3 detections to feed directly into the Finegrain Box Segmenter or downstream cropping tools. 8. Native FP16 Inference & VRAM Optimization - RMBG-2.0 Native FP16 on CUDA: Over 50 percent reduction in weights and activation VRAM, providing roughly 2x faster throughput using NVIDIA Tensor Cores. - Batch Processing Stability: Implemented automatic intermediate VRAM clearing per batch chunk during video and long sequence background removal to prevent GPU driver timeouts (TDR). - Numerical stability improvements across half-precision RMBG-2.0 and BiRefNet outputs to eliminate transparency artifacts. 9. General Bug Fixes and Stability - Fixed Image Resize scaling factor calculation where scale_by was accidentally applied twice (#211). - Hardened node loader exception handling so a single missing optional library will not crash the entire node pack (#217, #218, #220). - Updated timm.models.layers imports to timm.layers across backbones to silence upstream deprecation warnings (#210). How to Update & Documentation You can update directly via ComfyUI Manager, or run git pull inside your custom_nodes/ComfyUI-RMBG directory. - GitHub Repository: 1038lab/ComfyUI-RMBG - Complete Changelog & Details: github.com/1038lab/ComfyUI-RMBG/blob/main/update.… - Example workflows for the Canvas node, VRMBG video matting, and Florence-2 to Finegrain box workflows are included in the repository's example_workflows/ folder. If you encounter any edge cases with specific video formats or layer setups, feel free to open an issue on GitHub. Hope this saves you some time in your daily workflows.