It maintained clean cutout edges in the low-contrast night scene, with no halo or sky-bleed around the silhouette.
What was measured
Edge quality
How clean are the cutouts around hair, fingers, and clothing edges; are there visible halo, fringing, or jagged edges?
decisive for this rankingtransformation
Clean edges around hair, fingers, and clothing are a core measure of whether the background cutout works well at all. (3 of 3 judges)
What was given, what came back
Test input: Busy Urban Street · video · group: remove-or-replace-video-backgrounds-using-ai
Input — what we sent
Busy Urban Street
A video of a person walking through a busy city street with multiple people, moving vehicles, and a visually complex urban background. It was used to stress segmentation and tracking under heavy background distraction and continuous motion.
Why this input is hard
- · Complex background segmentation
- · Handling background distractions
- · Subject tracking
- · Temporal consistency across frames
- · Edge accuracy during continuous movement
Output — unretouched
Also checked on this input — same tool, 3 other criteria
Motion handling✓ WorkedIt kept the subject and secondary pedestrians consistent through a full ~20-second continuous walking shot, with no ghosting or motion breakdown.Output resolution✗ FailedIt silently downgraded to 1080×1918 instead of true 4K, and the close crop looks soft rather than 4K-sharp.Temporal consistency✓ WorkedThe replacement background stayed steady despite continuous camera motion, with no visible flicker or warping across the clip.
Provenance
- Observation
- 1da27c0b-3c3b-4018-b267-0228a01707a1
- Evidence run
- 10155228-7ce8-438a-a210-547331ef080b
- Study
- Remove or Replace Video Backgrounds Using AI
- Research task
- 86ba42c2d
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "invideo-ai",
scenario: "remove-or-replace-video-backgrounds-using-ai"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 6 other tools
measured on Edge quality
Bria.ai⚠ StruggledThe cutouts are dim and partially soft-edged, with semi-transparent edge fringing and residue in gaps that should read as pure black.Cutout.Pro⚠ StruggledLeaves a residual dark shadow smudge near the feet instead of a clean shoe-to-ground cutoff.FlexClip⚠ StruggledThe cutout keeps a soft grey-white halo around the beanie and head silhouette, so the edge remains visibly fringed under snowy street conditions.Fotor✓ WorkedFur-hood trim and backpack edges stayed clean, with no hard cutout line around the subject.Media.io⚠ StruggledFor moving multi-person footage, jacket, sleeve, and pant-leg boundaries faded gradually into black instead of cutting sharply, leaving a soft feathered outline.VEED⚠ StruggledProduces rough subject outlines and backpack-edge artifacts on the multi-person street cutout, rather than a clean silhouette.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com