tool· draft

VGGT-Ω

Feed-forward 3D vision model from Meta AI and Oxford's Visual Geometry Group that predicts camera poses, depth and point clouds from video; used as a reconstruction backend in DeepReefMap for coral reef mapping.

Sensory landscape

VGGT-Ω (VGGT-Omega) is a family of one-billion-parameter models from Meta AI and the Visual Geometry Group at the University of Oxford, presented as an oral paper at CVPR 2026 (arXiv 2605.15195). Given a set of frames it returns camera poses and intrinsics, per-pixel depth with confidence, and tokens that can be unprojected into a point cloud; variants are trained at 512, 416 and 256 pixel resolution, and one checkpoint adds a text-alignment embedding.

Its place in this wiki is as one of four reconstruction backends in DeepReefMap, the EPFL and MIT tool that turns handheld underwater video into a semantic 3D point cloud, an ortho-mosaic and benthic cover statistics for a reef. DeepReefMap's README rates it high quality and notes that, unlike its streaming alternative, it looks at the whole clip at once, so the length of video it can handle is capped by GPU memory; the README quotes upstream figures of roughly 6 GB for the model plus about 75 MB per frame on an A100.

The code is on GitHub and the weights are hosted at facebook/VGGT-Omega on Hugging Face behind an access request that is reviewed automatically. DeepReefMap describes the licence as the FAIR Noncommercial Research License and keeps the backend as an opt-in extra for that reason; the VGGT-Ω repository itself refers readers to its LICENSE file. It runs on NVIDIA, AMD and Apple Silicon GPUs.

Released; the repository lists updates from September 2026.

form
research model
homepage
https://github.com/facebookresearch/vggt-omega
licence
noncommercial research licence
cost
free

used by

  • DeepReefMap tool draft

    Open-source pipeline from EPFL's ECEO lab that turns handheld underwater video of coral reefs into labelled 3D point clouds, orthomosaics and benthic cover statistics.

Tags: 3d reconstruction, computer vision, depth, camera pose, coral reef, video

staging: drafts and proposals shown