Jensen Huang, NVIDIA\u2019s CEO, used a bold statement to describe this future during his March 2025 keynote: \u201cEverything that moves will be autonomous.\u201d This paints Physical AI as the next logical evolution of AI.<\/span><\/p>\n Empowering machines and robots to interact with the physical world requires a broad range of capabilities, starting with the understanding of the 3D space around them. There is a cognitive dissonance regarding how valuable and complex this capability is. Humans tend to downplay the importance of everything physical and overestimate everything that has to do with language. This bias is reflected and reinforced in society, where intellectual (white-collar) jobs commonly have higher value and command higher status than physical (blue-collar) jobs. Yet, if we look at evolution and the structure of our brain, the picture is very different. The area of our brain that controls language is small and evolutionarily recent. Considering this, it’s not surprising that machines can handle language so well. Language, unlike the physical world, is a human construct; it is purely generative and doesn’t exist in nature.<\/span><\/p>\n But vision is a totally different story. It has been shaped by millions of years of evolution. Every form of life that developed an eye had to solve the same hard problem: converting 2D images into a 3D predictive reconstruction of the physical space around them in order to survive. This is what enables animals and humans to thrive in the physical world and effectively interact with it.<\/span><\/p>\n But it does not end here: the understanding of the 3D structure of our world is also what powers an important part of our reasoning capabilities. Creativity\u2014across design, movie production, architecture, industrial design, and even science\u2014is inherently visual, perceptual, and spatial. When Francis Crick and James Watson co-discovered the beautiful DNA double helix, they didn’t just reason through language; they were able to infer the DNA molecule’s 3D structure from X-ray diffraction patterns.<\/span><\/p>\n As stated by Fei-Fei Li, language is a \u201clossy way to capture the 3D physical world.\u201d If you are blindfolded in a room, a linguistic description is insufficient for task execution. However, with sight, the brain immediately reconstructs the 3D space in the mind\u2019s eye, enabling efficient manipulation and interaction. The entire evolutionary history of animals is built upon perceptual and embodied intelligence, which humans further leverage to construct and change the world. This is what <\/span>Spatial Intelligence<\/b> is about, and <\/span>Large Geospatial Models (LGMs)<\/b> are tackling this fundamental capability: enabling machines to understand the 3D structure of the world.<\/span><\/p>\n Just like our brain, an LGM can take a 2D view and create a full 3D representation, including what’s unseen. This means one can manipulate, move, measure, and stack objects within the computer, enabling applications in robotics, architecture, design, gaming, and even filling in missing data. Machine perception\u2014the ability to reconstruct 3D representations from 2D inputs\u2014is inherently a generative task. It’s about filling the informational gaps to map 2D data into a 3D space. LGMs need to extrapolate priors on the 3D structure of the world to achieve this goal. These models are trained using multiview images of objects and environments, and <\/span>OVER has built one of the world’s largest datasets<\/b> of such pictures, with <\/span>over 130,000 locations mapped<\/b>.<\/span><\/p>\n The primary application of LGMs is in robotics, which encompasses all embodied machines. These machines require understanding and training in 3D space to perform independent or collaborative tasks. The problem is fundamentally 3D because physics happens in 3D, and interaction happens in 3D. Navigating behind objects and composing the world physically or digitally all require a 3D understanding. While humans can reconstruct 3D from 2D video, a computer program or robot needs explicit 3D information to perform spatial tasks like measuring distance or grabbing objects. LGMs bridge this gap.<\/span><\/p>\n But the applications of LGMs do not stop here. If you can fill the gaps between 2D and 3D space, you can also generate infinite, coherent worlds. Early experiments of this capability can be seen with models trained by companies like <\/span>Odyssey<\/span><\/a>. Applications in gaming, the metaverse, and simulation are virtually endless.<\/span><\/p>\n![\"\"](\"https:\/\/blog.ovr.ai\/wp-content\/uploads\/2025\/08\/Screenshot-2025-08-05-at-15.29.37-1024x653.png\")
<\/p>\n![\"\"](\"https:\/\/blog.ovr.ai\/wp-content\/uploads\/2025\/08\/Screenshot-2025-08-05-at-15.31.33-1024x653.png\")
<\/p>\n