NVIDIA Launches Cosmos 3 Edge for Edge AI Applications

On July 20, 2023, NVIDIA launched Cosmos 3 Edge, a 4-billion-parameter open world model designed to help robots and vision AI agents understand their surroundings, reason in real time, and generate robot actions on edge devices.

Model Capabilities

Cosmos 3 Edge operates at robot-control resolution (640×360 observations), delivering real-time reasoning and generating 32 actions per inference on the newly announced Jetson T2000 and T3000 modules. It is designed as a compact open model that can serve as a small vision language model (VLM) with best-in-class throughput and accuracy with real-time inference.

Applications

The model is ideal for environments such as factories, warehouses, and hospitals, where it can help machines perform tasks that require understanding their surroundings and acting accordingly.

Availability

The model is available for download on Hugging Face’s Cosmos 3 repository. It delivers memory-efficient, high-throughput inference across various NVIDIA edge computers, including RTX PRO GPUs, DGX, GeForce RTX GPUs, and Jetson modules.

"Cosmos 3 Edge is a significant step forward in making advanced AI accessible on edge devices, enabling new applications and improving efficiency in various industries," said a spokesperson from NVIDIA.

For more details, you can visit the official announcement.