Introduction to Super Mode on Jetson Orin Nano and Jetson Orin NX
The introduction of the NVIDIA Jetson Orin Nano Super Developer Kit sparked a new age of generative AI for small edge devices. The new Super Mode delivered an unprecedented generative AI performance boost of up to 1.7x on the developer kit, making it the most affordable generative AI supercomputer.
New Reference Power Modes on the Jetson Orin Nano and Jetson Orin NX Series
JetPack 6.2 enables the power boost on the Jetson Orin Nano and Jetson Orin NX series by unlocking higher frequencies on the GPU, DLA memory, and CPU clocks.
Table 1. New Reference Power Modes on the Jetson Orin Nano and Jetson Orin NX Modules
Boost Performance on Popular Generative AI Models
With the introduction of Super Mode with JetPack 6.2, the Jetson Orin Nano and Jetson Orin NX modules deliver up to a 2x inference performance boost. We benchmarked the most popular large language models (LLMs), vision language models (VLMs), and vision transformers (ViTs).
Large Language Models
Figure 1. Performance improvements for LLMs using Super Mode
Vision Language Models
Figure 2. Performance improvements of VLMs when run using Super Mode
Vision Transformers
Figure 3. Performance improvements of ViTs when run using Super Mode
Getting Started on NVIDIA Jetson Orin Nano and Jetson Orin NX with JetPack 6.2
To install JetPack 6.2 on the Jetson Orin Nano Developer Kit or the modules, use one of the following methods:
New Flashing Configuration
The new power modes are only available with the new flashing configuration. The default flashing configuration has not changed. To enable the new power modes, you must use the new flashing configuration while flashing.
Jetson AI Lab
The Jetson AI Lab is the NVIDIA hub for exploring and experimenting with generative AI technologies optimized for edge devices. It supports developers and provides a collaborative community with nearly 50 tutorials, prebuilt containers, and resources for deploying on-device LLMs, SLMs, VLMs, diffusion policies, and speech models using optimized inferencing infrastructures.
Updated Documentation: Datasheets and Design Guides
With the newer performance boost, the following resources have been updated and can be downloaded from the Jetson Download Center:
Jetson Ecosystem Partners Ready for Super Mode
To support customer deployments, the Jetson ecosystem partners have enhanced their solutions to support this boosted performance.
NVIDIA Jetson Orin Lifecycle and Roadmap
Due to the growing customer demand for Jetson Orin, NVIDIA recently announced the extension of the product lifecycle of Jetson Orin through 2032. With this performance boost, the Jetson Orin Nano and Orin NX series are the ideal platforms for both current and future models.
Conclusion
JetPack 6.2 is a groundbreaking release. It delivers an astonishing 2x boost in inference performance on existing Jetson modules, without any added cost. This upgrade is a must-have for Jetson developers and customers looking to supercharge their applications. Upgrade to JetPack 6.2 today and unleash the full potential of your Jetson platform.
FAQs
Q: What is Super Mode on Jetson Orin Nano and Jetson Orin NX?
A: Super Mode is a new power mode that enables higher frequencies on the GPU, DLA memory, and CPU clocks, resulting in a performance boost of up to 2x.
Q: How do I enable Super Mode on my Jetson Orin Nano or Jetson Orin NX module?
A: You can enable Super Mode by using the new flashing configuration or by selecting the MAXN SUPER power mode from the power mode menu.
Q: What is the Jetson AI Lab, and how can it help me?
A: The Jetson AI Lab is a collaborative community and resource hub for exploring and experimenting with generative AI technologies optimized for edge devices. It provides tutorials, prebuilt containers, and resources for deploying on-device LLMs, SLMs, VLMs, diffusion policies, and speech models.
Q: Will the Jetson Orin Nano and Orin NX series be discontinued?
A: No, the Jetson Orin Nano and Orin NX series will continue to be supported through 2032, and future models will be compatible with the existing platform.
