ASUS IoT, a global provider of AIoT solutions, has unveiled enhancements to its edge AI computer models powered by NVIDIA Jetson Orin technology. With the addition of a new Super mode, these devices promise up to twice the performance for generative AI tasks, along with improved memory bandwidth and AI throughput.
Enhanced performance with Super mode
The Super mode, supported by the NVIDIA Jetson Orin NX and Orin Nano series, boosts AI TOPS (Tera Operations Per Second) by up to 1.7 times and enhances memory bandwidth by up to 1.5 times. This upgrade significantly elevates the performance of generative AI models, including large language models (LLMs), visual language models (VLMs), and vision transformers (ViTs).
Jetson Orin modules are compatible with popular machine learning frameworks, such as Hugging Face Transformers, Ollama, llama.cpp, vLLM, MLC, and NVIDIA TensorRT-LLM. This wide compatibility makes ASUS IoT edge AI computers an excellent choice for edge applications, robotics, and multimodal systems.
ASUS IoT edge AI computer models PE1102N, PE1101N, and PE1100N now offer up to 157 TOPS (sparse) for models powered by Jetson Orin NX 16GB modules. This performance upgrade positions these devices for high-speed data processing in applications like smart cities, smart transportation, and smart logistics.
Designed for demanding environments
The enhanced ASUS IoT edge AI computers are built for rugged environments and are capable of operating across a broad temperature range. This robust design, paired with advanced thermal management, ensures optimal performance in outdoor and industrial applications.
Compact yet versatile, these models are equipped with extensive connectivity options, enabling seamless integration into various systems. From managing smart parking and traffic analysis to supporting automated guided vehicles (AGVs) and autonomous mobile robots (AMRs), the devices empower developers to process data securely and efficiently at the edge.
Latest NVIDIA JetPack SDK brings new capabilities
The Super mode upgrade is enabled through the latest NVIDIA JetPack 6.2 SDK. This software release includes Jetson Linux 36.4.3, based on the Linux Kernel 5.15, and an Ubuntu 22.04-based root file system. It also features CUDA 12.6, NVIDIA TensorRT 10.3, and other tools designed to optimise AI workloads.
JetPack 6.2 introduces high-power Super modes for the Jetson Orin Nano and Jetson Orin NX production modules, delivering a significant boost in AI inference performance. Developers can activate this feature by updating their ASUS IoT edge AI computers with the new SDK, unlocking the ability to handle advanced generative AI models with twice the efficiency.
ASUS IoT: Pushing AI capabilities further
With these upgrades, ASUS IoT continues to set benchmarks in the AIoT space. The integration of NVIDIA Jetson Orin technology with Super mode ensures that these edge AI computers are ready to meet the growing demands of generative AI applications, offering faster speeds, enhanced security, and cost savings for a wide range of industries.