Description
Developed in partnership with USES Integrated Solutions, the AGX Inference Server is an extremely low wattage, high performance AI workstation powered by the NVIDIA Jetson platform. Running NVIDIA’s most powerful deep-learning software libraries, this inference server solves the challenge of deploying edge solutions at scale. The on-board 12x Jetson AGX Xavier modules are all connected by a Gigabit Ethernet fabric through a specialized Managed Ethernet Switch with 10G uplink capability (XDG201).
The AGX Inferencing Server includes Out of Band Management (OOBM) via an ARM-based SMARC module to control and monitor each of the Jetson AGX Xavier modules. The OOBM not only monitors the health/boot of each module, but also remotely hard power (on/off) them individually.
Additional information
Processing Modules | 12x NVIDIA® Jetson AGX Xavier™, CPU: 8-core Carmel ARM® v8.2 64-bit CPU, 8MB L2 + 4MB L3, GPU: 512-core Volta GPU with 64 Tensor Cores, 11 TFLOPS (FP16), 22 TOPS (INT8), Memory: 32GB 256-Bit LPDDR4x, 136.5GB/s, Storage: 32GB eMMC 5.1 |
---|---|
Processor Module Carriers | 3x module carriers can be installed in the system for a total of 12 modules, Each Module Carrier will allow up to 4x NVIDIA Jetson AGX Xavier modules to be installed |
Management Module | ARM Based OOBM, Enabling Serial console access, power status monitoring, and power control (ON/OFF) to all 12 x AGX Xavier modules, OOBM accessible via Ethernet or via its own integrated USB-to-Serial console |
Internal Storage | Each AGX Xavier Module has its own M.2 NVMe interface (optional) |
Array Communication | 12 x Gigabit Ethernet / 1000BASE-T / IEEE 802.3ab channels, All AGX Xavier modules can communicate to all other AGX Xavier modules |
Embedded Ethernet Switch | CPU: 500 MHz MIPS 24KEc, Memory: 4Gb DDR3 SDRAM, Multi 1G/10G uplinks, with 24 1G downstream module connections, Storage: 128Mb Serial NOR Flash, Vitesse/Microsemi VSC7448 Managed Ethernet Switch Engine |
External Uplink Connections | 2 x SFP 1G uplinks, 2 x SFP+ 10G uplink |
Misc Interfaces | 1 x 1GbE OOB management port via RJ-45 |
Cooling | Fans: Delta, 8x 40 x 40 x 28mm, 29 CFM / 2,400 in H2O static pressure, Forced convection via fans on front and rear of system |
Operating Temperature | 0°C to +50°C |
AGX Inference Server Spec Sheet
Loading...