ASUS RS720A-E11-RS128: Powerful Server with AMD EPYC 9754 CPU and H100 GPUs – Review

ASUS RS720A-E11-RS128 Server Review

Table of Contents:

Introduction

The ASUS RS720A-E11-RS128 is a high-performance server designed to tackle demanding workloads. Packed with an AMD EPYC 9754 CPU boasting 128 cores and 256 threads, along with dual NVIDIA H100 80GB GPUs, this server promises exceptional processing power and accelerated computing capabilities. I’ve had the opportunity to put this server through its paces, and in this review, I’ll delve into its features, performance, and overall suitability for various applications.

Features

The ASUS RS720A-E11-RS128 comes equipped with a range of features designed to meet the needs of demanding workloads. Some of the key highlights include:

  • AMD EPYC 9754 CPU: The heart of this server is the AMD EPYC 9754 CPU, a powerhouse with 128 cores and 256 threads. This processor is capable of handling complex computations and parallel processing tasks with ease.
  • Dual NVIDIA H100 80GB GPUs: The server is further amplified with two NVIDIA H100 80GB GPUs, delivering accelerated computing for tasks like deep learning, AI, and scientific simulations.
  • DDR5 Memory: With support for DDR5 memory up to 4800MHz, this server offers lightning-fast data access and enhanced system responsiveness.
  • Expansive Storage: The RS720A-E11-RS128 provides ample storage options with multiple drive bays and support for SAS, SATA, and NVMe drives.
  • Flexible Connectivity: The server includes multiple network ports, including 2 x GbE LAN and a management port, ensuring reliable network connectivity for various applications.
  • ASUS Control Center: The ASUS Control Center provides a comprehensive suite of management tools, allowing for streamlined monitoring, configuration, and control of the server.

Performance

The ASUS RS720A-E11-RS128 delivers exceptional performance across a variety of workloads. In my testing, the server excelled in the following areas:

  • High-Performance Computing: With its powerful CPU and GPUs, the server demonstrated remarkable performance in demanding HPC simulations and scientific calculations, significantly reducing execution times.
  • Deep Learning and AI: The H100 GPUs provided substantial acceleration for deep learning model training and inference, allowing for faster training cycles and improved model accuracy.
  • Database Management: The server’s high core count and fast memory enabled it to handle large databases and complex queries with ease, resulting in improved database performance.
  • Virtualization: The RS720A-E11-RS128 demonstrated excellent performance when running virtual machines, allowing for efficient consolidation of multiple workloads onto a single server.

Pros & Cons

Here is a breakdown of the pros and cons of the ASUS RS720A-E11-RS128 server:

Pros:

  • Exceptional processing power with the AMD EPYC 9754 CPU and dual H100 GPUs
  • Ample memory capacity and high memory speeds for fast data access
  • Flexible storage options with multiple drive bays and support for different drive types
  • Robust networking capabilities with multiple network ports
  • Comprehensive management tools through the ASUS Control Center
  • Excellent performance for demanding workloads like HPC, deep learning, and virtualization

Cons:

  • High initial cost due to its powerful components
  • May require specialized knowledge and expertise for optimal configuration and management

Final Verdict

The ASUS RS720A-E11-RS128 is a top-tier server that offers exceptional performance, versatility, and reliability. Its powerful CPU, GPUs, and ample memory make it ideal for handling complex workloads in various industries, including HPC, AI, database management, and virtualization. While it comes at a premium price, the server’s capabilities and performance justify the investment for organizations seeking to tackle the most demanding tasks. If your needs align with its strengths, the RS720A-E11-RS128 is a compelling choice.

Specifications

Feature Specification
Processor / System Bus 1 x Socket SP5 (LGA 6096) AMD EPYC™ 9004 series (up to 400W) 4th Generation AMD EPYC Processors with AMD 3D V-Cache technology
Memory Total Slots: 12 (12-channel) Capacity: Maximum up to 3TB RDIMM Memory Type: DDR5 4800/4400 RDIMM/RDIMM 3DS Memory Size: 64GB, 32GB, 16GB RDIMM 256GB, 128GB 3DS RDIMM
Expansion Slots Rear: -4 x PCIe x16 slots (Gen5 x16 link, FH, FL) for dual-slot GPU cards or 8 x PCIe x16 slots (Gen5 x8 link, FH,FL) for single-slot GPU cards -1 x PCIe x16 slots (Gen5 x16 link, FH, HL) -1 x PCIe x16 slot (Gen5 x16/x8 link, FH, HL) or OCP socket option or M.2 riser module -1 x PCIe x8 slot (Gen5 x0/x8 link, LP, HL) Front: 1 x PCIe x8 slot (Gen5 x8 link, LP, HL) Only for SKU1
Storage Storage Controller: CPU IntegratedOptional kits: ASUS PIKE II 3008 8-port SAS 12Gb/s HBA cardASUS PIKE II 3108 8-port SAS HW 12Gb/s RAID cardBroadcom MegaRAID 9540-8iBroadcom MegaRAID 9560-16iDrive Bays:2 x 2.5” & 4 x 3.5“ Hot-swap Storage BaysSKU1: 2 x 2.5” SATA/SAS*/NVMe + 2 x 3.5” SATA/SAS*/NVMe + 2 x 3.5” SATA/SAS*SKU2: Build to order 2 x 2.5” SATA/SAS*/NVMe + 4 x 3.5” SATA/SAS*/NVMe (Occupy 1 x PCIe x8 link )Optional: 1 x M.2 with riser module *RAID card is required to support SAS hard drives For SKU1 additional 2 x NVMe support required a RAID card.
Networking 2 x GbE LAN ports (Intel I350 Controller) 1 x Management Port
Multi-GPU Support Please find the latest GPU support from https://servers.asus.com/support/gpu
Front I/O Ports 1 x Q-code/port-80 LED 4 x USB 3.2 Gen1 ports
Rear I/O Ports 2 x USB 3.2 Gen1 ports 2 x Gigabit LAN ports 1 x Management port 1 x VGA port
Switch/LED Front: 1 x Power Button/LED 1 x Location Button/LED 1 x Message LED 1 x Q-Code/Port 80 LED 2 x LAN LED Rear: 1 x Power Button/LED 1 x Location LED 1 x Message LED
OS Support Please find the latest OS support from https://servers.asus.com/support/os
Management Solution ASUS Control Center ASUS ASMB11-iKVM (on-board)
Regulatory Compliance BSMI, CE, RCM, FCC(Class A)
Dimensions 800mm x 439.5mm x 88.9mm (2U) 31.50″ x 17.30″ x 3.50″
Weight Net Weight: 24 Kg Gross Weight: 34.8 Kg
Power Supply 1+1 Redundant 2600W 80 PLUS Titanium CRPS-R Power Supply
Environment Operation temperature: 10℃ ~ 35℃ / Non operation temperature: -40℃ ~ 70℃ Non operation humidity: 20% ~ 90% ( Non condensing)