1.7 Validating installed hardware

Q: Without logging into the OS, where can you see each GPU's VBIOS version and number of retired pages on a DGX H100?

The BMC web interface's GPU Information page.. Validating installed hardware means checking that every part is present and reports sane values. The BMC works out-of-band. Its GPU Information page lists each GPU's GUID, VBIOS version, InfoROM version and retired pages. Retired pages are memory pages the GPU has stopped using because of errors.

NCP-AII · System and Server Bring-up (31% of the exam) · Official objective: “Validate installed hardware.”

Checking health with NVSM and the BMC after install, including the expected RAID re-sync.

Key points

Validating installed hardware means checking that every part is present and reports sane values. The BMC works out-of-band. Its GPU Information page lists each GPU's GUID, VBIOS version, InfoROM version and retired pages. Retired pages are memory pages the GPU has stopped using because of errors.
What NVIDIA says (1)
“Provides basic information on all the GPUs in the systems, including GUID, VBIOS version, InfoROM version, and number of retired pages for each GPU.”
— DGX H100/H200 User Guide: Using the BMC
RAID 1 keeps two identical copies of a drive. After first boot it rebuilds the mirror. This is expected. nvsm reports a warning until the rebuild ends.
What NVIDIA says (2)
“During this time, running the nvsm show health command reports a warning that the RAID volume is re-syncing.”
— DGX H100/H200 User Guide: First Boot Setup
“The process can take an hour to complete.”
— DGX H100/H200 User Guide: First Boot Setup
The BMC web UI lets you check hardware without logging in to the OS. The Sensor page shows readings. The GPU Information page shows each GPU's VBIOS and InfoROM version and its retired pages.
What NVIDIA says (2)
“Provides status and readings for system sensors, such as SSD, PSUs, voltages, CPU temperatures, DIMM temperatures, and fan speeds.”
— DGX H100/H200 User Guide: Using the BMC
“Provides basic information on all the GPUs in the systems, including GUID, VBIOS version, InfoROM version, and number of retired pages for each GPU.”
— DGX H100/H200 User Guide: Using the BMC

Key terms

Baseboard management controller: A small computer on the server board that lets you power, monitor and configure the system over the network, even when the OS is down.
NVIDIA System Management: The DGX tool that reports system health and runs stress tests from one command line.
RAID 1: A disk setup that keeps two identical copies of a drive, so the OS survives one drive failing.

Sample question

Without logging into the OS, where can you see each GPU's VBIOS version and number of retired pages on a DGX H100?

Show the answer

Answer: The BMC web interface's GPU Information page.

Validating installed hardware means checking that every part is present and reports sane values. The BMC works out-of-band. Its GPU Information page lists each GPU's GUID, VBIOS version, InfoROM version and retired pages. Retired pages are memory pages the GPU has stopped using because of errors.

What NVIDIA says (1)

“Provides basic information on all the GPUs in the systems, including GUID, VBIOS version, InfoROM version, and number of retired pages for each GPU.”
— DGX H100/H200 User Guide: Using the BMC

Practice 1.7 (3 questions) Full System and Server Bring-up guide

← 1.6 Installing GPU servers · 1.8 Cable types and transceivers →