Aegis-GPU7.3 NVIDIA technology for trust
NeMo Guardrails and confidential computing.
Key points
Guardrails are programmable rules around an AI app. Topical guardrails keep it on subject. Safety guardrails limit language and sources. DALI means the NVIDIA Data Loading Library.
What NVIDIA says (2)
“Topical guardrails ensure that chatbots stick to specific subjects.”
“is an open-source Python package for adding programmable guardrails to LLM-based applications.”
Data in use is data being processed in memory. Confidential computing protects it with hardware-based trusted execution environments (TEEs).
What NVIDIA says (1)
“Confidential computing secures AI workloads by encrypting application code, models, and data in use—not just at rest or in transit.”
Key terms
- NeMo Guardrails: An open-source package for programmable rules that check what goes into and out of an LLM app.
- Confidential computing: Protecting code, models and data while in use, with hardware trusted execution environments.
Sample question
Which NVIDIA tool lets you keep a multimodal chatbot on approved topics and set limits on its responses?
Show the answer
Answer: NeMo Guardrails
Guardrails are programmable rules around an AI app. Topical guardrails keep it on subject. Safety guardrails limit language and sources. DALI means the NVIDIA Data Loading Library.
What NVIDIA says (2)
“Topical guardrails ensure that chatbots stick to specific subjects.”
“is an open-source Python package for adding programmable guardrails to LLM-based applications.”