AI Agents to Transform Productivity with Knowledge Robots
AI agents are poised to transform productivity for the world’s billion knowledge workers with "knowledge robots" that can accomplish a variety of tasks. To develop AI agents, enterprises need to address critical concerns like trust, safety, security, and compliance.
NVIDIA NIM Microservices for AI Guardrails
New NVIDIA NIM microservices for AI guardrails – part of the NVIDIA NeMo Guardrails collection of software tools – are portable, optimized inference microservices that help companies improve the safety, precision, and scalability of their generative AI applications.
Central to the Orchestration of the Microservices
Central to the orchestration of the microservices is NeMo Guardrails, part of the NVIDIA NeMo platform for curating, customizing, and guardrailing AI. NeMo Guardrails helps developers integrate and manage AI guardrails in large language model (LLM) applications. Industry leaders Amdocs, Cerence AI, and Lowe’s are among those using NeMo Guardrails to safeguard AI applications.
Deployed in Customer Service
Developers can use the NIM microservices to build more secure, trustworthy AI agents that provide safe, appropriate responses within context-specific guidelines and are bolstered against jailbreak attempts. Deployed in customer service across industries like automotive, finance, healthcare, manufacturing, and retail, the agents can boost customer satisfaction and trust.
One of the New Microservices
One of the new microservices, built for moderating content safety, was trained using the Aegis Content Safety Dataset – one of the highest-quality, human-annotated data sources in its category. Curated and owned by NVIDIA, the dataset is publicly available on Hugging Face and includes over 35,000 human-annotated data samples flagged for AI safety and jailbreak attempts to bypass system restrictions.
NVIDIA NeMo Guardrails Keeps AI Agents on Track
AI is rapidly boosting productivity for a broad range of business processes. In customer service, it’s helping resolve customer issues up to 40% faster. However, scaling AI for customer service and other AI agents requires secure models that prevent harmful or inappropriate outputs and ensure the AI application behaves within defined parameters.
Industry Leaders and Partners Safeguard AI
NeMo Guardrails, available to the open-source community, helps developers orchestrate multiple AI software policies – called rails – to enhance LLM application security and control. It works with NVIDIA NIM microservices to offer a robust framework for building AI systems that can be deployed at scale without compromising on safety or performance.
Conclusion
NeMo Guardrails is open and extensible, offering integration with a robust ecosystem of leading AI safety model and guardrail providers, as well as AI observability and development tools. It supports integration with ActiveFence’s ActiveScore, which filters harmful or inappropriate content in conversational AI applications, and provides visibility, analytics, and monitoring.
FAQs
Q: What are NVIDIA NeMo Guardrails?
A: NVIDIA NeMo Guardrails is a collection of software tools for curating, customizing, and guardrailing AI, including NIM microservices that help companies improve the safety, precision, and scalability of their generative AI applications.
Q: What is the purpose of NeMo Guardrails?
A: The purpose of NeMo Guardrails is to help developers integrate and manage AI guardrails in large language model (LLM) applications, ensuring safe, appropriate, and trustworthy AI agents.
Q: Who is using NeMo Guardrails?
A: Industry leaders Amdocs, Cerence AI, and Lowe’s are among those using NeMo Guardrails to safeguard AI applications.
Q: What is NVIDIA Garak?
A: NVIDIA Garak is an open-source toolkit for LLM and application vulnerability scanning developed by the NVIDIA Research team.
Q: Where can I learn more about NeMo Guardrails?
A: Developers can get started building AI safeguards into AI agents for customer service using NeMo Guardrails with this tutorial.
