Key Learnings
Here’s how to build a great AI sales assistant.
Start with a user-friendly chat interface
Begin with an intuitive, multi-turn chat platform powered by a capable LLM such as Llama 3.1 70B. Layer enhancements like RAG and web search through Perplexity API for advanced functionality without compromising accessibility.
Optimize document ingestion
Implement extensive preprocessing combining rule-based deterministic string processing with LLM-based logic for translation and editing. This approach maximizes the value of retrieved documents, significantly improving performance.
Implement wide RAG for comprehensive coverage
Use documents retrieved from internal document and media databases and public-facing content available on the company website to accommodate diverse workflows and ensure comprehensive information delivery.
Balance latency and quality
Optimize response speed and relevance by using strategies like showing early search results during long-running tasks and providing visual feedback on the progress of the answer generation.
Prioritize data freshness and diversity
Perform daily updates by ingesting items from an internal sales document and media database and implement real-time connections to structured data.
Address integration challenges
Prepare for diverse data formats such as PDFs, slide decks, audio recordings, and video files by making use of NVIDIA Multimodal PDF Ingestion efficient parsing and Riva Automatic Speech Recognition transcription.
Developing an AI Sales Assistant
NVIDIA’s diverse portfolio, spanning LLMs, physics simulations, 3D rendering, and data science, challenges the Sales team to stay informed in the fast-paced AI market.
Architecture and Workflows
The AI sales assistant is designed for scalability, flexibility, and responsiveness, with the following core architectural components:
- LLM-assisted document ingestion pipeline
- Wide RAG integration
- Event-driven chat architecture
- Early progress indicators
Pitfalls and Trade-offs: Balancing Innovation with Usability
Developing the AI sales assistant presented several challenges that require thoughtful trade-offs to balance innovation and user experience:
- Latency and relevance
- Data recency
- Integration complexity
- Distributed workloads
Summary
Building the AI sales assistant for the NVIDIA Sales team was a rewarding technical challenge, offering valuable insights into designing scalable, AI-driven solutions. Using a RAG-based architecture, we integrated diverse knowledge sources, optimized query handling, and ensured high performance and accuracy, to meet the demands of a dynamic, data-intensive environment.
Conclusion
By combining advanced LLMs, structured workflows, and real-time data retrieval, the AI sales assistant empowers the Sales team with instant, tailored insights while significantly enhancing workflow efficiency and user engagement. This project serves as a blueprint for developers tackling complex decision-support systems in fast-paced domains.
FAQs
Q: What is the key benefit of using an AI sales assistant?
A: The AI sales assistant provides unified access to information, combining internal NVIDIA data with broader insights through the Perplexity API and web search.
Q: How does the AI sales assistant handle diverse data formats?
A: The AI sales assistant uses NVIDIA Multimodal PDF Ingestion efficient parsing and Riva Automatic Speech Recognition transcription to handle diverse data formats such as PDFs, slide decks, audio recordings, and video files.
Q: What is the trade-off between latency and quality in the AI sales assistant?
A: The AI sales assistant optimizes response speed and relevance by using strategies like showing early search results during long-running tasks and providing visual feedback on the progress of the answer generation.
Q: How does the AI sales assistant prioritize data freshness and diversity?
A: The AI sales assistant performs daily updates by ingesting items from an internal sales document and media database and implements real-time connections to structured data.
