Sign in to access this content and additional site features.
eIQ® GenAI Flow is a software pipeline designed to enable conversational AI on edge devices featuring i.MX application processors.
The pipeline integrates key components, including wake word detection, speech to text, RAG, LLM and text-to-speech synthesis. Retrieval-Augmented Generation (RAG) enhances the knowledge base of a Large Language Model (LLM) for a target domain, device or context.
RAG helps control the LLM’s behavior, mitigate hallucinations and customize responses based on examples. RAG involves injecting additional contextual information into the input prompt of the LLM, retrieved from a compact knowledge database stored on the edge device.
Learn more about NXP's voice solutions and contact us at voice@nxp.com