Large language models face various security threats including prompt injection, jailbreaking, and data exfiltration. A proxy-based defense architecture with policy engines can protect against these attacks by intercepting requests and responses before they reach the LLM. This approach uses AI models like LlamaGuard to detect
•14m watch time
Sort: