Secure LLM inference: enforce access control on confidential data
Explore an adapter-based secure inference framework that uses LoRA adapters, policy-based routing, and role-aware authorization to protect confidential enterprise data during LLM inference
By Dasari Surya Sai Venkatesh, Pavani Penumalla, Pravein G. Kannan, Arun Kumar