Workflow · Production
LLMOps: Developing, Operating, and Securing LLMs in the Enterprise — Cisco at DevOps Enterprise Summit Las Vegas 2023
The problem
Many aspects of LLMs make existing DevOps workflows difficult, leaving enterprise teams without a clear model for continuously delivering, monitoring, securing, and operating LLM-powered applications.
Workflow diagram · grounded in source
1
New LLMOps deployment pipeline
output
“new deployment pipeline for this new technological paradigm”
2
Continuous delivery, monitoring, and security
validation
“continuously deliver, monitor, secure and go on-call for LLM-powered applications”
Reported outcome
(not stated)
Frequently asked questions
What did this team achieve with this AI workflow?
(not stated)
How is this workflow AI workflow structured?
New LLMOps deployment pipeline → Continuous delivery, monitoring, and security.