Workflow · Production

LLMOps: Developing, Operating, and Securing LLMs in the Enterprise — Cisco at DevOps Enterprise Summit Las Vegas 2023

The problem

Many aspects of LLMs make existing DevOps workflows difficult, leaving enterprise teams without a clear model for continuously delivering, monitoring, securing, and operating LLM-powered applications.

Workflow diagram · grounded in source
1
New LLMOps deployment pipeline
output
“new deployment pipeline for this new technological paradigm”
2
Continuous delivery, monitoring, and security
validation
“continuously deliver, monitor, secure and go on-call for LLM-powered applications”
Reported outcome

(not stated)

Source
https://videos.itrevolution.com/watch/873538323
Read source ↗

Frequently asked questions

What did this team achieve with this AI workflow?

(not stated)

How is this workflow AI workflow structured?

New LLMOps deployment pipeline → Continuous delivery, monitoring, and security.