Skip to Main Content
Agent Workflow on OKE using NVIDIA NIMs

About This Workshop

Youtube Video

About This Workshop
Running Agent Workflow on Oracle Kubernetes Engine (OKE) is easier than you think. Oracle Cloud Infrastructure (OCI) provides a wide variety of GPU-enabled nodes, both virtual and bare metal, tailored to run as worker nodes in your Kubernetes cluster. These come pre-installed with NVIDIA drivers and device plugin daemonset, simplifying setup.
Agent Workflow running on OCI helps you to configure different AI models securely and automate different workflows in order to simplify them.

Workshop Info

3 hours
  • Lab 1 - Provision of resources to run JupyterHub Notebook
  • Lab 2 - Run Agent workflow

- Administrative access to an OCI tenancy.
- Ability to spin-up A10 instances in OCI.
- Ability to create resources with Public IP addresses (Load Balancer, Instances, OKE API Endpoint).
- Access to HuggingFace.
- Accept CodeLlama7B HuggingFace model license agreement.
- Access to NGC Catalog for Llama3 and CuOpt NIMs.

Other Workshops you might like