Title

Agent Workflow on OKE using NVIDIA NIMs

About Or Title

About This Workshop

Desc Long

Running Agent Workflow on Oracle Kubernetes Engine (OKE) is easier than you think. Oracle Cloud Infrastructure (OCI) provides a wide variety of GPU-enabled nodes, both virtual and bare metal, tailored to run as worker nodes in your Kubernetes cluster. These come pre-installed with NVIDIA drivers and device plugin daemonset, simplifying setup.
Agent Workflow running on OCI helps you to configure different AI models securely and automate different workflows in order to simplify them.

Workshop Length

3 hours

Outline

Lab 1 - Provision of resources to run JupyterHub Notebook
Lab 2 - Run Agent workflow

Prerequisites

- Administrative access to an OCI tenancy.
- Ability to spin-up A10 instances in OCI.
- Ability to create resources with Public IP addresses (Load Balancer, Instances, OKE API Endpoint).
- Access to HuggingFace.
- Accept CodeLlama7B HuggingFace model license agreement.
- Access to NGC Catalog for Llama3 and CuOpt NIMs.

Other Workshops you might like

Manage Quota and Schedule Priority in OKE

Manage Quota and Schedule Priority in OKE

The workshop will be about deploying Kueue and Kuberay in OKE and using them with jobs with (..)

3 hrs
League of Legends Machine Learning with OCI - Introduction to Neural Networks

League of Legends Machine Learning with OCI - Introduction to Neural Networks

Neural Networks are becoming increasingly popular in the AI/ML space, and people who don’t know (..)

1 hr, 30 mins 16367 Views
Implement Data Sharing with PL/SQL in Autonomous Database

Implement Data Sharing with PL/SQL in Autonomous Database

Learn how to implement data sharing with PL/SQL using Delta Sharing protocol. Data Sharing allows (..)

1 hr 21711 Views
League of Legends Machine Learning with OCI - Data Extraction

League of Legends Machine Learning with OCI - Data Extraction

In this workshop, we'll leverage the power of AI with League of Legends in a unique an innovative (..)

2 hrs 36925 Views