RedAI Usage Guide

Student Quick Start

1. Request a RedAI API key from your instructor or TA.
2. Sign in at http://femianjc-gpu.csi.miamioh.edu:9000/ui/ using your campus credentials.
3. Use the key with any OpenAI-compatible client. Base URL: http://femianjc-gpu.csi.miamioh.edu:9000/v1
4. Try the models in Colab or VSCode using this snippet:

pip install openai
from openai import OpenAI
client = OpenAI(
    api_key="sk-YOUR-STUDENT-KEY",
    base_url="http://femianjc-gpu.csi.miamioh.edu:9000/v1",
)
resp = client.chat.completions.create(
    model="classroom-text",
    messages=[{"role": "user", "content": "Summarize Newton's laws in one sentence."}],
    max_tokens=200,
)
print(resp.choices[0].message.content)

Model Notes

• classroom-text – Qwen2.5-7B-Instruct, ~16K token context.
• classroom-vision – Qwen2.5-VL-7B-Instruct, ~16K token context. Send images via image_url or inline data:image....

curl http://femianjc-gpu.csi.miamioh.edu:9000/v1/chat/completions \
  -H "Authorization: Bearer sk-YOUR-KEY" \
  -H "Content-Type: application/json" \
  -d '{
        "model": "classroom-vision",
        "messages": [
          {"role": "user", "content": [
            {"type": "text", "text": "Describe this image."},
            {"type": "image_url", "image_url": {"url": "data:image/png;base64,..."}}
          ]}
        ]
      }'

Instructor Workflow

1. Request master access from Dr. John Femiani.
2. Log into the same portal (/ui/). Your role unlocks admin features.
3. Go to Teams and create a team per course (e.g., CSE434-Spring25), set a virtual budget, and choose allowed models.
4. Populate the team using the Internal Users area: use Bulk Invite for whole-class CSVs or Invite User for single students.
5. Monitor spend and revoke keys if budget is exceeded.

Team & Student Import (CSV)

Inside the LiteLLM dashboard:

1. Open Teams. Create a team for your class if it does not already exist.
2. Switch to Internal Users and click Bulk Invite. LiteLLM will download a template CSV with the required headers (user_id,user_alias,user_email).
3. Fill in the CSV (example below) and upload it back through the same dialog. For single enrollments, use Invite User instead.
4. When prompted, set Global Proxy Role to Internal User and Personal Key Creation to All Proxy Models so students can mint their own keys against the classroom models.

With SMTP configured, LiteLLM emails both individual invites and CSV imports automatically. If mail is temporarily unavailable, the UI will still show each invite link so you can copy/paste it into an email or Canvas announcement.

user_id,user_alias,user_email
sax123,Alex Smith,alex@example.edu
sby456,Briar Young,briar@example.edu

After uploading, the invited students receive email links to the LiteLLM portal where they can claim their accounts and generate keys.