GenAI Infrastructure for Allen School Courses
Introduction text here
Goals
Enumerate goals and constraints
Bicameral approach
On-prem Commercial services Frontend Request Router
Advantages of this approach
Fall Pilot
Courses:
- Vibe coding
- X
- Y
- Z
Data to be collected:
-
Cost per student per course
- Tokens
- Dollars
- Model usage patterns and preferences
-
On-prem system load
- Do we have enough capacity?
- How much more do we need?
I will share what we learn in future posts.