← Back to Chat
System Architecture
graph TD
subgraph Local_Workstation
Dev[Developer]
TF[Terraform CLI]
Code[Source Code]
end
subgraph GCP
subgraph Build_Artifacts
CB[Cloud Build]
AR[Artifact Registry]
end
subgraph Storage
GCS[GCS Bucket]
end
subgraph GKE_Cluster
LB[Load Balancer]
subgraph App_Pod
UI[Chat UI Container]
end
subgraph GPU_Pod
VLLM_SVC[vllm Service]
VLLM[vLLM Server]
end
end
end
Dev -->|1. Edit Code| Code
Dev -->|2. Update Version & Apply| TF
TF -->|3. Triggers Build| CB
Code -.->|Source| CB
CB -->|4. Push Image| AR
TF -->|5. Update Deployment| UI
User((User)) -->|HTTP| LB
LB --> UI
UI -->|Internal API| VLLM_SVC
VLLM_SVC --> VLLM
VLLM -->|Mounts Weights| GCS
UI -.->|Pulls Image| AR
VLLM -.->|Pulls vLLM Image| AR