Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
khluu authored Sep 26, 2024
1 parent d5a1939 commit bd49520
Showing 1 changed file with 8 additions and 5 deletions.
13 changes: 8 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,10 @@
# vLLM's Buildkite Cluster
# vLLM CI

This repo contains code to bootstrap vLLM's CI cluster running on GCP for Buildkite.
It contains terraform code to create a GCE instance group, a GKE cluster, and a GAR container registry.
The GKE cluster is configured to scale to zero with node pools of L4 and 2xL4 nodes.
This repo contains infrastructure and bootstrap code for vLLM Buildkite pipeline.

The GKE cluster is connected to Buildkite via the [Buildkite Agent Stack for K8s](https://github.com/buildkite/agent-stack-k8s#readme).
Currently, the CI infrastructure contains the following:
- Buildkite Elastic CI stack on AWS: see `infra/aws`
- 8 TPU nodes: see `infra/gcp_old`
- 1 GKE cluster (currently not in use): see `infra/gcp`

The bootstrap scripts are located in `scripts/`

0 comments on commit bd49520

Please sign in to comment.