Sticky Disks
Learn about how sticky disks can speed up your workloads
useblacksmith/stickydisk is a GitHub Action that helps persist state written to disk across jobs. This action can serve as a superior alternative to the Actions cache, especially when the cache artifacts are extremely large. Each sticky disk is hot-loaded into the runner and mounted at the specified path. The sticky disk is formatted as an ext4 filesystem.
Cache Performance Comparison
Caching Solution | Cache Size | Average Download Speed | Time to Access |
---|---|---|---|
GitHub Actions Cache | 6GB | 90 MB/s | ~1m6s |
Blacksmith Cache | 6GB | 400 MB/s | ~15s |
Sticky Disks | 6GB | N/A | 3 seconds |
Use Cases
NPM Package Caching
Node.js projects can have extensive dependency trees, leading to large node_modules
directories. Sticky disks provide persistent, high-performance storage for your NPM packages.
Bazel Build Caching
Bazel’s remote cache can significantly improve build times, but uploading and downloading cached artifacts can still be a bottleneck. Using sticky disks with Blacksmith runners provides near-instant access to your Bazel caches as they are bind mounted into your runners on demand. Our useblacksmith/setup-bazel@v2
action is a zero-confg way to use sticky disks to store the disk, repository, and external cache.
How it works
Blacksmith stores sticky disk artifacts in a secure, highly performant Ceph cluster, running on local NVMe drives. Our runners proxy their requests through our Storage Agents to interact with the Ceph cluster. Each sticky disk is uniquely identified by a key. When a GitHub Action job requests a sticky disk, the last committed snapshot will be cloned and mounted into the runner at the specified path. Once the job completes, the sticky disk will be unmounted and committed for future invocations. At the moment, customers can use up to 5 sticky disks in a single GitHub Action job.