Native support for Sccache Remote Storage

Starting today BuildFetch Cache supports Sccache Remote Storage allowing long compilation tasks to be cached and reused across machines.

Sccache includes support for caching the compilation of Rust, Assembler, C/C++, NVIDIA CUDA through nvcc and clang, and AMD ROCm HIP for AI and ML.

https://github.com/mozilla/sccache#sccache---shared-compilation-cache

Free for Open Source projects.

---

Technicalities

BuildFetch Cache now implements the Sccache WebDAV remote storage protocol and storage schema.

BuildFetch Cache act as a Sccache HTTP remote storage backend in both Cloud and On-Premise deployments, with distributed In-memory → NVMe → SSD storage.

How We Verify It

Whenever we add support for a new build cache protocol or toolchain, we validate it with unit tests for network and DB code, integration tests for storage code, and end-to-end tooling coverage.

For Sccache we have end-to-end test suite that:

1. Spins up BuildFetch Cache in Kubernetes cluster
2. Creates Sccache project
3. Sets up source code, stable version of Sccache and clang
4. Runs Sccache build twice with --show-stats --stats-format=json so we could analyze the Sccache stats report on cache hits, compiles, etc
5. Verifies that first Sccache build uploaded expected cache entries to BuildFetch Cache
6. Verifies that the second Ccache run got 100% cache hit that we verify both in our backend and in Sccache output.

Such test coverage protects Sccache compatibility whenever we touch the related protocol or storage code in the BuildFetch monorepo.

See Configure Sccache Remote Storage for detailed configuration instructions.

Product Perspective

BuildFetch is moving quickly towards being a single cache system for the full stack: Backend, ML / AI, Frontend & Mobile.

Sccache is one more step in that direction, and we are working hard on adding more protocols.

Kind regards, Tommy Zinnatullin. CEO & Founder of BuildFetch Inc.