Yeah I could setup a binary cache and maybe even Hydra to do that, might if I want it badly enough.
For now tried out Alpine Linux, but I don't really like OpenRC and their design choice of "when in doubt always install / ship less than required for stuff to work" already annoying me a lot.