Use hut as binary cache #89

abonerib · 2025-02-26T16:51:45+01:00

abonerib commented

2025-02-26 16:51:45 +01:00

This fixes the ngnix path to the binary cache and adds https://jungle.bsc.es/cache as a substituter to other nodes.

closes #77

TODOs

Bypass nginx, bind nix-serve to 0.0.0.0 and use http://xeon07:5000?
Consider using a replacement for nix-serve:
- nix-serve-ng (haskell, drop-in replacement, they claim to outperform harmonia)
- harmonia (rust, more active, but requires separate configuration)
Add post build hook to upload builds to cache?

Links:

This fixes the ngnix path to the binary cache and adds `https://jungle.bsc.es/cache` as a substituter to other nodes. closes #77 ### TODOs - [ ] Bypass nginx, bind `nix-serve` to `0.0.0.0` and use `http://xeon07:5000`? - [ ] Consider using a replacement for [nix-serve](https://github.com/edolstra/nix-serve): - [nix-serve-ng](https://github.com/aristanetworks/nix-serve-ng) (haskell, drop-in replacement, they claim to outperform harmonia) - [harmonia](https://github.com/nix-community/harmonia) (rust, more active, but requires separate configuration) - [ ] Add post build hook to upload builds to cache? --- Links: - https://nix.dev/guides/recipes/add-binary-cache#custom-binary-cache - https://nix.dev/tutorials/nixos/binary-cache-setup - https://nix.dev/guides/recipes/post-build-hook#post-build-hooks

abonerib added the

config

nix

labels 2025-02-26 16:51:45 +01:00

abonerib added 3 commits 2025-02-26 16:51:46 +01:00

Fix nginx /cache regex 5d549df767

`nix-serve` does not handle duplicates in the path:
```
hut$ curl http://127.0.0.1:5000/nix-cache-info
StoreDir: /nix/store
WantMassQuery: 1
Priority: 30
hut$ curl http://127.0.0.1:5000//nix-cache-info
File not found.
```

This meant that the cache was not accessible via:
`curl https://jungle.bsc.es/cache/nix-cache-info` but
`curl https://jungle.bsc.es/cachenix-cache-info` worked.

Add module to use hut as a binary substituter 6fac30abc4

Use hut-substituter module in owl{1,2} and raccoon b26aa2aa23

abonerib force-pushed 77-hut-cache from b26aa2aa23 to 982fc647cf

2025-02-26 16:52:08 +01:00

Compare

rarias commented

2025-02-26 17:17:52 +01:00

This fixes the ngnix path to the binary cache and adds https://jungle.bsc.es/cache as a substituter to other nodes.

Thanks, let's wait until the temperature situation is under control to test this.

closes #77

TODOs

Bypass nginx, bind nix-serve to 0.0.0.0 and use http://xeon07:5000?

Yeah, but use hut as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit).

Consider using a replacement for nix-serve:

nix-serve-ng (haskell, drop-in replacement, they claim to outperform harmonia)

harmonia (rust, more active, but requires separate configuration)

I don't mind much, but I would wait for it to be a problem, and hopefully something that doesn't bring a gigantic closure.

Add post build hook to upload builds to cache?

I would say not for now.

Can we also add the cache entry in the hut website page? So other users can add it to their local config.

> This fixes the ngnix path to the binary cache and adds `https://jungle.bsc.es/cache` as a substituter to other nodes. Thanks, let's wait until the temperature situation is under control to test this. > > closes #77 > > ### TODOs > > - [ ] Bypass nginx, bind `nix-serve` to `0.0.0.0` and use `http://xeon07:5000`? Yeah, but use `hut` as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit). > - [ ] Consider using a replacement for [nix-serve](https://github.com/edolstra/nix-serve): > - [nix-serve-ng](https://github.com/aristanetworks/nix-serve-ng) (haskell, drop-in replacement, they claim to outperform harmonia) > - [harmonia](https://github.com/nix-community/harmonia) (rust, more active, but requires separate configuration) I don't mind much, but I would wait for it to be a problem, and hopefully something that doesn't bring a gigantic closure. > - [ ] Add post build hook to upload builds to cache? I would say not for now. Can we also add the cache entry in the hut website page? So other users can add it to their local config.

abonerib added 1 commit 2025-02-26 18:22:49 +01:00

Add instructions on how to use the cache in the web 05d57602c4

abonerib force-pushed 77-hut-cache from 05d57602c4 to 5cd8372c4c

2025-02-26 18:26:00 +01:00

Compare

abonerib commented

2025-02-26 18:43:26 +01:00

Yeah, but use hut as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit).

Seems that raccoon can't access hut directly, I'll leave it as jungle.bsc.es for now.

raccoon$ ssh hut
ssh: Could not resolve hostname hut: Name or service not known

Can we also add the cache entry in the hut website page? So other users can add it to their local config.

I have added it in a separate file and referenced it in the hut page. I have added the page in /cache which may conflict with the nginx proxy, I'll have to test it.

> Yeah, but use hut as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit). Seems that raccoon can't access `hut` directly, I'll leave it as `jungle.bsc.es` for now. ``` raccoon$ ssh hut ssh: Could not resolve hostname hut: Name or service not known ``` > Can we also add the cache entry in the hut website page? So other users can add it to their local config. I have added it in a separate file and referenced it in the hut page. I have added the page in `/cache` which may conflict with the nginx proxy, I'll have to test it.

rarias commented

2025-04-03 18:32:50 +02:00

Seems that raccoon can't access hut directly, I'll leave it as jungle.bsc.es for now.

I'll need to check later which path involves less hops. For now let's use jungle.bsc.es.

I have added it in a separate file and referenced it in the hut page. I have added the page in /cache which may conflict with the nginx proxy, I'll have to test it.

I would prefer the doc to live in another place, so the confusion cannot arise. Maybe we can just append it to the hut page, after all this service is provided by hut only.

I can test this, but only after merging the other PR, as there are a lot of changes pending and I need to rebase this over them.

> Seems that raccoon can't access `hut` directly, I'll leave it as `jungle.bsc.es` for now. I'll need to check later which path involves less hops. For now let's use jungle.bsc.es. > I have added it in a separate file and referenced it in the hut page. I have added the page in `/cache` which may conflict with the nginx proxy, I'll have to test it. I would prefer the doc to live in another place, so the confusion cannot arise. Maybe we can just append it to the hut page, after all this service is provided by hut only. I can test this, but only after merging the other PR, as there are a lot of changes pending and I need to rebase this over them.

abonerib force-pushed 77-hut-cache from 5cd8372c4c to f940ad646b

2025-04-08 16:20:02 +02:00

Compare

abonerib added 1 commit 2025-04-08 16:43:22 +02:00

Add documentation section with commands to query the cache 58ce0e4445

abonerib changed title from ~~WIP: Use hut as binary cache~~ to Use hut as binary cache

2025-04-08 16:45:38 +02:00

rarias force-pushed 77-hut-cache from 58ce0e4445 to 3590879c17

2025-04-08 17:50:20 +02:00

Compare

abonerib added 1 commit 2025-04-08 18:30:30 +02:00

make hut cache a trusted substituter f4eb5f27d3

abonerib force-pushed 77-hut-cache from f4eb5f27d3 to 70a6d2e644

2025-04-11 11:11:28 +02:00

Compare

rarias force-pushed 77-hut-cache from 70a6d2e644 to fc2367f909

2025-04-11 12:02:08 +02:00

Compare

rarias force-pushed 77-hut-cache from fc2367f909 to 8834d561d2

2025-04-15 14:09:10 +02:00

Compare

rarias manually merged commit 8834d561d2 into master

2025-04-15 14:10:06 +02:00

rarias referenced this pull request

2025-04-15 17:12:22 +02:00

Enable nix cache server #77

Sign in to join this conversation.

2 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: rarias/jungle#89