rarias/jungle
rarias/jungle
2
0
Fork 3
Code Issues 53 Pull Requests 10 Actions Packages Projects Releases Wiki Activity

Use hut as binary cache #89

Manually merged
rarias merged 5 commits from abonerib/jungle:77-hut-cache into master 2025-04-15 14:10:06 +02:00
Conversation 3 Commits 5 Files Changed 8 +135 -3
abonerib commented 2025-02-26 16:51:45 +01:00
Collaborator
Copy Link

This fixes the ngnix path to the binary cache and adds https://jungle.bsc.es/cache as a substituter to other nodes.

closes #77

TODOs

  • Bypass nginx, bind nix-serve to 0.0.0.0 and use http://xeon07:5000?
  • Consider using a replacement for nix-serve:
    • nix-serve-ng (haskell, drop-in replacement, they claim to outperform harmonia)
    • harmonia (rust, more active, but requires separate configuration)
  • Add post build hook to upload builds to cache?

Links:

This fixes the ngnix path to the binary cache and adds `https://jungle.bsc.es/cache` as a substituter to other nodes. closes #77 ### TODOs - [ ] Bypass nginx, bind `nix-serve` to `0.0.0.0` and use `http://xeon07:5000`? - [ ] Consider using a replacement for [nix-serve](https://github.com/edolstra/nix-serve): - [nix-serve-ng](https://github.com/aristanetworks/nix-serve-ng) (haskell, drop-in replacement, they claim to outperform harmonia) - [harmonia](https://github.com/nix-community/harmonia) (rust, more active, but requires separate configuration) - [ ] Add post build hook to upload builds to cache? --- Links: - https://nix.dev/guides/recipes/add-binary-cache#custom-binary-cache - https://nix.dev/tutorials/nixos/binary-cache-setup - https://nix.dev/guides/recipes/post-build-hook#post-build-hooks
abonerib added the
config
nix
 labels 2025-02-26 16:51:45 +01:00
abonerib added 3 commits 2025-02-26 16:51:46 +01:00 
`nix-serve` does not handle duplicates in the path:
```
hut$ curl http://127.0.0.1:5000/nix-cache-info
StoreDir: /nix/store
WantMassQuery: 1
Priority: 30
hut$ curl http://127.0.0.1:5000//nix-cache-info
File not found.
```

This meant that the cache was not accessible via:
`curl https://jungle.bsc.es/cache/nix-cache-info` but
`curl https://jungle.bsc.es/cachenix-cache-info` worked.
abonerib force-pushed 77-hut-cache from b26aa2aa23 to 982fc647cf 2025-02-26 16:52:08 +01:00 Compare
rarias commented 2025-02-26 17:17:52 +01:00
Owner
Copy Link

This fixes the ngnix path to the binary cache and adds https://jungle.bsc.es/cache as a substituter to other nodes.

Thanks, let's wait until the temperature situation is under control to test this.

closes #77

TODOs

  • Bypass nginx, bind nix-serve to 0.0.0.0 and use http://xeon07:5000?

Yeah, but use hut as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit).

  • Consider using a replacement for nix-serve:
    • nix-serve-ng (haskell, drop-in replacement, they claim to outperform harmonia)
    • harmonia (rust, more active, but requires separate configuration)

I don't mind much, but I would wait for it to be a problem, and hopefully something that doesn't bring a gigantic closure.

  • Add post build hook to upload builds to cache?

I would say not for now.

Can we also add the cache entry in the hut website page? So other users can add it to their local config.

> This fixes the ngnix path to the binary cache and adds `https://jungle.bsc.es/cache` as a substituter to other nodes. Thanks, let's wait until the temperature situation is under control to test this. > > closes #77 > > ### TODOs > > - [ ] Bypass nginx, bind `nix-serve` to `0.0.0.0` and use `http://xeon07:5000`? Yeah, but use `hut` as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit). > - [ ] Consider using a replacement for [nix-serve](https://github.com/edolstra/nix-serve): > - [nix-serve-ng](https://github.com/aristanetworks/nix-serve-ng) (haskell, drop-in replacement, they claim to outperform harmonia) > - [harmonia](https://github.com/nix-community/harmonia) (rust, more active, but requires separate configuration) I don't mind much, but I would wait for it to be a problem, and hopefully something that doesn't bring a gigantic closure. > - [ ] Add post build hook to upload builds to cache? I would say not for now. Can we also add the cache entry in the hut website page? So other users can add it to their local config.
abonerib added 1 commit 2025-02-26 18:22:49 +01:00
abonerib force-pushed 77-hut-cache from 05d57602c4 to 5cd8372c4c 2025-02-26 18:26:00 +01:00 Compare
abonerib commented 2025-02-26 18:43:26 +01:00
Author
Collaborator
Copy Link

Yeah, but use hut as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit).

Seems that raccoon can't access hut directly, I'll leave it as jungle.bsc.es for now.

raccoon$ ssh hut
ssh: Could not resolve hostname hut: Name or service not known

Can we also add the cache entry in the hut website page? So other users can add it to their local config.

I have added it in a separate file and referenced it in the hut page. I have added the page in /cache which may conflict with the nginx proxy, I'll have to test it.

> Yeah, but use hut as xeon07 is the old name. We still need the nginx forward to use it from the outside (replit). Seems that raccoon can't access `hut` directly, I'll leave it as `jungle.bsc.es` for now. ``` raccoon$ ssh hut ssh: Could not resolve hostname hut: Name or service not known ``` > Can we also add the cache entry in the hut website page? So other users can add it to their local config. I have added it in a separate file and referenced it in the hut page. I have added the page in `/cache` which may conflict with the nginx proxy, I'll have to test it.
rarias commented 2025-04-03 18:32:50 +02:00
Owner
Copy Link

Seems that raccoon can't access hut directly, I'll leave it as jungle.bsc.es for now.

I'll need to check later which path involves less hops. For now let's use jungle.bsc.es.

I have added it in a separate file and referenced it in the hut page. I have added the page in /cache which may conflict with the nginx proxy, I'll have to test it.

I would prefer the doc to live in another place, so the confusion cannot arise. Maybe we can just append it to the hut page, after all this service is provided by hut only.

I can test this, but only after merging the other PR, as there are a lot of changes pending and I need to rebase this over them.

> Seems that raccoon can't access `hut` directly, I'll leave it as `jungle.bsc.es` for now. I'll need to check later which path involves less hops. For now let's use jungle.bsc.es. > I have added it in a separate file and referenced it in the hut page. I have added the page in `/cache` which may conflict with the nginx proxy, I'll have to test it. I would prefer the doc to live in another place, so the confusion cannot arise. Maybe we can just append it to the hut page, after all this service is provided by hut only. I can test this, but only after merging the other PR, as there are a lot of changes pending and I need to rebase this over them.
abonerib force-pushed 77-hut-cache from 5cd8372c4c to f940ad646b 2025-04-08 16:20:02 +02:00 Compare
abonerib added 1 commit 2025-04-08 16:43:22 +02:00
abonerib changed title from WIP: Use hut as binary cache to Use hut as binary cache 2025-04-08 16:45:38 +02:00
rarias force-pushed 77-hut-cache from 58ce0e4445 to 3590879c17 2025-04-08 17:50:20 +02:00 Compare
abonerib added 1 commit 2025-04-08 18:30:30 +02:00
abonerib force-pushed 77-hut-cache from f4eb5f27d3 to 70a6d2e644 2025-04-11 11:11:28 +02:00 Compare
rarias force-pushed 77-hut-cache from 70a6d2e644 to fc2367f909 2025-04-11 12:02:08 +02:00 Compare
rarias force-pushed 77-hut-cache from fc2367f909 to 8834d561d2 2025-04-15 14:09:10 +02:00 Compare
rarias manually merged commit 8834d561d2 into master 2025-04-15 14:10:06 +02:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
bug
ceph
ci
config
cross
hw
io
kernel
mpi
net
nix
ops
repair
slurm
No Label
config
nix
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
abonerib arocanon varcila rarias
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: rarias/jungle#89
No description provided.
Delete Branch "abonerib/jungle:77-hut-cache"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?