Commit Graph

323 Commits

Author SHA1 Message Date
8e130604aa machines: set the hardware revision for MN4
This change will cause a rebuild of all experiments.
2021-02-25 20:45:20 +01:00
0015c7e4cd pp: remove launcher
It has now been integrated with resultTree in pp/store.nix
2021-02-25 12:29:12 +01:00
9612c69aec doc: add garlic configuration section
Update the garlicd usage as well.
2021-02-25 11:38:29 +01:00
6e0e2f0bf6 garlicd: drop bscpkgs argument requirement
The bscpkgs/default.nix is not longer read, as the garlic tool only
needs it for the fetching (-F), when it runs nix-build.
2021-02-25 11:38:29 +01:00
48820ee2d3 resultTree: garlic must be used from the nix shell 2021-02-25 11:38:29 +01:00
9277e60079 timetable: enable verbose processing 2021-02-25 11:38:29 +01:00
c869b6e3b4 garlic: enable verbose rsync fetch 2021-02-25 11:38:29 +01:00
0b95ea20b7 garlicd: allow manual experiment executions 2021-02-25 11:37:58 +01:00
ceb25e5d18 osu: add figure for latency tests 2021-02-23 17:52:48 +01:00
0c9e89dcc0 osu: update experiments using stdexp 2021-02-23 15:22:56 +01:00
ebcbf91fbe exec: allow manual specification of program path 2021-02-23 15:22:18 +01:00
3e2b369e3e garlicd: allow nix builders write to the pipes 2021-02-17 10:28:34 +01:00
d4947a40b9 Fix ssh missing shell 2021-02-17 10:28:11 +01:00
243d022620 cn6: update name and add to the shell 2021-02-15 17:44:20 +01:00
0ee2747215 garlicd: avoid no match fail
We check the result in the next if.
2021-02-15 16:32:06 +01:00
5fd2a62684 doc: update garlicd usage from the nix-shell 2021-02-15 16:22:45 +01:00
0e0bf9e7a7 garlic: add shell with the garlic tools 2021-02-15 16:22:06 +01:00
cb5bcd7097 garlicd: add to index and check for error
The garlicd is now available under garlic.garlid and it requires the
extra-sandbox-path option to be properly set.
2021-02-15 16:20:06 +01:00
d51fe5db48 garlic tool: ensure the mountpoint is enabled 2021-02-15 16:18:21 +01:00
c36b724e9a Add experimental garlicd doc 2021-02-15 13:00:19 +01:00
cdf48181e5 user guide: add time measurement sections 2021-02-08 19:05:46 +01:00
a6b7b14d5e user guide: add initialization time limit 2021-02-08 19:05:46 +01:00
2ca58c46b4 user guide: Add postprocessing section 2021-02-08 19:05:46 +01:00
25208a8158 user guide: add tar.gz target for the web 2021-02-08 19:05:19 +01:00
c46feb4bf2 user guide: use ms macros
Added HTML output
2021-02-08 19:05:19 +01:00
4d626bff97 user guide: test ms macros 2021-02-08 19:05:19 +01:00
042876a287 user guide: generate html with css 2021-02-08 19:05:19 +01:00
edd71815eb pp: fix code block for html 2021-02-08 19:05:19 +01:00
39c360b413 user guide: add readme and branch name conventions 2021-02-08 19:04:51 +01:00
3ce0d3934b user guide: reorder development 2021-02-08 19:04:45 +01:00
60cab85fc4 user guide: expand the develop section 2021-02-08 19:04:36 +01:00
95809bd2bf user guide: add stub with mm macro 2021-02-08 19:04:30 +01:00
e5561b8735 control: save total execution time 2021-02-08 14:14:08 +01:00
d4dfbb7501 Remove garlic.ds attribute
Datasets are now handled directly when creating the figures, via the
timetable attribute.
2021-02-03 15:34:25 +01:00
b65a442cb0 fig: use timetable attribute in other plots 2021-02-03 15:34:10 +01:00
9c6b7a9f87 timetable: missing quote 2021-02-03 13:51:24 +01:00
d84ccf566b launcher: fix typo 2021-02-03 13:51:04 +01:00
0faf22a43f fig: add nbody example using timetable attribute 2021-02-03 13:07:55 +01:00
e89139284a stdexp: add result and timetable targets
These targets allow one experiment to directly refer to another
experiment results, thus a dependency chain can be formed to ensure
execution order.

It also simplifies the dataset definition, as they can be automatically
fetched from the experiment directly.
2021-02-03 12:37:54 +01:00
b453c12253 pp: Add automatic launcher 2021-02-03 12:36:59 +01:00
32d8636ae1 timetable: prevent empty time lines 2021-02-03 12:27:23 +01:00
e4e427b7f6 garlicd: add daemon to launch experiments 2021-02-03 12:08:25 +01:00
fe760c0023 garlic: sent trebuchet output to stderr 2021-02-03 11:50:31 +01:00
4591eca1fd garlic: Add blackbox diagram 2021-02-01 11:11:54 +01:00
9beda65778 lulesh: add experiment with all variants 2021-01-28 15:27:21 +01:00
0f62151dcf lulesh: follow garlic git branches 2021-01-28 15:27:21 +01:00
0bc81c8943 tools: add range2 function 2021-01-28 15:00:43 +01:00
a3804e31f2 develop: Simplify packages 2021-01-26 14:59:57 +01:00
ed4a9e1bc3 Add branch diagram 2021-01-25 17:54:24 +01:00
3d0e93b4d3 Add slides pdf 2021-01-14 13:06:20 +01:00
8262fd3104 Add slides for meeting 3 2021-01-13 20:19:28 +01:00
2b9c3da911 Add script stage 2021-01-12 18:19:49 +01:00
aeac1a6068 exec: Force newlines
Allow single line commands like pre="true"
2021-01-11 19:15:37 +01:00
130fe39c8e exec: Abort on error
We need exit on the first error, as otherwise we cannot track a bad
execution when no exec is done (when post is not empty).
2021-01-11 18:29:30 +01:00
892fb35d27 nbody: Fix infinite recursion
We want to override the previous layer (super), not the last one (self).
2021-01-11 14:30:12 +01:00
afd333adef creams: fix indentation 2020-12-18 12:43:06 +01:00
76f2ef4b95 creams: add figures for scalability 2020-12-18 12:26:40 +01:00
3b80c2fcb9 creams: Merge hybrid and pure datasets into ss.all 2020-12-17 15:26:25 +01:00
b5cadefca9 Allow a space before time tag
This matches the fortran format for creams
2020-12-17 15:24:23 +01:00
Pedro Martinez
203dc9f295 Configure the nanos6 environment and get the right hardware attributes 2020-12-15 19:34:49 +01:00
Pedro Martinez
2e18761b48 Use the 'hw' attributes 2020-12-15 19:11:29 +01:00
Pedro Martinez
748d335a39 Define variables 'ntasksPerNode' and 'cpusPerTask' for each experiment and other minor changes 2020-12-15 19:11:29 +01:00
5a8cc1e514 stdexp: Run python snippets and import the result 2020-12-10 15:41:49 +01:00
7d4db6b6de control: Exit on error
This prevents srun from silently returning with an error, without
actually queueing the job of a run.
2020-12-07 16:33:40 +01:00
756c5dff92 Update PM git server 2020-12-07 13:47:17 +01:00
9a0ea08d72 Reorganization
- All garlic stuff is moved into garlic/
- Group the overlay index by sections
- Add a garlic/default.nix link to the main default.nix, so we can
  build derivations at garlic/
2020-12-07 13:33:42 +01:00
d70316a25a fwi: disable nanos6 in ModelGenerator 2020-12-04 11:17:15 +01:00
eb4adf9520 ifsker: initial version 2020-12-03 18:49:28 +01:00
266fffdb5f miniamr: initial version for OmpSs-2 2020-12-03 18:09:47 +01:00
f65e4d01c3 Simplify compiler name variables 2020-12-03 18:06:51 +01:00
1bdeca9e7d unit: Remove dangerous slash from index names 2020-12-03 16:33:48 +01:00
5e9adf3fe6 nbody: Fix x label 2020-12-03 13:22:48 +01:00
c858f521bf isolate: add $TMPDIR in the namespace 2020-12-03 13:22:10 +01:00
bdaadd4ef7 nbody: add ctf tests 2020-12-03 13:20:40 +01:00
b8a1ea3f72 develop: Fix inputrc missing key codes 2020-12-03 13:09:42 +01:00
eea9539258 develop: Set shell and hisfile 2020-12-03 12:14:04 +01:00
da4bbf8533 isolate: only load some files from /etc 2020-12-03 12:04:51 +01:00
df1f22c122 develop: support for srun 2020-12-02 13:38:43 +01:00
f87d830218 isolate: preserve TERM 2020-12-02 13:06:55 +01:00
3d352fee19 isolate: allow argument passing 2020-12-02 13:06:35 +01:00
284662d6cd develop: fix bash PS1 2020-12-02 12:22:20 +01:00
1340d1d2e8 develop: Experimental interactive support 2020-12-02 11:58:00 +01:00
1f841649f8 exec: add support for nixPrefix 2020-12-02 11:57:40 +01:00
4000dbd0b8 Rename slides and generalize makefile 2020-11-24 18:05:16 +01:00
6fa3facfb1 Preliminar version for the slides 2020-11-24 17:58:14 +01:00
ed95cb0a04 Add wip presentation 2020-11-23 19:06:15 +01:00
aca7e36fc7 bigsort: add experiment with input generation 2020-11-20 15:41:27 +01:00
2153e58baf bigsort: add the shuffle program 2020-11-20 15:39:34 +01:00
ceeb0f7f41 bigsort: add genseq program 2020-11-20 15:38:26 +01:00
a147a396d9 trebuchet: add the experiment as attribute 2020-11-20 15:35:36 +01:00
8bc5656461 tools: recursive getExperiment
It allows getExperimentStage to be called from any stage above the
experiment.
2020-11-20 15:34:14 +01:00
d192a59fdc control: Export the run iteration 2020-11-20 15:32:41 +01:00
734d494d96 stdexp: Allow extra mounts 2020-11-20 15:30:47 +01:00
2863ab6ae1 machines: Use fs topology 2020-11-20 15:29:03 +01:00
4f0da10321 bigsort: Use cpusPerTask instead of cpuBind 2020-11-20 13:57:12 +01:00
David Alvarez
0c438d4dac Setup for test experiment 2020-11-20 13:57:12 +01:00
David Alvarez
a0dac209e3 First test experiment 2020-11-20 13:57:12 +01:00
David Alvarez
37bd4c33f2 Add BigSort MPI+OpenMP 2020-11-20 13:57:12 +01:00
e8f649327a exec: Avoid variable expansion at build
All bash variables passed in env, pre or post are now expanded at
execution time..
2020-11-20 13:54:45 +01:00
d2d3ccf332 Idea for FS naming convention 2020-11-17 18:33:57 +01:00