Commit Graph

216 Commits

Author SHA1 Message Date
433c8864ea Add divisor generator 2020-11-17 11:01:34 +01:00
e0ca33569b garlic tools: rename divList -> halfList 2020-11-17 11:01:34 +01:00
dea523460a Add slurm affinity experiment 2020-11-17 11:01:34 +01:00
b4a3bb0ede New stdexp resource specification
Now the options	cpusPerTask ntasksPerNode nodes and jobName are required
for the sbatch stage. Also cpuBind has been removed and is always set to
"cores,verbose" in the srun stage.
2020-11-17 11:01:34 +01:00
dabc6be640 Add more helper functions 2020-11-17 11:01:34 +01:00
18afcb1f44 Avoid nixpkgs reevaluation
The bsc attrset is now extensible: replacing a few bsc packages is very
fast. Also we allow the complete bscpkgs to be within other custom
overlays (not tested yet).
2020-11-17 10:49:45 +01:00
288318b556 Merge branch 'saiph' into 'master'
Saiph

See merge request rarias/bscpkgs!6
2020-11-13 10:25:47 +01:00
42f2227a9f sbatch: Use experiment reservation if given 2020-11-13 10:17:54 +01:00
Sandra
4ae66adb9a Saiph: adding granularity experiment and figures 2020-11-13 09:56:40 +01:00
Sandra
86d1d426ec Saiph: Removing devMode parameter 2020-11-12 19:10:43 +01:00
5333058741 report: build only required figures
Introduces a intermediate derivation that can be imported into the
report derivation, which contains a string cmd that expands the fig
variable as needed.
2020-11-11 19:03:02 +01:00
0b0f6ac9f0 rplot: Add a reference to the dataset 2020-11-11 18:59:57 +01:00
966606b62d hpcg: precompute the input 2020-11-09 17:48:46 +01:00
5763b91d39 Use the trebuchet only to specify an experiment 2020-11-09 17:46:11 +01:00
47f67dcd85 Extend abstract 2020-11-09 12:16:56 +01:00
48869d6e4a Clarify some sections 2020-11-09 12:09:54 +01:00
92f58651b8 Increase margins and enable utf8 targets 2020-11-09 12:09:22 +01:00
31f7d17a41 Add manual diagram for nroff 2020-11-06 14:26:11 +01:00
dec183b221 Fix execution out path 2020-11-06 12:31:39 +01:00
92eee2ede8 Use target machine notation 2020-11-06 12:31:31 +01:00
a8208480c1 Add a nix shell for playing with plots 2020-11-05 20:01:26 +01:00
dd0823876a hpcg: add plot for oss experiment 2020-11-05 19:59:47 +01:00
11ac02da08 heat: Add test experiment and plot 2020-11-05 19:56:26 +01:00
074a75facb saiph: name the experiment and units in numcomm 2020-11-05 19:53:38 +01:00
7a80d1ca98 heat: Use clang by default 2020-11-05 19:52:37 +01:00
9e477a2313 hpcg: smaller input size 2020-11-05 19:46:34 +01:00
5bd042ef67 nbody: mark the points with bad std 2020-11-05 19:43:39 +01:00
d7be13f88d Update garlic options in store stage 2020-11-05 19:38:45 +01:00
476c2f20f0 Add manual and update the garlic tool 2020-11-05 19:31:21 +01:00
de6b4864ee Add garlic tool manual 2020-11-05 19:29:40 +01:00
33682ef48d Document the results and pp stages 2020-11-05 14:52:57 +01:00
634d2040b5 Add reference index 2020-11-04 13:00:42 +01:00
df4d908f1c Add more rendered files to ignore 2020-11-04 12:57:22 +01:00
f0122d557f WIP: postprocessing doc 2020-11-04 12:56:35 +01:00
0c58bb63b5 hpcg: add exp and unit name 2020-11-03 19:10:00 +01:00
de46366985 nbody: plot nb/cpu rather than nb 2020-11-03 19:10:00 +01:00
5eea48c5b0 Add exp and unit name to nbody tampi experiment 2020-11-03 19:10:00 +01:00
c3988dacd2 WIP: documentation for the pp pipeline 2020-11-03 19:10:00 +01:00
317409f6ac Move index and out inside the user directory 2020-11-03 19:10:00 +01:00
3eae92bdc4 Remove old pp stages 2020-11-03 19:10:00 +01:00
6b40e6f9e9 Experimental garlic tool 2020-11-03 19:10:00 +01:00
d5d42b3c09 Add unit and exp name to nbody test 2020-11-03 19:10:00 +01:00
0bcfe5d25b Add new store pp stage 2020-11-03 19:10:00 +01:00
5e2797bcde Create index files for the experiments 2020-11-03 19:10:00 +01:00
efd7df068e Print full experiment path 2020-11-03 19:10:00 +01:00
7c5345f4bc report: Idea to reduce build time 2020-11-03 19:10:00 +01:00
43991e9173 nbody: plot nblocks in test 2020-11-03 19:10:00 +01:00
7b26b59988 Use rsync to fetch only the logs 2020-11-03 19:10:00 +01:00
a66cdb52fb nbody: Fix test experiment 2020-11-03 19:10:00 +01:00
3bd4e61f3f WIP: Testing with automatic fetching 2020-11-03 19:09:59 +01:00
59346fa97e control: Add status file 2020-11-03 19:09:59 +01:00
fd1229ddc0 nbody: add simple test figure 2020-11-03 19:09:59 +01:00
8ce88ef046 Add dataset attrset in garlic
Modify nbody to evenly distribute blocks per cpu
2020-11-03 19:09:59 +01:00
06c29b573f Add exp.nbody.tampi variants 2020-11-03 19:09:59 +01:00
7852d86a3f Fix plot details 2020-11-03 19:09:59 +01:00
4beb069627 WIP: postprocessing pipeline
Now each run is executed in a independent folder
2020-11-03 19:09:59 +01:00
1321b6a888 Add experiments with jemalloc and CPU affinity 2020-11-03 19:09:59 +01:00
81d144d716 Remove exp attrset from report
Fixes #43
2020-11-03 19:09:59 +01:00
30ad4219d9 Add example report 2020-11-03 19:09:59 +01:00
067fb0c0a2 Add R shell for quick plots 2020-11-03 19:09:59 +01:00
308673f7f6 Increase nbody test cases 2020-11-03 19:09:59 +01:00
1bd9cb6c0f Move the plot script to R 2020-11-03 19:09:59 +01:00
ede25b6736 Use the stage names as inputs 2020-11-03 19:09:59 +01:00
2680dcb66f Don't nest the unit results
The experiment directory now contains symlinks to the units, keeping the
old structure. The unit results are directly placed in the garlic out
directory.
2020-11-03 19:09:58 +01:00
f33137a55e WIP: Add experimental figure pipeline 2020-11-03 19:09:58 +01:00
65745e0aaf WIP: Add another nbody experiment 2020-11-03 19:09:58 +01:00
c3659d316d Add perf stage 2020-11-03 19:09:58 +01:00
4f901c1b9c WIP: add postprocessing stages 2020-11-03 19:09:58 +01:00
74f83b5c11 WIP: manual plot 2020-11-03 19:09:58 +01:00
72ba080db1 Merge branch 'nbody' into 'master'
NBody Experiments

See merge request rarias/bscpkgs!5
2020-10-30 16:25:27 +01:00
Raúl Peñacoba
9c20537f91 Since mpi+omp version uses 6 threads, change nblocks values 2020-10-30 15:11:23 +01:00
Raúl Peñacoba
6a1375726f Fix problem sizes to be equivalent between versions 2020-10-30 14:44:33 +01:00
Raúl Peñacoba
d757332448 Remove extrae home 2020-10-30 14:35:09 +01:00
Raúl Peñacoba
58e3d48a16 Use mask_cpu and n.x n.y n.z instead of n 2020-10-30 14:08:56 +01:00
Raúl Peñacoba
b856e2147a Use discrete deps in nanos6. Pass nblocks to omp version and use the same experiments as oss 2020-10-30 14:08:56 +01:00
Raúl Peñacoba
22a294f9cc Forgot to set one task per node 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
ea0272c212 Add OmpSs-2 (no mpi) version 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
e20061254b WIP: Add mpi, omp and mpi+omp experiments. See more.
Seems that gcc compilation with OpenMP throws an error. Investigate.
I think I've forgot to add an override of mpicxx compiler backend
2020-10-30 14:08:55 +01:00
01b2584688 Update hpcg experiments 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
7bf3e81233 WIP: trying to make mpi branch working 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
6bd7e12cff WIP: forgot to add the folder 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
b5fb3730ac WIP: first serial experiment. Don't know how to add gcc to compile 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
a44042615a WIP 2020-10-30 14:08:55 +01:00
Antoni Navarro
05ce36e158 Add the MPI-weak scaling experiment and strong scaling experiments 2020-10-29 16:31:21 +01:00
Antoni Navarro
6ccc159487 Fix one of the CPU Masks in the weak scaling experiment 2020-10-29 16:30:55 +01:00
Antoni Navarro
8b985de65d Add a few scalability experiments for some variants 2020-10-28 15:35:09 +01:00
80ccd1240a Less verbose execution 2020-10-14 16:29:22 +02:00
9d8f7d9074 Print the experiment being run 2020-10-14 16:28:27 +02:00
c7d2e2d866 Write the unit config in a file 2020-10-14 16:27:47 +02:00
148c614540 Add MN4 hw description 2020-10-14 16:24:56 +02:00
7a37913b4e Set the ssh host from the machine config 2020-10-13 14:30:03 +02:00
04328d81ff Add runexp stage documentation 2020-10-13 14:07:34 +02:00
a38ff31cca Introduce the runexp stage 2020-10-13 13:00:59 +02:00
d0a259f15d Ignore generated doc 2020-10-13 12:17:14 +02:00
f2b39decba Update execution doc with isolation 2020-10-13 12:16:48 +02:00
251103ffd3 Fix tbl preprocessor option 2020-10-13 12:16:46 +02:00
6ab448b10a Fix trebuchet description 2020-10-09 20:28:00 +02:00
aa1ffa5208 Remove unused experiments 2020-10-09 20:17:35 +02:00
4de20d3aa5 Remove old stages and update some 2020-10-09 20:12:52 +02:00
27bc977590 Remove strace from isolate stage 2020-10-09 19:50:28 +02:00