e8f649327a
exec: Avoid variable expansion at build
...
All bash variables passed in env, pre or post are now expanded at
execution time..
2020-11-20 13:54:45 +01:00
d2d3ccf332
Idea for FS naming convention
2020-11-17 18:33:57 +01:00
e1e34ddf75
exec: add pre and post code to allow cleanup tasks
2020-11-17 16:09:38 +01:00
33f6ae7e55
Add bundled report example
2020-11-17 15:51:09 +01:00
fe0bd8b200
creams: fix pure experiment
...
Use machine agnostic specification for resources
2020-11-17 12:31:03 +01:00
016422cede
Update nbody experiment
...
Generate the input based on the target machine description.
2020-11-17 11:26:35 +01:00
5e50ef19fe
Update experiments with cpusPerTask
...
Try to avoid manually setting the hardware specs and rather use
the hw attrset.
2020-11-17 11:17:57 +01:00
641e752bd5
Add a trace message at unit evaluation
2020-11-17 11:12:12 +01:00
74537e682c
Use divisors in the slurm cpu experiment
2020-11-17 11:01:34 +01:00
433c8864ea
Add divisor generator
2020-11-17 11:01:34 +01:00
e0ca33569b
garlic tools: rename divList -> halfList
2020-11-17 11:01:34 +01:00
dea523460a
Add slurm affinity experiment
2020-11-17 11:01:34 +01:00
b4a3bb0ede
New stdexp resource specification
...
Now the options cpusPerTask ntasksPerNode nodes and jobName are required
for the sbatch stage. Also cpuBind has been removed and is always set to
"cores,verbose" in the srun stage.
2020-11-17 11:01:34 +01:00
dabc6be640
Add more helper functions
2020-11-17 11:01:34 +01:00
18afcb1f44
Avoid nixpkgs reevaluation
...
The bsc attrset is now extensible: replacing a few bsc packages is very
fast. Also we allow the complete bscpkgs to be within other custom
overlays (not tested yet).
2020-11-17 10:49:45 +01:00
288318b556
Merge branch 'saiph' into 'master'
...
Saiph
See merge request rarias/bscpkgs!6
2020-11-13 10:25:47 +01:00
42f2227a9f
sbatch: Use experiment reservation if given
2020-11-13 10:17:54 +01:00
Sandra
4ae66adb9a
Saiph: adding granularity experiment and figures
2020-11-13 09:56:40 +01:00
Sandra
86d1d426ec
Saiph: Removing devMode parameter
2020-11-12 19:10:43 +01:00
5333058741
report: build only required figures
...
Introduces a intermediate derivation that can be imported into the
report derivation, which contains a string cmd that expands the fig
variable as needed.
2020-11-11 19:03:02 +01:00
0b0f6ac9f0
rplot: Add a reference to the dataset
2020-11-11 18:59:57 +01:00
966606b62d
hpcg: precompute the input
2020-11-09 17:48:46 +01:00
5763b91d39
Use the trebuchet only to specify an experiment
2020-11-09 17:46:11 +01:00
47f67dcd85
Extend abstract
2020-11-09 12:16:56 +01:00
48869d6e4a
Clarify some sections
2020-11-09 12:09:54 +01:00
92f58651b8
Increase margins and enable utf8 targets
2020-11-09 12:09:22 +01:00
31f7d17a41
Add manual diagram for nroff
2020-11-06 14:26:11 +01:00
dec183b221
Fix execution out path
2020-11-06 12:31:39 +01:00
92eee2ede8
Use target machine notation
2020-11-06 12:31:31 +01:00
a8208480c1
Add a nix shell for playing with plots
2020-11-05 20:01:26 +01:00
dd0823876a
hpcg: add plot for oss experiment
2020-11-05 19:59:47 +01:00
11ac02da08
heat: Add test experiment and plot
2020-11-05 19:56:26 +01:00
074a75facb
saiph: name the experiment and units in numcomm
2020-11-05 19:53:38 +01:00
7a80d1ca98
heat: Use clang by default
2020-11-05 19:52:37 +01:00
9e477a2313
hpcg: smaller input size
2020-11-05 19:46:34 +01:00
5bd042ef67
nbody: mark the points with bad std
2020-11-05 19:43:39 +01:00
d7be13f88d
Update garlic options in store stage
2020-11-05 19:38:45 +01:00
476c2f20f0
Add manual and update the garlic tool
2020-11-05 19:31:21 +01:00
de6b4864ee
Add garlic tool manual
2020-11-05 19:29:40 +01:00
33682ef48d
Document the results and pp stages
2020-11-05 14:52:57 +01:00
634d2040b5
Add reference index
2020-11-04 13:00:42 +01:00
df4d908f1c
Add more rendered files to ignore
2020-11-04 12:57:22 +01:00
f0122d557f
WIP: postprocessing doc
2020-11-04 12:56:35 +01:00
0c58bb63b5
hpcg: add exp and unit name
2020-11-03 19:10:00 +01:00
de46366985
nbody: plot nb/cpu rather than nb
2020-11-03 19:10:00 +01:00
5eea48c5b0
Add exp and unit name to nbody tampi experiment
2020-11-03 19:10:00 +01:00
c3988dacd2
WIP: documentation for the pp pipeline
2020-11-03 19:10:00 +01:00
317409f6ac
Move index and out inside the user directory
2020-11-03 19:10:00 +01:00
3eae92bdc4
Remove old pp stages
2020-11-03 19:10:00 +01:00
6b40e6f9e9
Experimental garlic tool
2020-11-03 19:10:00 +01:00
d5d42b3c09
Add unit and exp name to nbody test
2020-11-03 19:10:00 +01:00
0bcfe5d25b
Add new store pp stage
2020-11-03 19:10:00 +01:00
5e2797bcde
Create index files for the experiments
2020-11-03 19:10:00 +01:00
efd7df068e
Print full experiment path
2020-11-03 19:10:00 +01:00
7c5345f4bc
report: Idea to reduce build time
2020-11-03 19:10:00 +01:00
43991e9173
nbody: plot nblocks in test
2020-11-03 19:10:00 +01:00
7b26b59988
Use rsync to fetch only the logs
2020-11-03 19:10:00 +01:00
a66cdb52fb
nbody: Fix test experiment
2020-11-03 19:10:00 +01:00
3bd4e61f3f
WIP: Testing with automatic fetching
2020-11-03 19:09:59 +01:00
59346fa97e
control: Add status file
2020-11-03 19:09:59 +01:00
fd1229ddc0
nbody: add simple test figure
2020-11-03 19:09:59 +01:00
8ce88ef046
Add dataset attrset in garlic
...
Modify nbody to evenly distribute blocks per cpu
2020-11-03 19:09:59 +01:00
06c29b573f
Add exp.nbody.tampi variants
2020-11-03 19:09:59 +01:00
7852d86a3f
Fix plot details
2020-11-03 19:09:59 +01:00
4beb069627
WIP: postprocessing pipeline
...
Now each run is executed in a independent folder
2020-11-03 19:09:59 +01:00
1321b6a888
Add experiments with jemalloc and CPU affinity
2020-11-03 19:09:59 +01:00
81d144d716
Remove exp attrset from report
...
Fixes #43
2020-11-03 19:09:59 +01:00
30ad4219d9
Add example report
2020-11-03 19:09:59 +01:00
067fb0c0a2
Add R shell for quick plots
2020-11-03 19:09:59 +01:00
308673f7f6
Increase nbody test cases
2020-11-03 19:09:59 +01:00
1bd9cb6c0f
Move the plot script to R
2020-11-03 19:09:59 +01:00
ede25b6736
Use the stage names as inputs
2020-11-03 19:09:59 +01:00
2680dcb66f
Don't nest the unit results
...
The experiment directory now contains symlinks to the units, keeping the
old structure. The unit results are directly placed in the garlic out
directory.
2020-11-03 19:09:58 +01:00
f33137a55e
WIP: Add experimental figure pipeline
2020-11-03 19:09:58 +01:00
65745e0aaf
WIP: Add another nbody experiment
2020-11-03 19:09:58 +01:00
c3659d316d
Add perf stage
2020-11-03 19:09:58 +01:00
4f901c1b9c
WIP: add postprocessing stages
2020-11-03 19:09:58 +01:00
74f83b5c11
WIP: manual plot
2020-11-03 19:09:58 +01:00
72ba080db1
Merge branch 'nbody' into 'master'
...
NBody Experiments
See merge request rarias/bscpkgs!5
2020-10-30 16:25:27 +01:00
Raúl Peñacoba
9c20537f91
Since mpi+omp version uses 6 threads, change nblocks values
2020-10-30 15:11:23 +01:00
Raúl Peñacoba
6a1375726f
Fix problem sizes to be equivalent between versions
2020-10-30 14:44:33 +01:00
Raúl Peñacoba
d757332448
Remove extrae home
2020-10-30 14:35:09 +01:00
Raúl Peñacoba
58e3d48a16
Use mask_cpu and n.x n.y n.z instead of n
2020-10-30 14:08:56 +01:00
Raúl Peñacoba
b856e2147a
Use discrete deps in nanos6. Pass nblocks to omp version and use the same experiments as oss
2020-10-30 14:08:56 +01:00
Raúl Peñacoba
22a294f9cc
Forgot to set one task per node
2020-10-30 14:08:55 +01:00
Raúl Peñacoba
ea0272c212
Add OmpSs-2 (no mpi) version
2020-10-30 14:08:55 +01:00
Raúl Peñacoba
e20061254b
WIP: Add mpi, omp and mpi+omp experiments. See more.
...
Seems that gcc compilation with OpenMP throws an error. Investigate.
I think I've forgot to add an override of mpicxx compiler backend
2020-10-30 14:08:55 +01:00
01b2584688
Update hpcg experiments
2020-10-30 14:08:55 +01:00
Raúl Peñacoba
7bf3e81233
WIP: trying to make mpi branch working
2020-10-30 14:08:55 +01:00
Raúl Peñacoba
6bd7e12cff
WIP: forgot to add the folder
2020-10-30 14:08:55 +01:00
Raúl Peñacoba
b5fb3730ac
WIP: first serial experiment. Don't know how to add gcc to compile
2020-10-30 14:08:55 +01:00
Raúl Peñacoba
a44042615a
WIP
2020-10-30 14:08:55 +01:00
Antoni Navarro
05ce36e158
Add the MPI-weak scaling experiment and strong scaling experiments
2020-10-29 16:31:21 +01:00
Antoni Navarro
6ccc159487
Fix one of the CPU Masks in the weak scaling experiment
2020-10-29 16:30:55 +01:00
Antoni Navarro
8b985de65d
Add a few scalability experiments for some variants
2020-10-28 15:35:09 +01:00
80ccd1240a
Less verbose execution
2020-10-14 16:29:22 +02:00
9d8f7d9074
Print the experiment being run
2020-10-14 16:28:27 +02:00
c7d2e2d866
Write the unit config in a file
2020-10-14 16:27:47 +02:00
148c614540
Add MN4 hw description
2020-10-14 16:24:56 +02:00
7a37913b4e
Set the ssh host from the machine config
2020-10-13 14:30:03 +02:00
