Commit Graph

278 Commits

Author SHA1 Message Date
317409f6ac Move index and out inside the user directory 2020-11-03 19:10:00 +01:00
3eae92bdc4 Remove old pp stages 2020-11-03 19:10:00 +01:00
6b40e6f9e9 Experimental garlic tool 2020-11-03 19:10:00 +01:00
d5d42b3c09 Add unit and exp name to nbody test 2020-11-03 19:10:00 +01:00
0bcfe5d25b Add new store pp stage 2020-11-03 19:10:00 +01:00
5e2797bcde Create index files for the experiments 2020-11-03 19:10:00 +01:00
efd7df068e Print full experiment path 2020-11-03 19:10:00 +01:00
7c5345f4bc report: Idea to reduce build time 2020-11-03 19:10:00 +01:00
43991e9173 nbody: plot nblocks in test 2020-11-03 19:10:00 +01:00
7b26b59988 Use rsync to fetch only the logs 2020-11-03 19:10:00 +01:00
a66cdb52fb nbody: Fix test experiment 2020-11-03 19:10:00 +01:00
3bd4e61f3f WIP: Testing with automatic fetching 2020-11-03 19:09:59 +01:00
59346fa97e control: Add status file 2020-11-03 19:09:59 +01:00
fd1229ddc0 nbody: add simple test figure 2020-11-03 19:09:59 +01:00
8ce88ef046 Add dataset attrset in garlic
Modify nbody to evenly distribute blocks per cpu
2020-11-03 19:09:59 +01:00
06c29b573f Add exp.nbody.tampi variants 2020-11-03 19:09:59 +01:00
7852d86a3f Fix plot details 2020-11-03 19:09:59 +01:00
4beb069627 WIP: postprocessing pipeline
Now each run is executed in a independent folder
2020-11-03 19:09:59 +01:00
1321b6a888 Add experiments with jemalloc and CPU affinity 2020-11-03 19:09:59 +01:00
81d144d716 Remove exp attrset from report
Fixes #43
2020-11-03 19:09:59 +01:00
30ad4219d9 Add example report 2020-11-03 19:09:59 +01:00
067fb0c0a2 Add R shell for quick plots 2020-11-03 19:09:59 +01:00
308673f7f6 Increase nbody test cases 2020-11-03 19:09:59 +01:00
1bd9cb6c0f Move the plot script to R 2020-11-03 19:09:59 +01:00
ede25b6736 Use the stage names as inputs 2020-11-03 19:09:59 +01:00
2680dcb66f Don't nest the unit results
The experiment directory now contains symlinks to the units, keeping the
old structure. The unit results are directly placed in the garlic out
directory.
2020-11-03 19:09:58 +01:00
f33137a55e WIP: Add experimental figure pipeline 2020-11-03 19:09:58 +01:00
65745e0aaf WIP: Add another nbody experiment 2020-11-03 19:09:58 +01:00
c3659d316d Add perf stage 2020-11-03 19:09:58 +01:00
4f901c1b9c WIP: add postprocessing stages 2020-11-03 19:09:58 +01:00
74f83b5c11 WIP: manual plot 2020-11-03 19:09:58 +01:00
72ba080db1 Merge branch 'nbody' into 'master'
NBody Experiments

See merge request rarias/bscpkgs!5
2020-10-30 16:25:27 +01:00
Raúl Peñacoba
9c20537f91 Since mpi+omp version uses 6 threads, change nblocks values 2020-10-30 15:11:23 +01:00
Raúl Peñacoba
6a1375726f Fix problem sizes to be equivalent between versions 2020-10-30 14:44:33 +01:00
Raúl Peñacoba
d757332448 Remove extrae home 2020-10-30 14:35:09 +01:00
Raúl Peñacoba
58e3d48a16 Use mask_cpu and n.x n.y n.z instead of n 2020-10-30 14:08:56 +01:00
Raúl Peñacoba
b856e2147a Use discrete deps in nanos6. Pass nblocks to omp version and use the same experiments as oss 2020-10-30 14:08:56 +01:00
Raúl Peñacoba
22a294f9cc Forgot to set one task per node 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
ea0272c212 Add OmpSs-2 (no mpi) version 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
e20061254b WIP: Add mpi, omp and mpi+omp experiments. See more.
Seems that gcc compilation with OpenMP throws an error. Investigate.
I think I've forgot to add an override of mpicxx compiler backend
2020-10-30 14:08:55 +01:00
01b2584688 Update hpcg experiments 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
7bf3e81233 WIP: trying to make mpi branch working 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
6bd7e12cff WIP: forgot to add the folder 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
b5fb3730ac WIP: first serial experiment. Don't know how to add gcc to compile 2020-10-30 14:08:55 +01:00
Raúl Peñacoba
a44042615a WIP 2020-10-30 14:08:55 +01:00
Antoni Navarro
05ce36e158 Add the MPI-weak scaling experiment and strong scaling experiments 2020-10-29 16:31:21 +01:00
Antoni Navarro
6ccc159487 Fix one of the CPU Masks in the weak scaling experiment 2020-10-29 16:30:55 +01:00
Antoni Navarro
8b985de65d Add a few scalability experiments for some variants 2020-10-28 15:35:09 +01:00
80ccd1240a Less verbose execution 2020-10-14 16:29:22 +02:00
9d8f7d9074 Print the experiment being run 2020-10-14 16:28:27 +02:00
c7d2e2d866 Write the unit config in a file 2020-10-14 16:27:47 +02:00
148c614540 Add MN4 hw description 2020-10-14 16:24:56 +02:00
7a37913b4e Set the ssh host from the machine config 2020-10-13 14:30:03 +02:00
04328d81ff Add runexp stage documentation 2020-10-13 14:07:34 +02:00
a38ff31cca Introduce the runexp stage 2020-10-13 13:00:59 +02:00
d0a259f15d Ignore generated doc 2020-10-13 12:17:14 +02:00
f2b39decba Update execution doc with isolation 2020-10-13 12:16:48 +02:00
251103ffd3 Fix tbl preprocessor option 2020-10-13 12:16:46 +02:00
6ab448b10a Fix trebuchet description 2020-10-09 20:28:00 +02:00
aa1ffa5208 Remove unused experiments 2020-10-09 20:17:35 +02:00
4de20d3aa5 Remove old stages and update some 2020-10-09 20:12:52 +02:00
27bc977590 Remove strace from isolate stage 2020-10-09 19:50:28 +02:00
1b703bd431 Fix saiph numcomm experiment 2020-10-09 19:40:49 +02:00
298c7362b3 New config design 2020-10-09 19:33:06 +02:00
9020f87765 Simplify saiph numcomm experiment 2020-10-09 17:20:50 +02:00
53dca32469 Simplify experiment 2020-10-09 17:19:00 +02:00
9d2ce2a1c2 Remove old experiments 2020-10-09 16:43:00 +02:00
332b738889 Move apps into garlic/apps 2020-10-09 16:42:06 +02:00
a576be8031 WIP stage redesign 2020-10-09 16:42:06 +02:00
654e243735 Include an index in the trebuchet 2020-10-09 16:42:06 +02:00
45afe7d391 Simplify experiment stage 2020-10-09 16:42:06 +02:00
d599b8c52f New naming convention 2020-10-09 16:42:06 +02:00
697d4e652e Ignore pdf and generated txt 2020-10-09 16:42:06 +02:00
26ea326ded Group stages 2020-10-09 16:42:06 +02:00
66a5e06ada Generate trebuchet from nix 2020-10-09 16:42:06 +02:00
e8d884a627 Document the execution pipeline 2020-10-09 16:42:06 +02:00
81004b5ee6 control: Fix bashism 2020-10-09 16:42:06 +02:00
4ea0d16926 WIP isolation 2020-10-09 16:42:06 +02:00
ba221c5200 Add rw test 2020-10-09 16:42:06 +02:00
effcc2d20b Working isolated environment 2020-10-09 16:42:06 +02:00
2a01ee7f24 WIP isolate execution 2020-10-09 16:42:06 +02:00
896ebd4ace WIP nix-isolate 2020-10-09 16:42:06 +02:00
0a26c72440 extrae: Remove dangerous home 2020-10-08 18:34:20 +02:00
Sandra
ec555e59e7 Setting a developer mode and its implication 2020-10-07 11:53:47 +02:00
Sandra
8f65030161 Saiph: numcomm experiment changes 2020-10-07 11:38:57 +02:00
Sandra
30630a74be Saiph: Vectorisation compiler info flags 2020-10-07 11:38:02 +02:00
6d413c946c nbody: Remove libtampi-c patch
See #37
2020-10-05 12:39:34 +02:00
533d8e9768 Fix tampi experiment to use multiple CPUs per task 2020-10-05 10:47:16 +02:00
2f56488197 Merge branch 'master' of bscpm02.bsc.es:rarias/bscpkgs 2020-10-05 10:31:15 +02:00
368aa57cb7 nbody: Remove OpenMPI dirty hack
Was fixed in 7e1a5128b6
2020-10-05 10:28:38 +02:00
Pedro Martinez
231672a222 Rename files to improve consistency 2020-10-02 18:28:13 +02:00
Pedro Martinez
b403fbefe1 Add hybrid strong scalability experiments 2020-10-02 17:48:00 +02:00
Pedro Martinez
c85b2976ef Fix non-hybrid strong scalability experiments 2020-10-02 16:47:45 +02:00
Pedro Martinez
6ae71cc5e9 Improvement the experiment based on CREAMS 2020-10-02 16:40:43 +02:00
Pedro Martinez
5cbc8e4fbb First attempt to create an experiment with CREAMS: strong scaling from 1 to 16 nodes using the pure MPI version 2020-10-02 16:40:43 +02:00
50eeca2257 hist: Add -S option and allow joined plots 2020-10-02 15:30:55 +02:00
61a2db03dc Add postprocessing hist tool 2020-10-02 11:58:04 +02:00
Sandra
79a4a4d16b saiph: removing home paths 2020-10-02 10:46:56 +02:00
Sandra
cec7a280c0 saiph: removing nix-shell to avoid its use!! 2020-10-01 17:52:50 +02:00
Sandra
ce7566cf7a saiph: removing useless exports 2020-10-01 17:52:50 +02:00
Sandra
78b96c1bc6 saiph: including reservation option 2020-10-01 17:52:50 +02:00
Sandra
6a2d865225 saiph: adding ministat app to saiph shell 2020-10-01 17:52:50 +02:00
Sandra
8f5c5146b3 Saiph: update branchname according to garlic nomenclature 2020-10-01 17:52:50 +02:00
Sandra
e3349bb864 saiph: exp: adding extrae config files 2020-10-01 17:52:50 +02:00
Sandra
ef592c060f Saiph: saiph shell 2020-10-01 17:52:50 +02:00
d210e96d18 Mark the launcher for upload 2020-10-01 10:48:54 +02:00
35f4ba545a Experimental GDB stage 2020-09-30 16:00:34 +02:00
ec21ba98b5 nbody: Allow custom reservation 2020-09-30 09:32:25 +02:00
69b1dcf08a nbody: forgot nixsetup attr 2020-09-30 09:24:14 +02:00
fa734deaca extrae: remove home path from the xml 2020-09-28 14:11:14 +02:00
f72a4e9bc8 Enable symbolizer for asan 2020-09-28 13:07:07 +02:00
ae2cdf8790 numcomm: disable extrae 2020-09-28 13:06:35 +02:00
ff4d39233a Add valgrind stage 2020-09-28 13:00:59 +02:00
sandra
c1b64e8897 saiph: if extrae add some env var 2020-09-23 13:13:51 +02:00
sandra
c8915dfc89 saiph: cc is a experiment parameter 2020-09-23 13:10:12 +02:00
sandra
3419db1fc6 saiph: nixsetup to re-enter nix after the new added stage 2020-09-23 13:06:16 +02:00
79fae204c2 Typo 2020-09-22 18:39:29 +02:00
ed7f6e3e97 nbody: Clean environment 2020-09-22 18:39:11 +02:00
1d5b528cd0 Change output log files 2020-09-22 18:38:37 +02:00
e3623b05fd Print the env via stderr 2020-09-22 18:38:25 +02:00
58e6c76349 Move apps to garlic 2020-09-22 17:41:40 +02:00
c5e225c778 saiph:Remove old experiments 2020-09-22 17:40:26 +02:00
edf429c932 Avoid loading .bashrc 2020-09-22 17:39:26 +02:00
cd37d513e8 saiph: Extrae with the correct MPI 2020-09-22 14:26:01 +02:00
ad4df5e05d saiph: Up to 4 numcomm experiment 2020-09-21 19:54:12 +02:00
5920c964d2 saiph: fix hardening and affinity 2020-09-21 19:23:17 +02:00
cc101ad1d3 Add saiph experiments 2020-09-21 17:30:24 +02:00
126f05e92c Simplify paths 2020-09-21 14:34:08 +02:00