d108306a29
saiph: add blocking experiments to index
...
Remove unused environment variables as well.
2021-03-30 18:54:35 +02:00
e0fbbe32a6
saiph: update granularity experiment and R script
2021-03-30 18:54:35 +02:00
Sandra
37e11c749f
saiph: add cacheline compilation parameter
2021-03-30 18:54:35 +02:00
Sandra
02a62c18ac
saiph: add strong scaling experiment
2021-03-30 18:54:35 +02:00
Sandra
0ac0205366
saiph: add figures for blocking experiment
2021-03-30 18:54:35 +02:00
Sandra
a2306eb941
saiph: add some blocking experiments
2021-03-30 18:54:35 +02:00
Sandra
38d4d0b48c
saiph: delete extrae XML configuration files
2021-03-30 18:54:35 +02:00
63b08fa4e8
saiph: use nby for granularity plot
2021-03-30 18:54:35 +02:00
992af14c7f
saiph: add scaling experiment
2021-03-30 18:54:35 +02:00
99f3326609
saiph: allow custom gitCommit
2021-03-30 18:54:35 +02:00
a4b2dfddb4
saiph: update granularity experiment
2021-03-30 18:54:35 +02:00
830d648925
saiph: reduce the number of loops
...
The current app Heat3D_vect has a long initialization time
2021-03-30 18:54:16 +02:00
e4ab177d6c
saiph: remove dangerous Intel MPI envvar
...
It is no longer used, as we have moved to the release library version.
2021-03-30 17:56:26 +02:00
b7dcf7bc69
rplot: add support for gziped datasets
2021-03-30 16:35:47 +02:00
5ac581b573
creams: remove pure mpi from granularity
2021-03-30 16:14:32 +02:00
b900cb95f0
creams: make configurations unique
2021-03-30 16:14:11 +02:00
389d3f6310
creams: simplify granularity figure
2021-03-30 16:07:14 +02:00
76deac0a63
creams: update figures using one single pipeline
2021-03-30 15:59:52 +02:00
87f751185c
creams: merge similar experiments together
...
Large experiments have the enableExtended parameter disabled by default,
which enables more tests.
2021-03-30 15:55:57 +02:00
ec056d97e5
rplot: add total job time in the plots
2021-03-30 15:49:40 +02:00
872ad1a289
stdexp: allow preSrun attribute in the srun stage
...
This option allows an experiment to inject commands before srun starts,
while keeping the standard srun stage options.
2021-03-29 17:46:19 +02:00
Pedro Martinez
617ef21d38
creams: redefine granularity figures
2021-03-24 13:52:26 +01:00
Pedro Martinez
5cd9894636
creams: redefine granularity experiments
2021-03-24 13:52:26 +01:00
Pedro Martinez
bfc32ef4b7
creams: readjust granularity for strong scalability
2021-03-24 13:52:26 +01:00
Pedro Martinez
cb4d27aefb
creams: bugfix in granularity values
2021-03-24 13:52:26 +01:00
Pedro Martinez
d27c696259
creams: reduce granularity combinations to 8
2021-03-24 13:52:26 +01:00
Pedro Martinez
a55019c6ef
creams: add more nodes for granularity experiments
2021-03-24 13:52:26 +01:00
8a81c6bfba
creams: add granularity figure
...
Only the hybrid experiment is used by now
2021-03-24 13:52:26 +01:00
c59f298ae2
creams: reduce granularity experiment units
2021-03-24 13:52:26 +01:00
6818b29d02
creams: fix outdated nanos6.toml
...
This temporal fix allows the experiment to ignore the nanos6.toml in the
git repository, and only set version.dependencies variable.
2021-03-24 13:52:26 +01:00
Pedro Martinez
8445fb0928
creams: run the cp command in one process only
2021-03-24 13:52:26 +01:00
Pedro Martinez
1aa0e77157
creams: avoid race condition
...
Ensure only one Slurm process performs environment operations
2021-03-24 13:52:26 +01:00
Pedro Martinez
938246322f
creams: add OpenMP branches
2021-03-24 13:52:26 +01:00
Pedro Martinez
6c0f4ec1b3
creams: add granularity experiments
2021-03-24 13:52:26 +01:00
46f7add84c
garlicd: use head instead of the read builtin
...
It seems that bash is unable to propagate the SIGINT while
reading from the FIFO. This fixes the anoying ^C^C^C problems
found when running garlicd.
2021-03-22 18:43:01 +01:00
87fa3bb336
sbatch: assert types to avoid silent parse errors
2021-03-19 16:37:31 +01:00
74cd3d4fbc
rplot: fix fontconfig warning
2021-03-12 19:53:24 +01:00
c41456412c
examples: Add granularity examples
2021-03-12 19:33:40 +01:00
7d66b34140
nbody: fix converter rename in nanos6 CTF options
2021-03-12 12:58:41 +01:00
0781e8b28e
nbody: remove jemalloc experiments
...
Nanos6 has jemalloc enabled by default
2021-03-12 12:58:41 +01:00
88087bb4b7
nbody: add time-node plot
2021-03-12 12:58:41 +01:00
637c57b388
nbody: improve unit name
2021-03-12 12:58:41 +01:00
26ab2d9bbd
nbody: fix indentation in baseline R script
2021-03-12 12:58:41 +01:00
133ef50bb4
nbody: show time points
2021-03-12 12:58:41 +01:00
3a2694ad36
nbody: add mpi branch in scaling experiment
2021-03-12 12:58:37 +01:00
5804b167db
nbody: add scaling figure
2021-03-12 12:57:01 +01:00
425479c9fc
nbody: add scaling experiment
2021-03-12 12:57:01 +01:00
a286488979
rplot: add egg package for ggarange function
2021-03-12 12:56:58 +01:00
d70adae9ec
heat: add figure for the mode experiment
2021-03-12 12:14:51 +01:00
854707103c
heat: add ctf stage to analyze mode times
2021-03-12 12:13:10 +01:00
972be56eed
heat: patch to print the start and end time
...
It will be used to cut the CTF traces to take only the computation part
in cosideration.
2021-03-12 12:11:24 +01:00
56c625bfe4
ds: add ctf mode analysis
2021-03-12 12:10:18 +01:00
3445a72686
garlic tool: copy recursively from .garlic/
...
It allows an experiment to store a CTF trace in the resultTree (which is
not recommended for large traces).
2021-03-12 11:13:35 +01:00
b192fc44f5
heat: refactor cache into granul experiment
2021-03-09 18:45:33 +01:00
7b4da07dbf
heat: add more figures from perf counters
2021-03-09 18:21:59 +01:00
3bcbc62a98
fig: add fig.heat.cache to fig.article
2021-03-09 18:21:22 +01:00
52360c9459
rplot: add viridis R package
2021-03-09 18:20:40 +01:00
71a1396955
ds: parse time with perf generator
2021-03-09 11:07:19 +01:00
b600f64fcc
heat: add cache miss experiment and figure
2021-03-05 18:31:31 +01:00
14fbb1499b
ds: add perf stat parser
...
We can only read one output file by now, located at:
.garlic/perf.csv
2021-03-05 18:29:43 +01:00
c1efba1e65
heat: rename test -> granul experiment
2021-03-05 18:28:32 +01:00
29d7245135
heat: add figure with heatmap
2021-03-05 16:21:13 +01:00
363700eb9a
heat: update test experiment
2021-03-05 16:18:51 +01:00
7e10a43b40
heat: update new app version
...
The blocksize is now specified at runtime
2021-03-05 16:16:06 +01:00
6b6b54f757
timetable: add total_time column
2021-03-03 19:00:36 +01:00
5afe819724
osu: add impi figure
2021-03-03 12:42:19 +01:00
651d91ef79
fig: improve indentation
2021-03-03 12:42:19 +01:00
14211c9895
osu: use ggsave and reduce verbosity
2021-03-03 12:42:19 +01:00
6973f48638
osu: add an experiment for Intel MPI tunning
2021-03-03 12:42:19 +01:00
4786953eeb
garlic: fix self/super with correct scope
...
The callPackage function was trying to find packages in bsc.self before
the self of the input parameters.
2021-03-03 12:42:19 +01:00
a6815dc7cf
fig: add article figure directory
2021-03-03 12:41:31 +01:00
4ffb609261
osu: add figures using the fast generators
2021-03-01 12:21:10 +01:00
1d015c7e1e
ds: add osu fast generators
2021-03-01 12:00:58 +01:00
ed932c9921
osu: add bw test
2021-03-01 11:58:23 +01:00
a36d912022
osu: add multithread benchmark
2021-03-01 11:55:13 +01:00
8373751f67
rplot: remove suffix from input link
...
We may have compressed input datasets
2021-03-01 11:41:28 +01:00
2f7032aca6
pp: remove unused derivations and helpers
2021-03-01 11:40:56 +01:00
6dd41fd96f
fig: use the fast timetable generator by default
2021-03-01 11:38:28 +01:00
09a0348b0e
ds: add fast timetable generator
2021-03-01 11:16:03 +01:00
051a74b85d
srun: allow commands to run before srun
2021-02-26 17:00:09 +01:00
8a77900201
srun: don't expand variables on install
2021-02-26 16:59:29 +01:00
1291b90b7f
user guide: correct typo
2021-02-26 12:18:50 +01:00
8e130604aa
machines: set the hardware revision for MN4
...
This change will cause a rebuild of all experiments.
2021-02-25 20:45:20 +01:00
0015c7e4cd
pp: remove launcher
...
It has now been integrated with resultTree in pp/store.nix
2021-02-25 12:29:12 +01:00
9612c69aec
doc: add garlic configuration section
...
Update the garlicd usage as well.
2021-02-25 11:38:29 +01:00
6e0e2f0bf6
garlicd: drop bscpkgs argument requirement
...
The bscpkgs/default.nix is not longer read, as the garlic tool only
needs it for the fetching (-F), when it runs nix-build.
2021-02-25 11:38:29 +01:00
48820ee2d3
resultTree: garlic must be used from the nix shell
2021-02-25 11:38:29 +01:00
9277e60079
timetable: enable verbose processing
2021-02-25 11:38:29 +01:00
c869b6e3b4
garlic: enable verbose rsync fetch
2021-02-25 11:38:29 +01:00
0b95ea20b7
garlicd: allow manual experiment executions
2021-02-25 11:37:58 +01:00
ceb25e5d18
osu: add figure for latency tests
2021-02-23 17:52:48 +01:00
0c9e89dcc0
osu: update experiments using stdexp
2021-02-23 15:22:56 +01:00
ebcbf91fbe
exec: allow manual specification of program path
2021-02-23 15:22:18 +01:00
3e2b369e3e
garlicd: allow nix builders write to the pipes
2021-02-17 10:28:34 +01:00
d4947a40b9
Fix ssh missing shell
2021-02-17 10:28:11 +01:00
243d022620
cn6: update name and add to the shell
2021-02-15 17:44:20 +01:00
0ee2747215
garlicd: avoid no match fail
...
We check the result in the next if.
2021-02-15 16:32:06 +01:00
5fd2a62684
doc: update garlicd usage from the nix-shell
2021-02-15 16:22:45 +01:00
0e0bf9e7a7
garlic: add shell with the garlic tools
2021-02-15 16:22:06 +01:00
cb5bcd7097
garlicd: add to index and check for error
...
The garlicd is now available under garlic.garlid and it requires the
extra-sandbox-path option to be properly set.
2021-02-15 16:20:06 +01:00
d51fe5db48
garlic tool: ensure the mountpoint is enabled
2021-02-15 16:18:21 +01:00
c36b724e9a
Add experimental garlicd doc
2021-02-15 13:00:19 +01:00
cdf48181e5
user guide: add time measurement sections
2021-02-08 19:05:46 +01:00
a6b7b14d5e
user guide: add initialization time limit
2021-02-08 19:05:46 +01:00
2ca58c46b4
user guide: Add postprocessing section
2021-02-08 19:05:46 +01:00
25208a8158
user guide: add tar.gz target for the web
2021-02-08 19:05:19 +01:00
c46feb4bf2
user guide: use ms macros
...
Added HTML output
2021-02-08 19:05:19 +01:00
4d626bff97
user guide: test ms macros
2021-02-08 19:05:19 +01:00
042876a287
user guide: generate html with css
2021-02-08 19:05:19 +01:00
edd71815eb
pp: fix code block for html
2021-02-08 19:05:19 +01:00
39c360b413
user guide: add readme and branch name conventions
2021-02-08 19:04:51 +01:00
3ce0d3934b
user guide: reorder development
2021-02-08 19:04:45 +01:00
60cab85fc4
user guide: expand the develop section
2021-02-08 19:04:36 +01:00
95809bd2bf
user guide: add stub with mm macro
2021-02-08 19:04:30 +01:00
e5561b8735
control: save total execution time
2021-02-08 14:14:08 +01:00
d4dfbb7501
Remove garlic.ds attribute
...
Datasets are now handled directly when creating the figures, via the
timetable attribute.
2021-02-03 15:34:25 +01:00
b65a442cb0
fig: use timetable attribute in other plots
2021-02-03 15:34:10 +01:00
9c6b7a9f87
timetable: missing quote
2021-02-03 13:51:24 +01:00
d84ccf566b
launcher: fix typo
2021-02-03 13:51:04 +01:00
0faf22a43f
fig: add nbody example using timetable attribute
2021-02-03 13:07:55 +01:00
e89139284a
stdexp: add result and timetable targets
...
These targets allow one experiment to directly refer to another
experiment results, thus a dependency chain can be formed to ensure
execution order.
It also simplifies the dataset definition, as they can be automatically
fetched from the experiment directly.
2021-02-03 12:37:54 +01:00
b453c12253
pp: Add automatic launcher
2021-02-03 12:36:59 +01:00
32d8636ae1
timetable: prevent empty time lines
2021-02-03 12:27:23 +01:00
e4e427b7f6
garlicd: add daemon to launch experiments
2021-02-03 12:08:25 +01:00
fe760c0023
garlic: sent trebuchet output to stderr
2021-02-03 11:50:31 +01:00
4591eca1fd
garlic: Add blackbox diagram
2021-02-01 11:11:54 +01:00
9beda65778
lulesh: add experiment with all variants
2021-01-28 15:27:21 +01:00
0f62151dcf
lulesh: follow garlic git branches
2021-01-28 15:27:21 +01:00
0bc81c8943
tools: add range2 function
2021-01-28 15:00:43 +01:00
a3804e31f2
develop: Simplify packages
2021-01-26 14:59:57 +01:00
ed4a9e1bc3
Add branch diagram
2021-01-25 17:54:24 +01:00
3d0e93b4d3
Add slides pdf
2021-01-14 13:06:20 +01:00
8262fd3104
Add slides for meeting 3
2021-01-13 20:19:28 +01:00
2b9c3da911
Add script stage
2021-01-12 18:19:49 +01:00
aeac1a6068
exec: Force newlines
...
Allow single line commands like pre="true"
2021-01-11 19:15:37 +01:00
130fe39c8e
exec: Abort on error
...
We need exit on the first error, as otherwise we cannot track a bad
execution when no exec is done (when post is not empty).
2021-01-11 18:29:30 +01:00
892fb35d27
nbody: Fix infinite recursion
...
We want to override the previous layer (super), not the last one (self).
2021-01-11 14:30:12 +01:00
afd333adef
creams: fix indentation
2020-12-18 12:43:06 +01:00
76f2ef4b95
creams: add figures for scalability
2020-12-18 12:26:40 +01:00
3b80c2fcb9
creams: Merge hybrid and pure datasets into ss.all
2020-12-17 15:26:25 +01:00
b5cadefca9
Allow a space before time tag
...
This matches the fortran format for creams
2020-12-17 15:24:23 +01:00
Pedro Martinez
203dc9f295
Configure the nanos6 environment and get the right hardware attributes
2020-12-15 19:34:49 +01:00
Pedro Martinez
2e18761b48
Use the 'hw' attributes
2020-12-15 19:11:29 +01:00
Pedro Martinez
748d335a39
Define variables 'ntasksPerNode' and 'cpusPerTask' for each experiment and other minor changes
2020-12-15 19:11:29 +01:00
5a8cc1e514
stdexp: Run python snippets and import the result
2020-12-10 15:41:49 +01:00
7d4db6b6de
control: Exit on error
...
This prevents srun from silently returning with an error, without
actually queueing the job of a run.
2020-12-07 16:33:40 +01:00
756c5dff92
Update PM git server
2020-12-07 13:47:17 +01:00
9a0ea08d72
Reorganization
...
- All garlic stuff is moved into garlic/
- Group the overlay index by sections
- Add a garlic/default.nix link to the main default.nix, so we can
build derivations at garlic/
2020-12-07 13:33:42 +01:00
d70316a25a
fwi: disable nanos6 in ModelGenerator
2020-12-04 11:17:15 +01:00
eb4adf9520
ifsker: initial version
2020-12-03 18:49:28 +01:00
