The main website of the BSC is failing every day around 3:00 AM for almost one hour, so it is not a very good target. Instead, google.com is used which should be more reliable. The same robots.txt path is fetched, as it is smaller than the main page. Reviewed-by: Aleix Roca Nonell <aleix.rocanonell@bsc.es>
Description
Languages
Nix
87.7%
C++
7.1%
Shell
2.5%
Python
1.4%
CSS
0.6%
Other
0.5%