The main website of the BSC is failing every day around 3:00 AM for almost one hour, so it is not a very good target. Instead, google.com is used which should be more reliable. The same robots.txt path is fetched, as it is smaller than the main page. Reviewed-by: Aleix Roca Nonell <aleix.rocanonell@bsc.es>
Description
Languages
Nix
87.2%
C++
7%
Shell
3.2%
Python
1.3%
CSS
0.6%
Other
0.5%