rarias/jungle
rarias/jungle
2
0
Fork 3
Code Issues 53 Pull Requests 10 Actions Packages Projects Releases Wiki Activity

Cannot sync clock via NTP #14

New Issue
Closed
opened 2023-04-26 10:52:36 +02:00 by rarias · 4 comments
rarias commented 2023-04-26 10:52:36 +02:00 (Migrated from pm.bsc.es)
Copy Link

As the compute nodes cannot communicate to the outside world via the 123 UDP port, we cannot reliably sync the clocks.

As the compute nodes cannot communicate to the outside world via the 123 UDP port, we cannot reliably sync the clocks.
rarias commented 2023-04-26 10:59:26 +02:00 (Migrated from pm.bsc.es)
Copy Link

Consider enabling PTP, as the ethernet card have hardware support:

[nix-shell:/config/xeon01]# ethtool -T eno1
Time stamping parameters for eno1:
Capabilities:
        hardware-transmit
        software-transmit
        hardware-receive
        software-receive
        software-system-clock
        hardware-raw-clock
PTP Hardware Clock: 0
Hardware Transmit Timestamp Modes:
        off
        on
Hardware Receive Filter Modes:
        none
        ptpv1-l4-sync
        ptpv1-l4-delay-req
        ptpv2-event
Consider enabling PTP, as the ethernet card have hardware support: ``` [nix-shell:/config/xeon01]# ethtool -T eno1 Time stamping parameters for eno1: Capabilities: hardware-transmit software-transmit hardware-receive software-receive software-system-clock hardware-raw-clock PTP Hardware Clock: 0 Hardware Transmit Timestamp Modes: off on Hardware Receive Filter Modes: none ptpv1-l4-sync ptpv1-l4-delay-req ptpv2-event ```
rarias commented 2023-04-26 12:03:48 +02:00 (Migrated from pm.bsc.es)
Copy Link

Using PTP we can synchronize the clocks down to 10-20 nanoseconds:

phc2sys[61609.454]: CLOCK_REALTIME rms   10 max   18 freq -29752 +/-   9 delay   920 +/-   8
phc2sys[61619.456]: CLOCK_REALTIME rms   13 max   25 freq -29745 +/-  10 delay   922 +/-   8
phc2sys[61629.457]: CLOCK_REALTIME rms   14 max   26 freq -29744 +/-  13 delay   921 +/-   8
phc2sys[61639.459]: CLOCK_REALTIME rms   19 max   30 freq -29744 +/-  17 delay   917 +/-  10
phc2sys[61649.460]: CLOCK_REALTIME rms   11 max   17 freq -29739 +/-   9 delay   918 +/-   8
Using PTP we can synchronize the clocks down to 10-20 *nanoseconds*: ``` phc2sys[61609.454]: CLOCK_REALTIME rms 10 max 18 freq -29752 +/- 9 delay 920 +/- 8 phc2sys[61619.456]: CLOCK_REALTIME rms 13 max 25 freq -29745 +/- 10 delay 922 +/- 8 phc2sys[61629.457]: CLOCK_REALTIME rms 14 max 26 freq -29744 +/- 13 delay 921 +/- 8 phc2sys[61639.459]: CLOCK_REALTIME rms 19 max 30 freq -29744 +/- 17 delay 917 +/- 10 phc2sys[61649.460]: CLOCK_REALTIME rms 11 max 17 freq -29739 +/- 9 delay 918 +/- 8 ```
rarias commented 2023-06-30 15:18:41 +02:00 (Migrated from pm.bsc.es)
Copy Link

mentioned in issue #24

mentioned in issue #24
rarias commented 2023-07-03 16:14:26 +02:00 (Migrated from pm.bsc.es)
Copy Link

mentioned in merge request !14

mentioned in merge request !14
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
ceph
ci
config
cross
hw
io
kernel
mpi
net
nix
ops
repair
slurm
No Label
net
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
abonerib arocanon varcila rarias
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: rarias/jungle#14
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?