Collectives & Interconnects
0 questions
NCCL runs all-reduce, all-gather and reduce-scatter as ring or tree algorithms over NVLink, InfiniBand or RoCE. Interviewers ask you to estimate all-reduce cost and to debug an NCCL hang.
questions
no questions here yet
this part of the tree is still being written
>
0 questions in this topic or below it