learning-at-home / hivemind

What it does

• Distributed training without a master node. Distributed Hash Table allows connecting computers in a decentralized
• Fault-tolerant backpropagation. forward and backward passes succeed even if some nodes are unresponsive or take too
• Decentralized parameter averaging. iteratively aggregate updates from multiple workers without the need to
• Train neural networks of arbitrary size. parts of their layers are distributed across the participants with the