参考链接
1）Baidu All Reduce：
http://andrew.gibiansky.com/
https://github.com/baidu-research/baidu-allreduce
2）Horovod：
https://arxiv.org/pdf/1802.05799.pdf
All Reduce算法汇总
原文：https://www.cnblogs.com/yangwenhuan/p/11390823.html
