首页 > 其他 > 详细

Distributed Representations of Words and Phrases and their Compositionality

时间:2016-10-18 11:31:58      阅读:194      评论:0      收藏:0      [点我收藏+]

Skip-gram model is to find word representations that are useful for predicting the surrounding words in a sentence or a document

given a sequence of training words w1, w2, w3, . . . , wT , the objective of the Skip-gram model is to maximize the average log probability

 

Hierarchical Softmax

 

Negative Sampling

Noise Contrastive Estimation

differentiate data from noise by means of logistic regression

Distributed Representations of Words and Phrases and their Compositionality

原文:http://www.cnblogs.com/learnmuch/p/5972128.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!