NLP-分布表示(distributional representation)与分布式表示(distributed representation)

写论文好纠结这两个东西的概念。。。现对网上查到的资料进行以下整理。。。

distributed representation&distributional representation

---

1.关于Manning 在2015 年深度学习暑期学校（蒙特利尔）的澄清

Distributed: A concept is represented as continuous activation levels in a number of elements. Like a dense word embedding, as opposed to 1-hot vectors.
Distributional: Meaning is represented by contexts of use. Word2vec is distributional, but so are count-based word vectors, as we use the contexts of the word to model the meaning.

含义

• Distributed：分布式描述的是若干元素的连续表示形式，如稠密的词嵌入向量表示，与之相反的是独热向量。
• Distributional：使用词语的上下文来表示其语义，Word2vec和基于计数的词向量表示都是分布表示，因为我们都使用词语的上下文来表征它的含义。