Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training to get paragraph vectors D #10

Open
chenheh opened this issue Apr 23, 2015 · 1 comment
Open

Training to get paragraph vectors D #10

chenheh opened this issue Apr 23, 2015 · 1 comment

Comments

@chenheh
Copy link

chenheh commented Apr 23, 2015

Hi there,

I've read the paper by Quoc Le and Tomas Mikolov.
It seems that, at the first stage of the algorithm, what it does is training to get word vectors W, softmax weights U, b and paragraph vectors D on already seen paragraph.

But in your demo.py script, at stage one, it trains to get word vectors W, softmax weights U and b, using Word2Vec. It doesn't get the paragraph vectors D.
At the second stage of your demo.py script, it uses the word vectors obtained in stage one to get paragraph vectors D for new paragraphs.

It seems what your scripts do is not what the paper says.

Correct me if I am wrong.
Thanks.

He Chen

@mug2mag
Copy link

mug2mag commented Jan 10, 2017

@chenheh hi, have you know how to get paragraph vectors D now ? I really want to know how. But from the tutorial, the Paragraph Vector frame just can get the word vectors like word2vec.
Very appreciate it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants