-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Output is not as expected(politeness does not getting transferred) #15
Comments
@souro I am using the same input as yours, my output for the first sentence was OK, same as the output in the README. But the second one was same as yours. |
Hi, As you can imagine, there's several places where randomness can play a role (i.e., you might not get the exact same output). Perhaps you can using the pre-trained models https://drive.google.com/drive/folders/1tXLC4WbXc_WLgvQu2mTa3jDe0efZ3dz1. |
Thank you. Let me check with this. |
@madaan but getting the below error, so I renamed the pretrained models, RuntimeError: Error(s) in loading state_dict for Transformer: and RuntimeError: Error(s) in loading state_dict for Transformer: I am using configuration setting as mentioned in this repo without any changes. Can you please let me know if any changes required or not? |
This seems like there could be a difference between the vocabulary sizes of the loaded model and the initialized model. This could happen if you are initializing the model with the wrong vocabulary size. Could you give more details/code where you initialize the model and load the pre-trained model? |
@TanmayParekh Thank you for your reply ... Code I am using (again without a single change) ... I just have replaced the pretrained model within the location /tagger-generator/tag-and-generate-train/models/politeness/bpe/ |
Just trying to compare the potential cause for the difference in the vocabs, I want to clarify that you are using the BPE segmentation for words (using the |
so which version of sentencepiece shall I use? |
@madaan |
@madaan |
Did you all try sentencepiece version |
I have followed your tutorial to generate the output fully. I have not changed a tiny bit. Did whatever has been mentioned in your github tutorial. But not getting the expected output. I have also seen the another open issue same like mine and I have followed your new tutorial but not getting the output as you have mentioned. Please let me know how you can help me to track the issue? As I am doing exactly the same thing you mentioned and same data and all, but still let me know if I have to upload any file from my side to track the issue? Thank you.
Input:
send me the text files.
look into this issue.
Output:
send me copy of the text files.
look forward to looking into this issue.
The text was updated successfully, but these errors were encountered: