Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about vocab_size #8

Open
payphone131 opened this issue Dec 4, 2024 · 0 comments
Open

about vocab_size #8

payphone131 opened this issue Dec 4, 2024 · 0 comments

Comments

@payphone131
Copy link

hi, i ran into some problems when reproducing image hijacks. i found the vocab_size in config.json of llava-v1-0719-336px-lora-merge-vicuna-13b-v1.3 is 32000, but your code initializes an lm_head with out_features of 32001, which results in consequent size mismatch. i would appreciate it if you could tell me how to fix this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant