You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Directly importing a fine-tuned T5 model, like willwade/t5-small-spoken-typo fails with the following exception:
python t5.py --model willwade/t5-small-spoken-typo --prompt "grammar: A tasty apple"
File "./mlx-examples/t5/t5.py", line 495, in <module>
model, tokenizer = T5.from_pretrained(args.model, dtype)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./mlx-examples/t5/t5.py", line 427, in from_pretrained
model.load_weights(list(weights.items()))
File "/mlx/nn/layers/base.py", line 178, in load_weights
raise ValueError(f"Received parameters not in model: {extras}.")
ValueError: Received parameters not in model: decoder.layers.1.dense.wi.weight encoder.layers.0.dense.wi.weight decoder.layers.3.dense.wi.weight encoder.layers.1.dense.wi.weight encoder.layers.5.dense.wi.weight encoder.layers.3.dense.wi.weight encoder.layers.4.dense.wi.weight decoder.layers.0.dense.wi.weight decoder.layers.2.dense.wi.weight encoder.layers.2.dense.wi.weight decoder.layers.5.dense.wi.weight decoder.layers.4.dense.wi.weight.
After a recent commit d72fdeb, there is no longer a convert.py for T5 models.
Reverting d72fdeb and running convert.py to generate an .npz restores the expected functionality.
The text was updated successfully, but these errors were encountered:
Directly importing a fine-tuned T5 model, like
willwade/t5-small-spoken-typo
fails with the following exception:After a recent commit d72fdeb, there is no longer a
convert.py
for T5 models.Reverting d72fdeb and running
convert.py
to generate an.npz
restores the expected functionality.The text was updated successfully, but these errors were encountered: