Skip to content

Commit

Permalink
cleanup
Browse files Browse the repository at this point in the history
Signed-off-by: Mayank Mishra <[email protected]>
  • Loading branch information
mayank31398 committed Oct 24, 2024
1 parent 26c2aaf commit f58d1a5
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion dolomite_engine/hf_models/mixins/dense_TP/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ def __init__(self, config: CommonConfig, *args, **kwargs):

super().__init__(config, *args, **kwargs)

if self._tied_word_embeddings:
if self.pp_world_size > 1 and self._tied_word_embeddings:
raise NotImplementedError()


Expand Down

0 comments on commit f58d1a5

Please sign in to comment.