transformers-community
/

group-beam-search

Text Generation

custom_generate

text-generation-inference

Model card Files Files and versions

RaushanTurganbay HF Staff commited on 15 days ago

Commit

1a28162

·

verified ·

1 Parent(s): a52f0cd

Update custom_generate/generate.py

Files changed (1) hide show

custom_generate/generate.py +1 -1

custom_generate/generate.py CHANGED Viewed

@@ -158,7 +158,7 @@ def _group_beam_search(
     logits_processor: LogitsProcessorList,
     stopping_criteria: StoppingCriteriaList,
     generation_config: GenerationConfig,
-    synced_gpus: bool,
     streamer: Optional["BaseStreamer"] = None,
     **model_kwargs,
 ):

     logits_processor: LogitsProcessorList,
     stopping_criteria: StoppingCriteriaList,
     generation_config: GenerationConfig,
+    synced_gpus: bool = False,
     streamer: Optional["BaseStreamer"] = None,
     **model_kwargs,
 ):