Merge pull request #207 from ByeongkiJeong/patch-2

Update inference_on_multiple_gpus.md
This commit is contained in:
Cui Junbo
2024-06-04 22:26:45 +08:00
committed by GitHub

View File

@@ -93,7 +93,7 @@ modified device_map OrderedDict([('llm.model.embed_tokens', 0), ('llm.model.laye
```python
load_checkpoint_in_model(
model,
model_path,
MODEL_PATH,
device_map=device_map)
model = dispatch_model(