Skip to content

Commit be504d3

Browse files
CyCle1024irexyc
authored andcommitted
[Fix] device args in chat cli when using pytorch engine (#3999)
* [Fix] device args in chat cli when using pytorch engine * [Fix] change device into device_type in chat cli
1 parent 1f75dd6 commit be504d3

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

lmdeploy/cli/chat.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@ def build_pipe(model_path, backend, **kwargs):
2525
else:
2626
engine_config = PytorchEngineConfig()
2727
for key, value in kwargs.items():
28+
key = 'device_type' if key == 'device' else key
2829
if hasattr(PytorchEngineConfig, key):
2930
setattr(engine_config, key, value)
3031
if kwargs.get('adapters', None):

0 commit comments

Comments
 (0)