Feature Reequest: Multi model cli tools: Add a possibility to specify a image in conversation mode plus tab auto completion for path

[domasofan]

Hi all,

image to text cli tools: would be great if file path and name using tab auto
completion could be made possible when submitting the file during the
chat session which i recommended in #12982.
I somewhere read that i can submit somewhere a image in a chat session with the /image command though i wasn't able to enable conversation mode in the multi model cli tools.

Greetings,
Simon

[KaareLJensen]

It is possible to use the llama-mtmd-cli.exe tool with images in conversation mode. But the prompt do not accept tab auto completion.

Run the help option (llama-mtmd-cli.exe -h) and lastly you get:

Experimental CLI for multimodal

Usage: .\llama-mtmd-cli.exe [options] -m <model> --mmproj <mmproj> --image <image> -p <prompt>

  -m and --mmproj are required
  -hf user/repo can replace both -m and --mmproj in most cases
  --image and -p are optional, if NOT provided, the CLI will run in chat mode
  to disable using GPU for mmproj model, add --no-mmproj-offload

So you have two option: Chat mode or not.

If you use the -p <prompt> option the CLI will not be in chat mode and just return an answer. Using this you can optional add one or more images repeating the --image <image> option where is the the image file path.

If you do not use the -p <prompt> option the CLI will enter chat mode.
In this case you can use the chat prompt prefix /image which is also explained by the tool's initial output:

 Running in chat mode, available commands:
   /image <path>    load an image
   /clear           clear the chat history
   /quit or /exit   exit the program

Hope this helps.

[domasofan]

Hi @KaareLJensen ,

Thanks for the info.
That sounds great.

Greetings,
Simon

[KaareLJensen]

I have to correct myself, as I found out that using llama-mtmd-cli.exe with multiple --image <image> input is not working as expected as written in the help text. I posted a bug abou this, see #13704

Still using the chat mode with the prompt prefix /image work just fine.

[KaareLJensen]

The issue with llama-mtmd-cli.exe with multiple --image <image> was just fixed by #13784

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.