Skip to content

Conversation

mudler
Copy link
Owner

@mudler mudler commented Aug 26, 2025

Description

This pull request adds new model definitions for the InternVL3.5 multimodal family to the gallery/index.yaml file. The changes introduce support for different quantization levels of the InternVL3.5-30B-A3B model, including associated metadata, download URLs, and file references.

Model additions and configuration:

  • Added a new entry (internvl35) for the opengvlab_internvl3_5-30b-a3b model, including metadata such as description, tags, license, and links to Hugging Face resources.
  • Defined model-specific overrides for parameters and projection files, specifying the default quantization (Q4_K_M) and associated file hashes and URIs.

Support for multiple quantization levels:

  • Introduced a merged variant for the opengvlab_internvl3_5-30b-a3b-q8_0 model, specifying the Q8_0 quantization and corresponding file information.

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Copy link

netlify bot commented Aug 26, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit e373497
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/68adc5e6a8e1d20008e4b4e7
😎 Deploy Preview https://deploy-preview-6143--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@mudler mudler merged commit 1b3f660 into master Aug 26, 2025
29 checks passed
@mudler mudler deleted the models/opengvlab_internvl3_5-30b-a3b branch August 26, 2025 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant