Help setting up chroma server

[M-Subhan1]

I went through the docs and set up a local chroma server with docker + system services. However, I couldn't find the configuration details around updating config to use the server to use this server. Based on my current config, it keeps spawning a new server with a random port since the other one is busy (I do understand why from docs). How do I update so it uses the local instance without spawning a server itself each time a query is made.

{
  "database": {
    "provider": "chromadb",
    "host": "localhost",
    "port": 8000
  }
}

[Davidyz]

That doesn't look like a proper VectorCode config structure.

There's a sample config here in the wiki. You should use the db_url key to specify the database. In your case, it would be "db_url": "http://localhost:8000".

[M-Subhan1]

I updated to use this config. However, instead of using my chroma_db server that I've set up using services, it spins up a new one for each query. Is it possible to use the existing server rather than vectorcode spinning up a new one for each use?

[Davidyz]

Are you suggesting that you want the bundled Chromadb server to just stay there after a query? I don't think it's a good idea, mostly because there'd be no way (or rather, no easy and cross-platform way) of making sure that the process is safely terminated, making it more vulnerable to data loss. It'll be much safer if it's managed by tools like systemd and Docker.

[M-Subhan1]

No no. I had a systemd service already setup. The issue was instructing the vectorcode client / cli to use the existing service. For me, it kept trying to create new services.

The issue turned out to be the config file was misplaced. I was able to get this working with the solution you proposed :)