Code with local AI, linux & VSCode

install ollama: https://www.ollama.com/download/linux
how to download a model from https://www.ollama.com/search
- choose gpt-oss, deepseek-r1, gemma or qwen3-coder
- type in the terminal “ollama pull gpt-oss:20b”
install “continue” extension in VSCode https://docs.continue.dev/getting-started/install
drag the “continue” extenstion icon from the left to the right side
configure the extension:
- there is no need to login
- in the “select model” under the chat, select “Ollama” and the installed model
- if you ask anything, it will throw an error that the model can’t be found
- In the config.yaml that should have been opened (/home/$user/.continue/config.yaml) modify “models” section for this:
```
models:
  - name: gpt-oss:20b
    provider: ollama
    model: gpt-oss:20b
    roles:
      - chat
      - edit
      - apply
      - autocomplete
```
  This is because there is some kind of bug (right now) and it appends “openai” in the model name, it doesn’t use the proper name we pulled before from ollama repository.
add another models depending on your hardware capabilities:
- RTX 3090
  - gpt-oss:20b
  - deepseek-r1:14b
  - qwen3-coder:30b
  - llama3.1:8b

Navigation menu