Code with local AI, linux & VSCode

• install ollama: https://www.ollama.com/download/linux

• how to download a model from https://www.ollama.com/search

  • choose gpt-oss, deepseek-r1, gemma or qwen3-coder

  • type in the terminal “ollama pull gpt-oss:20b”

• install “continue” extension in VSCode https://docs.continue.dev/getting-started/install

• drag the “continue” extenstion icon from the left to the right side

• configure the extension:

  • there is no need to login

  • in the “select model” under the chat, select “Ollama” and the installed model

  • if you ask anything, it will throw an error that the model can’t be found

  • In the config.yaml that should have been opened (/home/$user/.continue/config.yaml) modify “models” section for this:

    models:
      - name: gpt-oss:20b
        provider: ollama
        model: gpt-oss:20b
        roles:
          - chat
          - edit
          - apply
          - autocomplete

    This is because there is some kind of bug (right now) and it appends “openai” in the model name, it doesn’t use the proper name we pulled before from ollama repository.

• add another models depending on your hardware capabilities:

  • RTX 3090

    • gpt-oss:20b

    • deepseek-r1:14b

    • qwen3-coder:30b

    • llama3.1:8b