feat: use allow changing the Copilot model used #2

[AntoineGS]

Depends on PR #372
Addition of github_model option, used as such:

return {
  "zbirenbaum/copilot.lua",
  config = function()
    require("copilot").setup {
      copilot_model = "gpt-4o-copilot",
    }
  end,
}

Big thank to @trixnz for figuring out the required configs!

Fixes #365

[AntoineGS]

I was not sure on the config placement, let me know if you prefer it elsewhere!
Also, passing vscode-chat does not seem to cause problems with the 3.5 model so I figured I would leave it in no matter the model.

[HOnatToprak]

When I set wrong model name, I can see on LSP logs that it fallbacks to default one. It would be nice to validate it in on setup and print error message.

[AntoineGS]

When I set wrong model name, I can see on LSP logs that it fallbacks to default one. It would be nice to validate it in on setup and print error message.

Hmm the downside to validating it before the LSP means that we would need to add future models whenever they come out. Though it took some time for 4o to come out so it might not be much maintenance.

I'll wait for @zbirenbaum to chip in on this one as I am divided on this!

[praveenperera]

Anyone know what to set it for, for Claude 3.7? And is there a way to check which model is being used?

[AntoineGS]

Claude 3.7 is only for the chat, not the autocomplete.
For chat you could check out CopilotChat.nvim which I believes supports using Claude 3.7.
The example config above is the latest model you can use, even in VSCode.

[luanlouzada]

nothing yet?

[grantjayy]

Can we get this merged @zbirenbaum? I was surprised to learn that I've been using GPT 3.5 this whole time

[AntoineGS]

Assuming @zbirenbaum is too busy to review and merge the PRs (life hapens!), you can always use my repo in your copilot.lua configuration:

return {
  "AntoineGS/copilot.lua",
  config = function()
    require("copilot").setup {
      copilot_model = "gpt-4o-copilot",
    }
  end,
}

It does include some other changes that are either in PRs or going to be on PRs:
master...AntoineGS:copilot.lua:master

[grantjayy]

Love it! Thank you!

[AntoineGS]

No problem,
@zbirenbaum I would be happy to help maintain the project if ever you are looking for another maintainer!

[jrock2004]

Is this going to add support for models like Claude that is supported in vscode?

[AntoineGS]

Claude 3.7 is only for the chat, not the autocomplete. For chat you could check out CopilotChat.nvim which I believes supports using Claude 3.7. The example config above is the latest model you can use, even in VSCode.

We should sticky this 😂

[jrock2004]

Sorry, my bad for bring up old wounds :)

[nickgnd]

Hey 👋
thanks a lot for the project.

I tried to configure copilot.lua to use claude-3.7-sonnet with the copilot_model option, but apparently it is ignored.

Checking the LSP logs

[default] User selected model claude-3.7-sonnet is not in the list of generic models: gpt-4o-copilot, falling back to default model."

I tried these variants:

• claude-3.7-sonnet
• copilot-claude-3.7-sonnet
• claude-3.7-sonnet-copilot

None of them works and if I asked in the chat (via CopilotChat) which models is used under the hood it confirms that it is using OpenAI ChatGPT 4, although it might hallucinate 😬 .

What I don't understand is how the LSP is detecting the generic models 🤔 As far as I know, Claude should be enabled for the repositories I'm working on. Any hint on how I can debug it furhter? Thanks

[bagaze]

@nickgnd These models are not available for completion (only for chat/agent work).

See in VSCode, the only available model is gpt-4o-copilot