Ben Brandt 57424e4743 language_models: Update tiktoken-rs to support newer models (#30951) ...

I was able to get this fix in upstream, so now we can have simpler code
paths for our model selection.

I also added a test to catch if this would cause a bug again in the
future.

Release Notes:

- N/A

2025-05-19 11:40:36 +00:00

..

src

language_models: Update tiktoken-rs to support newer models (#30951)

2025-05-19 11:40:36 +00:00

Cargo.toml

language_models: Dynamically detect Copilot Chat models (#29027)

2025-05-12 11:28:41 +00:00

LICENSE-GPL

Add language_models crate to house language model providers (#20945)

2024-11-20 18:49:34 -05:00