Skip to content

feat: add support for new openai-compatible endpoint on AskuiAPI in askuiVlmProvider - #290

Merged
philipph-askui merged 4 commits into
mainfrom
feat/google-messages-api
Jul 27, 2026
Merged

feat: add support for new openai-compatible endpoint on AskuiAPI in askuiVlmProvider#290
philipph-askui merged 4 commits into
mainfrom
feat/google-messages-api

Conversation

@philipph-askui

@philipph-askui philipph-askui commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

Adds support for AskUI's new OpenAI-compatible proxy endpoint (/proxy/openai/v1/chat/completions) to AskUIVlmProvider. The backend is inferred from model_id: Claude models route to the Anthropic proxy as before, while Gemini models route to the new endpoint via OpenAIMessagesApi. Gemini requests automatically use a 1000×1000 ScaledCoordinateSpace with a coordinate-augmented system prompt, and the single client argument now accepts either an Anthropic or OpenAI instance. It also fixes multi-turn tool calling for Gemini by preserving its thought_signature (carried in a new extra_content field on ToolUseBlockParam) across turns, which the API requires.

@philipph-askui
philipph-askui force-pushed the feat/google-messages-api branch from 88eb461 to 1192c87 Compare July 3, 2026 14:32
@philipph-askui
philipph-askui marked this pull request as ready for review July 27, 2026 16:21
@philipph-askui
philipph-askui force-pushed the feat/google-messages-api branch from ce59192 to e597076 Compare July 27, 2026 16:25
@philipph-askui
philipph-askui merged commit 646ce0f into main Jul 27, 2026
1 check passed
@philipph-askui
philipph-askui deleted the feat/google-messages-api branch July 27, 2026 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant