Skip to content

Feature clarification: AI provider enhancements — thinking mode, vision image input, and API host normalization #1595

Description

@lb1038678031

Background

We run a self-hosted Apache Answer as a community FAQ site, with an
OpenAI-compatible LLM gateway (SenseNova). While integrating the AI feature we
hit three concrete gaps. Following @LinkinStars's suggestion on #1594, this
issue clarifies the proposed feature set before the PR is resubmitted.

Proposed enhancements

1. API host normalization (bugfix)

The admin AI settings accept an "API host", but the model-listing endpoint
concatenates api_host + "/v1/models" while the chat client auto-appends
/v1. A base URL that already contains /v1 — the normal convention for
OpenAI-compatible gateways (SenseNova, SiliconFlow, OneAPI relays, vLLM,
SGLang...) — therefore produces /v1/v1/models and fails with the gateway's
NOT_FOUND error, which is passed through to the UI verbatim.

Proposal: a shared NormalizeAPIHost() helper (trim whitespace/trailing
slashes, append /v1 when missing, keep /v1beta/* endpoints intact) used by
both code paths, plus concise upstream error summaries instead of echoing raw
response bodies.

2. Per-provider thinking mode switch

Reasoning-capable models are increasingly common (DeepSeek V4, Qwen3,
SenseNova, ...). Proposal: an admin switch per AI provider that injects the
OpenAI-compatible enable_thinking: true flag into chat completion requests.
The existing reasoning_content streaming/rendering path already displays the
thought process, so no front-end change is required for display.

3. Per-provider vision (image input) switch

Proposal: an admin switch enabling image attachments in AI conversations —
up to 4 PNG/JPEG/WebP images (≤4 MB decoded each) sent as base64 data URLs or
HTTPS links, converted to MultiContent parts. The switch is exposed via site
info (ai_vision_enabled) so the chat input only shows the attach button for
vision-capable providers. History records keep a textual placeholder instead
of persisting image data, so no DB schema change is needed.

Scope / non-goals

  • No new provider protocols (OpenAI-compatible only); Anthropic removed from
    the default provider list since the backend speaks the OpenAI protocol.
  • No multi-provider routing or per-user model selection.
  • No persistence of image attachments in conversation history.

Related

Happy to hear feedback on the scope before resubmitting. Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions