Skip to content

Issue #8629 : Document max tokens and context size in AI Provider pre… - #8853

Merged
mattcasters merged 1 commit into
apache:mainfrom
bamaer:8629
Oct 11, 2026
Merged

mattcasters merged 1 commit into
apache:mainfrom
bamaer:8629

Conversation

@bamaer

@bamaer bamaer commented Oct 10, 2026

Copy link
Copy Markdown
Contributor

…cedence

The pgvector "Skip if empty" filter option and the AI Provider precedence docs were done in #8630. Since then, #8784 made the provider also override Max New Tokens, and the Ollama context size, which defaults to 16384 when the provider leaves it empty. Add both to the precedence table and the AI Provider page, and stop saying max tokens always come from the transform.

Please add a meaningful description for your change here


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Run mvn clean install apache-rat:check to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
  • If you have a group of commits related to the same change, please squash your commits into one and force push your branch using git rebase -i.
  • Mention the appropriate issue in your description (for example: addresses #123), if applicable.

To make clear that you license your contribution under the Apache License Version 2.0, January 2004
you have to acknowledge this by using the following check-box.

…er precedence

The pgvector "Skip if empty" filter option and the AI Provider precedence docs were done in apache#8630. Since then, apache#8784 made the provider also override Max New Tokens, and the Ollama context size, which defaults to 16384 when the provider leaves it empty. Add both to the precedence table and the AI Provider page, and stop saying max tokens always come from the transform.
@mattcasters
mattcasters merged commit 32907c2 into apache:main Oct 11, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants