Skip to content

KAFKA-20579: Initial producer incremental allocation for uncompressed data#22654

Open
lianetm wants to merge 12 commits into
apache:trunkfrom
lianetm:lm-producer-dyn-1
Open

KAFKA-20579: Initial producer incremental allocation for uncompressed data#22654
lianetm wants to merge 12 commits into
apache:trunkfrom
lianetm:lm-producer-dyn-1

Conversation

@lianetm

@lianetm lianetm commented Jun 23, 2026

Copy link
Copy Markdown
Member

Initial partial implementation for KIP-1332 (producer incremental
allocation strategy).

This PR includes:

  • new producer config for allocation strategy (incremental/full)
  • initial implementation of the incremental strategy: supports
    uncompressed data only (no growth support), extra-copy on send (linked
    chunks are flattened into a new buffer)
  • unit and integration tests (running existing Producer integration
    tests with the new strategy + new ones)

Support for compressed data and network layer improvements will come in
follow-up PRs.

@lianetm lianetm requested a review from junrao June 23, 2026 18:34
@github-actions github-actions Bot added core Kafka Broker producer build Gradle build or GitHub Actions clients labels Jun 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build Gradle build or GitHub Actions ci-approved clients core Kafka Broker producer tools

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants