Skip to content

[Kafka Sink] Updated docs - #6606

Closed
chernser wants to merge 3 commits into
mainfrom
07/31/26/kafka_connect_buffer_config
Closed

[Kafka Sink] Updated docs #6606
chernser wants to merge 3 commits into
mainfrom
07/31/26/kafka_connect_buffer_config

Conversation

@chernser

@chernser chernser commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Updated compatibility matrix
  • Added client_version config property
  • Added description about client's network buffer configuration

Checklist

@chernser
chernser requested review from a team as code owners July 31, 2026 19:03
@vercel

vercel Bot commented Jul 31, 2026 •
edited
Loading

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
clickhouse-docs Error Error Aug 4, 2026 1:26am
clickhouse-docs-jp Building Building Preview Aug 4, 2026 1:26am
3 Skipped Deployments
Project Deployment Actions Updated (UTC)
clickhouse-docs-ko Ignored Ignored Preview Aug 4, 2026 1:26am
clickhouse-docs-ru Ignored Ignored Preview Aug 4, 2026 1:26am
clickhouse-docs-zh Ignored Ignored Preview Aug 4, 2026 1:26am

Request Review

@github-actions

github-actions Bot commented Jul 31, 2026

Copy link
Copy Markdown

Thanks for contributing to the ClickHouse documentation!

We’ve moved documentation development to the main ClickHouse/ClickHouse repository. For future documentation changes, please open your pull request there, with changes under the docs/ directory.

We’ll continue reviewing this pull request here during the transition, and it will be transferred as part of the migration. You don’t need to reopen it.

See the documentation README for more information.

BentsiLeviav
BentsiLeviav reviewed Aug 2, 2026
View reviewed changes
Comment thread docs/integrations/data-ingestion/kafka/kafka-clickhouse-connect-sink.md Outdated

The v2 client copies data between the socket and application memory through a buffer controlled by the `client_network_buffer_size` client option, which defaults to 300,000 bytes. A larger buffer can improve throughput on high-latency or high-bandwidth links, but the buffer is allocated per pooled connection, so oversizing it raises memory use and JVM garbage collection pressure across every connector task.

The connector does not expose that option. Entries in `clickhouseSettings` are applied as query-level server settings, so `client_network_buffer_size` set there reaches ClickHouse as an unrecognized setting instead of resizing the client buffer. See [client configuration](/integrations/language-clients/java/client#client-configuration) for the full list of options available when you embed the Java client directly.

@BentsiLeviav BentsiLeviav Aug 2, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Based on that, is there no way to pass Java client settings today? Is this section wrong https://clickhouse.com/docs/integrations/connectors/data-ingestion/kafka/kafka-clickhouse-connect-sink#connection-pooling?

@chernser chernser Aug 3, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree - this is confusing.
It mean connector has no own parameter - will rewrite.

@chernser chernser Aug 4, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated.

@CLAassistant

CLAassistant commented Aug 4, 2026

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ chernser
❌ Sergey Chernov

Sergey Chernov seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

@dhtclk dhtclk mentioned this pull request Aug 4, 2026
Merged
@Blargian

Blargian commented Aug 4, 2026

Copy link
Copy Markdown
Member

Closing in favour of ClickHouse/ClickHouse#113222

@Blargian Blargian closed this Aug 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@BentsiLeviav BentsiLeviav BentsiLeviav left review comments

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@chernser @CLAassistant @Blargian @BentsiLeviav