Add std::unordered_set support and a helper BuildList to dedup list build handlers - #277
Conversation
|
The following sections might be updated with supplementary metadata relevant to reviewers and maintainers. ReviewsSee the guideline for information on the review process.
If your review is incorrectly listed, please copy-paste ConflictsReviewers, this pull request conflicts with the following ones:
If you consider this pull request important, please also help to review the conflicting pull requests. Ideally, start with the one that should be merged first. |
e1914bb to
5b9db34
Compare
5b9db34 to
00c9a8e
Compare
ryanofsky
left a comment
There was a problem hiding this comment.
Code review ACK 00c9a8e. This is a well-implemented change that simplifies bitcoin/bitcoin#29409, and could help other places, since unordered_sets are used for various things in bitcoin core, and it makes sense to allow them to be easily passed over capnproto interfaces.
I believe there could be more dedup adding a ReadList too. I could do that as a follow-up if desirable
Yes this would be a nice followup, especially since type-set.h and type-unordered-set.h files are almost exact duplicates of each other and other read functions are very similar. Might be possible to write a generic ReadList that works for all containers by taking an init(size) callback and an emplace(args...) callback.
|
The new optional_int field on master uses a proper camelCase capnp name (optionalInt) with $Proxy.name mapping to a snake_case C++ member, which reads cleaner than the older lowercase style (setint, vbool). Should I follow that pattern here and rename unorderedsetint to an unorderedSetInt capnp field with a snake_case C++ member? No need to touch the existing setint/vbool fields here. I believe that cleanup could be a separate PR. |
Anything seems fine to me, would choose whatever seems cleanest to you. Feel free to include a commit renaming existing fields in this PR too if you'd like |
00c9a8e to
81e508f
Compare
81e508f to
9de4b88
Compare
| std::set<int> setint; | ||
| std::vector<bool> vbool; | ||
| std::set<int> set_int; | ||
| std::vector<bool> v_bool; |
There was a problem hiding this comment.
In commit "test: use camelCase + $Proxy.name for FooStruct fields" (9de4b88)
Not important but vector_bool would seem more consistent with other field names
There was a problem hiding this comment.
I agree. If in the future I touch these code lines again I will apply this suggestion. Thanks for the feedback!
8412fcdc65 Merge bitcoin-core/libmultiprocess#295: Mark Waiter m_cv as guarded by m_mutex 1593ee2d18 Merge bitcoin-core/libmultiprocess#294: test: Add passDouble smoke test 9885d7dd33 Merge bitcoin-core/libmultiprocess#286: proxy-client: fix TSan data race in clientDestroy fa35501c4f Mark Waiter m_cv as guarded by m_mutex faaedb11f8 test: Add passDouble smoke test 733c64318d Merge bitcoin-core/libmultiprocess#292: type-number: fix clang-tidy modernize-use-nullptr 9cc3479ab3 Merge bitcoin-core/libmultiprocess#291: cmake: Add `mp_headers` custom target 201abd9e3a Merge bitcoin-core/libmultiprocess#289: cmake: make target_capnp_sources use CURRENT dirs 99820c8aec Merge bitcoin-core/libmultiprocess#279: doc: Add comments to FIELD_* constants in proxy.h 73b985540c Merge bitcoin-core/libmultiprocess#278: doc: Fix and expand design.md e7e91b2e23 Merge bitcoin-core/libmultiprocess#277: Add std::unordered_set support and a helper BuildList to dedup list build handlers 91a951f59a tidy fix: modernize-use-nullptr 16362f42d0 cmake: Add `mp_headers` custom target 615a94fe3a cmake: document ONLY_CAPNP option in target_capnp_sources 90982f75c6 mpgen: iwyu changes required by previous commit 25bb3e67f3 proxy-client: fix TSan data race in clientDestroy 620f297f31 cmake: make target_capnp_sources use CURRENT dirs 9de4b885aa test: use camelCase + $Proxy.name for FooStruct fields 011b91793d type: add std::unordered_set support 20d19b9644 proxy: add BuildList helper and dedup map/set/vector build handlers e863c6cdf6 doc: Add comments to FIELD_* constants in proxy.h 18db0ab957 doc: Fix and expand design.md 61de697536 Merge bitcoin-core/libmultiprocess#273: proxy-client: tolerate exceptions from remote destroy during cleanup 9cec9d6ca5 Merge bitcoin-core/libmultiprocess#243: mpgen: support primitive std::optional struct fields 4aaff11374 Merge bitcoin-core/libmultiprocess#238: cmake, ci: updates for recent nixpkgs 2ac55a56b5 Merge bitcoin-core/libmultiprocess#218: Better error and log messages 6de92e1c73 proxy-client: tolerate exceptions from remote destroy during cleanup 90be8354d4 test: regression for ~ProxyClient destroy after peer disconnect 3c69d125a1 Merge bitcoin-core/libmultiprocess#260: event loop: tolerate unexpected exceptions in `post()` callbacks b8a48c65e6 event loop: tolerate unexpected exceptions in `post()` callbacks f787863d2c Merge bitcoin-core/libmultiprocess#270: doc: Bump version 10 > 11 a22f602910 doc: Bump version 10 > 11 4eae445d6d debug: Add TypeName() function and log statements for Proxy objects being created and destroyed f326c5b1b7 logging: Add better logging on IPC server-side failures 6dbfa56a04 mpgen: support primitive std::optional struct fields 8d1277deb5 mpgen refactor: add AccessorType function db716bbcba mpgen refactor: Move field handling code to FieldList class db7acb3ce2 ci: Fix shell.nix compatibility with CMake 4.0 91a7759a9a cmake: Fix IWYU in nix by adding CMAKE_CXX_IMPLICIT_INCLUDE_DIRECTORIES git-subtree-dir: src/ipc/libmultiprocess git-subtree-split: 8412fcdc659e1379f9b4dea896c26bc1c5f3afa8
6450345 type: reserve first when reading std::unordered_set (ViniciusCestarii) 4d0f8db proxy: add ReadList helper and dedup map/set/vector read handlers (ViniciusCestarii) Pull request description: Follow up of #277 (review). This adds `ReadList` helper and uses it to dedup the `CustomReadField` implementations for `std::map`, `std::set`, `std::unordered_set`, and `std::vector`, mirroring the existing `BuildList` helper on the build side. I took the liberty of adding the commit f2a734a "type: reserve first when reading std::unordered_set" so it reserves the correct capacity first and then emplaces the values. ACKs for top commit: ryanofsky: Code review ACK 6450345. Looks great! It's really nice to deduplicate this code and drop `vector<bool>` specialization. Tree-SHA512: f8d44caccb5265e4d2206556514e099ad37ff958ae35ff08eea0190a1850178e2a9abfb5bc083491412f4439570f95d82e8a665fd4f452084dfd11a5167b4547
16bf05d Merge bitcoin-core/libmultiprocess#302: refactor: rename EventLoop::m_num_clients to m_num_refs dd537da Merge bitcoin-core/libmultiprocess#301: test: recursive async IPC calls and cleanups 400291d Merge bitcoin-core/libmultiprocess#299: ci: remove libevent from Core CIs 092be51 Merge bitcoin-core/libmultiprocess#285: Add ReadList helper 5b61788 Merge bitcoin-core/libmultiprocess#283: Add `makePool` method on `ThreadMap` d499830 refactor: rename EventLoop::m_num_clients to m_num_refs 6450345 type: reserve first when reading std::unordered_set 4d0f8db proxy: add ReadList helper and dedup map/set/vector read handlers 0e49d91 Add `makePool` method on `ThreadMap` 5519f7f test: recursive async IPC calls a29ceff ci: remove libevent from Core CIs 8412fcd Merge bitcoin-core/libmultiprocess#295: Mark Waiter m_cv as guarded by m_mutex 1593ee2 Merge bitcoin-core/libmultiprocess#294: test: Add passDouble smoke test 9885d7d Merge bitcoin-core/libmultiprocess#286: proxy-client: fix TSan data race in clientDestroy fa35501 Mark Waiter m_cv as guarded by m_mutex faaedb1 test: Add passDouble smoke test 733c643 Merge bitcoin-core/libmultiprocess#292: type-number: fix clang-tidy modernize-use-nullptr 9cc3479 Merge bitcoin-core/libmultiprocess#291: cmake: Add `mp_headers` custom target 201abd9 Merge bitcoin-core/libmultiprocess#289: cmake: make target_capnp_sources use CURRENT dirs 99820c8 Merge bitcoin-core/libmultiprocess#279: doc: Add comments to FIELD_* constants in proxy.h 73b9855 Merge bitcoin-core/libmultiprocess#278: doc: Fix and expand design.md e7e91b2 Merge bitcoin-core/libmultiprocess#277: Add std::unordered_set support and a helper BuildList to dedup list build handlers 91a951f tidy fix: modernize-use-nullptr 16362f4 cmake: Add `mp_headers` custom target 615a94f cmake: document ONLY_CAPNP option in target_capnp_sources 90982f7 mpgen: iwyu changes required by previous commit 25bb3e6 proxy-client: fix TSan data race in clientDestroy 620f297 cmake: make target_capnp_sources use CURRENT dirs 9de4b88 test: use camelCase + $Proxy.name for FooStruct fields 011b917 type: add std::unordered_set support 20d19b9 proxy: add BuildList helper and dedup map/set/vector build handlers e863c6c doc: Add comments to FIELD_* constants in proxy.h 18db0ab doc: Fix and expand design.md 61de697 Merge bitcoin-core/libmultiprocess#273: proxy-client: tolerate exceptions from remote destroy during cleanup 9cec9d6 Merge bitcoin-core/libmultiprocess#243: mpgen: support primitive std::optional struct fields 4aaff11 Merge bitcoin-core/libmultiprocess#238: cmake, ci: updates for recent nixpkgs 2ac55a5 Merge bitcoin-core/libmultiprocess#218: Better error and log messages 6de92e1 proxy-client: tolerate exceptions from remote destroy during cleanup 90be835 test: regression for ~ProxyClient destroy after peer disconnect 3c69d12 Merge bitcoin-core/libmultiprocess#260: event loop: tolerate unexpected exceptions in `post()` callbacks b8a48c6 event loop: tolerate unexpected exceptions in `post()` callbacks f787863 Merge bitcoin-core/libmultiprocess#270: doc: Bump version 10 > 11 a22f602 doc: Bump version 10 > 11 4eae445 debug: Add TypeName() function and log statements for Proxy objects being created and destroyed f326c5b logging: Add better logging on IPC server-side failures 6dbfa56 mpgen: support primitive std::optional struct fields 8d1277d mpgen refactor: add AccessorType function db716bb mpgen refactor: Move field handling code to FieldList class db7acb3 ci: Fix shell.nix compatibility with CMake 4.0 91a7759 cmake: Fix IWYU in nix by adding CMAKE_CXX_IMPLICIT_INCLUDE_DIRECTORIES git-subtree-dir: src/ipc/libmultiprocess git-subtree-split: 16bf05d
…ol` method 6b0a907 Squashed 'src/ipc/libmultiprocess/' changes from 3edbe8f..16bf05d (Ryan Ofsky) Pull request description: The changes can be verified by running `test/lint/git-subtree-check.sh src/ipc/libmultiprocess` as described in [developer notes](https://github.com/bitcoin/bitcoin/blob/master/doc/developer-notes.md#subtrees) and [lint instructions](https://github.com/bitcoin/bitcoin/tree/master/test/lint#git-subtree-checksh). Changes since last subtree update (#34977): - Adds `makePool` method on `ThreadMap` to support thread pool routing, allowing requests without a specific client thread to be dispatched to a pool using a shortest-queue strategy ([#283](bitcoin-core/libmultiprocess#283)). - Adds `std::unordered_set` support, a `BuildList` helper, and a `ReadList` helper to reduce duplication in list build and read handlers ([#277](bitcoin-core/libmultiprocess#277), [#285](bitcoin-core/libmultiprocess#285)). - Adds support for translating C++ `std::optional<T>` struct fields to pairs of `T` + `hasT :Bool` Cap'n Proto struct fields, allowing unset optional primitive fields to be represented ([#243](bitcoin-core/libmultiprocess#243)). - Produces more readable log output for Proxy object lifecycle events and IPC server-side failures ([#218](bitcoin-core/libmultiprocess#218)). - Handles exceptions thrown by `destroy` methods by logging instead of aborting ([#273](bitcoin-core/libmultiprocess#273)). This can prevent server crashes when non-libmultiprocess clients disconnect without destroying objects, in the case where a server object owns client objects and the server destructor tries to call the disconnected client to free them ([#219](bitcoin-core/libmultiprocess#219)). - Handles unexpected exceptions thrown by callbacks (that should never happen) by logging errors instead of deadlocking ([#260](bitcoin-core/libmultiprocess#260)). - Fixes a rare mptest hang on musl builds caused by a lost wakeup bug in `Waiter` ([#295](bitcoin-core/libmultiprocess#295)). - Fixes a race condition in a log print detected by TSan ([#286](bitcoin-core/libmultiprocess#286)). - Build improvements: makes `target_capnp_sources` work correctly when libmultiprocess is used as a CMake subproject ([#289](bitcoin-core/libmultiprocess#289)), adds `mp_headers` target for better lint tool support ([#291](bitcoin-core/libmultiprocess#291)), and fixes compatibility with recent Nix and CMake 4.0 ([#238](bitcoin-core/libmultiprocess#238)). - Test, CI, documentation, and minor code improvements: design document corrections ([#278](bitcoin-core/libmultiprocess#278)), field constant comments ([#279](bitcoin-core/libmultiprocess#279)), clang-tidy fix ([#292](bitcoin-core/libmultiprocess#292)), new smoke test for double-precision float values ([#294](bitcoin-core/libmultiprocess#294)), new test for recursive async IPC calls ([#301](bitcoin-core/libmultiprocess#301)), removal of libevent from Core CI builds ([#299](bitcoin-core/libmultiprocess#299)), and rename of `EventLoop::m_num_clients` to `m_num_refs` ([#302](bitcoin-core/libmultiprocess#302)). ACKs for top commit: fanquake: ACK 02afa66 hebasto: ACK 02afa66. Tree-SHA512: ef81a951c971f328a0a98436030467eeea30925eb6016eafd9bc7a25726c87628a852bbb1d84b88bce340aeea2bed25c65bc55db1168ebcb850628cd18808883
…hreadMap.makePool` method 6b0a907 Squashed 'src/ipc/libmultiprocess/' changes from 3edbe8f67c1..16bf05dea02 (Ryan Ofsky) Pull request description: The changes can be verified by running `test/lint/git-subtree-check.sh src/ipc/libmultiprocess` as described in [developer notes](https://github.com/bitcoin/bitcoin/blob/master/doc/developer-notes.md#subtrees) and [lint instructions](https://github.com/bitcoin/bitcoin/tree/master/test/lint#git-subtree-checksh). Changes since last subtree update (#34977): - Adds `makePool` method on `ThreadMap` to support thread pool routing, allowing requests without a specific client thread to be dispatched to a pool using a shortest-queue strategy ([#283](bitcoin-core/libmultiprocess#283)). - Adds `std::unordered_set` support, a `BuildList` helper, and a `ReadList` helper to reduce duplication in list build and read handlers ([#277](bitcoin-core/libmultiprocess#277), [#285](bitcoin-core/libmultiprocess#285)). - Adds support for translating C++ `std::optional<T>` struct fields to pairs of `T` + `hasT :Bool` Cap'n Proto struct fields, allowing unset optional primitive fields to be represented ([#243](bitcoin-core/libmultiprocess#243)). - Produces more readable log output for Proxy object lifecycle events and IPC server-side failures ([#218](bitcoin-core/libmultiprocess#218)). - Handles exceptions thrown by `destroy` methods by logging instead of aborting ([#273](bitcoin-core/libmultiprocess#273)). This can prevent server crashes when non-libmultiprocess clients disconnect without destroying objects, in the case where a server object owns client objects and the server destructor tries to call the disconnected client to free them ([#219](bitcoin-core/libmultiprocess#219)). - Handles unexpected exceptions thrown by callbacks (that should never happen) by logging errors instead of deadlocking ([#260](bitcoin-core/libmultiprocess#260)). - Fixes a rare mptest hang on musl builds caused by a lost wakeup bug in `Waiter` ([#295](bitcoin-core/libmultiprocess#295)). - Fixes a race condition in a log print detected by TSan ([#286](bitcoin-core/libmultiprocess#286)). - Build improvements: makes `target_capnp_sources` work correctly when libmultiprocess is used as a CMake subproject ([#289](bitcoin-core/libmultiprocess#289)), adds `mp_headers` target for better lint tool support ([#291](bitcoin-core/libmultiprocess#291)), and fixes compatibility with recent Nix and CMake 4.0 ([#238](bitcoin-core/libmultiprocess#238)). - Test, CI, documentation, and minor code improvements: design document corrections ([#278](bitcoin-core/libmultiprocess#278)), field constant comments ([#279](bitcoin-core/libmultiprocess#279)), clang-tidy fix ([#292](bitcoin-core/libmultiprocess#292)), new smoke test for double-precision float values ([#294](bitcoin-core/libmultiprocess#294)), new test for recursive async IPC calls ([#301](bitcoin-core/libmultiprocess#301)), removal of libevent from Core CI builds ([#299](bitcoin-core/libmultiprocess#299)), and rename of `EventLoop::m_num_clients` to `m_num_refs` ([#302](bitcoin-core/libmultiprocess#302)). ACKs for top commit: fanquake: ACK cd09e20 hebasto: ACK cd09e20. Tree-SHA512: ef81a951c971f328a0a98436030467eeea30925eb6016eafd9bc7a25726c87628a852bbb1d84b88bce340aeea2bed25c65bc55db1168ebcb850628cd18808883
BuildList turns a C++ container into a capnp list. It looped over the container with `for (const auto& elem : value)`, so every element was const. That breaks when the elements are interface pointers: to send one to the capnp server the proxy code has to take ownership away from the unique_ptr by calling unique_ptr::release(), and that cannot be called on a const object. So the code failed to compile, and returning a list of interface pointers stopped working after bitcoin-core#277. Fix this by looping with a plain iterator and passing each element to BuildField as non-const, only moving elements out of the container when the container itself is a temporary. See the code comment for details. In Bitcoin Core, interfaces::Node::listExternalSigners() returns a vector<unique_ptr<ExternalSigner>> over IPC and hits this code path. Add a `listBars` method to the test FooInterface that returns a vector<unique_ptr<Bar>>, plus a test that calls it over IPC, so this is covered and does not break again. Co-Authored-by: Sjors Provoost <sjors@sprovoost.nl> Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
BuildList turns a C++ container into a capnp list. It looped over the container with `for (const auto& elem : value)`, so every element was const. That breaks when the elements are interface pointers: to send one to the capnp server the proxy code has to take ownership away from the unique_ptr by calling unique_ptr::release(), and that cannot be called on a const object. So the code failed to compile, and returning a list of interface pointers stopped working after bitcoin-core#277. Fix this by looping with a plain iterator and passing each element to BuildField as non-const, only moving elements out of the container when the container itself is a temporary. See the code comment for details. In Bitcoin Core, interfaces::Node::listExternalSigners() returns a vector<unique_ptr<ExternalSigner>> over IPC and hits this code path. Add a `listBars` method to the test FooInterface that returns a vector<unique_ptr<Bar>>, plus a test that calls it over IPC, so this is covered and does not break again. Co-Authored-by: Sjors Provoost <sjors@sprovoost.nl> Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
BuildList turns a C++ container into a capnp list. It looped over the container with `for (const auto& elem : value)`, so every element was const. That breaks when the elements are interface pointers: to send one to the capnp server the proxy code has to take ownership away from the unique_ptr by calling unique_ptr::release(), and that cannot be called on a const object. So the code failed to compile, and returning a list of interface pointers stopped working after bitcoin-core#277. Fix this by looping with a plain iterator and passing each element to BuildField as non-const, only moving elements out of the container when the container itself is a temporary. See the code comment for details. In Bitcoin Core, interfaces::Node::listExternalSigners() returns a vector<unique_ptr<ExternalSigner>> over IPC and hits this code path. Add a `listBars` method to the test FooInterface that returns a vector<unique_ptr<Bar>>, plus a test that calls it over IPC, so this is covered and does not break again. Co-Authored-by: Sjors Provoost <sjors@sprovoost.nl> Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
…face types d6f8588 proxy: fix BuildList to use non-const iteration for interface types (Ryan Ofsky) Pull request description: Needed for bitcoin/bitcoin#10102 since #277 was merged. Since #277, it is no longer possible to return `vector<unique_ptr<ExternalSigner>>` from `Node::listExternalSigners()` in bitcoin/bitcoin#10102, because the proxy server objects libmultiprocess creates to wrap the `ExternalSigner` objects need to take ownership of the objects to keep them alive, so they need to be moved out of the returned vector, which can only be done if `BuildField` is passed a non-const vector element. This PR restores previous behavior before #277 making it possible to mutate container elements while serializing them, in cases like this where it is necessary. ACKs for top commit: ViniciusCestarii: tACK d6f8588 Tree-SHA512: 37bf03f3a3ee2b239480af53e05e4e46857db45ae8c489bda32e004d99aac3f5fa38f7fd6dba6123a0cafe3f64042ccbc1966448139d488b691d7ca16a1e8b9c
…hreadMap.makePool` method 6b0a907 Squashed 'src/ipc/libmultiprocess/' changes from 3edbe8f67c1..16bf05dea02 (Ryan Ofsky) Pull request description: The changes can be verified by running `test/lint/git-subtree-check.sh src/ipc/libmultiprocess` as described in [developer notes](https://github.com/bitcoin/bitcoin/blob/master/doc/developer-notes.md#subtrees) and [lint instructions](https://github.com/bitcoin/bitcoin/tree/master/test/lint#git-subtree-checksh). Changes since last subtree update (#34977): - Adds `makePool` method on `ThreadMap` to support thread pool routing, allowing requests without a specific client thread to be dispatched to a pool using a shortest-queue strategy ([#283](bitcoin-core/libmultiprocess#283)). - Adds `std::unordered_set` support, a `BuildList` helper, and a `ReadList` helper to reduce duplication in list build and read handlers ([#277](bitcoin-core/libmultiprocess#277), [#285](bitcoin-core/libmultiprocess#285)). - Adds support for translating C++ `std::optional<T>` struct fields to pairs of `T` + `hasT :Bool` Cap'n Proto struct fields, allowing unset optional primitive fields to be represented ([#243](bitcoin-core/libmultiprocess#243)). - Produces more readable log output for Proxy object lifecycle events and IPC server-side failures ([#218](bitcoin-core/libmultiprocess#218)). - Handles exceptions thrown by `destroy` methods by logging instead of aborting ([#273](bitcoin-core/libmultiprocess#273)). This can prevent server crashes when non-libmultiprocess clients disconnect without destroying objects, in the case where a server object owns client objects and the server destructor tries to call the disconnected client to free them ([#219](bitcoin-core/libmultiprocess#219)). - Handles unexpected exceptions thrown by callbacks (that should never happen) by logging errors instead of deadlocking ([#260](bitcoin-core/libmultiprocess#260)). - Fixes a rare mptest hang on musl builds caused by a lost wakeup bug in `Waiter` ([#295](bitcoin-core/libmultiprocess#295)). - Fixes a race condition in a log print detected by TSan ([#286](bitcoin-core/libmultiprocess#286)). - Build improvements: makes `target_capnp_sources` work correctly when libmultiprocess is used as a CMake subproject ([#289](bitcoin-core/libmultiprocess#289)), adds `mp_headers` target for better lint tool support ([#291](bitcoin-core/libmultiprocess#291)), and fixes compatibility with recent Nix and CMake 4.0 ([#238](bitcoin-core/libmultiprocess#238)). - Test, CI, documentation, and minor code improvements: design document corrections ([#278](bitcoin-core/libmultiprocess#278)), field constant comments ([#279](bitcoin-core/libmultiprocess#279)), clang-tidy fix ([#292](bitcoin-core/libmultiprocess#292)), new smoke test for double-precision float values ([#294](bitcoin-core/libmultiprocess#294)), new test for recursive async IPC calls ([#301](bitcoin-core/libmultiprocess#301)), removal of libevent from Core CI builds ([#299](bitcoin-core/libmultiprocess#299)), and rename of `EventLoop::m_num_clients` to `m_num_refs` ([#302](bitcoin-core/libmultiprocess#302)). ACKs for top commit: fanquake: ACK 02afa66169b5dc58d0fc6f608d0c6f4facefd5ec hebasto: ACK 02afa66169b5dc58d0fc6f608d0c6f4facefd5ec. Tree-SHA512: ef81a951c971f328a0a98436030467eeea30925eb6016eafd9bc7a25726c87628a852bbb1d84b88bce340aeea2bed25c65bc55db1168ebcb850628cd18808883
2dba13047 Merge bitcoin-core/libmultiprocess#363: ci: use LLVM 23 in Bitcoin Core CI 161197a5c Merge bitcoin-core/libmultiprocess#352: ci: add cmake debug output fb4ac7eb8 ci: use LLVM 23 in Bitcoin Core CI 7bac69de1 Merge bitcoin-core/libmultiprocess#360: pull latest .clang-tidy from downstream 79ddc44eb Merge bitcoin-core/libmultiprocess#359: ci: bump cmake version to 4.3.4 in newdeps job bf229bf82 Merge bitcoin-core/libmultiprocess#351: ci: do not ignore NIXPKGS_CHANNEL in local ci runs 073ac4f19 Merge bitcoin-core/libmultiprocess#347: refactor: Replace EventLoop::post() with sync() taking kj::FunctionParam fa1db7a9e pull latest .clang-tidy from downstream 5c49666a1 refactor: rename EventLoop::m_post_fn to m_sync_fn 2330fbe81 refactor: replace EventLoop::post() with sync() taking kj::FunctionParam 4d454a81d Merge bitcoin-core/libmultiprocess#358: refactor: Enable readability-container-contains dba99582b Merge bitcoin-core/libmultiprocess#357: doc: Update Cap'n Proto version to match minimum 00923922a Merge bitcoin-core/libmultiprocess#356: ci: Remove hard-coded -j4 from sanitize config 766867fb3 ci: clarify CAPNP_CHECKOUT=master is the v1.x release branch cc3675280 ci: bump cmake version to 4.3.4 in newdeps job fa101113b refactor: Enable readability-container-contains 81f824b02 doc: Update Cap'n Proto version to match minimum fa30e2093 ci: Remove hard-coded -j4 from sanitize config a7ff9d5da ci: add cmake debug output f2e8df82e Merge bitcoin-core/libmultiprocess#350: cmake: add type-unordered-set.h and version.h to public headers 0e146c046 Merge bitcoin-core/libmultiprocess#349: type-context: fix async disconnect race condition found by antithesis 49f95e263 Merge bitcoin-core/libmultiprocess#212: ci: add newdeps job testing newer versions of cmake and capnproto 7c73cceda ci: rename CI-internal variables to use CI_ prefix fe1b8339f ci: do not ignore NIXPKGS_CHANNEL in local ci runs 914dc839f proxy: fix data race between server request threads and disconnect handling 275c8eefd Merge bitcoin-core/libmultiprocess#345: Remove trailing whitespace and Add -Wtrailing-whitespace to default ci config cd7162fb8 Merge bitcoin-core/libmultiprocess#304: proxy: fix BuildList to use non-const iteration for interface types 9b136782a ci: Add -Wtrailing-whitespace to default config 2f4be9ec6 refactor: Remove trailing whitespace 2448d282c cmake: add type-unordered-set.h and version.h to public headers b3fc922ee ci: add newdeps job testing newest versions of cmake and capnproto 390b5f901 Merge bitcoin-core/libmultiprocess#344: test: listen_tests and connect_tests follow-ups d6f8588d1 proxy: fix BuildList to use non-const iteration for interface types e18ca520f Merge bitcoin-core/libmultiprocess#343: test: fix race in connect_tests disconnect-deferred-failure test c39c7850c doc: note construct() call in valid init interface test b9c36c617 test: close sockets unconditionally and check errors with KJ_SYSCALL 7eb741e63 test: drop unnecessary KJ_EXPECT(true) 113f1d4d2 test: join server thread unconditionally in connect tests 44bc4630b test: drop mp:: prefixes in connect tests 038d33eb3 test: share DefaultLogHandler between test files b54a16330 test: drop TestSetup socket members in connect tests 70467c5a7 test: add m_ prefix to TestSetup members in connect tests cc260f252 test: replace capnp fix link with upstream PR 137a6e4e0 test: fix race in connect_tests disconnect-deferred-failure test 8dab0d4bd Merge bitcoin-core/libmultiprocess#341: ci: add -Wextra-semi to llvm config b3b134eed ci: add -Wextra-semi to llvm config bdd0cd694 Merge bitcoin-core/libmultiprocess#339: refactor: add `[[noreturn]]` attributes a779a0976 ci: add -Wmissing-noreturn 636aaff57 refactor: add missing [[noreturn]] attributes cc11c2b1b Merge bitcoin-core/libmultiprocess#338: test: check ReadList return value 2d6e863c7 Merge bitcoin-core/libmultiprocess#334: ci: Set CMAKE_BUILD_PARALLEL_LEVEL to enable parallelism by default d4d10ff98 Merge bitcoin-core/libmultiprocess#332: ci: add -Wextra-semi to default config b540e70f2 Merge bitcoin-core/libmultiprocess#324: proxy: Name threads spawned by the event loop e5e367e78 Merge bitcoin-core/libmultiprocess#312: util: report back child errors to parent and throw 2220df68c Merge bitcoin-core/libmultiprocess#298: Fix error handling when creating clients (`mp::ConnectStream`) 51defb79e Merge bitcoin-core/libmultiprocess#340: ci: Update `capnproto` prerequisites on NetBSD 7e94790b0 ci: Update `capnproto` prerequisites on NetBSD 9f25ffca5 test: Cover OS thread names for worker, pool, and async threads 648a18589 proxy: Name threads spawned by the event loop 49834b260 ci: add -Wextra-semi to default config fae9a637e example: Remove unused kj/async.h include bb473690c Fix error handling when creating clients 44d191420 Add test coverage for ConnectStream 231361ae5 Correct stale UnixListener doc comment 060c1a50d Extract `UnixListener` class to a dedicated file 62f25af06 test: check ReadList return value ce51d7372 ci: Set CMAKE_BUILD_PARALLEL_LEVEL to enable parallism in build jobs by default 67302cd13 Merge bitcoin-core/libmultiprocess#331: Remove code for Cap'n Proto versions before 0.9 f13c64ab5 Merge bitcoin-core/libmultiprocess#330: ci: Compile with minimum supported g++ in olddeps 8e026f662 Merge bitcoin-core/libmultiprocess#327: build: avoid unnecessary capnp-rpc dependency for mpgen e5206e9eb Merge bitcoin-core/libmultiprocess#325: cmake: Remove `QUIET` option from `find_package(CapnProto ...)` 879efea2b Merge bitcoin-core/libmultiprocess#321: ci: Roll NetBSD releases to 11.0, drop 9.4 abf127a31 Merge bitcoin-core/libmultiprocess#317: ipc: Fix mpgen capnp tool path for vcpkg/Windows builds c437d7f10 Merge bitcoin-core/libmultiprocess#310: test: cover immediate client disconnects for `ListenConnections` 31bff8a67 Merge bitcoin-core/libmultiprocess#307: refactor: memcpy -> std::ranges::copy f355108b0 Merge bitcoin-core/libmultiprocess#303: type-chrono: Add CustomBuildField/CustomReadField overloads for std::chrono::time_point 2d678177c Merge bitcoin-core/libmultiprocess#296: ci: Bump channel to nixos-26.05 3f05b1162 util: kill and reap child on SpawnProcess error 4a56c1837 util: report back child error to parent and throw a9e70dbe7 ci: Add NetBSD release 11.0 2d33b14fb ci: Switch to default compiler on NetBSD 9.4 36f740027 ci: Drop NetBSD release 9.4 bd508311b refactor: Drop stray semicolons after function definitions 788f17a85 Remove code for Cap'n Proto versions before 0.9 7402affd0 ci: Pin oldeps config to older nixpkgs channel to compile older cmake with older gcc edf634356 ci: Compile with minimum supported g++-11 in olddeps fa47449af cmake: avoid unnecessary capnp-rpc dependency for mpgen a494b764d cmake: Remove `QUIET` option from `find_package(CapnProto ...)` 26452e02d refactor: memcpy -> std::ranges::copy e1dcc6eb1 Merge bitcoin-core/libmultiprocess#316: cmake: Fix stale codegen when mpgen binary changes 7a72df02e type-chrono: Add CustomBuildField/CustomReadField overloads for std::chrono::time_point 45b685c3f type-number, type-chrono: Fix static assert signed/unsigned comparisons 45f625597 type-number: exclude bool from the integral overload 8d6d46494 Merge bitcoin-core/libmultiprocess#315: Fix startup race in example a6fc80d25 Merge bitcoin-core/libmultiprocess#311: bugfix: clear FD_CLOEXEC in child instead of parent before fork 496fb84e6 test: cover immediate client disconnects for `ListenConnections` 36c6c6352 doc: Document reference-counted EventLoop lifetime 3a997e113 Fix startup race in mpexample f5c15ce33 Merge bitcoin-core/libmultiprocess#323: refactor: access ThreadContext through CurrentThread(), ci: switch Bitcoin Core to master 66298c737 ci: Switch back to Bitcoin Core's master branch 86b481050 refactor: access ThreadContext through CurrentThread() eea9c64f6 cmake: Fix stale codegen when mpgen binary changes a26a08496 cmake: Fix mpgen capnp tool path for vcpkg/Windows builds 140d9ba6f test: allow custom log handler in `ListenSetup` 1e0c7ff9a util: Clear FD_CLOEXEC in child instead of parent before fork 8550ee6a3 util, refactor: Add ChildFail helper for post-fork child errors 17eab90b5 test: Fix typo in listen_tests.cpp ce865a9ba refactor: Directly use value in CustomBuildField 3f221b5bf Merge bitcoin-core/libmultiprocess#274: Add nonunix platform support e8de5c7b6 Merge bitcoin-core/libmultiprocess#305: refactor: memcpy to std::ranges::copy to work around ubsan warn 1b0f60560 doc: Remove trailing whitespace d8f8ca311 ipc: Wrap mpgen main() in try-catch to print errors fbe5a14ad ci: Check out bitcoin/bitcoin PR #35084 instead of master 39d3690d8 types: Replace SFINAE with requires clauses to avoid MSVC C2039 error ba6852020 proxy, refactor: Fix C4305 truncation warning in Accessor on MSVC 1d81d4781 util, refactor: Fix PtrOrValue constructor for move-only types on MSVC b883fe1e5 proxy: Fix shutdownWrite() exception handling on macOS with dynamic libraries 0012411cc proxy: Call shutdownWrite() in Connection destructor 38312ad19 proxy, refactor: Change ConnectStream and ServeStream to accept stream objects e96d5d742 proxy, refactor: Replace EventLoop wakeup fd integers with KJ stream objects db4f9a3d7 cmake: Bump minimum required Cap'n Proto version to 0.9 652934fb7 util, refactor: Add SocketPair() and use it in SpawnProcess 1c6ef7a26 util, refactor: Do not fork() and exec() separately 1389cf313 util, refactor: Add SpawnConnectInfo type alias and use it c7ca1f00b util, refactor: Add SocketId type alias and use it be46a3520 util, refactor: Add ProcessId type alias and use it 91a78db78 doc: Bump version 13 > 14 9307e68e5 Merge bitcoin-core/libmultiprocess#306: doc: Bump version 12 > 13 fac7b9b7f refactor: memcpy to std::ranges::copy to work around ubsan warn 1bd702560 Merge bitcoin-core/libmultiprocess#297: test: add map serialization round-trip coverage 438fdd243 doc: Bump version 12 > 13 28e056576 Merge bitcoin-core/libmultiprocess#269: proxy: add local connection limit to ListenConnections 39a10ce89 proxy: add local connection limit to ListenConnections() 43172f52d test: add dedicated ListenConnections coverage 033f81219 doc/version: Bump version 11 > 12 463d073cb test: rename vBool to vector_bool 16bf05dea Merge bitcoin-core/libmultiprocess#302: refactor: rename EventLoop::m_num_clients to m_num_refs dd537da9e Merge bitcoin-core/libmultiprocess#301: test: recursive async IPC calls and cleanups 400291de0 Merge bitcoin-core/libmultiprocess#299: ci: remove libevent from Core CIs 092be515a Merge bitcoin-core/libmultiprocess#285: Add ReadList helper 5b617880c Merge bitcoin-core/libmultiprocess#283: Add `makePool` method on `ThreadMap` d49983041 refactor: rename EventLoop::m_num_clients to m_num_refs 6450345c9 type: reserve first when reading std::unordered_set 4d0f8db5f proxy: add ReadList helper and dedup map/set/vector read handlers 0e49d9118 Add `makePool` method on `ThreadMap` 5519f7f94 test: recursive async IPC calls a29ceff40 ci: remove libevent from Core CIs 85df23384 test: add mapStringInt to foo.capnp to cover map serialization and deserialization fa2c56ec2 ci: Bump channel to nixos-26.05 8412fcdc6 Merge bitcoin-core/libmultiprocess#295: Mark Waiter m_cv as guarded by m_mutex 1593ee2d1 Merge bitcoin-core/libmultiprocess#294: test: Add passDouble smoke test 9885d7dd3 Merge bitcoin-core/libmultiprocess#286: proxy-client: fix TSan data race in clientDestroy fa35501c4 Mark Waiter m_cv as guarded by m_mutex faaedb11f test: Add passDouble smoke test 733c64318 Merge bitcoin-core/libmultiprocess#292: type-number: fix clang-tidy modernize-use-nullptr 9cc3479ab Merge bitcoin-core/libmultiprocess#291: cmake: Add `mp_headers` custom target 201abd9e3 Merge bitcoin-core/libmultiprocess#289: cmake: make target_capnp_sources use CURRENT dirs 99820c8ae Merge bitcoin-core/libmultiprocess#279: doc: Add comments to FIELD_* constants in proxy.h 73b985540 Merge bitcoin-core/libmultiprocess#278: doc: Fix and expand design.md e7e91b2e2 Merge bitcoin-core/libmultiprocess#277: Add std::unordered_set support and a helper BuildList to dedup list build handlers 91a951f59 tidy fix: modernize-use-nullptr 16362f42d cmake: Add `mp_headers` custom target 615a94fe3 cmake: document ONLY_CAPNP option in target_capnp_sources 90982f75c mpgen: iwyu changes required by previous commit 25bb3e67f proxy-client: fix TSan data race in clientDestroy 620f297f3 cmake: make target_capnp_sources use CURRENT dirs 9de4b885a test: use camelCase + $Proxy.name for FooStruct fields 011b91793 type: add std::unordered_set support 20d19b964 proxy: add BuildList helper and dedup map/set/vector build handlers e863c6cdf doc: Add comments to FIELD_* constants in proxy.h 18db0ab95 doc: Fix and expand design.md git-subtree-dir: src/ipc/libmultiprocess git-subtree-split: 2dba130478ab71a745fe96c5726719fe357e6d17
Add std::unordered_set support and a helper BuildList to dedup list build handlers that is being used for map, set and vector.
While looking bitcoin/bitcoin#29409, found a TODO noting that libmultiprocess lacked std::unordered_set support, requiring downstream that PR to implement the build/read functions locally.
I believe there could be more dedup adding a ReadList too. I could do that as a follow-up if desirable