From: Vladislav Shpilevoy via Tarantool-patches <tarantool-patches@dev.tarantool.org> To: tarantool-patches@dev.tarantool.org, olegrok@tarantool.org, yaroslav.dynnikov@tarantool.org Subject: [Tarantool-patches] [PATCH vshard 00/11] VShard Map-Reduce, part 2: Ref, Sched, Map Date: Tue, 23 Feb 2021 01:15:36 +0100 [thread overview] Message-ID: <cover.1614039039.git.v.shpilevoy@tarantool.org> (raw) The patchset is a second part of the series introducing consistent Map-Reduce API for vshard. Core of the patchset - 3 last patches: new module 'storage.ref', new module 'storage.sched', and router's new function `map_callrw()`. The other patches are preparatory. They mostly introduce and unit-test helpers used in the last patches. For details see the commit messages. Branch: http://github.com/tarantool/vshard/tree/gerold103/gh-147-map-reduce-part2 Issue: https://github.com/tarantool/vshard/issues/147 Vladislav Shpilevoy (11): error: introduce vshard.error.timeout() storage: add helper for local functions invocation storage: cache bucket count registry: module for circular deps resolution util: introduce safe fiber_cond_wait() util: introduce fiber_is_self_canceled() storage: introduce bucket_generation_wait() storage: introduce bucket_are_all_rw() ref: introduce vshard.storage.ref module sched: introduce vshard.storage.sched module router: introduce map_callrw() test/reload_evolution/storage.result | 66 +++ test/reload_evolution/storage.test.lua | 28 ++ test/router/map-reduce.result | 636 +++++++++++++++++++++++++ test/router/map-reduce.test.lua | 258 ++++++++++ test/router/router.result | 9 +- test/router/sync.result | 10 +- test/router/sync.test.lua | 3 +- test/storage/ref.result | 406 ++++++++++++++++ test/storage/ref.test.lua | 169 +++++++ test/storage/scheduler.result | 410 ++++++++++++++++ test/storage/scheduler.test.lua | 178 +++++++ test/storage/storage.result | 168 +++++++ test/storage/storage.test.lua | 68 +++ test/unit-tap/ref.test.lua | 205 ++++++++ test/unit-tap/scheduler.test.lua | 555 +++++++++++++++++++++ test/unit/config.result | 59 +++ test/unit/config.test.lua | 23 + test/unit/error.result | 22 + test/unit/error.test.lua | 9 + test/unit/util.result | 110 +++++ test/unit/util.test.lua | 45 ++ test/upgrade/upgrade.result | 5 +- vshard/CMakeLists.txt | 3 +- vshard/cfg.lua | 8 + vshard/consts.lua | 6 + vshard/error.lua | 29 ++ vshard/registry.lua | 67 +++ vshard/replicaset.lua | 37 +- vshard/router/init.lua | 186 +++++++- vshard/storage/CMakeLists.txt | 2 +- vshard/storage/init.lua | 208 +++++++- vshard/storage/ref.lua | 397 +++++++++++++++ vshard/storage/sched.lua | 231 +++++++++ vshard/util.lua | 43 ++ 34 files changed, 4627 insertions(+), 32 deletions(-) create mode 100644 test/router/map-reduce.result create mode 100644 test/router/map-reduce.test.lua create mode 100644 test/storage/ref.result create mode 100644 test/storage/ref.test.lua create mode 100644 test/storage/scheduler.result create mode 100644 test/storage/scheduler.test.lua create mode 100755 test/unit-tap/ref.test.lua create mode 100755 test/unit-tap/scheduler.test.lua create mode 100644 vshard/registry.lua create mode 100644 vshard/storage/ref.lua create mode 100644 vshard/storage/sched.lua -- 2.24.3 (Apple Git-128)
next reply other threads:[~2021-02-23 0:15 UTC|newest] Thread overview: 47+ messages / expand[flat|nested] mbox.gz Atom feed top 2021-02-23 0:15 Vladislav Shpilevoy via Tarantool-patches [this message] 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 01/11] error: introduce vshard.error.timeout() Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-24 21:46 ` Vladislav Shpilevoy via Tarantool-patches 2021-02-25 12:42 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 10/11] sched: introduce vshard.storage.sched module Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:28 ` Oleg Babin via Tarantool-patches 2021-02-24 21:50 ` Vladislav Shpilevoy via Tarantool-patches 2021-03-04 21:02 ` Oleg Babin via Tarantool-patches 2021-03-05 22:06 ` Vladislav Shpilevoy via Tarantool-patches 2021-03-09 8:03 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 11/11] router: introduce map_callrw() Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:28 ` Oleg Babin via Tarantool-patches 2021-02-24 22:04 ` Vladislav Shpilevoy via Tarantool-patches 2021-02-25 12:43 ` Oleg Babin via Tarantool-patches 2021-02-26 23:58 ` Vladislav Shpilevoy via Tarantool-patches 2021-03-01 10:58 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 02/11] storage: add helper for local functions invocation Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 03/11] storage: cache bucket count Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-24 21:47 ` Vladislav Shpilevoy via Tarantool-patches 2021-02-25 12:42 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 04/11] registry: module for circular deps resolution Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 05/11] util: introduce safe fiber_cond_wait() Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-24 21:48 ` Vladislav Shpilevoy via Tarantool-patches 2021-02-25 12:42 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 06/11] util: introduce fiber_is_self_canceled() Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 07/11] storage: introduce bucket_generation_wait() Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 08/11] storage: introduce bucket_are_all_rw() Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:27 ` Oleg Babin via Tarantool-patches 2021-02-24 21:48 ` Vladislav Shpilevoy via Tarantool-patches 2021-02-23 0:15 ` [Tarantool-patches] [PATCH vshard 09/11] ref: introduce vshard.storage.ref module Vladislav Shpilevoy via Tarantool-patches 2021-02-24 10:28 ` Oleg Babin via Tarantool-patches 2021-02-24 21:49 ` Vladislav Shpilevoy via Tarantool-patches 2021-02-25 12:42 ` Oleg Babin via Tarantool-patches 2021-03-04 21:22 ` Oleg Babin via Tarantool-patches 2021-03-05 22:06 ` Vladislav Shpilevoy via Tarantool-patches 2021-03-09 8:03 ` Oleg Babin via Tarantool-patches 2021-03-21 18:49 ` Vladislav Shpilevoy via Tarantool-patches 2021-03-12 23:13 ` [Tarantool-patches] [PATCH vshard 00/11] VShard Map-Reduce, part 2: Ref, Sched, Map Vladislav Shpilevoy via Tarantool-patches 2021-03-15 7:05 ` Oleg Babin via Tarantool-patches 2021-03-28 18:17 ` Vladislav Shpilevoy via Tarantool-patches
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=cover.1614039039.git.v.shpilevoy@tarantool.org \ --to=tarantool-patches@dev.tarantool.org \ --cc=olegrok@tarantool.org \ --cc=v.shpilevoy@tarantool.org \ --cc=yaroslav.dynnikov@tarantool.org \ --subject='Re: [Tarantool-patches] [PATCH vshard 00/11] VShard Map-Reduce, part 2: Ref, Sched, Map' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox