[Tarantool-patches] [PATCH vshard 00/11] VShard Map-Reduce, part 2: Ref, Sched, Map

Vladislav Shpilevoy v.shpilevoy at tarantool.org
Tue Feb 23 03:15:36 MSK 2021


The patchset is a second part of the series introducing consistent Map-Reduce
API for vshard.

Core of the patchset - 3 last patches: new module 'storage.ref', new module
'storage.sched', and router's new function `map_callrw()`.

The other patches are preparatory. They mostly introduce and unit-test helpers
used in the last patches.

For details see the commit messages.

Branch: http://github.com/tarantool/vshard/tree/gerold103/gh-147-map-reduce-part2
Issue: https://github.com/tarantool/vshard/issues/147

Vladislav Shpilevoy (11):
  error: introduce vshard.error.timeout()
  storage: add helper for local functions invocation
  storage: cache bucket count
  registry: module for circular deps resolution
  util: introduce safe fiber_cond_wait()
  util: introduce fiber_is_self_canceled()
  storage: introduce bucket_generation_wait()
  storage: introduce bucket_are_all_rw()
  ref: introduce vshard.storage.ref module
  sched: introduce vshard.storage.sched module
  router: introduce map_callrw()

 test/reload_evolution/storage.result   |  66 +++
 test/reload_evolution/storage.test.lua |  28 ++
 test/router/map-reduce.result          | 636 +++++++++++++++++++++++++
 test/router/map-reduce.test.lua        | 258 ++++++++++
 test/router/router.result              |   9 +-
 test/router/sync.result                |  10 +-
 test/router/sync.test.lua              |   3 +-
 test/storage/ref.result                | 406 ++++++++++++++++
 test/storage/ref.test.lua              | 169 +++++++
 test/storage/scheduler.result          | 410 ++++++++++++++++
 test/storage/scheduler.test.lua        | 178 +++++++
 test/storage/storage.result            | 168 +++++++
 test/storage/storage.test.lua          |  68 +++
 test/unit-tap/ref.test.lua             | 205 ++++++++
 test/unit-tap/scheduler.test.lua       | 555 +++++++++++++++++++++
 test/unit/config.result                |  59 +++
 test/unit/config.test.lua              |  23 +
 test/unit/error.result                 |  22 +
 test/unit/error.test.lua               |   9 +
 test/unit/util.result                  | 110 +++++
 test/unit/util.test.lua                |  45 ++
 test/upgrade/upgrade.result            |   5 +-
 vshard/CMakeLists.txt                  |   3 +-
 vshard/cfg.lua                         |   8 +
 vshard/consts.lua                      |   6 +
 vshard/error.lua                       |  29 ++
 vshard/registry.lua                    |  67 +++
 vshard/replicaset.lua                  |  37 +-
 vshard/router/init.lua                 | 186 +++++++-
 vshard/storage/CMakeLists.txt          |   2 +-
 vshard/storage/init.lua                | 208 +++++++-
 vshard/storage/ref.lua                 | 397 +++++++++++++++
 vshard/storage/sched.lua               | 231 +++++++++
 vshard/util.lua                        |  43 ++
 34 files changed, 4627 insertions(+), 32 deletions(-)
 create mode 100644 test/router/map-reduce.result
 create mode 100644 test/router/map-reduce.test.lua
 create mode 100644 test/storage/ref.result
 create mode 100644 test/storage/ref.test.lua
 create mode 100644 test/storage/scheduler.result
 create mode 100644 test/storage/scheduler.test.lua
 create mode 100755 test/unit-tap/ref.test.lua
 create mode 100755 test/unit-tap/scheduler.test.lua
 create mode 100644 vshard/registry.lua
 create mode 100644 vshard/storage/ref.lua
 create mode 100644 vshard/storage/sched.lua

-- 
2.24.3 (Apple Git-128)



More information about the Tarantool-patches mailing list