From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from [87.239.111.99] (localhost [127.0.0.1]) by dev.tarantool.org (Postfix) with ESMTP id 1020B71827; Tue, 23 Feb 2021 03:15:52 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org 1020B71827 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tarantool.org; s=dev; t=1614039352; bh=KwSD3w2ickq7YgwjM5k8xDU75GVHkjFrqckSzgGYork=; h=To:Date:Subject:List-Id:List-Unsubscribe:List-Archive:List-Post: List-Help:List-Subscribe:From:Reply-To:From; b=eH7wu5zecM+05sUYFX+ZKB/4fJ4Ciif7LL3MiRmpa7q0mX3zRT8mgifox4ntf7LHG HyEmL9GIpkmZU4BiMx+Iy68/0X5L1/3Me1/9jYcKiZseqjNGj93faOuygv4DeHt/rX Szzplp9yo0ax/l9L1gqSPvCPSggd6xPJ1F3UfUWk= Received: from smtpng2.m.smailru.net (smtpng2.m.smailru.net [94.100.179.3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dev.tarantool.org (Postfix) with ESMTPS id BF0DA71814 for ; Tue, 23 Feb 2021 03:15:49 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org BF0DA71814 Received: by smtpng2.m.smailru.net with esmtpa (envelope-from ) id 1lELMi-0003CR-GY; Tue, 23 Feb 2021 03:15:48 +0300 To: tarantool-patches@dev.tarantool.org, olegrok@tarantool.org, yaroslav.dynnikov@tarantool.org Date: Tue, 23 Feb 2021 01:15:36 +0100 Message-Id: X-Mailer: git-send-email 2.24.3 (Apple Git-128) MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-7564579A: 646B95376F6C166E X-77F55803: 4F1203BC0FB41BD975C3EC174F566922928A658C60196E87DF7449A63D990329182A05F538085040AC8248BE5A2A494DDCC8EC1792FD3EF7C793B14B5F652CC3B37AECDF7AB9E86F X-7FA49CB5: FF5795518A3D127A4AD6D5ED66289B5278DA827A17800CE7C2204D4F9A221771EA1F7E6F0F101C67BD4B6F7A4D31EC0BCC500DACC3FED6E28638F802B75D45FF8AA50765F79006374D0D183F14C070BA8638F802B75D45FF5571747095F342E8C7A0BC55FA0FE5FC425FEB8730D3840328E7ACC9F9A1A2657D837FC6F7725C7C389733CBF5DBD5E913377AFFFEAFD269176DF2183F8FC7C0A3E989B1926288338941B15DA834481FCF19DD082D7633A0EF3E4896CB9E6436389733CBF5DBD5E9D5E8D9A59859A8B636DA1BED736F9328CC7F00164DA146DA6F5DAA56C3B73B23C77107234E2CFBA567F23339F89546C55F5C1EE8F4F765FC08F9A42B2210255C75ECD9A6C639B01BBD4B6F7A4D31EC0BC0CAF46E325F83A522CA9DD8327EE4930A3850AC1BE2E73579C543ECCDAE434EC4224003CC836476C0CAF46E325F83A50BF2EBBBDD9D6B0F347543BADC64E7283B503F486389A921A5CC5B56E945C8DA X-C1DE0DAB: C20DE7B7AB408E4181F030C43753B8186998911F362727C4C7A0BC55FA0FE5FC425FEB8730D3840328E7ACC9F9A1A26508B6F04EDEA3EDBBB1881A6453793CE9C32612AADDFBE061E94A99F1AE0C32DA6DABF04D5057A81F728CF7B057D10C700839144E5BB460BAB936CB490224F2464EEA7BD89490CAC0EDDA962BC3F61961 X-C8649E89: 4E36BF7865823D7055A7F0CF078B5EC49A30900B95165D34ADE558D2B396DA7C9F93D6B7C604ED8DEE5D1B93238876DB403268A01B3A1448BAFF3DEDFDD1D29F1D7E09C32AA3244CA430C2744AFE9F2E8F677D4097A874A59CA7333006C390A0FACE5A9C96DEB163 X-D57D3AED: 3ZO7eAau8CL7WIMRKs4sN3D3tLDjz0dLbV79QFUyzQ2Ujvy7cMT6pYYqY16iZVKkSc3dCLJ7zSJH7+u4VD18S7Vl4ZUrpaVfd2+vE6kuoey4m4VkSEu530nj6fImhcD4MUrOEAnl0W826KZ9Q+tr5ycPtXkTV4k65bRjmOUUP8cvGozZ33TWg5HZplvhhXbhDGzqmQDTd6OAevLeAnq3Ra9uf7zvY2zzsIhlcp/Y7m53TZgf2aB4JOg4gkr2bioj2drqE2xHc+EqgY25oQoIQw== X-Mailru-Sender: 689FA8AB762F73936BC43F508A06382296470926E44FCD61AF3CC2B70223E0F83841015FED1DE5223CC9A89AB576DD93FB559BB5D741EB963CF37A108A312F5C27E8A8C3839CE0E267EA787935ED9F1B X-Mras: Ok Subject: [Tarantool-patches] [PATCH vshard 00/11] VShard Map-Reduce, part 2: Ref, Sched, Map X-BeenThere: tarantool-patches@dev.tarantool.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Tarantool development patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Vladislav Shpilevoy via Tarantool-patches Reply-To: Vladislav Shpilevoy Errors-To: tarantool-patches-bounces@dev.tarantool.org Sender: "Tarantool-patches" The patchset is a second part of the series introducing consistent Map-Reduce API for vshard. Core of the patchset - 3 last patches: new module 'storage.ref', new module 'storage.sched', and router's new function `map_callrw()`. The other patches are preparatory. They mostly introduce and unit-test helpers used in the last patches. For details see the commit messages. Branch: http://github.com/tarantool/vshard/tree/gerold103/gh-147-map-reduce-part2 Issue: https://github.com/tarantool/vshard/issues/147 Vladislav Shpilevoy (11): error: introduce vshard.error.timeout() storage: add helper for local functions invocation storage: cache bucket count registry: module for circular deps resolution util: introduce safe fiber_cond_wait() util: introduce fiber_is_self_canceled() storage: introduce bucket_generation_wait() storage: introduce bucket_are_all_rw() ref: introduce vshard.storage.ref module sched: introduce vshard.storage.sched module router: introduce map_callrw() test/reload_evolution/storage.result | 66 +++ test/reload_evolution/storage.test.lua | 28 ++ test/router/map-reduce.result | 636 +++++++++++++++++++++++++ test/router/map-reduce.test.lua | 258 ++++++++++ test/router/router.result | 9 +- test/router/sync.result | 10 +- test/router/sync.test.lua | 3 +- test/storage/ref.result | 406 ++++++++++++++++ test/storage/ref.test.lua | 169 +++++++ test/storage/scheduler.result | 410 ++++++++++++++++ test/storage/scheduler.test.lua | 178 +++++++ test/storage/storage.result | 168 +++++++ test/storage/storage.test.lua | 68 +++ test/unit-tap/ref.test.lua | 205 ++++++++ test/unit-tap/scheduler.test.lua | 555 +++++++++++++++++++++ test/unit/config.result | 59 +++ test/unit/config.test.lua | 23 + test/unit/error.result | 22 + test/unit/error.test.lua | 9 + test/unit/util.result | 110 +++++ test/unit/util.test.lua | 45 ++ test/upgrade/upgrade.result | 5 +- vshard/CMakeLists.txt | 3 +- vshard/cfg.lua | 8 + vshard/consts.lua | 6 + vshard/error.lua | 29 ++ vshard/registry.lua | 67 +++ vshard/replicaset.lua | 37 +- vshard/router/init.lua | 186 +++++++- vshard/storage/CMakeLists.txt | 2 +- vshard/storage/init.lua | 208 +++++++- vshard/storage/ref.lua | 397 +++++++++++++++ vshard/storage/sched.lua | 231 +++++++++ vshard/util.lua | 43 ++ 34 files changed, 4627 insertions(+), 32 deletions(-) create mode 100644 test/router/map-reduce.result create mode 100644 test/router/map-reduce.test.lua create mode 100644 test/storage/ref.result create mode 100644 test/storage/ref.test.lua create mode 100644 test/storage/scheduler.result create mode 100644 test/storage/scheduler.test.lua create mode 100755 test/unit-tap/ref.test.lua create mode 100755 test/unit-tap/scheduler.test.lua create mode 100644 vshard/registry.lua create mode 100644 vshard/storage/ref.lua create mode 100644 vshard/storage/sched.lua -- 2.24.3 (Apple Git-128)