From: Georgy Kirichenko <georgy@tarantool.org>
To: tarantool-patches@freelists.org
Cc: Georgy Kirichenko <georgy@tarantool.org>
Subject: [tarantool-patches] [PATCH v3 00/14] Parallel applier
Date: Sun, 9 Jun 2019 23:44:29 +0300 [thread overview]
Message-ID: <cover.1560112747.git.georgy@tarantool.org> (raw)
This patch set introduces parallel applier processing on top of
asynchronous transaction feature with corresponding fixes essential
for the patch.
This patch set is focused on three major options:
1. To make a transaction and a fiber independent from one another.
2. To make a transaction commit asynchronous.
3. To allow applier write transaction in parallel.
Changes in v3:
- Add a parallel applier implementation
- Store transaction related data such as ddl trigger to a transaction
memory region
- Fix privileges defining
- Minor fixes according to review
Changes in v2:
- Three patches are merged to master
- Replicated rows are also copied to txn region
- A fiber to process tx_prio endpoint
- Engine commit and triggers are changed in order
- Minor fixes according to review
Georgy Kirichenko (14):
txn: Fire a trigger after a transaction finalization
ddl: synchronize privileges cache with actual data state.
txn: transaction memory allocation
ddl: place alter structures onto a txn memory region
txn: get rid of autocommit from a txn structure
txn: get rid of fiber_gc from txn_rollback
wal: remove fiber from a journal_entry structure
wal: enable asyncronous wal writes
wal: a dedicated wal scheduling fiber
core: latch_unlock_external routine
txn: introduce asynchronous txn commit
txn: handle fiber stop event at transaction level
applier: apply transaction in parallel
test: fix flaky test
src/box/alter.cc | 47 ++-
src/box/applier.cc | 395 ++++++++++++++++++--------
src/box/applier.h | 4 +
src/box/box.cc | 131 +++++++--
src/box/call.c | 22 +-
src/box/index.cc | 10 +-
src/box/journal.c | 34 ++-
src/box/journal.h | 51 +++-
src/box/memtx_engine.c | 16 +-
src/box/memtx_space.c | 8 +-
src/box/sql.c | 2 +-
src/box/txn.c | 294 +++++++++++--------
src/box/txn.h | 45 ++-
src/box/vinyl.c | 18 +-
src/box/vy_log.c | 2 +-
src/box/vy_scheduler.c | 16 +-
src/box/wal.c | 137 +++++++--
src/lib/core/latch.h | 13 +-
test/box/ddl.result | 37 +++
test/box/ddl.test.lua | 15 +
test/replication/sync.result | 7 +-
test/replication/sync.test.lua | 4 +-
test/replication/transaction.result | 16 +-
test/replication/transaction.test.lua | 7 +-
24 files changed, 939 insertions(+), 392 deletions(-)
--
2.21.0
next reply other threads:[~2019-06-09 20:44 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-06-09 20:44 Georgy Kirichenko [this message]
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 01/14] txn: Fire a trigger after a transaction finalization Georgy Kirichenko
2019-06-09 21:59 ` [tarantool-patches] " Konstantin Osipov
2019-06-11 11:42 ` [tarantool-patches] " Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 02/14] ddl: synchronize privileges cache with actual data state Georgy Kirichenko
2019-06-11 13:13 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 03/14] txn: transaction memory allocation Georgy Kirichenko
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 04/14] ddl: place alter structures onto a txn memory region Georgy Kirichenko
2019-06-11 14:14 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 05/14] txn: get rid of autocommit from a txn structure Georgy Kirichenko
2019-06-13 14:11 ` Vladimir Davydov
2019-06-16 16:20 ` [tarantool-patches] " Konstantin Osipov
2019-06-16 16:14 ` Konstantin Osipov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 06/14] txn: get rid of fiber_gc from txn_rollback Georgy Kirichenko
2019-06-13 14:12 ` Vladimir Davydov
2019-06-13 19:28 ` Георгий Кириченко
2019-06-14 9:21 ` Vladimir Davydov
2019-06-16 16:38 ` [tarantool-patches] " Konstantin Osipov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 07/14] wal: remove fiber from a journal_entry structure Georgy Kirichenko
2019-06-13 14:17 ` Vladimir Davydov
2019-06-13 19:33 ` Георгий Кириченко
2019-06-14 8:05 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 08/14] wal: enable asyncronous wal writes Georgy Kirichenko
2019-06-13 14:21 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 09/14] wal: a dedicated wal scheduling fiber Georgy Kirichenko
2019-06-13 14:24 ` Vladimir Davydov
2019-06-13 19:36 ` Георгий Кириченко
2019-06-14 9:20 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 10/14] core: latch_unlock_external routine Georgy Kirichenko
2019-06-13 14:27 ` Vladimir Davydov
2019-06-13 19:38 ` Георгий Кириченко
2019-06-14 8:10 ` Vladimir Davydov
2019-06-14 9:18 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 11/14] txn: introduce asynchronous txn commit Georgy Kirichenko
2019-06-13 14:34 ` Vladimir Davydov
2019-06-13 19:45 ` Георгий Кириченко
2019-06-14 7:58 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 12/14] txn: handle fiber stop event at transaction level Georgy Kirichenko
2019-06-13 14:36 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 13/14] applier: apply transaction in parallel Georgy Kirichenko
2019-06-13 15:17 ` Vladimir Davydov
2019-06-09 20:44 ` [tarantool-patches] [PATCH v3 14/14] test: fix flaky test Georgy Kirichenko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1560112747.git.georgy@tarantool.org \
--to=georgy@tarantool.org \
--cc=tarantool-patches@freelists.org \
--subject='Re: [tarantool-patches] [PATCH v3 00/14] Parallel applier' \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox