[tarantool-patches] [PATCH v5 0/7] Parallel applier

[Georgy Kirichenko]

This patch set introduces parallel applier processing on top of
asynchronous transaction feature with corresponding fixes that are 
essential for the patch set. 

This patch set is focused on three major options:
 1. To make a transaction and fiber engines independent from one
another.
 2. To make a transaction commit asynchronous.
 3. To allow applier write transaction in parallel.

Changes in v5:
 - fiber_gc after each txn_rollback
 - Autocommit patch fixes according to review
 - replicaset.applier.on_{commit/rollback} triggers to coordinate
   appliers
 - Extract refactoring into a separate patch
 - Minor fixes according to review

Changes in v4:
 - Rebase against latest master
 - Move helper commits to the head of the patch set
 - Squash asynchronous wal and asynchronous transaction commits
 - Make txn responsible for fiber yields
 - Make journal asynchronous and simplify its interface
 - Don't implement txn_wait method
 - Minor fixes according to review

Changes in v3:
 - Add a parallel applier implementation
 - Store transaction related data such as ddl trigger to a transaction
   memory region
 - Fix privileges defining
 - Minor fixes according to review

Changes in v2:
 - Three patches are merged to master
 - Replicated rows are also copied to txn region
 - A fiber to process tx_prio endpoint
 - Engine commit and triggers are changed in order
 - Minor fixes according to review

Branch:
https://github.com/tarantool/tarantool/tree/g.kirichenko/gh-1254-parallel-applier
Issue: https://github.com/tarantool/tarantool/issues/1254

Georgy Kirichenko (7):
  txn: unref statement at txn_free
  txn: get rid of autocommit from a txn structure
  txn: get rid of fiber_gc from txn_rollback
  wal: introduce a journal entry finalization callback
  txn: introduce asynchronous txn commit
  applier: apply transaction in parallel
  test: fix flaky test

 src/box/alter.cc                      |   6 +
 src/box/applier.cc                    | 236 +++++++++++++++----
 src/box/applier.h                     |   7 +
 src/box/box.cc                        |  78 ++++---
 src/box/call.c                        |  22 +-
 src/box/index.cc                      |  10 +-
 src/box/journal.c                     |  11 +-
 src/box/journal.h                     |  35 ++-
 src/box/memtx_engine.c                |  11 +-
 src/box/memtx_space.c                 |   6 +-
 src/box/replication.cc                |   7 +
 src/box/replication.h                 |  11 +
 src/box/sql.c                         |   2 +-
 src/box/txn.c                         | 311 ++++++++++++++++----------
 src/box/txn.h                         |  39 ++--
 src/box/vy_log.c                      |   3 +-
 src/box/vy_scheduler.c                |  16 +-
 src/box/wal.c                         |  48 ++--
 src/lib/core/latch.h                  |  10 +
 test/replication/sync.result          |   7 +-
 test/replication/sync.test.lua        |   4 +-
 test/replication/transaction.result   |  16 +-
 test/replication/transaction.test.lua |   7 +-
 23 files changed, 630 insertions(+), 273 deletions(-)

-- 
2.22.0