[tarantool-patches] [PATCH 0/7] Replication: In-memory replication
Georgy Kirichenko
georgy at tarantool.org
Tue Aug 13 09:27:38 MSK 2019
This patchset introduces from-wal-memory-replication and consist of 4
preparation patches, one patch that introduces memory-replication and 2
follow ups that clear unused facility from tarantool code.
First patch introduces a wal writer fiber and write queue what is needed
in order to have an ability to yield during wal writes. Without this
functionality there is no possibility to make a cbus call from wal
writer functions.
Second patch moves wal dir tracking into gc state. This is required to
simplify relay state tracking as in-memory relay would not have any glue
about wal files boundaries.
Third patch removes wal boundaries tracking from relay
Forth patch prepares wal to write all data in a memory buffer and then
write the data to a file. This memory buffer contains raw encoded data
and xrow_header index to support navigation thorough the data.
The next patch allows a relay to attach to relay and call send callback
on each row stored in a wal memory buffer.
Two subsequent patches removes wal_watcher and on_close_log triggers as
unused.
Branch: https://github.com/tarantool/tarantool/tree/g.kirichenko/gh-3794-memory-replication
Issue: https://github.com/tarantool/tarantool/issues/3794
Georgy Kirichenko (7):
Refactoring: wal writer fiber and queue
Refactoring: Track wal files using gc state.
Replication: Relay does not rely on xlog boundaries
Replication: wal memory buffer
Replication: in memory replication
Refactoring: remove wal_watcher routines
Refactoring: get rid of on_close_log
src/box/CMakeLists.txt | 1 +
src/box/box.cc | 25 +-
src/box/gc.c | 131 ++++-
src/box/gc.h | 34 +-
src/box/lua/info.c | 25 +-
src/box/memtx_engine.c | 2 +-
src/box/recovery.cc | 10 +-
src/box/recovery.h | 5 +-
src/box/relay.cc | 263 +++------
src/box/vy_log.c | 4 +-
src/box/wal.c | 742 +++++++++++++++-----------
src/box/wal.h | 97 +---
src/box/wal_mem.c | 273 ++++++++++
src/box/wal_mem.h | 166 ++++++
src/box/xlog.c | 87 ++-
src/box/xlog.h | 11 +-
test/replication/gc_no_space.result | 4 +-
test/replication/gc_no_space.test.lua | 4 +-
18 files changed, 1208 insertions(+), 676 deletions(-)
create mode 100644 src/box/wal_mem.c
create mode 100644 src/box/wal_mem.h
--
2.22.0
More information about the Tarantool-patches
mailing list