From: Vladimir Davydov <vdavydov.dev@gmail.com>
To: kostja@tarantool.org
Cc: tarantool-patches@freelists.org
Subject: [PATCH v2 00/11] Replica rejoin
Date: Fri, 8 Jun 2018 20:34:18 +0300 [thread overview]
Message-ID: <cover.1528478913.git.vdavydov.dev@gmail.com> (raw)
After this patch set is applied, an instance will try to detect if
it fell too much behind its peers in the cluster and so needs to be
rebootstrapped. If it does, it will skip local recovery and instead
proceed to bootstrap from a remote master. Old files (xlog, snap)
are not deleted during rebootstrap. They will be removed by gc as
usual.
TODO: write a test checking that garbage collection works as expected.
https://github.com/tarantool/tarantool/issues/461
https://github.com/tarantool/tarantool/commits/gh-461-replica-rejoin
Changes in v2:
- Implement rebootstrap support for vinyl engine.
- Call recover_remaining_wals() explicitly after recovery_stop_local()
as suggested by @kostja.
- Add comment to memtx_engine_new() explaining why we need to init
INSTANCE_UUID before proceeding to local recovery.
v1: https://www.freelists.org/post/tarantool-patches/RFC-PATCH-0012-Replica-rejoin
Vladimir Davydov (11):
box: retrieve instance uuid before starting local recovery
box: refactor hot standby recovery
box: retrieve end vclock before starting local recovery
box: open the port before starting local recovery
box: connect to remote peers before starting local recovery
box: factor out local recovery function
applier: inquire oldest vclock on connect
replication: rebootstrap instance on startup if it fell behind
vinyl: simplify vylog recovery from backup
vinyl: pass flags to vy_recovery_new
vinyl: implement rebootstrap support
src/box/applier.cc | 15 ++
src/box/applier.h | 2 +
src/box/box.cc | 312 +++++++++++++++++--------------
src/box/box.h | 4 +-
src/box/iproto.cc | 30 ++-
src/box/iproto.h | 5 +-
src/box/iproto_constants.h | 2 +
src/box/lua/cfg.cc | 1 -
src/box/memtx_engine.c | 21 ++-
src/box/recovery.cc | 34 +++-
src/box/recovery.h | 5 +-
src/box/replication.cc | 15 ++
src/box/replication.h | 9 +
src/box/vinyl.c | 8 +-
src/box/vy_log.c | 208 +++++++++++++++------
src/box/vy_log.h | 50 ++++-
src/box/xrow.c | 36 ++++
src/box/xrow.h | 31 +++
test/replication/replica_rejoin.result | 201 ++++++++++++++++++++
test/replication/replica_rejoin.test.lua | 75 ++++++++
20 files changed, 832 insertions(+), 232 deletions(-)
create mode 100644 test/replication/replica_rejoin.result
create mode 100644 test/replication/replica_rejoin.test.lua
--
2.11.0
next reply other threads:[~2018-06-08 17:34 UTC|newest]
Thread overview: 34+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-06-08 17:34 Vladimir Davydov [this message]
2018-06-08 17:34 ` [PATCH v2 01/11] box: retrieve instance uuid before starting local recovery Vladimir Davydov
2018-06-08 17:51 ` Konstantin Osipov
2018-06-08 17:34 ` [PATCH v2 02/11] box: refactor hot standby recovery Vladimir Davydov
2018-06-08 17:34 ` [PATCH v2 03/11] box: retrieve end vclock before starting local recovery Vladimir Davydov
2018-06-14 12:58 ` Konstantin Osipov
2018-06-08 17:34 ` [PATCH v2 04/11] box: open the port " Vladimir Davydov
2018-06-13 20:43 ` Konstantin Osipov
2018-06-14 8:31 ` Vladimir Davydov
2018-06-14 12:59 ` Konstantin Osipov
2018-06-15 15:48 ` [PATCH 0/3] Speed up recovery in case rebootstrap is not needed Vladimir Davydov
2018-06-15 15:48 ` [PATCH 1/3] xlog: erase eof marker when reopening existing file for writing Vladimir Davydov
2018-06-27 17:09 ` Konstantin Osipov
2018-06-15 15:48 ` [PATCH 2/3] wal: rollback vclock on write failure Vladimir Davydov
2018-06-27 17:22 ` Konstantin Osipov
2018-06-15 15:48 ` [PATCH 3/3] wal: create empty xlog on shutdown Vladimir Davydov
2018-06-27 17:29 ` Konstantin Osipov
2018-06-08 17:34 ` [PATCH v2 05/11] box: connect to remote peers before starting local recovery Vladimir Davydov
2018-06-13 20:45 ` Konstantin Osipov
2018-06-14 8:34 ` Vladimir Davydov
2018-06-14 12:59 ` Konstantin Osipov
2018-06-08 17:34 ` [PATCH v2 06/11] box: factor out local recovery function Vladimir Davydov
2018-06-13 20:50 ` Konstantin Osipov
2018-06-08 17:34 ` [PATCH v2 07/11] applier: inquire oldest vclock on connect Vladimir Davydov
2018-06-13 20:51 ` Konstantin Osipov
2018-06-14 8:40 ` Vladimir Davydov
2018-06-08 17:34 ` [PATCH v2 08/11] replication: rebootstrap instance on startup if it fell behind Vladimir Davydov
2018-06-13 20:55 ` Konstantin Osipov
2018-06-14 8:58 ` Vladimir Davydov
2018-06-08 17:34 ` [PATCH v2 09/11] vinyl: simplify vylog recovery from backup Vladimir Davydov
2018-06-08 17:34 ` [PATCH v2 10/11] vinyl: pass flags to vy_recovery_new Vladimir Davydov
2018-06-13 20:56 ` Konstantin Osipov
2018-06-08 17:34 ` [PATCH v2 11/11] vinyl: implement rebootstrap support Vladimir Davydov
2018-06-10 12:02 ` Vladimir Davydov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1528478913.git.vdavydov.dev@gmail.com \
--to=vdavydov.dev@gmail.com \
--cc=kostja@tarantool.org \
--cc=tarantool-patches@freelists.org \
--subject='Re: [PATCH v2 00/11] Replica rejoin' \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox