From: Vladimir Davydov <vdavydov.dev@gmail.com>
To: kostja@tarantool.org
Cc: tarantool-patches@freelists.org
Subject: [RFC PATCH 00/12] Replica rejoin
Date: Wed, 6 Jun 2018 20:45:00 +0300 [thread overview]
Message-ID: <cover.1528305232.git.vdavydov.dev@gmail.com> (raw)
After this patch set is applied, an instance will try to detect if
it fell too much behind its peers in the cluster and so needs to be
rebootstrapped. If it does, it will skip local recovery and instead
proceed to bootstrap from a remote master. Old files (xlog, snap)
are not deleted during rebootstrap. They will be removed by gc as
usual.
NOTE rebootstrap will bluntly fail if there are vinyl spaces on the
replica. Vinyl support is planned for the near future, but since it
won't touch generic code, I'm posting the patch set now for early
review.
https://github.com/tarantool/tarantool/issues/461
https://github.com/tarantool/tarantool/commits/gh-461-replica-rejoin
Vladimir Davydov (12):
recovery: drop unused recovery_exit
recovery: constify vclock argument
applier: remove extra new line in log message printed on connect
xrow: add helper function for encoding vclock
box: retrieve instance uuid before starting local recovery
box: refactor hot standby recovery
box: retrieve end vclock before starting local recovery
box: open the port before starting local recovery
box: connect to remote peers before starting local recovery
box: factor out local recovery function
applier: inquire oldest vclock on connect
replication: rebootstrap instance on startup if it fell behind
src/box/applier.cc | 17 +-
src/box/applier.h | 2 +
src/box/box.cc | 311 +++++++++++++++++--------------
src/box/box.h | 4 +-
src/box/iproto.cc | 30 ++-
src/box/iproto.h | 5 +-
src/box/iproto_constants.h | 2 +
src/box/lua/cfg.cc | 1 -
src/box/memtx_engine.c | 11 +-
src/box/recovery.cc | 49 ++---
src/box/recovery.h | 9 +-
src/box/replication.cc | 15 ++
src/box/replication.h | 9 +
src/box/xrow.c | 94 +++++++---
src/box/xrow.h | 31 +++
test/replication/replica_rejoin.result | 194 +++++++++++++++++++
test/replication/replica_rejoin.test.lua | 73 ++++++++
test/replication/suite.cfg | 1 +
18 files changed, 640 insertions(+), 218 deletions(-)
create mode 100644 test/replication/replica_rejoin.result
create mode 100644 test/replication/replica_rejoin.test.lua
--
2.11.0
next reply other threads:[~2018-06-06 17:45 UTC|newest]
Thread overview: 22+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-06-06 17:45 Vladimir Davydov [this message]
2018-06-06 17:45 ` [RFC PATCH 01/12] recovery: drop unused recovery_exit Vladimir Davydov
2018-06-08 4:13 ` Konstantin Osipov
2018-06-06 17:45 ` [RFC PATCH 02/12] recovery: constify vclock argument Vladimir Davydov
2018-06-08 4:14 ` Konstantin Osipov
2018-06-06 17:45 ` [RFC PATCH 03/12] applier: remove extra new line in log message printed on connect Vladimir Davydov
2018-06-08 4:15 ` Konstantin Osipov
2018-06-06 17:45 ` [RFC PATCH 04/12] xrow: add helper function for encoding vclock Vladimir Davydov
2018-06-08 4:16 ` Konstantin Osipov
2018-06-06 17:45 ` [RFC PATCH 05/12] box: retrieve instance uuid before starting local recovery Vladimir Davydov
2018-06-08 4:22 ` Konstantin Osipov
2018-06-06 17:45 ` [RFC PATCH 06/12] box: refactor hot standby recovery Vladimir Davydov
2018-06-08 4:40 ` Konstantin Osipov
2018-06-08 6:43 ` Vladimir Davydov
2018-06-08 13:15 ` Konstantin Osipov
2018-06-08 13:30 ` Vladimir Davydov
2018-06-06 17:45 ` [RFC PATCH 07/12] box: retrieve end vclock before starting local recovery Vladimir Davydov
2018-06-06 17:45 ` [RFC PATCH 08/12] box: open the port " Vladimir Davydov
2018-06-06 17:45 ` [RFC PATCH 09/12] box: connect to remote peers " Vladimir Davydov
2018-06-06 17:45 ` [RFC PATCH 10/12] box: factor out local recovery function Vladimir Davydov
2018-06-06 17:45 ` [RFC PATCH 11/12] applier: inquire oldest vclock on connect Vladimir Davydov
2018-06-06 17:45 ` [RFC PATCH 12/12] replication: rebootstrap instance on startup if it fell behind Vladimir Davydov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1528305232.git.vdavydov.dev@gmail.com \
--to=vdavydov.dev@gmail.com \
--cc=kostja@tarantool.org \
--cc=tarantool-patches@freelists.org \
--subject='Re: [RFC PATCH 00/12] Replica rejoin' \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox