From: Vladimir Davydov <vdavydov.dev@gmail.com> To: kostja@tarantool.org Cc: tarantool-patches@freelists.org Subject: [PATCH 0/6] WAL garbage collection and checkpointing fixes Date: Sun, 25 Nov 2018 16:48:07 +0300 [thread overview] Message-ID: <cover.1543152574.git.vdavydov.dev@gmail.com> (raw) This patch set fixes a couple of issues related to WAL checkpointing and garbage collection (see [1, 2]) and does some refactoring necessary for implementation of checkpoint-on-WAL-threshold feature (see [3]). The branch with the code is available at [4]. [1] https://github.com/tarantool/tarantool/issues/3822 [2] https://github.com/tarantool/tarantool/issues/3830 [3] https://github.com/tarantool/tarantool/issues/1082 [4] https://github.com/tarantool/tarantool/commits/dv/wal-gc-fixes Vladimir Davydov (6): vclock: allow to use const vclock as search key engine: pass vclock instead of lsn to collect_garbage callback box: do not rotate WAL when replica subscribes box: use replicaset.vclock in replica join/subscribe wal: separate checkpoint and flush paths wal: remove files needed for recovery from backup checkpoints on ENOSPC src/box/box.cc | 45 +++--- src/box/engine.c | 9 +- src/box/engine.h | 9 +- src/box/gc.c | 22 +-- src/box/gc.h | 14 -- src/box/memtx_engine.c | 5 +- src/box/vclock.c | 4 +- src/box/vclock.h | 5 +- src/box/vinyl.c | 14 +- src/box/vy_log.c | 36 ++--- src/box/vy_log.h | 4 +- src/box/wal.c | 171 ++++++++++++--------- src/box/wal.h | 34 ++-- test/replication/gc.result | 8 +- test/replication/gc.test.lua | 6 +- test/replication/gc_no_space.result | 51 +++++- test/replication/gc_no_space.test.lua | 27 +++- test/replication/show_error_on_disconnect.result | 12 +- test/replication/show_error_on_disconnect.test.lua | 10 +- test/replication/sync.result | 37 +++++ test/replication/sync.test.lua | 12 ++ 21 files changed, 326 insertions(+), 209 deletions(-) -- 2.11.0
next reply other threads:[~2018-11-25 13:48 UTC|newest] Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top 2018-11-25 13:48 Vladimir Davydov [this message] 2018-11-25 13:48 ` [PATCH 1/6] vclock: allow to use const vclock as search key Vladimir Davydov 2018-11-26 17:38 ` Konstantin Osipov 2018-11-27 9:56 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 2/6] engine: pass vclock instead of lsn to collect_garbage callback Vladimir Davydov 2018-11-26 17:41 ` Konstantin Osipov 2018-11-27 9:56 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 3/6] box: do not rotate WAL when replica subscribes Vladimir Davydov 2018-11-26 17:50 ` Konstantin Osipov 2018-11-27 9:57 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 4/6] box: use replicaset.vclock in replica join/subscribe Vladimir Davydov 2018-11-26 17:54 ` Konstantin Osipov 2018-11-27 9:57 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 5/6] wal: separate checkpoint and flush paths Vladimir Davydov 2018-11-26 17:58 ` Konstantin Osipov 2018-11-26 20:19 ` Vladimir Davydov 2018-11-28 16:46 ` Konstantin Osipov 2018-11-25 13:48 ` [PATCH 6/6] wal: remove files needed for recovery from backup checkpoints on ENOSPC Vladimir Davydov 2018-11-28 16:14 ` Vladimir Davydov
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=cover.1543152574.git.vdavydov.dev@gmail.com \ --to=vdavydov.dev@gmail.com \ --cc=kostja@tarantool.org \ --cc=tarantool-patches@freelists.org \ --subject='Re: [PATCH 0/6] WAL garbage collection and checkpointing fixes' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox