From: Vladimir Davydov <vdavydov.dev@gmail.com> To: Konstantin Osipov <kostja.osipov@gmail.com> Cc: tarantool-patches@freelists.org Subject: Re: [PATCH 5/6] wal: separate checkpoint and flush paths Date: Mon, 26 Nov 2018 23:19:31 +0300 [thread overview] Message-ID: <20181126201931.o5tntrxgrqsao5uc@esperanza> (raw) In-Reply-To: <20181126175834.GF7839@chai> On Mon, Nov 26, 2018 at 08:58:34PM +0300, Konstantin Osipov wrote: > * Vladimir Davydov <vdavydov.dev@gmail.com> [18/11/26 10:27]: > > Currently, wal_checkpoint() is used for two purposes. First, to make a > > checkpoint (rotate = true). Second, to flush all pending WAL requests > > (rotate = false). Since checkpointing has to fail if cascading rollback > > is in progress so does flushing. This is confusing. Let's separate the > > two paths. > > I agree with the two paths, but wal_flush() as a name is > confusing, since no flushing is happening. This function makes sure that all requests submitted to WAL are processed before it returns, i.e. it effectively flushes WAL cpipe. Its name is consistent with cbus_flush, which it uses under the hood. > > Let's call it wal_sync() or wal_wait() or something similar. > > wal_checkpoint() could also be made more obvious and renamed to > wal_rotate(). There will be more to WAL checkpointing than simply rotating the current WAL file. For example, in patch #6 I update WAL's vision of the last checkpoint vclock there, and in the scope of checkpoint_wal_threshold option implementation I will reset the size of WAL files written since the last checkpoint there, too. In fact, I'll need two functions to do all those things properly - one to be called when checkpointing is started (this is where wal_checkpoint() is currently called), another - when it completes. I'm planning to call them wal_begin_checkpoint() and wal_commit_checkpoint() to match the corresponding engine methods (again see patch #6).
next prev parent reply other threads:[~2018-11-26 20:19 UTC|newest] Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top 2018-11-25 13:48 [PATCH 0/6] WAL garbage collection and checkpointing fixes Vladimir Davydov 2018-11-25 13:48 ` [PATCH 1/6] vclock: allow to use const vclock as search key Vladimir Davydov 2018-11-26 17:38 ` Konstantin Osipov 2018-11-27 9:56 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 2/6] engine: pass vclock instead of lsn to collect_garbage callback Vladimir Davydov 2018-11-26 17:41 ` Konstantin Osipov 2018-11-27 9:56 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 3/6] box: do not rotate WAL when replica subscribes Vladimir Davydov 2018-11-26 17:50 ` Konstantin Osipov 2018-11-27 9:57 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 4/6] box: use replicaset.vclock in replica join/subscribe Vladimir Davydov 2018-11-26 17:54 ` Konstantin Osipov 2018-11-27 9:57 ` Vladimir Davydov 2018-11-25 13:48 ` [PATCH 5/6] wal: separate checkpoint and flush paths Vladimir Davydov 2018-11-26 17:58 ` Konstantin Osipov 2018-11-26 20:19 ` Vladimir Davydov [this message] 2018-11-28 16:46 ` Konstantin Osipov 2018-11-25 13:48 ` [PATCH 6/6] wal: remove files needed for recovery from backup checkpoints on ENOSPC Vladimir Davydov 2018-11-28 16:14 ` Vladimir Davydov
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20181126201931.o5tntrxgrqsao5uc@esperanza \ --to=vdavydov.dev@gmail.com \ --cc=kostja.osipov@gmail.com \ --cc=tarantool-patches@freelists.org \ --subject='Re: [PATCH 5/6] wal: separate checkpoint and flush paths' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox