From: Vladimir Davydov <vdavydov.dev@gmail.com>
To: kostja@tarantool.org
Cc: tarantool-patches@freelists.org
Subject: [PATCH 0/6] Introduce blackhole engine
Date: Fri, 20 Jul 2018 20:43:29 +0300 [thread overview]
Message-ID: <cover.1532107326.git.vdavydov.dev@gmail.com> (raw)
In the scope of #2129, we need to store deferred DELETE statements
generated during primary index compaction in the WAL so that we can
recover them after restart. This patch set introduces a new engine for
this purpose - blackhole. Spaces that use this engine may be written to,
but not read from (they don't even support creation of indexes). All
operations done on a blackhole space are logged in the WAL and hence
replayed during recovery, which is just what we need.
https://github.com/tarantool/tarantool/issues/2129
https://github.com/tarantool/tarantool/commits/dv/blackhole
Nikita Pettik (1):
Rework memtx replace function
Vladimir Davydov (5):
Add generic engine, space, index method stubs
Merge sysview_index.[hc] and sysview_engine.[hc]
txn: unify txn_stmt tuples reference counting rules
space: call before_replace trigger even if space has no indexes
Introduce blackhole engine
src/box/CMakeLists.txt | 4 +-
src/box/blackhole.c | 210 ++++++++++++++++
src/box/{sysview_index.h => blackhole.h} | 40 ++-
src/box/box.cc | 6 +-
src/box/engine.c | 161 ++++++++++++
src/box/engine.h | 28 +++
src/box/index.cc | 13 +
src/box/index.h | 3 +
src/box/memtx_engine.c | 47 +---
src/box/memtx_space.c | 100 +++++---
src/box/memtx_space.h | 20 +-
src/box/space.c | 109 +++++++--
src/box/space.h | 14 ++
src/box/{sysview_index.c => sysview.c} | 195 +++++++++++++--
src/box/{sysview_engine.h => sysview.h} | 16 +-
src/box/sysview_engine.c | 406 -------------------------------
src/box/txn.c | 19 ++
src/box/vinyl.c | 42 +---
test/box/blackhole.result | 177 ++++++++++++++
test/box/blackhole.test.lua | 64 +++++
20 files changed, 1068 insertions(+), 606 deletions(-)
create mode 100644 src/box/blackhole.c
rename src/box/{sysview_index.h => blackhole.h} (69%)
rename src/box/{sysview_index.c => sysview.c} (70%)
rename src/box/{sysview_engine.h => sysview.h} (84%)
delete mode 100644 src/box/sysview_engine.c
create mode 100644 test/box/blackhole.result
create mode 100644 test/box/blackhole.test.lua
--
2.11.0
next reply other threads:[~2018-07-20 17:43 UTC|newest]
Thread overview: 24+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-07-20 17:43 Vladimir Davydov [this message]
2018-07-20 17:43 ` [PATCH 1/6] Add generic engine, space, index method stubs Vladimir Davydov
2018-07-20 17:56 ` Konstantin Osipov
2018-07-21 12:24 ` Vladimir Davydov
2018-07-20 17:43 ` [PATCH 2/6] Merge sysview_index.[hc] and sysview_engine.[hc] Vladimir Davydov
2018-07-20 18:02 ` Konstantin Osipov
2018-07-21 12:24 ` Vladimir Davydov
2018-07-20 17:43 ` [PATCH 3/6] Rework memtx replace function Vladimir Davydov
2018-07-20 18:04 ` Konstantin Osipov
2018-07-21 12:24 ` Vladimir Davydov
2018-07-20 17:43 ` [PATCH 4/6] txn: unify txn_stmt tuples reference counting rules Vladimir Davydov
2018-07-20 18:31 ` Konstantin Osipov
2018-07-21 12:24 ` Vladimir Davydov
2018-07-20 17:43 ` [PATCH 5/6] space: call before_replace trigger even if space has no indexes Vladimir Davydov
2018-07-20 18:39 ` Konstantin Osipov
2018-07-21 12:26 ` Vladimir Davydov
2018-07-21 20:59 ` Konstantin Osipov
2018-07-23 10:15 ` Vladimir Davydov
2018-07-20 17:43 ` [PATCH 6/6] Introduce blackhole engine Vladimir Davydov
2018-07-20 18:42 ` Konstantin Osipov
2018-07-21 12:35 ` Vladimir Davydov
2018-07-23 11:02 ` Vladimir Davydov
2018-07-23 12:53 ` Vladimir Davydov
2018-07-23 18:30 ` [PATCH 0/6] " Konstantin Osipov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1532107326.git.vdavydov.dev@gmail.com \
--to=vdavydov.dev@gmail.com \
--cc=kostja@tarantool.org \
--cc=tarantool-patches@freelists.org \
--subject='Re: [PATCH 0/6] Introduce blackhole engine' \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox