From: Vladimir Davydov <vdavydov.dev@gmail.com> To: kostja@tarantool.org Cc: tarantool-patches@freelists.org Subject: [PATCH 04/12] vinyl: zap iterator_src_type enum Date: Sun, 15 Apr 2018 22:55:17 +0300 [thread overview] Message-ID: <6924981de65120ece74b08af2c8884034918a1cd.1523820298.git.vdavydov.dev@gmail.com> (raw) In-Reply-To: <cover.1523820298.git.vdavydov.dev@gmail.com> In-Reply-To: <cover.1523820298.git.vdavydov.dev@gmail.com> vy_history_append_stmt requires the caller to pass the statement type, a value of iterator_src_type enumeration. It is needed to reference statements stored in runs (ITER_SRC_RUN). Point lookup doesn't need to reference other statements: txw is immutable during point lookup; if a statement is found in cache, point lookup returns immediately so nothing has to be referenced; mem statements are unrefable, and point lookup uses mem_tree_version to track their lifetime. To make vy_history usable by vy_read_iterator, we need to reference all kinds of statements except mem statements. The latter can be identified with vy_stmt_is_refable helper so there's no need in that extra argument nor in iterator_src_type enum. Let's zap them. However, we do need to remember whether the statement was refable at the time of insertion into a history, because by the time we clean up the history, mem statements stored in it might have been deleted, thus making vy_stmt_is_refable unusable. --- src/box/vy_point_lookup.c | 52 +++++++++++++++++++++++------------------------ 1 file changed, 26 insertions(+), 26 deletions(-) diff --git a/src/box/vy_point_lookup.c b/src/box/vy_point_lookup.c index d985bdc2..805e5455 100644 --- a/src/box/vy_point_lookup.c +++ b/src/box/vy_point_lookup.c @@ -48,27 +48,29 @@ #include "vy_upsert.h" /** - * ID of an iterator source type. Can be used in bitmaps. - */ -enum iterator_src_type { - ITER_SRC_TXW = 1, - ITER_SRC_CACHE = 2, - ITER_SRC_MEM = 4, - ITER_SRC_RUN = 8, -}; - -/** * History of a key in vinyl is a continuous sequence of statements of the * same key in order of decreasing lsn. The history can be represented as a * list, the structure below describes one node of the list. */ struct vy_history_node { - /* Type of source that the history statement came from */ - enum iterator_src_type src_type; - /* The history statement. Referenced for runs. */ - struct tuple *stmt; - /* Link in the history list */ + /** Link in a history list. */ struct rlist link; + /** History statement. Referenced if @is_refable is set. */ + struct tuple *stmt; + /** + * Set if the statement stored in this node is refable, + * i.e. has a reference counter that can be incremented + * to pin the statement in memory. Refable statements are + * referenced by the history. It is a responsibility of + * the user of the history to track lifetime of unrefable + * statements. + * + * Note, we need to store this flag here, because by the + * time we clean up a history list, unrefable statements + * stored in it might have been deleted, thus making + * vy_stmt_is_refable() unusable. + */ + bool is_refable; }; /** @@ -76,8 +78,7 @@ struct vy_history_node { * Returns 0 on success, -1 on memory allocation error. */ static int -vy_history_append_stmt(struct rlist *history, struct tuple *stmt, - enum iterator_src_type src_type) +vy_history_append_stmt(struct rlist *history, struct tuple *stmt) { struct region *region = &fiber()->gc; struct vy_history_node *node = region_alloc(region, sizeof(*node)); @@ -86,8 +87,8 @@ vy_history_append_stmt(struct rlist *history, struct tuple *stmt, "struct vy_history_node"); return -1; } - node->src_type = src_type; - if (node->src_type == ITER_SRC_RUN) + node->is_refable = vy_stmt_is_refable(stmt); + if (node->is_refable) tuple_ref(stmt); node->stmt = stmt; rlist_add_tail_entry(history, node, link); @@ -102,7 +103,7 @@ vy_history_cleanup(struct rlist *history, size_t region_svp) { struct vy_history_node *node; rlist_foreach_entry(node, history, link) - if (node->src_type == ITER_SRC_RUN) + if (node->is_refable) tuple_unref(node->stmt); region_truncate(&fiber()->gc, region_svp); @@ -144,7 +145,7 @@ vy_point_lookup_scan_txw(struct vy_lsm *lsm, struct vy_tx *tx, return 0; vy_stmt_counter_acct_tuple(&lsm->stat.txw.iterator.get, txv->stmt); - return vy_history_append_stmt(history, txv->stmt, ITER_SRC_TXW); + return vy_history_append_stmt(history, txv->stmt); } /** @@ -163,7 +164,7 @@ vy_point_lookup_scan_cache(struct vy_lsm *lsm, return 0; vy_stmt_counter_acct_tuple(&lsm->cache.stat.get, stmt); - return vy_history_append_stmt(history, stmt, ITER_SRC_CACHE); + return vy_history_append_stmt(history, stmt); } /** @@ -193,8 +194,7 @@ vy_point_lookup_scan_mem(struct vy_lsm *lsm, struct vy_mem *mem, return 0; while (true) { - if (vy_history_append_stmt(history, (struct tuple *)stmt, - ITER_SRC_MEM) != 0) + if (vy_history_append_stmt(history, (struct tuple *)stmt) != 0) return -1; vy_stmt_counter_acct_tuple(&lsm->stat.memory.iterator.get, @@ -261,7 +261,7 @@ vy_point_lookup_scan_slice(struct vy_lsm *lsm, struct vy_slice *slice, struct tuple *stmt; rc = vy_run_iterator_next_key(&run_itr, &stmt); while (rc == 0 && stmt != NULL) { - if (vy_history_append_stmt(history, stmt, ITER_SRC_RUN) != 0) { + if (vy_history_append_stmt(history, stmt) != 0) { rc = -1; break; } @@ -333,7 +333,7 @@ vy_history_apply(struct rlist *history, const struct key_def *cmp_def, if (vy_history_is_terminal(history)) { if (vy_stmt_type(node->stmt) == IPROTO_DELETE) { /* Ignore terminal delete */ - } else if (node->src_type == ITER_SRC_MEM) { + } else if (!node->is_refable) { curr_stmt = vy_stmt_dup(node->stmt); } else { curr_stmt = node->stmt; -- 2.11.0
next prev parent reply other threads:[~2018-04-15 19:55 UTC|newest] Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top 2018-04-15 19:55 [PATCH 00/12] vinyl: prepare read iterator for index rebuild Vladimir Davydov 2018-04-15 19:55 ` [PATCH 01/12] vinyl: rename vy_stmt_history to vy_history Vladimir Davydov 2018-04-15 19:55 ` [PATCH 02/12] vinyl: factor out vy_history_apply from vy_point_lookup_apply_history Vladimir Davydov 2018-05-14 18:19 ` [tarantool-patches] " Vladislav Shpilevoy 2018-04-15 19:55 ` [PATCH 03/12] vinyl: add vy_history_append_stmt helper Vladimir Davydov 2018-04-15 19:55 ` Vladimir Davydov [this message] 2018-04-15 19:55 ` [PATCH 05/12] vinyl: encapsulate key history with struct Vladimir Davydov 2018-04-15 19:55 ` [PATCH 06/12] vinyl: refine vy_history_cleanup Vladimir Davydov 2018-04-15 19:55 ` [PATCH 07/12] vinyl: move vy_history to its own source file Vladimir Davydov 2018-04-15 19:55 ` [PATCH 08/12] vinyl: use mempool for vy_history_node allocations Vladimir Davydov 2018-04-15 19:55 ` [PATCH 09/12] vinyl: consolidate skip optimization checks in read iterator Vladimir Davydov 2018-05-14 18:25 ` [tarantool-patches] " Vladislav Shpilevoy 2018-05-15 15:00 ` Vladimir Davydov 2018-04-15 19:55 ` [PATCH 10/12] vinyl: refactor vy_read_iterator_next Vladimir Davydov 2018-04-15 19:55 ` [PATCH 11/12] vinyl: make read iterator always return newest tuple version Vladimir Davydov 2018-04-15 19:55 ` [PATCH 12/12] vinyl: zap vy_read_iterator::curr_stmt Vladimir Davydov 2018-05-04 18:05 ` [tarantool-patches] Re: [PATCH 00/12] vinyl: prepare read iterator for index rebuild Vladislav Shpilevoy
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=6924981de65120ece74b08af2c8884034918a1cd.1523820298.git.vdavydov.dev@gmail.com \ --to=vdavydov.dev@gmail.com \ --cc=kostja@tarantool.org \ --cc=tarantool-patches@freelists.org \ --subject='Re: [PATCH 04/12] vinyl: zap iterator_src_type enum' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox