From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from [87.239.111.99] (localhost [127.0.0.1]) by dev.tarantool.org (Postfix) with ESMTP id E30D76901D; Wed, 14 Apr 2021 17:19:22 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org E30D76901D DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tarantool.org; s=dev; t=1618409962; bh=QZ32Y+4/0aI6JguWXPsNl5harNg6IvOye6JAaSHGfDs=; h=To:Date:In-Reply-To:References:Subject:List-Id:List-Unsubscribe: List-Archive:List-Post:List-Help:List-Subscribe:From:Reply-To:Cc: From; b=scbbeLoqwrh0RmVDyFOE/IrmvgqMu1hHKtQuyRlcotSXhh1KZNqvfrVgYRZo6Wcss PNWoK5QSlDPU2CWaY0gcFC205GOzoD0h46o3unSlbMtrefPB695z64X8clSEU0rDXF Ymcui1eIZr0LP4ldLVE+5kpVQWtUbgqMDYkxUaeI= Received: from smtp41.i.mail.ru (smtp41.i.mail.ru [94.100.177.101]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dev.tarantool.org (Postfix) with ESMTPS id A1E946901D for ; Wed, 14 Apr 2021 17:17:25 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org A1E946901D Received: by smtp41.i.mail.ru with esmtpa (envelope-from ) id 1lWgKa-000456-Tw; Wed, 14 Apr 2021 17:17:25 +0300 To: v.shpilevoy@tarantool.org, gorcunov@gmail.com Date: Wed, 14 Apr 2021 17:17:14 +0300 Message-Id: <63f4e63825172aaad50b910ed7c0431246380d45.1618409665.git.sergepetrenko@tarantool.org> X-Mailer: git-send-email 2.24.3 (Apple Git-128) In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-7564579A: 646B95376F6C166E X-77F55803: 4F1203BC0FB41BD92FFCB8E6708E7480D608FE24BC85426BB1B55F651FED8C70182A05F5380850408FBCDD139BEC5BDC84956767FCBD04AECA992E87AEBE058AE785D157E08A4B28 X-7FA49CB5: FF5795518A3D127A4AD6D5ED66289B5278DA827A17800CE7B4D64F1449264784EA1F7E6F0F101C67BD4B6F7A4D31EC0BCC500DACC3FED6E28638F802B75D45FF8AA50765F7900637AE7D31454303AF298638F802B75D45FF914D58D5BE9E6BC1A93B80C6DEB9DEE97C6FB206A91F05B26BB47E05DF6076339DDF1239964562DCAD368CDB2FD0D9CCD2E47CDBA5A96583C09775C1D3CA48CFA12191B5F2BB8629117882F4460429724CE54428C33FAD30A8DF7F3B2552694AC26CFBAC0749D213D2E47CDBA5A9658378DA827A17800CE7BEE62E5629C982429FA2833FD35BB23DF004C90652538430302FCEF25BFAB3454AD6D5ED66289B5278DA827A17800CE7D8B6069DCA00196BD32BA5DBAC0009BE395957E7521B51C20BC6067A898B09E4090A508E0FED6299176DF2183F8FC7C0B01F8B705E65F4D2B3661434B16C20AC78D18283394535A9E827F84554CEF50127C277FBC8AE2E8BA83251EDC214901ED5E8D9A59859A8B6D0C9BB9AE6BD5D69089D37D7C0E48F6C5571747095F342E88FB05168BE4CE3AF X-B7AD71C0: AC4F5C86D027EB782CDD5689AFBDA7A24209795067102C07E8F7B195E1C978317776011BB17C354FE7218EB9B50BAE8A X-C1DE0DAB: C20DE7B7AB408E4181F030C43753B8183A4AFAF3EA6BDC44E1F4276B80994196B69F9342289A40B39FE28831B606568F7D02FE1CB026D3CF9C2B6934AE262D3EE7EAB7254005DCED7532B743992DF240BDC6A1CF3F042BAD6DF99611D93F60EF0417BEADF48D1460699F904B3F4130E343918A1A30D5E7FCCB5012B2E24CD356 X-C8649E89: 4E36BF7865823D7055A7F0CF078B5EC49A30900B95165D34697E0FA301E28215B416B437BB32D9A7BEF649B2E6BD73EFEAD64DAEA8A0D06B7FEFDBC1FB1B62261D7E09C32AA3244C02D1F65D9DF82D7C86C77C36B687F095E8FBBEFAE1C4874C927AC6DF5659F194 X-D57D3AED: 3ZO7eAau8CL7WIMRKs4sN3D3tLDjz0dLbV79QFUyzQ2Ujvy7cMT6pYYqY16iZVKkSc3dCLJ7zSJH7+u4VD18S7Vl4ZUrpaVfd2+vE6kuoey4m4VkSEu530nj6fImhcD4MUrOEAnl0W826KZ9Q+tr5ycPtXkTV4k65bRjmOUUP8cvGozZ33TWg5HZplvhhXbhDGzqmQDTd6OAevLeAnq3Ra9uf7zvY2zzsIhlcp/Y7m53TZgf2aB4JOg4gkr2biojrcJA+pXcDukXNDvJtZnBRg== X-Mailru-Sender: 583F1D7ACE8F49BDD2846D59FC20E9F832D6326595065D5C8B8C285E1EFF4D966B6DFD5BB5DC3097424AE0EB1F3D1D21E2978F233C3FAE6EE63DB1732555E4A8EE80603BA4A5B0BC112434F685709FCF0DA7A0AF5A3A8387 X-Mras: Ok Subject: [Tarantool-patches] [PATCH v3 04/10] box: make clear_synchro_queue() write a PROMOTE entry instead of CONFIRM + ROLLBACK X-BeenThere: tarantool-patches@dev.tarantool.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Tarantool development patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Serge Petrenko via Tarantool-patches Reply-To: Serge Petrenko Cc: tarantool-patches@dev.tarantool.org Errors-To: tarantool-patches-bounces@dev.tarantool.org Sender: "Tarantool-patches" A successful box_clear_synchro_queue() call results in writing CONFIRM(N) ROLLBACK(N+1) pair, where N is the confirmed lsn. Let's write a single PROMOTE(N) entry instead. It'll have the same meaning as CONFIRM + ROLLBACK and it will give followers some additional information regarding leader state change later. Part of #5445 --- src/box/box.cc | 14 +++++++- src/box/txn_limbo.c | 81 +++++++++++++++++++++++++-------------------- src/box/txn_limbo.h | 17 ++++++---- 3 files changed, 69 insertions(+), 43 deletions(-) diff --git a/src/box/box.cc b/src/box/box.cc index 70b325180..9adb6ba46 100644 --- a/src/box/box.cc +++ b/src/box/box.cc @@ -1556,7 +1556,19 @@ box_clear_synchro_queue(bool try_wait) "new synchronous transactions appeared"); rc = -1; } else { - txn_limbo_force_empty(&txn_limbo, wait_lsn); + /* + * Term parameter is unused now, We'll pass + * box_raft()->term there later. + */ + txn_limbo_write_promote(&txn_limbo, wait_lsn, 0); + struct synchro_request req = { + .type = 0, /* unused */ + .replica_id = 0, /* unused */ + .origin_id = instance_id, + .lsn = wait_lsn, + .term = 0, /* unused */ + }; + txn_limbo_read_promote(&txn_limbo, &req); assert(txn_limbo_is_empty(&txn_limbo)); } } diff --git a/src/box/txn_limbo.c b/src/box/txn_limbo.c index d29722ef7..bfe0ad302 100644 --- a/src/box/txn_limbo.c +++ b/src/box/txn_limbo.c @@ -317,21 +317,24 @@ txn_limbo_write_cb(struct journal_entry *entry) } static void -txn_limbo_write_synchro(struct txn_limbo *limbo, uint32_t type, int64_t lsn) +txn_limbo_write_synchro(struct txn_limbo *limbo, uint32_t type, int64_t lsn, + uint64_t term) { - assert(lsn > 0); + assert(lsn >= 0); struct synchro_request req = { .type = type, .replica_id = limbo->owner_id, .lsn = lsn, + .term = term, }; /* - * This is a synchronous commit so we can - * allocate everything on a stack. + * This is a synchronous commit so we can allocate everything on a + * stack. Note, that promote body includes synchro body. */ - struct synchro_body_bin body; + struct promote_body_bin body_bin; + struct xrow_header row; char buf[sizeof(struct journal_entry) + sizeof(struct xrow_header *)]; @@ -339,7 +342,10 @@ txn_limbo_write_synchro(struct txn_limbo *limbo, uint32_t type, int64_t lsn) struct journal_entry *entry = (struct journal_entry *)buf; entry->rows[0] = &row; - xrow_encode_synchro(&row, &body, &req); + if (type == IPROTO_PROMOTE) + xrow_encode_promote(&row, &body_bin, &req); + else + xrow_encode_synchro(&row, &body_bin.base, &req); journal_entry_create(entry, 1, xrow_approx_len(&row), txn_limbo_write_cb, fiber()); @@ -371,14 +377,14 @@ txn_limbo_write_confirm(struct txn_limbo *limbo, int64_t lsn) assert(lsn > limbo->confirmed_lsn); assert(!limbo->is_in_rollback); limbo->confirmed_lsn = lsn; - txn_limbo_write_synchro(limbo, IPROTO_CONFIRM, lsn); + txn_limbo_write_synchro(limbo, IPROTO_CONFIRM, lsn, 0); } /** Confirm all the entries <= @a lsn. */ static void txn_limbo_read_confirm(struct txn_limbo *limbo, int64_t lsn) { - assert(limbo->owner_id != REPLICA_ID_NIL); + assert(limbo->owner_id != REPLICA_ID_NIL || txn_limbo_is_empty(limbo)); assert(limbo == &txn_limbo); struct txn_limbo_entry *e, *tmp; rlist_foreach_entry_safe(e, &limbo->queue, in_queue, tmp) { @@ -425,7 +431,7 @@ txn_limbo_write_rollback(struct txn_limbo *limbo, int64_t lsn) assert(lsn > limbo->confirmed_lsn); assert(!limbo->is_in_rollback); limbo->is_in_rollback = true; - txn_limbo_write_synchro(limbo, IPROTO_ROLLBACK, lsn); + txn_limbo_write_synchro(limbo, IPROTO_ROLLBACK, lsn, 0); limbo->is_in_rollback = false; } @@ -433,7 +439,7 @@ txn_limbo_write_rollback(struct txn_limbo *limbo, int64_t lsn) static void txn_limbo_read_rollback(struct txn_limbo *limbo, int64_t lsn) { - assert(limbo->owner_id != REPLICA_ID_NIL); + assert(limbo->owner_id != REPLICA_ID_NIL || txn_limbo_is_empty(limbo)); assert(limbo == &txn_limbo); struct txn_limbo_entry *e, *tmp; struct txn_limbo_entry *last_rollback = NULL; @@ -464,6 +470,32 @@ txn_limbo_read_rollback(struct txn_limbo *limbo, int64_t lsn) box_update_ro_summary(); } +void +txn_limbo_write_promote(struct txn_limbo *limbo, int64_t lsn, uint64_t term) +{ + limbo->confirmed_lsn = lsn; + /* + * We make sure that promote is only written once everything this + * instance has may be confirmed. + */ + struct txn_limbo_entry *e = txn_limbo_last_synchro_entry(limbo); + assert(e == NULL || e->lsn <= lsn); + (void) e; + txn_limbo_write_synchro(limbo, IPROTO_PROMOTE, lsn, term); + limbo->is_in_rollback = false; +} + +void +txn_limbo_read_promote(struct txn_limbo *limbo, + const struct synchro_request *req) +{ + txn_limbo_read_confirm(limbo, req->lsn); + txn_limbo_read_rollback(limbo, req->lsn + 1); + assert(txn_limbo_is_empty(&txn_limbo)); + limbo->owner_id = req->origin_id; + limbo->confirmed_lsn = 0; +} + void txn_limbo_ack(struct txn_limbo *limbo, uint32_t replica_id, int64_t lsn) { @@ -626,38 +658,15 @@ txn_limbo_process(struct txn_limbo *limbo, const struct synchro_request *req) case IPROTO_ROLLBACK: txn_limbo_read_rollback(limbo, req->lsn); break; + case IPROTO_PROMOTE: + txn_limbo_read_promote(limbo, req); + break; default: unreachable(); } return; } -void -txn_limbo_force_empty(struct txn_limbo *limbo, int64_t confirm_lsn) -{ - struct txn_limbo_entry *e, *last_quorum = NULL; - struct txn_limbo_entry *rollback = NULL; - rlist_foreach_entry(e, &limbo->queue, in_queue) { - if (txn_has_flag(e->txn, TXN_WAIT_ACK)) { - if (e->lsn <= confirm_lsn) { - last_quorum = e; - } else { - rollback = e; - break; - } - } - } - - if (last_quorum != NULL) { - txn_limbo_write_confirm(limbo, last_quorum->lsn); - txn_limbo_read_confirm(limbo, last_quorum->lsn); - } - if (rollback != NULL) { - txn_limbo_write_rollback(limbo, rollback->lsn); - txn_limbo_read_rollback(limbo, rollback->lsn); - } -} - void txn_limbo_on_parameters_change(struct txn_limbo *limbo) { diff --git a/src/box/txn_limbo.h b/src/box/txn_limbo.h index f2a98c8bb..4a1c43856 100644 --- a/src/box/txn_limbo.h +++ b/src/box/txn_limbo.h @@ -272,14 +272,19 @@ int txn_limbo_wait_confirm(struct txn_limbo *limbo); /** - * Make txn_limbo confirm all the entries with lsn less than or - * equal to the given one, and rollback all the following entries. - * The function makes txn_limbo write CONFIRM and ROLLBACK - * messages for appropriate lsns, and then process the messages - * immediately. + * Write a PROMOTE request, which has the same effect as CONFIRM(@a lsn) and + * ROLLBACK(@a lsn + 1) combined. */ void -txn_limbo_force_empty(struct txn_limbo *limbo, int64_t last_confirm); +txn_limbo_write_promote(struct txn_limbo *limbo, int64_t lsn, uint64_t term); + +/** + * Process a PROMOTE request, i.e. confirm all entries <= @req.lsn and rollback all + * entries > @req.lsn. + */ +void +txn_limbo_read_promote(struct txn_limbo *limbo, + const struct synchro_request *req); /** * Update qsync parameters dynamically. -- 2.24.3 (Apple Git-128)