Tarantool development patches archive
 help / color / mirror / Atom feed
From: Serge Petrenko <sergepetrenko@tarantool.org>
To: v.shpilevoy@tarantool.org, gorcunov@gmail.com
Cc: tarantool-patches@dev.tarantool.org
Subject: [Tarantool-patches] [PATCH v2 0/6] make clear_synchro_queue commit everything
Date: Wed, 23 Dec 2020 14:59:18 +0300	[thread overview]
Message-ID: <cover.1608724238.git.sergepetrenko@tarantool.org> (raw)

Changes in v2:
  - implement something similar to relay_lsn_watcher with the help of triggers.
  - fix election_qsync_stress test hang. One issue with the test itself and one
    issue with the txn_limbo.
  - various minor fixes.
  - change clear_synchro_queue behaviour: wait for quorum for
    replication_synchro_timeout. If the quorum isn't reached, rollback nothing,
    and warn the user.

@ChangeLog
  - Change `box.ctl.clear_synchro_queue` behaviour. Now it tries to commit
    everything that is present on the node. In order to do so it waits for other
    instances to replicate the data for `replication_synchro_quorum` seconds.
    In case timeout passes and quorum wasn't reached, nothing is rolled back (gh-5435)


Serge Petrenko (6):
  box: add a single execution guard to clear_synchro_queue
  relay: introduce on_status_update trigger
  txn_limbo: introduce txn_limbo_last_synchro_entry method
  box: rework clear_synchro_queue to commit everything
  test: fix replication/election_qsync_stress test
  txn_limbo: ignore CONFIRM/ROLLBACK for a foreign master

 src/box/applier.cc                            |   3 +-
 src/box/box.cc                                | 170 +++++++++++++++---
 src/box/box.h                                 |   2 +-
 src/box/lua/ctl.c                             |   4 +-
 src/box/raft.c                                |   9 +-
 src/box/relay.cc                              |  12 ++
 src/box/relay.h                               |   4 +
 src/box/txn_limbo.c                           |  26 ++-
 src/box/txn_limbo.h                           |   9 +-
 test/replication/election_qsync_stress.result |   7 +-
 .../election_qsync_stress.test.lua            |   7 +-
 test/replication/election_replica.lua         |   5 +-
 ...5435-clear-synchro-queue-commit-all.result | 144 +++++++++++++++
 ...35-clear-synchro-queue-commit-all.test.lua |  65 +++++++
 test/replication/suite.cfg                    |   1 +
 15 files changed, 423 insertions(+), 45 deletions(-)
 create mode 100644 test/replication/gh-5435-clear-synchro-queue-commit-all.result
 create mode 100644 test/replication/gh-5435-clear-synchro-queue-commit-all.test.lua

-- 
2.24.3 (Apple Git-128)

             reply	other threads:[~2020-12-23 11:59 UTC|newest]

Thread overview: 18+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-12-23 11:59 Serge Petrenko [this message]
2020-12-23 11:59 ` [Tarantool-patches] [PATCH v2 1/6] box: add a single execution guard to clear_synchro_queue Serge Petrenko
2020-12-23 11:59 ` [Tarantool-patches] [PATCH v2 2/6] relay: introduce on_status_update trigger Serge Petrenko
2020-12-23 17:25   ` Vladislav Shpilevoy
2020-12-24 16:11     ` Serge Petrenko
2020-12-23 11:59 ` [Tarantool-patches] [PATCH v2 3/6] txn_limbo: introduce txn_limbo_last_synchro_entry method Serge Petrenko
2020-12-23 17:25   ` Vladislav Shpilevoy
2020-12-24 16:13     ` Serge Petrenko
2020-12-23 11:59 ` [Tarantool-patches] [PATCH v2 4/6] box: rework clear_synchro_queue to commit everything Serge Petrenko
2020-12-23 17:28   ` Vladislav Shpilevoy
2020-12-24 16:12     ` Serge Petrenko
2020-12-24 17:35       ` Vladislav Shpilevoy
2020-12-24 21:02         ` Serge Petrenko
2020-12-23 11:59 ` [Tarantool-patches] [PATCH v2 5/6] test: fix replication/election_qsync_stress test Serge Petrenko
2020-12-23 11:59 ` [Tarantool-patches] [PATCH v2 6/6] txn_limbo: ignore CONFIRM/ROLLBACK for a foreign master Serge Petrenko
2020-12-23 17:28   ` Vladislav Shpilevoy
2020-12-24 16:13     ` Serge Petrenko
2020-12-25 10:04 ` [Tarantool-patches] [PATCH v2 0/6] make clear_synchro_queue commit everything Kirill Yukhin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=cover.1608724238.git.sergepetrenko@tarantool.org \
    --to=sergepetrenko@tarantool.org \
    --cc=gorcunov@gmail.com \
    --cc=tarantool-patches@dev.tarantool.org \
    --cc=v.shpilevoy@tarantool.org \
    --subject='Re: [Tarantool-patches] [PATCH v2 0/6] make clear_synchro_queue commit everything' \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox