From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <v.shpilevoy@tarantool.org>
Received: from smtpng2.m.smailru.net (smtpng2.m.smailru.net [94.100.179.3])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (No client certificate requested)
 by dev.tarantool.org (Postfix) with ESMTPS id F3AD94765E0
 for <tarantool-patches@dev.tarantool.org>;
 Mon, 21 Dec 2020 20:49:55 +0300 (MSK)
References: <20201214113935.1040421-1-gorcunov@gmail.com>
 <20201214113935.1040421-3-gorcunov@gmail.com>
 <619b78fe-d559-7eb6-5e28-e239ed7f6e46@tarantool.org>
From: Vladislav Shpilevoy <v.shpilevoy@tarantool.org>
Message-ID: <577274db-ec07-c646-0e49-033d6257082a@tarantool.org>
Date: Mon, 21 Dec 2020 18:49:54 +0100
MIME-Version: 1.0
In-Reply-To: <619b78fe-d559-7eb6-5e28-e239ed7f6e46@tarantool.org>
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 7bit
Subject: Re: [Tarantool-patches] [PATCH v4 2/3] cfg: support symbolic
 evaluation of replication_synchro_quorum
List-Id: Tarantool development patches <tarantool-patches.dev.tarantool.org>
List-Unsubscribe: <https://lists.tarantool.org/mailman/options/tarantool-patches>, 
 <mailto:tarantool-patches-request@dev.tarantool.org?subject=unsubscribe>
List-Archive: <https://lists.tarantool.org/pipermail/tarantool-patches/>
List-Post: <mailto:tarantool-patches@dev.tarantool.org>
List-Help: <mailto:tarantool-patches-request@dev.tarantool.org?subject=help>
List-Subscribe: <https://lists.tarantool.org/mailman/listinfo/tarantool-patches>, 
 <mailto:tarantool-patches-request@dev.tarantool.org?subject=subscribe>
To: Cyrill Gorcunov <gorcunov@gmail.com>, tml <tarantool-patches@dev.tarantool.org>
Cc: Mons Anderson <v.perepelitsa@corp.mail.ru>

Oh, sorry. Also the test seems to be flaky.

I run it some number of times using this command:

	python test-run.py replication/gh-5446-qsync replication/gh-5446-qsync replication/gh-5446-qsync ... <repeat tens of times>

And got this:

[001] Test failed! Result content mismatch:
[001] --- replication/gh-5446-qsync-eval-quorum.result	Mon Dec 21 18:42:44 2020
[001] +++ var/rejects/replication/gh-5446-qsync-eval-quorum.reject	Mon Dec 21 18:47:40 2020
[001] @@ -38,7 +38,7 @@
[001]   | ...
[001]  test_run:grep_log("default", match) ~= nil
[001]   | ---
[001] - | - true
[001] + | - false
[001]   | ...
[001]  
[001]  -- Create a sync space we will operate on
[001]