[Tarantool-patches] [PATCH v1] test: mark tests as fragile, 2nd group

[Tarantool-patches] [PATCH v1] test: mark tests as fragile, 2nd group

[Alexander V. Tikhonov]

Fragiled flaky tests from parallel runs to avoid
of flaky fails in regular testing:

  app/fiber_channel.test.lua                ; gh-4961
  box/alter_limits.test.lua                 ; gh-4926
  replication/wal_stress.test.lua           ; gh-4977

Part of #4953
---

Github: https://github.com/tarantool/tarantool/tree/avtikhon/gh-4953-fragile-flaky-tests
Issue: https://github.com/tarantool/tarantool/issues/4953

 test/app/suite.ini         | 1 +
 test/box/suite.ini         | 1 +
 test/replication/suite.ini | 1 +
 3 files changed, 3 insertions(+)

diff --git a/test/app/suite.ini b/test/app/suite.ini
index dd802d98c..829765447 100644
--- a/test/app/suite.ini
+++ b/test/app/suite.ini
@@ -7,3 +7,4 @@ use_unix_sockets = True
 use_unix_sockets_iproto = True
 is_parallel = True
 pretest_clean = True
+fragile = fiber_channel.test.lua            ; gh-4961
diff --git a/test/box/suite.ini b/test/box/suite.ini
index 01f07236b..cd933e9e8 100644
--- a/test/box/suite.ini
+++ b/test/box/suite.ini
@@ -14,3 +14,4 @@ fragile = bitset.test.lua      ; gh-4095
           func_reload.test.lua ; gh-4425
           function1.test.lua   ; gh-4199
           net.box.test.lua     ; gh-3851 gh-4383
+          alter_limits.test.lua ; gh-4926
diff --git a/test/replication/suite.ini b/test/replication/suite.ini
index 897514aa6..1475e2395 100644
--- a/test/replication/suite.ini
+++ b/test/replication/suite.ini
@@ -18,3 +18,4 @@ fragile = errinj.test.lua            ; gh-3870
           sync.test.lua              ; gh-3835 gh-3877
           transaction.test.lua       ; gh-4312
           wal_off.test.lua           ; gh-4355
+          wal_stress.test.lua        ; gh-4977
-- 
2.17.1

Re: [Tarantool-patches] [PATCH v1] test: mark tests as fragile, 2nd group

[Sergey Bronnikov]

Hi, Alexander

On 07:46 Fri 15 May , Alexander V. Tikhonov wrote:
> Fragiled flaky tests from parallel runs to avoid
> of flaky fails in regular testing:
> 
>   app/fiber_channel.test.lua                ; gh-4961
>   box/alter_limits.test.lua                 ; gh-4926
>   replication/wal_stress.test.lua           ; gh-4977
> 
> Part of #4953
> ---

LGTM

Re: [Tarantool-patches] [PATCH v1] test: mark tests as fragile, 2nd group

[Oleg Piskunov]

[-- Attachment #1: Type: text/plain, Size: 1802 bytes --]


LGTM

  
>Пятница, 15 мая 2020, 7:46 +03:00 от Alexander V. Tikhonov <avtikhon@tarantool.org>:
> 
>Fragiled flaky tests from parallel runs to avoid
>of flaky fails in regular testing:
>
>  app/fiber_channel.test.lua ; gh-4961
>  box/alter_limits.test.lua ; gh-4926
>  replication/wal_stress.test.lua ; gh-4977
>
>Part of #4953
>---
>
>Github:  https://github.com/tarantool/tarantool/tree/avtikhon/gh-4953-fragile-flaky-tests
>Issue:  https://github.com/tarantool/tarantool/issues/4953
>
> test/app/suite.ini | 1 +
> test/box/suite.ini | 1 +
> test/replication/suite.ini | 1 +
> 3 files changed, 3 insertions(+)
>
>diff --git a/test/app/suite.ini b/test/app/suite.ini
>index dd802d98c..829765447 100644
>--- a/test/app/suite.ini
>+++ b/test/app/suite.ini
>@@ -7,3 +7,4 @@ use_unix_sockets = True
> use_unix_sockets_iproto = True
> is_parallel = True
> pretest_clean = True
>+fragile = fiber_channel.test.lua ; gh-4961
>diff --git a/test/box/suite.ini b/test/box/suite.ini
>index 01f07236b..cd933e9e8 100644
>--- a/test/box/suite.ini
>+++ b/test/box/suite.ini
>@@ -14,3 +14,4 @@ fragile = bitset.test.lua ; gh-4095
>           func_reload.test.lua ; gh-4425
>           function1.test.lua ; gh-4199
>           net.box.test.lua ; gh-3851 gh-4383
>+ alter_limits.test.lua ; gh-4926
>diff --git a/test/replication/suite.ini b/test/replication/suite.ini
>index 897514aa6..1475e2395 100644
>--- a/test/replication/suite.ini
>+++ b/test/replication/suite.ini
>@@ -18,3 +18,4 @@ fragile = errinj.test.lua ; gh-3870
>           sync.test.lua ; gh-3835 gh-3877
>           transaction.test.lua ; gh-4312
>           wal_off.test.lua ; gh-4355
>+ wal_stress.test.lua ; gh-4977
>--
>2.17.1
>  
 
 
--
Oleg Piskunov
 

[-- Attachment #2: Type: text/html, Size: 2840 bytes --]

Re: [Tarantool-patches] [PATCH v1] test: mark tests as fragile, 2nd group

[Kirill Yukhin]

Hello,

On 15 май 07:46, Alexander V. Tikhonov wrote:
> Fragiled flaky tests from parallel runs to avoid
> of flaky fails in regular testing:
> 
>   app/fiber_channel.test.lua                ; gh-4961
>   box/alter_limits.test.lua                 ; gh-4926
>   replication/wal_stress.test.lua           ; gh-4977
> 
> Part of #4953
> ---
> 
> Github: https://github.com/tarantool/tarantool/tree/avtikhon/gh-4953-fragile-flaky-tests
> Issue: https://github.com/tarantool/tarantool/issues/4953

I've checked your patch into 1.10, 2.3, 2.4 and master.

--
Regards, Kirill Yukhin