[Tarantool-patches] [PATCH v1] Enable test reruns on failed fragiled tests

Kirill Yukhin kyukhin at tarantool.org
Fri Sep 25 18:58:07 MSK 2020


Hello,

On 22 сен 22:18, Alexander V. Tikhonov wrote:
> In test-run implemented the new format of the fragile lists based on
> JSON format set as fragile option in 'suite.ini' files per each suite:
> 
>    fragile = {
>         "retries": 10,
>         "tests": {
>             "bitset.test.lua": {
>                 "issues": [ "gh-4095" ],
>                 "checksums": [ "050af3a99561a724013995668a4bc71c", "f34be60193cfe9221d3fe50df657e9d3" ]
>             }
>         }}
> 
> Added ability to check results file checksum on tests fail and
> compare with the checksums of the known issues mentioned in the
> fragile list.
> 
> Also added ability to set 'retries' option, which sets the number
> of accepted reruns of the tests failed from 'fragile' list that
> have checksums on its fails.
> 
> Closes #5050

LGTM.
I've checked your patch into 1.10, 2.4, 2.5 master.

--
Regards, Kirill Yukhin


More information about the Tarantool-patches mailing list