From: sergeyb@tarantool.org
To: tarantool-patches@dev.tarantool.org, v.shpilevoy@tarantool.org
Subject: [Tarantool-patches] [PATCH v2 0/3] Make unit tests TAP-compliant
Date: Mon, 8 Jun 2020 18:58:18 +0300 [thread overview]
Message-ID: <cover.1591631501.git.sergeyb@tarantool.org> (raw)
From: Sergey Bronnikov <sergeyb@tarantool.org>
Tarantool unit tests uses TAP framework but some tests haven't produce
TAP-compliant output. This patch fixes such tests.
TAP framework contains primitives to check correctness of test functions
behaviour and produced test output contains information about passed and failed
testcases. This output processed by test-run.py on test execution. In this scheme
separate artifacts like reference output files are useless and patch removes them.
Changelog v2:
- removed dummy ok()'s
- fixed alignment
- added commit to bump msgpuck submodule version
- removed .result file in csv.test
GH branch: https://github.com/tarantool/tarantool/tree/ligurio/gh-5000-using-tap-output-in-unit-tests
GH issue: https://github.com/tarantool/tarantool/issues/5000
Sergey Bronnikov (3):
test: update unit test lib to produce TAP-compliant output
test: update unit tests to make them TAP-compliant
msgpuck: bump version to make test output TAP-compliant
src/lib/msgpuck | 2 +-
test/unit/CMakeLists.txt | 49 +-
test/unit/base64.result | 178 --
test/unit/bit.c | 59 +-
test/unit/bit.result | 715 --------
test/unit/bitset_basic.c | 32 +-
test/unit/bitset_basic.result | 12 -
test/unit/bitset_index.c | 13 +-
test/unit/bitset_index.result | 21 -
test/unit/bitset_iterator.c | 2 +
test/unit/bitset_iterator.result | 22 -
test/unit/bloom.cc | 14 +-
test/unit/bloom.result | 6 -
test/unit/bps_tree.cc | 58 +-
test/unit/bps_tree.result | 284 ---
test/unit/bps_tree_iterator.cc | 18 +-
test/unit/bps_tree_iterator.result | 21 -
test/unit/cbus.c | 20 +-
test/unit/cbus.result | 24 -
test/unit/cbus_hang.c | 2 +-
test/unit/cbus_hang.result | 4 -
test/unit/cbus_stress.c | 2 +
test/unit/cbus_stress.result | 2 -
test/unit/checkpoint_schedule.result | 41 -
test/unit/coio.result | 12 -
test/unit/coll.cpp | 59 +-
test/unit/coll.result | 90 -
test/unit/column_mask.result | 36 -
test/unit/crypto.result | 132 --
test/unit/csv.c | 2 +
test/unit/csv.result | 102 --
test/unit/decimal.result | 709 --------
test/unit/fiber.cc | 12 +-
test/unit/fiber.result | 19 -
test/unit/fiber_channel.cc | 2 +
test/unit/fiber_channel.result | 23 -
test/unit/fiber_channel_stress.cc | 2 +
test/unit/fiber_channel_stress.result | 2 -
test/unit/fiber_cond.result | 8 -
test/unit/fiber_stack.c | 3 +
test/unit/fiber_stack.result | 11 -
test/unit/fiber_stress.cc | 3 +
test/unit/fiber_stress.result | 0
test/unit/find_path.c | 2 +
test/unit/find_path.result | 2 -
test/unit/guard.cc | 1 +
test/unit/guard.result | 1 -
test/unit/guava.c | 2 +
test/unit/guava.result | 6 -
test/unit/heap.c | 2 +
test/unit/heap.result | 24 -
test/unit/heap_iterator.c | 2 +
test/unit/heap_iterator.result | 8 -
test/unit/histogram.c | 2 +
test/unit/histogram.result | 6 -
test/unit/int96.cc | 48 +-
test/unit/int96.result | 2 -
test/unit/json.result | 208 ---
test/unit/light.cc | 14 +-
test/unit/light.result | 8 -
test/unit/luaL_iterator.result | 89 -
test/unit/luaT_tuple_new.result | 22 -
test/unit/merger.result | 71 -
test/unit/mhash.result | 18 -
test/unit/mhash_bytemap.result | 18 -
test/unit/mp_error.result | 114 --
test/unit/msgpack.result | 2291 -------------------------
test/unit/popen.result | 30 -
test/unit/queue.c | 51 +-
test/unit/queue.result | 34 -
test/unit/ratelimit.result | 13 -
test/unit/reflection_c.result | 5 -
test/unit/reflection_cxx.result | 31 -
test/unit/rmean.cc | 13 +-
test/unit/rmean.result | 11 -
test/unit/rope.c | 6 +-
test/unit/rope.result | 299 ----
test/unit/rope_avl.c | 2 +
test/unit/rope_avl.result | 123 --
test/unit/rope_basic.c | 2 +
test/unit/rope_basic.result | 139 --
test/unit/rope_common.h | 7 +-
test/unit/rope_stress.c | 2 +
test/unit/rope_stress.result | 4 -
test/unit/rtree.cc | 10 +-
test/unit/rtree.result | 8 -
test/unit/rtree_iterator.cc | 4 +-
test/unit/rtree_iterator.result | 7 -
test/unit/rtree_multidim.cc | 35 +-
test/unit/rtree_multidim.result | 15 -
test/unit/say.result | 67 -
test/unit/scramble.c | 10 +-
test/unit/scramble.result | 4 -
test/unit/sio.result | 36 -
test/unit/sql-bitvec.result | 39 -
test/unit/stailq.result | 76 -
test/unit/swim.result | 234 ---
test/unit/swim_errinj.result | 18 -
test/unit/swim_proto.c | 2 +-
test/unit/swim_proto.result | 40 -
test/unit/tuple_bigref.result | 17 -
test/unit/unit.c | 3 +
test/unit/unit.h | 13 +-
test/unit/uri.result | 1307 --------------
test/unit/uuid.result | 18 -
test/unit/vclock.cc | 3 +-
test/unit/vclock.result | 149 --
test/unit/vy_cache.result | 9 -
test/unit/vy_mem.c | 4 +-
test/unit/vy_mem.result | 17 -
test/unit/vy_point_lookup.result | 20 -
test/unit/vy_write_iterator.result | 61 -
test/unit/xrow.result | 58 -
113 files changed, 327 insertions(+), 8518 deletions(-)
delete mode 100644 test/unit/base64.result
delete mode 100644 test/unit/bit.result
delete mode 100644 test/unit/bitset_basic.result
delete mode 100644 test/unit/bitset_index.result
delete mode 100644 test/unit/bitset_iterator.result
delete mode 100644 test/unit/bloom.result
delete mode 100644 test/unit/bps_tree.result
delete mode 100644 test/unit/bps_tree_iterator.result
delete mode 100644 test/unit/cbus.result
delete mode 100644 test/unit/cbus_hang.result
delete mode 100644 test/unit/cbus_stress.result
delete mode 100644 test/unit/checkpoint_schedule.result
delete mode 100644 test/unit/coio.result
delete mode 100644 test/unit/coll.result
delete mode 100644 test/unit/column_mask.result
delete mode 100644 test/unit/crypto.result
delete mode 100644 test/unit/csv.result
delete mode 100644 test/unit/decimal.result
delete mode 100644 test/unit/fiber.result
delete mode 100644 test/unit/fiber_channel.result
delete mode 100644 test/unit/fiber_channel_stress.result
delete mode 100644 test/unit/fiber_cond.result
delete mode 100644 test/unit/fiber_stack.result
delete mode 100644 test/unit/fiber_stress.result
delete mode 100644 test/unit/find_path.result
delete mode 100644 test/unit/guard.result
delete mode 100644 test/unit/guava.result
delete mode 100644 test/unit/heap.result
delete mode 100644 test/unit/heap_iterator.result
delete mode 100644 test/unit/histogram.result
delete mode 100644 test/unit/int96.result
delete mode 100644 test/unit/json.result
delete mode 100644 test/unit/light.result
delete mode 100644 test/unit/luaL_iterator.result
delete mode 100644 test/unit/luaT_tuple_new.result
delete mode 100644 test/unit/merger.result
delete mode 100644 test/unit/mhash.result
delete mode 100644 test/unit/mhash_bytemap.result
delete mode 100644 test/unit/mp_error.result
delete mode 100644 test/unit/msgpack.result
delete mode 100644 test/unit/popen.result
delete mode 100644 test/unit/queue.result
delete mode 100644 test/unit/ratelimit.result
delete mode 100644 test/unit/reflection_c.result
delete mode 100644 test/unit/reflection_cxx.result
delete mode 100644 test/unit/rmean.result
delete mode 100644 test/unit/rope.result
delete mode 100644 test/unit/rope_avl.result
delete mode 100644 test/unit/rope_basic.result
delete mode 100644 test/unit/rope_stress.result
delete mode 100644 test/unit/rtree.result
delete mode 100644 test/unit/rtree_iterator.result
delete mode 100644 test/unit/rtree_multidim.result
delete mode 100644 test/unit/say.result
delete mode 100644 test/unit/scramble.result
delete mode 100644 test/unit/sio.result
delete mode 100644 test/unit/sql-bitvec.result
delete mode 100644 test/unit/stailq.result
delete mode 100644 test/unit/swim.result
delete mode 100644 test/unit/swim_errinj.result
delete mode 100644 test/unit/swim_proto.result
delete mode 100644 test/unit/tuple_bigref.result
delete mode 100644 test/unit/uri.result
delete mode 100644 test/unit/uuid.result
delete mode 100644 test/unit/vclock.result
delete mode 100644 test/unit/vy_cache.result
delete mode 100644 test/unit/vy_mem.result
delete mode 100644 test/unit/vy_point_lookup.result
delete mode 100644 test/unit/vy_write_iterator.result
delete mode 100644 test/unit/xrow.result
--
2.23.0
next reply other threads:[~2020-06-08 15:59 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-06-08 15:58 sergeyb [this message]
2020-06-08 15:58 ` [Tarantool-patches] [PATCH v2 1/3] test: update unit test lib to produce TAP-compliant output sergeyb
2020-06-08 23:55 ` Vladislav Shpilevoy
2020-06-09 18:25 ` Sergey Bronnikov
2020-06-08 15:58 ` [Tarantool-patches] [PATCH v2 2/3] test: update unit tests to make them TAP-compliant sergeyb
2020-06-08 23:55 ` Vladislav Shpilevoy
2020-06-09 16:04 ` Sergey Bronnikov
2020-06-11 18:42 ` Vladislav Shpilevoy
2020-06-08 15:58 ` [Tarantool-patches] [PATCH v2 3/3] msgpuck: bump version to make test output TAP-compliant sergeyb
2020-06-08 16:03 ` [Tarantool-patches] [PATCH v2 4/3][msgpuck] test: " Sergey Bronnikov
2020-06-11 18:42 ` [Tarantool-patches] [PATCH v2 4/3] test: add additional checks Vladislav Shpilevoy
2020-06-11 18:42 ` [Tarantool-patches] [PATCH v2 0/3] Make unit tests TAP-compliant Vladislav Shpilevoy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1591631501.git.sergeyb@tarantool.org \
--to=sergeyb@tarantool.org \
--cc=tarantool-patches@dev.tarantool.org \
--cc=v.shpilevoy@tarantool.org \
--subject='Re: [Tarantool-patches] [PATCH v2 0/3] Make unit tests TAP-compliant' \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox