Tarantool development patches archive
 help / color / mirror / Atom feed
* [Tarantool-patches] [PATCH v2 0/3] Make unit tests TAP-compliant
@ 2020-06-08 15:58 sergeyb
  2020-06-08 15:58 ` [Tarantool-patches] [PATCH v2 1/3] test: update unit test lib to produce TAP-compliant output sergeyb
                   ` (5 more replies)
  0 siblings, 6 replies; 12+ messages in thread
From: sergeyb @ 2020-06-08 15:58 UTC (permalink / raw)
  To: tarantool-patches, v.shpilevoy

From: Sergey Bronnikov <sergeyb@tarantool.org>

Tarantool unit tests uses TAP framework but some tests haven't produce
TAP-compliant output. This patch fixes such tests.

TAP framework contains primitives to check correctness of test functions
behaviour and produced test output contains information about passed and failed
testcases. This output processed by test-run.py on test execution. In this scheme
separate artifacts like reference output files are useless and patch removes them.

Changelog v2:

- removed dummy ok()'s
- fixed alignment
- added commit to bump msgpuck submodule version
- removed .result file in csv.test

GH branch: https://github.com/tarantool/tarantool/tree/ligurio/gh-5000-using-tap-output-in-unit-tests
GH issue: https://github.com/tarantool/tarantool/issues/5000

Sergey Bronnikov (3):
  test: update unit test lib to produce TAP-compliant output
  test: update unit tests to make them TAP-compliant
  msgpuck: bump version to make test output TAP-compliant

 src/lib/msgpuck                       |    2 +-
 test/unit/CMakeLists.txt              |   49 +-
 test/unit/base64.result               |  178 --
 test/unit/bit.c                       |   59 +-
 test/unit/bit.result                  |  715 --------
 test/unit/bitset_basic.c              |   32 +-
 test/unit/bitset_basic.result         |   12 -
 test/unit/bitset_index.c              |   13 +-
 test/unit/bitset_index.result         |   21 -
 test/unit/bitset_iterator.c           |    2 +
 test/unit/bitset_iterator.result      |   22 -
 test/unit/bloom.cc                    |   14 +-
 test/unit/bloom.result                |    6 -
 test/unit/bps_tree.cc                 |   58 +-
 test/unit/bps_tree.result             |  284 ---
 test/unit/bps_tree_iterator.cc        |   18 +-
 test/unit/bps_tree_iterator.result    |   21 -
 test/unit/cbus.c                      |   20 +-
 test/unit/cbus.result                 |   24 -
 test/unit/cbus_hang.c                 |    2 +-
 test/unit/cbus_hang.result            |    4 -
 test/unit/cbus_stress.c               |    2 +
 test/unit/cbus_stress.result          |    2 -
 test/unit/checkpoint_schedule.result  |   41 -
 test/unit/coio.result                 |   12 -
 test/unit/coll.cpp                    |   59 +-
 test/unit/coll.result                 |   90 -
 test/unit/column_mask.result          |   36 -
 test/unit/crypto.result               |  132 --
 test/unit/csv.c                       |    2 +
 test/unit/csv.result                  |  102 --
 test/unit/decimal.result              |  709 --------
 test/unit/fiber.cc                    |   12 +-
 test/unit/fiber.result                |   19 -
 test/unit/fiber_channel.cc            |    2 +
 test/unit/fiber_channel.result        |   23 -
 test/unit/fiber_channel_stress.cc     |    2 +
 test/unit/fiber_channel_stress.result |    2 -
 test/unit/fiber_cond.result           |    8 -
 test/unit/fiber_stack.c               |    3 +
 test/unit/fiber_stack.result          |   11 -
 test/unit/fiber_stress.cc             |    3 +
 test/unit/fiber_stress.result         |    0
 test/unit/find_path.c                 |    2 +
 test/unit/find_path.result            |    2 -
 test/unit/guard.cc                    |    1 +
 test/unit/guard.result                |    1 -
 test/unit/guava.c                     |    2 +
 test/unit/guava.result                |    6 -
 test/unit/heap.c                      |    2 +
 test/unit/heap.result                 |   24 -
 test/unit/heap_iterator.c             |    2 +
 test/unit/heap_iterator.result        |    8 -
 test/unit/histogram.c                 |    2 +
 test/unit/histogram.result            |    6 -
 test/unit/int96.cc                    |   48 +-
 test/unit/int96.result                |    2 -
 test/unit/json.result                 |  208 ---
 test/unit/light.cc                    |   14 +-
 test/unit/light.result                |    8 -
 test/unit/luaL_iterator.result        |   89 -
 test/unit/luaT_tuple_new.result       |   22 -
 test/unit/merger.result               |   71 -
 test/unit/mhash.result                |   18 -
 test/unit/mhash_bytemap.result        |   18 -
 test/unit/mp_error.result             |  114 --
 test/unit/msgpack.result              | 2291 -------------------------
 test/unit/popen.result                |   30 -
 test/unit/queue.c                     |   51 +-
 test/unit/queue.result                |   34 -
 test/unit/ratelimit.result            |   13 -
 test/unit/reflection_c.result         |    5 -
 test/unit/reflection_cxx.result       |   31 -
 test/unit/rmean.cc                    |   13 +-
 test/unit/rmean.result                |   11 -
 test/unit/rope.c                      |    6 +-
 test/unit/rope.result                 |  299 ----
 test/unit/rope_avl.c                  |    2 +
 test/unit/rope_avl.result             |  123 --
 test/unit/rope_basic.c                |    2 +
 test/unit/rope_basic.result           |  139 --
 test/unit/rope_common.h               |    7 +-
 test/unit/rope_stress.c               |    2 +
 test/unit/rope_stress.result          |    4 -
 test/unit/rtree.cc                    |   10 +-
 test/unit/rtree.result                |    8 -
 test/unit/rtree_iterator.cc           |    4 +-
 test/unit/rtree_iterator.result       |    7 -
 test/unit/rtree_multidim.cc           |   35 +-
 test/unit/rtree_multidim.result       |   15 -
 test/unit/say.result                  |   67 -
 test/unit/scramble.c                  |   10 +-
 test/unit/scramble.result             |    4 -
 test/unit/sio.result                  |   36 -
 test/unit/sql-bitvec.result           |   39 -
 test/unit/stailq.result               |   76 -
 test/unit/swim.result                 |  234 ---
 test/unit/swim_errinj.result          |   18 -
 test/unit/swim_proto.c                |    2 +-
 test/unit/swim_proto.result           |   40 -
 test/unit/tuple_bigref.result         |   17 -
 test/unit/unit.c                      |    3 +
 test/unit/unit.h                      |   13 +-
 test/unit/uri.result                  | 1307 --------------
 test/unit/uuid.result                 |   18 -
 test/unit/vclock.cc                   |    3 +-
 test/unit/vclock.result               |  149 --
 test/unit/vy_cache.result             |    9 -
 test/unit/vy_mem.c                    |    4 +-
 test/unit/vy_mem.result               |   17 -
 test/unit/vy_point_lookup.result      |   20 -
 test/unit/vy_write_iterator.result    |   61 -
 test/unit/xrow.result                 |   58 -
 113 files changed, 327 insertions(+), 8518 deletions(-)
 delete mode 100644 test/unit/base64.result
 delete mode 100644 test/unit/bit.result
 delete mode 100644 test/unit/bitset_basic.result
 delete mode 100644 test/unit/bitset_index.result
 delete mode 100644 test/unit/bitset_iterator.result
 delete mode 100644 test/unit/bloom.result
 delete mode 100644 test/unit/bps_tree.result
 delete mode 100644 test/unit/bps_tree_iterator.result
 delete mode 100644 test/unit/cbus.result
 delete mode 100644 test/unit/cbus_hang.result
 delete mode 100644 test/unit/cbus_stress.result
 delete mode 100644 test/unit/checkpoint_schedule.result
 delete mode 100644 test/unit/coio.result
 delete mode 100644 test/unit/coll.result
 delete mode 100644 test/unit/column_mask.result
 delete mode 100644 test/unit/crypto.result
 delete mode 100644 test/unit/csv.result
 delete mode 100644 test/unit/decimal.result
 delete mode 100644 test/unit/fiber.result
 delete mode 100644 test/unit/fiber_channel.result
 delete mode 100644 test/unit/fiber_channel_stress.result
 delete mode 100644 test/unit/fiber_cond.result
 delete mode 100644 test/unit/fiber_stack.result
 delete mode 100644 test/unit/fiber_stress.result
 delete mode 100644 test/unit/find_path.result
 delete mode 100644 test/unit/guard.result
 delete mode 100644 test/unit/guava.result
 delete mode 100644 test/unit/heap.result
 delete mode 100644 test/unit/heap_iterator.result
 delete mode 100644 test/unit/histogram.result
 delete mode 100644 test/unit/int96.result
 delete mode 100644 test/unit/json.result
 delete mode 100644 test/unit/light.result
 delete mode 100644 test/unit/luaL_iterator.result
 delete mode 100644 test/unit/luaT_tuple_new.result
 delete mode 100644 test/unit/merger.result
 delete mode 100644 test/unit/mhash.result
 delete mode 100644 test/unit/mhash_bytemap.result
 delete mode 100644 test/unit/mp_error.result
 delete mode 100644 test/unit/msgpack.result
 delete mode 100644 test/unit/popen.result
 delete mode 100644 test/unit/queue.result
 delete mode 100644 test/unit/ratelimit.result
 delete mode 100644 test/unit/reflection_c.result
 delete mode 100644 test/unit/reflection_cxx.result
 delete mode 100644 test/unit/rmean.result
 delete mode 100644 test/unit/rope.result
 delete mode 100644 test/unit/rope_avl.result
 delete mode 100644 test/unit/rope_basic.result
 delete mode 100644 test/unit/rope_stress.result
 delete mode 100644 test/unit/rtree.result
 delete mode 100644 test/unit/rtree_iterator.result
 delete mode 100644 test/unit/rtree_multidim.result
 delete mode 100644 test/unit/say.result
 delete mode 100644 test/unit/scramble.result
 delete mode 100644 test/unit/sio.result
 delete mode 100644 test/unit/sql-bitvec.result
 delete mode 100644 test/unit/stailq.result
 delete mode 100644 test/unit/swim.result
 delete mode 100644 test/unit/swim_errinj.result
 delete mode 100644 test/unit/swim_proto.result
 delete mode 100644 test/unit/tuple_bigref.result
 delete mode 100644 test/unit/uri.result
 delete mode 100644 test/unit/uuid.result
 delete mode 100644 test/unit/vclock.result
 delete mode 100644 test/unit/vy_cache.result
 delete mode 100644 test/unit/vy_mem.result
 delete mode 100644 test/unit/vy_point_lookup.result
 delete mode 100644 test/unit/vy_write_iterator.result
 delete mode 100644 test/unit/xrow.result

-- 
2.23.0

^ permalink raw reply	[flat|nested] 12+ messages in thread

end of thread, other threads:[~2020-06-11 18:42 UTC | newest]

Thread overview: 12+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-06-08 15:58 [Tarantool-patches] [PATCH v2 0/3] Make unit tests TAP-compliant sergeyb
2020-06-08 15:58 ` [Tarantool-patches] [PATCH v2 1/3] test: update unit test lib to produce TAP-compliant output sergeyb
2020-06-08 23:55   ` Vladislav Shpilevoy
2020-06-09 18:25     ` Sergey Bronnikov
2020-06-08 15:58 ` [Tarantool-patches] [PATCH v2 2/3] test: update unit tests to make them TAP-compliant sergeyb
2020-06-08 23:55   ` Vladislav Shpilevoy
2020-06-09 16:04     ` Sergey Bronnikov
2020-06-11 18:42   ` Vladislav Shpilevoy
2020-06-08 15:58 ` [Tarantool-patches] [PATCH v2 3/3] msgpuck: bump version to make test output TAP-compliant sergeyb
2020-06-08 16:03 ` [Tarantool-patches] [PATCH v2 4/3][msgpuck] test: " Sergey Bronnikov
2020-06-11 18:42 ` [Tarantool-patches] [PATCH v2 4/3] test: add additional checks Vladislav Shpilevoy
2020-06-11 18:42 ` [Tarantool-patches] [PATCH v2 0/3] Make unit tests TAP-compliant Vladislav Shpilevoy

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox