From: Alexander Turenko <alexander.turenko@tarantool.org> To: Vladislav Shpilevoy <v.shpilevoy@tarantool.org> Cc: tarantool-patches@dev.tarantool.org, Alexander Turenko <alexander.turenko@tarantool.org> Subject: [Tarantool-patches] [PATCH v3 14/16] module api: expose box_key_def_extract_key() Date: Tue, 13 Oct 2020 02:23:21 +0300 [thread overview] Message-ID: <808c8f94de8981eab1e8971b73514b937aa808f7.1602541394.git.alexander.turenko@tarantool.org> (raw) In-Reply-To: <cover.1602541394.git.alexander.turenko@tarantool.org> Unlike box_tuple_extract_key() it accepts a key_def structure, not space_id, index_id pair. Another difference from box_tuple_extract_key() is that this function allows to pass so called multikey index. See commit 2.2.0-259-gf1d9f2575 ('box: introduce multikey indexes in memtx') for details. Note: The <multikey_idx> parameter is ignored on the backported version of the patch on 1.10. Part of #5273 --- src/box/key_def.c | 7 ++ src/box/key_def.h | 20 +++++ src/exports.h | 1 + test/app-tap/module_api.c | 126 +++++++++++++++++++++++++++++++ test/app-tap/module_api.test.lua | 2 +- 5 files changed, 155 insertions(+), 1 deletion(-) diff --git a/src/box/key_def.c b/src/box/key_def.c index 7226f2482..da1c23135 100644 --- a/src/box/key_def.c +++ b/src/box/key_def.c @@ -620,6 +620,13 @@ box_key_def_merge(const box_key_def_t *first, const box_key_def_t *second) return key_def_merge(first, second); } +char * +box_key_def_extract_key(box_key_def_t *key_def, box_tuple_t *tuple, + int multikey_idx, uint32_t *key_size_ptr) +{ + return tuple_extract_key(tuple, key_def, multikey_idx, key_size_ptr); +} + /* }}} Module API functions */ int diff --git a/src/box/key_def.h b/src/box/key_def.h index fdf65dec6..1b27836a8 100644 --- a/src/box/key_def.h +++ b/src/box/key_def.h @@ -525,6 +525,26 @@ box_tuple_compare_with_key(box_tuple_t *tuple_a, const char *key_b, API_EXPORT box_key_def_t * box_key_def_merge(const box_key_def_t *first, const box_key_def_t *second); +/** + * Extract key from tuple by given key definition and return + * buffer allocated on the box region with this key. + * @sa <box_region_truncate>(). + * + * This function has O(n) complexity, where n is the number of key + * parts. + * + * @param key_def Definition of key that need to extract. + * @param tuple Tuple from which need to extract key. + * @param multikey_idx Multikey index hint or -1. + * @param key_size_ptr Here will be size of extracted key. + * + * @retval not NULL Success. + * @retval NULL Memory allocation error. + */ +API_EXPORT char * +box_key_def_extract_key(box_key_def_t *key_def, box_tuple_t *tuple, + int multikey_idx, uint32_t *key_size_ptr); + /** \endcond public */ /* diff --git a/src/exports.h b/src/exports.h index 223390d52..a0c7ac84d 100644 --- a/src/exports.h +++ b/src/exports.h @@ -31,6 +31,7 @@ EXPORT(box_iterator_free) EXPORT(box_iterator_next) EXPORT(box_key_def_delete) EXPORT(box_key_def_dump_parts) +EXPORT(box_key_def_extract_key) EXPORT(box_key_def_merge) EXPORT(box_key_def_new) EXPORT(box_key_def_new_v2) diff --git a/test/app-tap/module_api.c b/test/app-tap/module_api.c index 175217ef9..25cd8a5e7 100644 --- a/test/app-tap/module_api.c +++ b/test/app-tap/module_api.c @@ -1580,6 +1580,131 @@ test_key_def_merge(struct lua_State *L) return 1; } +/** + * Basic <box_key_def_extract_key>() test. + */ +static int +test_key_def_extract_key(struct lua_State *L) +{ + size_t region_svp = box_region_used(); + + /* + * Create a key_def. + * + * | tuple + * | [x, x, x] + * | key_def ^ ^ + * | | | | + * | (0) <-----+---- string (optional) + * | | | + * | (1) <---- unsigned + */ + box_key_part_def_t parts[2]; + box_key_part_def_create(&parts[0]); + box_key_part_def_create(&parts[1]); + parts[0].fieldno = 2; + parts[0].field_type = "string"; + parts[0].flags |= BOX_KEY_PART_DEF_IS_NULLABLE; + parts[1].fieldno = 0; + parts[1].field_type = "unsigned"; + box_key_def_t *key_def = box_key_def_new_v2(parts, 2); + assert(key_def != NULL); + + /* + * Create tuples to extract keys from them. + * + * | # | tuple | key | + * | - | ------------- | ---------- | + * | 0 | [1, 2, "moo"] | ["moo", 1] | + * | 1 | [1, 2, null] | [null, 1] | + * | 2 | [1, 2] | [null, 1] | + * | 3 | [1] | [null, 1] | + */ + box_tuple_t *tuples[] = { + /* [0] = */ new_runtime_tuple("\x93\x01\x02\xa3moo", 7), + /* [1] = */ new_runtime_tuple("\x93\x01\x02\xc0", 4), + /* [2] = */ new_runtime_tuple("\x92\x01\x02", 3), + /* [3] = */ new_runtime_tuple("\x91\x01", 2), + }; + struct { + const char *key; + uint32_t key_size; + } expected_keys_1[] = { + /* [0] = */ {"\x92\xa3moo\x01", 6}, + /* [1] = */ {"\x92\xc0\x01", 3}, + /* [2] = */ {"\x92\xc0\x01", 3}, + /* [3] = */ {"\x92\xc0\x01", 3}, + }; + + for (size_t i = 0; i < lengthof(tuples); ++i) { + uint32_t key_size = 0; + char *key = box_key_def_extract_key(key_def, tuples[i], -1, + &key_size); + assert(key != NULL); + uint32_t exp_key_size = expected_keys_1[i].key_size; + const char *exp_key = expected_keys_1[i].key; + assert(key_size == exp_key_size); + assert(memcmp(key, exp_key, exp_key_size) == 0); + } + + /* Clean up. */ + for (size_t i = 0; i < lengthof(tuples); ++i) + box_tuple_unref(tuples[i]); + box_key_def_delete(key_def); + + /* + * Create a key_def with multikey JSON path. + * + * | tuple + * | [[x, x, x], x, x] + * | key_def ^ ^ ^ + * | | 0 1 2 + * | | | | | + * | | |--+--+ + * | | | + * | (0) <---- unsigned + */ + box_key_part_def_t part; + box_key_part_def_create(&part); + part.fieldno = 0; + part.field_type = "unsigned"; + part.path = "[*]"; + key_def = box_key_def_new_v2(&part, 1); + assert(key_def != NULL); + + /* [[7, 2, 1], 5, 4] */ + box_tuple_t *tuple = + new_runtime_tuple("\x93\x93\x07\x02\x01\x05\x04", 7); + + struct { + const char *key; + uint32_t key_size; + } expected_keys_2[] = { + /* [0] = */ {"\x91\x07", 2}, + /* [1] = */ {"\x91\x02", 2}, + /* [2] = */ {"\x91\x01", 2}, + }; + + for (int i = 0; i < (int)lengthof(expected_keys_2); ++i) { + uint32_t key_size = 0; + char *key = box_key_def_extract_key(key_def, tuple, i, + &key_size); + assert(key != NULL); + uint32_t exp_key_size = expected_keys_2[i].key_size; + const char *exp_key = expected_keys_2[i].key; + assert(key_size == exp_key_size); + assert(memcmp(key, exp_key, exp_key_size) == 0); + } + + /* Clean up. */ + box_tuple_unref(tuple); + box_key_def_delete(key_def); + box_region_truncate(region_svp); + + lua_pushboolean(L, 1); + return 1; +} + /* }}} key_def api v2 */ static int @@ -1961,6 +2086,7 @@ luaopen_module_api(lua_State *L) {"test_key_def_dump_parts", test_key_def_dump_parts}, {"test_key_def_validate_tuple", test_key_def_validate_tuple}, {"test_key_def_merge", test_key_def_merge}, + {"test_key_def_extract_key", test_key_def_extract_key}, {NULL, NULL} }; luaL_register(L, "module_api", lib); diff --git a/test/app-tap/module_api.test.lua b/test/app-tap/module_api.test.lua index 6d045f8ce..4de450462 100755 --- a/test/app-tap/module_api.test.lua +++ b/test/app-tap/module_api.test.lua @@ -177,7 +177,7 @@ local function test_iscdata(test, module) end local test = require('tap').test("module_api", function(test) - test:plan(32) + test:plan(33) local status, module = pcall(require, 'module_api') test:is(status, true, "module") test:ok(status, "module is loaded") -- 2.25.0
next prev parent reply other threads:[~2020-10-12 23:23 UTC|newest] Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top 2020-10-12 23:23 [Tarantool-patches] [PATCH v3 00/16] module api: extend for external key_def Lua module Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 01/16] module api: get rid of typedef redefinitions Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 02/16] module api: expose box region Alexander Turenko 2020-10-14 23:41 ` Vladislav Shpilevoy 2020-10-15 13:17 ` Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 03/16] module api/lua: add luaL_iscdata() function Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 04/16] lua: factor out tuple encoding from luaT_tuple_new Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 05/16] lua: don't raise a Lua error from luaT_tuple_new() Alexander Turenko 2020-10-14 23:41 ` Vladislav Shpilevoy 2020-10-15 13:17 ` Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 06/16] module api/lua: add luaT_tuple_encode() Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 07/16] module api/lua: expose luaT_tuple_new() Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 08/16] module api/lua: add API_EXPORT to tuple functions Alexander Turenko 2020-10-14 23:41 ` Vladislav Shpilevoy 2020-10-15 2:35 ` Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 09/16] module api: add API_EXPORT to key_def functions Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 10/16] module api: add box_key_def_new_v2() Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 11/16] module api: add box_key_def_dump_parts() Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 12/16] module api: expose box_key_def_validate_tuple() Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 13/16] module api: expose box_key_def_merge() Alexander Turenko 2020-10-14 23:41 ` Vladislav Shpilevoy 2020-10-12 23:23 ` Alexander Turenko [this message] 2020-10-14 23:41 ` [Tarantool-patches] [PATCH v3 14/16] module api: expose box_key_def_extract_key() Vladislav Shpilevoy 2020-10-15 2:39 ` Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 15/16] module api: add box_key_def_validate_key() Alexander Turenko 2020-10-14 23:41 ` Vladislav Shpilevoy 2020-10-15 13:18 ` Alexander Turenko 2020-10-12 23:23 ` [Tarantool-patches] [PATCH v3 16/16] module api: add box_key_def_validate_full_key() Alexander Turenko 2020-10-14 23:41 ` [Tarantool-patches] [PATCH v3 00/16] module api: extend for external key_def Lua module Vladislav Shpilevoy 2020-10-15 3:09 ` Alexander Turenko 2020-10-15 13:19 ` Alexander Turenko 2020-10-16 6:05 ` Alexander Turenko 2020-10-15 20:12 ` Vladislav Shpilevoy
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=808c8f94de8981eab1e8971b73514b937aa808f7.1602541394.git.alexander.turenko@tarantool.org \ --to=alexander.turenko@tarantool.org \ --cc=tarantool-patches@dev.tarantool.org \ --cc=v.shpilevoy@tarantool.org \ --subject='Re: [Tarantool-patches] [PATCH v3 14/16] module api: expose box_key_def_extract_key()' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox