From: Alex Khatskevich <avkhatskevich@tarantool.org> To: tarantool-patches@freelists.org Subject: [tarantool-patches] Re: [PATCH 4/4] Introduce storage reload evolution Date: Tue, 31 Jul 2018 14:33:02 +0300 [thread overview] Message-ID: <83a958f1-e47c-cf5c-7996-3983b7a28b9f@tarantool.org> (raw) In-Reply-To: <3d8a81f7-33a6-bf1d-809f-ae5b95730a64@tarantool.org> diff of test/lua_libs/git_util.lua commit 199e198af97200e9a01b5b2568c8e9b2a2a9f34d Author: AKhatskevich <avkhatskevich@tarantool.org> Date: Fri Jun 29 20:34:26 2018 +0300 Introduce storage reload evolution Changes: 1. Introduce storage reload evolution. 2. Setup cross-version reload testing. 1: This mechanism updates Lua objects on reload in case they are changed in a new vshard.storage version. Since this commit, any change in vshard.storage.M has to be reflected in vshard.storage.reload_evolution to guarantee correct reload. 2: The testing uses git infrastructure and is performed in the following way: 1. Copy old version of vshard to a temp folder. 2. Run vshard on this code. 3. Checkout the latest version of the vshard sources. 4. Reload vshard storage. 5. Make sure it works (Perform simple tests). Notes: * this patch contains some legacy-driven decisions: 1. SOURCEDIR path retrieved differently in case of packpack build. 2. git directory in the `reload_evolution/storage` test is copied with respect to Centos 7 and `ro` mode of SOURCEDIR. Closes #112 #125 diff --git a/test/lua_libs/git_util.lua b/test/lua_libs/git_util.lua new file mode 100644 index 0000000..8826c4c --- /dev/null +++ b/test/lua_libs/git_util.lua @@ -0,0 +1,49 @@ +-- +-- Lua bridge for some of the git commands. +-- +local os = require('os') + +-- +-- Exec a git command. +-- @param params Table of parameters: +-- * options - git options. +-- * cmd - git command. +-- * args - command arguments. +-- * dir - working directory. +-- * fout - write output to the file. +local function exec_cmd(params) + local fout = params.fout + local shell_cmd = {'git'} + for _, param in pairs({'options', 'cmd', 'args'}) do + table.insert(shell_cmd, params[param]) + end + if fout then + table.insert(shell_cmd, ' >' .. fout) + end + shell_cmd = table.concat(shell_cmd, ' ') + if params.dir then + shell_cmd = string.format('cd %s && %s', params.dir, shell_cmd) + end + local res = os.execute(shell_cmd) + assert(res == 0, 'Git cmd error: ' .. res) +end + +local function log_hashes(params) + params.args = "--format='%h' " .. params.args + -- Store log to the file. + local temp_file = os.tmpname() + params.fout = temp_file + params.cmd = 'log' + exec_cmd(params) + local lines = {} + for line in io.lines(temp_file) do + table.insert(lines, line) + end + os.remove(temp_file) + return lines +end + +return { + exec_cmd = exec_cmd, + log_hashes = log_hashes +}
next prev parent reply other threads:[~2018-07-31 11:33 UTC|newest] Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top 2018-07-30 8:56 [tarantool-patches] [PATCH v4] vshard module reload AKhatskevich 2018-07-30 8:56 ` [tarantool-patches] [PATCH 1/4] Fix races related to object outdating AKhatskevich 2018-07-30 11:55 ` [tarantool-patches] " Vladislav Shpilevoy 2018-07-30 16:46 ` Alex Khatskevich 2018-07-30 17:50 ` Vladislav Shpilevoy 2018-07-31 11:05 ` Alex Khatskevich 2018-08-01 12:36 ` Vladislav Shpilevoy 2018-08-01 17:44 ` Alex Khatskevich 2018-08-02 11:51 ` Vladislav Shpilevoy 2018-07-30 8:56 ` [tarantool-patches] [PATCH 2/4] Refactor reloadable fiber AKhatskevich 2018-07-30 11:55 ` [tarantool-patches] " Vladislav Shpilevoy 2018-07-31 11:24 ` Alex Khatskevich 2018-07-31 11:30 ` Alex Khatskevich 2018-08-01 11:54 ` Vladislav Shpilevoy 2018-07-30 8:56 ` [tarantool-patches] [PATCH 3/4] tests: separate bootstrap routine to a lua_libs AKhatskevich 2018-08-01 12:03 ` [tarantool-patches] " Vladislav Shpilevoy 2018-07-30 8:56 ` [tarantool-patches] [PATCH 4/4] Introduce storage reload evolution AKhatskevich 2018-07-30 11:55 ` [tarantool-patches] " Vladislav Shpilevoy 2018-07-31 11:29 ` Alex Khatskevich 2018-07-31 11:33 ` Alex Khatskevich [this message] 2018-08-01 12:36 ` Vladislav Shpilevoy 2018-08-01 18:09 ` Alex Khatskevich 2018-08-02 11:40 ` Vladislav Shpilevoy 2018-08-02 11:46 ` Vladislav Shpilevoy 2018-08-06 10:59 ` Alex Khatskevich 2018-08-06 15:36 ` Vladislav Shpilevoy 2018-08-06 16:08 ` Alex Khatskevich 2018-08-06 17:18 ` Vladislav Shpilevoy 2018-08-07 9:14 ` Alex Khatskevich 2018-08-08 10:35 ` Vladislav Shpilevoy 2018-08-01 14:07 ` [tarantool-patches] [PATCH] Check self arg passed for router objects AKhatskevich -- strict thread matches above, loose matches on Subject: below -- 2018-07-23 11:14 [tarantool-patches] [PATCH v2] vshard reload mechanism AKhatskevich 2018-07-23 11:14 ` [tarantool-patches] [PATCH 4/4] Introduce storage reload evolution AKhatskevich 2018-07-23 14:44 ` [tarantool-patches] " Vladislav Shpilevoy 2018-07-23 20:10 ` Alex Khatskevich
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=83a958f1-e47c-cf5c-7996-3983b7a28b9f@tarantool.org \ --to=avkhatskevich@tarantool.org \ --cc=tarantool-patches@freelists.org \ --subject='[tarantool-patches] Re: [PATCH 4/4] Introduce storage reload evolution' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox