From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from [87.239.111.99] (localhost [127.0.0.1]) by dev.tarantool.org (Postfix) with ESMTP id B9A3615B1F70; Fri, 24 Oct 2025 13:50:46 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org B9A3615B1F70 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tarantool.org; s=dev; t=1761303046; bh=evYWHExbf8XnDcq/fccFWvtUNYk3I8KVdVEIHcnHfbk=; h=To:Date:Subject:List-Id:List-Unsubscribe:List-Archive:List-Post: List-Help:List-Subscribe:From:Reply-To:Cc:From; b=XEoX5FBCjey6Te0h9hTXEKuJHbLqWNCHZRqXwYXiQBM/6cETLswTUQ6VNmCMNf6c2 3B0q63uIx99T/LhLcj5aZbUQsTvSeZ55uCmS3Qsh8eiVHvARY2zatXKS9GV0L9hnvO /6tgXMn7OjpVbtl93vQIDXRBZqybED8YdJR9Vz4A= Received: from send276.i.mail.ru (send276.i.mail.ru [95.163.59.115]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by dev.tarantool.org (Postfix) with ESMTPS id 851EA15B1F71 for ; Fri, 24 Oct 2025 13:50:44 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org 851EA15B1F71 Received: by exim-smtp-855f5997bb-88mr2 with esmtpa (envelope-from ) id 1vCFNb-000000006vv-21rH; Fri, 24 Oct 2025 13:50:44 +0300 To: Sergey Bronnikov Date: Fri, 24 Oct 2025 13:50:04 +0300 Message-ID: X-Mailer: git-send-email 2.51.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Mailru-Src: smtp X-7564579A: B8F34718100C35BD X-77F55803: 4F1203BC0FB41BD9DAB542EDD08389FE6972E6A35AEC2CEF82223B772369C626182A05F538085040314A0CF98A540F3B3DE06ABAFEAF67052FDC75DCF73F285352E7C6720268728E261E30AE1A3D82FE X-7FA49CB5: FF5795518A3D127A4AD6D5ED66289B5278DA827A17800CE7F9D3BE5B596754B8C2099A533E45F2D0395957E7521B51C2CFCAF695D4D8E9FCEA1F7E6F0F101C6759CC434672EE6371C2A783ECEC0211ADC4224003CC836476D5A39DEEDB180909611E41BBFE2FEB2BFC536AB7B6F580DB6356CE3070BFE8F667DAA7B10DE44490D6D439A3272465379FA2833FD35BB23D9E625A9149C048EE33AC447995A7AD186FD1C55BDD38FC3FD2E47CDBA5A96583BD4B6F7A4D31EC0BC014FD901B82EE079FA2833FD35BB23D27C277FBC8AE2E8B3A703B70628EAD7BA471835C12D1D977C4224003CC8364762BB6847A3DEAEFB0F43C7A68FF6260569E8FC8737B5C2249EC8D19AE6D49635B68655334FD4449CB9ECD01F8117BC8BEAAAE862A0553A39223F8577A6DFFEA7CB4A8AE5B8DA9854D43847C11F186F3C59DAA53EE0834AAEE X-C1DE0DAB: 0D63561A33F958A546C72D0EC4AEB1565002B1117B3ED69644574911BAA86977C638DF663A625AFA823CB91A9FED034534781492E4B8EEAD2B1D74EDA564F90EC79554A2A72441328621D336A7BC284946AD531847A6065A535571D14F44ED41 X-C8649E89: 1C3962B70DF3F0ADE00A9FD3E00BEEDF77DD89D51EBB7742D3581295AF09D3DF87807E0823442EA2ED31085941D9CD0AF7F820E7B07EA4CFF253419183475EF3941DAA7C0E5386238A59883A73C91960EDACF4E05AFF90159EC5AF04A575AA6C6EB503EC62A3E87F33639054D48D094FE2422C6CC32E61FE1A318004D1A59A9B5F4332CA8FE04980913E6812662D5F2A5EAB5682573093F7837F15F2B5E4A70B33F2C28C22F508233FCF178C6DD14203 X-D57D3AED: 3ZO7eAau8CL7WIMRKs4sN3D3tLDjz0dLbV79QFUyzQ2Ujvy7cMT6pYYqY16iZVKkSc3dCLJ7zSJH7+u4VD18S7Vl4ZUrpaVfd2+vE6kuoey4m4VkSEu53w8ahmwBjZKM/YPHZyZHvz5uv+WouB9+ObcCpyrx6l7KImUglyhkEat/+ysWwi0gdhEs0JGjl6ggRWTy1haxBpVdbIX1nthFXMZebaIdHP2ghjoIc/363UZI6Kf1ptIMVRN2q9QiacRuLajmbdVcJ7g= X-DA7885C5: 641D4BC01B01DCC1F255D290C0D534F93E27C806EEF4EA946B207E07F4A7E166F645B1D5098609525B1A4C17EAA7BC4BEF2421ABFA55128DAF83EF9164C44C7E X-Mailru-Sender: 689FA8AB762F7393DDD5FD59B456EAD26A90F25DAA29014B11988E4495A63B6ED899DD440DDBC359E49D44BB4BD9522A059A1ED8796F048DB274557F927329BE89D5A3BC2B10C37545BD1C3CC395C826B4A721A3011E896F X-Mras: Ok Subject: [Tarantool-patches] [PATCH v1 luajit 00/41] LuaJIT performance testing X-BeenThere: tarantool-patches@dev.tarantool.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Tarantool development patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Sergey Kaplun via Tarantool-patches Reply-To: Sergey Kaplun Cc: tarantool-patches@dev.tarantool.org Errors-To: tarantool-patches-bounces@dev.tarantool.org Sender: "Tarantool-patches" This patchset introduces the performance testing suite for LuaJIT benchmarks. It takes the LuaJIT test cleanup benches [1] and adapts them to use a custom benchmark module with the GoogleBenchamark-similar format. All results are collected and reported to InfluxDB, like it is done for the Tarantool's tests. The results for the following benchmarks are not very stable. It should be investigated later (I appreciate any help with this): * array3d * binary-trees * euler14-bit * k-nukleotide * nsieve (most unstable) * nsieve-bit * spectral-norm Also, I've added notes to some commits where I'm not sure that the implementation/solution is very good. Any insights are welcome :). [1]: https://github.com/LuaJIT/LuaJIT-test-cleanup/tree/014708b/bench Sergey Kaplun (41): perf: add LuaJIT-test-cleanup perf suite perf: introduce clock module perf: introduce bench module perf: adjust array3d in LuaJIT-benches perf: adjust binary-trees in LuaJIT-benches perf: adjust chameneos in LuaJIT-benches perf: adjust coroutine-ring in LuaJIT-benches perf: adjust euler14-bit in LuaJIT-benches perf: adjust fannkuch in LuaJIT-benches perf: adjust fasta in LuaJIT-benches perf: adjust k-nucleotide in LuaJIT-benches perf: adjust life in LuaJIT-benches perf: adjust mandelbrot-bit in LuaJIT-benches perf: adjust mandelbrot in LuaJIT-benches perf: adjust md5 in LuaJIT-benches perf: adjust meteor in LuaJIT-benches perf: adjust nbody in LuaJIT-benches perf: adjust nsieve-bit-fp in LuaJIT-benches perf: adjust nsieve-bit in LuaJIT-benches perf: adjust nsieve in LuaJIT-benches perf: adjust partialsums in LuaJIT-benches perf: adjust pidigits-nogmp in LuaJIT-benches perf: adjust ray in LuaJIT-benches perf: adjust recursive-ack in LuaJIT-benches perf: adjust recursive-fib in LuaJIT-benches perf: adjust revcomp in LuaJIT-benches perf: adjust scimark-2010-12-20 in LuaJIT-benches perf: move to directory perf: adjust scimark-fft in LuaJIT-benches perf: adjust scimark-lu in LuaJIT-benches perf: add scimark-mc in LuaJIT-benches perf: adjust scimark-sor in LuaJIT-benches perf: adjust scimark-sparse in LuaJIT-benches perf: adjust series in LuaJIT-benches perf: adjust spectral-norm in LuaJIT-benches perf: adjust sum-file in LuaJIT-benches perf: add CMake infrastructure perf: add aggregator helper for bench statistics perf: add a script for the environment setup perf: provide CMake option to setup the benchmark ci: introduce the performance workflow .github/actions/setup-performance/README.md | 10 + .github/actions/setup-performance/action.yml | 18 + .github/workflows/performance.yml | 110 ++ .gitignore | 5 + .luacheckrc | 1 + CMakeLists.txt | 11 + perf/CMakeLists.txt | 119 +++ perf/LuaJIT-benches/CMakeLists.txt | 52 + perf/LuaJIT-benches/PARAM_arm.txt | 29 + perf/LuaJIT-benches/PARAM_mips.txt | 29 + perf/LuaJIT-benches/PARAM_ppc.txt | 29 + perf/LuaJIT-benches/PARAM_x86.txt | 29 + perf/LuaJIT-benches/SUMCOL_1.txt | 1000 ++++++++++++++++++ perf/LuaJIT-benches/TEST_md5sum.txt | 20 + perf/LuaJIT-benches/array3d.lua | 74 ++ perf/LuaJIT-benches/binary-trees.lua | 105 ++ perf/LuaJIT-benches/chameneos.lua | 82 ++ perf/LuaJIT-benches/coroutine-ring.lua | 53 + perf/LuaJIT-benches/euler14-bit.lua | 42 + perf/LuaJIT-benches/fannkuch.lua | 81 ++ perf/LuaJIT-benches/fasta.lua | 29 + perf/LuaJIT-benches/k-nucleotide.lua | 129 +++ perf/LuaJIT-benches/libs/fasta.lua | 98 ++ perf/LuaJIT-benches/libs/scimark_lib.lua | 297 ++++++ perf/LuaJIT-benches/life.lua | 188 ++++ perf/LuaJIT-benches/mandelbrot-bit.lua | 61 ++ perf/LuaJIT-benches/mandelbrot.lua | 49 + perf/LuaJIT-benches/md5.lua | 196 ++++ perf/LuaJIT-benches/meteor.lua | 246 +++++ perf/LuaJIT-benches/nbody.lua | 140 +++ perf/LuaJIT-benches/nsieve-bit-fp.lua | 62 ++ perf/LuaJIT-benches/nsieve-bit.lua | 52 + perf/LuaJIT-benches/nsieve.lua | 46 + perf/LuaJIT-benches/partialsums.lua | 44 + perf/LuaJIT-benches/pidigits-nogmp.lua | 121 +++ perf/LuaJIT-benches/ray.lua | 159 +++ perf/LuaJIT-benches/recursive-ack.lua | 23 + perf/LuaJIT-benches/recursive-fib.lua | 31 + perf/LuaJIT-benches/revcomp.lua | 59 ++ perf/LuaJIT-benches/scimark-2010-12-20.lua | 415 ++++++++ perf/LuaJIT-benches/scimark-fft.lua | 18 + perf/LuaJIT-benches/scimark-lu.lua | 19 + perf/LuaJIT-benches/scimark-mc.lua | 19 + perf/LuaJIT-benches/scimark-sor.lua | 19 + perf/LuaJIT-benches/scimark-sparse.lua | 19 + perf/LuaJIT-benches/series.lua | 42 + perf/LuaJIT-benches/spectral-norm.lua | 58 + perf/LuaJIT-benches/sum-file.lua | 25 + perf/helpers/aggregate.lua | 124 +++ perf/helpers/setup_env.sh | 135 +++ perf/utils/bench.lua | 509 +++++++++ perf/utils/clock.lua | 35 + 52 files changed, 5366 insertions(+) create mode 100644 .github/actions/setup-performance/README.md create mode 100644 .github/actions/setup-performance/action.yml create mode 100644 .github/workflows/performance.yml create mode 100644 perf/CMakeLists.txt create mode 100644 perf/LuaJIT-benches/CMakeLists.txt create mode 100644 perf/LuaJIT-benches/PARAM_arm.txt create mode 100644 perf/LuaJIT-benches/PARAM_mips.txt create mode 100644 perf/LuaJIT-benches/PARAM_ppc.txt create mode 100644 perf/LuaJIT-benches/PARAM_x86.txt create mode 100644 perf/LuaJIT-benches/SUMCOL_1.txt create mode 100644 perf/LuaJIT-benches/TEST_md5sum.txt create mode 100644 perf/LuaJIT-benches/array3d.lua create mode 100644 perf/LuaJIT-benches/binary-trees.lua create mode 100644 perf/LuaJIT-benches/chameneos.lua create mode 100644 perf/LuaJIT-benches/coroutine-ring.lua create mode 100644 perf/LuaJIT-benches/euler14-bit.lua create mode 100644 perf/LuaJIT-benches/fannkuch.lua create mode 100644 perf/LuaJIT-benches/fasta.lua create mode 100644 perf/LuaJIT-benches/k-nucleotide.lua create mode 100644 perf/LuaJIT-benches/libs/fasta.lua create mode 100644 perf/LuaJIT-benches/libs/scimark_lib.lua create mode 100644 perf/LuaJIT-benches/life.lua create mode 100644 perf/LuaJIT-benches/mandelbrot-bit.lua create mode 100644 perf/LuaJIT-benches/mandelbrot.lua create mode 100644 perf/LuaJIT-benches/md5.lua create mode 100644 perf/LuaJIT-benches/meteor.lua create mode 100644 perf/LuaJIT-benches/nbody.lua create mode 100644 perf/LuaJIT-benches/nsieve-bit-fp.lua create mode 100644 perf/LuaJIT-benches/nsieve-bit.lua create mode 100644 perf/LuaJIT-benches/nsieve.lua create mode 100644 perf/LuaJIT-benches/partialsums.lua create mode 100644 perf/LuaJIT-benches/pidigits-nogmp.lua create mode 100644 perf/LuaJIT-benches/ray.lua create mode 100644 perf/LuaJIT-benches/recursive-ack.lua create mode 100644 perf/LuaJIT-benches/recursive-fib.lua create mode 100644 perf/LuaJIT-benches/revcomp.lua create mode 100644 perf/LuaJIT-benches/scimark-2010-12-20.lua create mode 100644 perf/LuaJIT-benches/scimark-fft.lua create mode 100644 perf/LuaJIT-benches/scimark-lu.lua create mode 100644 perf/LuaJIT-benches/scimark-mc.lua create mode 100644 perf/LuaJIT-benches/scimark-sor.lua create mode 100644 perf/LuaJIT-benches/scimark-sparse.lua create mode 100644 perf/LuaJIT-benches/series.lua create mode 100644 perf/LuaJIT-benches/spectral-norm.lua create mode 100644 perf/LuaJIT-benches/sum-file.lua create mode 100644 perf/helpers/aggregate.lua create mode 100755 perf/helpers/setup_env.sh create mode 100644 perf/utils/bench.lua create mode 100644 perf/utils/clock.lua -- 2.51.0