From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from [87.239.111.99] (localhost [127.0.0.1]) by dev.tarantool.org (Postfix) with ESMTP id 3EB7C65E76F; Fri, 6 Oct 2023 17:45:26 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org 3EB7C65E76F DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=tarantool.org; s=dev; t=1696603526; bh=Os0W1LMQ5Sg0h/yKPKL5zyumB2CJq+N2YhDUWek0DVw=; h=Date:To:Cc:References:In-Reply-To:Subject:List-Id: List-Unsubscribe:List-Archive:List-Post:List-Help:List-Subscribe: From:Reply-To:From; b=RilKjbFAbEYvtvtuhX88uNICK5bAw2X3pufAOr9c3rLGe8tMQLqeDLO3gpi4uUO6x XBLGsTRhe+vhJteAKbREKTwFs/Su5EeqH+0LBkWiH/5HWDvP+htq3FJV2laRFibA7l HlOjt5OTTZb40xiB/eVsd+oB3WniOYGwn41k+mKE= Received: from smtp54.i.mail.ru (smtp54.i.mail.ru [95.163.41.89]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by dev.tarantool.org (Postfix) with ESMTPS id 1B84E65E76F for ; Fri, 6 Oct 2023 17:45:24 +0300 (MSK) DKIM-Filter: OpenDKIM Filter v2.11.0 dev.tarantool.org 1B84E65E76F Received: by smtp54.i.mail.ru with esmtpa (envelope-from ) id 1qom4x-006W4U-0U; Fri, 06 Oct 2023 17:45:23 +0300 Message-ID: <8db5ce8b-2ced-44cc-81b2-83058fd5cda8@tarantool.org> Date: Fri, 6 Oct 2023 17:45:22 +0300 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: Maxim Kokryashkin Cc: Maxim Kokryashkin , tarantool-patches@dev.tarantool.org References: <1694514399.719299784@f315.i.mail.ru> <370699e3-9e7d-f24b-600d-970cd5bed080@tarantool.org> <1695028695.970460840@f316.i.mail.ru> <9c1f5176-6bcc-4a35-bf80-40ad3e2d6074@tarantool.org> In-Reply-To: <9c1f5176-6bcc-4a35-bf80-40ad3e2d6074@tarantool.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Mailru-Src: smtp X-4EC0790: 10 X-7564579A: 646B95376F6C166E X-77F55803: 4F1203BC0FB41BD9FE0487E502468146AC7211124AC77F8351859FAB5C33BC6F00894C459B0CD1B9373DED19B40A71598F35B485BF376ED2E3EFEB9ACFFB32EC6DD001A71ABC03EA X-7FA49CB5: FF5795518A3D127A4AD6D5ED66289B5278DA827A17800CE70312E9A300D47E3BEA1F7E6F0F101C67BD4B6F7A4D31EC0BCC500DACC3FED6E28638F802B75D45FF8AA50765F790063703E3935C5A8197E98638F802B75D45FF36EB9D2243A4F8B5A6FCA7DBDB1FC311F39EFFDF887939037866D6147AF826D87D8B0F8BF93096E71852ED991CBE24A0117882F4460429724CE54428C33FAD305F5C1EE8F4F765FC974A882099E279BDA471835C12D1D9774AD6D5ED66289B52BA9C0B312567BB23117882F446042972877693876707352033AC447995A7AD18F04B652EEC242312D2E47CDBA5A96583BA9C0B312567BB2376E601842F6C81A19E625A9149C048EE26055571C92BF10FB341D7040ADD27A2D8FC6C240DEA76429C9F4D5AE37F343AA9539A8B242431040A6AB1C7CE11FEE32D01283D1ACF37BA2D242C3BD2E3F4C6C4224003CC836476E2F48590F00D11D6E2021AF6380DFAD1A18204E546F3947CB11811A4A51E3B096D1867E19FE1407959CC434672EE6371089D37D7C0E48F6C8AA50765F79006372C56F9BC9525AE6AEFF80C71ABB335746BA297DBC24807EABDAD6C7F3747799A X-C1DE0DAB: 0D63561A33F958A5EBEBC233F4C73C52AE97E57BB2A9650DF2450E2079F45EA6F87CCE6106E1FC07E67D4AC08A07B9B04E7D9683544204AFCB5012B2E24CD356 X-C8649E89: 1C3962B70DF3F0ADBF74143AD284FC7177DD89D51EBB7742424CF958EAFF5D571004E42C50DC4CA955A7F0CF078B5EC49A30900B95165D342B1F2AD168155B06F57CF78E86FBC713DBDA3D6D503257F7282044532662680B3B72ABF774255C081D7E09C32AA3244C6B5899B792A3E53F6CC02C17A8B45253408A6A02710B730485A42E4C463514DC5DA084F8E80FEBD3FFA33E6B6B2F82C47A83BD0C44CE203720ABEDE4BBDD9CDD X-D57D3AED: 3ZO7eAau8CL7WIMRKs4sN3D3tLDjz0dLbV79QFUyzQ2Ujvy7cMT6pYYqY16iZVKkSc3dCLJ7zSJH7+u4VD18S7Vl4ZUrpaVfd2+vE6kuoey4m4VkSEu530nj6fImhcD4MUrOEAnl0W826KZ9Q+tr5ycPtXkTV4k65bRjmOUUP8cvGozZ33TWg5HZplvhhXbhDGzqmQDTd6OAevLeAnq3Ra9uf7zvY2zzsIhlcp/Y7m53TZgf2aB4JOg4gkr2bioj0Piy1iZpfs4D1QYKwDuMTA== X-Mailru-Sender: 11C2EC085EDE56FAC07928AF2646A76905665A9B78543F1A277CB73B0219B55BB67A942A63B4089AEBA65886582A37BD66FEC6BF5C9C28D98A98C1125256619760D574B6FC815AB872D6B4FCE48DF648AE208404248635DF X-Mras: Ok Subject: Re: [Tarantool-patches] [PATCH luajit 2/2] profilers: purge generation mechanism X-BeenThere: tarantool-patches@dev.tarantool.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Tarantool development patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , From: Sergey Bronnikov via Tarantool-patches Reply-To: Sergey Bronnikov Errors-To: tarantool-patches-bounces@dev.tarantool.org Sender: "Tarantool-patches" On 10/6/23 17:43, Sergey Bronnikov via Tarantool-patches wrote: > Hi, Max > > On 9/18/23 12:18, Maxim Kokryashkin wrote: >> Hi, Sergey! >> Thanks for the comments! >> Here is the new message: >> ======= >> profilers: purge generation mechanism >> Since both of the profiler parsers are now processing >> the events in a stream-like fashion, the generation >> mechanism is excessive and can be purged. This results >> in a significant memory consumption drop, especially >> for the AVL-tree part. >> Consider this script: >> | jit.off() >> | misc.sysprof.start{mode = 'C', interval=10} >> | for i = 1, 1e7 do tostring(i) end >> | misc.sysprof.stop() >> After executing it with LuaJIT, you can parse it like this: >> | $ time -v luajit-parse-sysprof sysprof.bin >> So, before the patch: >> | Maximum resident set size (kbytes): 224928 >> And after the patch: >> | Maximum resident set size (kbytes): 32780 >> That is the 85% reduction in memory consumption. >> Follows up tarantool/tarantool#8700 > > > Seems you forgot force-push to the branch. > Please disregard.