Tarantool development patches archive
 help / color / mirror / Atom feed
From: Serge Petrenko <sergepetrenko@tarantool.org>
To: Vladislav Shpilevoy <v.shpilevoy@tarantool.org>
Cc: tarantool-patches@dev.tarantool.org
Subject: Re: [Tarantool-patches] [PATCH v2 2/2] app/fiber: wait till a full event loop iteration ends
Date: Fri, 15 Nov 2019 18:35:39 +0300	[thread overview]
Message-ID: <B549AA64-0046-485E-9D8F-1414E74DD9FB@tarantool.org> (raw)
In-Reply-To: <5fa2b099f3a4716a8418d2ddd6afd71a8a2f1198.1573828446.git.sergepetrenko@tarantool.org>

> 15 нояб. 2019 г., в 17:58, Serge Petrenko <sergepetrenko@tarantool.org> написал(а):
> 
> fiber.top() fills in statistics every event loop iteration,
> so if it was just enabled, fiber.top() may contain 'inf's and
> 'nan's in fiber cpu usage averages because total time consumed by
> the main thread was not yet accounted for.
> Same stands for viewing top() results for a freshly created fiber:
> its metrics will be zero since it hasn't lived a full ev loop iteration
> yet.
> Fix this by delaying the test till top() results are meaningful and add
> minor refactoring.
> 
> Follow-up #2694
> —

Sorry, the commit message was outdated here. Fixed it on the branch:
```
app/fiber: wait till a full event loop iteration ends
fiber.top() fills in statistics every event loop iteration,
so if it was just enabled, fiber.top() returns zero in fiber cpu
usage statistics because total time consumed by the main thread was
not yet accounted for.
Same stands for viewing top() results for a freshly created fiber:
its metrics will be zero since it hasn't lived a full ev loop iteration
yet.
Fix this by delaying the test till top() results are meaningful and add
minor refactoring.

Follow-up 
#2694

```


> test/app/fiber.result   | 28 +++++++++++++++++++---------
> test/app/fiber.test.lua | 26 ++++++++++++++++++--------
> 2 files changed, 37 insertions(+), 17 deletions(-)
> 
> diff --git a/test/app/fiber.result b/test/app/fiber.result
> index 4a094939f..b4e448282 100644
> --- a/test/app/fiber.result
> +++ b/test/app/fiber.result
> @@ -1469,6 +1469,12 @@ sum = 0
> fiber.top_enable()
> ---
> ...
> +-- Wait till a full event loop iteration passes, so that
> +-- top() contains meaningful results. On the ev loop iteration
> +-- following fiber.top_enable() results will be zero.
> +while fiber.top().cpu["1/sched"].instant == 0 do fiber.yield() end
> +---
> +...
> a = fiber.top()
> ---
> ...
> @@ -1504,9 +1510,9 @@ for k, v in pairs(a) do\
> end
> ---
> ...
> -sum_inst
> +sum_inst > 99 and sum_inst < 101 or sum_inst
> ---
> -- 100
> +- true
> ...
> -- not exact due to accumulated integer division errors
> sum_avg > 99 and sum_avg < 101 or sum_avg
> @@ -1517,24 +1523,28 @@ tbl = nil
> ---
> ...
> f = fiber.new(function()\
> -    for i = 1,1000 do end\
> -    fiber.yield()\
> -    tbl = fiber.top().cpu[fiber.self().id()..'/'..fiber.self().name()]\
> +    local fiber_key = fiber.self().id()..'/'..fiber.self().name()\
> +    tbl = fiber.top().cpu[fiber_key]\
> +    while tbl.time == 0 do\
> +        for i = 1,1000 do end\
> +        fiber.yield()\
> +        tbl = fiber.top().cpu[fiber_key]\
> +    end\
> end)
> ---
> ...
> -while f:status() ~= 'dead' do fiber.sleep(0.01) end
> +while f:status() ~= 'dead' do fiber.yield() end
> ---
> ...
> -tbl["average"] > 0
> +tbl.average > 0
> ---
> - true
> ...
> -tbl["instant"] > 0
> +tbl.instant > 0
> ---
> - true
> ...
> -tbl["time"] > 0
> +tbl.time > 0
> ---
> - true
> ...
> diff --git a/test/app/fiber.test.lua b/test/app/fiber.test.lua
> index 38b85d554..e2834216b 100644
> --- a/test/app/fiber.test.lua
> +++ b/test/app/fiber.test.lua
> @@ -634,6 +634,12 @@ sum = 0
> -- gh-2694 fiber.top()
> fiber.top_enable()
> 
> +
> +-- Wait till a full event loop iteration passes, so that
> +-- top() contains meaningful results. On the ev loop iteration
> +-- following fiber.top_enable() results will be zero.
> +while fiber.top().cpu["1/sched"].instant == 0 do fiber.yield() end
> +
> a = fiber.top()
> type(a)
> -- scheduler is present in fiber.top()
> @@ -652,19 +658,23 @@ for k, v in pairs(a) do\
>     sum_avg = sum_avg + v["average"]\
> end
> 
> -sum_inst
> +sum_inst > 99 and sum_inst < 101 or sum_inst
> -- not exact due to accumulated integer division errors
> sum_avg > 99 and sum_avg < 101 or sum_avg
> tbl = nil
> f = fiber.new(function()\
> -    for i = 1,1000 do end\
> -    fiber.yield()\
> -    tbl = fiber.top().cpu[fiber.self().id()..'/'..fiber.self().name()]\
> +    local fiber_key = fiber.self().id()..'/'..fiber.self().name()\
> +    tbl = fiber.top().cpu[fiber_key]\
> +    while tbl.time == 0 do\
> +        for i = 1,1000 do end\
> +        fiber.yield()\
> +        tbl = fiber.top().cpu[fiber_key]\
> +    end\
> end)
> -while f:status() ~= 'dead' do fiber.sleep(0.01) end
> -tbl["average"] > 0
> -tbl["instant"] > 0
> -tbl["time"] > 0
> +while f:status() ~= 'dead' do fiber.yield() end
> +tbl.average > 0
> +tbl.instant > 0
> +tbl.time > 0
> 
> fiber.top_disable()
> fiber.top()
> -- 
> 2.21.0 (Apple Git-122)
> 

--
Serge Petrenko
sergepetrenko@tarantool.org

  reply	other threads:[~2019-11-15 15:35 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-11-15 14:58 [Tarantool-patches] [PATCH v2 0/2] fiber.top(): minor fixup Serge Petrenko
2019-11-15 14:58 ` [Tarantool-patches] [PATCH v2 1/2] fiber: reset clock stats on fiber.top_enable() Serge Petrenko
2019-11-15 16:11   ` Alexander Turenko
2019-11-15 18:23     ` Serge Petrenko
2019-11-15 21:39   ` Vladislav Shpilevoy
2019-11-18 16:11     ` Serge Petrenko
2019-11-15 14:58 ` [Tarantool-patches] [PATCH v2 2/2] app/fiber: wait till a full event loop iteration ends Serge Petrenko
2019-11-15 15:35   ` Serge Petrenko [this message]
2019-11-15 16:27   ` Alexander Turenko

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=B549AA64-0046-485E-9D8F-1414E74DD9FB@tarantool.org \
    --to=sergepetrenko@tarantool.org \
    --cc=tarantool-patches@dev.tarantool.org \
    --cc=v.shpilevoy@tarantool.org \
    --subject='Re: [Tarantool-patches] [PATCH v2 2/2] app/fiber: wait till a full event loop iteration ends' \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox