From: Vladimir Davydov <vdavydov.dev@gmail.com>
To: kostja@tarantool.org
Cc: tarantool-patches@freelists.org
Subject: [PATCH 00/11] vinyl: prepare for transaction throttling
Date: Thu, 20 Sep 2018 12:34:05 +0300 [thread overview]
Message-ID: <cover.1537435404.git.vdavydov.dev@gmail.com> (raw)
This patch set contains preparatory patches necessary for implementing
transaction throttling. It does some refactoring, introduces basic
throttling based on dump bandwidth, and splits the rate limit in soft
and hard, which is necessary for compaction based throttling. The only
thing left is invent such a throttling policy that guarantees that
compaction always keeps up with dumps.
https://github.com/tarantool/tarantool/issues/1862
https://github.com/tarantool/tarantool/tree/dv/gh-1862-vy-throttling
Vladimir Davydov (11):
vinyl: merge vy_quota_release and vy_quota_update_dump_bandwidth
vinyl: refactor quota use/unuse methods
vinyl: do not try to trigger dump if it is already in progress
vinyl: don't start quota timer until local recovery is complete
vinyl: add helper to start scheduler and enable quota on startup
vinyl: zap vy_env::memory, read_threads, and write_threads
vinyl: do not account zero dump bandwidth
vinyl: set quota timer period to 100 ms
vinyl: implement basic transaction throttling
vinyl: implement quota wait queue without fiber_cond
vinyl: split quota consumption rate limit into soft and hard
src/box/vinyl.c | 79 +++++-----
src/box/vy_quota.c | 340 +++++++++++++++++++++++++++++++++----------
src/box/vy_quota.h | 146 +++++++++++++++----
src/box/vy_run.c | 12 +-
src/box/vy_run.h | 17 ++-
test/unit/vy_point_lookup.c | 2 +-
test/vinyl/suite.ini | 2 +-
test/vinyl/throttle.result | 102 +++++++++++++
test/vinyl/throttle.test.lua | 54 +++++++
9 files changed, 601 insertions(+), 153 deletions(-)
create mode 100644 test/vinyl/throttle.result
create mode 100644 test/vinyl/throttle.test.lua
--
2.11.0
next reply other threads:[~2018-09-20 9:34 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-09-20 9:34 Vladimir Davydov [this message]
2018-09-20 9:34 ` [PATCH 01/11] vinyl: merge vy_quota_release and vy_quota_update_dump_bandwidth Vladimir Davydov
2018-09-20 9:34 ` [PATCH 02/11] vinyl: refactor quota use/unuse methods Vladimir Davydov
2018-09-20 9:34 ` [PATCH 03/11] vinyl: do not try to trigger dump if it is already in progress Vladimir Davydov
2018-09-20 9:34 ` [PATCH 04/11] vinyl: don't start quota timer until local recovery is complete Vladimir Davydov
2018-09-20 9:34 ` [PATCH 05/11] vinyl: add helper to start scheduler and enable quota on startup Vladimir Davydov
2018-09-25 23:22 ` [tarantool-patches] " Konstantin Osipov
2018-09-20 9:34 ` [PATCH 06/11] vinyl: zap vy_env::memory, read_threads, and write_threads Vladimir Davydov
2018-09-25 23:23 ` [tarantool-patches] " Konstantin Osipov
2018-09-20 9:34 ` [PATCH 07/11] vinyl: do not account zero dump bandwidth Vladimir Davydov
2018-09-25 23:24 ` [tarantool-patches] " Konstantin Osipov
2018-09-20 9:34 ` [PATCH 08/11] vinyl: set quota timer period to 100 ms Vladimir Davydov
2018-09-20 9:34 ` [PATCH 09/11] vinyl: implement basic transaction throttling Vladimir Davydov
2018-09-20 9:34 ` [PATCH 10/11] vinyl: implement quota wait queue without fiber_cond Vladimir Davydov
2018-09-20 9:34 ` [PATCH 11/11] vinyl: split quota consumption rate limit into soft and hard Vladimir Davydov
2018-09-25 23:19 ` [tarantool-patches] Re: [PATCH 00/11] vinyl: prepare for transaction throttling Konstantin Osipov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1537435404.git.vdavydov.dev@gmail.com \
--to=vdavydov.dev@gmail.com \
--cc=kostja@tarantool.org \
--cc=tarantool-patches@freelists.org \
--subject='Re: [PATCH 00/11] vinyl: prepare for transaction throttling' \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox