From: Vladimir Davydov <vdavydov.dev@gmail.com>
To: kostja@tarantool.org
Cc: tarantool-patches@freelists.org
Subject: [PATCH v2 0/8] vinyl: improve stats for throttling
Date: Sun, 16 Sep 2018 20:06:43 +0300 [thread overview]
Message-ID: <cover.1537115208.git.vdavydov.dev@gmail.com> (raw)
This patch set adds some essential global disk statistics necessary for
transaction throttling, namely size of data stored on disk, written by
dump and compaction threads, awaiting compaction. This is probably not
enough for implementing throttling, but that should be a good start.
https://github.com/tarantool/tarantool/issues/1862
https://github.com/tarantool/tarantool/commits/dv/vy-stats-for-throttling
Changes in v2:
- Remove controversial disk idle ratio and compaction debt metrics,
because they still need to be elaborated.
- Rework the way global disk statistics are reported.
- Remove the patches that have been merged, rebase on the latest 1.10,
and refactor the code slightly.
v1: https://www.freelists.org/post/tarantool-patches/PATCH-07-vinyl-improve-stats-for-throttling
Vladimir Davydov (8):
vinyl: fix force compaction logic
vinyl: update compact priority usual way on range split/coalesce
vinyl: annotate info_table_end with comment
vinyl: report pages and bytes_compressed in dump/compact in/out stats
vinyl: add helpers for resetting statement counters
vinyl: keep track of compaction queue length
vinyl: factor out helpers for accounting dump/compaction
vinyl: add global disk stats
src/box/vinyl.c | 111 +++++++++++++++++++++++++++++--------------
src/box/vy_lsm.c | 95 ++++++++++++++++++++++++++++++-------
src/box/vy_lsm.h | 34 +++++++++++++-
src/box/vy_range.c | 27 +++++------
src/box/vy_range.h | 10 ++--
src/box/vy_scheduler.c | 40 +++++++++-------
src/box/vy_stat.h | 62 +++++++++++++++++++-----
src/errinj.h | 1 +
test/box/errinj.result | 4 +-
test/vinyl/errinj.result | 114 +++++++++++++++++++++++++++++++++++++++++++++
test/vinyl/errinj.test.lua | 32 +++++++++++++
test/vinyl/info.result | 111 ++++++++++++++++++++++++++++++++++++++++---
test/vinyl/info.test.lua | 14 ++++++
13 files changed, 544 insertions(+), 111 deletions(-)
--
2.11.0
next reply other threads:[~2018-09-16 17:06 UTC|newest]
Thread overview: 18+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-09-16 17:06 Vladimir Davydov [this message]
2018-09-16 17:06 ` [PATCH v2 1/8] vinyl: fix force compaction logic Vladimir Davydov
2018-09-19 1:43 ` Konstantin Osipov
2018-09-16 17:06 ` [PATCH v2 2/8] vinyl: update compact priority usual way on range split/coalesce Vladimir Davydov
2018-09-19 1:46 ` Konstantin Osipov
2018-09-16 17:06 ` [PATCH v2 3/8] vinyl: annotate info_table_end with comment Vladimir Davydov
2018-09-19 1:47 ` Konstantin Osipov
2018-09-16 17:06 ` [PATCH v2 4/8] vinyl: report pages and bytes_compressed in dump/compact in/out stats Vladimir Davydov
2018-09-19 1:48 ` Konstantin Osipov
2018-09-16 17:06 ` [PATCH v2 5/8] vinyl: add helpers for resetting statement counters Vladimir Davydov
2018-09-19 1:49 ` Konstantin Osipov
2018-09-16 17:06 ` [PATCH v2 6/8] vinyl: keep track of compaction queue length Vladimir Davydov
2018-09-19 1:53 ` Konstantin Osipov
2018-09-16 17:06 ` [PATCH v2 7/8] vinyl: factor out helpers for accounting dump/compaction Vladimir Davydov
2018-09-19 1:53 ` Konstantin Osipov
2018-09-16 17:06 ` [PATCH v2 8/8] vinyl: add global disk stats Vladimir Davydov
2018-09-19 1:56 ` Konstantin Osipov
2018-09-19 9:59 ` [PATCH v2 0/8] vinyl: improve stats for throttling Vladimir Davydov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1537115208.git.vdavydov.dev@gmail.com \
--to=vdavydov.dev@gmail.com \
--cc=kostja@tarantool.org \
--cc=tarantool-patches@freelists.org \
--subject='Re: [PATCH v2 0/8] vinyl: improve stats for throttling' \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox