From: Georgy Kirichenko <georgy@tarantool.org> To: tarantool-patches@freelists.org Cc: Georgy Kirichenko <georgy@tarantool.org> Subject: [tarantool-patches] [PATCH 08/10] Use mempool to alloc wal messages Date: Fri, 19 Apr 2019 15:44:04 +0300 [thread overview] Message-ID: <f2bc5654a6258347b65a5689982f76fd3332e502.1555677159.git.georgy@tarantool.org> (raw) In-Reply-To: <cover.1555677159.git.georgy@tarantool.org> Don't use fiber gc region to alloc wal messages. This relaxes friction between fiber life cycle and transaction processing. Prerequisites: #1254 --- src/box/wal.c | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/src/box/wal.c b/src/box/wal.c index 6ccc1220a..f0352e938 100644 --- a/src/box/wal.c +++ b/src/box/wal.c @@ -89,6 +89,8 @@ struct wal_writer struct stailq rollback; /** A pipe from 'tx' thread to 'wal' */ struct cpipe wal_pipe; + /** A memory pool for messages. */ + struct mempool msg_pool; /* ----------------- wal ------------------- */ /** A setting from instance configuration - rows_per_wal */ int64_t wal_max_rows; @@ -287,6 +289,7 @@ tx_schedule_commit(struct cmsg *msg) /* Update the tx vclock to the latest written by wal. */ vclock_copy(&replicaset.vclock, &batch->vclock); tx_schedule_queue(&batch->commit); + mempool_free(&writer->msg_pool, container_of(msg, struct wal_msg, base)); } static void @@ -308,6 +311,9 @@ tx_schedule_rollback(struct cmsg *msg) trigger_run(&req->on_error, NULL); tx_schedule_queue(&writer->rollback); stailq_create(&writer->rollback); + if (msg != &writer->in_rollback) + mempool_free(&writer->msg_pool, + container_of(msg, struct wal_msg, base)); } @@ -378,6 +384,9 @@ wal_writer_create(struct wal_writer *writer, enum wal_mode wal_mode, writer->on_garbage_collection = on_garbage_collection; writer->on_checkpoint_threshold = on_checkpoint_threshold; + + mempool_create(&writer->msg_pool, &cord()->slabc, + sizeof(struct wal_msg)); } /** Destroy a WAL writer structure. */ @@ -1158,8 +1167,7 @@ wal_write(struct journal *journal, struct journal_entry *entry) stailq_add_tail_entry(&batch->commit, entry, fifo); } else { - batch = (struct wal_msg *) - region_alloc(&fiber()->gc, sizeof(struct wal_msg)); + batch = (struct wal_msg *)mempool_alloc(&writer->msg_pool); if (batch == NULL) { diag_set(OutOfMemory, sizeof(struct wal_msg), "region", "struct wal_msg"); -- 2.21.0
next prev parent reply other threads:[~2019-04-19 12:44 UTC|newest] Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top 2019-04-19 12:43 [tarantool-patches] [PATCH 00/10] Transaction refactoring Georgy Kirichenko 2019-04-19 12:43 ` [tarantool-patches] [PATCH 01/10] Introduce a txn memory region Georgy Kirichenko 2019-04-24 18:20 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:43 ` [tarantool-patches] [PATCH 02/10] Alloc journal entry on " Georgy Kirichenko 2019-04-24 18:21 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:43 ` [tarantool-patches] [PATCH 03/10] Encode a dml statement to a transaction " Georgy Kirichenko 2019-04-24 18:28 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:44 ` [tarantool-patches] [PATCH 04/10] Get rid of autocommit from a txn structure Georgy Kirichenko 2019-04-24 19:07 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:44 ` [tarantool-patches] [PATCH 05/10] Get rid of fiber_gc from txn_rollback Georgy Kirichenko 2019-04-24 19:12 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:44 ` [tarantool-patches] [PATCH 06/10] Require for txn in case of txn_begin_stmt/txn_rollback_stmt Georgy Kirichenko 2019-04-24 19:13 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:44 ` [tarantool-patches] [PATCH 07/10] Remove fiber from a journal_entry structure Georgy Kirichenko 2019-04-24 19:16 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:44 ` Georgy Kirichenko [this message] 2019-04-24 19:18 ` [tarantool-patches] Re: [PATCH 08/10] Use mempool to alloc wal messages Konstantin Osipov 2019-04-19 12:44 ` [tarantool-patches] [PATCH 09/10] Enable asyncronous wal writes Georgy Kirichenko 2019-04-24 19:19 ` [tarantool-patches] " Konstantin Osipov 2019-04-19 12:44 ` [tarantool-patches] [PATCH 10/10] Introduce asynchronous txn commit Georgy Kirichenko 2019-04-24 19:20 ` [tarantool-patches] " Konstantin Osipov
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=f2bc5654a6258347b65a5689982f76fd3332e502.1555677159.git.georgy@tarantool.org \ --to=georgy@tarantool.org \ --cc=tarantool-patches@freelists.org \ --subject='Re: [tarantool-patches] [PATCH 08/10] Use mempool to alloc wal messages' \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox