Mirror of the lttng-dev mailing list
 help / color / mirror / Atom feed
From: laijs@cn.fujitsu.com (Lai Jiangshan)
Subject: [ltt-dev] [PATCH 08/10 round10] comments for memory management
Date: Wed, 16 Nov 2011 14:48:23 +0800	[thread overview]
Message-ID: <1321426105-24303-9-git-send-email-laijs@cn.fujitsu.com> (raw)
In-Reply-To: <1321426105-24303-1-git-send-email-laijs@cn.fujitsu.com>

Signed-off-by: Lai Jiangshan <laijs at cn.fujitsu.com>
---
 rculfhash.c |   33 +++++++++++++++++++++++++++++++++
 1 files changed, 33 insertions(+), 0 deletions(-)

diff --git a/rculfhash.c b/rculfhash.c
index b764dc1..3f982cf 100644
--- a/rculfhash.c
+++ b/rculfhash.c
@@ -117,6 +117,39 @@
  * grow hash table from order 5 to 6: init the index=6 bucket node table
  * shrink hash table from order 6 to 5: fini the index=6 bucket node table
  *
+ * Bucket memory management:
+ * - Bucket node order tables are high level or algorithm level view
+ *   of bucket management of the hash table. The management of
+ *   the memory where the bucket node tables locate is low level
+ *   or raw level view of the hash table.
+ * - The bucket management uses cds_lfht_alloc_bucket_table(order) and
+ *   cds_lfht_free_bucket_table(order) of the memory management to
+ *   alloc/free the bucket node tables.
+ * - Memory management attributes: min_alloc_size, max_size
+ *   Memory management configurations: LFHT_MEMORY_ORDER, LFHT_MEMORY_CHUNK,
+ *   				       LFHT_MEMORY_RESERVED
+ * - min_alloc_size: the smallest allocation buckets size to use and the
+ *   small bucket node tables are forced to be allocated in this contiguous
+ *   memory which improve cache locality of small index orders.
+ * - max_size: the max size of buckets for future growing.
+ * - LFHT_MEMORY_ORDER: a block order memory per a bucket node order table.
+ *   (except small bucket node tables, see min_alloc_size).
+ *   + the size of the table can grow infinitely
+ *   + two level bucket indexing which requires hard/soft fls()
+ *   + bad indexing when there is node hardware fls() instruction
+ * - LFHT_MEMORY_CHUNK: use same-size memory chunks. A big bucket node table
+ *   will be constructed by multi/one memory chunk(s). The size of a chunk
+ *   is choson to be min_alloc_size.
+ *   + a chunk ptr table need be be allocted when the hash table is created
+ *   + two level bucket indexing but simpler than LFHT_MEMORY_ORDER
+ * - LFHT_MEMORY_RESERVED: reserve a large memory space for all the max_size
+ *   buckets when hash table is created. All of the bucket node tables
+ *   are/(will be) allocated in this contiguous memory space. The memory
+ *   is allocated only when it is demanded. And when a bucket node table
+ *   is free, the memory can be discard to reduce system memory presure.
+ *   + one level bucket indexing, extremly simple
+ *   + recomended only when the system have enough memory space: 64BITS.
+ *
  * A bit of ascii art explanation:
  * 
  * Order index is the off-by-one compare to the actual power of 2 because 
-- 
1.7.4.4




  parent reply	other threads:[~2011-11-16  6:48 UTC|newest]

Thread overview: 32+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-11-16  6:48 [ltt-dev] [PATCH 00/10 round10] rculfhash memory managements Lai Jiangshan
2011-11-16  6:48 ` [ltt-dev] [PATCH 01/10 round10] introduce bucket_at() and improve readability Lai Jiangshan
2011-11-22  9:58   ` Mathieu Desnoyers
2011-11-23  6:33     ` Lai Jiangshan
2011-11-23  6:50       ` Mathieu Desnoyers
2011-11-16  6:48 ` [ltt-dev] [PATCH 02/10 round10] proper wrapper for bucket table alloc and free Lai Jiangshan
2011-11-22 10:01   ` Mathieu Desnoyers
2011-11-23  6:36     ` Lai Jiangshan
2011-11-23  6:49       ` Mathieu Desnoyers
2011-11-16  6:48 ` [ltt-dev] [PATCH 03/10 round10] ht->t.size is no required larger than ht->min_table_size now Lai Jiangshan
2011-11-22 10:06   ` Mathieu Desnoyers
2011-11-23  7:05     ` Lai Jiangshan
2011-11-23  7:17       ` Mathieu Desnoyers
2011-11-16  6:48 ` [ltt-dev] [PATCH 04/10 round10] remove struct rcu_level Lai Jiangshan
2011-11-22 10:08   ` Mathieu Desnoyers
2011-11-16  6:48 ` [ltt-dev] [PATCH 05/10 round10] add max_size arguemnt Lai Jiangshan
2011-11-22 10:11   ` Mathieu Desnoyers
2011-11-23  7:13     ` Lai Jiangshan
2011-11-23  7:15       ` Mathieu Desnoyers
2011-11-16  6:48 ` [ltt-dev] [PATCH 06/10 round10] add LFHT_MEMORY_CHUNK low level memory management Lai Jiangshan
2011-11-22 10:20   ` Mathieu Desnoyers
2011-11-23  6:05     ` Mathieu Desnoyers
2011-11-23  8:11     ` Lai Jiangshan
2011-11-23  9:21       ` Mathieu Desnoyers
2011-11-16  6:48 ` [ltt-dev] [PATCH 07/10 round10] add LFHT_MEMORY_RESERVED " Lai Jiangshan
2011-11-17  2:15   ` Lai Jiangshan
2011-11-22 10:25   ` Mathieu Desnoyers
2011-11-16  6:48 ` Lai Jiangshan [this message]
2011-11-16  6:48 ` [ltt-dev] [PATCH 09/10 round10] fix comments of cds_lfht_new() Lai Jiangshan
2011-11-23  5:46   ` Mathieu Desnoyers
2011-11-16  6:48 ` [ltt-dev] [PATCH 10/10 round10] add my name Lai Jiangshan
2011-11-23  5:48   ` Mathieu Desnoyers

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1321426105-24303-9-git-send-email-laijs@cn.fujitsu.com \
    --to=laijs@cn.fujitsu.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox