From: laijs@cn.fujitsu.com (Lai Jiangshan)
Subject: [ltt-dev] [PATCH 08/10 round10] comments for memory management
Date: Wed, 16 Nov 2011 14:48:23 +0800 [thread overview]
Message-ID: <1321426105-24303-9-git-send-email-laijs@cn.fujitsu.com> (raw)
In-Reply-To: <1321426105-24303-1-git-send-email-laijs@cn.fujitsu.com>
Signed-off-by: Lai Jiangshan <laijs at cn.fujitsu.com>
---
rculfhash.c | 33 +++++++++++++++++++++++++++++++++
1 files changed, 33 insertions(+), 0 deletions(-)
diff --git a/rculfhash.c b/rculfhash.c
index b764dc1..3f982cf 100644
--- a/rculfhash.c
+++ b/rculfhash.c
@@ -117,6 +117,39 @@
* grow hash table from order 5 to 6: init the index=6 bucket node table
* shrink hash table from order 6 to 5: fini the index=6 bucket node table
*
+ * Bucket memory management:
+ * - Bucket node order tables are high level or algorithm level view
+ * of bucket management of the hash table. The management of
+ * the memory where the bucket node tables locate is low level
+ * or raw level view of the hash table.
+ * - The bucket management uses cds_lfht_alloc_bucket_table(order) and
+ * cds_lfht_free_bucket_table(order) of the memory management to
+ * alloc/free the bucket node tables.
+ * - Memory management attributes: min_alloc_size, max_size
+ * Memory management configurations: LFHT_MEMORY_ORDER, LFHT_MEMORY_CHUNK,
+ * LFHT_MEMORY_RESERVED
+ * - min_alloc_size: the smallest allocation buckets size to use and the
+ * small bucket node tables are forced to be allocated in this contiguous
+ * memory which improve cache locality of small index orders.
+ * - max_size: the max size of buckets for future growing.
+ * - LFHT_MEMORY_ORDER: a block order memory per a bucket node order table.
+ * (except small bucket node tables, see min_alloc_size).
+ * + the size of the table can grow infinitely
+ * + two level bucket indexing which requires hard/soft fls()
+ * + bad indexing when there is node hardware fls() instruction
+ * - LFHT_MEMORY_CHUNK: use same-size memory chunks. A big bucket node table
+ * will be constructed by multi/one memory chunk(s). The size of a chunk
+ * is choson to be min_alloc_size.
+ * + a chunk ptr table need be be allocted when the hash table is created
+ * + two level bucket indexing but simpler than LFHT_MEMORY_ORDER
+ * - LFHT_MEMORY_RESERVED: reserve a large memory space for all the max_size
+ * buckets when hash table is created. All of the bucket node tables
+ * are/(will be) allocated in this contiguous memory space. The memory
+ * is allocated only when it is demanded. And when a bucket node table
+ * is free, the memory can be discard to reduce system memory presure.
+ * + one level bucket indexing, extremly simple
+ * + recomended only when the system have enough memory space: 64BITS.
+ *
* A bit of ascii art explanation:
*
* Order index is the off-by-one compare to the actual power of 2 because
--
1.7.4.4
next prev parent reply other threads:[~2011-11-16 6:48 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-11-16 6:48 [ltt-dev] [PATCH 00/10 round10] rculfhash memory managements Lai Jiangshan
2011-11-16 6:48 ` [ltt-dev] [PATCH 01/10 round10] introduce bucket_at() and improve readability Lai Jiangshan
2011-11-22 9:58 ` Mathieu Desnoyers
2011-11-23 6:33 ` Lai Jiangshan
2011-11-23 6:50 ` Mathieu Desnoyers
2011-11-16 6:48 ` [ltt-dev] [PATCH 02/10 round10] proper wrapper for bucket table alloc and free Lai Jiangshan
2011-11-22 10:01 ` Mathieu Desnoyers
2011-11-23 6:36 ` Lai Jiangshan
2011-11-23 6:49 ` Mathieu Desnoyers
2011-11-16 6:48 ` [ltt-dev] [PATCH 03/10 round10] ht->t.size is no required larger than ht->min_table_size now Lai Jiangshan
2011-11-22 10:06 ` Mathieu Desnoyers
2011-11-23 7:05 ` Lai Jiangshan
2011-11-23 7:17 ` Mathieu Desnoyers
2011-11-16 6:48 ` [ltt-dev] [PATCH 04/10 round10] remove struct rcu_level Lai Jiangshan
2011-11-22 10:08 ` Mathieu Desnoyers
2011-11-16 6:48 ` [ltt-dev] [PATCH 05/10 round10] add max_size arguemnt Lai Jiangshan
2011-11-22 10:11 ` Mathieu Desnoyers
2011-11-23 7:13 ` Lai Jiangshan
2011-11-23 7:15 ` Mathieu Desnoyers
2011-11-16 6:48 ` [ltt-dev] [PATCH 06/10 round10] add LFHT_MEMORY_CHUNK low level memory management Lai Jiangshan
2011-11-22 10:20 ` Mathieu Desnoyers
2011-11-23 6:05 ` Mathieu Desnoyers
2011-11-23 8:11 ` Lai Jiangshan
2011-11-23 9:21 ` Mathieu Desnoyers
2011-11-16 6:48 ` [ltt-dev] [PATCH 07/10 round10] add LFHT_MEMORY_RESERVED " Lai Jiangshan
2011-11-17 2:15 ` Lai Jiangshan
2011-11-22 10:25 ` Mathieu Desnoyers
2011-11-16 6:48 ` Lai Jiangshan [this message]
2011-11-16 6:48 ` [ltt-dev] [PATCH 09/10 round10] fix comments of cds_lfht_new() Lai Jiangshan
2011-11-23 5:46 ` Mathieu Desnoyers
2011-11-16 6:48 ` [ltt-dev] [PATCH 10/10 round10] add my name Lai Jiangshan
2011-11-23 5:48 ` Mathieu Desnoyers
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1321426105-24303-9-git-send-email-laijs@cn.fujitsu.com \
--to=laijs@cn.fujitsu.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox