niXforums Forum Index
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   PreferencesPreferences   Log in to check your private messagesLog in to check your private messages   Log inLog in 
·  nixdoc.net ·  man pages ·  Linux HOWTOs ·  FreeBSD Tips ·  Forums
navigation Forum index » Databases » Berkeley DB
Large cache size support
Post new topic   Reply to topic Page 1 of 1 [2 Posts] View previous topic :: View next topic
Author Message
Michael Cahill
*nix forums Guru Wannabe


Joined: 26 May 2005
Posts: 219

PostPosted: Wed Apr 13, 2005 12:46 am    Post subject: Re: Large cache size support Reply with quote

Quote:
Here is my problem:
I'm unable to get BDB to use a cache size greater than 1GB
866983779
bytes and to get it to use the 1.8GB I had to split it across 59
cache
files! What gives? Is this a BDB problem or a Linux problem or Java
problem or what? The upper limit on 32bit is supposed to be 4GB. I'm
barely getting a third of that. Does anyone have a clue?

To configure a single cache region of 1.8GB, you'll need to have that
much free virtual memory in one contiguous block. What's happening is
that the JVM and shared libraries reserve blocks of memory in ways that
leave you without one big block.

In addition, the operating system will reserve part of the address
space (1GB by default, with Linux 2.6), so that makes your upper limit
3GB, not 4. There are patches to the kernel that address this, but
they incur runtime overhead. See this article:

http://kerneltrap.org/node/2450

for more information.

Of course, the simplest way to configure a larger cache is to run on a
64-bit CPU.

You should also find that reducing the size of the Java heap (with the
"-Xmx" command line flag) allows you to configure a larger cache, but
there is obviously a tradeoff there with the corresponding increase in
garbage collection.

In any case, you're getting 60% of the maximum now -- it may be
possible to do better, but not by a whole lot if you want to have a JVM
in the same address space.

Regards,
Michael.
Back to top
studdugie@gmail.com
*nix forums beginner


Joined: 21 Jun 2005
Posts: 28

PostPosted: Tue Apr 12, 2005 7:06 pm    Post subject: Large cache size support Reply with quote

Here is my setup:

BDB: BerkeleDB 4.3.27NC (3 patches)

Arch: Intel Xeon 3.06GHz

RAM: 6GB

OS: Gentoo Linux 2.6.11.5

glibc: Compiled by GNU CC version 3.3.5 (Gentoo Linux 3.3.5-r1,
ssp-3.3.2-3, pie-8.7.7.1).
Compiled on a Linux 2.6.8 system on 2005-02-26.
Available extensions:
GNU libio by Per Bothner
crypt add-on version 2.1 by Michael Glad and others
Native POSIX Threads Library by Ulrich Drepper et al
BIND-8.2.3-T5B
NIS(YP)/NIS+ NSS modules 0.19 by Thorsten Kukuk
Thread-local storage support included.

gcc: 3.3.5

Language: J2SE 1.5.0_02

FS: XFS

Here is my problem:
I'm unable to get BDB to use a cache size greater than 1GB 866983779
bytes and to get it to use the 1.8GB I had to split it across 59 cache
files! What gives? Is this a BDB problem or a Linux problem or Java
problem or what? The upper limit on 32bit is supposed to be 4GB. I'm
barely getting a third of that. Does anyone have a clue?
Back to top
Google

Back to top
Display posts from previous:   
Post new topic   Reply to topic Page 1 of 1 [2 Posts] View previous topic :: View next topic
The time now is Thu Jan 08, 2009 3:33 am | All times are GMT
navigation Forum index » Databases » Berkeley DB
Jump to:  

Similar Topics
Topic Author Forum Replies Last Post
No new posts Install suse from USB without BIOS support vjy04 Suse 0 Tue Jun 24, 2008 8:57 am
No new posts Install suse from USB without BIOS support vjy04 Suse 0 Tue Jun 24, 2008 8:56 am
No new posts Install suse from USB without BIOS support vjy04 Suse 0 Tue Jun 24, 2008 8:56 am
No new posts Install suse from USB without BIOS support vjy04 Suse 0 Tue Jun 24, 2008 8:55 am
No new posts Does stream I/O support "%a" floating-point format? John Friedland C++ 3 Fri Jul 21, 2006 9:26 am

Debt Consolidation | Secured Loans | Credit Cards | Sailor Moon Music | Personal Finance
Copyright © 2004-2005 DeniX Solutions SRL
 
Other DeniX Solutions sites: Unix/Linux blog |  electronics forum |  medicine forum |  science forum | 
Privacy Policy


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.1310s ][ Queries: 20 (0.0598s) ][ GZIP on - Debug on ]