Welcome Guest. | Log In| Register | Membership Benefits
  • Email this page E-mail this page
  • |  Print Print this page
  • |   Bookmark and Share
  • |  icon
  • | 

Mountains Of Data: 500 Terabytes And Counting


The database at the Stanford Linear Accelerator has reached the 500 terabyte mark, roughly equivalent to a billion books.

By Diane Rezendes Khirallah
InformationWeek
April 25, 2002 12:00 AM

The database at the Stanford Linear Accelerator has reached the 500 terabyte mark, roughly equivalent to a billion books, or 60 times the content of the U.S. Library of Congress. It's not a magic number, says Jacek Becla, database group manager for the accelerator, but it is a marker--and it won't stand long. "Within a year or so, we expect it will reach a petabyte."

The nearly unimaginable amount of data is generated by the BABAR experiment, a collaborative experiment involving 600 physicists from nine countries. They're smashing subatomic particles in the mile-long supercollider to create anti-matter and observe its behavior with matter. By using a 1,000-ton particle detector to observe the collision of these submicroscopic particles, scientists hope to gain a better understanding of how the universe was formed, and perhaps even to answer one of nature's biggest mysteries: why the universe is dominated by matter over anti-matter.

More Software Insights

White Papers

Webcasts

Reports

Videos


Going green often involves the immediate thought of taming the data center, but there's plenty to do in software. We talked to IBM/Tivoli Software CTO Alan Ganek and InformationWeek's head of analytics, Art Wittmann. Data Warehouse Appliance Promises Database Transparence, Mixed BI Workload, Massive Scalability We caught up with CEI's CEO D. Raja to talk about the state of the custom development market, what CEI's role in it is and also about the entrepreunerial nature of the Pittsburgh PA market.
We caught up with CEI's CEO D. Raja to talk about the state of the custom development market, what CEI's role in it is and also about the entrepreunerial nature of the Pittsburgh PA market.
When Becla's team began the project in 1998 with $177 million from the Department of Energy, it opted for object-oriented database technology over more ubiquitous relational database systems. But because relational databases are pretty much the business standard, there are relatively few experts in object-oriented database technology. Companies aren't really looking at object-oriented database technology, even though Becla says it's more scalable, partly because they've already chosen another standard. And it's pretty daunting to consider that of the 5 million lines of C++ BABAR's code in the accelerator's database, half a million are dedicated to customizing the object-oriented database engine.

While it takes 2,000 CPUs and 100 servers to support the system, not many people are needed--three developers and three database administrators handle the load.

Five hundred terabytes is much larger than most businesses need now but that will soon change, contends Becla, whose group monitors large database systems. Most are less than a hundredth the size of this one, but he thinks many businesses will eventually need superdata storage. With bio-informatics, streaming video, and other large applications, he says, "it will happen sooner than they think."


Subscribe to RSS


Advertisement

CAREER CENTER
Ready to take that job and shove it?



TechCareers

SEARCH
Function:

Keyword(s):

State:
SPONSOR
RECENT JOB POSTINGS
CAREER NEWS
10 Search Engines You Don't Know About
Go beyond Google and get vertical. These specialized search sites will help you find the business information you need -- fast.

Yahoo Profits Fall 23%, Cuts 1,000 Jobs
Ari Balogh was named to the post of chief technology officer as the companys for a "realignment" of employees.

More articles from our career center

The Latest Software News

more Software articles




Subscription Info
Apply for a free 52-week subscription to InformationWeek (a $199 value)

Last Name:

First Name:

Title:

Company Name:

City:

Business Address:

Zip:

State:

Email Address:

NOTE: Offer valid for U.S., U.S. possessions, & Canada only

            

Join economist Chris Cornell and 3 CIOs in an Exclusive Online Exchange for Senior IT Executives: Using IT to Drive Value in a Turbulent Economy. November 5th only.