Commentary

Alexander Wolfe
 

Wall Street Tech Elite Are Gonna Take Supercomputing To IT Main Street

What's in a supercomputer? Twenty years ago, the fastest machines in the world were specialty architectures designed by quirky geniuses like Seymour Cray. Today, the field's name has changed -- it's called HPC, for high-performance computing -- but it's still where the action is. That was definitely the deal Monday at the High Performance on Wall Street conference in New York City.

What's in a supercomputer? Twenty years ago, the fastest machines in the world were specialty architectures designed by quirky geniuses like Seymour Cray. Today, the field's name has changed -- it's called HPC, for high-performance computing -- but it's still where the action is. That was definitely the deal Monday at the High Performance on Wall Street conference in New York City.Since supercomputers are to desktops, or even enterprise blades, as Corvettes are to Ford Tauruses, you might wonder why you should care about them. (Sorry, I can't resist using the older term, though technically speaking there's a difference, according to Wikipedia.)

Attention must be paid because they're a leading indicator of the type of computing technology you're going to see in the mainstream, in two to three years time. I've been covering supercomputers on and off for 20 years, and what I saw at the conference convinced me that the pace of technology transfer is going to accelerate.


More Global CIO Insights

White Papers

More >>

Reports

More >>

Webcasts

More >>

Indeed, given all the hubbub about multicore processors at the conference, I predict that the high-performance crowd -- or IT managers, developers, and programmers who've cut their teeth in that sector -- are going to be key providers of technical assistance to mainstream data centers from here on out.

The reason: These people are the only ones who are up to speed on, and have the technical smarts to take real advantage of, the new multicore processing architectures coming out of Intel and AMD.

Think about it. In the presentations I saw, panelists were talking about how to manage clusters with from 100 to 1,000 processors!

The HPC crowd is messing around with this stuff because they're charged with managing the most mission-critical applications around. Those are the real-time, advanced trading programs used by Wall Street.

However, unlike in the old days, when ultra-high-end processors were mostly unaffordable and locked away in an NSA back room, today everybody can access HPC. If you've got a bunch of blades, you can create your own cluster. And if you don't have the hardware on hand, you can rent compute cycles from IBM or Sun Microsystems.

Interestingly, and perhaps paradoxically, the challenge today remains the same as it ever was. Namely, it's very hard to create software which can take proper advantage of all the hardware.

OK, I've done a lot of telegraphing in the above post, without diving into the nitty-gritty details, which in any case you shouldn't try at home. Let me instead leave you with something useful. That would be a pointer to the three main tech areas you should familiarize yourself with. These are all things which were on the tips of everyone's tongues at the conference, and they will be very important in the next 6 to 36 months.

  • Grid Computing

    Originally a technology, then a cottage industry of startups (see my old but not too moldy grid article). Now, we're beyond the hype stage and grid is a commercial reality. Look for major activity in this arena in the coming year, with some of the smaller vendors becoming attractive acquisition targets.

  • Infiniband

    This multi-gigabit-per-second communications link is the main means by which processors in large cluster pass messages back and forth. A really fast link is important here because of the hundreds (often, thousands) of CPUs in such clusters. Even with Infiniband, latency remains a big problem.

  • Multicore

    The multicore processor architectures, from Intel and AMD, which I mentioned earlier, are by now so well known that you probably think of them as commonplace. That would be wrong, very wrong. You should instead think of them as the enablers of computing's future, which is here today. (Yes, Virginia, we live in very exciting times.)

    One thing panelists harped on at the conference, which I wasn't as aware of as I should be, is that both AMD and Intel have posted on their Web sites lots of heavy-duty technical training material available on their respective multicore processors and architectures. I'll add in links as I get them…


  • Related Reading




    Currently we allow the following HTML tags in comments:

    Single tags

    These tags can be used alone and don't need an ending tag.

    <br> Defines a single line break

    <hr> Defines a horizontal line

    Matching tags

    These require an ending tag - e.g. <i>italic text</i>

    <a> Defines an anchor

    <b> Defines bold text

    <big> Defines big text

    <blockquote> Defines a long quotation

    <caption> Defines a table caption

    <cite> Defines a citation

    <code> Defines computer code text

    <em> Defines emphasized text

    <fieldset> Defines a border around elements in a form

    <h1> This is heading 1

    <h2> This is heading 2

    <h3> This is heading 3

    <h4> This is heading 4

    <h5> This is heading 5

    <h6> This is heading 6

    <i> Defines italic text

    <p> Defines a paragraph

    <pre> Defines preformatted text

    <q> Defines a short quotation

    <samp> Defines sample computer code text

    <small> Defines small text

    <span> Defines a section in a document

    <s> Defines strikethrough text

    <strike> Defines strikethrough text

    <strong> Defines strong text

    <sub> Defines subscripted text

    <sup> Defines superscripted text

    <u> Defines underlined text

    InformationWeek encourages readers to engage in spirited, healthy debate, including taking us to task. However, InformationWeek moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing/SPAM. InformationWeek further reserves the right to disable the profile of any commenter participating in said activities.

    Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.
    T-Shirt Giveaway T-Shirt Giveaway: Each week we're selecting one great comment from our readers. The author of the comment will receive an InformaitonWeek Community t-shirt. So get posting!
    Subscribe to RSS

    Resource Links