The Babbage column in The Economist has published a short report about parallel computing, in the context of the water-cooled machines at Supercomputing ’11. The piece makes an interesting point about the way that supercomputing didn’t invent parallel computing, but it did turn the theory into practice and kickstart the cycle of innovation we see in consumer PCs with cheap multicore chips being widely available, and many proven techniques available to programmers to exploit them. It’s often observed that the desktop follows where high performance computing leads, but I guess the interesting thing is that the theories were already established. We have lots of theories and proposed solutions available today for different parallel programming solutions. It made me wonder whether their advocates should focus their efforts towards securing a major supercomputing implementation, as proof of concept? Certainly, if your goal was to get a parallel paradigm off the ground, it might be a smart move to befriend academics who might be interested in your work. I reckon one big supercomputing installation would carry a lot more weight than a few hundred implementations among consumer-software programmers. What do you think?
It also occurred to me that water-cooling could add a huge amount of complexity to the data centre. I guess supercomputers aren’t designed to be just dropped into the typical data centre, but ultimately the designs might end up there. Data centres today already struggle to manage their physical resources, particularly power, space and heat dissipation (and having the right combination available at the right place to support the right equipment), so adding another dimension of water plumbing would make many a data centre manager break out in a sweat.
Food for thought, certainly. You can check out The Economist’s article here.
Filed under: Programming | Tagged: parallel computing | Leave a Comment »





