NVIDIA is the company behind the industry-leading graphics processing unit (GPU), H100, currently the most sought-after hardware for AI and used extensively by some of the biggest AI companies in the world, including OpenAI, Microsoft and Google. H100 is generally 2-3 times faster than the previous A100 generation, and an impressive 30 times faster for AI workloads such as large language models (LLM). The recently announced supercomputer, Gefion, by Novo Nordisk Foundation (NNF) and the Export and Investment Fund of Denmark (EIFO) will make use of the same technology. <\/p>\n\n\n\n
![\"\"](\"http:\/\/escience.sdu.dk\/wp-content\/uploads\/2024\/05\/image003.jpg\")
<\/figure><\/div>\n\n\n\nIn the past, Danish researchers had to either search abroad or pay commercial cloud providers expensive fees to use these powerful machines. However, since January this year the 16 H100 GPUs have been available via the DeiC Interactive HPC service, provided by a consortium of universities consisting of Aarhus University (AU), Aalborg University (AAU) and the University of Southern Denmark (SDU). The H100 GPUs are hosted at the SDU data center and available via the user-friendly platform, UCloud<\/a>, that powers the DeiC Interactive HPC service. <\/p>\n\n\n\n Lenovo\u2019s role in the production of the H100 GPUs is to provide the liquid cooling system, which removes heat from the power-hungry GPUs. GPUs with this much power produce massive amount of heat, and the liquid glycerol used in the Lenovo\u2019s \u201cNeptune\u201d liquid-to-air system takes the heat away from the GPUs, similarly to the way a radiator works in a car.<\/p>\n\n\n\n \u201cLenovo\u2019s contribution to this machine is fundamental,\u201d says Dr. Valerio Rizzo. \u201cAs the computational capabilities of the machine grows, the TDP (thermal design power) and heat generation also grows. The more heat you remove from the single node, the more nodes you can pile up into a rack, and the density of the GPUs will mean that you reduce the total amount of cooling devices needed in your data center.\u201d<\/p><\/blockquote>\n\n\n\n \u201cNeptune\u201d is used for the Lenovo ThinkSystem SR670, similar to the SR675 acquired by the consortium, which is currently leading the GREEN500<\/a> list. <\/p>\n\n\n\n \u201cThis makes it the most efficient single node server on earth,\u201d says Dr. Valerio Rizzo.<\/p><\/blockquote>\n\n\n\n Supercomputers and AI in general consume immense amounts of electricity, so reducing their carbon footprint is essential. This is a task which Lenovo continues to work on.<\/p>\n\n\n\n \u201cWe are working on the form factor and on the thermal envelope in order to host this ever-increasing TDP or power-hungry GPUs,\u201d says Dr. Valerio Rizzo. <\/p><\/blockquote>\n\n\n\n Valerio Rizzo himself has a background as a researcher before he joined Lenovo. He is incredibly excited about the advancements currently happening in his field thanks to AI. <\/p>\n\n\n\n \u201cWe are seeing things that were unimaginable just a few years ago. My background is in neuroscience, and what I’m seeing right now in the community is insane.\u201d<\/p><\/blockquote>\n\n\n\n Dr. Rizzo highlights a paper<\/a> in which researchers used AI to reconstruct a song from the electrical signals recorded in the brain of the participants in the experiment. In this sense, the AI is reconstructing the experience of the participants listening to the song. <\/p>\n\n\n\n On top of this, AI is now reaching the point where it can reconstruct mental images from our brains. <\/p>\n\n\n\n \u201cIn the recent six months, I have seen at least three different papers on how you can decode or reproduce images out of magnetic resonance, so this is pretty exciting to me. I can imagine how this can have a beneficial impact on certain very dramatic conditions such as dementia or on neurological pathology in general,\u201d says Dr. Valerio Rizzo.<\/p><\/blockquote>\n\n\n\n It is examples such as this that underlines the current potential arising out of ensuring easy access to world-leading AI infrastructure for researchers. <\/p>\n\n\n\n \u201cI come from biology and about 99% of biologist are not into IT stuff,\u201d says Dr. Valerio Rizzo. \u201cI was passionate about computer science and IT, so I developed myself as a midway between a biologist and a computer scientist, but this is not common. Jensen Huang (CEO of NVIDIA) has said that with Generative AI and Large Language Models, we are enabling domain experts to leverage IT tools to do a better work and to solve some of the most critical challenges of our time. This is the power of democratization of technology.\u201d<\/p><\/blockquote>\n\n\n\n The democratization of technology is a vision that the DeiC Interactive HPC consortium share with NVIDIA and Lenovo. By making these powerful GPUs available via the user-friendly and interactive HPC platform, UCloud, accessing some of the most complex IT tools in the world has never been easier for the Danish research community. On top of this, Danish researchers will now be able to use this hardware for the most sensitive types of data, e.g. medical records or genomics data, something which has so far not been possible. <\/p>\n\n\n\n It also follows that the investment made by the DeiC Interactive HPC consortium is an investment in the future generation of AI researchers in Denmark. <\/p>\n\n\n\n \u201cIf you think about the variety of users, who will be able to access this type of system at a university \u2013 anything from students to full professors \u2013 you would expect that not all of them are experienced. Some of them will have to go through a learning curve and they will use the system inefficiently. Imagine translating this into a commercial cloud system \u2013 that would be a massive cost without a return of investment in the sense that once these people learn how to leverage this technology, the investment would probably already cover the cost of an on-premises alternative,\u201d says Dr. Valerio Rizzo. <\/p><\/blockquote>\n\n\n\n More and more applications for AI are available on the DeiC Interactive HPC. We just released a new app called \u201cChat UI\u201d which provides a simple interface to powerful AI Large Language Models (LLM), similar to commercially available services like ChatGPT. The app, which is now available to all Danish users of the DeiC Interactive HPC, takes full advantage of the new GPUs to analyze texts and generate answers to complex prompts. The Chat UI app<\/a> can use any of the many open-source LLMs available online, which are now competitive for most tasks with state-of-the-art commercial solutions.<\/p>\n\n\n\n Since January where the 16 H100 GPUs were made available via the DeiC Interactive HPC service, the Novo Nordisk Foundation (NNF) and the Export and Investment Fund of Denmark (EIFO) have announced that in collaboration with NVIDIA, they will establish a national AI innovation center featuring one of the world\u2019s most powerful AI supercomputers. The new AI supercomputer will be equipped with more than 1500 H100 GPUs.<\/p>\n\n\n\n The initiative from NNF and EIFO complements the service available via DeiC Interactive HPC well. The service Gefion will provide is batch access to the H100 GPUs on a much larger scale in a similar way to traditional HPC systems. For interactive use, Danish researchers can benefit from the GPUs at the DeiC Interactive HPC and then use larger machines like Gefion for scaling up their research whenever needed.<\/p>\n\n\n\n We asked Dr. Valerio Rizzo how he thinks the new AI supercomputer might impact the Danish research community. <\/p>\n\n\n\n \u201cIt’s exciting to see how fast research is adopting AI technology nowadays, and some of the most critical problems today might find a solution by applying a certain kind of algorithm and methodology. The array of possibilities within the AI space is huge.\u201d<\/p><\/blockquote>\n\n\n\n We would like to thank Dr. Valerio Rizzo for taking the time to talk with us! If you are interested in reading more examples of how AI is revolutionizing neuroscience, Dr. Rizzo recommends the following papers:<\/p>\n\n\n\n https:\/\/medium.com\/@VRizzo\/non-omnis-moriar-5002e16dc95b<\/a><\/p>\n\n\n\n https:\/\/www.nature.com\/articles\/s41593-023-01304-9<\/a><\/p>\n\n\n\n https:\/\/arxiv.org\/abs\/2209.07162<\/a><\/p>\n\n\n\n https:\/\/journals.plos.org\/plosbiology\/article?id=10.1371\/journal.pbio.3002176<\/a><\/p>\n\n\n\n If you want to know more about Gefion, please see the NNF press release here<\/a>. <\/p>\n\n\n\n You can find a link to an article recently published on our website about director of the SDU eScience Center, Prof. Claudio Pica\u2019s, involvement in the establishment of the new national AI innovation center here<\/a>. <\/p>\n\n\n\n If you are a Danish researcher, and you want to try out the H100 GPUs available via DeiC Interactive HPC, you can find the resources on <\/strong>UCloud<\/strong><\/a> now (select machine type u3-gpu). For further guidance, please contact your local <\/strong>Front Office<\/strong><\/a>. <\/strong><\/p>\n\n\n\n <\/p>\n\n\n\n <\/p>\n","protected":false},"excerpt":{"rendered":" Denmark has marked a significant milestone in computational research with the addition of 16 NVIDIA H100 GPUs to the DeiC Interactive HPC service, and 16 more are expected by the end of the year. The Read more…<\/a><\/p>\n","protected":false},"author":11,"featured_media":7811,"comment_status":"closed","ping_status":"closed","template":"","tags":[],"news-category":[],"_links":{"self":[{"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/news\/7780"}],"collection":[{"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/news"}],"about":[{"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/types\/news"}],"author":[{"embeddable":true,"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/comments?post=7780"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/media\/7811"}],"wp:attachment":[{"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/media?parent=7780"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/tags?post=7780"},{"taxonomy":"news-category","embeddable":true,"href":"http:\/\/escience.sdu.dk\/index.php\/wp-json\/wp\/v2\/news-category?post=7780"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Democratization of technology<\/strong><\/h3>\n\n\n\n
Fostering the next AI generation<\/strong><\/h3>\n\n\n\n
Arrival of Gefion<\/strong><\/h3>\n\n\n\n
More information:<\/strong><\/h3>\n\n\n\n