Scale-out architecture is the future for HPC
Nijmegen, November 24 2015 – The clear trend in High Performance Computing is to scale out rather than to scale up. The IT service provider and HPC specialist transtec has responded with different variables such as CPU, network or storage.
To scale horizontally (or scale out) is a key trend in the HPC environment as it accelerates parallel processing. This not only applies to processor and network technology but also storage with the deployment of parallel file systems.
In terms of the CPU, this scale-out trend is seen in the deployment of ever more cores per CPU while the clock rate has pretty much stayed the same. In other words, to accelerate performance, the focus is on multi-core processor technology rather than the techni-cally complex task of increasing the clock rate.
transtec believes that, besides Intel CPUs, ARM processors are also the one to watch as they deliver extremely high scalability and parallel computing. “Intel will not be the only key player defining the future of the processor environment. ARM CPUs are also increas-ingly demanding our attention”, explains Dr. Oliver Tennert, Director of HPC Solutions at transtec in Reutlingen, South-West Germany. “Since the launch of the ARMv8 generation with its 64-bit architec-ture, its development has been clearly noticeable in the academic sector. Energy efficiency and value for money are the key factors in favour of ARM processors and will definitely promote their deploy-ment in commercial applications in all research and development areas as well as in private companies.”
The scale-out trend is also being witnessed in storage by the use of parallel file systems. Multi-terabyte data volumes are now a regular occurrence in high performance computing. The challenge is less about data storage and more about the transfer of large data volumes, in other words to retain the performance when the jobflow involves “copying data backwards and forwards” as well as the total job runtime. In response to these challenges, parallel file systems have long since become a favourite in the storage industry. They enable users to effectively save input or result data as well as temporary data during the job runtime.
There are currently four parallel file system solutions available for HPC storage systems: Commercial solutions from Panasas or IBM as well as open-source solutions such as Lustre or BeeGFS from the Fraunhofer Institute for Industrial Mathematics ITWM in Kaiserslau-tern.
Scale-out architectures are also dominating the network industry. Today’s standard for complex HPC applications is InfiniBand. The key benefits of this network interconnectivity solution are its high bandwidth and low latency which enable the high performance of the HPC applications. InfiniBand is also deployed to scale clusters as the point-to-point latency is constantly below 1.2 microseconds despite the growing number of nodes and cores.
“Although InfiniBand currently dominates the market, this popularity is set to decline next year”, predicts Dr. Tennert. “The reason is Intel’s launch of Omni-Path. The announced port-to-port latency between 100 and 110 nanoseconds will record better results than by using InfiniBandEDR to leverage scalability and connect larger networks.”
HPC is one of transtec’s key business areas. HPC systems are becoming an increasingly more attractive option for companies as besides processing intensive computing simulations, they are also used to analyse large data volumes – the keyword being big data. These factors are influencing how companies can stay and make themselves more competitive”, believes Dr. Tennert. “It is not always easy for companies to find the right HPC solution for their needs. This is where transtec can help enterprises by providing extensive support and years of HPC experience in applications from various sectors.”
The IT service provider ttec Computer B.V. offers unique IT expertise based on the combination of its manufacturer, system house and High Performance Computing (HPC) competence. ttec delivers client-specific solutions, a broad service portfolio and fulfils the highest security standards with its Cloud. Customers include public institutions as well as companies from different branches. The market-listed company has offices in Germany, France, Great Britain and Switzerland and generated a revenue of 44,6 million Euros in 2015. www.ttec.nl