Samsung's HBM-PIM to address memory/power challenges for HPC, AI computing

Samsung's HBM-PIM integrates into existing systems and does not require any hardware or software changes. The new architecture, when applied to the company's existing HBM2 Aquabolt solution, is claimed to deliver over twice the system performance whilst reducing energy consumption by over 70 percent.

Devdiscourse News Desk | Seoul | Updated: 17-02-2021 10:04 IST | Created: 17-02-2021 09:20 IST
Samsung's HBM-PIM to address memory/power challenges for HPC, AI computing
Samsung's HBM-PIM solution Image Credit: Samsung

Samsung has developed High Bandwidth Memory (HBM), the industry's first processing-in-memory (PIM) solution with artificial intelligence (AI) processing power, the South Korean technology giant announced on Wednesday.

The HBM-PIM solution will accelerate large-scale processing in data centres, high performance computing (HPC) systems and AI-enabled mobile applications.

While most of today's computing systems are based on the von Neumann architecture, which uses separate processor and memory units to carry out millions of intricate data processing tasks, the news solution brings processing power directly to where the data is stored, enabling parallel processing and minimizing data movement. This is achieved by placing a DRAM-optimized AI engine inside each memory bank, a storage sub-unit.

Samsung's HBM-PIM integrates into existing systems and does not require any hardware or software changes. The new architecture, when applied to the company's existing HBM2 Aquabolt solution, is claimed to deliver over twice the system performance whilst reducing energy consumption by over 70 percent.

"Our groundbreaking HBM-PIM is the industry's first programmable PIM solution tailored for diverse AI-driven workloads such as HPC, training and inference. We plan to build upon this breakthrough by further collaborating with AI solution providers for even more advanced PIM-powered applications," said Kwangil Park, senior vice president of Memory Product Planning at Samsung Electronics.

Samsung's paper on the HBM-PIM will be presented at the 2021 edition of the International Solid-State Circuits Conference (ISSCC), an annual conference for the presentation of advances in solid-state circuits and systems-on-a-chip, held virtually through February 22.


TRENDING

OPINION / BLOG / INTERVIEW

East African women traders: 'Celebrating the past, planning for the future'

COVID-19 has hit women disproportionately hard across East Africa, especially those working in the informal sector. Lessons must be learnt to prevent this from happening again....

Viral variants and vaccine nationalism pose two-pronged threat to Covid victory

... ...

Tracking Fintech during COVID-19: Harnessing power of technology

Its abundantly clear now that as fintech cements its place in the financial sector, accelerated further by the COVID-19 pandemic, it could open the sector to new possibilities by harnessing the power of technology to deliver financial ...

Tectonic turns: How technology shaped healthcare over the decades

Tracing an episodic evolution, with technology at the interface of human and his health....

Videos

Latest News

British regulator says AstraZeneca COVID shot clots rise to 168

Britains medicines regulator on Thursday said there had been 168 major blood clots following a dose of AstraZenecas COVID-19 vaccine, a rate of 7.9 clots per million doses, a jump in incidence from the previous weeks figure. This was up fro...

Himachal Pradesh govt to provide free COVID vaccine to people between 18 and 44 years

The Himachal Pradesh government on Thursday said it will provide COVID vaccine free of cost to people between 18 and 44 years from May 1. Following a meeting of the state cabinet chaired by Chief Minister Jai Ram Thakur, Parliamentary Affai...

Researchers find how climate change is driving some to skip having kids

A new study drove by the University of Arizona found that overconsumption, overpopulation and uncertainty about the future are among the top concerns of those who say climate change is affecting their reproductive decision-making. When deci...

Rapper DMX's public memorial at Barclays Center to stream live on YouTube

A public memorial event for the rapper DMX is scheduled to be held at the Barclays Center on April 24 that will be streamed live on YouTube, giving his fans a chance to honour him virtually. American rapper DMX, who passed away on Friday lo...

Give Feedback