Hardware & Systems | Kisaco Research

Hardware & Systems

Hardware & Systems

As the adoption of generative and agentic AI accelerates, the challenges for memory as a key enabler of AI/ML processing architectures continue to grow. Balancing the demands for ever greater bandwidth and capacity with the needs of power efficiency, thermal management and increased reliability is increasingly difficult. Continued advances in high performance HBM and GDDR memories, and mainstream DDR and LPDDR memories, remains a strategic industry imperative. In addition, a suite of new technologies including multiplexed modules (MRDIMM), CXL and processing in memory are needed to meet upcoming AI requirements. In this panel, we’ll discuss the evolution of memory technologies and the challenges the industry faces on the road ahead for future AI chips and systems.

 

Memory

Author:

Steven Woo

Fellow and Distinguished Inventor
Rambus

I was drawn to Rambus to focus on cutting edge computing technologies. Throughout my 15+ year career, I’ve helped invent, create and develop means of driving and extending performance in both hardware and software solutions. At Rambus, we are solving challenges that are completely new to the industry and occur as a response to deployments that are highly sophisticated and advanced.

As an inventor, I find myself approaching a challenge like a room filled with 100,000 pieces of a puzzle where it is my job to figure out how they all go together – without knowing what it is supposed to look like in the end. For me, the job of finishing the puzzle is as enjoyable as the actual process of coming up with a new, innovative solution.

For example, RDRAM®, our first mainstream memory architecture, implemented in hundreds of millions of consumer, computing and networking products from leading electronics companies including Cisco, Dell, Hitachi, HP, Intel, etc. We did a lot of novel things that required inventiveness – we pushed the envelope and created state of the art performance without making actual changes to the infrastructure.

I’m excited about the new opportunities as computing is becoming more and more pervasive in our everyday lives. With a world full of data, my job and my fellow inventors’ job will be to stay curious, maintain an inquisitive approach and create solutions that are technologically superior and that seamlessly intertwine with our daily lives.

After an inspiring work day at Rambus, I enjoy spending time with my family, being outdoors, swimming, and reading.

Education

  • Ph.D., Electrical Engineering, Stanford University
  • M.S. Electrical Engineering, Stanford University
  • Master of Engineering, Harvey Mudd College
  • B.S. Engineering, Harvey Mudd College

... read more

Steven Woo

Fellow and Distinguished Inventor
Rambus

I was drawn to Rambus to focus on cutting edge computing technologies. Throughout my 15+ year career, I’ve helped invent, create and develop means of driving and extending performance in both hardware and software solutions. At Rambus, we are solving challenges that are completely new to the industry and occur as a response to deployments that are highly sophisticated and advanced.

As an inventor, I find myself approaching a challenge like a room filled with 100,000 pieces of a puzzle where it is my job to figure out how they all go together – without knowing what it is supposed to look like in the end. For me, the job of finishing the puzzle is as enjoyable as the actual process of coming up with a new, innovative solution.

For example, RDRAM®, our first mainstream memory architecture, implemented in hundreds of millions of consumer, computing and networking products from leading electronics companies including Cisco, Dell, Hitachi, HP, Intel, etc. We did a lot of novel things that required inventiveness – we pushed the envelope and created state of the art performance without making actual changes to the infrastructure.

I’m excited about the new opportunities as computing is becoming more and more pervasive in our everyday lives. With a world full of data, my job and my fellow inventors’ job will be to stay curious, maintain an inquisitive approach and create solutions that are technologically superior and that seamlessly intertwine with our daily lives.

After an inspiring work day at Rambus, I enjoy spending time with my family, being outdoors, swimming, and reading.

Education

  • Ph.D., Electrical Engineering, Stanford University
  • M.S. Electrical Engineering, Stanford University
  • Master of Engineering, Harvey Mudd College
  • B.S. Engineering, Harvey Mudd College

Author:

Taeksang Song

CVP
Samsung Electronics

Taeksang is a Corporate VP at Samsung Electronics where he is leading a team dedicated to pioneering cutting-edge technologies including CAMM, MRDIMM, CXL memory expander, fabric attached memory solution and processing near memory to meet the evolving demands of next-generation data-centric AI architecture. He has 20 years' professional experience in memory and sub-system architecture, interconnect protocols, system-on-chip design and collaborating with CSPs to enable heterogeneous computing infrastructure. Prior to joining Samsung Electronics, he worked at Rambus Inc., Micron Technology and SK hynix in lead architect roles for the emerging memory controllers and systems. 

Taeksang received his Ph.D. degree from KAIST, South Korea, in 2006. Dr. Song has authored and co-authored over 20 technical papers and holds over 50 U.S. patents.

 

... read more

Taeksang Song

CVP
Samsung Electronics

Taeksang is a Corporate VP at Samsung Electronics where he is leading a team dedicated to pioneering cutting-edge technologies including CAMM, MRDIMM, CXL memory expander, fabric attached memory solution and processing near memory to meet the evolving demands of next-generation data-centric AI architecture. He has 20 years' professional experience in memory and sub-system architecture, interconnect protocols, system-on-chip design and collaborating with CSPs to enable heterogeneous computing infrastructure. Prior to joining Samsung Electronics, he worked at Rambus Inc., Micron Technology and SK hynix in lead architect roles for the emerging memory controllers and systems. 

Taeksang received his Ph.D. degree from KAIST, South Korea, in 2006. Dr. Song has authored and co-authored over 20 technical papers and holds over 50 U.S. patents.

 

Systems Optimization
Memory

Author:

Puneet Kumar

CEO
Rivos

Puneet Kumar, CEO and co-founder of Rivos Inc., which he established in May 2021. His impressive career includes leading the ChromeOS Platform Engineering team at Google as a Senior Director, where he oversaw the program's growth to over 100 million users. Puneet's entrepreneurial journey includes co-founding Agnilux (acquired by Google), where he served as VP of Engineering, and PASemi Inc. (acquired by Apple), where he was an Engineering Director in the Platform Architecture team. He also held senior leadership positions at SiByte Inc. (acquired by Broadcom) and was a Systems Researcher at Digital Equipment Corporation's Systems Research Center. Puneet holds a PhD in Computer Science from Carnegie Mellon University.

... read more

Puneet Kumar

CEO
Rivos

Puneet Kumar, CEO and co-founder of Rivos Inc., which he established in May 2021. His impressive career includes leading the ChromeOS Platform Engineering team at Google as a Senior Director, where he oversaw the program's growth to over 100 million users. Puneet's entrepreneurial journey includes co-founding Agnilux (acquired by Google), where he served as VP of Engineering, and PASemi Inc. (acquired by Apple), where he was an Engineering Director in the Platform Architecture team. He also held senior leadership positions at SiByte Inc. (acquired by Broadcom) and was a Systems Researcher at Digital Equipment Corporation's Systems Research Center. Puneet holds a PhD in Computer Science from Carnegie Mellon University.

Systems Optimization

Author:

Haseeb Budhani

Co-Founder & CEO
Rafay Systems

Haseeb Budhani is the CEO and co-founder of Rafay Systems. He previously co-founded and led Soha Systems, which was acquired by Akamai Technologies, where he later served as Vice President of Enterprise Strategy. Haseeb has also held executive and leadership roles at Infineta Systems, NET, and several other technology companies. He holds an MBA from UC Berkeley’s Haas School of Business and a B.S. in Computer Science from the University of Southern California.

... read more

Haseeb Budhani

Co-Founder & CEO
Rafay Systems

Haseeb Budhani is the CEO and co-founder of Rafay Systems. He previously co-founded and led Soha Systems, which was acquired by Akamai Technologies, where he later served as Vice President of Enterprise Strategy. Haseeb has also held executive and leadership roles at Infineta Systems, NET, and several other technology companies. He holds an MBA from UC Berkeley’s Haas School of Business and a B.S. in Computer Science from the University of Southern California.

Systems Optimization

Author:

Apala Guha

Principal AI Architect
Microsoft

Apala Guha is Principal AI Architect at Microsoft. In her current role, she studies AI model architectures and analyzes their behavior and performance on GPUs. With these insights, she co-designs SoCs, systems and compilers for Azure AI. In the past, she was part of AI hardware development at Tenstorrent and Lightmatter. She has a PhD in Computer Engineering from University of Virginia and has held several academic research positions on accelerator compilers.

... read more

Apala Guha

Principal AI Architect
Microsoft

Apala Guha is Principal AI Architect at Microsoft. In her current role, she studies AI model architectures and analyzes their behavior and performance on GPUs. With these insights, she co-designs SoCs, systems and compilers for Azure AI. In the past, she was part of AI hardware development at Tenstorrent and Lightmatter. She has a PhD in Computer Engineering from University of Virginia and has held several academic research positions on accelerator compilers.

Author:

James Kelly

VP Market Intelligence & Innovation
Open Compute Project

James joined the OCP Foundation staff in 2024 as VP Market Intelligence and Innovation, working with technology leaders in the community and augmenting the foundation’s directional strategy, innovation efforts and marketing. His contributions to the OCP proceed from over two decades of experience in technology research, engineering, product management and marketing.

... read more

James Kelly

VP Market Intelligence & Innovation
Open Compute Project

James joined the OCP Foundation staff in 2024 as VP Market Intelligence and Innovation, working with technology leaders in the community and augmenting the foundation’s directional strategy, innovation efforts and marketing. His contributions to the OCP proceed from over two decades of experience in technology research, engineering, product management and marketing.

Author:

Dharmesh Jani

Director of AI Infrastructure Ecosystem & Partnerships
Meta
... read more

Dharmesh Jani

Director of AI Infrastructure Ecosystem & Partnerships
Meta
Storage
Systems Optimization
Moderator

Author:

Rashmi Gopinath

General Partner
BAM Corner Point

Rashmi Gopinath is a General Partner at B Capital Group where she leads the fund’s enterprise software practice in cloud infrastructure, cybersecurity, devops, and AI/ML sectors. She brings over two decades of experience investing and operating in cutting-edge enterprise technologies. She led B Capital’s investments in over 24 companies such as DataRobot, FalconX, Clari, Phenom People, Synack, Innovaccer, Labelbox, Fabric, 6Sense, Highspot, Pendo, Starburst, OwnBackup, Figment, Perimeter81, Zesty, among others.

Rashmi was previously a Managing Director at M12, Microsoft’s venture fund, where she led investments globally in enterprise software and sat on several boards including Synack, Innovaccer, Contrast Security, Frame, UnravelData, Incorta, among others.

Prior to M12, Rashmi was an Investment Director with Intel Capital where she was involved in the firm’s investments in startups including MongoDB (Nasdaq: MDB), ForeScout (Nasdaq: FSCT), Maginatics (acq. by EMC), BlueData (acq. by HPE), among others. Rashmi held operating roles at high-growth startups such as BlueData (acq. by HPE) and Couchbase (Nasdaq: BASE) where she led global business development, product and marketing roles. She began her career in engineering and product roles at Oracle and GE Healthcare. She earned an M.B.A. from Northwestern University, and a B.S. in Electrical Engineering from University of Mumbai in India.

... read more

Rashmi Gopinath

General Partner
BAM Corner Point

Rashmi Gopinath is a General Partner at B Capital Group where she leads the fund’s enterprise software practice in cloud infrastructure, cybersecurity, devops, and AI/ML sectors. She brings over two decades of experience investing and operating in cutting-edge enterprise technologies. She led B Capital’s investments in over 24 companies such as DataRobot, FalconX, Clari, Phenom People, Synack, Innovaccer, Labelbox, Fabric, 6Sense, Highspot, Pendo, Starburst, OwnBackup, Figment, Perimeter81, Zesty, among others.

Rashmi was previously a Managing Director at M12, Microsoft’s venture fund, where she led investments globally in enterprise software and sat on several boards including Synack, Innovaccer, Contrast Security, Frame, UnravelData, Incorta, among others.

Prior to M12, Rashmi was an Investment Director with Intel Capital where she was involved in the firm’s investments in startups including MongoDB (Nasdaq: MDB), ForeScout (Nasdaq: FSCT), Maginatics (acq. by EMC), BlueData (acq. by HPE), among others. Rashmi held operating roles at high-growth startups such as BlueData (acq. by HPE) and Couchbase (Nasdaq: BASE) where she led global business development, product and marketing roles. She began her career in engineering and product roles at Oracle and GE Healthcare. She earned an M.B.A. from Northwestern University, and a B.S. in Electrical Engineering from University of Mumbai in India.

Author:

Sebastien Jean

CTO
Phison
... read more

Sebastien Jean

CTO
Phison
Memory
Generative AI

Author:

Euicheol Lim

Research Fellow, System Architect
SK Hynix

Eui-cheol Lim is a Research Fellow and leader of Solution Advanced Technology team in SK Hynix. He received the B.S. degree and the M.S. degree from Yonsei University, Seoul, Korea, in 1993 and 1995, and the Ph.D. degree from Sungkyunkwan University, suwon, Korea in 2006. Dr.Lim joined SK Hynix in 2016 as a system architect in memory system R&D. Before joining SK Hynix, he had been working as an SoC architect in Samsung Electronics and leading the architecture of most Exynos mobile SoC. His recent interesting points are memory and storage system architecture with new media memory and new memory solution such as CXL memory and Processing in Memory. In particular, he is proposing a new computing architecture based on PIM, which is more efficient and flexible than existing AI accelerators, to process generative AI and LLM (large language Model) that is currently causing a sensation.

... read more

Euicheol Lim

Research Fellow, System Architect
SK Hynix

Eui-cheol Lim is a Research Fellow and leader of Solution Advanced Technology team in SK Hynix. He received the B.S. degree and the M.S. degree from Yonsei University, Seoul, Korea, in 1993 and 1995, and the Ph.D. degree from Sungkyunkwan University, suwon, Korea in 2006. Dr.Lim joined SK Hynix in 2016 as a system architect in memory system R&D. Before joining SK Hynix, he had been working as an SoC architect in Samsung Electronics and leading the architecture of most Exynos mobile SoC. His recent interesting points are memory and storage system architecture with new media memory and new memory solution such as CXL memory and Processing in Memory. In particular, he is proposing a new computing architecture based on PIM, which is more efficient and flexible than existing AI accelerators, to process generative AI and LLM (large language Model) that is currently causing a sensation.

Memory

Author:

Rochan Sankar

Co-Founder & CEO
Enfabrica

Rochan is Founder, President and CEO of Enfabrica. Prior to founding Enfabrica, he was Senior Director and leader of the Data Center Ethernet switch silicon business at Broadcom, where he defined and brought to market multiple generations of Tomahawk/Trident chips and helped build industry-wide ecosystems including 25G Ethernet and disaggregated whitebox networking.

Prior, he held roles in product management, chip architecture, and applications engineering across startup and public semiconductor companies. Rochan holds a B.A.Sc. in Electrical Engineering from the University of Toronto and an MBA from the Wharton School, and has 6 issued patents.

... read more

Rochan Sankar

Co-Founder & CEO
Enfabrica

Rochan is Founder, President and CEO of Enfabrica. Prior to founding Enfabrica, he was Senior Director and leader of the Data Center Ethernet switch silicon business at Broadcom, where he defined and brought to market multiple generations of Tomahawk/Trident chips and helped build industry-wide ecosystems including 25G Ethernet and disaggregated whitebox networking.

Prior, he held roles in product management, chip architecture, and applications engineering across startup and public semiconductor companies. Rochan holds a B.A.Sc. in Electrical Engineering from the University of Toronto and an MBA from the Wharton School, and has 6 issued patents.

Networking
Networking

Author:

Ashwin Gumaste

Principal Architect Azure Network Hardware
Microsoft

Ashwin Gumaste is an AI Architect at Microsoft. He specializes in building AI systems, scaling networks, and model estimation. Before joining Microsoft, Ashwin held key roles at Infinera, Cisco, and Fujitsu, as well as academic positions at IIT Bombay and MIT. Earlier in his career at IIT Bombay, he designed, developed, and successfully commercialized carrier Ethernet switch routers, earning India's highest science and technology honor, the Bhatnagar Prize. A distinguished fellow of the Indian National Academy of Engineering and the National Academy of Sciences in India, Ashwin has made significant contributions to AI and network engineering. He has authored three books, published 215 peer-reviewed papers, and holds 28 granted patents.

 

... read more

Ashwin Gumaste

Principal Architect Azure Network Hardware
Microsoft

Ashwin Gumaste is an AI Architect at Microsoft. He specializes in building AI systems, scaling networks, and model estimation. Before joining Microsoft, Ashwin held key roles at Infinera, Cisco, and Fujitsu, as well as academic positions at IIT Bombay and MIT. Earlier in his career at IIT Bombay, he designed, developed, and successfully commercialized carrier Ethernet switch routers, earning India's highest science and technology honor, the Bhatnagar Prize. A distinguished fellow of the Indian National Academy of Engineering and the National Academy of Sciences in India, Ashwin has made significant contributions to AI and network engineering. He has authored three books, published 215 peer-reviewed papers, and holds 28 granted patents.

 

Author:

Dudy Cohen

VP Product Marketing
Drivenets

Dudy is a qualified manager and technology expert, with more than 30 years of experience in the networking industry. As a senior AI networking expert, he partners closely with the product and engineering teams to shape DriveNets’ vision for AI Networking, helping to deliver the high performance of a proprietary solution with a standards-based Ethernet implementation that provides unrivaled performance. Previously, Dudy served as the VP of Product Marketing at Ceragon. He also served as a Director of Solutions Engineering at Alvarion Ltd. Dudy holds an M.Sc.-E.E degree from the Tel Aviv University.

... read more

Dudy Cohen

VP Product Marketing
Drivenets

Dudy is a qualified manager and technology expert, with more than 30 years of experience in the networking industry. As a senior AI networking expert, he partners closely with the product and engineering teams to shape DriveNets’ vision for AI Networking, helping to deliver the high performance of a proprietary solution with a standards-based Ethernet implementation that provides unrivaled performance. Previously, Dudy served as the VP of Product Marketing at Ceragon. He also served as a Director of Solutions Engineering at Alvarion Ltd. Dudy holds an M.Sc.-E.E degree from the Tel Aviv University.

Author:

Dave Lazovsky

Co-Founder & CEO
Celestial

Dave Lazovsky is the Co-founder and CEO of Celestial AI, the creators of the Photonic FabricTM. Celestial AI, founded in April 2020, has developed the optical interconnectivity technology platform for AI computing.

Prior to founding Celestial AI, Mr. Lazovsky was a Venture Partner at Khosla Ventures. He has 30 years of experience in the semiconductor industry and over two decades of experience building and leading successful start-ups. In 2004 Mr. Lazovsky founded Intermolecular, a semiconductor and clean energy R&D and Intellectual Property licensing company. He served as the company’s Chief Executive Officer, President and as a member of the board of directors from September 2004 through October 2014.

As President and CEO, Mr. Lazovsky led all aspects of the business through its lifecycle from early-stage start-up to public company. Intermolecular (IMI) went public on the NASDAQ in 2011. He currently has over 80 issued and pending U.S. patents.

... read more

Dave Lazovsky

Co-Founder & CEO
Celestial

Dave Lazovsky is the Co-founder and CEO of Celestial AI, the creators of the Photonic FabricTM. Celestial AI, founded in April 2020, has developed the optical interconnectivity technology platform for AI computing.

Prior to founding Celestial AI, Mr. Lazovsky was a Venture Partner at Khosla Ventures. He has 30 years of experience in the semiconductor industry and over two decades of experience building and leading successful start-ups. In 2004 Mr. Lazovsky founded Intermolecular, a semiconductor and clean energy R&D and Intellectual Property licensing company. He served as the company’s Chief Executive Officer, President and as a member of the board of directors from September 2004 through October 2014.

As President and CEO, Mr. Lazovsky led all aspects of the business through its lifecycle from early-stage start-up to public company. Intermolecular (IMI) went public on the NASDAQ in 2011. He currently has over 80 issued and pending U.S. patents.