search menu icon-carat-right cmu-wordmark

The Messy Middle of Large Language Models

April 2023 Podcast
Jay Palat, Rachel Dzombak

Jay Palat and Rachel Dzombak discuss the current landscape of large language models (LLMs) and how to leverage tools built on top of LLMs, such as ChatGPT and Copilot.

Publisher:

Software Engineering Institute

DOI (Digital Object Identifier):
10.58012/hwce-tn76

Listen

Watch

Abstract

The recent growth of applications that leverage large language models, including ChatGPT and Copilot, has spurred reactions ranging from fear and uncertainty to adoration and lofty expectations. In this SEI podcast, Jay Palat, senior engineer and technical director of AI for mission, and Dr. Rachel Dzombak, senior advisor to the director of the SEI’s AI Division, discuss the current landscape of large language models (LLMs), common misconceptions about LLMs, how to leverage tools built on top of LLMs, and the need for critical thinking around both the outputs of the tools and the trends in their use.

About the Speaker

Jay Palat

Jay Palat

Jay Palat is a software engineer at the SEI Emerging Technology Center and leads engineering efforts for customers and research projects. Before coming to SEI, Palat ran his own consulting company, ...

Jay Palat is a software engineer at the SEI Emerging Technology Center and leads engineering efforts for customers and research projects. Before coming to SEI, Palat ran his own consulting company, accelerating engineering teams with a mix of management, best practices, and product engineering. Palat was the Director of Engineering and Senior Director of Data Engineering at Rhiza (now Nielsen) and has successfully led teams to deliver products and services in retail, healthcare, finance, and analytics at companies ranging from IBM to Series A startups.

Read more
Rachel Dzombak

Rachel Dzombak

Dr. Rachel Dzombak is the digital transformation lead within the Emerging Technology Center at Carnegie Mellon University’s Software Engineering Institute. In this role, Dzombak works with organizations ...

Dr. Rachel Dzombak is the digital transformation lead within the Emerging Technology Center at Carnegie Mellon University’s Software Engineering Institute. In this role, Dzombak works with organizations to realize the capability of artificial intelligence (AI) for mission outcomes. Additionally, Dzombak helps lead efforts around the growth of the AI engineering discipline, a field focused on developing tools, systems, and processes to enable the application of AI in real-world contexts. Prior to joining CMU, Dzombak was an Innovation Fellow and professional faculty member at the University of California, Berkeley, where her research focused on processes for design, innovation, and systems thinking and the development of tools to support teaming with diversity. Dzombak has published multiple papers on circular economy, design education, and impact assessment and holds doctoral and master’s degrees in Civil and Environmental Engineering from the University of California, Berkeley as well as a bachelor of science degree in Bioengineering from The Pennsylvania State University.
 

Read more