search
menu
icon-carat-right
cmu-wordmark
✕
About
Leadership
Divisions
Work with Us
Collaboration with CMU
History of Innovation at the SEI
Our Work
Agile
Artificial Intelligence Engineering
Cyber Workforce Development
Cybersecurity Center Development
Cybersecurity Engineering
DevSecOps
Enterprise Risk and Resilience Management
All Topics
All Projects
Publications
Annual Reviews
Blog
Digital Library
Podcast Series
Software and Tools
Technical Papers
Vulnerability Notes Database
Webcasts
News and Events
News
Events
SEI Bulletin
Education and Outreach
Courses
Credentials
Curricula
License SEI Materials
Careers
Job Openings
Diversity, Equity and Inclusion
Internship Opportunities
Working at the SEI
Carnegie Mellon University
Software Engineering Institute
About
Leadership
Divisions
Work with Us
Collaboration with CMU
History of Innovation at the SEI
Our Work
Agile
Artificial Intelligence Engineering
Cloud Computing
Cyber Workforce Development
Cybersecurity Center Development
Cybersecurity Engineering
DevSecOps
All Topics
All Projects
Publications
Annual Reviews
Blog
Digital Library
Podcast Series
Software and Tools
Technical Papers
Vulnerability Notes Database
Webcasts Series
News and Events
News
Events
SEI Bulletin
Education and Outreach
Courses
Credentials
Curricula
License SEI Materials
Careers
Job Openings
Diversity, Equity, and Inclusion
Internship Opportunities
Home
Publications
Authors
Shing-hon Lau
Shing-hon Lau
Software Engineering Institute
All
Tech Publications
Blog Posts
Videos
OpenAI Collaboration Yields 14 Recommendations for Evaluating LLMs for Cybersecurity
February 21, 2024
•
Blog Post
By
Jeff Gennari
,
Shing-hon Lau
,
Samuel J. Perl
Considerations for Evaluating Large Language Models for Cybersecurity Tasks
February 20, 2024
•
White Paper
By
Jeff Gennari
,
Shing-hon Lau
,
Samuel J. Perl
,
Joel Parish (OpenAI)
,
Girish Sastry (OpenAI)
Ask Us Anything: Generative AI Edition
September 25, 2023
•
Webcast
By
Douglas Schmidt (Vanderbilt University)
,
John E. Robert
,
Rachel Dzombak
,
Jasmine Ratchford
,
Matthew Walsh
,
Shing-hon Lau
AI Evaluation Methodology for Defensive Cyber Operator Tools
November 11, 2022
•
Presentation
By
Shing-hon Lau
Preview of AI Evaluation Methodology for Defensive Cyber Operator Tools
November 7, 2022
•
Video
By
Shing-hon Lau
More from Shing-hon Lau
Considerations for Evaluating Large Language Models for Cybersecurity Tasks
February 20, 2024
•
White Paper
By
Jeff Gennari
,
Shing-hon Lau
,
Samuel J. Perl
,
Joel Parish (OpenAI)
,
Girish Sastry (OpenAI)
More from Shing-hon Lau
OpenAI Collaboration Yields 14 Recommendations for Evaluating LLMs for Cybersecurity
February 21, 2024
•
Blog Post
By
Jeff Gennari
,
Shing-hon Lau
,
Samuel J. Perl
How Do You Trust AI Cybersecurity Devices?
January 24, 2022
•
Blog Post
By
Grant Deffenbaugh
,
Shing-hon Lau
Measuring Resilience in Artificial Intelligence and Machine Learning Systems
December 12, 2019
•
Blog Post
By
Alexander Petrilli
,
Shing-hon Lau
More from Shing-hon Lau
Ask Us Anything: Generative AI Edition
September 25, 2023
•
Webcast
By
Douglas Schmidt (Vanderbilt University)
,
John E. Robert
,
Rachel Dzombak
,
Jasmine Ratchford
,
Matthew Walsh
,
Shing-hon Lau
Preview of AI Evaluation Methodology for Defensive Cyber Operator Tools
November 7, 2022
•
Video
By
Shing-hon Lau
AIDE: Artificial Intelligence Defense Evaluation
December 15, 2020
•
Video
By
Shing-hon Lau
More from Shing-hon Lau
Send a Message
