Samuel Perl
Software Engineering Institute
Samuel J. Perl is a member of the CSIRT (Computer Security Incident Response Team) development team within the CERT® Division at the Software Engineering Institute (SEI), a unit of Carnegie Mellon University in Pittsburgh, PA. He has been with CERT since 2011 and has worked in a variety of areas, including insider threat, vulnerability assessment, security incident data analysis, and incident management team development. Prior to joining CERT, Perl gained over 10 years of industry experience working with client organizations to manage their most challenging IT security risk issues. Perl holds a Master of Science degree in Information Security Management and a Bachelor of Science in Information Systems from Carnegie Mellon University.
Evaluating Large Language Models for Cybersecurity Tasks: Challenges and Best Practices
• Podcast
By Jeff Gennari , Samuel Perl
OpenAI Collaboration Yields 14 Recommendations for Evaluating LLMs for Cybersecurity
• Blog Post
By Jeff Gennari , Shing-hon Lau , Samuel Perl
Considerations for Evaluating Large Language Models for Cybersecurity Tasks
• White Paper
By Jeff Gennari , Shing-hon Lau , Samuel Perl , Joel Parish (OpenAI) , Girish Sastry (OpenAI)
Cyber Intelligence Tradecraft Report: The State of Cyber Intelligence Practices in the United States (Study Report and Implementation Guides)
• Collection
By Jared Ettinger , April Galyardt , Ritwik Gupta , Daniel DeCapria , Eliezer Kanal , Dan J. Klinedinst , Deana Shick , Samuel Perl , Geoffrey B. Dobson , Geoff Sanders , Dan Costa , Larry Rogers , Hollen Barmer , Jennifer Kane , Heather Evans , Erica Brandon , Andrew O. Mellinger
Considerations for Evaluating Large Language Models for Cybersecurity Tasks
• White Paper
By Jeff Gennari , Shing-hon Lau , Samuel Perl , Joel Parish (OpenAI) , Girish Sastry (OpenAI)
Incident Management Capability Assessment
• SEI Report
By Audrey J. Dorofee , Robin Ruefle , Mark Zajicek , David McIntire , Samuel Perl , Christopher J. Alberts , Carly L. Huth , Pennie Walters
An Insider Threat Indicator Ontology
• SEI Report
By Dan Costa , Michael J. Albrethsen , Matthew L. Collins , Samuel Perl , George Silowash , Derrick Spooner
OpenAI Collaboration Yields 14 Recommendations for Evaluating LLMs for Cybersecurity
• Blog Post
By Jeff Gennari , Shing-hon Lau , Samuel Perl
New SEI CERT Tool Extracts Artifacts from Free Text for Incident Report Analysis
• Blog Post
By Matthew Sisk , Samuel Perl