Cover art for The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Nidhi Rastogi

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

CTIBench: Evaluating LLMs in Cyber Threat Intelligence with Nidhi Rastogi

Published
April 30, 2025
Duration
56:18
Summary source
description
Last updated
Jun 7, 2026

Discusses ai.

Summary

Today, we're joined by Nidhi Rastogi, assistant professor at Rochester Institute of Technology to discuss Cyber Threat Intelligence (CTI), focusing on her recent project CTIBench—a benchmark for evaluating LLMs on real-world CTI tasks. Nidhi explains the evolution of AI in cybersecurity, from rule-based systems to LLMs that accelerate analysis by providin…

Intelligent report

Sign in to read teasers, or upgrade to Research Pro to commission a new dossier for this episode. Learn more →

Show notes

Today, we're joined by Nidhi Rastogi, assistant professor at Rochester Institute of Technology to discuss Cyber Threat Intelligence (CTI), focusing on her recent project CTIBench—a benchmark for evaluating LLMs on real-world CTI tasks. Nidhi explains the evolution of AI in cybersecurity, from rule-based systems to LLMs that accelerate analysis by providing critical context for threat detection and defense. We dig into the advantages and challenges of using LLMs in CTI, how techniques like Retrie

Themes

  • ai
Nidhi Rastogi: CTIBench: Evaluating LLMs in Cyber Threat Intelligence with Nidhi Rastogi | The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) | Vagelintel