Read. Understand. Apply.

AI-generated Alerts and Warnings? Part 7 Originally posted on LinkedIn on May 2, 2026 as part of a series on AI-generated alerts and warnings. Test bank – answer key – grading rubric. Now under construction. To be honest, it took me quite a while to understand what my EM1 colleagues were interested in doing with an AI-generated Alert and Warning benchmark. It took months of back and forth before I was assured that I understood what they needed for running tests, including t

AI-generated Alerts and Warnings? Part 6 Originally published on LinkedIn on April 25, 2026 as part of a series on AI generated Alerts and Warnings. I recently had a conversation with a team of researchers who commented on how transparent I’ve been with my articles about building a benchmark for AI-generated alerts and warnings. Being so open about the planning, the process, and the steps we are taking is unexpected, it seems. And yet when EM1 asked me to come on board as a

AI-generated Alerts and Warnings? Part 5 Originally published on LinkedIn on April 18 as part of a series on AI-generated Alerts and Warnings “If we can’t measure it, we can’t improve.” That’s what Tyler Felous, CEO of EM1 said about benchmarks. And agree with this 100%. Using a data-driven approach means measuring success and failure in order to identify ways to improve. But what exactly would a benchmark measure? Last week, I described the ways that medical researchers

AI-Generated Alerts and Warnings? Part 4 Originally published on LinkedIn on April 11, 2026 as part of a series on AI-generated Alerts and Warnings For the past few weeks, I’ve been writing about AI for Alert and Warning and the need for benchmarks that set standards that LLMs should adhere to. I’ve had a few research groups reach out to me about this and I’m happy to see that there is academic and practitioner interest in the project that I have begun with my colleagues. I

AI-generated Alerts and Warnings? Part 3 Originally published on LinkedIn on April 4 as part of a series on AI generated Alerts and Warnings. In a previous article, I introduced the idea of establishing benchmarks for AI Alert and Warnings (see this link). I explained that AI A&W benchmarks can help to set standards that will increase trustworthy use of AI while also ensuring that AI-generated messages align with the state-of-the-art in research and practice. I also introduc

AI -Generated Alerts and Warnings? Part 2 Originally published on LinkedIn on March 28, 2026 as part of a series on AI generated Alert and Warnings. Why are benchmarks valuable to Emergency Managers and other public safety organizations? Well, without them, you don't have a standardized way of determining if something is “good enough.” In medicine, researchers conduct clinical trials to determine the effectiveness of a new drug. In public health, researchers conduct experim

AI Generated Alerts and Warnings Part 1 Originally posted on LinkedIn March 21, 2026 as part of a series on AI Generated Alerts and Warnings I've been thinking for a while about AI generated alerts and warnings. As AI capabilities increase, it's a reasonable thing to consider. After all, I've seen students in my training classes load my published papers into ChatGPT and prompt it to write a message that follows the guidance I've written. And it's no secret that there are some