TVCG Invited Partnership Presentations

Save It for the “Hot” Day: An LLM-Empowered Visual Analytics System for Heat Risk Management

Haobo Li (Hong Kong University of Science and Technology), Wong Kam-Kwai (Hong Kong University of Science and Technology), Yan Luo (Hong Kong University of Science and Technology), Juntong Chen (School of Computer Science and Technology, East China Normal University (ECNU)), Chengzhong Liu (Hong Kong University of Science and Technology), Yaxuan Zhang (Hong Kong University of Science and Technology), Alexis Kai Hon Lau (Hong Kong University of Science and Technology), Huamin Qu (Hong Kong University of Science and Technology), Dongyu Liu (University of California at Davis)

Heat risk managementclimate changenumerical modelnews datalarge language modelvisual analytics

Jump to Discussion

Presentation

Session
Data really is everywhere
Time
Tuesday, Nov 10, 15:48 – 16:00 (US/Eastern) · session 15:00 – 16:30
Room
Hall Essex north

Abstract

The escalating frequency and intensity of heat-related climate events, particularly heatwaves, emphasize the pressing need for advanced heat risk management strategies. Current approaches, primarily relying on numerical models, face challenges in spatial-temporal resolution and in capturing the dynamic interplay of environmental, social, and behavioral factors affecting heat risks. This has led to difficulties in translating risk assessments into effective mitigation actions. Recognizing these problems, we introduce a novel approach leveraging the burgeoning capabilities of Large Language Models (LLMs) to extract rich and contextual insights from news reports. We hence propose an LLM-empowered visual analytics system, Savior, that integrates the precise, data-driven insights of numerical models with nuanced news report information. This hybrid approach enables a more comprehensive assessment of heat risks and better identification, assessment, and mitigation of heat-related threats. The system incorporates novel visualization designs, such as ``thermoglyph'' and news glyph, enhancing intuitive understanding and analysis of heat risks. The integration of LLM-based techniques also enables advanced information retrieval and semantic knowledge extraction that can be guided by experts' analytics needs. We conducted an experiment on information extraction, a case study on the 2022 China Heatwave, and an expert survey & interview collaborated with six domain experts, demonstrating the usefulness of our system in providing in-depth and actionable insights for heat risk management.