Evaluating the performance and robustness of LLMs in materials science Q&A and property predictions

• DOI: 10.1039/d5dd00090d
• Publication Date: 2025-05-28T09:31:20Z
• Authors: Hongchen Wang; Kangming Li; Scott Ramsay; Yao Fehlis; Edward Kim; Jason Hattrick-Si...
• Keywords: Robustness

We evaluate LLM performance and robustness for materials science Q&A property prediction. Prompt sensitivity mode collapse reveal reliability concerns, providing informed skepticism guiding more cautious adoption in scientific research.