A5020046654- Software Engineering Research
- Green IT and Sustainability
- Software Engineering Techniques and Practices
- Topic Modeling
- Age of Information Optimization
University of Washington
2024
Large language models (LLMs) have shown remarkable abilities to generate code. However, their ability develop software for physical computing and embedded systems, which requires cross-domain hardware knowledge, has not been thoroughly studied. We observe through our experiments a 15-user pilot study that even when LLMs fail produce working code, they can helpful reasoning about design tasks, as well specific debugging suggestions both novice expert developers. These results highlight the...
Large language models (LLMs) have shown remarkable abilities to generate code, however their ability develop software for embedded systems, which requires cross-domain knowledge of hardware and has not been studied. In this paper we an extensible, open source hardware-in-the-loop framework systematically evaluate leading LLMs (GPT-3.5, GPT-4, PaLM 2) assess capabilities limitations system development. We observe through our study that even when these tools fail produce working they...