Rethinking Software Engineering in the Era of Foundation Models: A Curated Catalogue of Challenges in the Development of Trustworthy FMware

• DOI: 10.48550/arxiv.2402.15943
• Publication Date: 2024-02-24
• Authors: Ahmed E. Hassan; Dayi Lin; Gopi Krishnan Raj...; Keheliya Gallaba; Filipe R. Cogo; Boyuan Chen; Haoxiang Zhang; Kishanthan Thanga...; Gustavo A. Oliva; Jiahuei Lin; Wali Mohammad Abd...; Zhen Ming Jiang
• Keywords: Trustworthiness; Foundation (evidence)

Foundation models (FMs), such as Large Language Models (LLMs), have revolutionized software development by enabling new use cases and business models. We refer to built using FMs FMware. The unique properties of FMware (e.g., prompts, agents, the need for orchestration), coupled with intrinsic limitations hallucination) lead a completely set engineering challenges. Based on our industrial experience, we identified 10 key SE4FMware challenges that caused enterprise be unproductive, costly, risky. In this paper, discuss these in detail state path innovation envision. Next, present FMArts, which is long-term effort towards creating cradle-to-grave platform trustworthy Finally, (i) show how FMArts enabled us design develop complex large customer timely manner (ii) lessons learned doing so. hope disclosure aforementioned associated efforts tackle them will not only raise awareness but also promote deeper further discussions, knowledge sharing, innovative solutions across discipline.