Hardware Acceleration and Approximation of CNN Computations: Case Study on an Integer Version of LeNet

• DOI: 10.3390/electronics13142709
• Publication Date: 2024-07-11T15:33:22Z
• Authors: Régis Leveugle; Arthur Cogney; Ahmed Baba Gah El...; Tristan Lailler; Maxime Pieau
• Keywords: Artificial Intelligence (AI); 02 engineering and technology; [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE]; Approximate Computing (AC); [INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; 004; PACS 8542; hardware acceleration; LeNet; 0202 electrical engineering, electronic engineering, information engineering; [SPI.NANO]Engineering Sciences [physics]/Micro and nanotechnologies/Microelectronics; CNN

AI systems have an increasing sprawling impact in many application areas. Embedded systems built on AI have strong conflictual implementation constraints, including high computation speed, low power consumption, high energy efficiency, strong robustness and low cost. Neural Networks (NNs) used by these systems are intrinsically partially tolerant to computation disturbances. As a consequence, they are an interesting target for approximate computing seeking reduced resources, lower power consumption and faster computation. Also, the large number of computations required by a single inference makes hardware acceleration almost unavoidable to globally meet the design constraints. The reported study, based on an integer version of LeNet, shows the possible gains when coupling approximation and hardware acceleration. The main conclusions can be leveraged when considering other types of NNs. The first one is that several approximation types that look very similar can exhibit very different trade-offs between accuracy loss and hardware optimizations, so the selected approximation has to be carefully chosen. Also, a strong approximation leading to the best hardware can also lead to the best accuracy. This is the case here when selecting the ApxFA5 adder approximation defined in the literature. Finally, combining hardware acceleration and approximate operators in a coherent manner also increases the global gains.