Aislex: Approximate Individual Sample Learning Entropy with Jax

• DOI: 10.2139/ssrn.4866622
• Publication Date: 2024-06-15T15:22:37Z
• Authors: Ondrej Budik; Milan Novak; Florian Sobieczky; Ivo Bukovsky
• Keywords: Learning entropy; QA76.75-76.765; Machine learning weight evaluation; Anomaly detection; Computer software; JAX

We present AISLEX, an online anomaly detection module based on the Learning Entropy algorithm, a novel machine learning-based information measure that quantifies the learning effort of neural networks. AISLEX detects anomalous data samples when the learning entropy value is high. The module is designed to be readily usable, with both NumPy and JAX backends, making it suitable for various application fields. The NumPy backend is optimized for devices running Python3, prioritizing limited memory and CPU usage. In contrast, the JAX backend is optimized for fast execution on CPUs, GPUs, and TPUs but requires more computational resources. AISLEX also provides extensive implementation examples in Jupyter notebooks, utilizing in-parameter-linear-nonlinear neural architectures selected for their low data requirements, computational simplicity, convergence analyzability, and dynamical stability.