- Topic Modeling
- Sentiment Analysis and Opinion Mining
- Natural Language Processing Techniques
- Artificial Intelligence in Healthcare and Education
- Evolutionary Algorithms and Applications
- Reinforcement Learning in Robotics
- Computational and Text Analysis Methods
- Domain Adaptation and Few-Shot Learning
- Explainable Artificial Intelligence (XAI)
- COVID-19 diagnosis using AI
- Stock Market Forecasting Methods
- Advanced Neural Network Applications
- Machine Learning in Healthcare
Wrocław University of Science and Technology
2023
AGH University of Krakow
2023
OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized approach in artificial intelligence to human-model interaction. The first contact with chatbot reveals its ability provide detailed precise answers various areas. Several publications on ChatGPT evaluation test effectiveness well-known natural language processing (NLP) tasks. However, existing studies are mostly non-automated tested a very limited scale. In this work, we examined ChatGPT's...
Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chung, Leon Derczynski, Xingjian Du, Matteo Grella, Kranthi Gv, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartłomiej Koptyra, Hayden Lau, Jiaju Lin, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Guangyu Song, Xiangru Tang, Johan Wind, Stanisław Woźniak, Zhenyuan Zhang, Qinghua Zhou, Jian Zhu, Rui-Jie Zhu. Findings of the Association for...
OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized approach in artificial intelligence to human-model interaction. The first contact with chatbot reveals its ability provide detailed precise answers various areas. There are several publications on ChatGPT evaluation, testing effectiveness well-known natural language processing (NLP) tasks. However, existing studies mostly non-automated tested a very limited scale. In this work, we examined ChatGPT's...
OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized approach in artificial intelligence to human-model interaction. Several publications on ChatGPT evaluation test its effectiveness well-known natural language processing (NLP) tasks. However, existing studies are mostly non-automated tested a very limited scale. In this work, we examined ChatGPT's capabilities 25 diverse analytical NLP tasks, most of them subjective even humans, such as sentiment...
Large language models (LLMs) have significantly advanced Natural Language Processing (NLP) tasks in recent years. However, their universal nature poses limitations scenarios requiring personalized responses, such as recommendation systems and chatbots. This paper investigates methods to personalize LLMs, comparing fine-tuning zero-shot reasoning approaches on subjective tasks. Results demonstrate that improves model compared non-personalized models. Experiments datasets for emotion...
Transformers have revolutionized almost all natural language processing (NLP) tasks but suffer from memory and computational complexity that scales quadratically with sequence length. In contrast, recurrent neural networks (RNNs) exhibit linear scaling in requirements struggle to match the same performance as due limitations parallelization scalability. We propose a novel model architecture, Receptance Weighted Key Value (RWKV), combines efficient parallelizable training of transformers...
We present Eagle (RWKV-5) and Finch (RWKV-6), sequence models improving upon the RWKV (RWKV-4) architecture. Our architectural design advancements include multi-headed matrix-valued states a dynamic recurrence mechanism that improve expressivity while maintaining inference efficiency characteristics of RNNs. introduce new multilingual corpus with 1.12 trillion tokens fast tokenizer based on greedy matching for enhanced multilinguality. trained four models, ranging from 0.46 to 7.5 billion...