- Advanced Image and Video Retrieval Techniques
- Video Analysis and Summarization
- Multimodal Machine Learning Applications
- Domain Adaptation and Few-Shot Learning
- Image Retrieval and Classification Techniques
- Computer Graphics and Visualization Techniques
- Topic Modeling
- 3D Shape Modeling and Analysis
- Advanced Vision and Imaging
- Virtual Reality Applications and Impacts
- Human Motion and Animation
- Multiple Sclerosis Research Studies
- Geographic Information Systems Studies
- Skin Protection and Aging
- Advanced Optical Imaging Technologies
- Olfactory and Sensory Function Studies
- Visual Attention and Saliency Detection
- Simulation and Modeling Applications
- Cerebrospinal fluid and hydrocephalus
- Hand Gesture Recognition Systems
- Land Use and Ecosystem Services
- 3D Surveying and Cultural Heritage
- Interactive and Immersive Displays
- Museums and Cultural Heritage
- Dermatology and Skin Diseases
University of Basel
2020-2024
Institute of Dermatology
2021
TU Dortmund University
2018
University of California System
1980
The choroid plexus has been shown to play a crucial role in CNS inflammation. Previous studies found larger multiple sclerosis (MS) compared with healthy controls. However, it is not clear whether the similarly involved MS and neuromyelitis optica spectrum disorder (NMOSD). Thus, aim of this study was compare volume NMOSD.In retrospective, cross-sectional study, patients were included by convenience sampling from 4 international centers. lateral ventricles segmented fully automatically on...
This paper conducts a thorough examination of the 12th Video Browser Showdown (VBS) competition, which is well-established international benchmarking campaign for interactive video search systems. The annual VBS competition has witnessed steep rise in popularity multimodal embedding-based approaches retrieval. majority thirteen systems participating 2023 utilized CLIP-based cross-modal model, allowing specification free-form text queries to visual content. shared emphasis on joint embedding...
The Lifelog Search Challenge (LSC) is an interactive benchmarking evaluation workshop for lifelog retrieval systems. challenge was first organised in 2018 aiming to find the system that can quickly retrieve relevant images a given semantic query. This paper provides analysis of performance all 17 systems participating 4th LSC held at 2021 Annual ACM International Conference on Multimedia Retrieval (ICMR). LSC'21 largest effort comparing different approaches seen thus far. Findings from...
The Lifelog Search Challenge (LSC) is an annual benchmarking competition for interactive multimedia retrieval systems, where participating systems compete in finding events based on textual descriptions containing hints about structured, semi-structured, and/or unstructured data. In this paper, we present the system vitrivr, a long-time participant to LSC, with focus new functionality. Specifically, introduce image stabilisation module which added prior feature extraction reduce degradation...
The multimodal nature of lifelog data collections poses unique challenges for multimedia management and retrieval systems. Lifelog Search Challenge (LSC) offers an annual evaluation platform such interactive They compete against one another in finding items interest within a set time frame.
The multimodal nature of lifelog data poses unique challenges for analysis, indexing and interactive retrieval. To address these challenges, the Lifelog Search Challenge (LSC) is an annual evaluation campaign allowing retrieval systems to explore new ideas measure their performance against each other.
Personal lifelog data collections are becoming more common as a memory aid, well for analytical tasks, such health and fitness analysis. Due to the multimodal personal nature of data, interactive multimedia retrieval approaches required facilitate flexible iterative query formulation result exploration In recent years, novel user interface modalities have emerged, that allow new ways users interact with system. Virtual reality, one modality, provides advantages challenges in comparison...
In the research of video retrieval systems, comparative assessments during dedicated competitions provide priceless insights into performance individual systems. The scope and depth such evaluations are unfortunately hard to improve, due limitations by set-up costs, logistics, organization complexity large events. We show that this easily impairs statistical significance collected results, reproducibility competition outcomes. article, we present a methodology for remote content-based...
Interactive retrieval with user-friendly and performant interfaces remains a necessity for video retrieval, even in light of significant gains performance through multi-modal encoders. In recent years, novel interaction modalities such as virtual reality (VR) augmented (AR) have gained popularity, but the best way to adapt paradigms from traditional interfaces, especially result browsing interaction, an open research question. this paper, we compare two controlled setting gain insight into...
As Virtual Reality (VR) devices become more affordable and experience a widespread adoption, applications for this immersive technology diverse, increasingly also including text-based uses, such as messaging text processing. While input methods VR have existed long time, none reached the ease-of-use or performance of conventional, physical keyboards. In absence keyboards, touch-screen adopted word-gesture that allow users to through smooth motions. work, we introduce keyboard uses direct...
This tutorial provides an overview of multimedia retrieval in the context eXtended Reality (XR), including using virtual and augmented/mixed reality as a user interface for retrieval, well search tasks addressing content needs creation XR experiences. It will discuss opportunities limitations XR-based search, evaluation systems, demonstration selected research open challenges.
Virtual reality (VR) applications are increasingly permeating our lives. The immersion provided by VR enables novel interactions with data that would be impossible in conventional environments. Especially regarding multimedia data, could overcome existing limitations when browsing videos to find specific scenes. This paper introduces a virtual drawer, tailored environments, enable ways interact videos. A within-subjects design experiment (N=24) was conducted evaluate the drawer on user...
Modern wearables and smart devices make it easier than ever to collect a detailed, digital record of biometric as well visual aural information. Reasons such lifelog range from health applications vacation documentation. With the large quantities data that can be collected in very short periods time, remains challenging problem find specific events answer questions based on lifelogs. In order support multimedia analytics within collections sizes, interactive methods must developed take...
We reflect on some of the preliminary findings Participatory Knowledge Practices in Analogue and Digital Image Archives (PIA) research project around annotations photographic archives from Swiss Society for Folklore Studies (SSFS) as knowledge practices, underlying technological decisions, their impact. The aim is not only to seek more information but find new approaches understanding way which people’s memory relate collective, public form archival ultimately how users figure shape digital...