While the integration of IoT devices in virtual spaces is becoming increasingly common, technical barriers to controlling custom multi-user Virtual Reality (VR) environments remain high, particularly limiting new applications educational and prototyping settings. We propose MetaGadget, a framework for connecting commercial metaverse platforms that implements device control through HTTP-based event triggers without requiring persistent client connections. Through two workshops focused on...

Visual guidance (VG) plays an essential role in directing user attention virtual reality (VR) and augmented (AR) environments. However, traditional approaches rely on explicit visual annotations, which often compromise clarity increase cognitive load. To address this issue, we propose unobtrusive VG technique based color vibration, a phenomenon rapidly alternating colors at frequencies above 25 Hz are perceived as single intermediate color. Our work explores perceptual state that exists...

Untethered control of soft-bodied robots is attractive for interactions in a variety unstructured and dynamic environments. However, soft robotics systems are currently limited terms wireless, selective, scalable multiple actuators. Therefore, we propose method to wirelessly drive actuators by laser projection. A small amount low-boiling-point liquid inside planar thin pouch can be heated evaporated inflate the whole body. Laser projection enables both wireless energy supply selection target...

Wearable haptic displays can provide information while allowing for free body movement. Among these displays, pneumatic have the advantages of flexibility and lightweight; however, they require bulky air tubes a heavy compressor. To solve this problem, we propose wearable display that uses liquid-to-gas phase change actuator Peltier device as way to reduce size entire system. A low-boiling-point liquid is encapsulated in flexible bladder actuator, vaporization liquid, which induces inflation...

This paper presents a shadowless projection mapping system for interactive applications in which target surface is frequently occluded from projector with user's body. We propose delay-free optical solution this critical problem. Specifically, as the primary technical contribution, we apply large format retrotransmissive plate to project images onto wide viewing angles. also tackle issues unique proposed principle. First, optics inevitably suffer stray light, leads significant contrast...

In this letter, we propose and demonstrate ProtoHand, which is a soft artificial hand that can work as universal platform for prototyping electrical circuits similar to breadboard. ProtoHand made of flexible transparent polydimethyl siloxane. has multiple channels filled with liquid metal beneath the surface, like blood vessels hand. Electric components, such resistors capacitors, be inserted by piercing into electrically connected via conductive metal. Soldering unnecessary, parts removed...

In the present study, we propose a largely deformable and miniaturized soft actuator that is made by an elastic rubber bladder (called pouch) with low-boiling-point liquid. When temperature of liquid reaches 34 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">°</sup> C, inside pouch evaporates, whole structure inflates. Thanks to proposed fabrication method, can make approximately 5 mm in diameter thin membrane, inflate volume 86 times or more...

Human body augmentation makes it possible to obtain new abilities that we cannot achieve with our actual bodies. A projected virtual hand interface is a promising approach for because can extend user's reach in daily life without the need wear device. Although users manipulate as if were their own and interact distant objects through it, they feel sensation of touch when overlaid on real object. In this paper, propose novel pseudo-haptic feedback framework provide tactile texture use haptic...

Aiming at realizing novel vision augmentation experiences, this paper proposes the IlluminatedFocus technique, which spatially defocuses real-world appearances regardless of distance from user's eyes to observed real objects. With proposed a part object in an image appears blurred, while fine details other same remain visible. We apply Electrically Focus-Tunable Lenses (ETL) as eyeglasses and synchronized high-speed projector illumination for scene. periodically modulate focal lengths...

We propose HaptoFloater, a low-latency mid-air visuo-haptic augmented reality (VHAR) system that utilizes imperceptible color vibrations. When adding tactile stimuli to the visual information of image, user should not perceive latency between and information. However, conventional presentation methods for images, based on cameradetected fingertip positioning, introduce due image processing communication. To mitigate this latency, we use vibration technique; humans cannot when display...

This paper proposes a new shadow interface system that provides tactile feedback from user's to physical body. When users obstruct the projected image by their bodies, wearable photoreactive displays receive light information; they decode it and transmit sensation. The proposed does not require complex sensing, complicated settings communication systems; can perform high speed with information directly received light. Perspective projection of occluding objects generate shadows is preserved...

Collaboration between computer graphics and multiple robots has attracted increasing attention in several areas. To preserve the seamless connection them, system needs to be able accurately determine position state of control them easily instantly. However, realizing a responsive for large number mobile without complex settings at same time avoiding load problem is not trivial. Our system, called "Phygital Field", can project two types information: visible images humans data patterns...

Collaboration between computer graphics and multiple robots has attracted increasing attention in several fields. To enhance the seamless connection them, system should be able to accurately determine position state of control them easily instantly. However, realizing a responsive for large number mobile without complicated settings while avoiding load problem is not trivial. We propose novel system, called "Phygital Field," localization robots. Utilizing pixel-level visible light...

Abstract In recent years, soft robots have been attracting interest because of their potential for new application fields. Among actuators robots, liquid-to-gas phase change the advantage structural simplicity. However, require an external heater to vaporize a low boiling point liquid inside actuator. The typically consists solid electrode that often reduces durability and flexibility heater. this study, we propose small actuator with integrated metal A were encapsulated in...

Owing to the pervasive use of displays and smartphones, mobile interactions with display screens have gained attention within advertising gaming industries as well in human-computer interaction research. Communication through QR code-like markers localization via AR are common examples such interactions. However, these visible interfere content; this problem is critical for over a wide range interactions, fewer result less reliability accuracy. Although some studies addressed issue, few...

In addition to displaying images, graphic display devices can be configured transmit information nearby computing devices, facilitate human interaction with the image. However, some existing methods require use of visible markers, which impairs visual experience, while others specially modified projectors.. To solve these problems, we propose a novel method that employs imperceptible color vibration embed pixel-by-pixel data into images on an ordinary LCD display; this is achieved by fixing...

We previously studied methods leveraging pixel-level visible light communication (PVLC) that embeds imperceptible information for human eyes in each pixel of an image. The PC computation load and amount data transferred between the projector previous PVLC systems were excessive because executed both video encoding processes. As a result, it was impossible to achieve high-dynamic-range images dynamic updates data. In this paper, we propose system offers high quality interactively through...

We propose a novel method for the localization and navigation of multiple mobile robots. Our uses coded light superimposed onto visual image projected Robots localize their position by receiving decoding light, can follow target using velocity vector field. Localization information be independently conveyed in each pixel, we change this over time. The entire system only requires projector to navigate robot swarm; thus, it used on any projection surface. To robots, they need placed within...

We propose "NavigaTorch", a projection-based robot control interface that enables the user to operate quickly and intuitively. The can navigate from third-person viewpoint using projected video as visual feedback. achieved flickerless image feedback quick response in operation by developing handheld pixel-level visible light communication (PVLC) projector. Our contribution is development of based on high-speed projection technology exploration design methodology

Communication between screens and cameras has attracted attention as a ubiquitous information source, motivated by the widespread use of smartphones increase public screens. The method that encodes data into visible patterns impairs user's visual experience. Previously, embedding matrix barcodes images on displays utilizing imperceptible color vibration was proposed. In this approach, experience is maintained considering are imperceptible, it can be implemented almost any display camera....

Conventional pneumatic haptic displays need a complex and weight system because air is fed through tube from an compressor. To address this problem, we propose display that uses liquid-to-gas phase change actuator Peltier device. The composed of thin plastic pouch containing low boiling point liquid. temperature the liquid controlled by device in close contact with actuator. This approach allows soft actuators to be inflated without use compressor tubes, allowing us realize small light...