Presentation Device

Abstract

A presentation device is provided that can provide an immersive sensory experience for audio by controlling vibration presentation and light presentation in an integrated manner based on an audio signal. [Solution] The presentation device of this invention comprises a control unit that analyzes audio signals received wirelessly from an external device, and a vibration presentation unit and light-emitting unit that are driven based on the analysis results. The control unit controls the vibration waveform and light-emitting pattern in response to changes in the frequency component or volume of the audio signal, achieving tactile and visual presentations synchronized with the audio. In addition, the vibration is transmitted clearly using a vibration-proof structure, and the presentation can be expanded by connecting to external devices.

Description

[Technical Field]

[0001] The present invention relates to a presentation device that provides tactile and visual presentations based on audio signals, and more particularly to a device and system that enhances the immersive audio experience by synchronously controlling vibration and light emission according to the characteristics of the audio signal. [Background technology]

[0002] Conventionally, devices such as penlights and glow sticks have been widely used at concerts and events to create visual effects throughout the venue by controlling the color and lighting pattern of LEDs. Among these, a technology is known that receives a light-emitting control signal from an event production server via wireless communication and synchronizes light-emitting effects across all audience devices (Patent Document 1).

[0003] Also proposed is a technology that stores pre-generated light-emitting pattern data inside a device and plays that pattern upon receiving a trigger signal during an event (Patent Document 2).Furthermore, there are proposals regarding communication methods and data structures for efficiently transmitting control information to a large number of terminals (Patent Document 3).

[0004] On the other hand, there is also a known system that detects the user's movements and the excitement of the entire venue and reflects this in the performance in order to enhance the realism of the audience experience (Patent Document 4).

[0005] However, all of these technologies either focused solely on visual effects or were mechanisms for playing predefined performance patterns, and did not express the timbre and rhythmic characteristics contained in actual audio signals in real time using tactile sensations and light. That is, the conventional technology had the following three problems: (1) it did not use audio signals as input, (2) it did not analyze the frequency components or strength of the audio and reflect them in vibration and light control, and (3) it did not generate an integrated representation that synchronized tactile and visual presentations in time. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-4322

[0007] [Patent Document 2] Japanese Patent Application Laid-Open No. 2015-11981

[0008] [Patent Document 3] International Publication No. WO2023 / 202044

[0009] [Patent Document 4] Japanese Patent Publication No. 2022-66666 Summary of the Invention [Problem to be solved by the invention]

[0010] However, all of the above-mentioned conventional technologies are mechanisms for producing effects that are primarily visual effects or for reproducing predefined production patterns, and do not reflect the timbre and rhythmic characteristics contained in the actual audio signal in the presentation.

[0011] In other words, conventional presentation devices (1) do not use audio signals as input, (2) are unable to analyze the frequency components and strength of audio signals and reflect them in the presentation, and (3) have difficulty synchronizing tactile and visual presentations to achieve multisensory expression.

[0012] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a presentation device that can provide an immersive sensory experience for audio by integrating control of vibration presentation and light presentation based on audio signals. [Means for solving the problem]

[0013] First, the present invention comprises a presentation device including a receiving unit that receives an audio signal, a control unit that analyzes the audio signal, a vibration presentation unit that generates a vibration control signal or the received audio signal based on the analysis result and outputs vibration, and a light-emitting unit that generates a light control signal based on the analysis result and emits light.

[0014] In addition, as a second aspect of the present invention, in addition to the first configuration, the control unit may be configured to decompose the audio signal into frequency bands and generate the vibration control signal having vibration characteristics corresponding to each frequency band.

[0015] Furthermore, as a third configuration, in addition to the first configuration, the control unit may be configured to modulate the frequency component of the vibration output by the vibration presentation unit by performing pitch shift processing or filter processing on the audio signal.

[0016] As a fourth configuration, in addition to the first configuration, the control unit may be configured to control the light color, light intensity, or light emitting position of the light emitting unit in association with the frequency band of the audio signal.

[0017] As a fifth configuration, in addition to the first configuration, the device may further include a sensor means for detecting an operating state, and the control unit may be configured to modulate the vibration control signal and / or the light control signal according to the operating state.

[0018] As a sixth feature, in addition to the fifth feature, the control unit The vibration intensity or light intensity may be increased.

[0019] Seventh, in addition to the first configuration, the vibration presentation unit may be supported on the housing via a main frame, and the main frame may be fastened to the housing at multiple points to suppress resonance and increase the transmission efficiency of vibration.

[0020] As an eighth aspect, in addition to the first configuration, a connection portion for detachably connecting an external accessory may be further provided.

[0021] As a ninth aspect, in addition to the first configuration, a rotatable ring may be provided on the outer periphery of the housing, and the power state or operation mode may be switched by manipulating the ring.

[0022] As a tenth aspect, in addition to the first configuration, the audio signal may include a signal received by wireless communication and an analog input signal. [Effects of the Invention]

[0023] According to this invention, the control unit analyzes the characteristics of the audio signal, such as tone, dynamics, and rhythm, and then controls the vibration and light presentations in an integrated manner based on the analysis results. This allows for a multi-sensory immersion in the audio experience, where the tactile and visual senses are synchronized, compared to conventional presentation methods that primarily focus on visual effects.

[0024] According to the first aspect of the present invention, the control unit analyzes the audio signal and synchronizes the vibration and light-emitting units based on the analysis results, allowing the user holding the device to directly perceive changes in the intonation of the audio or musical structure as a physical sensation. It is also possible to play the received audio signal on the vibration unit without necessarily performing analysis, and in this case, vibration feedback corresponding to audio changes can also be easily obtained. Therefore, various tactile sensations can be realized depending on whether or not analysis processing is performed and the presentation mode, allowing for flexible presentation experiences suited to the user's usage scenario.

[0025] According to the second component of the present invention, the audio signal can be decomposed into frequency bands, and vibration characteristics corresponding to each band can be assigned to the vibration presentation unit, thereby making it possible to tactilely reproduce the texture of the tone, such as the thickness of the low range and the brilliance of the high range.

[0026] According to the third aspect of the present invention, by performing pitch shifting or filtering on the audio signal, the frequency components of the vibration can be dynamically controlled in response to changes in the sound, making it possible to express vibrations based on melody or harmonic structure.

[0027] According to the fourth aspect of the present invention, the color, intensity, or position of the light can be controlled in accordance with the frequency band of the audio signal, so that the visual presentation matches the rhythm, strength, and melody of the sound, enabling a sensory presentation in which sound and light are integrated.

[0028] According to the fifth invention component of the present invention, the user's motion state can be acquired by a sensor means, and the operation of the vibration presentation unit and / or light-emitting unit can be modulated according to the motion state, so that the user can get the feeling that their own physical motion affects the presented content, thereby enhancing the sense of participation and immersion in the performance.

[0029] According to the sixth aspect of the present invention, the vibration intensity or light intensity can be increased in response to the amount of movement, so that the user's excitement and emotional excitement can be directly reflected in the presentation, thereby creating a sense of unity and synchronized excitement among the audience at live music venues, etc.

[0030] According to the seventh aspect of the present invention, by fastening the main frame supporting the vibration presentation unit to the housing at multiple points, unnecessary resonance can be suppressed and vibration energy can be efficiently transmitted to the user, thereby improving the clarity and reproducibility of the tactile presentation.

[0031] According to the eighth design element of the present invention, by providing a connection part for detachably connecting external accessories, it is possible to expand the wearing style and appearance design depending on the application, thereby increasing usability and the range of expression.

[0032] According to the ninth aspect of the present invention, a rotatable ring is provided on the outer periphery of the housing, allowing users with limited vision or limited vision to switch power and operating modes tactilely and intuitively by feel. This eliminates the need to look at their hands while playing or listening to music, allowing users to continue operating without losing immersion or performance. This achieves both improved operability and continuity of experience, making it possible to provide a presentation device that is easy to use for a wide range of users.

[0033] According to the tenth component of the present invention, in addition to audio signals received via wireless communication, it can also handle audio signals input via analog input, making it highly convenient for a variety of usage scenarios, such as at home, at live concerts, when watching games, or playing musical instruments, regardless of the network environment. [Brief explanation of the drawings]

[0034] [Figure 1] 1 is a perspective view of an external appearance of a presentation device according to an embodiment of the present invention; [Figure 2] 1 is an exploded perspective view showing the main components of a presentation device according to an embodiment of the present invention; [Figure 3] 3 is a schematic diagram illustrating a support structure of a main frame of a presentation device according to an embodiment of the present invention; FIG. [Figure 4] 1 is a block diagram showing the configuration of a signal processing and control system in a presentation device according to an embodiment of the present invention; [Figure 5] FIG. 10 is a block diagram showing a second embodiment of the present invention, illustrating a general configuration in which a presentation device operates as an entire sound system in cooperation with an external electronic musical instrument system at a concert venue or the like. [Figure 6] FIG. 10 is a block diagram showing a signal processing path for executing vibration presentation control in a presentation device based on a signal transmitted from a small communication device 8 attached to an acoustic guitar 7 in an audio system according to a second embodiment of the present invention. [Figure 7]10 is a flowchart showing a basic vibration control flow for extracting and adjusting specific frequency components from audio data to drive a VCM (vibration motor) in an audio system according to a second embodiment of the present invention. [Figure 8] 10 is a flowchart showing a detailed vibration control flow for decomposing audio data into a plurality of frequency bands (low, mid, and high ranges) by FFT and adjusting the gain of each band individually in the audio system showing the second embodiment of the present invention. [Figure 9] 10 is a block diagram showing a signal processing path when the sound of a musical instrument or the like is presented as visual feedback via an LED of a presentation device in an audio system according to a second embodiment of the present invention. FIG. [Figure 10] 10 is a flowchart showing an LED sequence branching control flow in the audio system according to the second embodiment of the present invention. [Figure 11] 10 is a flowchart illustrating a control flow of the visual spectrum representation of the LED in the audio system according to the second embodiment of the present invention. [Figure 12] 10 is a block diagram showing a signal processing path when motion (movement information) such as dancing is presented as haptic feedback via a VCM (vibration motor) of a presentation device in an audio system according to a second embodiment of the present invention. FIG. [Figure 13] 10 is a flowchart showing a feedback switching control flow according to an operation speed in the audio system showing the second embodiment of the present invention. [Figure 14] 10 is a flowchart showing a flow of intensity proportional control according to an amount of operation in an audio system according to a second embodiment of the present invention. [Figure 15] 1 is a reference diagram showing the state in which the universal plug is removed from the main body of the presentation device according to an embodiment of the present invention and an attachment with a belt strap is attached, as well as the cross-sectional shape thereof; FIG. [Figure 16]1 is a reference diagram showing the state in which the universal plug is removed from the main body of the presentation device according to one embodiment of the present invention and an ornamental or highly designed joint part is attached, as well as the appearance of the joint part. DETAILED DESCRIPTION OF THE INVENTION

[0035] FIG. 1 is an external perspective view of a presentation device according to an embodiment of the present invention, and FIG. 2 is an exploded perspective view showing its main components. The presentation device 1 of this embodiment has a rod-shaped main body housing 10, one end of which is provided with a grip unit 20 for handholding. The other end is provided with a light-emitting unit 30 for emitting light. A strap 40 can be attached to the end of the grip unit 20 for attaching the device to a user's wrist or the like. While the presentation device 1 is primarily intended for use as a handheld device held in the hand at live music venues and the like, it can also be used as a wearable device attached to the body, such as the arm or leg, by combining it with a strap or various attachments. Therefore, it is configured as a flexible presentation device that allows users to choose from a variety of attachment methods depending on their physical characteristics and the environment in which they are used.

[0036] 2, inside the main body casing 10 are installed a control board 33 (MCU) that performs light control and communication processing as a receiving means and an analyzing means, a plurality of LEDs 34 that constitute the light emitting unit 30, a voice coil module 36 (VCM) that serves as a vibration presentation means, a battery 37 that supplies power to the device, and a main frame 35 that supports all of these. Also, a switch 38 that can be operated by the user to turn on the power or switch modes is located on the grip portion 20.

[0037] A cover 31 is attached to the light-emitting unit 30, covering the tip end, and a decorative ring 32 is fitted around the base end. The decorative ring 32 may also function as a switch for a user interface. A universal plug 21 is provided at the end of the grip 20 for detachably connecting external accessories.

[0038] With the above-described configuration, the presentation device 1 has a housing structure that can efficiently perform vibration presentation and visual presentation based on an audio signal. Furthermore, the configuration can accommodate not only presentation control based on the analysis results of the audio signal by the control unit, but also direct use of the received audio signal for vibration presentation without analysis processing. This allows for flexible switching of presentation methods depending on the quality of the input signal and the usage environment, enabling stable experience quality to be provided in a variety of use cases.

[0039] 3 is a diagram showing in detail the support structure of the main frame 35 in the presentation device 1. In the presentation device 1, the main frame 35 is supported at multiple points by both the grip part 20 and the cover part 31.

[0040] Specifically, the grip section 20 is provided with a grip fastening section 20A for fixing the frame in the axial direction, and a grip frame vibration prevention member 20B is formed to prevent cantilevered bending and resonance caused by vibration of the main frame 35. This prevents vibration energy from escaping to the outer periphery of the housing when vibration is presented, improving the efficiency of transmission to the user's hand.

[0041] Also, a cover fastening portion 30A is provided on the light emitting portion 30 side, and is configured to reliably fix the main frame 35 via the cover portion 31. Furthermore, a cover frame vibration prevention member 30B is used to suppress rotational and radial vibrations at the tip end, allowing the vibrations generated by the voice coil module 36 to occur efficiently without causing unnecessary resonance.

[0042] In this way, in the presentation device 1, by fastening and supporting the main frame 35 at multiple points, the rigidity of the housing can be ensured while the vibrations required for tactile presentation can be clearly transmitted to the user, thereby achieving a highly immersive tactile presentation that corresponds to an audio signal.

[0043] 4 is a block diagram showing the configuration of a signal processing and control system in the presentation device 1. The presentation device 1 provides vibration and visual presentation based on an audio signal input from the outside, and is configured to allow audio signals to be input via both wired and wireless connections.

[0044] First, the wireless receiving system includes a wireless receiving unit (Auracast receiving unit) that receives audio signals transmitted from the event venue or external devices, and the received digital audio signal is converted to an analog signal by a DAC (Digital to Analog Converter). The converted signal is amplified by an amplifier as needed and then supplied to a vibration presentation means, which is a voice coil module 36 for presenting vibration.

[0045] The presentation device 1 also includes an analog audio input terminal, allowing it to receive analog audio signals directly input from external audio equipment. When an analog signal is input, the signal is amplified by an analog amplifier and output to the voice coil module 36 via a switch mechanism and a volume adjustment mechanism (SW / Vol).

[0046] Furthermore, the control means (MCU) mounted on the control board 33 can supply control signals based on the amount of movement detected by an IMU sensor or the like as a sensor means, as well as internally generated sound effects, etc. to the voice coil module 36 via a DAC amplifier. This makes it possible to present tactile sensations even when there is no external input signal.

[0047] In addition, the MCU generates light control signals for controlling the light intensity, lighting pattern, and light color of the LEDs 34 of the light-emitting unit 30, enabling visual presentation to be synchronized with audio or motion. Also, power control and mode switching operations via a switch 38 are input to the MCU, which appropriately controls the operating state of the entire presentation device 1.

[0048] Furthermore, the battery 37 supplies power to each component and performs power saving control to enable long-term use. From this block diagram, it can be understood that the presentation device 1 is equipped with various input systems and an integrated control system, thereby enabling appropriate multi-sensory presentation in response to audio signals and user actions.

[0049] The analysis means (MCU) of this embodiment can implement various algorithms that perform frequency band analysis, pitch shifting, or filtering of the audio signal, and control the vibration presentation means and light emission means based on the analysis results. This allows for a variety of tactile and visual presentations to be realized according to the features of the audio signal (such as strength, tone, and rhythm).

[0050] A presentation system (hereinafter, the presentation system includes an audio system) according to a second embodiment of the present invention includes, in addition to the presentation device 1 described above, a configuration for transmitting a performance signal or an audio signal from an external device to the presentation device 1 to realize a linked operation. Fig. 5 is a block diagram showing the schematic configuration of the presentation system.

[0051] In this presentation system, external devices (electronic drum 2, electronic tambourine 3, small communication device 8, etc.) function as transmitting means for acquiring audio signals or sensor signals, converting them into a format suitable for wireless communication, and transmitting them to presentation device 1. In contrast, presentation device 1 is not a passive receiving device that simply receives signals, converts them into vibrations or light, and outputs them, but rather functions as an autonomous presentation device that actively analyzes the received signals using analysis means (MCU) and performs integrated control of tactile and visual presentations based on the analysis results. This analysis and integrated control can be performed by presentation device 1 alone, without relying on the presentation control function of the external devices.

[0052] As shown in Figure 5, this presentation system is composed of external musical instruments such as an electronic drum 2, an electronic tambourine 3, a transmitter 4, and an acoustic guitar 7, as well as a signal converter 6 that transmits the performance signals from these instruments, and a speaker 5 that outputs the performance status.

[0053] The electronic drum 2 and the electronic tambourine 3 each have a sensor that detects striking operations and generates instruction signals according to the striking strength, striking position, etc. These instruction signals are input as MIDI signals or analog signals to the signal converter 6, converted into a signal format suitable for wireless transmission, and then transmitted to the presentation device 1.

[0054] The presentation device 1 controls the vibration presentation means and light emission means described above based on the performance signal received from the signal converter 6, thereby providing tactile and visual presentations synchronized with the performance of the external musical instruments 2 and 3. This allows the performer or audience to experience the expression of the performance not only through sound, but also through touch and vision.

[0055] Additionally, a small communication device 8 that detects vibrations and movements is attached to the acoustic guitar 7, and the small communication device 8 transmits the detection signal to the signal converter 6. As described above, the signal converter 6 converts the signal into a transmission signal for the presentation device 1 and transmits it to the presentation device 1, thereby realizing presentation control according to the playing status of the acoustic guitar 7.

[0056] The speaker 5 outputs the performance sound based on the audio signal from the signal converter 6 or the performance device, and if an external projector is installed, it can output images synchronized with the performance as needed, thereby creating an overall multi-sensory integrated music presentation space.

[0057] The above configuration makes it possible to provide an unprecedented multi-sensory musical experience not only to performers but also to audiences, and in particular to provide an environment in which people with hearing or visual impairments can enjoy music as a physical sensation.

[0058] 6 is a block diagram showing an example of the configuration of the presentation system according to the second embodiment, in which the presentation device 1 is controlled to present to a large number of spectators at a performance venue, etc. In this presentation system, the signal converter 6 functions as a hub device, and can integrate performance signals input from multiple external musical instruments and transmit wireless transmission signals to the presentation device 1 in a batch.

[0059] Specifically, performance signals obtained from external instruments such as an electronic drum 2, an electronic tambourine 3, and an acoustic guitar 7 equipped with a small communication device 8 are collected in a signal converter 6, and based on these signals, the signal converter 6 wirelessly transmits control signals for vibration presentation and control signals for light presentation to the presentation device 1. The presentation device 1 performs the aforementioned tactile and visual presentations in response to these control signals.

[0060] Furthermore, if an external projector is installed, visual effects can be displayed throughout the venue in sync with the performance information, and at the same time, the speaker 5 can output the performance sounds, realizing an integrated performance across the entire space in addition to the individual tactile and visual presentations provided by the presentation device 1. In other words, it is possible to create a multi-sensory experiential space that creates a sense of unity between the performers and the audience.

[0061] This allows the audience to intuitively experience the dynamics, rhythm, and synchronization with the stage direction of the performance not only through the sound but also through the vibration and light emitted by the presentation device 1, providing an unprecedented sense of immersion and participation. This can provide an environment in which audience members with hearing or visual impairments can share the musical experience through their bodies.

[0062] In this second embodiment, the presentation device 1 is assumed to be worn by the audience, but a similar configuration can also be applied when worn by a performer, and can function as a means of tactilely expanding musical expression even on stage.

[0063] FIG. 6 is a block diagram showing a signal processing path for executing vibration presentation control in the presentation device 1 based on a signal transmitted from a small communication device 8 attached to the acoustic guitar 7. As shown in FIG.

[0064] The small communication device 8 detects the vibration of the strings of the acoustic guitar 7 or the amount of movement during playing using a sensor (for example, an IMU or a microphone), and transmits the detected signal as a transmission signal suitable for wireless communication to the signal converter 6. The signal converter 6 converts the received signal into a data format that can be transferred to the presentation device 1, and transmits it to the presentation device 1 wirelessly.

[0065] Figure 7 is a flowchart showing the basic control flow in which the analysis unit (MCU) of the presentation device 1 executes vibration presentation based on an audio signal. This flow applies a frequency filter to the received audio data, extracts a signal in a specific frequency band suitable for driving the VCM, and then performs gain adjustment to drive the vibration presentation unit (VCM). This simple configuration enables efficient driving of the VCM and basic vibration expression.

[0066] 8 shows a detailed vibration control flow in the presentation device 1. The receiving means of the presentation device 1 receives the audio data or motion detection data transmitted via the small communication device 8 and inputs it to the MCU, which is the analyzing means. The MCU performs frequency analysis on the audio data using FFT (Fast Fourier Transform) and extracts feature quantities for each frequency band, such as low-frequency volume, mid-frequency volume, and high-frequency volume.

[0067] The MCU generates a control signal suitable for the vibration presentation means (VCM) by adjusting the gain according to the extracted band features. The gain-adjusted signal is reconstructed into a time waveform using iFFT (inverse Fourier transform) and then output to the VCM via a DAC and DC amplifier. This allows the tactile sensation to be conveyed with the timbre, rhythm, and dynamics unique to guitar playing.

[0068] The MCU also uses motion data detected during performance to dynamically change vibration intensity or light emission control according to the strength of the performer's strokes and motions, providing multisensory feedback synchronized with the performer's physical movements, further enhancing the immersive feeling of haptic presentation.

[0069] Through the above processing, the presentation device 1 reproduces the vibration expression of the live sound of the acoustic guitar 7 in real time as tactile feedback, enabling the enjoyment of musical expression that does not depend on auditory information. Therefore, the presentation device 1 expands the performance experience or appreciation experience for a variety of users, including those with hearing impairments.

[0070] 9 is a block diagram showing a signal processing path for performing light emission presentation control in the presentation device 1 based on an audio signal transmitted from a small communication device 8 attached to an acoustic guitar 7. In this processing flow, when audio data is received, the MCU performs frequency analysis such as FFT (Fast Fourier Transform) to extract feature quantities for each frequency band, such as low-frequency volume, mid-frequency volume, and high-frequency volume.

[0071] The MCU can perform different lighting control for each of the multiple LEDs 34 that make up the light-emitting unit 30, depending on the volume value for each extracted frequency band. For example, the MCU can be configured to control the light intensity and number of LEDs 34 that are lit depending on the low-frequency volume, LED 2 depending on the mid-frequency volume, and LED 3 depending on the high-frequency volume, so that changes in the timbre of the played sound are visually presented.

[0072] Furthermore, by combining temporal phase and delay processing with changes in intensity for each frequency band, MCU can also visually express sensations of pulsation, echo, and spaciousness, thereby visually emphasizing the emotional dynamics inherent in guitar playing and enhancing the immersive musical experience.

[0073] As shown in FIG. 9, in the presentation device 1, received audio data is input to the same analysis means (MCU), and vibration presentation control and light-emitting presentation control are executed independently or in conjunction with each other depending on the analyzed feature amount. This makes it possible to present information to both the tactile and visual senses in accordance with the acoustic characteristics. FIG. 10 shows an LED sequence branching control flow, which is an example of this control. In the presentation device 1, received audio data is input to the same analysis means (MCU), and vibration presentation control and light-emitting presentation control are executed independently or in conjunction with each other depending on the analyzed feature amount. This makes it possible to present information to both the tactile and visual senses in accordance with the acoustic characteristics.

[0074] In this way, in this system, input data such as performance signals and sensor signals sent from external devices are clearly separated from the analysis processing performed internally by the presentation device 1. The presentation device 1 can extract features such as frequency components, dynamics, rhythm, and movement amount of the input signal, and perform sophisticated and complex presentation control based on these features. This dramatically improves the sense of realism and immersion in dynamic input environments such as live performances, compared to conventional systems that simply receive predefined sequence patterns from external devices.

[0075] 11 is a flowchart showing an example of a control flow for visual spectrum expression of LEDs when a motion detection signal (sensor data) is also used. That is, the MCU can be configured to integrate the motion amount acquired by an IMU or the like with the audio feature amount, and to realize an interactive visual presentation according to the physical motion of the performer or audience, for example, by increasing the light intensity or the number of lights when the motion amount is large.

[0076] In this way, by integrating and processing the acoustic analysis results and the motion detection results, this presentation device 1 is able to not only visualize the performance signal, but also reflect the interaction between the performers and the audience in the visual presentation, thereby creating an unprecedented sense of participation and unity.

[0077] In particular, by synchronizing and controlling tactile presentation (vibration) and visual presentation (light emission) in an integrated manner with acoustic features, the hearing impaired can recognize changes in musical expression through light emission and vibration, and the visually impaired can recognize changes through vibration. Therefore, by applying this presentation device 1, a universal listening environment can be provided in which users with any sensory characteristics can share the creativity and excitement of music.

[0078] 13 is a flowchart showing an example of a processing flow for controlling switching between light presentation and vibration presentation in the presentation device 1 using a speed threshold based on the body movement of a performer or the like detected by the small communication device 8. In this processing, the MCU performs signal correction such as averaging processing on movement data such as speed, acceleration, and position acquired by an IMU sensor or the like, and then determines whether the movement amount exceeds a predetermined threshold.

[0079] When the amount of movement is large, strong vibrations (VCM drive) and visual presentations (LEDs) with high light intensity or many lights are displayed according to the momentum of the performance, while when the amount of movement is small, gentle vibrations and light intensity are displayed according to a gentle performance. This allows performers and audience members to interactively change the light emission and vibration of the presentation device 1 through their own physical movements.

[0080] Fig. 14 shows an example of a processing flow that introduces intensity proportional control that continuously reflects the amount of movement in addition to the switching control shown in Fig. 13. That is, by continuously changing the light intensity, number of lights on, or lighting pattern of the LEDs 34 in proportion to the averaged amount of movement and proportionally controlling the gain (vibration intensity) of the VCM 36, seamless and continuous extraauditory presentation of the performance movement becomes possible.

[0081] Alternatively, the VCM 36 may be configured to play a predetermined vibration loop pattern as a reference and change only its gain depending on the amount of movement. In this case, stable vibration expression can be maintained even if the amount of movement changes rapidly, enabling tactile presentation with excellent real-time performance.

[0082] Furthermore, as shown in Figures 13 and 14, it is also possible to configure the system to integrate and process the results of acoustic analysis (see Figures 7, 8, 9, 10, and 11) and the results of movement amount analysis (see Figures 13 and 14). In this case, the dynamics and timbre of the played sound are presented through vibration and light emission, and additional effects (expanded light effects, emphasized vibration effects, etc.) according to the performer's physical movements can be superimposed, resulting in a more expressive multi-sensory presentation.

[0083] As described above, this presentation device 1 can provide both performers and audiences with a new experience value that enhances the sense of unity between musical reaction and physical movement by integrating control of tactile and visual presentation based on both acoustic analysis and motion analysis. In particular, by presenting information using a combination of light and vibration for the hearing impaired and primarily vibration for the visually impaired, it is possible to create a universal music enjoying environment for users with diverse sensory characteristics.

[0084] In other words, the presentation device 1 and the presentation system equipped with it are not a system that passively plays back signals transmitted from external devices, but are based on a unique control concept that extracts signal features and autonomously synchronizes tactile and visual sensations based on these features. This control concept makes it possible to provide a universal listening environment that physically expands the music experience for all users with diverse sensory characteristics, including those with hearing or visual limitations.

[0085] Furthermore, the presentation device 1 has a detachable universal plug 21 provided at the end of the grip unit 20, providing expandability that allows the presentation device 1 to be appropriately attached to various body parts and accessories. FIG. 15 shows an example of the appearance of the presentation device 1 with the universal plug 21 removed and an attachment 50 equipped with a belt strap attached. The attachment 50 can be used to securely attach the presentation device 1 to other body parts, such as the leg or waist, in addition to the arm, and can provide a stable form of use even when a user with a disability in one of their limbs has difficulty holding the presentation device 1.

[0086] As shown in Figure 15 (right side), the end of the grip section 20 of the presentation device 1 is provided with a connection interface equipped with a common screw mechanism as a standard plug 21. The attachment 50 has a fitting structure that can be screwed onto the common screw mechanism, and when combined with a belt strap, it can prevent unexpected rotation or detachment even during the player's movements or when vibration presentation is output. This allows the presentation device 1 to be worn at a more flexible location depending on the usage scenario, enabling tactile and visual presentations to be performed without impairing the sense of immersion.

[0087] 16, the presentation device 1 is configured so that the universal plug 21 can be removed and an ornament or a highly designed joint part 51 can be attached. The joint part 51 can be used to use the presentation device 1 as a decoration or accessory, and can create a sense of unity with costumes and props in a stage performance, for example.

[0088] The shape, material, mechanism, etc. of the attachment 50 and joint parts 51 can be changed as appropriate according to the usage scene and design requirements, and can accommodate a variety of usage forms without changing the basic structure (internal configuration of the housing and control function) of the presentation device 1. In other words, by providing high functionality and design expandability, the presentation device 1 can be widely deployed not only for music listening purposes but also as a fashion item, performance gear, rehabilitation support tool, etc.

Claims

1. a receiving unit for receiving an audio signal; a control unit that analyzes the audio signal; a vibration presentation unit that generates a vibration control signal or a received audio signal based on the analysis result and outputs vibration; a light emitting unit that generates a light control signal based on the analysis result and emits light; A presentation device comprising:

2. The control unit decomposes the audio signal into frequency bands, The presentation device according to claim 1 , wherein the vibration control signal is generated to have vibration characteristics corresponding to each of the frequency bands.

3. The control unit performs pitch shift processing or filter processing on the audio signal, The presentation device according to claim 1 , wherein a frequency component of the vibration output by the vibration presentation unit is modulated.

4. The control unit associates the frequency band of the audio signal with the frequency band of the audio signal, The presentation device according to claim 1, wherein the light emitting unit controls a light color, a light amount, or a light emitting position.

5. Further comprising a sensor means for detecting an operating state; The control unit, depending on the operating state, The presentation device according to claim 1 , characterized in that the vibration control signal and / or the light control signal is modulated.

6. The presentation device of claim 5 , wherein the control unit increases vibration intensity or light emission intensity as the operating state increases.

7. the vibration presentation unit is supported by a housing via a main frame; The main frame is fastened to the housing at multiple points, 2. The presentation device according to claim 1, wherein resonance is suppressed to increase the transmission efficiency of vibration.

8. The presentation device of claim 1 , further comprising a connector for removably connecting an external accessory.

9. a rotatable ring portion is provided on the outer periphery of the housing; 2. The presentation device according to claim 1, wherein the power state or the operation mode is switched by operating the ring portion.

10. The audio signal is in addition to the audio signal received by wireless communication.

10. The presentation device of claim 1, including an audio signal input from an analog input.

Images