Mobile object
The integration of a haptics device and strategically positioned speakers in moving bodies addresses sound leakage by providing immersive audio experiences while minimizing disturbance to others, ensuring user safety and comfort.
Patent Information
- Application Number
- PCT/JP2024/045006
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-04
- Filing Date
- 2024-12-19
- Publication Date
- 2025-07-10
AI Technical Summary
Sound leakage from moving bodies such as bicycles can disturb those around the user and hinder immersive audio experiences, causing concern for both the user and others.
A moving body with a haptics device that vibrates according to low-frequency audio components, combined with strategically positioned mid-range and high-range speakers, adjusts audio levels based on user and environmental conditions to suppress sound leakage.
Effectively reduces sound leakage, allowing users to enjoy audio content without disturbing others and enhancing safety through dynamic audio adjustments.
Smart Images

Figure JP2024045006_10072025_PF_FP_ABST
Abstract
Description
Mobile
[0001] The present technology relates to a moving body, and in particular to a moving body that can suppress sound leakage to the surroundings, for example.
[0002] For example, Patent Document 1 describes headphones that analyze a noise signal picked up by a microphone and select the most suitable noise canceling mode from among a plurality of noise canceling modes based on the analysis results.
[0003] Patent No. 6274247
[0004] When a user is listening to content such as music, sound leakage to the surroundings can be a nuisance to those around them. Furthermore, if the user is concerned about such a nuisance to those around them, they may not be able to concentrate on watching the content and may not be able to enjoy it.
[0005] The present technology has been made in consideration of such circumstances, and makes it possible to suppress sound leakage to the surroundings.
[0006] The mobile body of the present technology is a mobile body in which a haptic device that vibrates in accordance with the low-frequency components of an audio signal is arranged so that vibrations from the haptic device stimulate the tactile sense of a user riding on the mobile body.
[0007] In the moving body of the present technology, the haptic device that vibrates in accordance with the low-frequency component of an audio signal is arranged so that vibrations produced by the haptic device stimulate the tactile sense of a user riding on the moving body.
[0008] 1 is a perspective view showing an example of the external configuration of one embodiment of an e-bike (electric-bike), which is an electrically assisted bicycle to which the present technology is applied. FIG. 2 is a side view of the right side of the e-bike 10 showing an example of the external configuration of the e-bike 10. FIG. 3 is a top view (plan view) showing the arrangement of a haptic device 61, a speaker 71, and speakers 81 to 85 on the e-bike 10. FIG. 4 is a diagram explaining the concept of the e-bike 10. FIG. 5 is a diagram showing an example of an application (program) installed on the e-bike 10. FIG. 6 is a diagram showing a first example of light emission of an LED provided on the e-bike 10. FIG. 7 is a diagram showing a second example of light emission of an LED provided on the e-bike 10. FIG. 8 is a diagram showing a third example of light emission of an LED provided on the e-bike 10. FIG. 9 is a diagram showing a fourth example of light emission of an LED provided on the e-bike 10. FIG. 10 is a diagram showing a fifth example of light emission of an LED provided on the e-bike 10. FIG. 11 is a diagram showing a first example of the configuration of an information processing system using the e-bike 10. FIG. 12 is a block diagram showing a first example of the electrical configuration of the e-bike 10. FIG. 13 is a diagram showing a second example of the configuration of an information processing system using the e-bike 10. 1 is a block diagram showing a second example electrical configuration of the e-bike 10. FIG. 2 is a block diagram showing an example configuration of an embodiment of an audio signal processing device to which the present technology is applied. FIG. 3 is a block diagram showing an example configuration of a signal processing unit 254. FIG. 4 is a diagram illustrating an example of 3-way processing by a signal generation unit 261. FIG. 5 is a diagram illustrating output of low-frequency components of a content signal by a haptic device 61. FIG. 6 is a diagram illustrating output of mid-frequency components of a content signal by a speaker 71 as a mid-frequency speaker. FIG. 7 is a diagram illustrating output of high-frequency components of a content signal by speakers 81 to 85 as high-frequency speakers. FIG. 8 is a diagram illustrating the degree of sound leakage suppression by 3-way configuration. FIG. 9 is a diagram showing the arrangement of high-frequency speakers and the names of the high-frequency speakers. FIG. 10 is a diagram illustrating a first example of adjustment of the level of high-frequency components of a content signal based on recognition information by a level adjustment unit 262. FIG. 11 is a diagram illustrating a second example of adjustment of the level of high-frequency components of a content signal based on recognition information by the level adjustment unit 262. FIG. 12 is a diagram illustrating a third example of adjustment of the level of high-frequency components of a content signal based on recognition information by the level adjustment unit 262. 10A and 10B are diagrams illustrating a fourth example of adjustment of the level of the high-frequency component of a content signal based on recognition information by the level adjustment unit 262.Fig. 10 is a diagram illustrating a fifth example of adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. Fig. 11 is a diagram illustrating a sixth example of adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. Fig. 12 is a diagram illustrating a seventh example of adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. Fig. 13 is a diagram illustrating an example of superimposing an audio signal of a danger notification sound onto the high-frequency component of a content signal by the superimposing unit 263 (content mix).
[0009] <One embodiment of an e-bike to which the present technology is applied>
[0010] Fig. 1 is a perspective view showing an example of the exterior configuration of an embodiment of an e-bike (electric-bike), which is an electrically assisted bicycle to which the present technology is applied. Fig. 2 is a right side view of the e-bike 10, showing an example of the exterior configuration of the e-bike 10 in Fig. 1.
[0011] In FIG. 2, in order to avoid the diagram becoming too complicated, the speaker 71 and the speakers 81 to 85 shown in FIG. 1 are shown by ellipses.
[0012] A seat (saddle) 31 is disposed behind the top tube 21 of the frame 20 of the e-bike 10, and a speaker 71 is disposed in front of the top tube 21.
[0013] The speaker 71 (MD) is a mid-range speaker that outputs (sounds corresponding to) mid-range components of content such as music or other audio signals. The speaker 71 is positioned so that it faces the direction of the user riding the e-bike 10, i.e., the user sitting on the seat 31 (so that it has directionality toward the user). As described above, the seat 31 is located behind the top tube 21, on which the speaker 71 is positioned forward, and therefore the speaker 71 can be said to be positioned in front of and below the user riding the e-bike 10.
[0014] A backrest 32 is disposed at the rear of the seat 31 and comes into contact with the back of the user when riding the e-bike 10. A haptic device 61 is disposed on the backrest 32, for example, in a portion that comes into contact with the back of the user when riding the e-bike 10.
[0015] In FIG. 2, the haptic device 61 is shown as an oval to make it easier to understand, but the haptic device 61 is built into the backrest 32 and cannot actually be seen from the outside.
[0016] The placement position of the haptic device 61 is not limited to the backrest 32. The haptic device 61 may be placed anywhere so that vibrations from the haptic device 61 stimulate the tactile sense of the user while riding the e-bike 10.
[0017] The haptic device 61 vibrates in accordance with the low-frequency components of the audio signal. The vibrations produced by the haptic device 61 stimulate the user's sense of touch, i.e., the haptic device 61 applies vibrations to the spine of the user sitting in the seat 31 (spine vibration), so that the low-frequency components of the audio signal are reproduced not as sound but as a bass-like sound. The user feels the low-frequency components of the audio signal through their sense of touch due to the vibrations produced by the haptic device 61.
[0018] A battery 51 is detachably attached to the down tube 22 of the frame 20. The battery 51 supplies power to, for example, a light 52 provided on the front fork 42, a motor (not shown) of the e-bike, and other necessary blocks.
[0019] A support 80 (FIG. 1) is fixed to the handlebar or stem of the handlebar 41. The support 80 supports the speakers 81 to 83 so that the speakers 81, 82, and 83 are arranged in a predetermined state.
[0020] Speakers 81 to 83 are high-frequency speakers that output (sound corresponding to) the high-frequency components of an audio signal. In addition to speakers 81 to 83, the e-bike 10 also has speakers 84 and 85 as high-frequency speakers. Therefore, the e-bike 10 has five speakers 81 to 85 as multiple high-frequency speakers.
[0021] Speakers 84 and 85 are supported by the backrest 32 .
[0022] The speakers 81 to 85 are all positioned so that they face the direction of the user riding the e-bike 10 and are located at a height near the height of the user's ears when riding the e-bike 10.
[0023] That is, the speaker 81(C) is supported by the support 80 so as to be located in front of the user when riding the e-bike 10, facing the user, and at a height near the user's ears. The speaker 82(FL) is supported by the support 80 so as to be located to the left of the user when riding the e-bike 10, facing the user, and at a height near the user's ears. The speaker 83(FR) is supported by the support 80 so as to be located to the right of the user when riding the e-bike 10, facing the user, and at a height near the user's ears. The speaker 84(SL) is supported by the backrest 32 so as to be located to the left of the user (slightly behind) when riding the e-bike 10, facing the user, and at a height near the user's ears. The speaker 85 (SR) is supported by the backrest 32 so that it is located to the right (slightly behind) the user while riding the e-bike 10, facing the user, and at a height approximately at ear level with the user.
[0024] Note that the support 80 that supports the speakers 81-83 and the backrest 32 that supports the speakers 84 and 85 can be provided with a height adjustment mechanism that adjusts the height of the speakers 81-85. The e-bike 10 detects the ears of the user while riding the e-bike 10, and the height adjustment mechanism can adjust the positions (heights) of the speakers 81-85 so that the speakers 81-85 are positioned at a height close to the height of the detected user's ears.
[0025] A display 91 that displays various information is provided on the handlebar or stem of the handlebar 41. The display 91 is integrated with a touch panel to form a touch screen, and also functions as an operation panel that accepts various operations from the user.
[0026] Instead of providing a display 91 on the handlebars or stem of the handlebars 41, the e-bike 10 can be configured to allow a mobile device, such as a smartphone, that has communication capabilities and can run applications (programs) to be attached or detached. The smartphone can then be used as the display 91 and operation panel.
[0027] In addition, various displays can be made on the display 91 as well as smart glasses (including contact lenses) worn by the user.
[0028] Light sources, such as LEDs (light emitting diodes), are provided in the parts that form the skeleton of the e-bike 10. The LEDs emit light, making it appear as if the e-bike 10 is floating in a dark environment. The parts that form the skeleton of the e-bike 10 include, for example, the frame 20, the seat 31, the handlebars 41, the front fork 42, the rims of the front wheel 43 and the rear wheel 44, and the pedals 45 (including cranks and chain rings as necessary).
[0029] The e-bike 10 may also be provided with an LED that projects light onto the road surface around the e-bike 10 and uses that light to display a predetermined pattern on the road surface.
[0030] Furthermore, the e-bike 10 is equipped with various sensors, such as a camera that captures images of the user and their surroundings by sensing light, a microphone that collects sound by sensing sound, and a distance sensor that measures distance by sensing light or radio waves. Based on the sensor information output by the sensors, the e-bike 10 can control the illumination of the LEDs and the output of audio signals (corresponding vibrations and sounds) from the haptic device 61, speaker 71, and speakers 81-85.
[0031] FIG. 3 is a top view (plan view) showing the arrangement of the haptic device 61, speaker 71, and speakers 81 to 85 on the e-bike 10.
[0032] The haptic device 61(H) is located directly behind (behind) the user riding the e-bike 10 in a plan view.
[0033] The speaker 71 (MD) is located directly in front of the user riding the e-bike 10 in a plan view.
[0034] The speaker 81(C) is located directly in front of the user while riding the e-bike 10, and further away from the speaker 71. The speaker 82(FL) is located to the front left of the user while riding the e-bike 10. The speaker 83(FR) is located to the front right of the user while riding the e-bike 10. The speaker 84(SL) is located to the left (slightly behind) of the user while riding the e-bike 10. The speaker 85(SR) is located to the right (slightly behind) of the user while riding the e-bike 10.
[0035] In addition, Figure 3 also shows the positions of the haptic device 61, speaker 71, and speakers 81 to 85 in a three-dimensional coordinate system (XYZ coordinate system) with the user's position while riding the e-bike 10 as the origin (0, 0, 0).
[0036] <10 e-bike concepts, etc.>
[0037] FIG. 4 is a diagram illustrating the concept of the e-bike 10.
[0038] The concept of the e-bike 10 is that it is a connected e-bike with built-in speakers, the perfect buddy (SIDE-KICK) for enjoying Machi Asobi (playing in various places) to the fullest. To help consumers who become users of the e-bike 10 understand this concept, the e-bike 10 has three appealing points 1, 2, and 3.
[0039] Appeal point 1 is that the e-bike 10 does not tire easily even when ridden for long periods of time, is enveloped in pleasant sounds, and makes you want to keep riding forever. To achieve appeal point 1, the e-bike 10 has, for example, functions 1 and 2. Function 1 is a function that makes it easy to ride for long periods of time without getting tired, thanks to an ergonomic design. Function 2 is a function that uses high-performance speakers to envelop you in a pleasant acoustic space that blends with the surrounding sounds.
[0040] Appeal point 2 is that a dedicated AI (artificial intelligence) will be your companion, giving you a new way to enjoy your city. To achieve appeal point 2, the e-bike 10 has, for example, function 3. Function 3 is a function in which the conversational AI smoothly navigates you, whether you are guided to your destination or take a sudden detour.
[0041] Appeal point 3 is that various effects and content that enhance the enjoyment of cycling will stimulate your (the user's) curiosity. To achieve appeal point 3, the e-bike 10 has, for example, function 4. Function 4 is a function that adds excitement to the ride with sounds, lights, and vibrations that are automatically generated based on the passing scenery and pedaling while riding (the e-bike 10).
[0042] FIG. 5 is a diagram showing an example of an application (program) installed on the e-bike 10.
[0043] The e-bike 10 is equipped with applications such as "Music Generator" and "Safety."
[0044] The application "Music Generator" is an application that generates music that is unique to the user at that time and place in conjunction with the surrounding environment and the user's (the user's) operations. Audio signals (corresponding sounds and vibrations) of music etc. generated by the application "Music Generator" are output from the haptic device 61, speaker 71, and speakers 81 to 85 and are perceived by the user through their senses of touch and hearing.
[0045] The application "Safety" provides safety and security through audio danger notifications without interfering with the experience. The application "Safety" controls rear approach detection alerts, roadway detection (right-side driving alerts), and danger point alerts. The rear approach detection alert is a process that detects (senses) the approach of an object (including a living being such as a person) approaching from behind the e-bike 10 and issues an audio (voice) danger notification. The roadway detection is a process that detects when the e-bike 10 is driving in an inappropriate location on the road, for example, when driving on the right side of the road, and issues an audio danger notification. The danger point alert is a process that detects when the e-bike 10 is approaching a danger point, such as a location where a rockfall has occurred or a location where a traffic accident has occurred, and issues an audio danger notification.
[0046] The e-bike 10 can also be equipped with various other applications for providing Functions 1 to 4. For example, an application providing Function 4 can create a sort of moving installation.
[0047] For example, the e-bike 10 can stylishly decorate a city street by utilizing the illumination of the display and the illumination of the LEDs provided on the frame 20, etc. The e-bike 10 can also be a way for users to express their own fashion. For example, when two e-bikes 10 pass each other, the LED lights react to each other and gradually change. Furthermore, at a nighttime music festival where e-bikes 10 are encouraged to attend, the LED illumination of the e-bikes 10 of attendees can be simultaneously controlled to create an atmosphere similar to that of a festival using penlights. Furthermore, by controlling the LED illumination of the e-bikes 10 of attendees based on the beat of the music playing at the festival, the e-bikes 10 can change their appearance in time with the music and create a lively atmosphere at the festival. Simultaneous control of LED illumination can be performed in the same way as simultaneous control of tens of thousands of LED lights, such as the so-called FuriFura (registered trademark) penlights held by attendees.
[0048] FIG. 6 is a diagram showing a first example of the light emitted by the LEDs provided on the e-bike 10.
[0049] For example, when the e-bike 10 is stopped, the LEDs on the rim of the front wheel 43 can be lit in an arc that occupies approximately one-third of the circumference of the rim on the front side. Furthermore, the LEDs on the rim of the rear wheel 44 can be lit in an arc that occupies approximately one-third of the circumference of the rim on the rear side. The LEDs on the front wheel 43 and the LEDs on the rear wheel 44 can be lit in different colors. For example, the LEDs on the front wheel 43 can be lit in white, and the LEDs on the rear wheel 44 can be lit in red.
[0050] FIG. 7 is a diagram showing a second example of the light emitted by the LEDs provided on the e-bike 10.
[0051] For example, while the e-bike 10 is being driven, LEDs on the entire circumference of the rim of the rear wheel 44 can be lit.
[0052] FIG. 8 is a diagram showing a third example of the light emitted by the LEDs provided on the e-bike 10.
[0053] 8, LEDs are lit up on parts that form the skeleton of the e-bike 10, such as the frame 20, seat 31, handlebars 41, front fork 42, rims of the front wheel 43 and rear wheel 44, and pedals 45. By lighting up the LEDs on the parts that form the skeleton of the e-bike 10, you can enjoy riding the e-bike 10 as if it were floating in the darkness.
[0054] FIG. 9 is a diagram showing a fourth example of the light emitted by the LEDs provided on the e-bike 10.
[0055] In FIG. 9, the LEDs provided on the e-bike 10 emit light such that a point cloud pattern is formed on the road surface around the e-bike 10.
[0056] FIG. 10 is a diagram showing a fifth example of the light emission of the LED provided on the e-bike 10.
[0057] In FIG. 10 , the LEDs provided on the e-bike 10 emit light in such a way that double arc patterns are formed on the road surface in front of and behind the e-bike 10 .
[0058] As described above, the illumination of the LEDs provided on the e-bike 10 can be controlled based on the music being played at the venue and whether the e-bike 10 is stopped or moving, as well as based on the operation of an external operator or the operation of the user of the e-bike 10. Furthermore, the illumination of the LEDs can be controlled based on the scenery around the e-bike 10, the audio signals (corresponding to vibrations and sounds) output from the haptic device 61, the speaker 71, and the speakers 81-85, and other conditions of the e-bike 10 and the surrounding environment.
[0059] <Information Processing System Using E-Bike 10>
[0060] FIG. 11 is a diagram showing a first configuration example of an information processing system using the e-bike 10.
[0061] In FIG. 11, an information processing system 110 is composed of an e-bike 10 and a server (e-bike server) 111.
[0062] The e-bike 10 is a connected e-bike, and communicates with a server 111 via a network such as the Internet, a local area network (LAN), a wide area network (WAN), or a mobile phone network. The e-bike 10 communicates with the server 111, sends various types of information to the server 111 to store it, and receives and retrieves necessary information from the server 111.
[0063] For example, the e-bike 10 transmits sensor information from sensors provided on the e-bike 10 to the server 111. The e-bike 10 also receives, for example, audio signals such as content to be output from the haptic device 61, speaker 71, and speakers 81-85, and map data (corresponding to a map image) to be displayed on the display 91 for navigation, from the server 111. The e-bike 10 also receives, from the server 111, for example, AI (or a trained model) that performs various processes such as interactive AI, applications that perform various processes, control information for controlling the e-bike 10, and the like.
[0064] By executing AI and applications, the e-bike 10 controls the output of audio signals (corresponding sounds and vibrations) from the haptic device 61, speaker 71, and speakers 81 to 85. In addition, the e-bike 10 performs recognition, judgment, various data processing, etc. based on sensor information.
[0065] The server 111 stores various types of information transmitted from the e-bike 10 as necessary. The server 111 also uses the information from the e-bike 10 and other types of information as learning data to train various AIs and memorize (save) the trained AIs. The server 111 also stores applications released for the e-bike 10, music, sound effects, and other content (audio signals), etc. The server 111 also transmits information requested by the e-bike 10, such as AI, applications, and content (audio signals), to the e-bike 10. The server 111 can also generate control information for controlling the e-bike 10, for example, for controlling the illumination of an LED, and transmit this information to the e-bike 10.
[0066] The server 111 may be a virtual server such as a cloud server, or may be a physically existing server. Furthermore, if the cost of hardware such as high-performance processors continues to decrease in the future, such high-performance hardware may be installed on the e-bike 10. In this case, the e-bike 10 may be made into a so-called edge AI, and AI learning may be performed on the e-bike 10 rather than on the server 111.
[0067] FIG. 12 is a block diagram showing a first example of the electrical configuration of the e-bike 10.
[0068] That is, FIG. 12 shows an example of the electrical configuration of the e-bike 10 that constitutes the information processing system 110 of FIG.
[0069] In FIG. 12 , the e-bike 10 includes a battery 51, an SoC (System on a chip) 121, a GPS (Global Positioning System) unit 122, a BLE (Bluetooth (registered trademark) Low Energy) unit 123, a touch screen 124, a light-emitting unit 125, a microcontroller 126, a drive unit 127, a haptics unit 128, a sensor unit 129, and an audio unit 130.
[0070] Of the blocks that make up the e-bike 10, the SoC 121, microcontroller 126, drive unit 127, sensor unit 129, audio unit 130, and other blocks that require power are connected to the battery 51 via power supply lines so that they receive power from the battery 51. However, to avoid cluttering the diagram, the power supply lines have been omitted from the illustration. The same applies to Figure 14, which will be described later.
[0071] The SoC 121 includes an RF (Radio Frequency) modem 141, a CPU (Central Processing Unit) 142, and a GPU (Graphics Processing Unit) 143, and has functions equivalent to those of a smartphone as a computer and a communication device.
[0072] The RF modem 141 performs processes for communication with the server 111 etc. via a network, such as transmission and reception of RF signals, modulation to RF signals, and demodulation of RF signals. The RF modem 141 also performs processes for communication with the GPS unit 122 and the BLE unit 123.
[0073] The CPU 142 loads various programs such as applications and an OS (operating system) into a memory (not shown) and executes them to perform various processes, including control of the blocks that make up the e-bike 10.
[0074] The GPU 143 is responsible for image processing while the CPU 142 executes the program.
[0075] The GPS unit 122 receives radio waves from GPS satellites and supplies them to the RF modem 141 of the SoC 121. The SoC 121 detects (senses) the position of the e-bike 10 based on the radio waves from the GPS satellites.
[0076] The BLE unit 123 transmits a signal from the RF modem 141 by BLE communication, and also receives a signal (radio wave) by BLE communication and supplies it to the RF modem 141.
[0077] In addition to the GPS unit 122 and the BLE unit 123, the e-bike 10 may also be provided with an IF (interface) that transmits and / or receives radio waves for NFC (near field communication) communication or the like.
[0078] The touch screen 124 is configured by integrating a display 91 and a touch panel (operation panel) 151, and performs various displays and accepts user operations. That is, the display 91 performs various displays, such as images obtained by image processing by the CPU 142, and the touch panel 151 outputs operation signals corresponding to user operations. The SoC 121 performs various processes in response to the operation signals output by the touch panel 151.
[0079] The light-emitting unit 125 has an LED (not shown) provided on the frame 20 or the like, and a drive unit (not shown) that drives the LED. In the light-emitting unit 125, the drive unit drives the LED under the control of the SoC 121 (the CPU 142 thereof) to turn the LED on or off.
[0080] The microcontroller 126 controls the drive unit 127 under the control of the SoC 121. The drive unit 127 drives each unit (bicycle unit) of the e-bike 10 as a driven unit, such as a motor, under the control of the microcontroller 126.
[0081] The haptic unit 128 includes a haptic device 61 and a driving unit 161 that drives the haptic device 61. In the haptic unit 128, the driving unit 161 drives the haptic device 61, which is configured with an actuator such as a piezoelectric element or a motor, under the control of the SoC 121, to vibrate the haptic device 61.
[0082] The sensor unit 129 includes various sensors. For example, the sensor unit 129 includes the camera, microphone, and distance sensor described in FIGS. 1 and 2 . The sensor unit 129 also includes, for example, an IMU (Inertial Measurement Unit) that detects translational and rotational motion in three orthogonal axial directions, a temperature sensor (Temperature) that detects temperature, a pressure (pressure-sensitive) sensor that detects pressure, and a biosensor that detects biometric information. The pressure sensor and biosensor can be provided on parts of the e-bike 10 that come into contact with the user, such as the seat 31, the backrest 32, and the handlebars 41 (handle grips). The pressure sensor can recognize, for example, whether the user is seated or standing, and the user's posture, based on the pressure as sensor information output by the pressure sensor. The biosensor can recognize, for example, the user's level of tension or fatigue, based on the biometric information as sensor information output by the biosensor. If the user is wearing a wearable device such as a smartwatch, the biometric information can also be acquired from the wearable device. Other sensors that make up the sensor unit 129 may include sensors that detect the state of each part of the e-bike 10, such as a sensor that detects whether the stand of the e-bike 10 is up or down (stand state).
[0083] The audio unit 130 includes speakers such as the speaker 71 and speakers 81 to 85, and a power amplifier 171. The power amplifier 171 amplifies the audio signal supplied from the SoC 121 and supplies it to the speakers such as the speaker 71 and speakers 81 to 85 to output the corresponding sound.
[0084] In the e-bike 10 configured as described above, for example, the SoC 121 executes applications such as "Music Generator" and "Safety" to receive two-channel audio signals of content from the server 111, generate two-channel audio signals of content, and generate two-channel audio signals for danger notification sounds. Furthermore, the SoC 121 performs processing on the two-channel audio signals as appropriate. Examples of processing performed on the two-channel audio signals include multi-channel or three-way processing for outputting the audio signals from the haptic device 61, speaker 71, and speakers 81-85.
[0085] The SoC 121 supplies multi-channel audio signals to the haptic unit 128 and the audio unit 130. As a result, the SoC 121 outputs the audio signal of each channel from the haptic device 61 in charge of that channel, or the speaker 71 or speakers 81 to 85.
[0086] In the haptics unit 128, the haptics device 61 outputs the audio signal from the SoC 121 as vibration, and in the audio unit 130, the speaker 71 and speakers 81 to 85 output the audio signal from the SoC 121 as sound. As a result, the audio signal (and corresponding vibration and sound) from the SoC 121 is presented to the user.
[0087] FIG. 13 is a diagram showing a second configuration example of an information processing system using the e-bike 10.
[0088] In the figure, parts corresponding to those in FIG. 11 are given the same reference numerals, and the description thereof will be omitted below as appropriate.
[0089] In FIG. 13 , the information processing system 110 is composed of an e-bike 10 , a server 111 , and a smartphone 211 .
[0090] Therefore, the information processing system 110 in FIG. 13 is similar to the case in FIG. 11 in that it includes an e-bike 10 and a server 111, but differs from the case in FIG. 11 in that a smartphone 211 is newly provided.
[0091] In FIG. 11 , the e-bike 10 communicates with the server 111 directly, so to speak, but in FIG. 13 , the e-bike 10 communicates with the server 111 via a smartphone 211 .
[0092] 13, the smartphone 211 is, for example, a smartphone 211 owned by the user of the e-bike 10, and as described in Figures 1 and 2, can be attached to the e-bike 10 in place of the display 91 (which has a touch screen 124). The smartphone 211 functions as the SoC 121 to the touch screen 124 in Figure 12.
[0093] The smartphone 211 exchanges information with the e-bike 10 by communicating using a predetermined communication method, for example, Bluetooth (registered trademark) communication. For example, the smartphone 211 receives various types of information, such as sensor information, from the e-bike 10 and transmits it to the server 111. In addition, for example, the smartphone 211 receives necessary information, such as audio signals of content, from the server 111 and transmits it to the e-bike 10.
[0094] FIG. 14 is a block diagram showing a second example of the electrical configuration of the e-bike 10.
[0095] That is, FIG. 14 shows an example of the electrical configuration of the e-bike 10 that constitutes the information processing system 110 of FIG.
[0096] In the figure, parts corresponding to those in FIG. 12 are given the same reference numerals, and the description thereof will be omitted below as appropriate.
[0097] In FIG. 14, the e-bike 10 includes a battery 51, a light emitting unit 125, a microcontroller 126, a drive unit 127, a haptics unit 128, a sensor unit 129, an audio unit 130, an RTOS (Real Time Operating System) BLE module 221, and the like.
[0098] Therefore, the e-bike 10 in Fig. 14 is the same as the e-bike 10 in Fig. 12 in that it has a battery 51 and components from a light emitting unit 125 to an audio unit 130. However, the e-bike 10 in Fig. 14 differs from the e-bike 10 in Fig. 12 in that it does not have the SoC 121 to the touch screen 124, and instead has a new RTOS BLE module 221.
[0099] The RTOS BLE module 221 functions as an IF for BLE communication, and performs BLE communication with the smartphone 211 to send and receive information.
[0100] In FIG. 14, a smartphone 211 functions as the SoC 121 to the touch screen 124 in FIG. 12, and in combination with the e-bike 10, can perform the same processing as the e-bike 10 in FIG.
[0101] In FIG. 14, if the smartphone 211 is removed from the e-bike 10, it becomes difficult to detect the position of the e-bike 10. Therefore, the sensor unit 129 can be provided with a sensor (Position) that detects the position, such as the GPS unit 122 in FIG. 12.
[0102] The e-bike 10 of Figure 12 needs to incorporate an SoC 121 with functions equivalent to a smartphone, which requires a high-performance CPU 142 capable of running various applications. This makes the e-bike 10 of Figure 12 expensive. However, the e-bike 10 of Figure 12 does not require a smartphone 211.
[0103] On the other hand, with the e-bike 10 of Fig. 14, it is necessary to prepare a mobile terminal such as a smartphone 211 equivalent to the SoC 121, etc., and link (communicate, etc.) with the e-bike 10. However, because the e-bike 10 of Fig. 14 does not need to have an SoC 121, etc. built in, the e-bike 10 can be manufactured at low cost.
[0104] With respect to the e-bike 10 in FIG. 14 , the smartphone 211 is only responsible for communication with the server 111 and the like via the network, and communication with the e-bike 10, while other processing such as application execution (including processing by the audio signal processing device 250, described below) can be performed by the e-bike 10, that is, by the RTOS BLE module 221, or by providing the e-bike 10 with dedicated hardware (for example, a chip simpler than the SoC 121).
[0105] In addition, the smartphone 211 may be made to handle some of the other processes, and the e-bike 10 may be made to handle the remaining processes, thereby enabling load balancing.
[0106] For example, the smartphone 211 can be responsible for generating a two-channel audio signal, while the e-bike 10 can be responsible for processing the signal to be multi-channel or three-way.
[0107] Furthermore, for example, the smartphone 211 can be made to execute applications other than the application "Safety," while the e-bike 10 can be made to execute the application "Safety." Because BLE communication is performed between the e-bike 10 and the smartphone 211, when the application "Safety" is executed on the smartphone 211, the sensor information output by the sensor unit 129 needs to be sent from the e-bike 10 to the smartphone 211 via BLE communication. Furthermore, when the smartphone 211 recognizes a danger from the sensor information, it needs to generate an audio signal (corresponding to a sound) for danger notification and send it to the e-bike 10 via BLE communication. Therefore, the output of the audio signal for danger notification from the haptic device 61 of the e-bike 10 and the speaker 71 and speakers 81 to 85 is delayed from the output of the sensor information by the sensor unit 129 by at least the time required for BLE communication. When the "Safety" application is executed on the e-bike 10, the time delay required for BLE communication in outputting the audio signal for danger notification can be reduced compared to when the "Safety" application is executed on the smartphone 211.
[0108] In addition to executing the application "Safety," the e-bike 10 can be responsible for processing that is highly important and / or urgent and requires real-time processing in relation to safety and security.
[0109] <Audio signal processing device applying this technology>
[0110] FIG. 15 is a block diagram showing an example configuration of an embodiment of an audio signal processing device to which the present technology is applied.
[0111] The e-bike 10 functions as a processing device that performs various processes by having the SoC 121 (FIG. 12) as a computer or the smartphone 211 (FIG. 14) execute various applications.
[0112] FIG. 15 shows an example of the functional configuration of an audio signal processing device 250, which is one such processing device.
[0113] The e-bike 10 outputs audio signals such as content to provide an acoustic space for the user while riding the e-bike 10. However, when an audio signal is output from the e-bike 10, sound leaks into the surrounding area, which can be a nuisance to people around. Furthermore, the user of the e-bike 10 may be concerned about this nuisance to people around them and be unable to enjoy the content.
[0114] A first method for suppressing sound leakage is to cancel sound from areas other than the required area. A specific example of this first method is to use a vertical array speaker in which multiple speaker units (components in a speaker that output electrical signals as air vibrations) are arranged vertically. Other methods include, for example, a technology called area noise canceling and control of the area to which sound reaches using wave field synthesis.
[0115] However, with the first method, although it is easy to control the high-frequency components of the audio signal, which have short wavelengths, it is difficult to control the directivity of the low-frequency components, which have long wavelengths.
[0116] A second method for suppressing sound leakage is to use technology that achieves narrow directivity. Specific examples of this second method include using a horizontal array speaker in which multiple speaker units are arranged horizontally, using bone flare, using beam tweeters, and using a parabolic dome.
[0117] However, in the second method, in order to achieve narrow directivity, the speaker must be large to a certain extent, and the reproduction band is also narrowed.
[0118] A third method for suppressing sound leakage is to reduce the sound pressure level and narrow the area where the sound reaches by attenuating the sound over distance. A specific example of this third method is to use a wearable speaker, such as a neckband speaker, whose speaker unit can be placed close to the user's ear.
[0119] However, in the third method, if the speakers are arranged on the e-bike 10 so that the speaker units are located near the user's ears, as in the case of neck speakers, many restrictions arise, such as making it inconvenient to get on and off the e-bike 10. Furthermore, having the user wear a wearable neck speaker places a burden on the user. Furthermore, while speaker placement near the ears can involve, for example, placing two-channel speakers directly next to the user's left and right ears, such speaker placement raises concerns that the three-dimensional sound field generated by signal processing may be disrupted if the user's head position shifts while riding the e-bike 10. Specifically, for example, if a sound field is generated by signal processing to provide a three-dimensional sound representation in which a notification sound notifying the user of the approaching emergency vehicle sounds as if it is being played from the rear right when an emergency vehicle is approaching from the rear right, the user will naturally turn their head to the rear right. In this case, the position of the user's head (ear position) may shift, which may cause the stereophonic sound to be disrupted and the notification sound may not be heard from the rear right.
[0120] Therefore, the audio signal processing device 250 performs, for example, three-way processing, to generate multiple frequency components of the audio signal, as if the audio signal had been divided into multiple frequency bands. The audio signal processing device 250 then outputs each frequency component of the audio signal obtained by the three-way processing to the haptic device 61 and the speaker 71 and the speakers 81-85, which are responsible for the respective frequency bands. Furthermore, on the e-bike 10, the haptic device 61 and the speaker 71 and the speakers 81-85 are arranged as described with reference to FIGS. 1 and 2 . This reduces sound leakage to the surroundings. As a result, while riding the e-bike 10, the user can enjoy a comfortable cycling experience surrounded by sound without worrying about sound leakage to the surroundings.
[0121] Furthermore, the e-bike 10 recognizes either or both of the user's state and the surrounding situation based on the sensor information output by the sensor unit 129, and adjusts the level of the audio signal (the volume of the sound corresponding to the audio signal) based on the recognition result. By adjusting the level of the audio signal, the range of sound leakage is dynamically controlled without the user having to take the time to adjust the volume, and the ease with which the user can hear surrounding sounds while riding the e-bike 10 is controlled.
[0122] For example, when consideration is needed to prevent sound leakage into the surroundings, the e-bike 10 enters a quiet state that takes into account the direction in which consideration is needed. That is, the level of the audio signal is adjusted to further suppress sound leakage in the direction in which consideration is needed. Therefore, the user does not need to worry about sound leakage in the direction in which consideration is needed.
[0123] Furthermore, when consideration needs to be given to the ease with which the user of the e-bike 10 can hear surrounding sounds, the e-bike 10 enters a quiet state that takes into account the direction in which that consideration is needed. That is, the level of the audio signal is adjusted so that sounds from directions in which consideration is needed, such as the sound of an approaching car or the speech (voice) of a person riding a bicycle alongside the user (pedestrian), can be easily heard by the user of the e-bike 10. This improves safety against approaching cars and makes it easier to converse with pedestrians riding alongside.
[0124] 15, an audio signal processing device 250 includes a recognition unit 251 , a content acquisition unit 252 , a multi-channelization unit 253 , and a signal processing unit 254 .
[0125] The recognition unit 251 is supplied with sensor information output by the sensor unit 129. Based on the sensor information, the recognition unit 251 recognizes one or both of the state of the user of the e-bike 10 (including the state of the e-bike 10 being ridden by the user) and the surrounding situation, and supplies recognition information representing the recognition results to the content acquisition unit 252 and the signal processing unit 254.
[0126] For example, the recognition unit 251 recognizes (detects, determines) whether the user is speaking as the user's state based on an audio signal as sensor information output by a microphone constituting the sensor unit 129. Furthermore, for example, the recognition unit 251 recognizes the traveling speed of the user (of the e-bike 10 being ridden by the user) as the user's state based on sensor information output by an IMU constituting the sensor unit 129. Furthermore, for example, the recognition unit 251 recognizes whether the user (of the e-bike 10 being ridden by the user) is traveling or stopped as the user's state based on sensor information output by a sensor that detects the state of the stand of the e-bike 10. Furthermore, for example, the recognition unit 251 recognizes whether the user (of the e-bike 10 being ridden by the user) is seated or standing, or the user's posture as the user's state based on pressure as sensor information output by pressure sensors provided on the seat 31, backrest 32, handlebars 41, etc. constituting the sensor unit 129.
[0127] For example, the recognition unit 251 recognizes the presence or absence of speech by others in the vicinity, and specific sounds such as danger sounds, such as the sound of a car approaching the e-bike 10 (engine noise, horn sound, emergency vehicle siren, etc.), as surrounding conditions based on audio signals as sensor information output by the microphone constituting the sensor unit 129. Furthermore, for example, the recognition unit 251 recognizes the approach of a car or the like from behind, etc., as surrounding conditions based on images (including distance images) as sensor information output by the camera and distance measurement sensor constituting the sensor unit 129. Note that the recognition unit 251 not only recognizes the presence or absence of speech by others in the vicinity and specific sounds, but also recognizes the direction of the sound source by directional analysis, which analyzes the direction of the sound source of the speech (other people) or the sound source of the specific sound (cars, etc.).
[0128] The content acquisition unit 252 acquires audio signals for content, such as music that matches the surrounding circumstances (scenery, etc.) or sound effects that match the state of the e-bike 10, based on the recognition information from the recognition unit 251. The audio signals for content are acquired by receiving them from the server 111, reading them from a memory (not shown) built into the e-bike 10, or by generating them. Content can be generated, for example, using a generation AI or any other method. The content acquisition unit 252 acquires the two-channel audio signals for the content and supplies them to the multi-channelization unit 253.
[0129] It should be noted that content such as audio signals of predetermined sound effects can be stored in the built-in memory of the e-bike 10. Examples of predetermined sound effects include the sound that can be made when the stand of the e-bike 10 is kicked up, or a sound that beats out a rhythm according to the traveling speed of the e-bike 10.
[0130] The multi-channelization unit 253 performs a multi-channelization process to generate multi-channel audio signals from the audio signals of the content from the content acquisition unit 252. Here, in the multi-channelization process, seven-channel audio signals for the haptic device 61, speaker 71, and speakers 81 to 85 are generated from the two-channel audio signals of the content from the content acquisition unit 252. In the multi-channelization process, for example, a 5.1-channel audio signal can be generated from the two-channel audio signal, and a seven-channel audio signal can be generated from the 5.1-channel audio signal. The multi-channelization unit 253 supplies the multi-channel audio signals of the content obtained by the multi-channelization process to the signal processing unit 254.
[0131] The signal processing unit 254 performs signal generation processing to generate multiple frequency components of the audio signal from the (multi-channel) audio signal of the content from the multi-channel conversion unit 253. The signal generation processing is performed, for example, by filtering (applying an equalizer) the audio signal of each channel. The filtering processing is performed using a low-pass filter, a high-pass filter, or both a low-pass filter and a high-pass filter. The signal generation processing can be, for example, a three-way processing to generate low-frequency components, mid-frequency components, and high-frequency components of the audio signal of the content. In the three-way processing, a low-pass filter is applied to the audio signal of the channel for the haptic device 61, and both a low-pass filter and a high-pass filter are applied to the audio signal of the channel for the speaker 71. Furthermore, a high-pass filter is applied to the audio signal of the channels for the speakers 81 to 85. As a result, three frequency components, i.e., low-frequency components, mid-frequency components, and high-frequency components, of the audio signal of the content are generated.
[0132] The signal processing unit 254 performs necessary signal processing on the low-frequency components, mid-frequency components, and high-frequency components of the audio signal of the content. The signal processing unit 254 supplies the low-frequency components of the audio signal obtained as a result of the signal processing to a haptic device 61 that is responsible for (reproducing) the low-frequency components of the audio signal in the haptic unit 128. Furthermore, the signal processing unit 254 supplies the mid-frequency components of the audio signal obtained as a result of the signal processing to a speaker 71 that serves as a mid-frequency speaker that is responsible for (reproducing) the mid-frequency components of the audio signal in the audio unit 130. Furthermore, the signal processing unit 254 supplies the high-frequency components of the audio signal obtained as a result of the signal processing to speakers 81 to 85 that serve as high-frequency speakers that are responsible for (reproducing) the high-frequency components of the audio signal in the audio unit 130.
[0133] Note that, although the signal generation process described here involves three-way processing that generates three frequency components—low-frequency, mid-frequency, and high-frequency components—from the content audio signal, the signal generation process is not limited to this. The signal generation process can also generate two frequency components—a low-frequency component and a high-frequency component—or four or more frequency components—from the content audio signal. For example, when generating two frequency components—a low-frequency component and a high-frequency component—from the content audio signal during the signal generation process, the speaker 71 can be responsible for the high-frequency components along with the speakers 81-85, or the speakers 81-85 can be omitted and the speaker 71 alone can be responsible for the high-frequency components, or the e-bike 10 can be configured with the speakers 81-85 responsible for the high-frequency components and without the speaker 71.
[0134] <Configuration example of signal processing unit 254>
[0135] FIG. 16 is a block diagram showing an example of the configuration of the signal processing unit 254 in FIG.
[0136] In the following description, the audio signal of the content will also be referred to as the content signal.
[0137] 16, the signal processing unit 254 includes a signal generating unit 261 , a level adjusting unit 262 , and a superimposing unit 263 .
[0138] The signal generation unit 261 is supplied with the recognition information from the recognition unit 251 and the (multi-channel) content signal from the multi-channelization unit 253. As a signal generation process, the signal generation unit 261 performs 3-way conversion of the content signal to generate low-frequency components, mid-frequency components, and high-frequency components of the content signal. Furthermore, the signal generation unit 261 generates a haptic signal that drives the haptic device 61 based on the low-frequency components of the content signal and the recognition information.
[0139] The haptic signal can be generated by filtering the low-frequency components of a content signal. For example, for a content signal of unknown content (sound source), such as content generated by a generation AI, the haptic signal is generated based on the low-frequency components of the content signal.
[0140] Furthermore, the haptic signal can be generated, for example, by reading it from a memory (not shown) built into the e-bike 10. That is, for example, for a haptic signal for known content (sound source), an effective haptic signal can be created in advance and stored in memory built into the e-bike 10. Then, reading the haptic signal from that memory can be used to generate the haptic signal. Examples of known content include sound effects that are played when the stand of the e-bike 10 is kicked up, sound effects that create a rhythm according to the traveling speed of the e-bike 10, and pre-prepared content such as music content received from the server 111. The signal generation unit 261 can recognize the kicking up of the stand of the e-bike 10 and the traveling speed of the e-bike 10 from the recognition information. The signal generating unit 261 generates haptic signals such as a sound effect that is played when the stand of the e-bike 10 is kicked up, or a sound effect that beats out a rhythm according to the traveling speed of the e-bike 10, in accordance with recognition information such as the kicking up of the stand of the e-bike 10 and the traveling speed of the e-bike 10.
[0141] Furthermore, the signal generator 261 can generate mid-frequency components that are delayed more than the high-frequency components of the content signal by delaying the mid-frequency components of the content signal. Note that the delay time for delaying the mid-frequency components can be a time that causes the precedence effect (Haas effect), for example, a time that is greater than 0 seconds and equal to or less than 0.04 seconds.
[0142] The level adjustment unit 262 is supplied with the recognition information from the recognition unit 251 and the low-frequency component (the corresponding haptic signal), mid-frequency component, and high-frequency component of the content signal generated by the signal generation unit 261. The level adjustment unit 262 adjusts the levels of the mid-frequency component and high-frequency component of the content signal so that the sound pressure due to the mid-frequency component and high-frequency component is approximately the same at the position of the user riding the e-bike 10. The low-frequency component (the corresponding haptic signal) of the content signal is also adjusted so that the sound pressure felt by the user due to the vibration of the haptic device 61 in accordance with the low-frequency component is approximately the same as the sound pressure due to the mid-frequency component and high-frequency component. Furthermore, the level adjustment unit 262 adjusts the level of the high-frequency component of the content signal based on the recognition information.
[0143] The superimposing unit 263 is supplied with the recognition information from the recognition unit 251, the high-frequency components of the content signal generated by the signal generation unit 261, and the audio signal detected (collected) by the microphone that constitutes the sensor unit 129. When the superimposing unit 263 recognizes a danger, such as an approaching automobile to the e-bike 10, based on the recognition information, it superimposes an audio signal of a danger notification sound that notifies the danger onto the high-frequency components of the content signal. For example, the superimposing unit 263 separates an audio signal of the sound of a automobile approaching the e-bike 10 from the audio signal from the sensor unit 129. Furthermore, the superimposing unit 263 enhances the audio signal of the automobile sound and superimposes the enhanced audio signal of the automobile sound onto the high-frequency components of the content signal as an audio signal of a danger notification sound.
[0144] <3-way processing>
[0145] FIG. 17 is a diagram illustrating an example of the 3-way processing performed by the signal generating unit 261. In FIG.
[0146] In the 3-way processing, low-frequency components, mid-frequency components, and high-frequency components are generated as if the content signal were band-divided into low-frequency components, mid-frequency components, and high-frequency components.
[0147] Low-frequency components are, for example, frequency components between approximately 100 Hz and 300 Hz. Mid-frequency components are frequency components between approximately 100 Hz and 300 Hz and between approximately 1 kHz and 5 kHz. High-frequency components are frequency components between approximately 1 kHz and 5 kHz.
[0148] The low-frequency components of the content signal are output by supplying the low-frequency components (the corresponding haptic signal) to a haptic device 61 located on the backrest 32, which comes into contact with the back, which is susceptible to vibrations even while the e-bike 10 is in motion.
[0149] The mid-range components of the content signal are output by being supplied to speaker 71, which serves as a mid-range speaker and is positioned so that the mid-range components face in the direction of the user (the head (ears)) while riding the e-bike 10 and are positioned in front of and below the user.
[0150] The high-frequency components of the content signal are output by being supplied to speakers 81-85, which serve as high-frequency speakers that are positioned so that the high-frequency components face in the direction of the user (the head (ears)) while riding the e-bike 10 and are located at a height close to the height of the user's ears. As explained in FIGS. 1 and 2, speakers 81-83 are supported by a support 80 fixed to the handlebars 41, and speakers 84 and 85 are supported by the backrest 32. These speakers 81-85 can be positioned close to the ears of the user while riding the e-bike 10, as long as they do not significantly interfere with the user getting on and off the e-bike 10.
[0151] FIG. 18 is a diagram illustrating the output of the low-frequency component of the content signal by the haptic device 61. In FIG.
[0152] It is difficult to suppress sound leakage when the long-wavelength low-frequency components of the content signal are output from a speaker. Therefore, sound leakage can be suppressed by outputting the low-frequency components of the content signal as vibrations of the haptic device 61 arranged on the backrest 32. The vibration of the haptic device 61 arranged on the backrest 32 vibrates the user's spine (back), and the user can feel the low-frequency components of the content signal as sound (as if they were sound) through tactile stimulation.
[0153] FIG. 19 is a diagram illustrating the output of the mid-frequency component of the content signal by the speaker 71 serving as a mid-frequency speaker.
[0154] The mid-range components of the content signal are output from a speaker 71 that faces the user riding the e-bike 10 and is positioned in front of and below the user. Therefore, the mid-range components of the content signal are output from the speaker 71 in front of and below the user in a diagonally upward direction behind the e-bike 10. As a result, sound leakage in all directions of the e-bike 10 can be suppressed.
[0155] 16, the signal generator 261 generates mid-frequency components that are delayed relative to the high-frequency components of the content signal. As a result, the high-frequency components of the content reach the user riding the e-bike 10 earlier than the mid-frequency components of the content. As a result, due to the precedence effect, the user can perceive the sound image at the positions of speakers 81 to 85, which act as high-frequency speakers that output high-frequency components, rather than at the position of speaker 71, which acts as a mid-frequency speaker that outputs mid-frequency components.
[0156] FIG. 20 is a diagram for explaining the output of high-frequency components of a content signal by speakers 81 to 85 as high-frequency speakers.
[0157] The high-frequency components of the content signal are output from speakers 81 to 85, which are high-frequency speakers that face the direction of the user riding the e-bike 10 and are positioned at a height near the user's ears.
[0158] High-frequency components are easy to control for narrow directivity, and by outputting such high-frequency components from speakers 81-85 that are positioned so that they face the user riding the e-bike 10 and are at approximately the height of the user's ears, sound leakage to the surroundings can be suppressed. Furthermore, as described with reference to Figures 16 and 19, the mid-frequency components of the content signal are delayed more than the high-frequency components, so the high-frequency components reach the user earlier than the mid-frequency components of the content. As a result, due to the precedence effect, the user can recognize a sound image at the position of speakers 81-85, which act as high-frequency speakers outputting the high-frequency components.
[0159] The high-frequency speakers that output high-frequency components can be configured with small speaker units with a diameter of approximately 15 mm to 18 mm. Therefore, small speakers can be used as the high-frequency speakers 81 to 85, and using such small speakers increases the degree of freedom in placement.
[0160] Here, the frequency bands of each frequency component of the audio signal (content signal) generated in the 3-way processing as the signal generation processing, and the placement positions and placement angles of the speaker 71 as the mid-range speaker and the speakers 81 to 85 as the high-range speakers, are not limited to those described above. That is, the present technology can be applied to various mobile bodies other than bicycles. When applying the present technology to various mobile bodies, the frequency bands of each frequency component of the audio signal generated in the 3-way processing, and the placement positions and placement angles of the mid-range speaker and the high-range speaker can be set to suppress sound leakage depending on the mobile body to which the present technology is applied.
[0161] Furthermore, while the signal generation unit 261 is configured to delay the mid-frequency components of the content signal, it is possible to delay not only the mid-frequency components but also the low-frequency components (and the corresponding haptic signals) in the same way. For the low-frequency components, whether or not to delay them can be set, for example, depending on the placement position of the haptic device 61 that outputs the low-frequency components. That is, the haptic device 61 can be placed in a position other than the backrest 32 where vibrations from the haptic device 61 can stimulate the tactile sense of the user while riding the e-bike 10. Whether or not to delay the low-frequency components can be set depending on the placement position of the haptic device 61.
[0162] Here, the audio signal (content signal) is split into three frequency components: low-frequency component, mid-frequency component, and high-frequency component, and the low-frequency component is output from a haptic device 61 arranged on the backrest 32 that comes into contact with the user. The mid-frequency component is output from a speaker 71 arranged in front of and below the user, and the high-frequency component is output from speakers 81 to 85 arranged at about the height of the user's ears.
[0163] Sound leakage can be suppressed by any one or two of the following: outputting low-frequency components from the haptic device 61, outputting mid-frequency components from the speaker 71 positioned in front of and below the user, and outputting high-frequency components from the speakers 81 to 85 positioned at a height near the user's ears. Using two of these methods is more effective at suppressing sound leakage than using one, and using three of these methods is even more effective at suppressing sound leakage than using two.
[0164] FIG. 21 is a diagram illustrating the degree of sound leakage suppression achieved by adopting a 3-way configuration.
[0165] Figure 21 shows the measurement results of the amount of sound attenuation at a position 2 m from a user riding an e-bike 10 with and without a 3-way system. Note that in Figure 21, the amount of attenuation is shown as a negative value (dB).
[0166] For example, when directly behind the user, the attenuation is approximately 5 dB when 3-way is not implemented, whereas when 3-way is implemented, the attenuation is approximately 7.5 dB. Therefore, when 3-way is implemented, the attenuation is approximately 2.5 dB more than when not implemented, and it can be confirmed that sound leakage is suppressed.
[0167] The attenuation measurements were carried out in a room with walls, which means that there are effects of sound reflection and standing waves. However, the measurement results confirm that sound leakage is suppressed in most areas around the user riding the e-bike 10.
[0168] Here, the positions of the haptic device 61, the speaker 71 as a mid-range speaker, and the speakers 81 to 85 as high-range speakers are not limited to those described above. Also, the high-range speakers are not limited to the speakers 81 to 85.
[0169] For example, the haptic device 61 can be placed at any position where vibrations from the haptic device 61 can stimulate the tactile sense of the user while riding. For example, the haptic device 61 can be placed on the backrest 32, the seat 31 with which the user's buttocks come into contact, or the handlebars 41 with which the user's palms come into contact. Furthermore, multiple haptic devices 61 can be placed at multiple positions.
[0170] FIG. 22 is a diagram showing the arrangement of high-frequency speakers and the names of the high-frequency speakers.
[0171] The high-frequency speakers are positioned at a height approximately at ear height for a user riding the e-bike 10.
[0172] The high-frequency speaker placed in a position directly in front of the user riding the e-bike 10 is also called speaker C, and the high-frequency speakers placed in a position directly to the left and right of the user are also called speakers FL and FR, respectively.
[0173] The high-frequency speakers located to the left (slightly behind) and right (slightly behind) of the user are also referred to as speakers SL and SR, respectively.
[0174] Furthermore, the high-frequency speaker placed directly behind the user is also referred to as speaker SB, and the high-frequency speakers placed to the rear left and rear right of the user are also referred to as speakers SBL and SBR, respectively.
[0175] As the high-frequency speakers, speakers 81 to 85 corresponding to the five-channel speakers C, FL, FR, SL, and SR, as well as seven-channel speakers FL, C, FR, SR, SL, SBR, and SBL, and six-channel speakers FL, FR, SR, SL, SBR, and SBL can be used.Other high-frequency speakers that can be used include four-channel speakers FL, FR, SR, and SL, three-channel speakers FL, FR, and SB, three-channel speakers C, SR, and SL, and two-channel speakers C and SB.
[0176] <Adjustment of the Level of the Content Signal by the Level Adjustment Unit 262>
[0177] FIG. 23 is a diagram illustrating a first example of adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. In FIG.
[0178] Note that the following description will discuss adjusting the levels of the high-frequency components of the content signal output by speakers FL, FR, SL, and SR, assuming that the e-bike 10 has four-channel speakers FL, FR, SL, and SR corresponding to speakers 82 to 84 as high-frequency speakers. However, in addition to four-channel speakers FL, FR, SL, and SR, seven-channel speakers such as FL, C, FR, SR, SL, SBR, and SBL can also be used as high-frequency speakers that output the high-frequency components of the audio signal whose levels are to be adjusted. Other examples include six-channel speakers FL, FR, SR, SL, SBR, and SBL, five-channel speakers FL, C, FR, SR, and SL, three-channel speakers FL, FR, and SB, three-channel speakers C, SR, and SL, and two-channel speakers C and SB.
[0179] FIG. 23 shows an example of adjusting the level of the high-frequency component of the content signal when the recognition information indicates that no object is present within a predetermined range around the e-bike 10.
[0180] When there are no objects around the e-bike 10, the levels of the high-frequency components of the content signal output by the speakers FL, FR, SL, and SR can be adjusted to approximately the same level so that the sound leakage range falls within a predetermined range. "Approximately the same level" means that the sound pressure at the user's position while riding the e-bike 10 is approximately the same. The sound leakage range is the range in which the sound level corresponding to the content signal is equal to or greater than a predetermined value. The predetermined value can be set, for example, by subjective evaluation to determine the maximum sound level that a person does not find annoying. Furthermore, the predetermined value can be controlled based on the level of the surrounding environmental sound; if the level of the environmental sound is high, it can be controlled to a higher value, and if the level of the environmental sound is low, it can be controlled to a lower value.
[0181] Hereinafter, the level of the high-frequency components of the content signal output by the speakers FL, FR, SL, and SR when there are no objects around the e-bike 10 will also be referred to as the default level.
[0182] Based on the recognition information, the level adjustment unit 262 lowers the level of the high-frequency components of the content signal output from all or some of the speakers FL, FR, SL, and SR.
[0183] For example, the level adjustment unit 262 can reduce the level of the high-frequency components of the content signal output by one of the speakers FL, FR, SL, and SR that is located in the opposite direction from the direction in which sound leakage is desired to be suppressed, as seen from the user riding the e-bike 10, in consideration of sound leakage to the surrounding area.
[0184] Taking into consideration the directionality of the speakers FL, FR, SL, and SR, i.e., that the speakers FL, FR, SL, and SR are facing the user, the level of the high-frequency components of the audio signal output by the speakers located in the opposite direction from the direction in which sound leakage is desired to be suppressed is reduced, thereby reducing the range of sound leakage in the direction in which sound leakage is desired to be suppressed, and suppressing sound leakage.
[0185] Furthermore, for example, the level adjustment unit 262 can reduce the level of the high-frequency components of the content signal output by one of the speakers FL, FR, SL, and SR that is located in the direction from which the user wants to hear surrounding sounds when viewed from the user's perspective while riding the e-bike 10, in consideration of the ease with which the user can hear surrounding sounds.
[0186] Taking into consideration the directionality of the speakers FL, FR, SL, and SR, i.e., that the speakers FL, FR, SL, and SR are facing the direction of the user, the level of the high-frequency components of the content signal output by the speaker located in the direction from which the user wants to hear surrounding sounds is reduced, making it easier for the user to hear sounds from the direction from which the user wants to hear surrounding sounds.
[0187] As described above, the adjustment of the level of the high-frequency components of the content signal to take into consideration sound leakage to the surroundings, and the adjustment of the level of the high-frequency components of the content signal to take into consideration the ease with which the user can hear surrounding sounds, can be performed not just one way but both ways simultaneously.
[0188] FIG. 24 is a diagram illustrating a second example of the level adjustment of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. In FIG.
[0189] Figure 24 shows an example of adjusting the level of the high-frequency components of the content signal when the recognition information indicates that the e-bike 10 has stopped temporarily in front of a crosswalk, or when the recognition information indicates that a person (pedestrian) is present in front of the stopped e-bike 10.
[0190] If the e-bike 10 stops in front of a crosswalk or if there is a person in front of the stopped e-bike 10, the direction in which sound leakage needs to be suppressed is forward, toward the crosswalk or person. Therefore, the level of the high-frequency components of the content signal output by speakers SL and SR, for example, located in the opposite direction from the front, can be adjusted to be lower (by a predetermined value) than the default level.
[0191] In this case, the range of sound leakage ahead is reduced, and when a pedestrian is crossing the crosswalk, sound leakage to the pedestrian and people ahead can be suppressed.
[0192] FIG. 25 is a diagram illustrating a third example of the level adjustment of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. In FIG.
[0193] FIG. 25 shows an example of adjusting the level of the high-frequency components of the content signal when the recognition information indicates that the user has dismounted from the e-bike 10 and is pushing the e-bike 10, or when the recognition information indicates that the user has moved away from the e-bike 10.
[0194] When the user dismounts from the e-bike 10 and pushes it, or when the user moves away from the e-bike 10, it is appropriate to suppress sound leakage from the e-bike 10 in all directions. For this purpose, the levels of the high-frequency components of the content signals output by all speakers FL, FR, SL, and SR located in the opposite direction of each of the omnidirectional directions can be adjusted to be lower than the default level.
[0195] In this case, the range of sound leakage in all directions around the e-bike 10 is reduced, and sound leakage to people near the e-bike 10 can be suppressed.
[0196] In addition, when the user moves away from the e-bike 10, the output of the high-frequency components of the content signal from the speakers FL, FR, SL, and SR can be stopped to adjust the level of the high-frequency components of the content signal output by the speakers FL, FR, SL, and SR.
[0197] FIG. 26 is a diagram illustrating a fourth example of the level adjustment of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. In FIG.
[0198] FIG. 26 shows an example of adjusting the level of the high-frequency component of the content signal when the recognition information indicates that a person is approaching from the right rear of the e-bike 10 while it is in motion.
[0199] If a person is approaching from the rear right of the e-bike 10 while it is in motion, for example, if a person is riding a bicycle or a scooter, the direction in which sound leakage needs to be suppressed is the rear right from which the person is approaching. Therefore, for example, the level of the high-frequency components of the content signal output by a speaker FL located in the opposite direction from the rear right can be adjusted to be lower than the default level.
[0200] In this case, the range of sound leakage to the rear right is reduced, and sound leakage to a person approaching from the rear right can be suppressed.
[0201] FIG. 27 is a diagram illustrating a fifth example of the level adjustment of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. In FIG.
[0202] Figure 27 shows an example of adjusting the level of the high-frequency components of the content signal when the recognition information indicates that a person is riding alongside the e-bike 10 while it is in motion, and that the user is having a conversation with the person riding alongside (the person riding alongside).
[0203] If the user is having a conversation with a person riding alongside to the right of the e-bike 10 while it is moving, for example if the person riding alongside is a friend riding a bicycle and riding alongside the right side of the e-bike 10 while it is moving and talking to the user, the direction in which sound leakage needs to be suppressed is to the right, toward the person riding alongside. Therefore, the level of the high-frequency components of the content signal output by speakers FL and SL, for example, located in the opposite direction to the right, can be adjusted to be lower than the default level.
[0204] In this case, as shown in A of FIG. 27, the range of sound leakage to the right is reduced, and sound leakage to a person running alongside to the right can be suppressed.
[0205] Also, if the user is having a conversation with a person riding alongside them to the right of the e-bike 10 while they are riding, the direction in which the user wants to hear the surrounding sounds is to the right, where the person riding alongside is. Therefore, as shown in B of Fig. 27, the level of the high-frequency components of the content signal output by speakers FR and SR located to the right, for example, can be adjusted to be lower than the default level.
[0206] By reducing the level of the high frequency components of the content signal output by the speakers FR and SR located to the right, the user can more easily hear the voice (speech) of the person running alongside them to the right.
[0207] As described above, the adjustment of the level of the high-frequency components of the content signal to suppress sound leakage to people running alongside to the right and the adjustment of the level of the high-frequency components of the content signal to make it easier for the user to hear the voice of people running alongside to the right can be performed simultaneously.
[0208] For example, as shown in C of Fig. 27, the level of the high-frequency components of the content signal output by, for example, speaker SL, which is located in the opposite direction to the right where the person running alongside is located, and in which it is desired to suppress sound leakage, can be adjusted to be lower than the default level. At the same time, as shown in C of Fig. 27, the level of the high-frequency components of the content signal output by, for example, speakers FR and SR, which are located in the direction to the right where the person running alongside is located, and in which it is desired to hear surrounding sounds, can be adjusted to be lower than the default level.
[0209] In this case, the sound leakage range to the right front is reduced, and sound leakage to the person running alongside to the right is reduced, as shown in C of Fig. 27. At the same time, by reducing the level of the high-frequency components of the content signal output by the speakers FR and SR located to the right, the user can more easily hear the voice of the person running alongside to the right.
[0210] If a user riding the e-bike 10 is having a conversation with a person riding alongside them while the e-bike 10 is in motion, the level of the high-frequency components of the content signal output from some of the speakers FL, FR, SL, and SR can be adjusted down as described above, or the level of the high-frequency components of the content signal can be adjusted down for all of the speakers FL, FR, SL, and SR. Adjusting the level of the high-frequency components of the content signal output from the speakers FL, FR, SL, and SR also involves stopping the output of the high-frequency components of the content signal from the speakers FL, FR, SL, and SR.
[0211] In addition, when a user riding an e-bike 10 is having a conversation with a person riding alongside, the level of the high-frequency components of the content signal output by the speakers FL and SL located in the opposite direction (left direction) from the right side of the person riding alongside can be adjusted down to make it easier for the person riding alongside to hear the user's voice when the user is speaking, thereby reducing the range of sound leakage to the right side of the person riding alongside. Furthermore, when the person riding alongside is speaking, the level of the high-frequency components of the content signal output by the speakers FR and SR located on the right side (rightward direction) of the person riding alongside can be adjusted down to make it easier for the user to hear the person riding alongside.
[0212] Whether the user or the person running alongside is speaking can be determined, for example, by performing a direction analysis of the sound source (speaker) of the voice contained in the audio signal output by the microphone that constitutes the sensor unit 129.
[0213] FIG. 28 is a diagram illustrating a sixth example of the level adjustment of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. In FIG.
[0214] FIG. 28 shows an example of adjusting the level of the high-frequency component of the content signal when the recognition information indicates that an automobile (vehicle) is approaching from the right rear of the e-bike 10 while it is in motion.
[0215] If a car is approaching from the rear right of the e-bike 10 while it is in motion, from the perspective of user safety, the direction in which the user wants to hear surrounding sounds is the direction of the approaching car, i.e., the rear right. Therefore, for example, the level of the high-frequency components of the content signal output by a speaker SR located at the rear right can be adjusted to be lower than the default level.
[0216] By reducing the level of the high frequency components of the content signal output by the speaker SR located at the rear right, the user can more easily hear the sound of a car approaching from the rear right.
[0217] If a car is approaching from the rear right of the e-bike 10 while it is in motion, the user can adjust the level of the high-frequency components of the content signal output by the speaker SR located at the rear right as well as the speaker SL located at the rear left to be lower than the default level, so that the user can hear the sounds from behind more easily. In this case, the level of the high-frequency components of the content signal can be reduced less for the speaker SL located at the rear left, which is slightly offset from the direction of the approaching car (the rear right), than for the speaker SR located at the rear right, which is in a direction that is roughly aligned with the direction of the approaching car (the rear right).
[0218] FIG. 29 is a diagram illustrating a seventh example of adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262. In FIG.
[0219] FIG. 29 shows an example of adjusting the level of the high-frequency component of the content signal when the recognition information indicates that a specific sound has been recognized.
[0220] If a specific sound, such as a siren from an emergency vehicle, is being emitted near the e-bike 10 while it is in motion, it is desirable for the user to quickly recognize that a specific sound is being emitted, from the perspective of user safety and preventing the emergency vehicle from being obstructed. Therefore, for example, the level of the high-frequency components of the content signals output by all speakers FL, FR, SL, and SR can be adjusted to be lower than the default level. Alternatively, the level of the high-frequency components of the content signals output by speakers FL, FR, SL, and SR can be adjusted by stopping the output of the high-frequency components of the content signals from all speakers FL, FR, SL, and SR.
[0221] In addition, if the recognition information indicates that a specific sound source, for example, an emergency vehicle sounding a siren, is approaching, the level of the high-frequency component of the content signal output by one of the speakers FL, FR, SL, and SR that is located in the direction of the approaching emergency vehicle can be adjusted to be lower than the default level.
[0222] For example, as shown in Figure 29, if an emergency vehicle blaring a siren is approaching from the right rear of a moving e-bike 10, the level of the high-frequency components of the content signal output by the speaker SR located on the same right rear can be adjusted to a level lower than the default level so that the user can more easily hear the sound from the right rear.
[0223] In this case, as described above, when the levels of the high-frequency components of the content signals output by all speakers FL, FR, SL, and SR have already been adjusted to be lower, the level of the high-frequency components of the content signals output by the speaker SR located to the rear right can be adjusted to be even lower.
[0224] As for the speaker SR located at the rear right, the output of the high frequency component of the content signal can be stopped in order to adjust the level of the high frequency component of the content signal.
[0225] The specific sound can be set in advance.
[0226] FIG. 30 is a diagram illustrating an example of superimposing the audio signal of the danger notification sound onto the high-frequency component of the content signal by the superimposing unit 263 (content mix).
[0227] When the superimposing unit 263 recognizes a danger, such as an approaching automobile (vehicle) to the e-bike 10, based on the recognition information, it superimposes an audio signal of a danger notification sound that notifies of the danger onto the high-frequency components of the content signal.
[0228] In Figure 30, similar to Figure 28, the recognition information indicates that a car is approaching from the rear right of the moving e-bike 10. In this case, as explained in Figure 28, the level adjustment unit 262 can adjust the level of the high-frequency components of the content signal to be lower than the default level for the rear right speaker SR, and further, if necessary, for the rear left speaker SL.
[0229] The superimposing unit 263 can superimpose the audio signal of the danger notification sound on the high frequency component of the content signal output from the right rear speaker SR in the direction of the approaching vehicle, that is, the direction of the content signal output from the right rear speaker SR.
[0230] The danger notification sound may be, for example, a voice notifying of danger such as an approaching vehicle, or a predetermined warning sound. Furthermore, the danger notification sound (audio signal) may be, for example, a signal obtained by enhancing the audio signal of the sound of an approaching vehicle. The audio signal of the sound of the approaching vehicle can be obtained by the superimposing unit 263 separating the audio signal of the sound of the approaching vehicle contained in the audio signal collected by the microphone constituting the sensor unit 129.
[0231] As described above, by superimposing the audio signal of the danger notification sound on the high-frequency components of the content signal, the user can quickly recognize danger, such as an approaching car, and take action to avoid the danger if necessary.
[0232] The e-bike 10 to which the present technology is applied has been described above, but the present technology can be applied to various types of moving objects in addition to bicycles such as electrically assisted bicycles (including smart bikes) like the e-bike 10. For example, the present technology can be applied to personal mobility such as mopeds (motorcycles with pedals), motorcycles, kick scooters, wheelchairs, and golf carts. In addition, the present technology can be applied to various types of moving objects such as automobiles, airplanes, trains, and ships. Furthermore, the present technology can be applied to some indoor and outdoor spaces in addition to moving objects.
[0233] Furthermore, this technology is not only applicable to vehicles such as bicycles that the user rides in a state where the user is exposed to the outside, but also to vehicles such as automobiles with closed bodies (closed cars) that the user rides in a state where the user is housed inside and not exposed to the outside.
[0234] It should be noted that the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible within the scope of the present technology.
[0235] Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may also be present.
[0236] The present technology can have the following configurations.
[0237] <1> A mobile body in which a haptic device is arranged so that vibrations produced by the haptic device, which vibrates in accordance with low-frequency components of an audio signal, stimulate the tactile sense of a user while riding on the mobile body. <2> The mobile body described in <1>, in which the haptic device is arranged on a backrest that comes into contact with the back of the user while riding on the mobile body. <3> The mobile body described in <1> or <2>, in which the low-frequency components of the audio signal are frequency components of approximately 100 Hz to 300 Hz or less. <4> The mobile body described in any of <1> to <3>, in which a mid-range speaker that outputs mid-frequency components of the audio signal is arranged so as to face the user while riding on the mobile body and be located in front of and below the user while riding on the mobile body. <5> The mobile body described in <4>, further comprising a signal generation unit that generates mid-frequency components of the audio signal that are delayed relative to the high-frequency components of the audio signal. <6> The mobile body described in <4> or <5>, in which the mid-frequency components of the audio signal are frequency components of approximately 100 Hz to 300 Hz or more and approximately 1 kHz to 5 kHz or less. <7> The vehicle according to any one of <1> to <6>, wherein a high-frequency speaker that outputs a high-frequency component of the audio signal is positioned so as to face the user in a seated state and to be located at a height near the ear height of the user in a seated state. <8> The vehicle according to <7>, wherein the high-frequency component of the audio signal is a frequency component of approximately 1 kHz to 5 kHz or more. <9> The vehicle according to <7> or <8>, wherein the high-frequency speaker is a plurality of speakers. <10> The vehicle according to <9>, further comprising: a recognition unit that recognizes one or both of the state of the user and a surrounding situation; and a level adjustment unit that adjusts the level of the high-frequency component of the audio signal based on recognition information representing the recognition result of the recognition unit. <11> The vehicle according to <10>, wherein the level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker, of the plurality of speakers, that is located in the opposite direction from the direction in which sound leakage is desired to be suppressed, as seen from the user in a seated state.<12> The vehicle according to <11>, wherein the level adjustment unit reduces the level of a high-frequency component of the audio signal output by a speaker, of the plurality of speakers, that is located in a direction opposite to a direction of surrounding people as viewed from the user in a seated state. <13> The vehicle according to any one of <10> to <12>, wherein the level adjustment unit reduces the level of a high-frequency component of the audio signal output by a speaker, of the plurality of speakers, that is located in a direction from which the user in a seated state wants to hear ambient sounds. <14> The vehicle according to <13>, wherein the level adjustment unit reduces the level of a high-frequency component of the audio signal output by a speaker, of the plurality of speakers, that is located in a direction from which the user in a seated state wants to hear ambient sounds. <15> The vehicle according to <13>, wherein the level adjustment unit reduces the level of a high-frequency component of the audio signal output by a speaker, of the plurality of speakers, that is located in a direction from which the user in a seated state wants to hear an approaching vehicle. <16> The mobile body according to any one of <10> to <15>, wherein the level adjustment unit reduces the level of a high-frequency component of the audio signal output from all of the plurality of speakers when the user has dismounted. <17> The mobile body according to any one of <10> to <16>, further comprising a superimposing unit that superimposes an audio signal of a danger notification sound that notifies of danger onto the audio signal based on the recognition information. <18> The mobile body according to <17>, wherein the superimposing unit superimposes the audio signal of the danger notification sound onto the high-frequency component of the audio signal output by a speaker, of the plurality of speakers, that is located in the direction of an approaching vehicle as seen from the user in a riding state. <19> The mobile body according to <18>, wherein the superimposing unit superimposes an audio signal of a sound in which the sound of the vehicle is enhanced onto the high-frequency component of the audio signal as the audio signal of the danger notification sound. <20> The mobile body according to any one of <1> to <19>, wherein the mobile body is a bicycle.
[0238] 10 e-bike, 20 frame, 21 top tube, 22 down tube, 31 seat, 32 backrest, 41 handlebars, 42 front fork, 43 front wheel, 44 rear wheel, 45 pedals, 51 battery, 61 haptic device, 71 speaker, 80 support, 81-85 speaker, 91 display, 110 information processing system, 111 server, 121 SoC, 122 GPS unit, 123 BLE unit, 124 touch screen, 125 light-emitting unit, 126 microcontroller, 127 drive unit, 128 haptic unit, 129 sensor unit, 130 audio unit, 141 RF modem, 142 CPU, 143 GPU, 151 touch panel, 161 Driving unit, 171 power amplifier, 211 smartphone, 221 RTOS BLE module, 251 recognition unit, 252 content acquisition unit, 253 multi-channel unit, 254 signal processing unit, 261 signal generation unit, 262 level adjustment unit, 263 superposition unit
Claims
1. A moving body in which a haptics device that vibrates according to a low-frequency component of an audio signal is arranged so that the vibration stimulates the sense of touch of a user in a mounted state.
2. The moving body according to claim 1, wherein the haptics device is arranged on a backrest that contacts the back of the user in the mounted state.
3. The moving body according to claim 1, wherein the low-frequency component of the audio signal is a frequency component of approximately 100 Hz to 300 Hz or less.
4. The moving body according to claim 1, wherein a midrange speaker that outputs a midrange component of the audio signal is arranged so as to face the direction of the user in the mounted state and be positioned below and in front of the user in the mounted state.
5. The moving body according to claim 4, further comprising a signal generation unit that generates a midrange component of the audio signal that is delayed from a high-frequency component of the audio signal.
6. The moving body according to claim 4, wherein the midrange component of the audio signal is a frequency component of approximately 100 Hz to 300 Hz or more and approximately 1 kHz to 5 kHz or less.
7. The moving body according to claim 1, wherein a high-frequency speaker that outputs a high-frequency component of the audio signal is arranged so as to face the direction of the user in the mounted state and be positioned at a height near the height of the user's ears in the mounted state.
8. The moving body according to claim 7, wherein the high-frequency component of the audio signal is a frequency component of approximately 1 kHz to 5 kHz or more.
9. The moving body according to claim 7, having a plurality of speakers as the high-frequency speaker.
10. The moving body according to claim 9, further comprising a recognition unit that recognizes one or both of the state of the user and the surrounding situation, and a level adjustment unit that adjusts the level of the high-frequency component of the audio signal based on recognition information representing the recognition result of the recognition unit.
11. The moving body according to claim 10, wherein the level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker among the plurality of speakers that is located in a direction opposite to the direction in which sound leakage is to be suppressed when viewed from the user in the mounted state.
12. The moving body according to claim 11, wherein the level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker among the plurality of speakers that is located in a direction opposite to the direction of a person in the surroundings when viewed from the user in the mounted state.
13. The level adjustment unit reduces the level of the high-frequency component of the audio signal output by the speaker located in the direction in which the user in the mounted state wishes to hear ambient sound among the plurality of speakers. The moving body according to claim 10.
14. The level adjustment unit reduces the level of the high-frequency component of the audio signal output by the speaker located in the direction of an approaching vehicle among the plurality of speakers as viewed from the user in the mounted state. The moving body according to claim 13.
15. The level adjustment unit reduces the level of the high-frequency component of the audio signal output by the speaker located in the direction of the sound source of a specific sound among the plurality of speakers as viewed from the user in the mounted state. The moving body according to claim 13.
16. When the user is in the dismounted state, the level adjustment unit reduces the level of the high-frequency component of the audio signal output by all of the plurality of speakers. The moving body according to claim 10.
17. The moving body according to claim 10 further includes a superimposing unit that superimposes an audio signal of a danger notification sound for notifying danger on the audio signal based on the recognition information.
18. The superimposing unit superimposes the audio signal of the danger notification sound on the high-frequency component of the audio signal output by the speaker located in the direction of an approaching vehicle as viewed from the user in the mounted state among the plurality of speakers. The moving body according to claim 17.
19. The superimposing unit superimposes, as the audio signal of the danger notification sound, an audio signal of a sound obtained by enhancing the sound of the vehicle on the high-frequency component of the audio signal. The moving body according to claim 18.
20. A bicycle. The moving body according to claim 1.
Citation Information
Patent Citations
Feedforward-type noise-canceling headphones and feedback-type noise-canceling headphones
JP6274247B2
Obstacle alarm device
JP1993058219A
On-vehicle acoustic system
JP2015226147A
Vibration device, vibration device driving method, program, and recording medium
JP2022125275A
On-vehicle audio system
JP2023180846A