Mobile body
The e-bike uses a haptics device for tactile feedback and targeted audio delivery to reduce sound leakage, improving user experience and minimizing disturbance to others.
Patent Information
- Application Number
- JP2024000071
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-04
- Publication Date
- 2025-07-16
AI Technical Summary
Sound leakage from moving bodies, such as e-bikes, causes inconvenience to users and those around them, disrupting the user's experience and potentially disturbing others.
A haptics device on the e-bike vibrates in response to low-frequency audio components, providing tactile feedback to the user, while mid- and high-frequency audio is directed through specific speakers to minimize sound leakage.
This approach effectively suppresses sound leakage, allowing users to enjoy audio content without disturbing others and enhancing the overall riding experience.
Smart Images

Figure 2025106666000001_ABST
Abstract
Description
Technical Field
[0001] The present technology relates to a moving body, and particularly to a moving body that can suppress, for example, sound leakage to the surroundings.
Background Art
[0002] For example, Patent Document 1 describes a headphone that analyzes a noise signal picked up by a microphone and selects an optimal noise cancellation mode from a plurality of noise cancellation modes based on the analysis result.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] When a user listens to content such as music, sound leakage to the surroundings causes inconvenience to people around. Also, the user may be concerned about such inconvenience to people around and may not be able to fully immerse themselves in watching the content and may not enjoy it.
[0005] The present technology has been made in view of such a situation and is intended to suppress sound leakage to the surroundings.
Means for Solving the Problems
[0006] The moving body of the present technology is a moving body in which a haptics device that vibrates according to a low-frequency component of an audio signal is arranged so that the vibration of the haptics device stimulates the tactile sensation of a user in a mounted state.
[0007] In the moving body of the present technology, the haptic device that vibrates according to the low-frequency component of the audio signal is arranged so that the vibration by the haptic device stimulates the sense of touch of the user in the riding state.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
[0009] <One Embodiment of an e-Bike to Which the Present Technology is Applied>
[0010] FIG. 1 is a perspective view showing an example of an external configuration of an embodiment of an electric assist bicycle (e-bike) to which the present technology is applied. FIG. 2 is a right side view of the e-bike 10 showing an example of the external configuration of the e-bike 10 in FIG. 1.
[0011] In addition, in FIG. 2, in order to avoid complication of the figure, the speakers 71 and 81 to 85 shown in FIG. 1 are shown as ellipses.
[0012] A seat (saddle) 31 is arranged behind the top tube 21 of the frame 20 of the e-bike 10, and a speaker 71 is arranged in front of the top tube 21.
[0013] The speaker 71 (MD) is, for example, a midrange speaker that outputs midrange components (sounds corresponding thereto) of audio signals such as music and other content. The speaker 71 is arranged so as to face the direction of a user in a state of riding on the e-bike 10, that is, a user sitting on the seat 31 (having directivity in the direction of the user). Since the seat 31 is arranged behind the top tube 21 where the speaker 71 is arranged in the front, it can be said that the speaker 71 is arranged so as to be located below the front of the user in a riding state.
[0014] At the rear part of the seat 31, a backrest 32 that contacts the back of the user in the state of riding on the e-bike 10 is arranged. A haptics device 61 is arranged at, for example, a portion of the backrest 32 that contacts the back of the user in the state of riding on the e-bike 10.
[0015] In FIG. 2, for the sake of clarity of the haptics device 61, the haptics device 61 is shown as an ellipse. However, the haptics device 61 is built into the backrest 32 and actually cannot be seen from the outside.
[0016] Note that the arrangement position of the haptics device 61 is not limited to the backrest 32. The haptics device 61 may be arranged as long as the vibration by the haptics device 61 stimulates the tactile sensation of the user in the state of riding on the e-bike 10.
[0017] The haptics device 61 vibrates according to the low-frequency component of the audio signal. By the vibration by the haptics device 61 stimulating the tactile sensation of the user, that is, by applying vibration to the backbone of the user sitting on the seat 31 by the haptics device 61 (backbone vibration), the low-frequency component of the audio signal is reproduced not as sound but as a bass feeling. The user feels the low-frequency component of the audio signal tactilely by the vibration by the haptics device 61.
[0018] The battery 51 is detachably attached to the down tube 22 of the frame 20. The battery 51 supplies power to, for example, the light 52 provided on the front fork 42, a motor (not shown) of the e-bike, and other necessary blocks.
[0019] A support 80 (FIG. 1) is fixed to the handlebar or the stem of the handle 41. The support 80 supports the speakers 81 to 83 so that the speakers 81 to 83 are arranged in a predetermined state.
[0020] Speakers 81 to 83 are high-range speakers that output high-frequency components (sounds corresponding thereto) of the audio signal. The e-bike 10 has speakers 84 and 85 in addition to speakers 81 to 83 as high-range speakers. Therefore, the e-bike 10 has five speakers 81 to 85, which are a plurality of speakers, as high-range speakers.
[0021] Speakers 84 and 85 are supported by the backrest 32.
[0022] All of the speakers 81 to 85 are arranged to face the direction of the user in the state of riding on the e-bike 10 and to be positioned at a height near the height of the user's ears in the state of riding on the e-bike 10.
[0023] That is, the speaker 81 (C) is supported by the support 80 so as to be positioned in the front direction of the user in the state of riding on the e-bike 10, face the direction of the user, and be positioned at a height near the height of the user's ears. The speaker 82 (FL) is supported by the support 80 so as to be positioned in the front left direction of the user in the state of riding on the e-bike 10, face the direction of the user, and be positioned at a height near the height of the user's ears. The speaker 83 (FR) is supported by the support 80 so as to be positioned in the front right direction of the user in the state of riding on the e-bike 10, face the direction of the user, and be positioned at a height near the height of the user's ears. The speaker 84 (SL) is supported by the backrest 32 so as to be positioned on the left (slightly rearward) of the user in the state of riding on the e-bike 10, face the direction of the user, and be positioned at a height near the height of the user's ears. The speaker 85 (SR) is supported by the backrest 32 so as to be positioned on the right (slightly rearward) of the user in the state of riding on the e-bike 10, face the direction of the user, and be positioned at a height near the height of the user's ears.
[0024] Note that a support tool 80 for supporting speakers 81 to 83 and a backrest 32 for supporting speakers 84 and 85 can be provided with a height adjustment mechanism for adjusting the heights of speakers 81 to 85. In the e-bike 10, the ears of the user in the state of riding on the e-bike 10 are detected, and in the height adjustment mechanism, the positions (heights) of speakers 81 to 85 can be adjusted so that speakers 81 to 85 are located at heights near the heights of the detected ears of the user.
[0025] A display 91 for performing various displays is provided on the handlebar or stem of the handle 41. The display 91 is integrated with a touch panel to form a touch screen and also functions as an operation panel for receiving various operations of the user.
[0026] Note that the e-bike 10 can be configured such that a mobile terminal having a communication function and capable of executing an application (program), such as a smartphone, can be detachably attached to the handlebar or stem of the handle 41 instead of providing the display 91. Then, the smartphone can be used as the display 91 and the operation panel.
[0027] In addition, various displays can be performed not only on the display 91 but also on smart glasses (including contact lenses) worn by the user.
[0028] In the e-bike 10, a light source, for example, an LED (light emitting diode) is provided in a part forming the so-called skeleton. By the LED emitting light, an effect can be achieved such that the e-bike 10 stands out in a dark environment. The part forming the skeleton of the e-bike 10 is, for example, the frame 20, the seat 31, the handle 41, the front fork 42, the rims of the front wheel 43 and the rear wheel 44, and the pedal 45 (including a crank and a chain ring as required), etc.
[0029] In addition, the e-bike 10 can also be provided with an LED that irradiates light on the road surface around the e-bike 10 and displays a predetermined pattern on the road surface by the light.
[0030] Furthermore, the e-bike 10 is provided with various sensors such as a camera that captures the user and the surroundings by sensing light, a microphone that collects sound by sensing sound, and a distance measuring sensor that measures distance by sensing light or radio waves. In the e-bike 10, based on the sensor information output by the sensors, it is possible to control the light emission of the LED and the output of vibration and sound corresponding to the audio signals from the haptics device 61 and the speakers 71 and 81 to 85.
[0031] FIG. 3 is a top view (plan view) showing the arrangement of the haptics device 61, the speaker 71, and the speakers 81 to 85 in the e-bike 10.
[0032] The haptics device 61 (H) is located directly behind the user in the state of riding on the e-bike 10 in a plan view.
[0033] The speaker 71 (MD) is located directly in front of the user in the state of riding on the e-bike 10 in a plan view.
[0034] The speaker 81 (C) is located at a position farther from the speaker 71 in the direct front of the user in the state of riding on the e-bike 10. The speaker 82 (FL) is located in the front left direction of the user in the state of riding on the e-bike 10. The speaker 83 (FR) is located in the front right direction of the user in the state of riding on the e-bike 10. The speaker 84 (SL) is located on the left (slightly rearward) of the user in the state of riding on the e-bike 10. The speaker 85 (SR) is located on the right (slightly rearward) of the user in the state of riding on the e-bike 10.
[0035] In addition, in FIG. 3, the positions of the haptics device 61, the speaker 71, and the speakers 81 to 85 in a three-dimensional coordinate system (XYZ coordinate system) with the position of the user in the state of riding on the e-bike 10 as the origin (0, 0, 0) are also shown.
[0036] <Concepts of the e-bike 10, etc.>
[0037] FIG. 4 is a diagram for explaining the concept of the e-bike 10.
[0038] The concept of the e-bike 10 is the ultimate buddy (SIDE-KICK), a speaker-equipped connected e-bike that allows you to fully enjoy Machiasobi (playing in various places). To make consumers who become users of the e-bike 10 feel this concept, the e-bike 10 has three appeal points 1, 2, and 3.
[0039] Appeal point 1 is that it is not tiring even after a long ride and is wrapped in a pleasant sound, making you want to keep riding forever. To achieve appeal point 1, the e-bike 10 has, for example, functions 1 and 2. Function 1 is a design that pursues ergonomics and is a function that is not tiring even after a long ride. Function 2 is a function where a high-performance speaker wraps you in a pleasant acoustic space that blends with the surrounding sounds.
[0040] Appeal point 2 is that a dedicated AI (artificial intelligence) becomes your buddy and gives you new ways to enjoy the city. To achieve appeal point 2, the e-bike 10 has, for example, function 3. Function 3 is a function where an interactive AI smoothly navigates you to your destination and also to any detours.
[0041] Appeal point 3 is that various effects and contents that expand the fun of cycling stimulate your (the user's) curiosity. To achieve appeal point 3, the e-bike 10 has, for example, function 4. Function 4 is a function that enlivens with your own unique sound, light, and vibration effects automatically generated from the scenery passing by and pedaling during the ride (of the e-bike 10).
[0042] FIG. 5 is a diagram showing an example of an application (program) installed in the e-bike 10.
[0043] The e-bike 10 is equipped with, for example, applications such as "Music Generator" and "Safety".
[0044] The application "Music Generator" is an application that generates music unique to the user at that time and place in conjunction with the surrounding environment and the user's own operations. Audio signals (corresponding sounds and vibrations) such as music generated by the application "Music Generator" are output from the haptics device 61, as well as the speakers 71 and 81 - 85, and are perceived by the user through the user's sense of touch and hearing.
[0045] The application "Safety" is an application that provides a sense of safety without hindering the experience through voice-based danger notifications. The application "Safety" performs controls such as rear approach detection alerts, driving lane detection (right-hand driving alerts), and danger location alerts. The rear approach detection alert is a process of detecting an object (including living organisms such as people) approaching the rear of the e-bike 10 and issuing a danger notification by sound. The driving lane detection is a process of detecting when the e-bike 10 is driving in an inappropriate location on the road, for example, when driving on the right side of the road, and issuing a danger notification by sound. The danger location alert is a process of detecting that the e-bike 10 is approaching a dangerous location, such as a location where a rockfall has occurred or an accident has taken place, and issuing a danger notification by sound.
[0046] The e-bike 10 can also be equipped with various applications for providing functions 1 - 4. For example, an application that provides function 4 can realize a so-called running installation.
[0047] That is, for example, the e-bike 10 can colorfully decorate the streets while making use of the light emission of the display and the light emission of the LEDs provided on the frame 20 and the like. The e-bike 10 can become one of the user's own fashion expressions. For example, when e-bikes 10 pass by each other, the lights of the LEDs react with each other and gradually change. Also, for example, at a night music festival that recommends the presence of e-bikes 10, the light emission of the LEDs of the e-bikes 10 of the attendees can be controlled all at once to perform the same kind of venue production as that done with penlights. Furthermore, for example, based on the beat of the music playing at the venue and the like, by controlling the light emission of the LEDs of the e-bikes 10 of the attendees, it is possible to change the so-called expression of the e-bikes 10 according to the music or to perform a production that enlivens the venue. The simultaneous control of the light emission of the LEDs can be performed in the same way as, for example, the simultaneous control of tens of thousands of LED lights such as penlights that the attendees have, called Flifla (registered trademark).
[0048] FIG. 6 is a diagram showing a first example of the light emission of the LEDs provided on the e-bike 10.
[0049] For example, when the e-bike 10 is parked, it is possible to turn on the LEDs in the arc portion of approximately one-third of the front side of the circumference as the rim among the LEDs provided on the rim of the front wheel 43. Furthermore, it is possible to turn on the LEDs in the arc portion of approximately one-third of the rear side of the circumference as the rim among the LEDs provided on the rim of the rear wheel 44. The LEDs of the front wheel 43 and the LEDs of the rear wheel 44 can be turned on in different colors. For example, the LEDs of the front wheel 43 can be turned on white, and the LEDs of the rear wheel 44 can be turned on red.
[0050] FIG. 7 is a diagram showing a second example of the light emission of the LEDs provided on the e-bike 10.
[0051] For example, when the e-bike 10 is running, it is possible to turn on the LEDs in the entire circumferential portion as the rim of the rear wheel 44.
[0052] FIG. 8 is a diagram showing a third example of the light emission of the LEDs provided in the e-bike 10.
[0053] In FIG. 8, the LEDs provided on the parts forming the skeleton of the e-bike 10, for example, the frame 20, the seat 31, the handle 41, the front fork 42, the rims of the front wheel 43 and the rear wheel 44, and the pedal 45 are lit. By lighting the LEDs on the parts forming the skeleton of the e-bike 10, it is possible to enjoy the e-bike 10 that seems to float in the dark.
[0054] FIG. 9 is a diagram showing a fourth example of the light emission of the LEDs provided in the e-bike 10.
[0055] In FIG. 9, the LEDs are emitting light so that a dot pattern is formed on the road surface around the e-bike 10 by the light of the LEDs provided in the e-bike 10.
[0056] FIG. 10 is a diagram showing a fifth example of the light emission of the LEDs provided in the e-bike 10.
[0057] In FIG. 10, the LEDs are emitting light so that a double arc pattern is formed on the road surface in front of and behind the e-bike 10 respectively by the light of the LEDs provided in the e-bike 10.
[0058] As described above, the light emission of the LEDs provided in the e-bike 10 can be controlled based on the music playing at the venue, whether the e-bike 10 is stopped or running, in addition to being controlled based on the operation of an external operator or the operation of the user of the e-bike 10. Furthermore, the light emission of the LEDs can be controlled based on the scenery around the e-bike 10, the haptics device 61, and the audio signals (corresponding to vibration and sound) output from the speakers 71 and 81 to 85, and other states and surrounding environments of the e-bike 10.
[0059] <Information Processing System Using the e-bike 10>
[0060] FIG. 11 is a diagram showing a first configuration example of an information processing system using the e-bike 10.
[0061] In FIG. 11, the information processing system 110 is composed of the e-bike 10 and a server (e-bike server) 111.
[0062] The e-bike 10 is a connected e-bike and communicates with the server 111 via the Internet, a LAN (local area network), a WAN (wide area network, such as a mobile phone network). The e-bike 10 communicates with the server 111, stores various information by sending it to the server 111, and retrieves necessary information by receiving it from the server 111.
[0063] For example, the e-bike 10 sends sensor information of sensors provided in the e-bike 10 to the server 111. Also, for example, the e-bike 10 receives audio signals such as content to be output from the haptics device 61, the speaker 71, and the speakers 81 to 85, and map data (corresponding to a map image) to be displayed on the display 91 for navigation from the server 111. The e-bike 10 also receives, for example, an AI (a learned model as an AI) that performs various processes such as interactive AI, an application that performs various processes, control information for controlling the e-bike 10, etc. from the server 111.
[0064] The e-bike 10 controls the output of audio signals (corresponding sounds and vibrations) from the haptics device 61, the speaker 71, and the speakers 81 to 85 by executing the AI and the application. In addition, the e-bike 10 performs recognition, determination, various data processing, etc. based on the sensor information.
[0065] Server 111 stores various information sent from e-bike 10 as needed. In addition, server 111 uses the information from e-bike 10 and other various information as learning data to perform learning of various AIs and stores the learned AIs. Furthermore, server 111 stores applications released for e-bike 10, and contents such as music and sound effects (audio signals). Also, server 111 transmits information requested from e-bike 10, such as AIs, applications, and contents (audio signals), to e-bike 10. In addition, server 111 can generate control information for controlling e-bike 10, such as LED lighting control, and transmit it to e-bike 10.
[0066] Note that server 111 may be a virtual server such as a cloud server or a physically existing server. Also, when the cost reduction of hardware such as high-performance processors progresses in the future, such high-performance hardware can be installed in e-bike 10. In this case, e-bike 10 can be made into a so-called edge AI, and AI learning can be performed on e-bike 10 instead of server 111.
[0067] FIG. 12 is a block diagram showing a first electrical configuration example of e-bike 10.
[0068] That is, FIG. 12 shows an electrical configuration example of e-bike 10 that constitutes information processing system 110 in FIG. 11.
[0069] In FIG. 12, e-bike 10 includes battery 51, system on a chip (SoC) 121, global positioning system (GPS) unit 122, Bluetooth (registered trademark) low energy (BLE) unit 123, touch screen 124, light emitting unit 125, microcontroller 126, drive unit 127, haptics unit 128, sensor unit 129, and audio unit 130, etc.
[0070] Among the blocks that make up the e-bike 10, the SoC 121, the microcontroller 126, the drive unit 127, the sensor unit 129, and the audio unit 130, and other blocks that require power are connected via a power supply line for power supply to the battery 51 so that power is supplied from the battery 51. However, the illustration of the power supply line is omitted to avoid making the figure complicated. The same applies to FIG. 14 described later.
[0071] The SoC 121 has an RF (Radio Frequency) modem 141, a CPU (Central Processing Unit) 142, a GPU (Graphics Processing Unit) 143, etc., and has a function equivalent to that of a smartphone as a computer and a communication device.
[0072] The RF modem 141 performs processing for communication with the server 111 etc. via the network, such as transmission and reception of RF signals, modulation of RF signals, and demodulation of RF signals. The RF modem 141 also performs processing for communication with the GPS unit 122 and the BLE unit 123.
[0073] The CPU 142 loads various programs such as applications and an OS (operating system) into a memory (not shown) and executes them, thereby performing various processes including control of each block that makes up the e-bike 10.
[0074] The GPU 143 is in charge of image processing while the CPU 142 executes a program.
[0075] The GPS unit 122 receives radio waves from GPS satellites and supplies them to the RF modem 141 of the SoC 121. In the SoC 121, the position of the e-bike 10 is detected (sensed) based on the radio waves from the GPS satellites.
[0076] The BLE unit 123 transmits the signal from the RF modem 141 by BLE communication, receives the signal (radio wave) by BLE communication, and supplies it to the RF modem 141.
[0077] Note that the electric bicycle 10 can be provided with an IF (interface) that transmits and / or receives radio waves such as NFC (near field communication) communication, in addition to the GPS unit 122 and the BLE unit 123.
[0078] The touch screen 124 is configured by integrating the display 91 and the touch panel (operation panel) 151, and performs various displays and accepts user operations. That is, the display 91 performs various displays, for example, displays an image obtained by the image processing of the CPU 142, and the touch panel 151 outputs an operation signal corresponding to the user operation. The SoC 121 performs various processes according to the operation signal output by the touch panel 151.
[0079] The light emitting unit 125 includes an LED (not shown) provided on the frame 20 or the like and a driving unit (not shown) that drives the LED. In the light emitting unit 125, the driving unit drives the LED according to the control of the SoC 121 (CPU 142 thereof) to turn the LED on or off.
[0080] The microcontroller 126 controls the driving unit 127 according to the control of the SoC 121. The driving unit 127 drives each unit (Bicycle Unit) of the electric bicycle 10 as the driven unit, for example, a motor or the like, according to the control of the microcontroller 126.
[0081] The haptics unit 128 includes a haptics device 61 and a driving unit 161 that drives the haptics device 61. In the haptics unit 128, the driving unit 161 drives the haptics device 61, which is composed of an actuator such as a piezo element or a motor, according to the control of the SoC 121 to vibrate the haptics device 61.
[0082] The sensor unit 129 has various sensors. The sensor unit 129 has, for example, the cameras, microphones, and distance measurement sensors described with reference to FIGS. 1 and 2. Further, the sensor unit 129 has, for example, an IMU (Inertial Measurement Unit) as a sensor that detects translational and rotational motions in three orthogonal axial directions, a temperature sensor (Temp) that detects temperature, a pressure (pressure-sensitive) sensor that detects pressure, a biological sensor that detects biological information, and the like. The pressure sensor and the biological sensor can be provided at portions of the e-bike 10 that come into contact with the user, such as the seat 31, the backrest 32, the handle 41 (handle grip). Regarding the pressure sensor, based on the pressure as the sensor information output by the pressure sensor, for example, it is possible to recognize whether the user is sitting, standing up, or the user's posture. Regarding the biological sensor, based on the biological information as the sensor information output by the biological sensor, for example, it is possible to recognize the user's degree of tension or fatigue. Regarding the biological information, for example, when the user wears a wearable device such as a smartwatch, it can also be obtained from the wearable device. In addition, as sensors constituting the sensor unit 129, for example, sensors that detect the states of respective parts of the e-bike 10, such as a sensor that detects whether the stand of the e-bike 10 is standing or raised (stand state), can be provided.
[0083] The audio unit 130 has speakers such as the speaker 71 and the speakers 81 to 85, and a power amplifier 171. The power amplifier 171 amplifies the audio signal supplied from the SoC 121 and supplies it to the speakers such as the speaker 71 and the speakers 81 to 85 to output (corresponding sounds).
[0084] In the e-bike 10 configured as described above, for example, the SoC 121 executes applications such as "Music Generator" and "Safety" to receive a two-channel audio signal of content from the server 111, generate a two-channel audio signal of content, generate a two-channel audio signal of sound for danger notification, etc. Further, the SoC 121 appropriately processes the two-channel audio signal. Examples of the processing performed on the two-channel audio signal include multi-channel conversion and 3-way conversion for outputting the audio signal from the haptic device 61, the speaker 71, and the speakers 81 to 85.
[0085] The SoC 121 supplies the multi-channel audio signal to the haptic unit 128 and the audio unit 130. Thereby, the SoC 121 causes the haptic device 61 responsible for that channel, or the speaker 71 or the speakers 81 to 85, to output the audio signal of each channel.
[0086] In the haptic unit 128, the haptic device 61 outputs the audio signal from the SoC 121 as vibration, and in the audio unit 130, the speakers 71 and the speakers 81 to 85 output the audio signal from the SoC 121 as sound. Thereby, the audio signal (corresponding vibration, sound) from the SoC 121 is presented to the user.
[0087] FIG. 13 is a diagram showing a second configuration example of the information processing system using the e-bike 10.
[0088] In the figure, parts corresponding to those in FIG. 11 are denoted by the same reference numerals, and their descriptions will be omitted as appropriate below.
[0089] In FIG. 13, the information processing system 110 is composed of the e-bike 10, the server 111, and the smartphone 211.
[0090] Therefore, the information processing system 110 in FIG. 13 is common with the case of FIG. 11 in that it has the e-bike 10 and the server 111, and is different from the case of FIG. 11 in that the smartphone 211 is newly provided.
[0091] In FIG. 11, the e-bike 10 communicates directly with the server 111, while in FIG. 13, the e-bike 10 communicates with the server 111 via the smartphone 211.
[0092] In FIG. 13, the smartphone 211 is, for example, the smartphone 211 owned by the user of the e-bike 10, and as described with reference to FIGS. 1 and 2, it can be attached to the e-bike 10 in place of the display 91 (touch screen 124 having the same). The smartphone 211 functions as the SoC 121 to the touch screen 124 in FIG. 12.
[0093] The smartphone 211 exchanges information with the e-bike 10 by performing communication using a predetermined communication method, for example, Bluetooth (registered trademark) communication. For example, the smartphone 211 receives various information such as sensor information from the e-bike 10 and transmits it to the server 111. Further, for example, the smartphone 211 receives necessary information such as the audio signal of the content from the server 111 and transmits it to the e-bike 10.
[0094] FIG. 14 is a block diagram showing a second electrical configuration example of the e-bike 10.
[0095] That is, FIG. 14 shows an electrical configuration example of the e-bike 10 that constitutes the information processing system 110 in FIG. 13.
[0096] In the figure, the corresponding parts in FIG. 12 are denoted by the same reference numerals, and the description thereof will be omitted as appropriate below.
[0097] In FIG. 14, the e-bike 10 includes a battery 51, a light-emitting unit 125, a microcontroller 126, a drive unit 127, a haptics unit 128, a sensor unit 129, an audio unit 130, an RTOS (Real Time Operating System) BLE module 221, etc.
[0098] Therefore, the e-bike 10 in FIG. 14 is common with the case of FIG. 12 in that it includes a battery 51 and the light-emitting unit 125 to the audio unit 130. However, the e-bike 10 in FIG. 14 is different from the case of FIG. 12 in that the SoC 121 to the touch screen 124 are not provided and the RTOS BLE module 221 is newly provided.
[0099] The RTOS BLE module 221 functions as an interface for BLE communication, performs BLE communication with the smartphone 211, and transmits and receives information.
[0100] In FIG. 14, the smartphone 211 functions as the SoC 121 to the touch screen 124 in FIG. 12, and together with the e-bike 10, can perform the same processing as the e-bike 10 in FIG. 12.
[0101] Note that in FIG. 14, when the smartphone 211 is removed from the e-bike 10, it becomes difficult to detect the position of the e-bike 10. Therefore, the sensor unit 129 can be provided with a sensor (Position) for detecting the position such as the GPS unit 122 in FIG. 12.
[0102] In the e-bike 10 of FIG. 12, it is necessary to incorporate an SoC 121 or the like having functions equivalent to those of a smartphone. For this purpose, a high-performance CPU 142 or the like capable of executing various applications and the like is required. Therefore, the e-bike 10 of FIG. 12 becomes more expensive. However, the e-bike 10 of FIG. 12 does not require the preparation of a smartphone 211.
[0103] On the other hand, in the e-bike 10 of FIG. 14, it is necessary to prepare a mobile terminal such as a smartphone 211 corresponding to the SoC 121, etc., and to cooperate (communicate, etc.) with the e-bike 10. However, since it is not necessary to incorporate the SoC 121, etc. in the e-bike 10 of FIG. 14, the e-bike 10 can be manufactured at low cost.
[0104] Regarding the e-bike 10 of FIG. 14, the smartphone 211 is only responsible for communication via a network with the server 111, etc. and communication with the e-bike 10, and other processes such as the execution of applications (including the processes of the audio signal processing device 250 described later) are to be performed by the e-bike 10, that is, by the RTOS BLE module 221, or by providing dedicated hardware (for example, a chip simpler than the SoC 121, etc.) in the e-bike 10.
[0105] Also, it is possible to achieve load distribution by having the smartphone 211 be responsible for a part of the other processes and the e-bike 10 be responsible for the remaining processes of the other processes.
[0106] For example, the smartphone 211 can be responsible for generating a 2-channel audio signal, and the e-bike 10 can be responsible for processes such as multi-channel conversion and 3-way conversion.
[0107] Further, for example, the smartphone 211 can be made to execute applications other than the application "Safety", and the e-bike 10 can be made to execute the application "Safety". Since BLE communication is performed between the e-bike 10 and the smartphone 211, when the application "Safety" is executed on the smartphone 211, it is necessary to transmit the sensor information output by the sensor unit 129 from the e-bike 10 to the smartphone 211 via BLE communication. Further, when a danger is recognized from the sensor information on the smartphone 211, it is necessary to generate an audio signal (corresponding to sound) for danger notification and transmit it to the e-bike 10 via BLE communication. Therefore, the output of the haptics device 61 of the e-bike 10 and the audio signal for danger notification from the speakers 71 and 81 to 85 are delayed by at least the time required for BLE communication from the output of the sensor information by the sensor unit 129. When the application "Safety" is executed on the e-bike 10, it is possible to suppress the occurrence of a delay in the time required for BLE communication in the output of the audio signal for danger notification as compared with the case where the application "Safety" is executed on the smartphone 211.
[0108] In addition to the execution of the application "Safety", for processes related to safety and security that are highly important and / or urgent and require real-time performance, the e-bike 10 can be made responsible.
[0109] <Audio Signal Processing Apparatus to which the Present Technology is Applied>
[0110] FIG. 15 is a block diagram showing a configuration example of an embodiment of an audio signal processing apparatus to which the present technology is applied.
[0111] The e-bike 10 functions as a processing device that performs various processes by the SoC 121 (FIG. 12) or the smartphone 211 (FIG. 14) as a computer executing various applications.
[0112] FIG. 15 shows a functional configuration example of an audio signal processing apparatus 250, which is one of such processing apparatuses.
[0113] The e-bike 10 provides an acoustic space to a user in a state of riding on the e-bike 10 by outputting an audio signal such as content. However, when an audio signal is output in the e-bike 10, sound leakage to the surroundings may occur, which may cause trouble to people around. In addition, the user of the e-bike 10 may be concerned about such trouble to people around and may not be able to enjoy the content.
[0114] As a first method for suppressing sound leakage, there is a method of canceling sound in areas other than necessary areas. As a specific method of the first method, for example, there is a method using a vertical array speaker in which a plurality of speaker units (parts that output an electrical signal as an air vibration in a speaker) are arranged vertically. In addition, for example, there are technologies called area noise canceling and control of an area where sound reaches by wavefront synthesis.
[0115] However, in the first method, it is easy to control the high-frequency components with a short wavelength of the audio signal, but it is difficult to control the directivity of the low-frequency components with a long wavelength.
[0116] As a second method for suppressing sound leakage, there is a method using a technology for realizing a narrow directivity. As a specific method of the second method, for example, there are a method using a horizontal array speaker in which a plurality of speaker units are arranged horizontally, a method using a bone flare, a method using a beam tweeter, and a method using a parabolic dome.
[0117] However, in the second method, in order to realize a narrow directivity, a certain size is required as the size of the speaker, and the speaker becomes larger. Furthermore, in the second method, the reproduction band becomes narrower.
[0118] As a third method for suppressing sound leakage, there is a method of reducing the sound pressure level and narrowing the area where sound reaches by distance attenuation. As a specific method of the third method, for example, there is a method of using a wearable speaker such as a neckband-type speaker in which a speaker unit can be arranged near the user's ear.
[0119] However, in the third method, when the speaker is arranged on the e-bike 10 such that the speaker unit is arranged near the user's ear like a neck speaker, for example, many restrictions such as inconvenience in getting on and off the e-bike 10 occur. Also, when the user is made to wear a wearable neck speaker, a burden is imposed on the user for wearing. Further, as an arrangement of the speaker at a position close to the ear, for example, there is an arrangement of two-channel speakers directly beside the user's left and right ears. In such a case of arranging the speakers, if the position of the head of the user riding the e-bike 10 shifts, there are concerns such as the collapse of the stereophonic sound field generated by signal processing. Specifically, for instructing the position of an emergency vehicle where real-time performance is important, for example, when an emergency vehicle approaches from the right rear, a sound field in which a notification sound notifying the approach of the emergency vehicle is emitted as if it is ringing from the right rear is generated by signal processing, the user naturally turns the head to the right rear. At that time, the position of the user's head (the position of the ear) shifts, thereby collapsing the stereophonic sound representation and the notification sound may not be heard from the right rear.
[0120] Therefore, the audio signal processing device 250 generates a plurality of frequency components of the audio signal, such as performing 3-way processing that band-divides the audio signal into a plurality of frequency bands. Then, the audio signal processing device 250 outputs each frequency component of the audio signal obtained by the 3-way processing to the haptics device 61 and the device responsible for each frequency band among the speakers 71 and 81 to 85. Further, in the e-bike 10, the arrangement of the haptics device 61 and the speakers 71 and 81 to 85 is devised as described in FIGS. 1 and 2. Thereby, sound leakage to the surroundings can be suppressed. As a result, the user can enjoy a comfortable cycling experience surrounded by sound without worrying about sound leakage to the surroundings while the e-bike 10 is running.
[0121] Furthermore, in the e-bike 10, based on the sensor information output by the sensor unit 129, one or both of the user's state and the surrounding situation are recognized, and based on the recognition result, the level of the audio signal (the volume of the sound corresponding to the audio signal) is adjusted. By adjusting the level of the audio signal, the range of sound leakage is dynamically controlled without the user having to trouble themselves with operating the volume, and the audibility of the surrounding sound for the user in the state of riding the e-bike 10 is controlled.
[0122] For example, when sound leakage to the surroundings needs to be considered, the e-bike 10 enters a silent state considering the direction in which such consideration is necessary. That is, the level of the audio signal is adjusted so as to further suppress sound leakage in the direction where consideration is necessary. Therefore, the user does not need to worry about sound leakage in the direction where sound leakage needs to be considered.
[0123] In addition, when it is necessary to consider the audibility of ambient sounds for the user of the e-bike 10, the e-bike 10 enters a silent state considering the direction in which such consideration is required. That is, the audio signal level is adjusted so that sounds from the direction requiring consideration, for example, the sound of an approaching automobile from the direction in which the automobile is approaching or the speech (voice) of a person riding a bicycle (a fellow rider) traveling alongside, can be easily heard by the user of the e-bike 10. Therefore, it is possible to improve safety against the approach of an automobile and to facilitate conversation with a fellow rider.
[0124] In FIG. 15, the audio signal processing device 250 includes a recognition unit 251, a content acquisition unit 252, a multi-channel conversion unit 253, and a signal processing unit 254.
[0125] The recognition unit 251 is supplied with sensor information output by the sensor unit 129. Based on the sensor information, the recognition unit 251 recognizes one or both of the state of the user of the e-bike 10 (including the state of the e-bike 10 on which the user is riding) and the surrounding situation, and supplies recognition information representing the recognition result to the content acquisition unit 252 and the signal processing unit 254.
[0126] For example, the recognition unit 251 recognizes (detects, determines) the presence or absence of the user's speech as the state of the user based on the audio signal as the sensor information output by the microphone constituting the sensor unit 129. Further, for example, the recognition unit 251 recognizes the traveling speed of the user (on the e-bike 10 on which the user is riding) as the state of the user based on the sensor information output by the IMU constituting the sensor unit 129. Furthermore, for example, the recognition unit 251 recognizes whether the user (on the e-bike 10 on which the user is riding) is traveling or stopped, etc. as the state of the user based on the sensor information output by the sensor that detects the state of the stand of the e-bike 10. Also, for example, the recognition unit 251 recognizes, as the state of the user, whether the user is seated or standing, the user's posture, etc. based on the pressure as the sensor information output by the pressure sensors provided on the seat 31, the backrest 32, the handle 41, etc. constituting the sensor unit 129.
[0127] For example, based on the audio signal as sensor information output by the microphone that constitutes the sensor unit 129, the recognition unit 251 recognizes specific sounds such as the presence or absence of speech of other people around, and sounds that notify of dangers such as the sound of an automobile approaching the e-bike 10 (engine sound, horn sound, siren sound of an emergency vehicle, etc.) as the surrounding situation. Further, for example, based on an image (including a distance image) as sensor information output by the camera or the distance measurement sensor that constitutes the sensor unit 129, the recognition unit 251 recognizes the approach of an automobile or the like from behind or the like as the surrounding situation. Note that the recognition unit 251, based on the audio signal, not only recognizes the presence or absence of speech of other people around and specific sounds, but also analyzes the direction in which the sound source (other person) of the speech or the sound source (automobile or the like) of the specific sound is located by azimuth analysis, and can recognize the direction in which the sound source is located.
[0128] Based on the recognition information from the recognition unit 251, the content acquisition unit 252 acquires, for example, an audio signal of content such as a music piece suitable for the surrounding situation (scenery or the like) or an effect sound suitable for the state of the e-bike 10 or the like. The acquisition of the audio signal of the content is performed by receiving from the server 111, reading from a memory (not shown) built in the e-bike 10, or generating. The generation of the content can be performed by, for example, a generation AI or any other method. The content acquisition unit 252 acquires a two-channel audio signal of the content and supplies it to the multi-channel conversion unit 253.
[0129] Note that the memory built in the e-bike 10 can store, for example, an audio signal of a predetermined effect sound as content. Examples of the predetermined effect sound include a sound that can be emitted when the stand of the e-bike 10 is kicked up, and a sound that beats a rhythm according to the traveling speed of the e-bike 10.
[0130] The multi-channel conversion unit 253 performs a multi-channel conversion process to generate a multi-channel audio signal from the audio signal of the content from the content acquisition unit 252. Here, in the multi-channel conversion process, a haptic device 61 and a 7-channel audio signal of speakers 71 and 81 to 85 are generated from the 2-channel audio signal of the content from the content acquisition unit 252. In the multi-channel conversion process, for example, a 5.1-channel audio signal can be generated from the 2-channel audio signal, and a 7-channel audio signal can be generated from the 5.1-channel audio signal. The multi-channel conversion unit 253 supplies the multi-channel audio signal of the content obtained by the multi-channel conversion process to the signal processing unit 254.
[0131] The signal processing unit 254 performs a signal generation process to generate a plurality of frequency components of the audio signal from the (multi-channel) audio signal of the content from the multi-channel conversion unit 253. The signal generation process is performed, for example, by filter processing (applying an equalizer) to the audio signal of each channel. The filter processing is performed using a low-pass filter or a high-pass filter, or both a low-pass filter and a high-pass filter. As the signal generation process, for example, a 3-way conversion process for generating a low-frequency component, a mid-frequency component, and a high-frequency component of the audio signal of the content can be performed. In the 3-way conversion process, a low-pass filter is applied to the audio signal of the channel for the haptic device 61, and both a low-pass filter and a high-pass filter are applied to the audio signal of the channel for the speaker 71. Further, a high-pass filter is applied to the audio signal of the channels for the speakers 81 to 85. Thereby, three frequency components, i.e., a low-frequency component, a mid-frequency component, and a high-frequency component of the audio signal of the content are generated.
[0132] The signal processing unit 254 performs signal processing necessary for the low-frequency component, mid-frequency component, and high-frequency component of the audio signal of the content. The signal processing unit 254 supplies the low-frequency component of the audio signal obtained as a result of the signal processing to the haptic device 61 that is responsible for the low-frequency component (reproduction) of the audio signal in the haptic unit 128. Further, the signal processing unit 254 supplies the mid-frequency component of the audio signal obtained as a result of the signal processing to the speaker 71 as a mid-frequency speaker that is responsible for the mid-frequency component (reproduction) of the audio signal in the audio unit 130. Also, the signal processing unit 254 supplies the high-frequency component of the audio signal obtained as a result of the signal processing to the speakers 81 to 85 as high-frequency speakers that are responsible for the high-frequency component (reproduction) of the audio signal in the audio unit 130.
[0133] Here, as the signal generation process, a three-way process of generating three frequency components, namely, a low-frequency component, a mid-frequency component, and a high-frequency component, from the audio signal of the content has been performed. However, the signal generation process is not limited to this. In the signal generation process, it is possible to generate two frequency components, namely, a low-frequency component and a high-frequency component, or four or more frequency components from the audio signal of the content. For example, when generating two frequency components, namely, a low-frequency component and a high-frequency component, of the audio signal of the content in the signal generation process, the speaker 71 may be made responsible for the high-frequency component together with the speakers 81 to 85, or the speakers 81 to 85 may not be provided and only the speaker 71 may be made responsible for the high-frequency component, or the speakers 81 to 85 may be made responsible for the high-frequency component and the e-bike 10 may be configured without providing the speaker 71.
[0134] <Configuration example of signal processing unit 254>
[0135] FIG. 16 is a block diagram showing a configuration example of the signal processing unit 254 of FIG. 15.
[0136] Hereinafter, the audio signal of the content is also referred to as the content signal.
[0137] In FIG. 16, the signal processing unit 254 includes a signal generation unit 261, a level adjustment unit 262, and a superimposition unit 263.
[0138] The signal generation unit 261 is supplied with recognition information from the recognition unit 251 and a (multi-channel) content signal from the multi-channel conversion unit 253. As a signal generation process, the signal generation unit 261 generates a low-frequency component, a mid-frequency component, and a high-frequency component of the content signal by performing three-way conversion of the content signal. Further, the signal generation unit 261 generates a haptics signal for driving the haptics device 61 based on the low-frequency component of the content signal and the recognition information.
[0139] In the generation of the haptics signal, the haptics signal can be generated by performing filter processing on the low-frequency component of the content signal based on the low-frequency component of the content signal. For example, for a content signal of unknown content (sound source) such as content generated by a generation AI or the like, the haptics signal is generated based on the low-frequency component of the content signal.
[0140] In addition, in generating the haptics signal, for example, it can be done by reading out the haptics signal from a memory (not shown) built in the e-bike 10. That is, for example, for the haptics signal for known content (sound source), an effective haptics signal can be created in advance and stored in the memory built in the e-bike 10. Then, reading out the haptics signal from the memory can be performed as the generation of the haptics signal. The known content is, for example, prepared content such as a sound effect that sounds when the stand of the e-bike 10 is kicked up, a sound effect that beats a rhythm according to the running speed of the e-bike 10, the content of a music piece received from the server 111, etc. The signal generation unit 261 can recognize the kick-up of the stand of the e-bike 10 and the running speed of the e-bike 10 from the recognition information. The signal generation unit 261 generates haptics signals such as a sound effect that sounds when the stand of the e-bike 10 is kicked up and a sound effect that beats a rhythm according to the running speed of the e-bike 10 in accordance with the recognition information such as the kick-up of the stand of the e-bike 10 and the running speed of the e-bike 10.
[0141] In addition, the signal generation unit 261 can generate a mid-range component of the content signal that is delayed more than the high-range component of the content signal by delaying the mid-range component of the content signal. Note that as the delay time for delaying the mid-range component, a time during which the precedence effect (Hass effect) occurs, for example, a time greater than 0 seconds and equal to or less than 0.04 seconds can be adopted.
[0142] The level adjustment unit 262 is supplied with the recognition information from the recognition unit 251, and the low-frequency component (haptic signal corresponding thereto), mid-frequency component, and high-frequency component of the content signal generated by the signal generation unit 261. The level adjustment unit 262 adjusts the levels of the mid-frequency component and the high-frequency component of the content signal so that the sound pressures due to the mid-frequency component and the high-frequency component of the content signal are substantially the same at the position of the user riding on the e-bike 10. The low-frequency component (haptic signal corresponding thereto) of the content signal is also adjusted so that the sound pressure felt by the user due to the vibration of the haptic device 61 according to the low-frequency component is substantially the same as the sound pressures due to the mid-frequency component and the high-frequency component. Further, the level adjustment unit 262 adjusts the level of the high-frequency component of the content signal based on the recognition information.
[0143] The superimposing unit 263 is supplied with the recognition information from the recognition unit 251, the high-frequency component of the content signal generated by the signal generation unit 261, and the audio signal detected (collected) by the microphone constituting the sensor unit 129. When the superimposing unit 263 recognizes a danger such as the approach of an automobile to the e-bike 10 based on the recognition information, the superimposing unit 263 superimposes the audio signal of the danger notification sound for notifying the danger on the high-frequency component of the content signal. For example, the superimposing unit 263 separates the audio signal of the sound of the automobile approaching the e-bike 10 from the audio signal from the sensor unit 129. Further, the superimposing unit 263 enhances the audio signal of the sound of the automobile and superimposes the enhanced audio signal of the sound of the automobile on the high-frequency component of the content signal as the audio signal of the danger notification sound.
[0144] <Processing for three-way conversion>
[0145] FIG. 17 is a diagram for explaining an example of the three-way conversion process by the signal generation unit 261.
[0146] In the three-way conversion process, a low-frequency component, a mid-frequency component, and a high-frequency component are generated as if the content signal is band-divided into a low-frequency component, a mid-frequency component, and a high-frequency component.
[0147] The low-frequency component is, for example, a frequency component of approximately 100 Hz to 300 Hz or less. The mid-frequency component is a frequency component of approximately 100 Hz to 300 Hz or more and approximately 1 kHz to 5 kHz or less. The high-frequency component is a frequency component of approximately 1 kHz to 5 kHz or more.
[0148] The low-frequency component of the content signal is output by supplying the low-frequency component (the haptic signal corresponding thereto) to the haptic device 61 disposed on the backrest 32 that contacts the back where vibration is likely to be felt even during the running of the e-bike 10.
[0149] The mid-frequency component of the content signal is output by supplying the mid-frequency component to the speaker 71 as a mid-frequency speaker arranged to face the direction of the user (the head (ear)) in the state of riding on the e-bike 10 and to be positioned below and in front of the user.
[0150] The high-frequency component of the content signal is output by supplying the high-frequency component to the speakers 81 to 85 as high-frequency speakers arranged to face the direction of the user (the head (ear)) in the state of riding on the e-bike 10 and to be positioned at a height near the height of the user's ear. As described with reference to FIGS. 1 and 2, the speakers 81 to 83 are supported by the support tool 80 fixed to the handle 41, and the speakers 84 and 85 are supported by the backrest 32. These speakers 81 to 85 can be arranged near the ears of the user in the state of riding on the e-bike 10 within a range that does not significantly hinder the user from getting on and off the e-bike 10.
[0151] FIG. 18 is a diagram for explaining the output of the low-frequency component of the content signal by the haptic device 61.
[0152] Regarding the long-wavelength low-frequency components of the content signal, it is difficult to suppress sound leakage when output from the speaker. Therefore, by outputting the low-frequency components of the content signal as vibrations of the haptic device 61 arranged on the backrest 32, sound leakage can be suppressed. Due to the vibrations of the haptic device 61 arranged on the backrest 32, the user's spine (back) is vibrated, and the user can feel the low-frequency components of the content signal as sound (like sound) through tactile stimulation.
[0153] FIG. 19 is a diagram for explaining the output of the mid-frequency components of the content signal by the speaker 71 as the mid-range speaker.
[0154] The mid-frequency components of the content signal are output from the speaker 71 arranged so as to face the direction of the user in the state of riding on the e-bike 10 and be located below and in front of the user. Therefore, the mid-frequency components of the content signal are output from the speaker 71 below and in front of the user in an obliquely upward direction from the rear of the e-bike 10. As a result, sound leakage in the front, rear, left, and right directions of the e-bike 10 can be suppressed.
[0155] As described with reference to FIG. 16, the signal generation unit 261 generates mid-frequency components that are delayed compared to the high-frequency components of the content signal. As a result, the high-frequency components of the content reach the user in the state of riding on the e-bike 10 earlier in time than the mid-frequency components of the content. As a result, due to the precedence effect, the user can recognize the sound image at the positions of the speakers 81 to 85 as the high-frequency speakers that output the high-frequency components, rather than at the position of the speaker 71 as the mid-frequency speaker that outputs the mid-frequency components.
[0156] FIG. 20 is a diagram for explaining the output of the high-frequency components of the content signal by the speakers 81 to 85 as the high-frequency speakers.
[0157] The high-frequency components of the content signal are output from the speakers 81 to 85 as the high-frequency speakers arranged so as to face the direction of the user in the state of riding on the e-bike 10 and be located at a height near the height of the user's ears.
[0158] The high-frequency components are easy to control for narrow directivity, and by outputting such high-frequency components from the speakers 81 to 85 arranged to face the direction of the user in the state of riding on the e-bike 10 and to be located at a height near the height of the user's ears, it is possible to suppress sound leakage to the surroundings. Further, as described with reference to FIGS. 16 and 19, since the mid-frequency components of the content signal are delayed more than the high-frequency components, the high-frequency components reach the user earlier in time than the mid-frequency components of the content. As a result, due to the precedence effect, the user can recognize the sound image at the positions of the speakers 81 to 85 as the high-frequency speakers that output the high-frequency components.
[0159] Note that the high-frequency speakers that output the high-frequency components can be composed of small speaker units with a diameter of about 15 mm to 18 mm. Therefore, as the speakers 81 to 85 as the high-frequency speakers, small speakers can be adopted, and by adopting such small speakers, the degree of freedom in arrangement is improved.
[0160] Here, the frequency bands of the respective frequency components of the audio signal (content signal) generated in the 3-way processing as the signal generation processing, and the arrangement positions and arrangement angles of the speaker 71 as the mid-frequency speaker and the speakers 81 to 85 as the high-frequency speakers are not limited to those described above. That is, the present technology can be applied to various moving bodies other than bicycles. And when applying the present technology to various moving bodies, the frequency bands of the respective frequency components of the audio signal generated in the 3-way processing, and the arrangement positions and arrangement angles of the mid-frequency speaker and the high-frequency speaker can be set so as to suppress sound leakage according to the moving body to which the present technology is applied.
[0161] Also, in the signal generation unit 261, although the mid-range component of the content signal is to be delayed, in addition to the mid-range component, the low-range component (the haptic signal corresponding thereto) can also be delayed in the same manner. Regarding the low-range component, for example, the presence or absence of delay can be set according to the arrangement position of the haptic device 61 that outputs the low-range component. That is, the haptic device 61 can be arranged not only on the backrest 32 but also at a position where the vibration by the haptic device 61 can stimulate the tactile sensation of the user in the state of riding the e-bike 10. Then, the presence or absence of delay of the low-range component can be set according to the arrangement position of the haptic device 61.
[0162] Here, the audio signal (content signal) is divided into three frequency components: a low-range component, a mid-range component, and a high-range component. For the low-range component, it is output from the haptic device 61 arranged on the backrest 32 that contacts the user. Also, for the mid-range component, it is output from the speaker 71 arranged below the front of the user towards the user, and for the high-range component, it is output from the speakers 81 to 85 arranged at a height near the height of the user's ears towards the user.
[0163] Sound leakage can be suppressed by any one or two of outputting the low-range component from the haptic device 61, outputting the mid-range component from the speaker 71 arranged below the front of the user towards the user, and outputting the high-range component from the speakers 81 to 85 arranged at a height near the height of the user's ears towards the user. Performing two is more effective in suppressing sound leakage than performing one, and performing three is even more effective in suppressing sound leakage than performing two.
[0164] FIG. 21 is a diagram for explaining the degree of suppression of sound leakage by three-way division.
[0165] Figure 21 shows the measurement results of the sound attenuation at a position 2 m from the user on the e-bike 10 when the 3-way conversion is performed and when it is not performed. In Figure 21, the attenuation is shown as a negative value (dB).
[0166] For example, directly behind the user, when the 3-way conversion is not performed, the attenuation is about 5 dB, while when the 3-way conversion is performed, the attenuation is about 7.5 dB. Therefore, when the 3-way conversion is performed, the attenuation is about 2.5 dB more than when it is not performed, and it can be confirmed that the sound leakage is suppressed.
[0167] Note that the measurement of the attenuation was performed in a room with a wall, so there are effects of sound reflection and standing waves. Even so, according to the measurement results, it can be confirmed that the sound leakage is suppressed in most of the surroundings of the user on the e-bike 10.
[0168] Here, the arrangement positions of the haptics device 61, the speaker 71 as the midrange speaker, and the speakers 81 to 85 as the highrange speakers are not limited to the above-described arrangement positions. Also, the highrange speaker is not limited to the speakers 81 to 85.
[0169] For example, the haptics device 61 can be arranged at any position where the vibration by the haptics device 61 can stimulate the tactile sensation of the user in the mounted state. For example, the haptics device 61 can be arranged not only on the backrest 32 but also on the seat 31 where the user's buttocks contact or on the handle 41 where the user's palm contacts. Also, as the haptics device 61, a plurality of haptics devices can be arranged at a plurality of positions.
[0170] Figure 22 is a diagram showing the arrangement of the highrange speakers and the names of the highrange speakers.
[0171] Regarding the highrange speakers, in terms of height, they are arranged at a height near the height of the ears of the user on the e-bike 10.
[0172] The high - range speaker disposed at the position in the front direction of the user riding on the e - bike 10 is also referred to as speaker C, and the high - range speakers disposed at the positions in the left front direction and the right front direction of the user are also referred to as speakers FL and FR, respectively.
[0173] Also, the high - range speakers disposed at the positions on the left (slightly rearward) and right (slightly rearward) of the user are also referred to as speakers SL and SR, respectively.
[0174] Furthermore, the high - range speaker disposed at the position in the directly rear direction of the user is also referred to as speaker SB, and the high - range speakers disposed at the positions on the left rear and right rear of the user are also referred to as speakers SBL and SBR, respectively.
[0175] As the high - range speakers, in addition to the speakers 81 - 85 corresponding to the 5 - channel speakers C, FL, FR, SL, SR, for example, 7 - channel speakers FL, C, FR, SR, SL, SBR, SBL or 6 - channel speakers FL, FR, SR, SL, SBR, SBL can be adopted. In addition, as the high - range speakers, for example, 4 - channel speakers FL, FR, SR, SL, 3 - channel speakers FL, FR, SB, 3 - channel speakers C, SR, SL, 2 - channel speakers C, SB, etc. can be adopted.
[0176] <Adjustment of the level of the content signal by the level adjustment unit 262>
[0177] FIG. 23 is a diagram for explaining a first example of the adjustment of the level of the high - frequency component of the content signal based on the recognition information by the level adjustment unit 262.
[0178] Incidentally, hereinafter, assuming that the e-bike 10 has four-channel speakers FL, FR, SL, and SR corresponding to speakers 82 to 84 as high-range speakers, the adjustment of the level of the high-frequency components of the content signals output by the speakers FL, FR, SL, and SR will be described. However, as high-range speakers that output the high-frequency components of the audio signal to be adjusted in level, in addition to the four-channel speakers FL, FR, SL, and SR, for example, seven-channel speakers FL, C, FR, SR, SL, SBR, and SBL can be adopted. Other examples include six-channel speakers FL, FR, SR, SL, SBR, SBL, five-channel speakers FL, C, FR, SR, SL, three-channel speakers FL, FR, SB, three-channel speakers C, SR, SL, two-channel speakers C, SB, etc. that can be adopted.
[0179] FIG. 23 shows an example of the adjustment of the level of the high-frequency components of the content signal when the recognition information indicates that there is no object in a predetermined range around the e-bike 10.
[0180] When there is no object around the e-bike 10, the levels of the high-frequency components of the content signals output by the speakers FL, FR, SL, and SR can be adjusted to substantially the same level so that the sound leakage range becomes a predetermined range set in advance. Substantially the same level means that the sound pressure at the position of the user in the state of riding on the e-bike 10 is substantially the same. The sound leakage range is the range where the level of the sound corresponding to the content signal is equal to or higher than a predetermined value. As the predetermined value, for example, a perceptual evaluation can be performed to set the maximum level of the sound that does not cause annoyance to people. Also, the predetermined value can be controlled to a large value when the level of the ambient environmental sound is large and to a small value when the level of the ambient environmental sound is small, based on the level of the ambient environmental sound.
[0181] Hereinafter, when there is no object around the e-bike 10, the levels of the high-frequency components of the content signals output by the speakers FL, FR, SL, and SR are also referred to as default levels.
[0182] The level adjustment unit 262 reduces the level of the high-frequency component of the content signal output by all or part of the speakers FL, FR, SL, and SR based on the recognition information.
[0183] For example, the level adjustment unit 262 can reduce the level of the high-frequency component of the content signal output by the speakers located in the direction opposite to the direction in which sound leakage is to be suppressed, among the speakers FL, FR, SL, and SR, as viewed from the user riding on the e-bike 10, in consideration of sound leakage to the surroundings.
[0184] Considering the directivity of the speakers FL, FR, SL, and SR, that is, the fact that the speakers FL, FR, SL, and SR are facing the user's direction, by reducing the level of the high-frequency component of the audio signal output by the speakers located in the direction opposite to the direction in which sound leakage is to be suppressed, the sound leakage range in the direction where sound leakage is to be suppressed becomes smaller, and sound leakage is suppressed.
[0185] Also, for example, the level adjustment unit 262 can reduce the level of the high-frequency component of the content signal output by the speakers located in the direction in which the user wants to hear the surrounding sounds, among the speakers FL, FR, SL, and SR, as viewed from the user riding on the e-bike 10, in consideration of the audibility of the surrounding sounds for the user.
[0186] Considering the directivity of the speakers FL, FR, SL, and SR, that is, the fact that the speakers FL, FR, SL, and SR are facing the user's direction, by reducing the level of the high-frequency component of the content signal output by the speakers located in the direction in which the user wants to hear the surrounding sounds, the user can more easily hear the sounds in the direction where the user wants to hear the surrounding sounds.
[0187] The adjustment of the level of the high-frequency component of the content signal as consideration for sound leakage to the surroundings and the adjustment of the level of the high-frequency component of the content signal as consideration for the audibility of the surrounding sounds for the user, as described above, can be performed not only separately but also simultaneously.
[0188] FIG. 24 is a diagram for explaining a second example of adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262.
[0189] FIG. 24 shows an example of adjustment of the level of the high-frequency component of the content signal when the recognition information indicates that the e-bike 10 has stopped temporarily in front of a crosswalk or when there is a person (pedestrian) in front of the temporarily stopped e-bike 10.
[0190] When the e-bike 10 stops temporarily in front of a crosswalk or when there is a person in front of the temporarily stopped e-bike 10, the direction in which sound leakage is to be suppressed is in front of the crosswalk or where the person is present. Therefore, the level of the high-frequency component of the content signal output by, for example, the speakers SL and SR located in the opposite direction of the front can be adjusted to be smaller (by a predetermined value) than the default level.
[0191] In this case, the front sound leakage range becomes smaller, and it is possible to suppress sound leakage to the pedestrian or the person present in front when the pedestrian is crossing the crosswalk.
[0192] FIG. 25 is a diagram for explaining a third example of adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262.
[0193] FIG. 25 shows an example of adjustment of the level of the high-frequency component of the content signal when the recognition information indicates that the user has gotten off the e-bike 10 and is pushing the e-bike 10 by hand or when the user has left the e-bike 10.
[0194] When the user has gotten off the e-bike 10 and is pushing the e-bike 10 by hand or when the user has left the e-bike 10, it is appropriate to suppress sound leakage in all directions of the e-bike 10. Therefore, the level of the high-frequency component of the content signal output by, for example, all the speakers FL, FR, SL, and SR located in the opposite direction of each direction in all directions can be adjusted to be smaller than the default level.
[0195] In this case, the sound leakage range in all directions around the e-bike 10 becomes smaller, and sound leakage to people present near the e-bike 10 can be suppressed.
[0196] Note that when the user is away from the e-bike 10, as an adjustment of the level of the high-frequency component of the content signal output by the speakers FL, FR, SL, and SR, the output of the high-frequency component of the content signal from the speakers FL, FR, SL, and SR can be stopped.
[0197] FIG. 26 is a diagram for explaining a fourth example of the adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262.
[0198] FIG. 26 shows an example of the adjustment of the level of the high-frequency component of the content signal when the recognition information indicates that a person is approaching from the right rear of the e-bike 10 during travel.
[0199] When a person is approaching from the right rear of the e-bike 10 during travel, for example, when a person on a bicycle or a kick scooter is approaching, the direction in which sound leakage is to be suppressed is the right rear where the person is approaching. Therefore, the level of the high-frequency component of the content signal output by, for example, the speaker FL located in the opposite direction to the right rear can be adjusted to be smaller than the default level.
[0200] In this case, the sound leakage range in the right rear becomes smaller, and sound leakage to the person approaching from the right rear can be suppressed.
[0201] FIG. 27 is a diagram for explaining a fifth example of the adjustment of the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262.
[0202] FIG. 27 shows an example of the adjustment of the level of the high-frequency component of the content signal when the recognition information indicates that a person is traveling parallel to the e-bike 10 during travel and the person traveling parallel (the parallel traveler) is having a conversation with the user.
[0203] When the user is having a conversation with a fellow rider who is on the right side of the e-bike 10 while it is in motion, for example, when a friend as a fellow rider is riding a bicycle and paralleling the right side of the moving e-bike 10 and having a conversation with the user, the direction in which sound leakage is to be suppressed is the right direction where the fellow rider is present. Therefore, the level of the high-frequency component of the content signal output by, for example, speakers FL and SL, which are located in the opposite direction of the right direction, can be adjusted to be smaller than the default level.
[0204] In this case, as shown in A of FIG. 27, the sound leakage range in the right direction becomes smaller, and sound leakage to the fellow rider in the right direction can be suppressed.
[0205] Also, when the user is having a conversation with a fellow rider who is on the right side of the e-bike 10 while it is in motion, the direction in which the user wants to hear the surrounding sounds is the right direction where the fellow rider is present. Therefore, as shown in B of FIG. 27, the level of the high-frequency component of the content signal output by, for example, speakers FR and SR, which are located in the right direction, can be adjusted to be smaller than the default level.
[0206] By reducing the level of the high-frequency component of the content signal output by speakers FR and SR located in the right direction, the user can more easily hear the voice (utterance) of the fellow rider present in the right direction.
[0207] The adjustment of the level of the high-frequency component of the content signal to suppress sound leakage to the fellow rider in the right direction and the adjustment of the level of the high-frequency component of the content signal to make it easier for the user to hear the voice of the fellow rider present in the right direction, as described above, can be performed simultaneously.
[0208] For example, as shown in C of FIG. 27, the level of the high-frequency component of the content signal output by, for example, speaker SL, which is located in the opposite direction to the right direction where there is a fellow rider, which is the direction in which sound leakage is to be suppressed, can be adjusted to be smaller than the default level. At the same time, as shown in C of FIG. 27, the level of the high-frequency component of the content signal output by, for example, speakers FR and SR, which are located in the right direction where there is a fellow rider, which is the direction in which the user wants to hear the surrounding sound, can be adjusted to be smaller than the default level.
[0209] In this case, as shown in C of FIG. 27, the sound leakage range in the right front becomes smaller, and sound leakage to the fellow rider in the right direction can be suppressed. At the same time, by reducing the level of the high-frequency component of the content signal output by speakers FR and SR located in the right direction, the user can more easily hear the voice of the fellow rider existing in the right direction.
[0210] In addition, when the user riding on the e-bike 10 during travel is having a conversation with a fellow rider, as described above, in addition to adjusting the level of the high-frequency component of the content signal output by some of the speakers FL, FR, SL, and SR to be smaller, the level of the high-frequency component of the content signal can be adjusted to be smaller for all of the speakers FL, FR, SL, and SR. As the adjustment of the level of the high-frequency component of the content signal output by speakers FL, FR, SL, and SR, it is also possible to stop the output of the high-frequency component of the content signal from speakers FL, FR, SL, and SR.
[0211] Also, when the user riding on the e-bike 10 during travel is having a conversation with a fellow rider, when the user is speaking, the level of the high-frequency component of the content signal output by speakers FL and SL, which are located in the left direction, which is the opposite direction to the right side (the side of the fellow rider), can be adjusted to be smaller so that the fellow rider can easily hear the user's voice, and the sound leakage range on the right side, which is the side of the fellow rider, can be reduced. Furthermore, when the fellow rider is speaking, the level of the high-frequency component of the content signal output by speakers FR and SR, which are located in the right direction (the side of the fellow rider), can be adjusted to be smaller so that the user can easily hear the voice of the fellow rider.
[0212] Whether the user is speaking or the fellow traveler is speaking can be recognized, for example, by analyzing the direction of the sound source (speaker) of the voice included in the audio signal output by the microphone that constitutes the sensor unit 129.
[0213] FIG. 28 is a diagram for explaining a sixth example of adjusting the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262.
[0214] FIG. 28 shows an example of adjusting the level of the high-frequency component of the content signal when the recognition information indicates that an automobile (vehicle) is approaching from the right rear of the e-bike 10 during travel.
[0215] When an automobile is approaching from the right rear of the e-bike 10 during travel, from the viewpoint of the user's safety, the direction in which the user wants to hear the surrounding sounds is the direction of the approaching automobile, that is, the right rear. Therefore, the level of the high-frequency component of the content signal output by, for example, the speaker SR located in the right rear can be adjusted to be smaller than the default level.
[0216] By reducing the level of the high-frequency component of the content signal output by the speaker SR located in the right rear, the user can more easily hear the sound of the automobile approaching from the right rear.
[0217] When an automobile is approaching from the right rear of the e-bike 10 during travel, in order for the user to more easily hear the sounds from the rear, in addition to the speaker SR located in the right rear, the level of the high-frequency component of the content signal output by the speaker SL located in the left rear can be adjusted to be smaller than the default level. In this case, for the speaker SL located in the left rear, which is a direction slightly deviated from the right rear, which is the direction of the approaching automobile, the degree of reducing the level of the high-frequency component of the content signal can be reduced compared to the speaker SR located in the right rear, which is a direction substantially coinciding with the right rear, which is the direction of the approaching automobile.
[0218] FIG. 29 is a diagram for explaining a seventh example of adjusting the level of the high-frequency component of the content signal based on the recognition information by the level adjustment unit 262.
[0219] FIG. 29 shows an example of adjusting the level of the high-frequency component of the content signal when the recognition information indicates that a specific sound has been recognized.
[0220] When a specific sound, such as the siren sound of an emergency vehicle, is sounding in the vicinity of the e-bike 10 during travel, from the perspective of the user's safety and to prevent interfering with the travel of the emergency vehicle, it is desirable for the user to quickly recognize that the specific sound is sounding. Therefore, for example, the level of the high-frequency component of the content signal output by all the speakers FL, FR, SL, and SR can be adjusted to be lower than the default level. Or, as an adjustment of the level of the high-frequency component of the content signal output by the speakers FL, FR, SL, and SR, the output of the high-frequency component of the content signal from all the speakers FL, FR, SL, and SR can be stopped.
[0221] Also, when the recognition information indicates that the sound source of a specific sound, for example, an emergency vehicle sounding a siren, is approaching, the level of the high-frequency component of the content signal output by the speaker among the speakers FL, FR, SL, and SR that is located in the direction of the approaching emergency vehicle can be adjusted to be lower than the default level.
[0222] For example, as shown in FIG. 29, when an emergency vehicle sounding a siren is approaching from the right rear of the e-bike 10 during travel, in order for the user to easily hear the sound from the right rear, the level of the high-frequency component of the content signal output by the speaker SR located in the same right rear can be adjusted to be lower than the default level.
[0223] In this case, as described above, when the levels of the high-frequency components of the content signals output by all the speakers FL, FR, SL, and SR have already been adjusted to be low, the level of the high-frequency component of the content signal output by the speaker SR located at the right rear can be further adjusted to be lower.
[0224] Regarding the speaker SR located at the right rear, as an adjustment of the level of the high-frequency component of the content signal, the output of the high-frequency component of the content signal can be stopped.
[0225] Also, the specific sound can be set in advance.
[0226] FIG. 30 is a diagram for explaining an example of superimposing (content mixing) the audio signal of the danger notification sound by the superimposing unit 263 on the high-frequency component of the content signal.
[0227] Based on the recognition information, when the superimposing unit 263 recognizes a danger such as the approach of an automobile (vehicle) to the e-bike 10, for example, it superimposes the audio signal of the danger notification sound for notifying the danger on the high-frequency component of the content signal.
[0228] In FIG. 30, similar to FIG. 28, the recognition information indicates that an automobile is approaching from the right rear of the e-bike 10 during travel. In this case, as described in FIG. 28, the level adjustment unit 262 can adjust the level of the high-frequency component of the content signal to be lower than the default level for the speaker SR at the right rear and, further, for the speaker SL at the left rear as needed.
[0229] The superimposing unit 263 can superimpose the audio signal of the danger notification sound on the high-frequency component of the content signal output by the speaker SR at the right rear, that is, the direction of the approaching automobile.
[0230] As the danger notification sound, for example, a voice for notifying a danger such as the approach of a vehicle or a predetermined warning sound can be adopted. Further, as the danger notification sound (audio signal), for example, a signal obtained by enhancing the audio signal of the sound of an approaching vehicle can be adopted. The audio signal of the sound of an approaching vehicle can be obtained by separating, from the audio signal collected by the microphone constituting the sensor unit 129 in the overlapping unit 263, the audio signal of the sound of the approaching vehicle included in the audio signal.
[0231] As described above, by superimposing the audio signal of the danger notification sound on the high-frequency component of the content signal, the user can quickly recognize a danger such as the approach of a vehicle and take actions to avoid the danger as needed.
[0232] As described above, the e-bike 10 to which the present technology is applied has been described. However, the present technology can be applied not only to bicycles such as the e-bike 10 (including smart bikes) but also to various moving bodies. For example, the present technology can be applied to personal mobility such as mopeds (motorcycles with pedals), motorcycles, kick scooters, wheelchairs, and golf carts. In addition, for example, the present technology can be applied to various moving bodies such as automobiles, airplanes, trains, and ships. Furthermore, the present technology can also be applied to some indoor and outdoor spaces in addition to moving bodies.
[0233] In addition, the present technology can be applied not only to moving bodies on which the user rides in a state of being exposed to the outside like a bicycle but also to moving bodies on which the user rides in a state of being housed inside and not being exposed to the outside like an automobile (closed car) having a closed body.
[0234] Note that the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.
[0235] Moreover, the effects described in this specification are merely examples and are not limiting; there may be other effects.
[0236] Note that the present technology can take the following configurations.
[0237] <1> The haptics device that vibrates according to the low-frequency component of the audio signal is arranged such that the vibration stimulates the tactile sensation of the user in the riding state in the moving body. <2> The haptics device is arranged on the backrest that contacts the back of the user in the riding state in the moving body according to <1>. <3> The low-frequency component of the audio signal is a frequency component of approximately 100 Hz to 300 Hz or less in the moving body according to <1> or <2>. <4> The midrange speaker that outputs the midrange component of the audio signal is arranged to face the direction of the user in the riding state and to be located below and in front of the user in the riding state in the moving body according to any one of <1> to <3>. <5> The moving body according to <4> further includes a signal generation unit that generates a midrange component of the audio signal that is delayed from the high-frequency component of the audio signal. in the moving body according to <4>. <6> The midrange component of the audio signal is a frequency component of approximately 100 Hz to 300 Hz or more and approximately 1 kHz to 5 kHz or less in the moving body according to <4> or <5>. <7> The high-range speaker that outputs the high-frequency component of the audio signal is arranged to face the direction of the user in the riding state and to be located at a height near the height of the user's ears in the riding state in the moving body according to any one of <1> to <6>. <8> The high-frequency component of the audio signal is a frequency component of approximately 1 kHz to 5 kHz or higher. The moving body according to <7>. <9> As the high-frequency speaker, having a plurality of speakers The moving body according to <7> or <8>. <10> A recognition unit that recognizes one or both of the state of the user and the surrounding situation, A level adjustment unit that adjusts the level of the high-frequency component of the audio signal based on the recognition information indicating the recognition result of the recognition unit The moving body according to <9>, further comprising. <11> The level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker located in a direction opposite to the direction in which sound leakage is to be suppressed, as viewed from the user in the mounted state, among the plurality of speakers. The moving body according to <10>. <12> The level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker located in a direction opposite to the direction of a person in the surroundings, as viewed from the user in the mounted state, among the plurality of speakers. The moving body according to <11>. <13> The level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker located in a direction in which the user wants to hear the surrounding sound, as viewed from the user in the mounted state, among the plurality of speakers. The moving body according to any one of <10> to <12>. <14> The level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker located in the direction of an approaching vehicle, as viewed from the user in the mounted state, among the plurality of speakers. The moving body according to <13>. <15> The level adjustment unit reduces the level of the high-frequency component of the audio signal output by the speaker located in the direction of the sound source of a specific sound among the plurality of speakers, as viewed from the user in the mounted state. <13>The moving body according to <13>. <16> When the user is in the dismounted state, the level adjustment unit reduces the level of the high-frequency component of the audio signal output by all of the plurality of speakers. <10>~<15>The moving body according to any one of <10> to <15>. <17> The audio signal further includes a superimposing unit that superimposes an audio signal of a danger notification sound for notifying danger on the audio signal based on the recognition information. <10>~<16>The moving body according to any one of <10> to <16>. <18> The superimposing unit superimposes the audio signal of the danger notification sound on the high-frequency component of the audio signal output by the speaker located in the direction of the approaching vehicle, as viewed from the user in the mounted state, among the plurality of speakers. <17>The moving body according to <17>. <19> The superimposing unit superimposes, as the audio signal of the danger notification sound, an audio signal of a sound obtained by enhancing the sound of the vehicle on the high-frequency component of the audio signal. <18>The moving body according to <18>. <20> It is a bicycle. <1>~<19>The moving body according to any one of <1> to <19>.
Description of reference numerals
[0238] 10 e-bike, 20 frame, 21 top tube, 22 down tube, 31 seat, 32 backrest, 41 handlebar, 42 front fork, 43 front wheel, 44 rear wheel, 45 pedal, 51 battery, 61 haptics device, 71 speaker, 80 support, 81 - 85 speakers, 91 display, 110 information processing system, 111 server, 121 SoC, 122 GPS unit, 123 BLE unit, 124 touch screen, 125 light emitting unit, 126 microcontroller, 127 drive unit, 128 haptics unit, 129 sensor unit, 130 audio unit, 141 RF modem, 142 CPU, 143 GPU, 151 touch panel, 161 drive unit, 171 power amplifier, 211 smartphone, 221 RTOS BLE module, 251 recognition unit, 252 content acquisition unit, 253 multi-channeling unit, 254 signal processing unit, 261 signal generation unit, 262 level adjustment unit, 263 superimposing unit
Claims
1. A moving body in which a haptics device that vibrates according to a low-frequency component of an audio signal is arranged so that the vibration stimulates the tactile sensation of a user in a mounted state. Moving body.
2. The moving body according to claim 1, wherein the haptics device is arranged on a backrest that contacts the back of the user in the mounted state. Moving body according to claim 1.
3. The moving body according to claim 1, wherein the low-frequency component of the audio signal is a frequency component of approximately 100 Hz to 300 Hz or less. Moving body according to claim 1.
4. The moving body according to claim 1, wherein a mid-range speaker that outputs a mid-range component of the audio signal is arranged to face the direction of the user in the mounted state and is positioned below and in front of the user in the mounted state. Moving body according to claim 1.
5. The moving body according to claim 4, further comprising a signal generation unit that generates a mid-range component of the audio signal that is delayed from a high-frequency component of the audio signal. Moving body according to claim 4.
6. The moving body according to claim 4, wherein the mid-range component of the audio signal is a frequency component of approximately 100 Hz to 300 Hz or more and approximately 1 kHz to 5 kHz or less. Moving body according to claim 4.
7. The moving body according to claim 1, wherein a high-range speaker that outputs a high-frequency component of the audio signal is arranged to face the direction of the user in the mounted state and is positioned at a height near the height of the user's ear in the mounted state. Moving body according to claim 1.
8. The moving body according to claim 7, wherein the high-frequency component of the audio signal is a frequency component of approximately 1 kHz to 5 kHz or more. Moving body according to claim 7.
9. The moving body according to claim 7, having a plurality of speakers as the high-range speaker. Moving body according to claim 7.
10. A recognition unit that recognizes one or both of the state of the user and the surrounding situation, and A level adjustment unit that adjusts the level of the high-frequency component of the audio signal based on recognition information representing the recognition result of the recognition unit. The moving body according to claim 9, further comprising the above.
11. The level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker among the plurality of speakers that is located in a direction opposite to the direction in which sound leakage is to be suppressed when viewed from the user in the mounted state. Moving body according to claim 10.
12. The level adjustment unit reduces the level of the high-frequency component of the audio signal output by a speaker among the plurality of speakers that is located in a direction opposite to the direction of a person in the surroundings when viewed from the user in the mounted state. Moving body according to claim 11.
13. The level adjuster reduces the level of the high-frequency component of the audio signal output from the speaker among the plurality of speakers that is located in the direction in which the user in the mounted state desires to hear surrounding sounds, when viewed from the user in the mounted state. The moving body according to claim 10.
14. The level adjuster reduces the level of the high-frequency component of the audio signal output from the speaker among the plurality of speakers that is located in the direction of an approaching vehicle, when viewed from the user in the mounted state. The moving body according to claim 13.
15. The level adjuster reduces the level of the high-frequency component of the audio signal output from the speaker among the plurality of speakers that is located in the direction of the sound source of a specific sound, when viewed from the user in the mounted state. The moving body according to claim 13.
16. When the user is in the dismounted state, the level adjuster reduces the level of the high-frequency component of the audio signal output from all of the plurality of speakers. The moving body according to claim 10.
17. The moving body further includes a superimposing unit that superimposes, on the audio signal, an audio signal of a danger notification sound for notifying danger, based on the recognition information. The moving body according to claim 10.
18. The superimposing unit superimposes the audio signal of the danger notification sound on the high-frequency component of the audio signal output from the speaker among the plurality of speakers that is located in the direction of an approaching vehicle, when viewed from the user in the mounted state. The moving body according to claim 17.
19. The superimposing unit superimposes, as the audio signal of the danger notification sound, an audio signal of a sound obtained by enhancing the sound of the vehicle on the high-frequency component of the audio signal. The moving body according to claim 18.
20. It is a bicycle. The moving body according to claim 1.
Citation Information
Patent Citations
Production of grilled chicken-like food
JP1987074247A