Audio information transmission system, method, device and motorcycle
The audio information transmission system for electric two-wheelers and helmets addresses the interference issue by integrating a media control device and audio switching device to prioritize and mix audio signals, improving user safety and experience.
Patent Information
- Application Number
- JP2022569287
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-01-19
- Filing Date
- 2021-01-10
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2041-01-10
AI Technical Summary
Existing electric two-wheelers and helmets with Bluetooth earphones cannot simultaneously play audio information from navigation systems and mobile devices without interference, affecting user experience and safety.
An audio information transmission system that integrates a media control device and audio switching device to mix and prioritize audio signals from both sources, ensuring seamless playback in helmets.
Enables simultaneous and interference-free playback of navigation and mobile device audio, enhancing user safety and experience by eliminating the need to switch between audio sources during operation.
Smart Images

Figure 0007611939000001 
Figure 0007611939000002 
Figure 0007611939000003
Abstract
Description
[Technical field]
[0001] The present invention relates to the field of audio information interaction, in particular to an audio information transmission system, method, device and corresponding motorcycle and helmet. [Background technology]
[0002] With the development of technology, people's use of electric motorcycles has become more and more common. Electric motorcycles have gradually become a relatively good vehicle. However, as a relatively fast-speed vehicle, safety has become an important issue. Therefore, people have come up with the idea of using helmets to protect the safety of cyclists.
[0003] Existing electric motorcycles generally have their own navigation systems, and helmets also have corresponding Bluetooth® earphones for receiving audio information. However, the Bluetooth® earphones in the helmets cannot simultaneously receive and play audio information (e.g., music and phone calls) played by the terminal device and the navigation voice of the electric motorcycle. Even if they were to be played simultaneously, they would interfere with each other, affecting the user experience. Summary of the Invention
[0004] The present application provides an audio information transmission system, method, and device, as well as a corresponding motorcycle and helmet, for solving the technical problem of being able to play audio information transmitted by a user terminal via earphones in a helmet and to play information such as navigation transmitted by an electric motorcycle without interfering with each other.
[0005] A first aspect of the present invention is an audio information transmission system for transmitting audio information between a motorcycle, a mobile terminal, and a helmet, the system including: a media control device provided on the motorcycle; and an audio switching device connected to the media control device, the audio switching device including: the audio switching device is connected to the mobile terminal and the helmet, respectively, and is used for receiving first audio information transmitted by the mobile terminal and forwarding the first audio information to the media control device; the media control device is used to receive the first audio information and second audio information generated by the two-wheeled vehicle, and to generate audio mixing information by mixing the first audio information and the second audio information; The audio information transmission system is characterized in that the audio switching device is also used to transmit the audio mixing information to the helmet.
[0006] According to a preferred embodiment of the present invention, the audio switching device comprises a first communication module for receiving first audio information transmitted by the mobile terminal and forwarding the first audio information to the media control device, The media control device includes a media control module and an audio mixing module, among which: the media control module is used to transfer the first audio information to the audio mixing module and send control instructions to the audio mixing module; The voice mixing module is used for receiving the control instruction and mixing the first audio information and the second audio information to generate voice mixing information.
[0007] According to a preferred embodiment of the present invention, the media control module is also used for obtaining priority information of the first audio information and the second audio information, or setting different priorities for the first audio information and the second audio information based on types of audio information, and controlling the audio mixing module to mix the first audio information and the second audio information according to the priority information to generate the audio mixing information.
[0008] According to a preferred embodiment of the present invention, the audio switching device is also used for receiving instructions from the mobile terminal to set different priorities for the first audio information and the second audio information depending on the type of audio information and to send the priority information to the media control device.
[0009] According to a preferred embodiment of the present invention, the audio mixing module, when mixing audio information of different priorities, reduces or eliminates the volume of audio information of relatively lower priority.
[0010] According to a preferred embodiment of the present invention, the audio mixing module pauses audio information of relatively lower priority when mixing audio information of different priorities.
[0011] According to a preferred embodiment of the present invention, the audio switching device further includes an audio identification module for identifying the received first audio information type, wherein: If the first audio information is a call voice, the audio switching device transmits the first audio information to the helmet; If the first audio information is non-call voice, the audio switching device transfers the first audio information to the media control device.
[0012] According to a preferred embodiment of the present invention, the system further includes a second communication module and an audio mixing playback module provided in a helmet, the second communication module being used for receiving the audio mixing information and the audio mixing playback module being used for playing back the audio mixing information.
[0013] According to a preferred embodiment of the present invention, the system further includes a cloud server and a third communication module connected to the media control device, the cloud server performing information interaction with the media control device via the third communication module.
[0014] According to a preferred embodiment of the present invention, the media control device receives configuration instructions transmitted by the cloud server, and the configuration instructions are used to generate priority rules and / or audio mixing parameters for the audio mixing information.
[0015] According to a preferred embodiment of the present invention, the system further includes a display module provided on the two-wheeled vehicle, the display module being connected to the media control device, the media control device being used to transmit audio mixing status information to the display module, and the display module providing a visual display based on the audio mixing status information.
[0016] A second aspect of the present invention is an audio information transmission method for transmitting audio information between a motorcycle, a mobile terminal, and a helmet, comprising: The motorcycle generates second audio information and receives the first audio information transmitted by the mobile terminal; The two-wheeled vehicle generates audio mixing information by mixing the first audio information and the second audio information; and The motorcycle provides an audio information transmission method, characterized in that it includes transmitting the audio mixing information to the helmet so that the helmet reproduces the audio mixing information.
[0017] According to a preferred embodiment of the present invention, the above-mentioned generation of audio mixing information by the two-wheeled vehicle by mixing the first audio information or the second audio information is performed by: The two-wheeled vehicle further includes obtaining priority information for the first audio information and the second audio information, or setting different priorities for the first audio information and the second audio information based on a type of audio information, and mixing the first audio information and the second audio information according to the priority information to generate the voice mixing information.
[0018] According to a preferred embodiment of the present invention, the above-mentioned generation of audio mixing information by the two-wheeled vehicle by mixing the first audio information or the second audio information is performed by: The two-wheeled vehicle further includes receiving an instruction from the mobile terminal to set different priorities for the first audio information and the second audio information depending on the type of audio information, and to mix the first audio information and the second audio information according to the priority information to generate the audio mixing information.
[0019] According to a preferred embodiment of the present invention, when mixing audio information of different priorities, the volume of audio information having a relatively low priority is reduced or eliminated.
[0020] In accordance with a preferred embodiment of the present invention, when mixing audio information of different priorities, audio information of relatively lower priority is paused.
[0021] According to a preferred embodiment of the present invention, after the two-wheeled vehicle generates second audio information and receives the first audio information transmitted by the mobile terminal, the method further comprises identifying a type of the received first audio information, among which: If the first audio information is a call voice, transmitting the first audio information to the helmet; If the first audio information is non-speech voice, the first audio information is transferred to the motorcycle for generating voice mixing information.
[0022] According to a preferred embodiment of the invention, the method further comprises the steps of: The method further includes receiving a configuration instruction sent by a cloud server, the configuration instruction being used to generate priority rules and / or audio mixing parameters for the audio mixing information.
[0023] A third aspect of the present invention is an audio information transmission device for transmitting audio information between a motorcycle, a mobile terminal, and a helmet, comprising: an audio receiving module for receiving second audio information generated by the motorcycle and the first audio information transmitted by the mobile terminal; an audio mixing module for mixing the first audio information and the second audio information to generate audio mixing information; an audio transmission module for transmitting the audio mixing information to the helmet; and a control module for controlling the helmet to play the audio mixing information.
[0024] According to a preferred embodiment of the present invention, the audio mixing module comprises: a priority setting unit for setting different priorities for the first audio information and the second audio information; The audio mixing unit further includes an audio mixing unit for mixing the first audio information and the second audio information in order of priority to generate the audio mixing information.
[0025] According to a preferred embodiment of the present invention, the device further comprises an identification module for identifying the received first audio information type, wherein: If the first audio information is a call voice, the audio transmission module transmits the first audio information to the helmet; If the first audio information is non-speech voice, the audio transmitting module transfers the first audio information to the two-wheeled vehicle for generating voice mixing information.
[0026] A fourth aspect of the present invention is a two-wheeled vehicle including a vehicle body and a media control device provided on the vehicle body, further including an audio switching device connected to the media control device, wherein: the audio switching device is connected to the mobile terminal and the helmet, respectively, and is used for receiving first audio information transmitted by the mobile terminal and forwarding the first audio information to the media control device; the media control device is used to receive the first audio information and second audio information generated by the two-wheeled vehicle, and to generate audio mixing information by mixing the first audio information and the second audio information; The audio switching device provided on the motorcycle is also used to transmit the audio mixing information to the helmet.
[0027] According to a preferred embodiment of the present invention, the audio switching device comprises a first communication module for receiving first audio information transmitted by the mobile terminal and forwarding the first audio information to the media control device, The media control device includes a media control module and an audio mixing module, among which: the media control module is used to transfer the first audio information to the audio mixing module and send control instructions to the audio mixing module; The voice mixing module is used for receiving the control instruction and mixing the first audio information and the second audio information to generate voice mixing information.
[0028] According to a preferred embodiment of the present invention, the media control module is also used for obtaining priority information of the first audio information and the second audio information, or setting different priorities for the first audio information and the second audio information based on types of audio information, and controlling the audio mixing module to mix the first audio information and the second audio information according to the priority information to generate the audio mixing information.
[0029] According to a preferred embodiment of the present invention, the audio switching device is also used for receiving instructions from the mobile terminal to set different priorities for the first audio information and the second audio information depending on the type of audio information and to send the priority information to the media control device.
[0030] According to a preferred embodiment of the present invention, the audio mixing module, when mixing audio information of different priorities, reduces or eliminates the volume of audio information of relatively lower priority.
[0031] According to a preferred embodiment of the present invention, the audio mixing module pauses audio information of relatively lower priority when mixing audio information of different priorities.
[0032] According to a preferred embodiment of the present invention, the audio switching device further includes an audio identification module for identifying the received first audio information type, wherein: If the first audio information is a call voice, the audio switching device transmits the first audio information to the helmet; If the first audio information is non-call voice, the audio switching device transfers the first audio information to the media control device.
[0033] According to a preferred embodiment of the present invention, the media control device receives a configuration instruction sent by a cloud server, and the configuration instruction is used to generate priority rules and / or audio mixing parameters for the audio mixing information.
[0034] In a fifth aspect of the present invention, there is provided a helmet including a housing and a second communication module disposed in the housing, further including an audio mixing and playback module, wherein the second communication module is connected to a motorcycle and is used for receiving audio mixing information transmitted by the motorcycle and transmitting the audio mixing information to the audio mixing and playback module; the audio mixing information is obtained by mixing, by the motorcycle, first audio information transmitted by a mobile terminal and second audio information generated by the motorcycle; The audio mixing playback module provides a helmet that is used to play back the audio mixing information.
[0035] In a sixth aspect, the present invention provides a computer readable storage medium storing one or more programs, the one or more programs implementing the above method when executed by a processor.
[0036] The technical solution of the present invention has the following beneficial effects:
[0037] The present invention transmits audio information sent from the mobile terminal to the motorcycle, mixes audio information such as navigation and warnings emitted by the motorcycle itself with the audio information transmitted from the mobile terminal, adjusts the volume of each piece of audio information in the mixed audio information, and transmits the mixed audio mixing information to the helmet.This allows the user to obtain audio information transmitted by the user terminal while riding, and can also obtain information such as navigation transmitted by the electric motorcycle, without the need to constantly switch between the audio transmitted by the mobile terminal and the electric motorcycle, improving riding safety and improving the user experience. [Brief description of the drawings]
[0038] In order to clarify the technical problems to be solved, the technical means adopted, and the technical effects obtained by the present invention, the following will describe in detail specific embodiments of the present invention in conjunction with the accompanying drawings. It should be noted that the drawings described below are only drawings of exemplary embodiments of the present invention, and those skilled in the art can obtain drawings of other embodiments based on these drawings without creative labor. [Figure 1] FIG. 2 is a schematic diagram of an audio information transmission system application scenario according to one embodiment of the present invention; [Diagram 2] FIG. 1 is an overall architecture diagram of a vehicle intelligent control system according to an embodiment of the present invention. [Diagram 3] 1 is an overall architecture diagram of an audio information transmission system according to an embodiment of the present invention; [Figure 4] FIG. 1 is a block diagram of an audio information transmission system structure according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a block diagram of an audio information transmission system structure according to another embodiment of the present invention. [Figure 6] FIG. 2 is a block diagram of a communication device module structure of a helmet according to one embodiment of the present invention. [Figure 7]2 is a flowchart of a method for transmitting audio information according to an embodiment of the present invention. [Figure 8] 1 is a schematic diagram of an audio information transmission device according to an embodiment of the present invention; [Figure 9] 1 is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention; [Figure 10] 1 is a schematic diagram of a computer-readable storage medium according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0039] In the process of introducing specific embodiments, detailed descriptions of the structure, performance, effects, or other features are provided for the purpose of allowing those skilled in the art to fully understand the embodiments, but it does not exclude that those skilled in the art may implement the present invention with a technical solution that does not include the above structure, performance, effects, or other features in a particular case.
[0040] The flowcharts in the accompanying drawings are merely exemplary flow presentations, and do not represent that the aspects of the present invention must include all the contents, operations and steps in the flowcharts, nor must they be performed in the order shown in the figures. For example, in the flowcharts, some operations / steps can be separated, and some operations / steps can be integrated or partially integrated. The execution order shown in the flowcharts can be changed according to actual conditions without departing from the spirit of the present invention.
[0041] The block diagrams in the accompanying drawings generally represent functional entities which do not necessarily correspond to physically separate entities, i.e. these functional entities may be implemented in software form, or by one or more hardware modules or integrated circuits, or by different network and / or processing units and / or microcontroller devices.
[0042] The same or similar elements, components, or parts shown in each attached drawing are given the same reference numerals, and therefore, in the following, duplicated descriptions of the same or similar elements, components, or parts may be omitted. It should be understood that, although various devices, elements, components, or parts are described in this specification with limiting words representing numbers such as first, second, third, etc., these devices, elements, components, or parts should not be limited by these limiting words. That is, these limiting words are used only to distinguish one from the other. For example, a first device may also be called a second device, without departing from the substantial technical idea of the present invention. It should be noted that the term "and / or" refers to any one or more combinations of the listed items.
[0043] The present invention proposes an audio information transmission system, method, device, and motorcycle and helmet, and generally, the system includes a motorcycle and a mobile terminal that performs information interaction between the motorcycle and a helmet worn on a user's head, the motorcycle may be any two-wheeled vehicle, including a bicycle, an electric bicycle, a motorbike, an electric scooter, an electric kick scooter, etc., and the mobile terminal may be a mobile phone, a pad, a smart watch, etc.
[0044] In order to solve the problem in the prior art that a user cannot simultaneously obtain audio information transmitted by a mobile terminal and audio information transmitted by the motorcycle itself when wearing a helmet, the motorcycle of the present invention adopts an audio information transmission system, in which the mobile terminal transmits audio information to the motorcycle, and the motorcycle mixes voice information such as navigation and warnings emitted by the motorcycle itself, as well as driving information transmitted by a cloud server, with the audio information transmitted by the mobile terminal to form audio mixing information, and transmits the audio mixing information to the helmet for playback. The audio mixing information that is synthesized varies depending on the importance of each piece of audio information, and the user can obtain the audio information transmitted by the user terminal from the audio mixing information via earphones while riding, and can also obtain information such as navigation transmitted by the electric motorcycle, without the need to operate the user terminal or the motorcycle, thereby improving the user's riding safety and improving the user experience.
[0045] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail hereinafter in conjunction with specific embodiments and with reference to the accompanying drawings.
[0046] FIG. 1 is a schematic diagram of an audio information transmission system application scenario according to one embodiment of the present invention.
[0047] As shown in FIG. 1, in this exemplary application scenario, the audio information transmission system is provided in a control system 11 of a motorcycle 10, and can exchange data with a mobile terminal 20 via a wired or wireless network, where the wireless network can be Bluetooth, a mobile hotspot, etc., and the motorcycle 10 can also communicate with a smart helmet via the audio information transmission system. 30The motorcycle 10 communicates with the mobile terminal 20. Both the motorcycle 10 and the mobile terminal 20 can exchange data with the cloud server 80 via a mobile communication network. The user can not only directly operate the motorcycle 10, but also remotely monitor and control the motorcycle 10 via the mobile terminal 20 to realize various smart application functions. The motorcycle 10 is further provided with a touch screen (not shown in FIG. 1), and the user can control the motorcycle 10 and perform corresponding operations by operating on the display.
[0048] The mobile terminal 20 server It can also interact with 80 and cloud services. server 80 can also transmit a control command from the mobile terminal 20 to the second control system 11. The second control system 11 can receive a control command from the mobile terminal 20 and transfer to the first control system 12 a control command that needs to be processed by the first control system 12 to realize a remote control application, such as a remote lock for theft prevention.
[0049] In addition, the second control system 11 transmits vehicle operation status data from the first control system 12, which includes various operation status data of the vehicle, to the cloud. server 80. It should be noted that the operating state referred to here includes the vehicle's environmental state, the vehicle's overall state, and the state of each part, and includes not only the state when the vehicle is running, but also the state when the vehicle is in various modes such as stopped and not started, started and not running.
[0050] The mobile terminal 20 can transmit audio information to the motorcycle 10, and the type of audio information includes voice messages, telephone calls, music, etc. When the motorcycle 10 receives the audio information transmitted by the mobile terminal 20, it can first identify the type of audio information. If it is an immediate voice such as a telephone call, it can send the smart helmet 30 The user then uses the smart helmet 30A call can be made to the mobile terminal 20 via the smart helmet 20, and non-realtime voice such as a voice message or music can be sent from an application in the motorcycle and mixed with audio information such as navigation and warnings, and then the smart helmet 20 can receive the voice. 30 The user can then use the smart helmet 30 While listening to music via the smartphone, the user can listen to audio information transmitted by the motorcycle at a relevant time and perform a relevant operation based on the audio information.
[0051] FIG. 2 is an overall architecture diagram of a vehicle intelligent control system according to an embodiment of the present invention. As shown in FIG. 2, the motorcycle terminal includes a first control system 12 and a second control system 11, and the two control systems form a dual independent control system architecture. The dual independent control system architecture refers to the fact that the first control system 12 and the second control system 11 can operate independently of each other. Independent operation in the present invention refers to the fact that the normal operation of each of the two basic operation modes does not depend on the normal operation of the other. Specifically, on the one hand, when the second control system 11 does not operate normally, the first control system 12 does not affect its basic on-board device control. However, when the second control system 11 does not operate normally, the first control system 12 may not be able to obtain control commands from the second control system 11, and it is also not possible to transmit vehicle operation status data to the second control system 11 in real time. However, the above-mentioned control commands that cannot be obtained and status data that cannot be transmitted do not affect the basic driving control of the first control system 12 for the vehicle. On the other hand, if the second control system 11 does not operate normally, its basic network interconnection will also be affected, and the second control system 11 may not be able to obtain real-time vehicle operating status from the first control system 12, nor will it be able to send external additional control commands to the first control system 12.
[0052] When both of the two control systems operate normally, they can exchange data in real time. In order to realize the function of smart application based on remote control, the first control system 12 and the second control system 11 need to exchange data. The first control system 12 may be called a lower-layer control system, and its basic function refers to a conventional vehicle control function, and includes a function of monitoring the operation status of the vehicle in real time, controlling the operation of the vehicle, and receiving a control command from the second control system 11 in order to realize the function of smart application. The second control system 11 may be called a top-layer control system, and is mainly used to access car telematics and exchange data, and is used to realize direct information interaction between the motor vehicle terminal and the user (including controlling a display device to display the operation status of the vehicle, and performing information interaction with a smart helmet, etc.).
[0053] Specifically, on the one hand, the first control system 12 needs to transmit at least a part of the vehicle operation status data to the second control system 11 in real time. At the same time, the first control system 12 can also control the operation of the vehicle based on internal predetermined commands and control commands received from the second control system 11. On the other hand, the second control system 11 receives the data transmitted by the first control system 12 and uploads at least a part of the received data to the cloud. server The second control system 11 can transmit the information to the cloud. server 80, and can transfer to the first control system 12 control commands for controlling vehicle operation.
[0054] Between the first control system 12 and the second control system 11 of the present invention, and between the second control system 11 and the cloud server The specific data or control instructions that need to be exchanged between the vehicle and the control device may be designed differently depending on the specific vehicle type, application function, application environment, etc., but are not intended to be limiting of the present invention.
[0055] FIG. 3 is a diagram showing the overall architecture of an audio information transmission system according to an embodiment of the present invention.
[0056] The motorcycle terminal of the audio information transmission system described in the embodiment of the present invention is provided in the second control system 11 of the motorcycle. For the sake of clarity, the second control system 11 is referred to as the control system 11. As shown in FIG. 3, the control system 11 of the motorcycle 10 includes a media control device 112 and an audio switching device 111 connected to the media control device 112. The control system 11 is mainly used to access a network for data exchange, and is also used to realize direct information interaction between the motorcycle terminal and the user (including controlling a display device to display the vehicle's operating status, and performing information interaction with a smart helmet, etc.).
[0057] Specifically, the audio switching device 111 is connected to the mobile terminal 20 and the smart helmet 30 1 and 2, respectively, and are used to receive the first audio information transmitted by the mobile terminal 20 and transmit it to the media control device 112. The audio switching device 111 is provided with a Bluetooth module, and the mobile terminal 20 and the smart helmet 30 The smart helmet 100 can wirelessly exchange data with the smart helmet 100, and the first audio information may be audio information such as a voice message, a phone call, or music. The media control device 112 receives the first audio information and second audio information generated by the motorcycle 10, and is used to mix the first audio information and the second audio information to generate audio mixing information. The second audio information may be information such as navigation, an alarm, or the like, or may be audio information downloaded into the motorcycle 10 via the cloud server 80. The media control device 112 transmits the mixed audio mixing information to the smart helmet 100 via the audio switching device 111. 30 Send to Smart Helmet 30plays back the audio mixing information to the user.
[0058] By transmitting audio information sent from the mobile terminal to the motorcycle, audio information such as navigation and warnings emitted from the motorcycle itself can be mixed with the audio information sent from the mobile terminal, and the mixed audio mixing information can be sent to the helmet, allowing the user to obtain the audio information transmitted by the user terminal while riding, and can also obtain information such as navigation transmitted by the electric motorcycle, eliminating the need to constantly switch between the audio transmitted by the mobile terminal and the electric motorcycle, improving riding safety and improving the user experience.
[0059] FIG. 4 is a block diagram of an audio information transmission system structure according to an embodiment of the present invention.
[0060] As shown in FIG. 4, in this embodiment, the audio switching device 111 includes a first communication module 1111 and an audio identification module 1112, the media control device 112 includes an audio mixing module 1121 and a media control module 1122, the audio switching device 111 is connected to another sound generating device 113, which may be an application and device mounted on the motorcycle 10, and the media control module 1122 may be realized by an ECU (Electronic Control Unit), which is also called an "engine control unit" and is composed of a microprocessor (CPU), memory (ROM, RAM), input / output interface (I / O), analog-to-digital converter (A / D) and large-scale integrated circuits such as shaping and driving. However, the present invention does not exclude other forms of electronic control units, and it is sufficient that they have a certain data storage and processing capacity.
[0061] The audio switching device 111 communicates with the cloud via the third communication module 40. server 80 connected to the cloud serverPositioning information and audio information can be uploaded or downloaded via 80 .
[0062] The mobile terminal 20 sends audio information to the first communication module 1111. If the audio information is non-realtime voice information, the first communication module 1111 transmits the non-realtime voice information to the audio identification module 1112 for identification, and performs different voice mixing processing according to different audio identification types. If the audio information is realtime voice such as a telephone call, the audio identification module 1112 transmits the call voice information to the smart helmet via the first communication module 1111. 30 The user then uses the smart helmet 30 The user makes a call to the mobile terminal 20 via the telephone number and carries out a conversation.
[0063] For example, the mobile terminal 20 transmits non-call voice information to the first communication module 1111, and the first communication module 1111 transmits the non-call voice information to the audio identification module 1112 for identification. If the non-call voice information is identified as a music song, the user is listening to music through the mobile terminal at this time, and the audio identification module 1112 transmits the music to the audio mixing module 1121 of the media control device 112 through the first communication module 1111. If the motorcycle 10 does not transmit any audio information to the audio mixing module 1121 at this time, the audio mixing module 1121 transmits the music to the smart helmet 111. 30 When the voice mixing module 1121 receives voice navigation information transmitted by a map navigation application in another sound generating device 113 of the motorcycle 10, the user is about to drive the motorcycle out or is currently driving the motorcycle. At this time, the media control module 1122 sends a control command to the voice mixing module 1121, and after receiving the control command, the voice mixing module 1121 performs mixing on the voice navigation information and music.
[0064] The system can preset the priority rules of the audio mixing module 1121, and when setting the priority rules, different priorities can be set for different types of audio information on the display module 114 of the motorcycle 10, for example, the highest priority of the phone call, followed by alarm information, voice information, navigation information, entertainment information, etc., in descending order of priority, where entertainment information includes music, movies, and other entertainment types of audio information obtained from the cloud server 80, and the priority settings can be self-set according to the user's desire and are not limited thereto. Note that the user can also install an application corresponding to the control system 11 of the motorcycle 10 on the mobile terminal 20, and the user can set different priorities for different types of audio information through the application.
[0065] The audio mixing parameters may be automatically configured in advance, for example, audio mixing may be activated, or audio mixing may be automatically activated after the audio mixing module 1121 receives audio information to be mixed, and after audio mixing is activated, a priority rule may be selected, for example, when playing high priority audio information, the volume of relatively low priority audio information may be reduced or set to zero, or the playback of relatively low priority audio information may be paused.
[0066] The above priority rules and audio mixing parameters can both be manually set via a user interaction component on the motorcycle 10. The user interaction component can include keys, buttons, tabs, etc., provided on the motorcycle, as well as a display device for displaying the user interaction interface in real time, or the user interaction component can be directly realized by a touch screen that simultaneously has the function of receiving user input and the display interface.
[0067] In another embodiment, the priority rules and audio mixing parameters can be remotely set by the cloud server and the remote client. For example, the mobile terminal 20 or other user terminal that can access the cloud server can first call up the current priority rules and audio mixing parameters of the motorcycle through the cloud server, and set them through the user interaction interface of the user terminal, and the user terminal converts the user's input into a configuration command and sends it to the media control device 112 of the motorcycle through the cloud server. This allows the user to set the priority rules and audio mixing parameters in a remote access manner.
[0068] In addition, the user can also upload the priority rules and audio mixing parameters to the cloud server by operating directly on the motorcycle or by instructions sent by the cloud server. In a more preferred embodiment, the cloud server can store recommended priority rules and audio mixing parameters, which may be uploaded by another user or obtained by big data and machine learning. Thus, the user can download the recommended priority rules and audio mixing parameters via the cloud server and apply them to the motorcycle 10 by operating directly on the motorcycle or by instructions sent by the cloud server.
[0069] When the priority of audio information is set, if the audio information acquired by the voice mixing module 1121 includes audio information of different priorities, the volume of the audio information with a relatively low priority at the same time may be reduced or set to zero based on the preset priority rule, or the audio information with a relatively low priority may be paused, and the audio information with a relatively high priority is inserted into the audio information with a low priority, which corresponds to mixing the audio information. For example, when the received audio information is voice navigation information transmitted by the other sound generating device 113 of the motorcycle 10 and music transmitted by the mobile terminal 20, the priority of the voice navigation information is higher than the music according to the preset priority, so that when the voice navigation information and the music are monitored simultaneously at the same time, the volume of the music may be reduced or set to zero from the end of the navigation voice until the restart of the music, and the processed music and the voice navigation information are mixed to obtain the mixed voice mixing information, and the voice mixing information is made into one independent audio information, and when the voice navigation information and the music are monitored simultaneously at the same time, the music may be paused from the end of the navigation voice until the restart of the music playback, and the voice navigation information is inserted into the music at the corresponding time, which corresponds to forming the voice mixing information. There are various methods for forming the voice mixing information, but they are not limited here. When the audio mixing information is formed and transmitted to the helmet for playback, the display module 114 can display the audio mixing status of the audio mixing information. For example, when a pause process is performed on audio information with a relatively low priority during a certain time period, the user can view the audio mixing status of the audio mixing information through the display module so as not to miss any information.
[0070] By setting priorities for different types of audio information and regularly mixing various pieces of audio information to form audio mixing information, various pieces of information can be transmitted to the user without affecting the content and sound quality of the audio information, and the user does not need to be busy switching between the audio transmitted by the mobile terminal and the audio transmitted by the electric motorcycle, thereby improving the user's driving safety and improving the user experience.
[0071] FIG. 5 is a block diagram of an audio information transmission system structure according to another embodiment of the present invention.
[0072] According to the priority setting rule in the above embodiment, when the audio information that the mobile terminal 20 transmits to the first communication module 1111 is an instantaneous call voice such as a telephone call, this type of audio information has the highest priority. At this time, there is no need to transmit this call to the voice mixing module 1121 for voice mixing, and the voice information is sent to the smart helmet via the first communication module. 30 The call information is directly transferred to the smart helmet 112, and the call information is sent to the media control device 112. The media control device 112 is connected to the touch display module 114. The interface displayed by the display module 114 is the same as the interface displayed by the mobile terminal screen. The call information includes the callee's telephone number, and if there is a note on the mobile terminal, the note name, the destination, and other information will also be displayed. The user can also perform operations such as answering and ending the call on the touch display module 114. When the user selects to answer the call, the smart helmet 30 When the call information is received, the media control device 112 controls the smart helmet 30 The transmission of voice mixing information to the other party is stopped, so as to ensure that there is no interference with the call and improve the call quality.
[0073] An embodiment of the present invention further provides a motorcycle, as shown in FIG. 1, the motorcycle 10 includes a vehicle body and an audio information transmission system provided in the vehicle body, the mobile terminal transmits audio information to the motorcycle 10, the audio information transmission system in the motorcycle 10 mixes audio information such as navigation and warnings generated by the motorcycle 10 itself and driving information transmitted by a cloud server with the audio information transmitted by the mobile terminal to form audio mixing information, and transmits the audio mixing information to a helmet for playback, the audio mixing information synthesized depending on the importance of each piece of audio information is different, the user can obtain audio information transmitted by the user terminal from the audio mixing information through earphones while traveling, and can also obtain information such as navigation transmitted by the electric motorcycle, without the need to operate the user terminal or the motorcycle, improving the user's traveling safety and improving the user experience. The structure and function of the audio information transmission system in this embodiment are the same as or similar to the audio information transmission system described in the above embodiment, and therefore will not be described here.
[0074] FIG. 6 is a block diagram of a communication device module structure of a helmet according to one embodiment of the present invention.
[0075] The helmet in this embodiment may be a smart helmet, and the overall structure of the smart helmet in FIG. 306, the communication device includes a housing and a communication device disposed in the housing. As shown in FIG. 6, the communication device includes a main control module 503, a second communication module 501, and an earphone, in which the earphone further includes a microphone 504 and an earphone audio mixing and playback module 502, the second communication module 501 may be a Bluetooth module, wirelessly connected to the motorcycle, and used for receiving audio mixing information transmitted by the motorcycle and transferring the audio mixing information to the earphone audio mixing and playback module 502 via the main control module 503 for playback, in which the audio mixing information is obtained by the motorcycle mixing the first audio information transmitted by the mobile terminal and the second audio information generated by the motorcycle itself, and the earphone microphone 504 is used for user calls. If the motorcycle transmits real-time communication information such as a telephone call to the helmet rather than voice mixing information, the main control module 503 controls the earphone microphone 504 and the voice mixing playback module 502 to turn them on simultaneously, and makes a call via the second communication module 501.
[0076] Priority rules may be preset during audio mixing, and when the priority rules are set, different priorities may be set for different types of audio information on the display of the motorcycle 10, and an application corresponding to the control system 11 of the motorcycle 10 may be installed on the mobile terminal, and the user may set different priorities for different types of audio information through the application. If the audio information acquired by the motorcycle 10 includes audio information of different priorities, the volume of the audio information with a relatively low priority may be reduced or set to zero at the same time based on the preset priority rules, and the audio information with a relatively low priority may be paused, and the audio information with a relatively high priority is inserted into the audio information with a low priority, which corresponds to mixing the audio information. Finally, the obtained audio mixing information is sent to the earphones in the helmet, and the audio mixing information is played back through the earphones.
[0077] It should be noted that the smart helmet described in this embodiment is an exemplary embodiment of the present invention, and any helmet that can establish a communication connection with a motorcycle and display or play information can be applied to the present invention. That is, each functional module of the smart helmet may be added or deleted according to different purposes.
[0078] Through the interaction between the motorcycle and the smart helmet, the function of the audio information transmission system of the present invention is made more diverse and easier, further improving the user's sense of smart and remote control, enhancing the user experience, and improving people's quality of life.
[0079] FIG. 7 is a flowchart of a method for transmitting audio information according to an embodiment of the present invention.
[0080] As shown in FIG. 7, the method includes steps S61 to S63.
[0081] S61, the motorcycle generates second audio information and receives first audio information transmitted by a mobile terminal.
[0082] Specifically, the first audio information transmitted by the mobile terminal may be audio information such as music, voice messages, telephone calls, etc., and the second audio information generated by the motorcycle may be information such as navigation, alarms, etc., and may be audio information downloaded into the motorcycle via a cloud server, and the motorcycle stores both of the received two pieces of audio information.
[0083] S62, the motorcycle mixes the first audio information and the second audio information to generate audio mixing information.
[0084] Specifically, a priority rule may be preset during audio mixing, and when the priority rule is set, different priorities may be set for different types of audio information on the display of the motorcycle, for example, the highest priority of the phone call, followed by alarm information, voice information, navigation information, entertainment information, etc., in descending order of priority, where entertainment information includes music, movies, and other entertainment-type audio information obtained from a cloud server, and the priority setting may be self-set according to the user's desire and is not limited thereto. Note that the user may also install an application corresponding to the control system of the motorcycle on the mobile terminal, and the user may set different priorities for different types of audio information through the application.
[0085] When the mobile terminal transmits first audio information to the motorcycle, the audio information is non-realtime voice information, and the motorcycle also obtains second audio information emitted by itself, the two audio information at this time correspond to different priorities, and based on the preset priority rule, the volume of the audio information with a relatively low priority at the same time may be reduced or set to zero, or the audio information with a relatively low priority may be paused, or the audio information with a relatively high priority is inserted into the audio information with a low priority, which is equivalent to mixing the audio information. For example, when the received audio information is voice navigation information transmitted by a motorcycle and music transmitted by a mobile terminal, the priority of the voice navigation information is higher than that of the music according to the preset priority, so that when the voice navigation information and the music are monitored simultaneously at the same time, the volume of the music may be reduced or set to zero from the end of the navigation voice to the restart of the music, and the processed music and the voice navigation information are mixed to obtain the mixed voice mixing information, and the voice mixing information is made into one independent audio information, and when the voice navigation information and the music are monitored simultaneously at the same time, the music may be paused from the end of the navigation voice to the restart of the music playback, and the voice navigation information is inserted into the music at the corresponding time to form the voice mixing information. There are various methods for forming the voice mixing information, but they are not limited here.
[0086] S63, the motorcycle transmits the audio mixing information to the helmet so that the helmet reproduces the audio mixing information.
[0087] Specifically, the mobile terminal transmits audio information to the motorcycle, and if the audio information is non-realtime voice information, the motorcycle identifies the non-realtime voice information, performs different voice mixing processing according to different audio identification types, and transmits the audio information after audio mixing to the smart helmet for playback, and if the audio information is realtime call voice such as a phone call, the motorcycle transfers the call voice information to the smart helmet, and the user makes a call to the mobile terminal via the smart helmet.
[0088] By setting priorities for different types of audio information and regularly mixing various pieces of audio information to form audio mixing information, various pieces of information can be transmitted to the user without affecting the content and sound quality of the audio information, and the user does not need to be busy switching between the audio transmitted by the mobile terminal and the audio transmitted by the electric motorcycle, thereby improving the user's driving safety and improving the user experience.
[0089] FIG. 8 is a schematic diagram of an audio information transmitting device according to an embodiment of the present invention.
[0090] As shown in FIG. 8, the device 700 is used for transmitting audio information between a motorcycle, a mobile terminal and a helmet, and includes an audio receiving module 701, an audio mixing module 702, an audio transmitting module 703 and a control module 704.
[0091] The audio receiving module 701 is used to receive the second audio information generated by the motorcycle and the first audio information transmitted by the mobile terminal. Specifically, the first audio information transmitted by the mobile terminal may be audio information such as music, voice message, phone call, etc., and the second audio information generated by the motorcycle may be information such as navigation, warning, etc., or may be audio information downloaded into the motorcycle via a cloud server, and the motorcycle stores both of the received two pieces of audio information.
[0092] The audio mixing module 702 is used for mixing the first audio information and the second audio information to generate voice mixing information.
[0093] Specifically, a priority rule may be preset during audio mixing, and when the priority rule is set, different priorities may be set for different types of audio information on the display of the motorcycle. For example, the priority of the phone call may be set to be the highest, followed by alarm information, voice information, navigation information, entertainment information, etc., in descending order of priority, where the entertainment information includes music, movies, and other entertainment-type audio information obtained from a cloud server, and the priority setting may be self-set according to the user's desire and is not limited thereto. Note that the user may also install an application corresponding to the control system of the motorcycle on the mobile terminal, and the user may set different priorities for different types of audio information through the application.
[0094] When the mobile terminal transmits first audio information to the motorcycle, the audio information is non-realtime voice information, and the motorcycle also obtains second audio information emitted by itself, the two audio information at this time correspond to different priorities, and based on the preset priority rule, the volume of the audio information with a relatively low priority at the same time may be reduced or set to zero, or the audio information with a relatively low priority may be paused, or the audio information with a relatively high priority is inserted into the audio information with a low priority, which is equivalent to mixing the audio information. For example, when the received audio information is voice navigation information transmitted by a motorcycle and music transmitted by a mobile terminal, the priority of the voice navigation information is higher than that of the music according to the preset priority, so that when the voice navigation information and the music are monitored simultaneously at the same time, the volume of the music may be reduced or set to zero from the end of the navigation voice to the restart of the music, and the processed music and the voice navigation information are mixed to obtain the mixed voice mixing information, and the voice mixing information is made into one independent audio information, and when the voice navigation information and the music are monitored simultaneously at the same time, the music may be paused from the end of the navigation voice to the restart of the music playback, and the voice navigation information is inserted into the music at the corresponding time to form the voice mixing information. There are various methods for forming the voice mixing information, but they are not limited here.
[0095] The audio transmission module 703 is used to transmit the audio mixing information to the helmet.
[0096] Specifically, the mobile terminal transmits audio information to the motorcycle, and if the audio information is non-realtime voice information, the motorcycle identifies the non-realtime voice information, performs different voice mixing processing according to different audio identification types, and transmits the audio information after audio mixing to the smart helmet for playback, and if the audio information is realtime call voice such as a phone call, the motorcycle transfers the call voice information to the smart helmet, and the user makes a call to the mobile terminal via the smart helmet.
[0097] By setting priorities for different types of audio information and regularly mixing various pieces of audio information to form audio mixing information, various pieces of information can be transmitted to the user without affecting the content and sound quality of the audio information, and the user does not need to be busy switching between the audio transmitted by the mobile terminal and the audio transmitted by the electric motorcycle, thereby improving the user's driving safety and improving the user experience.
[0098] A control module 704 is used to control the helmet to play the audio mixing information.
[0099] Specifically, the control module 704 controls the audio transmission module 703 to transmit audio mixing information to the helmet for playback, and the audio mixing information synthesized varies depending on the importance of each piece of audio information. While the user is riding, the user can obtain audio information transmitted by the user terminal from the audio mixing information via earphones, and can also obtain information such as navigation transmitted by the electric motorcycle, without the need to operate the user terminal or the motorcycle, thereby improving the user's riding safety and improving the user experience.
[0100] FIG. 9 is a schematic diagram of the structure of an electronic device according to one embodiment of the present invention, the electronic device including a processor and a memory, the memory being used to store a computer-executable program, and when the computer-executable program is executed by the processor, the processor performs an audio information transmission method.
[0101] As shown in Fig. 9, the electronic device is embodied in the form of a general-purpose computing device. The processor therein may be one or more and may cooperate. The present invention does not exclude performing distributed processing, i.e. the processors may be distributed in different entity devices. The electronic device of the present invention is not limited to a single entity, but may be the sum of multiple entity devices.
[0102] The memory may store a computer executable program, typically machine readable code, that can be executed by the processor to cause the electronic device to perform the method of the invention, or at least some of the steps of the method.
[0103] The memory may include volatile memory, such as random access memory (RAM) and / or cache memory, and may be non-volatile memory, such as read only memory (ROM).
[0104] Optionally, in this embodiment, the electronic device further includes an I / O interface for transmitting data between the electronic device and an external device. The I / O interface may be one or more of a structure representing a number of types of buses, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any bus structure in a number of bus structures.
[0105] It should be noted that the electronic device shown in Fig. 9 is merely one example of the present invention, and the electronic device of the present invention may further include elements or components not shown in the above example. For example, some electronic devices further include a display unit such as a display, and some electronic devices further include man-machine interaction elements such as buttons, keyboards, etc. As long as the electronic device can execute a computer-readable program in a memory to realize the method of the present invention or at least some steps of the method, any of them can be considered as an electronic device covered by the present invention.
[0106] From the description of the above embodiment, a person skilled in the art can easily understand that the present invention may be realized by hardware capable of executing a specific computer program, for example, the system of the present invention, and an electronic processing unit, server, client, mobile phone, control unit, processor, etc. included in the system, and the present invention may also be realized by a vehicle including at least a part of the above system or parts. The present invention may also be realized by computer software that executes the method of the present invention, for example, control software executed by a microprocessor of a motor vehicle terminal, an electronic control unit, a client, a server end, etc. It should be explained that the computer software that executes the method of the present invention is not limited to being executed by one or a specific number of hardware entities, but may be realized in a distributed manner by unspecified concrete hardware, for example, some method steps executed by the computer program may be executed by a motor vehicle terminal, and another part may be executed by a mobile terminal or a smart helmet, etc. For computer software, the software product may be stored in one computer-readable storage medium (which may be a CD-ROM, a U-disk, a removable hard disk, etc.) or may be distributed and stored on a network, as long as it can cause an electronic device to execute the method according to the present invention.
[0107] FIG. 10 is a schematic diagram of a computer-readable storage medium according to an embodiment of the present invention. As shown in FIG. 10, the computer-readable storage medium has a computer-executable program stored therein, which, when executed, realizes the above-mentioned audio information transmission method of the present invention. The computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier, having readable program code therein. Such a propagated data signal may take a number of forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may be any readable medium other than a readable storage medium, which may transmit, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained in the readable storage medium may be transmitted in any suitable medium, including, but not limited to, wireless, wired, optical cable, RF, or the like, or any suitable combination of the above.
[0108] The program code for carrying out the operations of the present invention may be compiled in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and further including conventional program programming languages such as the "C" language or similar programming languages. The program code may be executed completely on the user computing device, partially on the user equipment, as a single independent software package, partially on the user computing device and partially on a remote computing device, or completely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device or to an external computing device (e.g., connected via the Internet using an Internet Service Provider) via any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN).
[0109] The above-mentioned specific embodiments have further explained the objectives, technical solutions and beneficial effects of the present invention in detail. However, it should be understood that the above embodiments are merely specific embodiments of the present invention, and the present invention is not limited thereto. Any modifications, equivalents, improvements, etc. made within the spirit and principle of the present invention are all included in the protection scope of the present invention.
Claims
1. An audio information transmission system for transmitting audio information between a motorcycle, a mobile terminal, and a helmet, the system including: a media control device provided on the motorcycle; and an audio switching device connected to the media control device, the audio switching device including: the audio switching device is used to establish a data connection with the mobile terminal and the helmet, receive first audio information transmitted by the mobile terminal, and transfer the first audio information to the media control device; the media control device is used to receive the first audio information and second audio information generated by the two-wheeled vehicle, and to generate audio mixing information by mixing the first audio information and the second audio information; The audio switching device is also used to transmit the audio mixing information to the helmet; The system further includes a cloud server and a third communication module connected to the media control device, the cloud server performing information interaction with the media control device via the third communication module; The media control device receives a configuration command transmitted by the cloud server, and the configuration command is used to generate priority rules and / or audio mixing parameters of the audio mixing information.
1. An audio information transmission system comprising:
2. the audio switching device includes a first communication module for receiving first audio information transmitted by the mobile terminal and forwarding the first audio information to the media control device; The media control device includes a media control module and an audio mixing module, among which: the media control module is used for obtaining priority information of the first audio information and the second audio information, or setting different priorities for the first audio information and the second audio information based on types of audio information, forwarding the first audio information to the audio mixing module, and sending control instructions to the audio mixing module; 2. The system of claim 1, wherein the audio mixing module is used to receive the control instruction and mix the first audio information and the second audio information according to the priority information or a priority to generate the audio mixing information.
3. 3. The system of claim 2, wherein the audio mixing module reduces or eliminates the volume of audio information of relatively lower priority when mixing audio information of different priorities.
4. 3. The system of claim 2, wherein the audio mixing module pauses relatively lower priority audio information when mixing audio information of different priorities.
5. The audio switching device further includes an audio identification module for identifying the received first audio information, wherein: If the first audio information is a call voice, the audio switching device transmits the first audio information to the helmet; 2. The system of claim 1, wherein if the first audio information is non-speech voice, the audio switching device forwards the first audio information to the media control device.
6. 2. The system of claim 1, further comprising a second communication module and an audio mixing and playback module provided in a helmet, the second communication module being used to receive the audio mixing information and the audio mixing and playback module being used to play back the audio mixing information.
7. 2. The system of claim 1, further comprising a display module provided on the two-wheeled vehicle, the display module being connected to the media control device, the media control device being used to send audio mixing status information to the display module, and the display module providing a visual display based on the audio mixing status information.
8. An audio information transmission method for transmitting audio information between a motorcycle, a mobile terminal, a cloud server, and a helmet, comprising: The motorcycle generates second audio information and receives the first audio information transmitted by the mobile terminal; The two-wheeled vehicle generates audio mixing information by mixing the first audio information and the second audio information; and The motorcycle transmits the audio mixing information to the helmet so that the helmet reproduces the audio mixing information; and The audio information transmission method includes the step of: the motorcycle receiving a configuration command transmitted from the cloud server, the configuration command being used to generate priority rules and / or audio mixing parameters of the audio mixing information.
9. A motorcycle including a vehicle body and a media control device provided on the vehicle body, further including an audio switching device connected to the media control device, the audio switching device is used to establish a data connection with the mobile terminal and the helmet, receive first audio information transmitted by the mobile terminal, and transfer the first audio information to the media control device; the media control device is used to receive the first audio information and second audio information generated by the two-wheeled vehicle, and to generate audio mixing information by mixing the first audio information and the second audio information; The audio switching device is also used to transmit the audio mixing information to the helmet; The media control device receives a configuration command transmitted from a cloud server, and the configuration command is used to generate priority rules and / or audio mixing parameters for the audio mixing information.
10. 1. An electronic device including a processor and a memory for storing a computer executable program, 9. An electronic device, comprising: an input section for inputting a first input of the first program; a second input section for inputting a second program;
11. 10. A computer readable storage medium storing one or more programs, the one or more programs implementing the method of claim 8 when executed by a processor.
Citation Information
Patent Citations
Radio communication system for vehicle
JP2001148657A
Electroacoustic transducer, ear-mount type electronic device, and sound emitting / Reproducing system
JP2001308977A
Parameter setting apparatus and program for achieving control method therefor
JP2010032876A
Vehicle voice processing device
JP2014072790A