In-vehicle interactive communication methods, devices, systems, electronic devices and media

Abstract

This invention discloses an in-vehicle interactive communication method. After the in-vehicle application is launched, a launch sound wave signal is acquired based on the launch operation for launching a target application on a mobile device, and the launch sound wave signal is sent to the mobile device; a sound wave confirmation signal is acquired from the mobile device; in response to the sound wave confirmation signal, a sound wave command signal group corresponding to the operation command code of the in-vehicle application is acquired, and the sound wave command signal group is sent to the mobile device; a target sound wave command signal is acquired from the mobile device, and the in-vehicle application is controlled to execute the target operation corresponding to the target sound wave command signal. The in-vehicle interactive communication method, device, system, electronic device, and medium disclosed in this invention can achieve in-vehicle interconnection with low hardware dependency and can ensure the number of in-vehicle interconnection devices.

Description

Technical Field

[0001] This invention relates to the field of vehicle driving technology, and in particular to an in-vehicle interactive communication method, device, system, electronic device, and medium. Background Technology

[0002] With the rapid development of automotive technology, especially the development of new energy vehicle technology, cars are becoming more intelligent and can provide more services, such as autonomous driving and automatic music playback, resulting in a better user experience.

[0003] In existing technologies, automotive infotainment systems can communicate with mobile devices such as smartphones and tablets through various communication methods. These methods include wired direct connection (USB), wireless direct connection (including Bluetooth and Wi-Fi), or cloud interconnection via mobile networks. Wired methods are highly dependent on both hardware and software; wireless connections, which typically use direct radio signals, usually require a network configuration and authentication process, which involves many steps. The advantage of this process is higher bandwidth and the ability to transmit more data, but it is also dependent on hardware and software. However, Bluetooth can be limited in terms of the number of devices that can be connected. Cloud interconnection usually involves latency and is highly dependent on the external network environment. Therefore, there is an urgent need for a method to achieve in-vehicle connectivity with low hardware dependency. Summary of the Invention

[0004] This invention provides an in-vehicle interactive communication method, device, system, electronic device, and medium that enables in-vehicle interconnection with low hardware dependency and ensures the number of in-vehicle interconnection devices.

[0005] The first aspect of this invention provides an in-vehicle interactive communication method applied to a vehicle infotainment system, the method comprising:

[0006] After the in-vehicle application is launched, a launch sound wave signal is obtained based on the launch operation used to launch the target application on the mobile device, and the launch sound wave signal is sent to the mobile device.

[0007] Obtain the acoustic confirmation signal returned by the mobile terminal, wherein the acoustic confirmation signal is generated by the mobile terminal based on the activation acoustic signal;

[0008] In response to the acoustic confirmation signal, the system acquires the acoustic command signal group corresponding to the operation command code of the vehicle application and sends the acoustic command signal group to the mobile terminal.

[0009] The target acoustic wave command signal returned by the mobile terminal is obtained, and the vehicle system application is controlled to perform the target operation corresponding to the target acoustic wave command signal. The target acoustic wave command signal is an acoustic wave command signal obtained by the mobile terminal from the acoustic wave command signal group based on the operation of the vehicle system application.

[0010] Optionally, obtaining the startup acoustic signal based on the startup operation for launching the target application on the mobile device includes:

[0011] Obtain the startup operation used to launch the target application;

[0012] In response to the start operation, the start sound wave signal is generated by the sound device in the vehicle system.

[0013] Optionally, the step of responding to the acoustic confirmation signal and obtaining the acoustic command signal group corresponding to the operation command code of the vehicle-mounted application includes:

[0014] In response to the acoustic confirmation signal, the system controls the establishment of a connection between the vehicle-mounted unit and the mobile terminal, and converts the operation command encoding into an acoustic signal to obtain the acoustic command signal group.

[0015] A second aspect of this invention also provides an in-vehicle interactive communication method, applied to a mobile terminal, the method comprising:

[0016] The system acquires a startup sound wave signal sent by the vehicle infotainment system, wherein the startup sound wave signal is obtained after the vehicle infotainment application in the vehicle infotainment system is started, based on the startup operation used to start the target application on the mobile terminal.

[0017] In response to the activation sound wave signal, the target application is activated, a sound wave confirmation signal is generated, and the sound wave confirmation signal is sent to the vehicle system;

[0018] The sound wave command signal group sent by the vehicle system is obtained, wherein the sound wave command signal group is obtained by the vehicle system according to the operation command encoding of the vehicle system application;

[0019] Based on the vehicle application operation for the vehicle application, a target acoustic command signal corresponding to the vehicle application operation is obtained from the acoustic command signal group, and the target acoustic command signal is sent to the vehicle system.

[0020] Optionally, after acquiring the acoustic command signal group sent by the vehicle-mounted system, the method further includes:

[0021] The control interface of the vehicle system application is generated based on the sound wave command signal group.

[0022] Optionally, obtaining the target acoustic command signal corresponding to the vehicle application operation from the acoustic command signal group includes:

[0023] The user's interface operations on the control interface are acquired, and the interface operations are used as the vehicle system application operations.

[0024] The target acoustic command signal is obtained from the acoustic command signal group.

[0025] A third aspect of the present invention also provides an in-vehicle interactive communication device, the device comprising:

[0026] The sound wave acquisition and transmission unit is used to acquire a startup sound wave signal and send the startup sound wave signal to the mobile terminal after the vehicle application in the vehicle is started, based on the startup operation of the target application used to start the mobile terminal.

[0027] A sound wave confirmation signal acquisition unit is used to acquire the sound wave confirmation signal returned by the mobile terminal, wherein the sound wave confirmation signal is generated by the mobile terminal based on the activation sound wave signal;

[0028] The acoustic command information acquisition and transmission unit is used to respond to the acoustic confirmation signal, acquire the acoustic command signal group corresponding to the operation command code of the vehicle application, and send the acoustic command signal group to the mobile terminal.

[0029] The control unit is configured to acquire the target acoustic wave command signal returned by the mobile terminal and control the vehicle application to execute the target operation corresponding to the target acoustic wave command signal, wherein the target acoustic wave command signal is an acoustic wave command signal acquired by the mobile terminal from the acoustic wave command signal group based on the operation of the vehicle application.

[0030] A fourth aspect of the present invention also provides an in-vehicle interactive communication device, the device comprising:

[0031] A startup sound wave receiving unit is used to acquire a startup sound wave signal sent by the vehicle system, wherein the startup sound wave signal is obtained after the vehicle system application is started, based on the startup operation for starting the target application on the mobile terminal.

[0032] An acoustic confirmation signal generation unit is used to respond to the start acoustic signal, start the target application, generate an acoustic confirmation signal, and send the acoustic confirmation signal to the vehicle system.

[0033] A sound wave command signal receiving unit is used to acquire a group of sound wave command signals sent by the vehicle system, wherein the group of sound wave command signals is obtained by the vehicle system according to the operation command encoding of the vehicle system application;

[0034] An operation instruction generation unit is configured to obtain a target acoustic wave instruction signal corresponding to the vehicle application operation from the acoustic wave instruction signal group based on the vehicle application operation for the vehicle application, and send the target acoustic wave instruction signal to the vehicle system.

[0035] A fifth aspect of the present invention also provides an in-vehicle interactive communication system, the system comprising:

[0036] The vehicle infotainment system is used to acquire a startup sound wave signal based on the startup operation for launching the target application on the mobile terminal after the vehicle infotainment application is launched, and to send the startup sound wave signal to the mobile terminal.

[0037] The mobile device is used to acquire the start sound wave signal sent by the vehicle system, respond to the start sound wave signal, launch the target application, generate a sound wave confirmation signal, and send the sound wave confirmation signal to the vehicle system.

[0038] The vehicle system is configured to acquire the acoustic confirmation signal returned by the mobile terminal, respond to the acoustic confirmation signal, acquire the acoustic command signal group corresponding to the operation command code of the vehicle system application, and send the acoustic command signal group to the mobile terminal.

[0039] The mobile terminal is used to acquire the sound wave command signal group sent by the vehicle system, acquire the target sound wave command signal corresponding to the vehicle system application operation according to the vehicle system application operation, and send the target sound wave command signal to the vehicle system.

[0040] The vehicle infotainment system is used to acquire the target acoustic wave command signal returned by the mobile terminal, and control the vehicle infotainment system application to execute the target operation corresponding to the target acoustic wave command signal, wherein the target acoustic wave command signal is an acoustic wave command signal acquired by the mobile terminal from the acoustic wave command signal group based on the operation of the vehicle infotainment system application.

[0041] A sixth aspect of the present invention provides an electronic device including a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs containing operation instructions for performing an in-vehicle interactive communication method as provided in the first aspect.

[0042] A seventh aspect of the present invention provides a computer program product, characterized in that the computer program product includes computer instructions stored in a computer-readable storage medium and adapted to be read and executed by a processor, so as to cause a computer device having the processor to perform the steps corresponding to the in-vehicle interactive communication method provided in the first aspect.

[0043] The above-described one or more technical solutions in the embodiments of this application have at least the following technical effects:

[0044] Based on the above technical solution, after the in-vehicle application is launched, a launch sound wave signal is obtained according to the launch operation used to launch the target application on the mobile terminal, and the launch sound wave signal is sent to the mobile terminal; a sound wave confirmation signal returned by the mobile terminal is obtained, wherein the sound wave confirmation signal is generated by the mobile terminal based on the launch sound wave signal; in response to the sound wave confirmation signal, a sound wave command signal group corresponding to the operation command code of the in-vehicle application is obtained, and the sound wave command signal group is sent to the mobile terminal; a target sound wave command signal returned by the mobile terminal is obtained, and the in-vehicle application is controlled to execute the target operation corresponding to the target sound wave command signal, wherein... The target acoustic wave command signal is the acoustic wave command signal obtained by the mobile terminal from the acoustic wave command signal group based on the operation of the vehicle system application. Therefore, the vehicle system application can be controlled to execute the target acoustic wave command signal by the target acoustic wave signal returned by the mobile terminal, thereby realizing the transmission of data through sound waves. When transmitting data through sound waves, sound waves can be transmitted through the mobile terminal and the sound device carried by the vehicle system itself, thereby realizing in-vehicle interconnection with low hardware dependency. Moreover, for multiple mobile terminals, each mobile terminal can be connected to the vehicle system in the above way, thereby ensuring the number of connected devices in the vehicle and improving the user experience when entertaining, such as in multiplayer online games. Attached Figure Description

[0045] Figure 1 A system architecture diagram of an in-vehicle interactive communication system provided in this application embodiment;

[0046] Figure 2 A data flow diagram of an in-vehicle interactive communication system provided in an embodiment of this application;

[0047] Figure 3 This is a schematic diagram of the structure of the control interface provided in the embodiments of this application;

[0048] Figure 4 A circuit diagram of the hardware for triggering acoustic wave signals in a mobile terminal provided in an embodiment of this application;

[0049] Figure 5 A flowchart of the first method of an in-vehicle interactive communication method provided in this application embodiment;

[0050] Figure 6 A second method flowchart of an in-vehicle interactive communication method provided in an embodiment of this application;

[0051] Figure 7 A first block diagram of an in-vehicle interactive communication device provided in an embodiment of this application;

[0052] Figure 8A second block diagram of an in-vehicle interactive communication device provided in this application embodiment.

[0053] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0054] The main implementation principles, specific implementation methods, and corresponding beneficial effects of the technical solutions of the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0055] Example

[0056] Please refer to Figure 1 This application provides an in-vehicle interactive communication system, the system comprising:

[0057] The vehicle system 10 is used to obtain a startup sound wave signal according to the startup operation of the target application used to start the mobile terminal 20 after the vehicle system application in the vehicle system 10 is started, and send the startup sound wave signal to the mobile terminal 20.

[0058] Mobile terminal 20 is used to obtain the start sound wave signal sent by vehicle system 10, respond to the start sound wave signal, start the target application, generate a sound wave confirmation signal, and send the sound wave confirmation signal to vehicle system 10.

[0059] The vehicle system 10 is used to obtain the sound wave confirmation signal returned by the mobile terminal 20, respond to the sound wave confirmation signal, obtain the sound wave command signal group corresponding to the operation command code of the vehicle system application, and send the sound wave command signal group to the mobile terminal 20.

[0060] Mobile terminal 20 is used to acquire the sound wave command signal group sent by vehicle system 10, and according to the vehicle system application operation for the vehicle system application, acquire the target sound wave command signal corresponding to the vehicle system application operation from the sound wave command signal group, and send the target sound wave command signal to vehicle system 10.

[0061] The vehicle system 10 is used to acquire the target acoustic wave command signal returned by the mobile terminal 20 and control the vehicle system application to execute the target operation corresponding to the target acoustic wave command signal. The target acoustic wave command signal is an acoustic wave command signal acquired by the mobile terminal 20 from the acoustic wave command signal group based on the operation of the vehicle system application.

[0062] In the embodiments of this specification, the mobile terminal may be, for example, a smartphone, a smartwatch, a tablet computer, or a laptop computer; "vehicle infotainment system" refers to an in-vehicle infotainment product installed in a car, which may be installed in the center console of the car; furthermore, the car corresponding to the vehicle infotainment system may be an electric vehicle or a gasoline-powered vehicle.

[0063] When launching a vehicle infotainment application, it can be done by operating the car's central control screen. The application can be a standalone application or a mini-program. The application icon can be displayed on the central control screen, and the application will be launched when the user clicks or double-clicks the icon.

[0064] Furthermore, after the in-vehicle application is launched, the system can first obtain the launch operation for launching the target application; then, in response to the launch operation, it can generate a launch sound wave signal and output the launch sound wave signal through the car's in-vehicle sound device.

[0065] Specifically, after the in-vehicle application is launched, it can display a target icon. If the target icon is clicked, double-clicked, or dragged, a launch operation is detected, and a launch sound wave signal is generated to launch the target application. Alternatively, after the in-vehicle application launches, a shortcut key or gesture can be pre-set as the launch operation. For example, if a circle gesture is set, a launch operation is detected upon receiving a circle gesture, and a launch sound wave signal is generated. Another option is to pre-set a QR code, using opening the QR code as the launch operation. If the user opens the QR code, this is treated as the launch operation, and a launch sound wave signal is generated. After generating the launch sound wave signal, it is output through the in-vehicle audio device and sent to the mobile device 20.

[0066] In the embodiments described in this specification, the in-vehicle sound device may be a speaker or microphone inside the car.

[0067] For example, taking user A as an example, when the vehicle system 10 detects that user A clicks or double-clicks the vehicle system application icon, it launches the vehicle system application. After the vehicle system application is launched, when it detects that user A clicks or double-clicks to open the QR code, it generates a startup sound wave signal and calls the car's in-car speakers to output the startup sound wave signal.

[0068] The mobile device 20 can receive the start-up sound wave signal through a target sound device such as a microphone. After receiving the start-up sound wave signal, it responds to the start-up sound wave signal, starts the target application, generates a sound wave confirmation signal, and outputs the sound wave confirmation signal through the target sound device, so that the in-vehicle sound device can receive the sound wave confirmation signal.

[0069] Specifically, when the mobile device 20 responds to the start sound wave signal and starts the target application, it can start the target application automatically, or it can start the target application based on the user's click or double-click operation. This manual does not impose any specific restrictions.

[0070] For example, taking user A and the target application B as an example, when the microphone of mobile terminal 20 receives the start sound wave signal output by the car speaker, in response to the start sound wave signal, mobile terminal 20 automatically starts application B. After detecting that application B has started, it generates a sound wave confirmation signal and outputs the sound wave confirmation signal through the microphone of mobile terminal 20, so that the car's in-car microphone can collect the sound wave confirmation signal.

[0071] After receiving the acoustic confirmation signal returned by the mobile terminal 20, the vehicle-mounted unit 10 responds to the acoustic confirmation signal, controls the vehicle-mounted unit 10 to establish a connection with the mobile terminal 20, and converts the operation command encoding into an acoustic signal to obtain an acoustic command signal group.

[0072] Furthermore, when the vehicle system 10 converts the operation command code into a sound wave signal to obtain a sound wave command signal group, it can first obtain the operation command code of the vehicle system application, then convert the operation command code into a sound wave command signal group, and then output the sound wave command signal group through the in-vehicle sound device, so that the target sound device of the mobile terminal 20, such as a microphone, receives the sound wave command signal group, thereby enabling the mobile terminal 20 to obtain the sound wave command signal group.

[0073] In one embodiment, after acquiring the sound wave command signal group, when acquiring vehicle application operations for the vehicle system application, the mobile terminal 20 can pre-set a shortcut key for each sound wave command signal in each sound wave command signal group. For example, the A key can be used to move left, the D key can be used to move right, the C key can be used to move up, and the D key can be used to move down, etc. In this way, vehicle application operations can be acquired through the keyboard displayed on the screen of the mobile terminal 20. Of course, a gesture can also be set for each sound wave command signal in each sound wave command signal group. This specification does not impose specific limitations.

[0074] In another embodiment, after acquiring the acoustic wave command signal group, the mobile terminal 20 can generate the control interface of the vehicle application based on the acoustic wave command signal group, display the control interface on the display screen of the mobile terminal 20, acquire the user's interface operation on the control interface, use the interface operation as the vehicle application operation, and acquire the command corresponding to the vehicle application operation from the acoustic wave command signal group as the target acoustic wave command signal.

[0075] Specifically, after generating the control interface, the vehicle control buttons of the vehicle system application can be displayed on the control interface. The user's operation on a certain button in the vehicle control buttons is obtained as the interface operation. Using the interface operation as the search condition, the operation command corresponding to the interface operation is obtained from the sound wave command signal group as the target sound wave command signal. For example, if the interface operation is clicking A, and clicking A is a leftward movement operation, then the leftward movement operation corresponding to the leftward movement operation is obtained from the sound wave command signal group. Then, the leftward sound wave command signal is output through the target sound device, so that the vehicle system 10 obtains the leftward sound wave command signal through the in-vehicle sound device.

[0076] For example, taking user A and the target application B as an example, after the microphone of mobile terminal 20 receives the start sound wave signal output from the in-car speaker and starts application B, the microphone of mobile terminal 20 outputs a sound wave confirmation signal, which is then collected by the in-car microphone. This allows the vehicle system 10 to obtain the sound wave confirmation signal and control the vehicle system 10 to establish a connection with mobile terminal 20. At this time, the vehicle system 10 will convert the operation command code of the vehicle system application into a sound wave command signal group and output the sound wave command signal group to mobile terminal 20 through the in-car speaker.

[0077] Furthermore, after receiving the sound wave command signal group, the mobile terminal 20 generates the control interface of the vehicle system application and displays the control interface on the screen of the mobile terminal 20. Then, it obtains the user's interface operation on the control interface. If the interface operation is that the user clicks the button C on the control interface, and the operation of clicking the button C is a right movement operation, then it obtains the right movement sound wave command signal corresponding to the right movement operation from the sound wave command signal group, and then outputs the right movement sound wave command signal through the target sound device, so that the vehicle system 10 obtains the right movement sound wave command signal through the in-vehicle sound device. The vehicle system 10 controls the vehicle system application to perform the right movement operation according to the right movement sound wave command signal.

[0078] Thus, the vehicle infotainment system 10 establishes a connection with the mobile terminal 20 by sending a start sound wave signal to the mobile terminal 20, and the mobile terminal 20 sends a sound wave confirmation signal after launching the target application. After the connection is established, the vehicle infotainment system 10 sends a set of sound wave command signals corresponding to the operation command code to the mobile terminal 20. The mobile terminal 20 obtains the target sound wave command signal corresponding to the vehicle application operation from the set of sound wave command signals and sends it to the vehicle infotainment system 10, so that the vehicle infotainment system 10 controls the vehicle application to perform the target operation corresponding to the target sound wave command signal. This realizes the control of the vehicle application in the vehicle infotainment system 10 by the mobile terminal 20 through sound waves. When transmitting data through sound waves, sound waves can be transmitted through the mobile terminal and the sound device carried by the vehicle infotainment system itself, thereby realizing in-vehicle interconnection with low hardware dependency.

[0079] Furthermore, when using multiple mobile devices 20 to play online games, the above operations are performed on each mobile device 20, thereby enabling each mobile device 20 to be connected to the vehicle system 10, thus ensuring the number of connected devices in the vehicle and providing a better user experience when users are entertained, such as in multiplayer online games.

[0080] In practical applications, see Figure 2 This application provides a data flow diagram for an in-vehicle interactive communication system. The system may include a vehicle infotainment system 10 and a mobile terminal 20. First, the vehicle infotainment system 10 executes step S1, obtaining an operation to open a vehicle application. After receiving this operation, the vehicle infotainment system 10 runs the application (or mini-program). After opening the vehicle application, the vehicle infotainment system 10 executes step S2, obtaining a startup operation and outputting a startup sound wave signal. The startup operation instructs the user to open a specified mobile app (or scan a QR code to open a mobile mini-program) and invokes the in-vehicle speakers to output a startup sound wave signal.

[0081] Next, the mobile terminal 20 executes step S3: after opening the mobile APP (or mini program), it obtains the start sound wave signal through the microphone, and outputs a confirmation sound wave signal after success; the vehicle system 10 executes step S4: after receiving the confirmation sound wave signal through the vehicle microphone, it confirms and establishes a connection; after establishing a connection, the vehicle system 10 executes step S5: the operable instructions of the vehicle system application are encoded and converted into a sound wave instruction signal group, which is then transmitted to the mobile terminal 20 via sound waves.

[0082] Next, the mobile terminal 20 executes step S6, receives the sound wave command signal group transmitted by sound waves, and generates a control interface; after generating the control interface, the mobile terminal 20 executes step S7, obtains the interface operation for the control interface, generates and outputs the target sound wave command signal; finally, the vehicle system 10 executes step S8, receives the target sound wave command signal, converts it into vehicle system application commands, and operates the vehicle system application interface through the vehicle system application commands.

[0083] In one embodiment, such as Figure 3 As shown, the control interface displays buttons A, B, C, and D, and a slider 30. The slider 30 is used to control the direction of the vehicle system application, while buttons A, B, C, and D each correspond to a game skill. For example, button A could be a dash in a certain direction. If it is detected that the user controls the slider 30 to slide to the right and clicks button A, the operation of sliding to the right and clicking button A is taken as the vehicle system application operation. The instruction corresponding to the vehicle system application operation is obtained from the sound wave instruction signal group as the target sound wave instruction signal, and then the target sound wave instruction signal is sent to the vehicle system 10, so that the vehicle system 10 controls the object in the vehicle system application to dash to the right according to the target sound wave instruction signal.

[0084] In one embodiment, when the mobile terminal 20 outputs the target sound wave command and the confirmation sound wave signal, it can be implemented by hardware that triggers the sound wave signal. For example, the sound wave operation signal can be preset, and a simple hardware device can be used to provide the sound wave signal generated by the battery. Due to its simple structure, the cost can be effectively reduced.

[0085] See Figure 4 The hardware for triggering the sound wave signal in the mobile terminal 20 includes a power supply 40, a music chip IC 41, a trigger button 42, and a speaker 43. The power supply 40 can be a battery compartment or a lithium battery, etc. The music chip IC 41 has preset sound wave frequency signals, each corresponding to a trigger button 42. The trigger button 42 can be powered on by clicking, allowing the music chip IC 41 to recognize which trigger button the user clicked. The speaker 43 outputs a specified frequency signal. The trigger button 42 includes trigger button A, trigger button B, trigger button C, and trigger button D.

[0086] When the user presses trigger button B in trigger button 42, the music chip IC 41 recognizes that the user has pressed trigger button B because trigger button B is connected to the power supply. It then obtains the specified frequency signal B1 corresponding to trigger button B from the preset sound wave frequency signal and outputs B1 through the speaker. In this way, the target sound wave command and confirmation sound wave signal can be output through the components of the mobile terminal 20 itself, thus ensuring in-vehicle connectivity with low hardware dependency.

[0087] The above-described one or more technical solutions in the embodiments of this application have at least the following technical effects:

[0088] Based on the above technical solution, after the in-vehicle application is launched, a launch sound wave signal is obtained according to the launch operation used to launch the target application on the mobile terminal, and the launch sound wave signal is sent to the mobile terminal; a sound wave confirmation signal returned by the mobile terminal is obtained, wherein the sound wave confirmation signal is generated by the mobile terminal based on the launch sound wave signal; in response to the sound wave confirmation signal, a sound wave command signal group corresponding to the operation command code of the in-vehicle application is obtained, and the sound wave command signal group is sent to the mobile terminal; a target sound wave command signal returned by the mobile terminal is obtained, and the in-vehicle application is controlled to execute the target operation corresponding to the target sound wave command signal, wherein... The target acoustic wave command signal is the acoustic wave command signal obtained by the mobile terminal from the acoustic wave command signal group based on the operation of the vehicle system application. Therefore, the vehicle system application can be controlled to execute the target acoustic wave command signal by the target acoustic wave signal returned by the mobile terminal, thereby realizing the transmission of data through sound waves. When transmitting data through sound waves, sound waves can be transmitted through the mobile terminal and the sound device carried by the vehicle system itself, thereby realizing in-vehicle interconnection with low hardware dependency. Moreover, for multiple mobile terminals, each mobile terminal can be connected to the vehicle system in the above way, thereby ensuring the number of connected devices in the vehicle and improving the user experience when entertaining, such as in multiplayer online games.

[0089] In addition to the in-vehicle interactive communication system provided in the above embodiments, this application also provides an in-vehicle interactive communication method, applied to an in-vehicle infotainment system. Please refer to [link / reference]. Figure 5 The method includes:

[0090] S501. After the vehicle application in the vehicle system is started, a startup sound wave signal is obtained according to the startup operation used to start the target application on the mobile terminal, and the startup sound wave signal is sent to the mobile terminal.

[0091] S502. Obtain the acoustic confirmation signal returned by the mobile terminal, wherein the acoustic confirmation signal is generated by the mobile terminal based on the activation acoustic signal;

[0092] S503. In response to the acoustic confirmation signal, obtain the acoustic command signal group corresponding to the operation command code of the vehicle application, and send the acoustic command signal group to the mobile terminal.

[0093] S504. Obtain the target acoustic wave command signal returned by the mobile terminal, and control the vehicle application to execute the target operation corresponding to the target acoustic wave command signal, wherein the target acoustic wave command signal is an acoustic wave command signal obtained by the mobile terminal from the acoustic wave command signal group based on the operation of the vehicle application.

[0094] In one optional implementation, obtaining the startup acoustic signal based on the startup operation for launching the target application on the mobile device includes:

[0095] Obtain the startup operation used to launch the target application;

[0096] In response to the start operation, the start sound wave signal is generated by the sound device in the vehicle system.

[0097] In one optional implementation, the step of responding to the acoustic confirmation signal and acquiring the acoustic command signal group corresponding to the operation command code of the vehicle-mounted application includes:

[0098] In response to the acoustic confirmation signal, the system controls the establishment of a connection between the vehicle-mounted unit and the mobile terminal, and converts the operation command encoding into an acoustic signal to obtain the acoustic command signal group.

[0099] In addition to the in-vehicle interactive communication system provided in the above embodiments, this application also provides an in-vehicle interactive communication method for use on a mobile device. Please refer to [link / reference]. Figure 6 The method includes:

[0100] S601. Obtain the start-up sound wave signal sent by the vehicle system, wherein the start-up sound wave signal is obtained after the vehicle system application in the vehicle system is started, based on the start-up operation for starting the target application of the mobile terminal.

[0101] S602. In response to the start sound wave signal, start the target application, generate a sound wave confirmation signal, and send the sound wave confirmation signal to the vehicle system;

[0102] S603. Obtain the acoustic command signal group sent by the vehicle system, wherein the acoustic command signal group is obtained by the vehicle system according to the operation command encoding of the vehicle system application;

[0103] S604. Based on the vehicle application operation for the vehicle application, obtain the target sound wave command signal corresponding to the vehicle application operation from the sound wave command signal group, and send the target sound wave command signal to the vehicle.

[0104] In one optional implementation, after acquiring the acoustic command signal group sent by the vehicle-mounted system, the method further includes:

[0105] The control interface of the vehicle system application is generated based on the sound wave command signal group.

[0106] In one optional implementation, obtaining the target acoustic command signal corresponding to the vehicle-mounted application operation from the acoustic command signal group includes:

[0107] The user's interface operations on the control interface are acquired, and the interface operations are used as the vehicle system application operations.

[0108] The target acoustic command signal is obtained from the acoustic command signal group.

[0109] In conjunction with the in-vehicle interactive communication system provided in the above embodiments, this application also provides an in-vehicle interactive communication device. Please refer to... Figure 7 The device includes:

[0110] The startup sound wave acquisition and transmission unit 701 is used to acquire a startup sound wave signal based on the startup operation of the target application for launching the mobile terminal after the vehicle application in the vehicle is launched, and send the startup sound wave signal to the mobile terminal.

[0111] The acoustic confirmation signal acquisition unit 702 is used to acquire the acoustic confirmation signal returned by the mobile terminal, wherein the acoustic confirmation signal is generated by the mobile terminal based on the activation acoustic signal;

[0112] The acoustic command information acquisition and transmission unit 703 is used to respond to the acoustic confirmation signal, acquire the acoustic command signal group corresponding to the operation command code of the vehicle application, and send the acoustic command signal group to the mobile terminal.

[0113] The control unit 704 is used to acquire the target acoustic wave command signal returned by the mobile terminal and control the vehicle application to perform the target operation corresponding to the target acoustic wave command signal, wherein the target acoustic wave command signal is an acoustic wave command signal acquired by the mobile terminal from the acoustic wave command signal group based on the operation of the vehicle application.

[0114] In one optional implementation, a sound wave acquisition and transmission unit 701 is activated to acquire a startup operation for launching the target application; in response to the startup operation, the startup sound wave signal is generated by the sound device in the vehicle system.

[0115] In one optional implementation, the acoustic command information acquisition and transmission unit 703 is used to respond to the acoustic confirmation signal, control the establishment of a connection between the vehicle-mounted system and the mobile terminal, and convert the operation command encoding into an acoustic signal to obtain the acoustic command signal group.

[0116] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0117] In conjunction with the in-vehicle interactive communication system provided in the above embodiments, this application also provides an in-vehicle interactive communication device. Please refer to... Figure 8The device includes:

[0118] A startup sound wave receiving unit 801 is used to acquire a startup sound wave signal sent by the vehicle system, wherein the startup sound wave signal is obtained after the vehicle system application is started, based on the startup operation for starting the target application on the mobile terminal.

[0119] The acoustic confirmation signal generation unit 802 is used to respond to the start acoustic signal, start the target application, generate an acoustic confirmation signal, and send the acoustic confirmation signal to the vehicle system.

[0120] The acoustic command signal receiving unit 803 is used to acquire the acoustic command signal group sent by the vehicle system, wherein the acoustic command signal group is obtained by the vehicle system according to the operation command encoding of the vehicle system application;

[0121] The operation instruction generation unit 804 is used to obtain a target acoustic wave instruction signal corresponding to the vehicle application operation from the acoustic wave instruction signal group according to the vehicle application operation for the vehicle application, and send the target acoustic wave instruction signal to the vehicle.

[0122] In one alternative implementation, it further includes:

[0123] The control interface generation unit is used to generate the control interface of the vehicle system application based on the sound wave command signal group sent by the vehicle system after acquiring the sound wave command signal group.

[0124] In one optional implementation, the operation instruction generation unit 804 is used to acquire the user's interface operation on the control interface, and use the interface operation as the vehicle system application operation; and to acquire the target sound wave instruction signal from the sound wave instruction signal group.

[0125] Figure 9 This is a block diagram illustrating an electronic device 800 for an in-vehicle interactive communication method according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0126] Reference Figure 9 The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / display (I / O) interface 812, a sensor component 814, and a communication component 816.

[0127] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0128] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0129] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.

[0130] Multimedia component 808 includes a screen that provides a display interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0131] Audio component 810 is configured to display and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for displaying audio signals.

[0132] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0133] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0134] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0135] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0136] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0137] Furthermore, it should be noted that this application also provides a computer program product or computer program, which may include computer instructions, which may be stored in a computer-readable storage medium. The processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor may execute the computer instructions, causing the computer device to perform the aforementioned actions. Figure 1 The description of the in-vehicle interactive communication method in the corresponding embodiments is already provided and will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the computer program products or computer program embodiments related to this application, please refer to the description of the method embodiments of this application.

[0138] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the following claims.

[0139] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

[0140] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for in-vehicle interactive communication, applied to a vehicle machine, characterized in that, The method comprises: After the car application in the car is started, a starting sound wave signal is obtained according to a starting operation for starting a target application of a mobile terminal, and the starting sound wave signal is sent to the mobile terminal; An acoustic confirmation signal returned by the mobile terminal is obtained, wherein the acoustic confirmation signal is generated by the mobile terminal according to the starting sound wave signal; In response to the acoustic confirmation signal, a group of acoustic instruction signals corresponding to operation instruction codes of the car application is obtained, and the group of acoustic instruction signals is sent to the mobile terminal, so that the mobile terminal generates a control interface of the car application according to the group of acoustic instruction signals, and displays the control interface on a display screen of the mobile terminal, the control interface displays car control buttons of the car application, and an interface operation of a user on the control interface is obtained as a car application operation for the car application; A target acoustic instruction signal returned by the mobile terminal is obtained, and the car application is controlled to perform a target operation corresponding to the target acoustic instruction signal, wherein the target acoustic instruction signal is an acoustic instruction signal obtained by the mobile terminal from the group of acoustic instruction signals based on the car application operation. In response to the acoustic confirmation signal, a group of acoustic instruction signals corresponding to operation instruction codes of the car application is obtained, including: in response to the acoustic confirmation signal, the car and the mobile terminal are controlled to establish a connection, the operation instruction codes of the car application are obtained, and the operation instruction codes are converted into acoustic signals to obtain the group of acoustic instruction signals.

2. The method of claim 1, wherein, The starting sound wave signal is obtained according to the starting operation for starting the target application of the mobile terminal, including: The starting operation for starting the target application is obtained; In response to the starting operation, the starting sound wave signal is generated by a sound device in the car. 3.A method for in-vehicle interactive communication, applied to a mobile terminal, the method comprising: The method comprises: A starting sound wave signal sent by a car is obtained, wherein the starting sound wave signal is obtained according to a starting operation for starting a target application of a mobile terminal after a car application in the car is started; In response to the starting sound wave signal, the target application is started, an acoustic confirmation signal is generated, and the acoustic confirmation signal is sent to the car; A group of acoustic instruction signals sent by the car is obtained, wherein the group of acoustic instruction signals is obtained by the car in response to the acoustic confirmation signal, obtaining operation instruction codes of the car application, and converting the operation instruction codes of the car application into acoustic signals; A target acoustic instruction signal corresponding to a car application operation for the car application is obtained from the group of acoustic instruction signals according to the car application operation, and the target acoustic instruction signal is sent to the car; Before obtaining a target sound wave instruction signal corresponding to the car application operation from the sound wave instruction signal group according to the car application operation of the car application, the method further comprises: generating a control interface of the car application according to the sound wave instruction signal group, displaying the control interface on a display screen of the mobile terminal, displaying a car control button of the car application on the control interface, obtaining an interface operation of a user on the control interface, and taking the interface operation as the car application operation.

4. An in-vehicle interactive communication device, characterized by comprising: The device comprises: A start sound wave acquisition and sending unit is configured to acquire a start sound wave signal according to a start operation for starting a target application of a mobile terminal after a car application in a car is started, and send the start sound wave signal to the mobile terminal; A sound wave confirmation signal acquisition unit is configured to acquire a sound wave confirmation signal returned by the mobile terminal, wherein the sound wave confirmation signal is generated by the mobile terminal according to the start sound wave signal; A sound wave instruction information acquisition and sending unit is configured to respond to the sound wave confirmation signal, acquire a sound wave instruction signal group corresponding to an operation instruction code of the car application, and send the sound wave instruction signal group to the mobile terminal, so that the mobile terminal generates a control interface of the car application according to the sound wave instruction signal group, displays the control interface on a display screen of the mobile terminal, displays a car control button of the car application on the control interface, and acquires an interface operation of a user on the control interface, taking the interface operation as a car application operation of the car application; A control unit is configured to acquire a target sound wave instruction signal returned by the mobile terminal, and control the car application to perform a target operation corresponding to the target sound wave instruction signal, wherein the target sound wave instruction signal is a sound wave instruction signal acquired by the mobile terminal from the sound wave instruction signal group based on the car application operation; The device comprises:

5. An in-vehicle interactive communication device, characterized by, A start sound wave receiving unit is configured to acquire a start sound wave signal sent by a car, wherein the start sound wave signal is obtained according to a start operation for starting a target application of a mobile terminal after a car application in the car is started; A sound wave confirmation signal generation unit is configured to respond to the start sound wave signal, start the target application, generate a sound wave confirmation signal, and send the sound wave confirmation signal to the car; A sound wave instruction signal receiving unit is configured to acquire a sound wave instruction signal group sent by the car, wherein the sound wave instruction signal group is obtained by the car in response to the sound wave confirmation signal, acquiring an operation instruction code of the car application, and converting the operation instruction code of the car application into a sound wave signal. ​ The operation instruction generation unit is configured to acquire a target sound wave instruction signal corresponding to the car application operation from the sound wave instruction signal group according to the car application operation of the car application, and send the target sound wave instruction signal to the car; The device further comprises: The operation interface generation unit is configured to generate an operation interface of the car application according to the sound wave instruction signal group after acquiring the sound wave instruction signal group sent by the car, and display the operation interface on a display screen of the mobile terminal, and the operation interface displays car control buttons of the car application. The operation instruction generation unit is further configured to acquire an interface operation of a user on the operation interface, and take the interface operation as the car application operation.

6. An in-vehicle interactive communication system characterized by comprising: The system comprises: The car is configured to acquire a start sound wave signal according to a start operation of a target application of a mobile terminal after starting a car application in the car, and send the start sound wave signal to the mobile terminal. The mobile terminal is configured to acquire the start sound wave signal sent by the car, start the target application in response to the start sound wave signal, generate a sound wave confirmation signal, and send the sound wave confirmation signal to the car. The car is configured to acquire the sound wave confirmation signal returned by the mobile terminal, respond to the sound wave confirmation signal, acquire a sound wave instruction signal group corresponding to an operation instruction code of the car application, and send the sound wave instruction signal group to the mobile terminal. The mobile terminal is configured to acquire the sound wave instruction signal group sent by the car, generate an operation interface of the car application according to the sound wave instruction signal group, display the operation interface on a display screen of the mobile terminal, and display car control buttons of the car application on the operation interface, acquire an interface operation of a user on the operation interface, take the interface operation as a car application operation of the car application, acquire a target sound wave instruction signal corresponding to the car application operation from the sound wave instruction signal group according to the car application operation of the car application, and send the target sound wave instruction signal to the car. The car is configured to acquire the target sound wave instruction signal returned by the mobile terminal, control the car application to perform a target operation corresponding to the target sound wave instruction signal, and the target sound wave instruction signal is a sound wave instruction signal acquired by the mobile terminal from the sound wave instruction signal group based on a car application operation. The operation instruction generation unit is further configured to acquire an interface operation of a user on the operation interface, and take the interface operation as the car application operation. The system comprises: The car is configured to acquire a start sound wave signal according to a start operation of a target application of a mobile terminal after starting a car application in the car, and send the start sound wave signal to the mobile terminal. The mobile terminal is configured to acquire the start sound wave signal sent by the car, start the target application in response to the start sound wave signal, generate a sound wave confirmation signal, and send the sound wave confirmation signal to the car. The car is configured to acquire the sound wave confirmation signal returned by the mobile terminal, respond to the sound wave confirmation signal, acquire a sound wave instruction signal group corresponding to an operation instruction code of the car application, and send the sound wave instruction signal group to the mobile terminal. The mobile terminal is configured to acquire the sound wave instruction signal group sent by the car, generate an operation interface of the car application according to the sound wave instruction signal group, display the operation interface on a display screen of the mobile terminal, and display car control buttons of the car application on the operation interface, acquire an interface operation of a user on the operation interface, take the interface operation as a car application operation of the car application, acquire a target sound wave instruction signal corresponding to the car application operation from the sound wave instruction signal group according to the car application operation of the car application, and send the target sound wave instruction signal to the car. The car is configured to acquire the target sound wave instruction signal returned by the mobile terminal, control the car application to perform a target operation corresponding to the target sound wave instruction signal, and the target sound wave instruction signal is a sound wave instruction signal acquired by the mobile terminal from the sound wave instruction signal group based on a car application operation. The operation instruction generation unit is further configured to acquire an interface operation of a user on the operation interface, and take the interface operation as the car application operation.

7. An electronic device, comprising: The computer program product comprises computer instructions stored in a computer readable storage medium and adapted to be read and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-3.

8. A computer program product, characterised in that, The computer program product comprises computer instructions stored in a computer readable storage medium and adapted to be read and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-3.

Images