Vehicle remote accompanying method, device and equipment and storage medium

Abstract

The invention discloses a vehicle remote accompanying method, device and equipment and a storage medium, and the method comprises the steps: responding to an accompanying instruction, and transmitting first data to a user side, the first data comprising in-vehicle and out-vehicle video data collected by a vehicle side or in-vehicle first audio data; second audio data or third audio data sent by the user side in response to the accompanying instruction are received, the second audio data or the third audio data are played, the second audio data are audio data collected by the user side, and the third audio data are audio data converted by the user side according to the obtained text information; wherein the accompanying instruction comprises at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input from the user end and received by the vehicle end. By integrating the two-way communication function of the vehicle end and the user end, the communication between the user in the vehicle and the remote user can be conveniently and quickly established, and the communication requirement and the accompanying requirement of the user in the vehicle during remote driving are met.

Description

Technical Field

[0001] The present invention relates to the field of intelligent driving technology, and in particular to a vehicle remote accompanying method, device, equipment and storage medium. Background Art

[0002] With the advancement of technology and the popularization of intelligent devices, modern transportation, especially private cars, has gradually become an indispensable part of people's daily lives. However, while enjoying the convenience and freedom brought by driving, users are also facing some new needs and challenges. For example, when a driver drives alone, especially when driving alone remotely, he often hopes to have a convenient and fast way to establish contact with relevant personnel so that the driver can seek help or share driving experience in an emergency, or relevant personnel can understand the driver's driving situation when the driver is driving alone, so as to better accompany or help the driver.

[0003] However, most of the technical solutions currently available on the market focus on improving vehicle safety performance, optimizing driving assistance systems, and implementing vehicle remote control. For example, some vehicles are equipped with remote monitoring functions, but these functions are usually limited to basic vehicle status checks, such as location tracking, fuel level display, etc., and cannot meet the above-mentioned specific needs of drivers when driving alone.

[0004] Therefore, how to meet the above-mentioned specific needs of the driver when driving alone in order to improve the intelligence level and safety of the vehicle is a technical problem that urgently needs to be solved. Summary of the invention

[0005] In view of the above problems, the present invention is proposed to provide a vehicle remote accompaniment method, device, equipment and storage medium that overcome the above problems or at least partially solve the above problems. The method integrates the two-way communication functions of the vehicle end and the user end, so as to conveniently and quickly establish a connection between the in-vehicle user and the remote user, meet the communication and companionship needs of the in-vehicle user during remote driving, and improve the intelligence level and safety of the vehicle.

[0006] In a first aspect, a vehicle remote accompanying method is provided, which is applied to a vehicle side, and the vehicle remote accompanying method comprises:

[0007] In response to the accompanying instruction, first data is sent to the user end, wherein the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle;

[0008] receiving second audio data or third audio data sent by the user terminal in response to the accompanying instruction, and playing the second audio data or the third audio data, wherein the second audio data is audio data collected by the user terminal, and the third audio data is audio data converted by the user terminal according to the acquired text information;

[0009] The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input from the user end and received at the vehicle end.

[0010] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction and a text accompanying instruction;

[0011] The second audio data is audio data collected by the user terminal in response to the voice accompaniment instruction, and the third audio data is audio data converted by the user terminal from the acquired text information in response to the text accompaniment instruction.

[0012] Optionally, in response to the accompanying instruction, sending the first data to the user terminal includes:

[0013] In response to the scene accompanying instruction, sending the in-vehicle and out-vehicle video data to a user terminal;

[0014] In response to the voice accompanying instruction and the text accompanying instruction, the first audio data is sent to the user end.

[0015] In a second aspect, a vehicle remote accompanying method is provided, which is applied to a user end, and the vehicle remote accompanying method includes:

[0016] In response to the accompanying instruction, the second audio data or the third audio data is sent to the vehicle end, wherein the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information;

[0017] receiving first data sent by the vehicle end in response to the accompanying instruction, playing the first data, or receiving first audio data sent by the vehicle end in response to the accompanying instruction, converting the first audio data into text for display, wherein the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle;

[0018] The accompanying instruction includes at least one of a first accompanying instruction input from the vehicle end and received by the user end, and a second accompanying instruction input at the user end.

[0019] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction; in response to the accompanying instruction, sending the second audio data or the third audio data to the vehicle end includes:

[0020] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0021] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0022] In a third aspect, a vehicle remote accompanying method is provided, which is applied to a vehicle end and a user end, and the vehicle remote accompanying method includes:

[0023] In response to the accompanying instruction, the vehicle end sends first data to the user end, where the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle;

[0024] The user end receives the first data sent by the vehicle end and plays the first data, or the user end receives the first audio data sent by the vehicle end and converts the first audio data into text for display;

[0025] In response to the accompanying instruction, the user end sends the second audio data or the third audio data to the vehicle end, wherein the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information;

[0026] The vehicle end receives the second audio data or the third audio data sent by the user end, and plays the second audio data or the third audio data;

[0027] The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input at the user end.

[0028] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction and a text accompanying instruction;

[0029] The second audio data is audio data collected by the user terminal in response to the voice accompaniment instruction, and the third audio data is audio data converted by the user terminal from the acquired text information in response to the text accompaniment instruction.

[0030] Optionally, in response to the accompanying instruction, the user end sends the second audio data or the third audio data to the vehicle end, including:

[0031] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0032] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0033] In a fourth aspect, a vehicle remote accompanying device is provided, characterized in that it is applied to a vehicle end and comprises:

[0034] A first controller, configured to send first data to a user terminal in response to the accompanying instruction, wherein the first data includes video data inside and outside the vehicle collected by the vehicle terminal, or first audio data inside the vehicle;

[0035] A first playing module is used to receive the second audio data or the third audio data sent by the user terminal in response to the accompanying instruction, and play the second audio data or the third audio data, wherein the second audio data is the audio data collected by the user terminal, and the third audio data is the audio data converted by the user terminal according to the acquired text information;

[0036] The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input from the user end and received at the vehicle end.

[0037] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction and a text accompanying instruction;

[0038] The second audio data is audio data collected by the user terminal in response to the voice accompaniment instruction, and the third audio data is audio data converted by the user terminal from the acquired text information in response to the text accompaniment instruction.

[0039] Optionally, the first controller is further used for:

[0040] In response to the scene accompanying instruction, sending the in-vehicle and out-vehicle video data to a user terminal;

[0041] In response to the voice accompanying instruction and the text accompanying instruction, the first audio data is sent to the user end.

[0042] In a fifth aspect, a vehicle remote companion device is provided, which is applied to a user end and includes:

[0043] A second controller is used to send second audio data or third audio data to the vehicle end in response to the accompanying instruction, wherein the second audio data is audio data collected by the user end, and the third audio data is audio data converted by the user end according to the acquired text information;

[0044] A second playing module is used to receive the first data sent by the vehicle end in response to the accompanying instruction, and play the first data, wherein the first data includes the video data inside and outside the vehicle collected by the vehicle end, or the first audio data inside the vehicle;

[0045] an audio conversion module, for receiving the first audio data sent by the vehicle end in response to the accompanying instruction, converting the first audio data into text for display; and for converting the text information obtained by the user end into the third audio data;

[0046] The accompanying instruction includes at least one of a first accompanying instruction input from the vehicle end and received by the user end, and a second accompanying instruction input at the user end.

[0047] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction; and the second controller is further used for:

[0048] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0049] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0050] In a sixth aspect, a vehicle remote companion device is provided, comprising a first controller and a first playback module applied to a vehicle end, and a second controller, a second playback module and an audio conversion module applied to a user end;

[0051] The first controller is used to send first data to the second playback module in response to the accompanying instruction, wherein the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle;

[0052] The first playing module is used to receive the second audio data or the third audio data, and play the second audio data or the third audio data;

[0053] The second controller is used to send the second audio data or the third audio data to the first playback module in response to the accompanying instruction, wherein the second audio data is the audio data collected by the user terminal, and the third audio data is the audio data converted by the user terminal according to the acquired text information;

[0054] The second playing module is used to receive the first data and play the first data;

[0055] The audio conversion module is used to receive the first audio data and convert the first audio data into text for display; and is also used to convert the text information obtained by the user end into the third audio data;

[0056] The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input at the user end.

[0057] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction and a text accompanying instruction;

[0058] The second audio data is audio data collected by the user terminal in response to the voice accompaniment instruction, and the third audio data is audio data converted by the user terminal from the acquired text information in response to the text accompaniment instruction.

[0059] Optionally, the first controller is further used for:

[0060] In response to the scene accompanying instruction, sending the in-vehicle and out-vehicle video data to a user terminal;

[0061] In response to the voice accompanying instruction and the text accompanying instruction, the first audio data is sent to the user end.

[0062] Optionally, the second controller is further used for:

[0063] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0064] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0065] In the seventh aspect, an electronic device is provided, comprising: a memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the vehicle remote accompaniment method as described in the first aspect, the second aspect or the third aspect by executing the computer instructions.

[0066] In an eighth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the vehicle remote companionship method as described in the first aspect, the second aspect or the third aspect.

[0067] The technical solution provided in the embodiments of the present invention has at least the following technical effects or advantages:

[0068] The embodiments of the present invention provide a vehicle remote companionship method, device, equipment and storage medium. Through real-time data transmission between the vehicle end and the user end, the first user in the vehicle can conveniently share the video inside and outside the vehicle or the audio inside the vehicle with the second user on the user end while driving, and receive audio feedback from the user end, thereby realizing remote companionship and communication, greatly enhancing the sense of security and companionship of the first user in the vehicle. In an emergency, the first user in the vehicle can quickly transmit the on-site situation to the second user on the user end (such as family, friends or emergency rescue center), so that relevant personnel can understand the situation in time and provide necessary help or guidance, effectively improving the response speed and efficiency of emergency situations. And this method is not limited to emergency response, but also allows the first user in the car to share driving experience with the second user on the user end, such as scenery and interesting things along the way. Through real-time transmission of audio or video, the driving experience of the users in the car is enriched, the fun and interactivity of driving are enhanced, and the loneliness and fatigue caused by long-distance driving can be effectively alleviated. Even if the first user is far away, he can use the vehicle as a medium to achieve emotional transmission and communication with the remote second user, as if riding in the same car, which increases the emotional connection and sense of companionship between family and friends, is conducive to improving user satisfaction and happiness, and enhances the closeness of interpersonal relationships. The present invention has achieved a new breakthrough in the intelligent application of vehicles by integrating the two-way communication function of the vehicle end and the user end. It is not only limited to traditional driving assistance and safety monitoring, but also expands the function of the vehicle as an information exchange platform, which is closer to the actual needs of users, provides personalized remote communication and companionship services, and shows a new direction for the development of vehicle intelligence.

[0069] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0071] Figure 1 is a flow chart of a vehicle remote accompanying method provided by an embodiment of the present invention;

[0072] Figure 2 is a flow chart of another vehicle remote accompanying method provided by an embodiment of the present invention;

[0073] Figure 3is a flow chart of another vehicle remote accompanying method provided by an embodiment of the present invention;

[0074] Figure 4 is a structural block diagram of a vehicle remote companion device provided by an embodiment of the present invention;

[0075] Figure 5 is a structural block diagram of a vehicle remote companion device provided by an embodiment of the present invention;

[0076] Figure 6 The present invention is a structural block diagram of a vehicle remote companion device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0077] In order to better understand the above-mentioned technical scheme, the above-mentioned technical scheme will be described in detail below in combination with the accompanying drawings and specific implementation methods of the specification. It should be understood that the embodiments of the present disclosure and the specific features in the embodiments are detailed descriptions of the technical scheme of the present application, rather than limitations on the technical scheme of the present application. In the absence of conflict, the embodiments of the present application and the technical features in the embodiments can be combined with each other.

[0078] In order to better understand the present invention, the following briefly describes the applicable scenarios of a vehicle remote accompanying method, device, equipment and storage medium provided by the present invention:

[0079] When a driver is currently driving a vehicle alone, the following scenarios may apply:

[0080] (1) The user (such as the driver's family, friends, etc.) is not in the vehicle but wants to observe the real-time driving conditions of the vehicle and the driver;

[0081] (2) The user is not in the car, the driver is driving alone, it is inconvenient to make a phone call, or the user is sleepy or lonely and wants someone to accompany him;

[0082] (3) The user wants to confirm the driver's condition, but the user is not in the car and it is inconvenient to speak;

[0083] (4) The driver cannot find the way and needs directions from the user, but the user is not in the car;

[0084] (5) The driver sees beautiful scenery or people while driving and wants to share the scene with users;

[0085] In the prior art, only a calling function is provided on the vehicle, so that the driver can have a remote call with the user, but the remote call cannot meet the above-mentioned scenario requirements, and currently there is no related technology that provides the above-mentioned function to meet the above-mentioned scenario requirements, and it is basically achieved through mobile phone video calls. And using mobile phone video calls will increase the driver's driving risk. Therefore, in order to meet the above-mentioned scenario requirements, the embodiments of the present invention provide a vehicle remote accompaniment method, device, equipment and storage medium, through real-time data transmission between the vehicle end and the user end, so that the connection between the driver and the remote user can be established conveniently and quickly, meeting the driver's communication needs and companionship needs when driving alone, and improving the vehicle's intelligence level and safety.

[0086] It should be noted that the above scenario requirements are only examples. The vehicle remote accompaniment method, device, equipment and storage medium provided in the embodiments of the present invention can actually meet more scenario requirements, which shall be subject to the specific implementation.

[0087] Figure 1 is a flow chart of a vehicle remote accompanying method provided by an embodiment of the present invention, such as Figure 1 As shown, the vehicle remote accompanying method is applied to the vehicle side, and the method includes:

[0088] Step S110: In response to the accompanying instruction, first data is sent to the user end, where the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle.

[0089] The accompanying instruction includes at least one of a first accompanying instruction inputted at the vehicle end and a second accompanying instruction inputted from the user end and received at the vehicle end. In other words, the method supports both the first user in the vehicle and the second user outside the vehicle to actively initiate accompanying instructions. At the same time, the method can flexibly adjust the communication mode and content according to the actual situation, which not only guarantees the autonomy of the first user, but also meets the personalized needs of the second user, and enhances the practicality and flexibility of the system.

[0090] In this embodiment, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction. The first user and the second user can input or select different accompanying modes on the vehicle side or the user side according to their own needs, thereby generating different accompanying instructions. For example, when the first user only wants to share the driving environment with the second user, the scene accompanying mode can be selected on the vehicle side to generate a scene accompanying instruction; when the first user wants to communicate with the second user, the voice accompanying mode can be selected on the vehicle side to generate a voice accompanying instruction; when the second user wants to obtain the first user's situation or the vehicle driving situation, the scene accompanying mode can be selected on the user side to generate a scene accompanying instruction; when the second user wants to communicate with the first user by voice, the voice accompanying mode can be selected on the user side to generate a voice accompanying instruction; when the second user is currently unable to speak and can only communicate with the first user through text, the text accompanying mode can be selected on the user side to generate a text accompanying instruction.

[0091] In specific implementation, a soft / hard key may be set on the vehicle side so that the first user can select different accompanying modes through the soft / hard key, thereby generating corresponding accompanying instructions and inputting the accompanying instructions on the vehicle side, or the accompanying instructions may be inputted on the vehicle side by voice input, which is not limited in this embodiment. At the same time, a corresponding remote APP may be set on the user side, such as the second user's mobile phone, so that the second user can select different accompanying modes through the remote APP by voice or soft / hard key, thereby generating corresponding accompanying instructions and inputting the accompanying instructions on the user side. In this embodiment, when the vehicle side generates the first accompanying instruction, the user side will also receive the first accompanying instruction, thereby executing the corresponding action according to the first accompanying instruction. When the user side generates the second accompanying instruction, the vehicle side will also receive the second accompanying instruction, thereby executing the corresponding action according to the second accompanying instruction.

[0092] It should be noted that, in this embodiment, the vehicle end and the user end execute the same type of accompanying instructions (that is, the vehicle end and the user end simultaneously respond to one of the scene accompanying instructions, voice accompanying instructions and text accompanying instructions). When the first user inputs the first accompanying instruction on the vehicle end, and the second user inputs the second accompanying instruction on the vehicle end, and the first accompanying instruction and the second accompanying instruction are different (for example, the first accompanying instruction is a voice accompanying instruction, and the second accompanying instruction is a text accompanying instruction), a reminder function can be set on the vehicle end and the user end to remind the first user on the vehicle end and the second user on the user end that the accompanying instructions input by both ends are different, and the type of accompanying instruction input by the other end is displayed to remind the first user or the second user to re-enter the accompanying instruction until the types of accompanying instructions input by both ends are consistent.

[0093] Optionally, step S110 includes:

[0094] In response to the scene accompanying instruction, the video data inside and outside the vehicle are sent to the user end;

[0095] In response to the voice accompanying instruction and the text accompanying instruction, the first audio data is sent to the user terminal.

[0096] Specifically, the in-vehicle and out-vehicle video data may include in-vehicle video data and out-vehicle video data. The in-vehicle video data may be acquired through at least one in-vehicle camera, and the out-vehicle video data may be acquired through at least one out-vehicle camera. The in-vehicle camera and the out-vehicle camera should cover the out-vehicle and in-vehicle perspectives as much as possible, so that the remote second user can understand the real-time driving conditions of the vehicle and the driving conditions of the first user as comprehensively as possible through the in-vehicle and out-vehicle video data. The first audio data may be acquired through an in-vehicle microphone.

[0097] In an implementation of this embodiment, the method may further include, in response to a video data sharing mode instruction, sending the in-vehicle video data or the out-vehicle video data to the user end. The video data sharing mode includes an out-vehicle video data sharing mode and an in-vehicle video data sharing mode, so that the first user can share the in-vehicle video data or the out-vehicle video data according to his own needs, so as to further protect the autonomy of the first user.

[0098] Step S120, receiving the second audio data or the third audio data sent by the user terminal in response to the accompanying instruction, and playing the second audio data or the third audio data, where the second audio data is the audio data collected by the user terminal, and the third audio data is the audio data converted by the user terminal according to the acquired text information.

[0099] Specifically, the second audio data is the audio data of the second user collected by the user terminal in response to the voice accompanying instruction, and the third audio data is the audio data converted by the user terminal from the acquired text information in response to the text accompanying instruction. The second audio data and the third audio data can be played through the in-vehicle speaker.

[0100] In this embodiment, the vehicle end and the user end can perform remote data transmission via wireless communication, for example, via cellular communication technology (such as 3G / 4G / 5G communication technology) or Zigbee technology.

[0101] It should be noted that in the above implementation, the method execution subject can be the first controller on the vehicle side. The first controller responds to the accompanying instructions to obtain the inside and outside vehicle video data collected by the inside and outside vehicle cameras, or the first audio data of the first user collected by the inside-vehicle microphone, and sends the obtained inside and outside vehicle video data or first audio data to the user side. At the same time, when receiving the audio data sent by the user side, the speaker is controlled to play the received audio data.

[0102] Figure 2 is a flow chart of another vehicle remote accompanying method provided by an embodiment of the present invention. Figure 2 As shown, the vehicle remote accompanying method is used at the user end, and the method includes:

[0103] Step S210, in response to the accompanying instruction, the second audio data or the third audio data is sent to the vehicle end, the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information.

[0104] The accompanying instruction includes at least one of a first accompanying instruction received by the user terminal and input from the vehicle terminal, and a second accompanying instruction input at the user terminal. In other words, the method supports both the first user in the vehicle and the second user outside the vehicle to actively initiate accompanying instructions. At the same time, the method can flexibly adjust the communication mode and content according to actual conditions, which not only guarantees the autonomy of the first user, but also meets the personalized needs of the user, and enhances the practicality and flexibility of the system.

[0105] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction. Then step S210 includes:

[0106] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0107] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0108] Specifically, the user terminal may include a microphone and an audio conversion device, the second audio data may be collected by the user terminal microphone, the third audio data may be converted by the user terminal audio conversion module, and the audio conversion module may convert text into audio or convert audio into text. In this implementation, the audio conversion module may convert the text information acquired by the user terminal into the third audio data, and at the same time, may also convert the first audio data received by the user terminal into text for display.

[0109] It should be noted that when the accompanying instruction is a scene-accompanying instruction, it means that the first user or the second user has no communication needs at this time, and only wants to share the scenery or obtain the driving conditions of the first user, etc., and there is no need to collect the user-side audio and send it to the vehicle side.

[0110] In this embodiment, the vehicle side will send different types of data to the user side in response to different accompanying instructions. When the user side receives the video data inside and outside the vehicle sent by the vehicle side in response to the scene accompanying instruction, or when the user side receives the first audio data sent by the vehicle side in response to the voice accompanying instruction, the following step S220 can be executed. When the user side receives the first audio data sent by the vehicle side in response to the text accompanying instruction, the following step S230 can be executed.

[0111] Step S220, receiving the first data sent by the vehicle end in response to the accompanying instruction, and playing the first data, where the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle.

[0112] Specifically, the in-vehicle and out-vehicle video data are sent to the user end by the vehicle end in response to the scene accompanying instruction, and the first audio data are sent to the user end by the vehicle end in response to the voice accompanying instruction or the text accompanying instruction. The user end may also include a video playback device and a speaker. When the user end receives the in-vehicle and out-vehicle video data sent by the vehicle end, the video playback device may be controlled to play the in-vehicle and out-vehicle video; when the user end receives the first audio data sent by the vehicle end in response to the voice accompanying instruction, the speaker may be controlled to play the first audio.

[0113] Step S230: The receiving vehicle sends the first audio data in response to the accompanying instruction, and converts the first audio data into text for display.

[0114] Specifically, when the user end receives the first audio data sent by the vehicle end in response to the text-accompanying instruction, the audio conversion module can be controlled to convert the first audio data into text for display.

[0115] In this embodiment, the vehicle end and the user end can perform remote data transmission through wireless communication. For example, cellular communication technology (such as 3G / 4G / 5G communication technology) or Zigbee communication technology can be used. The user end can be a second user terminal device such as a smart phone, a tablet computer, a laptop computer, etc., and the above wireless communication technology can be used to realize real-time communication between the first user and the remote second user.

[0116] It should be noted that in the above implementation, the method execution subject can be the second controller on the user side. The second controller responds to the accompanying instruction to obtain the second audio data collected by the microphone on the user side, or the audio conversion module on the user side converts the text input by the second user into the third audio data, and sends the obtained second audio data or third audio data to the vehicle side. At the same time, when receiving the video data inside and outside the vehicle sent by the vehicle side, the video playback device is controlled to play; when receiving the first audio data sent by the vehicle side, the speaker is controlled to play in response to the voice accompanying instruction; when receiving the first audio data sent by the vehicle side, the audio conversion module is controlled to convert the first audio data into text for display in response to the text accompanying instruction.

[0117] Figure 3 is a flow chart of another vehicle remote accompanying method provided by an embodiment of the present invention, such as Figure 3 As shown, the vehicle remote accompanying method is applied to the vehicle end and the user end, and the method includes:

[0118] Step S310: In response to the accompanying instruction, the vehicle end sends the first data to the user end, where the first data includes the video data inside and outside the vehicle collected by the vehicle end, or the first audio data inside the vehicle.

[0119] The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input at the user end.

[0120] In an embodiment, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction. The specific implementation of step S310 can refer to the relevant description of the above step S110, which will not be repeated here.

[0121] Step S320: The user end receives the first data sent by the vehicle end and plays the first data.

[0122] In this embodiment, the specific implementation method of step S320 can refer to the relevant description of the above step S220, which will not be repeated here.

[0123] Step S330, in response to the accompanying instruction, the user end sends the second audio data or the third audio data to the vehicle end, the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information.

[0124] The second audio data is the audio data of the second user collected by the user terminal in response to the voice accompanying instruction, and the third audio data is the audio data converted by the user terminal from the acquired text information in response to the text accompanying instruction.

[0125] Optionally, step S330 includes:

[0126] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0127] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0128] In this embodiment, the specific implementation of step S330 can refer to the relevant description of the above step S210, which will not be repeated here.

[0129] Step S340: the vehicle end receives the second audio data or the third audio data sent by the user end, and plays the second audio data or the third audio data.

[0130] In this embodiment, the specific implementation of step S340 can refer to the relevant description of the above step S120, which will not be repeated here.

[0131] Specifically, in the above implementation, the method execution subject at the vehicle end is the first controller, and the method execution subject at the user end is the second controller. The first controller and the second controller communicate with each other via a wireless communication module. The following describes the execution actions of the first controller and the second controller under each accompanying instruction:

[0132] (1) When the first user inputs a scene-accompanying instruction on the vehicle side, or the second user inputs a scene-accompanying instruction on the user side:

[0133] The first controller is used to send the in-vehicle and out-vehicle video data to the second controller in response to the scene accompanying instruction; the second controller 21 is used to play the received in-vehicle and out-vehicle video data in response to the scene accompanying instruction.

[0134] In the above implementation method, the vehicle side only needs to collect the video data inside and outside the vehicle and send it to the user side for playback, so that the first user can share the video data inside and outside the vehicle with the second user, and the second user can remotely understand the driving environment, road conditions, and driving status of the first user during driving, thereby realizing the second user's scene companionship with the first user.

[0135] (2) When the first user inputs a voice-accompanied instruction on the vehicle side, or the second user inputs a voice-accompanied instruction on the user side:

[0136] The first controller is used to send the first audio data to the second controller and play the received second audio data in response to the voice accompaniment instruction; the second controller is used to send the second audio data to the first controller and play the received first audio data in response to the voice accompaniment instruction.

[0137] In the above implementation method, the vehicle side only needs to collect the first audio data of the first user and send it to the user side for playback, and the user side only needs to collect the second audio data of the second user and send it to the vehicle side for playback, so that the first user and the second user can have remote voice communication and realize the voice accompaniment of the first user by the second user.

[0138] (3) When the second user inputs text accompanying the instruction on the user terminal:

[0139] The first controller is used to, in response to a text-accompanied instruction, send the first audio data to the second controller and play the received third audio data; the second controller is used to, in response to a text-accompanied instruction, convert the text input by the second user into a third audio and send it to the first controller, and convert the received first audio data into text for display.

[0140] In the above implementation, since the second user is unable to speak, the first audio data of the first user can be converted into text and displayed on the user side, and the text input by the second user can be converted into a third audio and sent to the vehicle side for playback, so that the first user can still communicate with the second user through voice to ensure driving safety, and the second user can communicate with the first user through text to meet the needs of the second user who is unable to speak.

[0141] Based on Figure 1 With the same inventive concept as the vehicle remote accompanying method shown, an embodiment of the present invention further provides a vehicle remote accompanying device applied to a vehicle side. Figure 4 is a structural block diagram of a vehicle remote accompanying device provided by an embodiment of the present invention, such as Figure 4 As shown, the vehicle remote companion device 400 applied to the vehicle side includes a first controller 410 and a first playback module 420 .

[0142] The first controller 410 is used to send first data to the user end in response to the accompanying instruction, where the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle.

[0143] The first playback module 420 is used to receive the second audio data or the third audio data sent by the user terminal in response to the accompanying instruction, and play the second audio data or the third audio data, where the second audio data is the audio data collected by the user terminal, and the third audio data is the audio data converted by the user terminal based on the acquired text information.

[0144] The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input from the user end and received at the vehicle end.

[0145] In this embodiment, the device 400 may further include a video acquisition module and a first audio module. The video acquisition module is used to acquire video data inside and outside the vehicle, and the first audio module is used to acquire first audio data inside the vehicle.

[0146] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction. The second audio data is the audio data of the second user collected by the user terminal in response to the voice accompanying instruction, and the third audio data is the audio data converted by the user terminal from the acquired text information in response to the text accompanying instruction.

[0147] Optionally, the first controller 410 is further configured to:

[0148] In response to the scene accompanying instruction, the video data inside and outside the vehicle are sent to the user end;

[0149] In response to the voice accompanying instruction and the text accompanying instruction, the first audio data is sent to the user terminal.

[0150] The specific details of the vehicle-side remote accompanying method involved in the above-mentioned vehicle remote accompanying system 400 may correspond to the above-mentioned Figure 1 The corresponding descriptions and effects in the vehicle remote accompanying method embodiment shown in the figure can be understood and will not be repeated here.

[0151] Based on Figure 2 With the same inventive concept as the vehicle remote accompanying method shown, an embodiment of the present invention further provides a vehicle remote accompanying device applied to a user end. Figure 5 is a structural block diagram of a vehicle remote accompanying device provided by an embodiment of the present invention, such as Figure 5 As shown, the vehicle remote companion device 500 applied to the user end includes a second controller 510 , a second playing module 520 and an audio conversion module 530 .

[0152] The second controller 510 is used to send the second audio data or the third audio data to the vehicle end in response to the accompanying instruction, the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information.

[0153] The second playback module 520 is used to receive the first data sent by the vehicle end in response to the accompanying instruction and play the first data, where the first data includes the video data inside and outside the vehicle collected by the vehicle end, or the first audio data inside the vehicle.

[0154] The audio conversion module 530 is used to receive the first audio data sent by the vehicle end in response to the accompanying instruction, convert the first audio data into text for display; and convert the user end into third audio data based on the acquired text information.

[0155] The accompanying instruction includes at least one of a first accompanying instruction input from the vehicle end and received at the user end, and a second accompanying instruction input at the user end.

[0156] In this embodiment, the device 500 may further include a video playback module and a second audio module, the video playback module is used to collect video data inside and outside the vehicle, and the second audio module is used to collect second audio data of the second user at the user end.

[0157] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction; the second controller 510 is further used to:

[0158] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0159] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0160] The specific details of the vehicle-side remote accompanying method involved in the above-mentioned vehicle remote accompanying system 500 may correspond to the above-mentioned Figure 2 The corresponding descriptions and effects in the vehicle remote accompanying method embodiment shown in the figure can be understood and will not be repeated here.

[0161] Based on Figure 3 With the same inventive concept as the vehicle remote accompanying method shown, an embodiment of the present invention further provides a vehicle remote accompanying device applied to a vehicle end and a user end. Figure 6 is a structural block diagram of a vehicle remote accompanying device provided by an embodiment of the present invention, such as Figure 6 As shown, the vehicle remote companion device 600 includes a first controller 611 and a first playback module 612 applied to the vehicle end, and a second controller 621, a second playback module 622 and an audio conversion module 623 applied to the user end.

[0162] The first controller 611 is used to send the first data to the second playback module in response to the accompanying instruction, where the first data includes the video data inside and outside the vehicle collected by the vehicle end, or the first audio data inside the vehicle.

[0163] The first playing module 612 is used to receive the second audio data or the third audio data, and play the second audio data or the third audio data.

[0164] The second controller 621 is used to send the second audio data or the third audio data to the first playback module in response to the accompanying instruction, the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information.

[0165] The second playing module 622 is used for receiving the first data and playing the first data.

[0166] The audio conversion module 623 is used to receive the first audio data and convert the first audio data into text for display; and is also used to convert the text information obtained by the user end into third audio data.

[0167] The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input at the user end.

[0168] Optionally, the first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction;

[0169] The second audio data is the audio data of the second user collected by the user terminal in response to the voice accompanying instruction, and the third audio data is the audio data converted by the user terminal from the acquired text information in response to the text accompanying instruction.

[0170] Optionally, the first controller 611 is further configured to:

[0171] In response to the scene accompanying instruction, the video data inside and outside the vehicle are sent to the user end;

[0172] In response to the voice accompanying instruction and the text accompanying instruction, the first audio data is sent to the user terminal.

[0173] Optionally, the second controller 621 is further configured to:

[0174] In response to the voice accompanying instruction, sending the second audio data to the vehicle end;

[0175] In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

[0176] The specific details of the vehicle-side remote accompanying method involved in the above-mentioned vehicle remote accompanying system 600 may correspond to the above-mentioned Figure 3 The corresponding descriptions and effects in the vehicle remote accompanying method embodiment shown in the figure can be understood and will not be repeated here.

[0177] Based on the same inventive concept as the above-mentioned vehicle remote accompanying method, the present invention also provides an electronic device, which may include a processor and a memory, wherein the processor and the memory may be connected to each other through a bus or other means. The processor may be a central processing unit (CPU). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components and other chips, or a combination of the above-mentioned various types of chips. The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to the vehicle remote accompanying method in the embodiment of the present invention. The processor executes various functional applications and data processing of the processor by running the non-transient software programs, instructions and modules stored in the memory, that is, realizing the vehicle remote accompanying in the above-mentioned method embodiment.

[0178] The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required by at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. The one or more modules are stored in the memory, and when executed by the processor, the execution is as follows: Figure 1 , 2 , and the vehicle remote accompanying method in the embodiment shown in 3.

[0179] For details of the above electronic equipment, please refer to Figures 1 to 3 The corresponding related descriptions and effects in the illustrated embodiments can be understood and will not be repeated here.

[0180] Based on the same inventive concept as the vehicle remote accompanying method, the present invention also provides a computer-readable storage medium, on which computer instructions are stored, and the computer program instructions are used to enable a computer to execute the vehicle remote accompanying method in the above embodiment.

[0181] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a read-only memory (ROM), a random access memory (RAM), a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), etc.; the storage medium can also include a combination of the above-mentioned types of memory.

[0182] The technical solutions provided in the above embodiments of the present application have at least the following technical effects or advantages:

[0183] The embodiments of the present invention provide a vehicle remote companionship method, device, equipment and storage medium. Through real-time data transmission between the vehicle end and the user end, the first user in the vehicle can conveniently share the video inside and outside the vehicle or the audio inside the vehicle with the second user on the user end while driving, and receive audio feedback from the user end, thereby realizing remote companionship and communication, greatly enhancing the sense of security and companionship of the first user in the vehicle. In an emergency, the first user in the vehicle can quickly transmit the on-site situation to the second user on the user end (such as family, friends or emergency rescue center), so that relevant personnel can understand the situation in time and provide necessary help or guidance, effectively improving the response speed and efficiency of emergency situations. And this method is not limited to emergency response, but also allows the first user in the car to share driving experience with the second user on the user end, such as scenery and interesting things along the way. Through real-time transmission of audio or video, the driving experience of the users in the car is enriched, the fun and interactivity of driving are enhanced, and the loneliness and fatigue caused by long-distance driving can be effectively alleviated. Even if the first user is far away, he can use the vehicle as a medium to achieve emotional transmission and communication with the remote second user, as if riding in the same car, which increases the emotional connection and sense of companionship between family and friends, is conducive to improving user satisfaction and happiness, and enhances the closeness of interpersonal relationships. The present invention has achieved a new breakthrough in the intelligent application of vehicles by integrating the two-way communication function of the vehicle end and the user end. It is not only limited to traditional driving assistance and safety monitoring, but also expands the function of the vehicle as an information exchange platform, which is closer to the actual needs of users, provides personalized remote communication and companionship services, and shows a new direction for the development of vehicle intelligence.

[0184] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0185] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the intention that the claimed invention requires more features than those explicitly recited in each claim. More specifically, as reflected in the claims below, inventive aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present invention.

[0186] It should be noted that the above-mentioned embodiments illustrate rather than limit the invention and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims.

Claims

1. A vehicle remote accompanying method, characterized in that: Applied to the vehicle side, the vehicle remote accompanying method includes: In response to the accompanying instruction, first data is sent to the user end, wherein the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle; receiving second audio data or third audio data sent by the user terminal in response to the accompanying instruction, and playing the second audio data or the third audio data, wherein the second audio data is audio data collected by the user terminal, and the third audio data is audio data converted by the user terminal according to the acquired text information; The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input from the user end and received at the vehicle end.

2. The vehicle remote accompanying method according to claim 1, characterized in that: The first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction; The second audio data is audio data collected by the user terminal in response to the voice accompaniment instruction, and the third audio data is audio data converted by the user terminal from the acquired text information in response to the text accompaniment instruction.

3. A vehicle remote accompanying method, characterized in that: Applied to the user side, the vehicle remote accompanying method includes: In response to the accompanying instruction, the second audio data or the third audio data is sent to the vehicle end, wherein the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information; receiving first data sent by the vehicle end in response to the accompanying instruction, playing the first data, or receiving first audio data sent by the vehicle end in response to the accompanying instruction, converting the first audio data into text for display, wherein the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle; The accompanying instruction includes at least one of a first accompanying instruction input from the vehicle end and received by the user end, and a second accompanying instruction input at the user end.

4. The vehicle remote accompanying method according to claim 3, characterized in that: The first accompanying instruction includes at least one of a scene accompanying instruction and a voice accompanying instruction, and the second accompanying instruction includes at least one of a scene accompanying instruction, a voice accompanying instruction, and a text accompanying instruction; in response to the accompanying instruction, sending the second audio data or the third audio data to the vehicle end includes: In response to the voice accompanying instruction, sending the second audio data to the vehicle end; In response to the text-accompanying instruction, the third audio data is sent to the vehicle end.

5. A vehicle remote accompanying method, characterized in that: Applied to the vehicle side and the user side, the vehicle remote accompanying method includes: In response to the accompanying instruction, the vehicle end sends first data to the user end, where the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle; The user end receives the first data sent by the vehicle end and plays the first data, or the user end receives the first audio data sent by the vehicle end and converts the first audio data into text for display; In response to the accompanying instruction, the user end sends the second audio data or the third audio data to the vehicle end, wherein the second audio data is the audio data collected by the user end, and the third audio data is the audio data converted by the user end according to the acquired text information; The vehicle end receives the second audio data or the third audio data sent by the user end, and plays the second audio data or the third audio data; The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input at the user end.

6. A vehicle remote accompanying device, characterized in that: Applied to the vehicle side, including: A first controller, configured to send first data to a user terminal in response to the accompanying instruction, wherein the first data includes video data inside and outside the vehicle collected by the vehicle terminal, or first audio data inside the vehicle; A first playing module is used to receive the second audio data or the third audio data sent by the user terminal in response to the accompanying instruction, and play the second audio data or the third audio data, wherein the second audio data is the audio data collected by the user terminal, and the third audio data is the audio data converted by the user terminal according to the acquired text information; The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input from the user end and received at the vehicle end.

7. A vehicle remote accompanying device, characterized in that: Applied to the user side, including: A second controller is used to send second audio data or third audio data to the vehicle end in response to the accompanying instruction, wherein the second audio data is audio data collected by the user end, and the third audio data is audio data converted by the user end according to the acquired text information; A second playing module is used to receive the first data sent by the vehicle end in response to the accompanying instruction, and play the first data, wherein the first data includes the video data inside and outside the vehicle collected by the vehicle end, or the first audio data inside the vehicle; an audio conversion module, for receiving the first audio data sent by the vehicle end in response to the accompanying instruction, converting the first audio data into text for display; and for converting the text information obtained by the user end into the third audio data; The accompanying instruction includes at least one of a first accompanying instruction input from the vehicle end and received by the user end, and a second accompanying instruction input at the user end.

8. A vehicle remote accompanying device, characterized in that: It includes a first controller and a first playback module applied to the vehicle end, and a second controller, a second playback module and an audio conversion module applied to the user end; The first controller is used to send first data to the second playback module in response to the accompanying instruction, wherein the first data includes video data inside and outside the vehicle collected by the vehicle end, or first audio data inside the vehicle; The first playing module is used to receive the second audio data or the third audio data, and play the second audio data or the third audio data; The second controller is used to send the second audio data or the third audio data to the first playback module in response to the accompanying instruction, wherein the second audio data is the audio data collected by the user terminal, and the third audio data is the audio data converted by the user terminal according to the acquired text information; The second playing module is used to receive the first data and play the first data; The audio conversion module is used to receive the first audio data and convert the first audio data into text for display; and is also used to convert the text information obtained by the user end into the third audio data; The accompanying instruction includes at least one of a first accompanying instruction input at the vehicle end and a second accompanying instruction input at the user end.

9. An electronic device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the vehicle remote accompanying method as described in any one of claims 1, 3, and 5 by executing the computer instructions.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the vehicle remote companionship method according to any one of claims 1, 3, and 5.

Images