Vehicle interaction method and device, vehicle and electronic equipment

Abstract

The invention relates to the field of automobiles, in particular to a vehicle interaction method and device, a vehicle and electronic equipment.The method comprises the steps that when the vehicle receives voice data of a target object, reply content is determined according to the voice data; and replying the reply content to the target object through the mobile terminal corresponding to the target object. The voice data of the user can be received through the automobile, and the reply content based on the voice data is replied to the user through the mobile terminal of the user, so that the effect of linkage between the automobile and the mobile phone is realized, and the problem that the automobile and the mobile phone cannot be linked to provide service is solved.

Description

Technical Field

[0001] The present application relates to the field of automotive technology, and in particular to a vehicle interaction method, device, vehicle, and electronic equipment. Background Art

[0002] In existing technologies, users can interact with their cars by interacting with the car's display screen. Alternatively, users can interact with their mobile phones. However, each phone and car independently provide services to the user, potentially overlapping services, or the user needs to interact with each separately, making the interaction complex. Therefore, existing technologies do not propose providing user services through the linkage between mobile phones and cars. Summary of the Invention

[0003] The present application provides a vehicle interaction method, device, vehicle and electronic device to solve the problem that mobile phones and cars are not linked to provide services to users.

[0004] In a first aspect, the present application provides a vehicle interaction method, comprising: when the vehicle receives voice data of a target object, determining reply content based on the voice data; and replying the reply content to the target object through a mobile terminal corresponding to the target object.

[0005] In the second aspect, the present application provides an interactive device for a vehicle, comprising: a receiving module for determining reply content based on the voice data when receiving the voice data of the target object; and a reply module for replying the reply content to the target object through a mobile terminal corresponding to the target object.

[0006] In the third aspect, the present application provides an interactive device for a vehicle, comprising: at least one communication interface; at least one bus connected to the at least one communication interface; at least one processor connected to the at least one bus; and at least one memory connected to the at least one bus, wherein the processor is configured to: when the vehicle receives voice data of a target object, determine reply content based on the voice data; and reply to the target object with the reply content through a mobile terminal corresponding to the target object.

[0007] In a fourth aspect, the present application also provides a computer storage medium storing computer executable instructions, wherein the computer executable instructions are used to execute the vehicle interaction method described in any one of the above items of the present application.

[0008] In a fifth aspect, the present application also provides a vehicle, which includes the above-mentioned vehicle interaction device.

[0009] Beneficial effects of this application:

[0010] In the present application, when the vehicle receives voice data of a target object, the reply content is determined based on the voice data; and the reply content is replied to the target object through the mobile terminal corresponding to the target object, thereby achieving the effect of the car and the mobile terminal working together to provide services to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 A flowchart of a vehicle interaction method of the present application;

[0012] Figure 2 A flowchart of another vehicle interaction method of the present application;

[0013] Figure 3 A flowchart of another vehicle interaction method of the present application;

[0014] Figure 4 A schematic diagram of a vehicle interaction system of the present application;

[0015] Figure 5 A flowchart of another vehicle interaction method of the present application;

[0016] Figure 6 A schematic diagram of an interactive device for a vehicle according to the present application;

[0017] Figure 7 This is a schematic diagram of an electronic device of the present application. DETAILED DESCRIPTION

[0018] The following will describe the embodiments of the present application with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand the other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are only for the purpose of illustrating the present application and are not intended to limit the scope of protection of the present application.

[0019] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application. Therefore, the illustrations only show components related to the present application and are not drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component can be changed at will, and the component layout type may also be more complicated.

[0020] For ease of description, spatially relative terms may be used herein to describe the relative position or movement of one element or feature relative to another element or feature as shown in the figures, such as "inside," "outside," "inside," "outside," "below," "beneath," "above," "above," "front," "back," and the like. Such spatially relative terms are intended to include different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures undergoes a positional flip or a change in posture or motion state, then these directional indications will also change accordingly. For example, an element described as "below" or "below" another element or feature will then be oriented as "above" or "above" another element or feature. Thus, the example term "below" can include both above and below orientations. The device can be oriented otherwise (rotated 90 degrees or in other orientations) and the spatially relative descriptors used herein will be interpreted accordingly.

[0021] In order to solve the technical problem in the prior art that cars and mobile terminals cannot work together to provide services to users, the present application provides a vehicle interaction method that can achieve the effect of cars and mobile terminals working together to provide services to users.

[0022] Figure 1 This is a flow chart of a vehicle interaction method provided in an embodiment of the present application. Figure 1 As shown, including;

[0023] S101, when the vehicle receives voice data of a target object, determining a reply content according to the voice data;

[0024] S102: replying the reply content to the target object via the mobile terminal corresponding to the target object.

[0025] The vehicle interaction method provided in the present application can be applied to a scenario in which a user carries a mobile terminal into a vehicle (car). The number of users is not limited. For example, one user can carry one or more mobile terminals into the vehicle, or multiple users can carry one or more mobile terminals into the vehicle. The above-mentioned vehicle can be a fuel-powered vehicle, a pure electric vehicle (Blade Electric Vehicles, BEV), a hybrid electric vehicle (Hybrid Electric Vehicle, HEV), a plug-in hybrid electric vehicle (Plug-in Hybrid Electric Vehicle, PHEV), an extended-range electric vehicle (Extended-Range Electric Vehicles, EREV) or a fuel cell electric vehicle (Fuel Cell Electric Vehicle, FCEV)

[0026] The target object can be the person in the main driver's seat, the front passenger seat, or a rear passenger. The target object's voice data is the voice initiated by any person in the vehicle. For example, a user in the main driver's seat may request navigation, or a user in another seat may request music.

[0027] The car in this embodiment may include one or more microphones, one or more cameras, and one or more speakers. The location of the one or more microphones within the car is not limited. The microphones can be used to capture the user's voice data. The location and angle of the one or more cameras within the car are also not limited, and they can be used to capture the situation within the car and obtain images including objects in the front or rear seats. The location of the one or more speakers within the car is also not limited. The speakers can be used to play music, interactive sounds, and the replies mentioned above.

[0028] When a car receives voice data from a target, it can determine the response based on the voice data. The response can come in a variety of forms, including voice, image, video, or real-time virtual avatar. The response can be sent to the target's mobile terminal and displayed on the target's mobile terminal. For example, if the target in the driver's seat of a car initiates voice data, the response is determined based on the target's voice data. The response is sent to the driver's mobile terminal and displayed on the driver's mobile terminal.

[0029] In this embodiment, an association relationship can also be established between the target object and the mobile terminal corresponding to the target object, so that it can be determined which target object initiates the voice data and to which mobile terminal the corresponding reply content is sent for display.

[0030] In this application, when the above-mentioned vehicle receives the voice data of the target object, the reply content is determined according to the above-mentioned voice data; the above-mentioned reply content is replied to the above-mentioned target object through the mobile terminal corresponding to the above-mentioned target object, thereby realizing the effect of the car and the mobile terminal working together to provide services to the user.

[0031] As an alternative example, Figure 2 As shown, the above method also includes:

[0032] S201, determining the target position of the target object;

[0033] S202: photographing the facial image of the target object via the mobile terminal.

[0034] In this embodiment, when determining the target position of the target object, the target position of the target object can be determined using a microphone within the vehicle. If the target position of the target object is determined using the microphone, the distance from the microphone can be determined based on the time sequence in which the voice is received by the microphone, thereby determining the position of the target object. Alternatively, when determining the target position of the target object, the vehicle interior can be captured using a camera within the vehicle. By performing facial recognition on the object in the captured image and identifying the mouth movement, the target object can be determined to determine which target object is emitting the voice data. Thus, the target position of the target object can be determined. Once the target position of the target object is determined, the target object's facial image can be captured using the mobile terminal corresponding to the target object.

[0035] In this embodiment, there are many ways to establish an association between a mobile terminal and a target object. For example, the position of the mobile terminal can be located by the car, and by locating the position of the mobile terminal, it can be determined whether the mobile terminal is in the main driver's seat, the co-driver's seat, or the rear passenger seat. The car's camera can capture the situation inside the car, thereby determining which target object is associated with which mobile terminal. Or in this example, it is also possible to determine which mobile terminal is located in which position in the car by setting up multiple mobile terminal holders. For example, corresponding mobile terminal holders are provided in the main driver's seat, the co-driver's seat, and the rear passenger seat in the car. After the user enters the car, the mobile terminal can be placed on the mobile terminal holder. In this way, the car can obtain which mobile terminal is associated with which target object.

[0036] For example, in this embodiment, a mobile terminal holder is installed at each position of the main driver's seat, the co-driver's seat and the rear passenger seat. The mobile terminal holder can be connected to the car. When the user enters the car, he fixes the mobile terminal to the mobile terminal holder. After the mobile terminal holder receives the induction that the mobile terminal is fixed to itself, it can send instructions to the car, so that the car can obtain which mobile terminal holder is associated with which mobile terminal.

[0037] A facial image of the target object is captured by a mobile terminal associated with the target object, thereby transmitting the facial image to the car.

[0038] As an optional example, the determining the target position of the target object includes: performing sound source localization on the voice data using multiple microphones in the vehicle to determine the target position.

[0039] This embodiment provides a method for localizing the sound source of voice data using multiple microphones to determine the target location of a target object. This method requires the use of multiple microphones, each of which is located in a different position within the vehicle. The multiple microphones can determine the distance of the sound source from the microphones based on the order in which they receive the sound data, thereby determining the location of the sound source.

[0040] Alternatively, microphone arrays may be arranged at the same location, but facing different directions. When the microphone array receives a sound, the direction of the sound source can be determined based on the sound intensity received by the microphones in the array at different orientations, thereby determining the target location of the target object emitting the target sound.

[0041] As an optional example, the capturing of the facial image of the target object by the mobile terminal includes: controlling the movement of a bracket holding the mobile terminal in the vehicle so that the mobile terminal tracks the face of the target object and captures the facial image.

[0042] In this embodiment, after the user secures the mobile terminal to the mobile terminal holder, the mobile terminal holder can adjust the direction and position of the mobile terminal's camera by moving itself. The adjustment of the mobile terminal holder's direction and position is controlled by commands from the vehicle. Therefore, in this example, after the mobile terminal is secured to the mobile terminal holder, if the target subject initiates voice data, the corresponding mobile terminal will activate its camera to capture image data of the target subject. However, if the target subject moves their face or body or turns their head during or after speaking, the mobile terminal may not be able to capture the target subject's image data. Therefore, after the vehicle captures the target subject's image data captured by the mobile terminal, it can recognize the image data and determine the target subject's posture and movement. Furthermore, the position and orientation of the mobile terminal holder can be adjusted based on the target subject's posture and movement. Upon receiving the vehicle's commands, the mobile terminal holder can adjust its position and orientation accordingly, thereby tracking the target subject's face and capturing the facial image.

[0043] To ensure more immediate and accurate facial images of the target subject, the subject's mouth can be used as the core point to identify the subject's mouth location after the vehicle receives the facial image. With the target subject's mouth centered in the image as the target result, the position or orientation of the mobile terminal's stand is controlled. If the target subject's mouth is not centered in the image, the distance between the target subject's mouth and the image center is determined. If the distance exceeds a preset threshold, the mobile terminal's stand is immediately adjusted.

[0044] To facilitate more immediate adjustment of the mobile terminal stand, when the target subject's mouth is not located at the center of the image and the distance between the target subject's mouth and the image center does not exceed a preset threshold, preparations are made to adjust the position or orientation of the mobile terminal stand based on the orientation of the target subject's mouth relative to the image center. Once the distance between the target subject's mouth and the image center exceeds the preset threshold, the mobile terminal stand is immediately adjusted. Preparations for adjustment can be made by energizing the motor of the mobile terminal stand, allowing the mobile terminal stand to be adjusted at any time.

[0045] As an alternative example, Figure 3 As shown, the reply content to the target object through the mobile terminal corresponding to the target object includes:

[0046] S301, replying the sound data and image data in the above reply content to the above target object through the above mobile terminal; or replying the image data in the above reply content to the above target object through the above mobile terminal, and replying the sound data in the above reply content to the above target object through the speaker in the above vehicle.

[0047] In this example, the reply content determined based on the voice data of the target object is diverse, and may include, for example, audio data, image data, video data, and virtual image data. If the reply content includes audio data, the audio data can be played through the speakers on the car, or through the speakers of the target object's mobile terminal, or through both. If it is image data, video data or virtual image data, it can be played through the display screen on the car or through the target object's mobile terminal. If the reply content includes both voice data and data that needs to be displayed on the display screen, the voice data can be played and the image data can be displayed simultaneously through the target object's mobile terminal, or the voice data can be played through the speakers on the car and the corresponding image data can be displayed through the target object's mobile terminal.

[0048] In other words, in this embodiment, whether the reply content is voice or image, there are two display modes. For voice, the two display modes are the car's speakers and the target recipient's mobile terminal. For images, the two display modes are the car's display screen and the target recipient's mobile terminal. For voice data, the car's speakers can be prioritized. If the car's speakers are unable to play, the target recipient's mobile terminal will play the message. This has the advantage of using the car's speakers for better quality. For image data, the target recipient's mobile terminal can be prioritized. If the target recipient's mobile terminal is unable to display, for example, because it is playing other content or is turned off, the car's display screen can be used to display the message. This has the advantage of displaying the image on the mobile terminal that matches the target recipient, allowing the target recipient to see the image content more clearly. Otherwise, passengers in the rear of the car would have a poor experience viewing the car's display screen.

[0049] In this embodiment, when a mobile terminal associated with a target object displays a reply, it can synchronize the displayed reply content with other mobile terminals if the other mobile terminals allow it. This synchronization can be achieved by the mobile terminal sending a sharing command to the car, which then synchronizes the reply content to the other mobile terminals, or by the mobile terminal establishing a connection with other mobile terminals and transmitting the reply content to the other mobile terminals. In this way, multiple mobile terminals can synchronously display the car's reply content, allowing multiple target objects to experience the reply content simultaneously. If the other mobile terminals are playing other content or do not allow sharing, the reply content will not be displayed.

[0050] As an optional example, when the vehicle receives the voice data of the target object, determining the reply content based on the voice data includes: determining the reply content based on the voice data; or obtaining a facial image of the target object, and determining the reply content based on the voice data and the facial image.

[0051] In the above content, a solution for determining the reply content based on the voice data of the target object is provided. In this example, the reply content can also be determined jointly by the voice data of the target object and the facial image of the target object. If the reply content is determined jointly by the voice data and the facial image of the target object, the voice data is suitable for determining the core of the reply content, the voice data can be converted into text data by text conversion, and the text data is recognized to determine the preliminary content to be replied to the target object, while the facial image is used to determine the emotions and actions of the target object. Emotions and actions are used to adjust the preliminary content determined by the text data. Therefore, the reply content can be made more accurate by comprehensively determining the reply content through voice data and the user's facial image.

[0052] As an optional example, the method further includes: the vehicle receiving the voice data of the target object through a microphone of the vehicle; or the vehicle receiving the voice data of the target object sent by the mobile terminal.

[0053] The above content introduces a method of receiving the user's voice data through the car's microphone. In addition, in this example, the target object's voice data can also be obtained through the target object's mobile terminal. And as another example, the target object's voice data can also be obtained simultaneously through the car's microphone and the target object's mobile terminal. When the target object's voice data is obtained at the same time, the car's microphone and the target object's mobile terminal are both in the turned-on state. When the target object initiates voice data, the microphone and the target object's mobile terminal can both receive the language data, and the language data can be further confirmed at this time. In further confirmation, the microphone and the received voice data can first be compared to see if they are the same. For example, the received voice data can be converted into text data, and then the text data can be compared to see if they are the same, so as to determine whether the voice data received by the microphone and the target object's mobile terminal are the same. If the received voice data is the same, the subsequent operation of determining the reply content can be carried out. If the determined voice data is different, it means that multiple target objects may have initiated voice data at the same time. When multiple target objects initiate voice data, the sound is relatively chaotic, so the microphone and mobile terminal recognize different voice data. In this case, the voice data received by the device closer to the target object can be used as the basis. For example, after the microphone and mobile terminal receive voice data and recognize different voice data, it can be determined which device is closer to the target object, and the voice data received by the device closer to the target object will be used as the basis.

[0054] Alternatively, in another example, when the voice data captured by the microphone and the mobile terminal are different, the voice data of one device can be used as the basis to determine the main voice line in the voice data. Based on this voice line, the content of the same voice line in the voice data captured by the other device is then deleted, the content of the different voice lines is retained, and finally the retained content is identified. In addition, the voice data of the other device is used as the basis to determine the main voice line, the same voice line in the voice data is deleted, the content of the different voice lines is retained, and then the retained content is identified. Then, the main voice line of each voice data is deleted from the other voice data, and the text recognized from the retained voice is used to determine the reply content.

[0055] Figure 4This is a system connection diagram of the present embodiment. The car in this embodiment includes a car computer 11, a microphone 12, a car speaker 13, a mobile terminal such as a mobile phone 14 and a smart bracket 15. Among them, the car computer serves as the core control unit of the system. The car computer runs artificial intelligence (AI) locally or connects to a cloud model, and has powerful image recognition, natural language processing, audio processing and data fusion capabilities. It is connected to the smart bracket via the Controller Area Network (CAN) Bluetooth bus to receive mobile phone-related status information transmitted by the smart bracket and send control instructions to the smart bracket, such as instructions to adjust the angle of the mobile phone. At the same time, the car computer establishes a direct connection with the mobile phone through WiFi to achieve high-speed transmission of image, touch, sensor and other data, as well as receive user operation instructions sent by the mobile phone. In addition, the car computer receives audio signals from the microphone, performs noise reduction, voice recognition and other processing, and controls the speaker to play the corresponding AI sound.

[0056] The vehicle is equipped with multiple microphones that form a microphone array and are distributed in different locations in the car, such as the roof, door interior panels, etc. The collected sound signals are transmitted to the car computer for subsequent processing. The high-quality speaker system installed in the vehicle is composed of multiple speakers of different frequency bands (treble, mid-range, bass), which are distributed in the doors, dashboards and other locations to form a surround sound effect. Based on the processing results of the AI ​​model, the car computer controls the speakers to play corresponding AI sounds, such as voice replies, prompts, warnings, etc., and can adjust the sound parameters and playback strategies according to the user's audio preferences and the location of the sound. For example, for users who initiate voice data, the sound parameters and playback strategies of the speakers can be adjusted to optimize the sound quality at the user's location.

[0057] These phones run specially developed adapter software that integrates image acquisition, touch data capture, sensor data integration, and data transmission. High-definition images from the phone's camera are captured and transmitted directly to the vehicle's computer via Wi-Fi. Touch operations are monitored in real time, and the encoded touch data is packaged and transmitted to the vehicle's computer, along with data from other sensors such as the accelerometer and gyroscope. Furthermore, the phone receives feedback from the vehicle's computer and displays the interactive interface and AI avatar on the screen.

[0058] The above-mentioned smart bracket can be flexibly installed on the vehicle dashboard or behind the front seat back. It supports the rotation of the mobile phone in 2 degrees of freedom, driven by a high-precision micro-servo, and cooperates with a high-sensitivity Hall sensor for angle feedback to achieve precise angle control (horizontally ±180°, vertically ±90°). It uses a combination of magnetic attraction and clamping to fix the mobile phone, and has a built-in wireless charging module that complies with the wireless charging Qi standard. It communicates with the vehicle computer via the CAN bus or Bluetooth, receives rotation commands from the vehicle computer to adjust the angle of the mobile phone, and feedbacks information such as the fixed status of the mobile phone to the vehicle computer.

[0059] Figure 5 This is a flow chart of receiving voice data and collecting facial images in this embodiment.

[0060] Multiple collection microphones distributed throughout the vehicle (forming a microphone array) collect surrounding audio data in real time. Using highly sensitive Micro-Electro-Mechanical System (MEMS) technology, they can clearly capture sound signals from all directions within the vehicle.

[0061] After receiving the data from the microphone, the car computer uses advanced sound source localization algorithms to process the collected audio data and accurately identify the source of the sound. For example, when someone in the car issues a voice command, the sound source localization system can quickly determine the approximate location of the speaker, such as the front driver, front passenger, or rear passenger.

[0062] Based on the sound source localization results, the car computer controls the mobile phone camera in the corresponding position to capture images. For example, if the sound source localization indicates that the sound is coming from the front driver's seat, the car computer sends a command via WiFi to the mobile phone mounted on the smart bracket on the dashboard, activating the mobile phone camera to begin capturing images in the driver's direction. The car computer's AI model analyzes the captured images in real time, using a deep learning-based face detection and tracking algorithm to track the position of the face in the image. By monitoring facial landmarks in real time, the speaker's face can be accurately tracked. Even if the speaker's head moves slightly during communication, the system can adjust in time to ensure that the mobile phone screen remains focused on the speaker's face.

[0063] When a change in facial position is detected, the vehicle computer calculates the required angle of adjustment based on the offset of the facial landmarks and sends a command to the smart holder via the CAN bus or Bluetooth. The smart holder's built-in high-precision micro-servo motor (servo) drives the phone horizontally and vertically according to the received command, adjusting the phone to the appropriate angle and ensuring that the phone camera can continuously and stably capture the speaker's face.

[0064] The vehicle computer transmits the collected voice data, or voice data and facial images, to the AI ​​recognition module for processing. The AI ​​model integrates advanced natural language processing technology and supports speech recognition in multiple languages. The model performs noise reduction, feature extraction, and semantic understanding on the voice data, converting the speech into text and analyzing the user's command intent. After receiving the intended command, it can also use image data to determine the user's emotion and adjust the intended command.

[0065] Based on the results of AI recognition and processing, the car computer controls the mobile phone screen to display the corresponding AI avatar animation. For example, if a user queries weather information through voice commands, the car computer will recognize and obtain the weather data. On the one hand, it will respond to the user in a natural, fluent, and emotional voice using speech synthesis technology. On the other hand, it will display a cute AI avatar on the mobile phone screen, displaying the weather conditions or responding to the user's inquiries through animation, making the interaction more interesting and approachable.

[0066] This embodiment also provides a vehicle interaction device, such as Figure 6 Shown, including:

[0067] Receiving module 601, configured to determine reply content based on the voice data received from the target object;

[0068] The reply module 602 is configured to reply the above reply content to the target object via the mobile terminal corresponding to the target object.

[0069] The vehicle interaction device provided in the present application can be applied to a scenario in which a user carries a mobile terminal into a vehicle (car). The number of users is not limited. For example, one user can carry one or more mobile terminals into the vehicle, or multiple users can carry one or more mobile terminals into the vehicle. The above-mentioned vehicle can be a fuel-powered vehicle, a pure electric vehicle (Blade Electric Vehicles, BEV), a hybrid electric vehicle (Hybrid Electric Vehicle, HEV), a plug-in hybrid electric vehicle (Plug-in Hybrid Electric Vehicle, PHEV), an extended-range electric vehicle (Extended-Range Electric Vehicles, EREV) or a fuel cell electric vehicle (Fuel Cell Electric Vehicle, FCEV)

[0070] The target object can be the person in the main driver's seat, the front passenger seat, or a rear passenger. The target object's voice data is the voice initiated by any person in the vehicle. For example, a user in the main driver's seat may request navigation, or a user in another seat may request music.

[0071] The car in this embodiment may include one or more microphones, one or more cameras, and one or more speakers. The location of the one or more microphones within the car is not limited. The microphones can be used to capture the user's voice data. The location and angle of the one or more cameras within the car are also not limited, and they can be used to capture the situation within the car and obtain images including objects in the front or rear seats. The location of the one or more speakers within the car is also not limited. The speakers can be used to play music, interactive sounds, and the replies mentioned above.

[0072] When a car receives voice data from a target, it can determine the response based on the voice data. The response can come in a variety of forms, including voice, image, video, or real-time virtual avatar. The response can be sent to the target's mobile terminal and displayed on the target's mobile terminal. For example, if the target in the driver's seat of a car initiates voice data, the response is determined based on the target's voice data. The response is sent to the driver's mobile terminal and displayed on the driver's mobile terminal.

[0073] In this embodiment, an association relationship can also be established between the target object and the mobile terminal corresponding to the target object, so that it can be determined which target object initiates the voice data and to which mobile terminal the corresponding reply content is sent for display.

[0074] In this application, when the above-mentioned vehicle receives the voice data of the target object, the reply content is determined according to the above-mentioned voice data; the above-mentioned reply content is replied to the above-mentioned target object through the mobile terminal corresponding to the above-mentioned target object, thereby realizing the effect of the car and the mobile terminal working together to provide services to the user.

[0075] This embodiment also provides a car, which is equipped with the above-mentioned vehicle interaction device, and implements the content of the above-mentioned vehicle interaction method through the above-mentioned vehicle interaction device. For other examples of this embodiment, please refer to the above examples and will not be repeated here.

[0076] like Figure 7As shown, an embodiment of the present application provides an interactive device for a vehicle, including a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other through the communication bus 114.

[0077] Memory 113, for storing computer programs;

[0078] In one embodiment of the present application, the processor 111 is configured to implement the vehicle interaction method provided in any one of the aforementioned method embodiments when executing the program stored in the memory 113 .

[0079] A computer-readable storage medium is also provided in an embodiment of the present application, on which a computer program is stored. When the computer program is executed by a processor, the vehicle interaction method provided in any of the aforementioned method embodiments is implemented.

[0080] The device embodiments described above are illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the solutions of this embodiment.

[0081] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, or of course by hardware. Based on this understanding, the above technical solution, in essence, or the part that contributes to the relevant technology, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment, or certain parts of the embodiments.

[0082] It should be understood that the terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "comprise", "include", "contain" and "have" are inclusive and therefore specify the presence of stated features, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not to be construed as necessarily requiring them to be performed in the specific order described or illustrated, unless the order of execution is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0083] The foregoing is merely a list of specific embodiments of the present application, intended to enable those skilled in the art to understand or implement the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the broadest scope consistent with the principles and novel features of the present application.

Claims

1. A vehicle interaction method, characterized in that: include: When the vehicle receives voice data of the target object, determining reply content according to the voice data; The reply content is replied to the target object through the mobile terminal corresponding to the target object.

2. The method according to claim 1, characterized in that The method further comprises: determining a target position of the target object; A facial image of the target object is captured by the mobile terminal according to the target location.

3. The method according to claim 2, characterized in that Determining the target position of the target object includes: The sound source of the voice data is localized using multiple microphones in the vehicle to determine the target position.

4. The method according to claim 2, characterized in that Taking the facial image of the target object by the mobile terminal includes: The support for the mobile terminal in the vehicle is controlled to move so that the mobile terminal tracks the face of the target object and captures the facial image.

5. The method according to claim 1, characterized in that The step of replying the reply content to the target object through the mobile terminal corresponding to the target object includes: Replying the sound data and image data in the reply content to the target object via the mobile terminal; or The image data in the reply content is replied to the target object through the mobile terminal, and the sound data in the reply content is replied to the target object through the speaker in the vehicle.

6. The method according to claim 1, characterized in that When the vehicle receives the voice data of the target object, determining the reply content according to the voice data includes: Determine the reply content according to the voice data; or A facial image of the target object is obtained, and the reply content is determined based on the voice data and the facial image.

7. The method according to claim 1, characterized in that The method further comprises: The vehicle receives the voice data of the target object through a microphone of the vehicle; or The vehicle receives the voice data of the target object sent by the mobile terminal.

8. A vehicle interaction device, characterized in that: include: A receiving module, configured to, upon receiving voice data from a target object, determine a reply content based on the voice data; The reply module is used to reply the reply content to the target object through the mobile terminal corresponding to the target object.

9. A vehicle, characterized in that: An interactive device for a vehicle comprising the vehicle as claimed in claim 8.

10. An interactive device for a vehicle, characterized in that: It includes at least one communication interface; at least one bus connected to the at least one communication interface; at least one processor connected to the at least one bus; and at least one memory connected to the at least one bus, wherein the processor is configured to: when the vehicle receives voice data of a target object, determine reply content based on the voice data; and reply the reply content to the target object through a mobile terminal corresponding to the target object.

Images