Human-vehicle interaction method and device, electronic equipment and storage medium

Abstract

The invention provides a human-vehicle interaction method and device, electronic equipment and a storage medium, and relates to the technical field of vehicles. The method comprises the steps that under the condition that a child interaction mode of a vehicle is started, whether passengers comprise a child or not is determined; and when it is determined that the passengers include the child, in response to a specific interaction instruction triggered by the child, controlling a vehicle-mounted device to execute a target interaction action. According to the technology provided by the invention, the vehicle-mounted equipment is controlled to interact with the child, so that the riding fun of the child can be greatly improved, and the riding novelty is brought to the child. In this way, the riding experience of children can be greatly improved, and then the riding willingness of children is greatly improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a method, device, electronic device and storage medium for human-vehicle interaction. Background Art

[0002] For many children, riding in a car is a boring thing. As a result, a considerable number of children are not willing to ride in a car, or even unwilling to travel by car. Therefore, the ability of a vehicle to provide children with a higher riding experience and thus increase children's willingness to ride has gradually become an important factor in many families with children deciding to buy a vehicle. In this case, how to improve children's riding experience has become a technical problem that needs to be solved urgently by relevant personnel.

[0003] It should be noted that in other scenarios, there may also be technical issues on how to improve children's riding experience. Summary of the invention

[0004] In order to solve one or more of the above-mentioned technical problems, the embodiments of the present application provide a human-vehicle interaction method, device, electronic device and storage medium.

[0005] In a first aspect, an embodiment of the present application provides a method for human-vehicle interaction, including:

[0006] When the vehicle is in child interaction mode, determine whether the passengers include children;

[0007] When it is determined that the passengers include children, in response to a specific interaction instruction triggered by the child, the in-vehicle device is controlled to execute a target interaction action.

[0008] In a second aspect, an embodiment of the present application provides a human-vehicle interaction device, including:

[0009] A child determination module, used to determine whether the passengers include children when the vehicle turns on the child interaction mode;

[0010] The interactive action execution module is used to control the vehicle-mounted device to execute a target interactive action in response to a specific interactive instruction triggered by a child when the child determination module determines that the passengers include a child.

[0011] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0012] at least one processor; and

[0013] a memory communicatively connected to the at least one processor; wherein,

[0014] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method in any embodiment of the present application.

[0015] In a fourth aspect, an embodiment of the present application provides a non-transitory computer-readable storage medium storing computer instructions, which are used to enable a computer to execute the method in any embodiment of the present application.

[0016] The technology of the present application, when the vehicle turns on the child interaction mode, if the passengers include children, can respond to the specific interaction instructions triggered by the children and control the vehicle-mounted equipment to perform the target interaction action. In other words, when the vehicle turns on the child interaction mode, the vehicle-mounted equipment can be controlled to interact with the children. By controlling the vehicle-mounted equipment to interact with the children, the fun of children riding in the vehicle can be greatly enhanced, and the children can be given a sense of novelty in riding. In this way, the riding experience of children can be greatly improved, and thus the willingness of children to ride can be greatly enhanced.

[0017] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present application will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed in the present application and should not be regarded as limiting the scope of the present application.

[0019] Figure 1 A flow chart of a human-vehicle interaction method provided in an embodiment of the present application is shown;

[0020] Figure 2 A schematic diagram of a functional module configuration provided in an embodiment of the present application is shown;

[0021] Figure 3 A schematic diagram of a human-vehicle interaction device provided in an embodiment of the present application is shown;

[0022] Figure 4 A block diagram of an electronic device used to implement an embodiment of the present application is shown. DETAILED DESCRIPTION

[0023] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present application. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0024] The human-vehicle interaction method provided in the embodiment of the present application is as follows: Figure 1 As shown, it is a flow chart of a human-vehicle interaction method provided in an embodiment of the present application. The method may include the following steps:

[0025] Step S101: When the vehicle is in child interaction mode, determine whether the passengers include children.

[0026] Step S102: When it is determined that the passengers include children, in response to a specific interaction instruction triggered by the child, the vehicle-mounted device is controlled to execute a target interaction action.

[0027] The human-vehicle interaction method provided in the embodiment of the present application, when the vehicle turns on the child interaction mode, if the passengers include children, can respond to the specific interaction instructions triggered by the children and control the vehicle-mounted equipment to perform the target interaction action. In other words, when the vehicle turns on the child interaction mode, the vehicle-mounted equipment can be controlled to interact with the children. By controlling the vehicle-mounted equipment to interact with the children, the fun of children riding in the vehicle can be greatly enhanced, and the children can be given a sense of novelty in riding. In this way, the riding experience of children can be greatly improved, and the willingness of children to ride can be greatly enhanced.

[0028] The child interaction mode is a vehicle working mode pre-configured on the vehicle that can control the vehicle-mounted devices to interact with children. In other words, when the vehicle turns on the child interaction mode, the server can control the vehicle-mounted devices to interact with children.

[0029] In the embodiment of the present application, the child interaction mode is often configured with two major functional modules. That is, a child voice interaction module and a child action interaction module. When the passenger turns on the child interaction mode, he or she may selectively turn on any of the two functional modules, or may turn on the two functional modules at the same time. Specifically, when the passenger turns on the child interaction mode, he or she may further configure the functional modules to be turned on.

[0030] If the passenger configures only the child voice interaction module to be turned on when the child interaction mode is turned on, the vehicle can only execute the child voice interaction module when the child interaction mode is turned on. If the passenger configures only the child action interaction module to be turned on when the child interaction mode is turned on, the vehicle can only execute the child action interaction module when the child interaction mode is turned on. If the passenger configures only the child voice interaction module to be turned on when the child interaction mode is turned on, the vehicle can execute both the child voice interaction module and the child action interaction module when the child interaction mode is turned on.

[0031] like Figure 2 As shown, when the passenger turns on the child interaction mode, the configuration only turns on the child action interaction module. At this time, when the vehicle turns on the child interaction mode, the vehicle will only execute the child action interaction module.

[0032] When the vehicle executes the child voice interaction module, the server will control the vehicle-mounted voice acquisition device to collect the child's voice, and based on the voice collected by the vehicle-mounted voice acquisition device for the child, generate interactive instructions including voice information to control the vehicle-mounted device to perform interactive actions. When the vehicle executes the child action interaction module, the server will control the vehicle-mounted image acquisition device to collect image frames including the child, and will identify the child's body movements based on the image frames collected by the vehicle-mounted image acquisition device. After identifying the child's body movements, the server will further generate interactive instructions including body movement information based on the body movements identified for the child, so as to control the vehicle-mounted device to perform interactive actions.

[0033] It should be noted that the server is the executor of the human-vehicle interaction method provided in the embodiment of the present application. The server generally refers to a vehicle-mounted server, and may also refer to a cloud server. The vehicle-mounted voice acquisition device generally refers to a microphone installed on the vehicle, and the vehicle-mounted image acquisition device generally refers to a camera installed on the vehicle. The form of the vehicle-mounted voice acquisition device and the vehicle-mounted image acquisition device is not specifically limited in the embodiment of the present application.

[0034] In a possible implementation, the method of determining whether the passengers include children may be to first collect designated biometric information of the passengers when the vehicle turns on the child interaction mode, and then determine whether the passengers include children based on the designated biometric information.

[0035] By using designated biometric information to determine whether the passengers include children, it is possible to accurately determine whether the passengers include children.

[0036] The designated biometric information includes: voiceprint feature information or facial feature information, etc. The voiceprint feature information is obtained by performing voiceprint recognition on the voice collected by the vehicle-mounted voice collection device, and the facial feature information is obtained by performing facial recognition on the facial image frame collected by the vehicle-mounted image collection device. It should be noted that in the embodiments of the present application, the method of voiceprint recognition and the method of facial feature recognition are not specifically limited.

[0037] In one example, a trained voiceprint recognition model may be used for voiceprint recognition. The voiceprint recognition model is used to perform voiceprint recognition on an input speech to be recognized and output voiceprint feature information corresponding to the speech to be recognized.

[0038] In one example, a trained facial recognition model may be used to perform facial recognition. The facial recognition model is used to perform facial recognition on an input facial image frame to be recognized, and output facial feature information corresponding to the facial image frame to be recognized.

[0039] In a possible implementation, in order to further enhance the fun and novelty of children riding in a vehicle, after determining that the passengers include children, a target voice broadcast mode matching the child can be randomly obtained from a plurality of pre-configured voice broadcast modes, and a greeting voice corresponding to the target voice broadcast mode can be obtained. Then, the vehicle-mounted device is controlled to broadcast the corresponding greeting voice using the target voice broadcast mode.

[0040] Since the target voice broadcast mode matching the child is randomly obtained from the pre-configured multiple voice broadcast modes, and the greeting voice corresponding to the target voice broadcast mode is obtained, the vehicle-mounted device is likely to use multiple voice broadcast modes to broadcast the corresponding greeting voice in different riding experiences of the child. In this way, the novelty of riding in a car can be further enhanced, and the fun of riding in a car can be further enhanced, thereby further enhancing the willingness of the child to ride in a car.

[0041] The voice broadcast mode is used to identify the sound theme to be adopted by the vehicle-mounted device for voice broadcast. Among them, the sound theme can be configured for film and television characters, virtual animals, or virtual characters. For example, when the sound theme identified by the voice broadcast mode is configured for a specific cartoon character, the vehicle-mounted device will use the voice of the specific cartoon character for voice broadcast. For another example, when the sound theme identified by the voice broadcast mode is configured for a specific virtual animal, the vehicle-mounted device will use the voice of the specific virtual animal for voice broadcast.

[0042] In the embodiment of the present application, randomly acquiring a target voice broadcast mode that matches a child from among the pre-configured multiple voice broadcast modes may refer to first acquiring facial feature information of the child, and determining a user portrait of the child based on the facial feature information. Then, acquiring at least one voice broadcast mode that matches the user portrait from among the pre-configured multiple voice broadcast modes, and randomly acquiring a target voice broadcast mode from among at least one voice broadcast mode.

[0043] First, at least one voice broadcast mode matching the user profile is obtained from the pre-configured multiple voice broadcast modes, and then the target voice broadcast mode is randomly obtained from the at least one voice broadcast mode, so as to ensure that the target voice broadcast mode matches the user profile of the child, so that the target voice broadcast mode is more likely to be liked by the child. In this way, the fun of riding in the car can be further enhanced, and the willingness of riding in the car can be further improved.

[0044] User portraits are used to identify the basic attributes of children, including the age group and gender of the child.

[0045] In one example, the user profile identifies that the child is a girl aged 0-5 years old. Then, among the pre-configured multiple voice broadcast modes, obtaining at least one voice broadcast mode that matches the user portrait may mean screening out, from the multiple voice broadcast modes, a voice broadcast mode corresponding to a gentle and cute sound theme as the at least one voice broadcast mode that matches the user portrait.

[0046] In another example, the user profile identifies that the child is a boy between the ages of 6 and 12. Then, among the pre-configured multiple voice broadcast modes, obtaining at least one voice broadcast mode that matches the user portrait may mean screening out, from the multiple voice broadcast modes, a voice broadcast mode corresponding to a cold and low-type voice theme as the at least one voice broadcast mode that matches the user portrait.

[0047] In the embodiment of the present application, different voice broadcast modes are configured with different greeting voices. For example, for the voice broadcast mode corresponding to the gentle and cute sound theme, the greeting voice configured for the voice broadcast mode may be "dong dong dong, the princess is here" or "hello, little friend". For another example, for the voice broadcast mode corresponding to the cold and low sound theme, the greeting voice configured for the voice broadcast mode may be "hi, welcome to my castle".

[0048] It should be noted that in the embodiment of the present application, a corresponding voice broadcast mode can also be pre-configured according to the preferences of children. In this way, when it is determined that the passengers include children, the voice broadcast mode correspondingly configured for children can be further determined as the target voice broadcast mode.

[0049] In one possible implementation, when it is determined that the passengers include children, in response to a specific interaction instruction triggered by the child, controlling the on-board device to perform a target interaction action means that when it is determined that the passengers include children, first determining whether the child's seating time reaches a specified duration, and then, when the seating time reaches the specified duration, controlling the on-board device to perform the target interaction action in response to the specific interaction instruction.

[0050] When the seat time reaches the specified time, the system will respond to the specific interactive instruction and control the vehicle-mounted device to perform the target interactive action, which can avoid the situation where the child does not need to ride, and the server will also control the vehicle-mounted device to interact with the child. In this way, it can not only avoid unnecessary human-vehicle interaction, but also avoid adverse effects such as frightening the child.

[0051] In a possible implementation, when the passenger turns on the child interaction mode, the child voice interaction module is configured to be turned on. In this case, the specific interaction instruction can be triggered based on the specified voice collected by the vehicle voice collection device for the child. When the specific interaction instruction is triggered based on the specified voice collected by the vehicle voice collection device for the child, in response to the specific interaction instruction triggered by the child, controlling the vehicle-mounted device to perform the target interaction action can mean first responding to the specific interaction instruction, determining the response voice matching the specified voice, and determining the broadcast response voice as the target interaction action. Then, the vehicle-mounted device is controlled to broadcast the response voice to perform the target interaction action.

[0052] The specific interactive instruction carries voice information corresponding to the specified voice, which is used to instruct the vehicle-mounted device to broadcast the specified voice. In this case, the vehicle-mounted device may refer to a vehicle-mounted smart speaker or a vehicle-mounted microphone.

[0053] In one example, multiple candidate voices can be preconfigured, and corresponding response voices can be configured for each candidate voice. In this way, only when the specified voice belongs to multiple voices can it be determined that the specified voice can trigger the server to generate an interactive instruction, and a specific interactive instruction will be generated for the specified voice.

[0054] In another example, the server can provide personalized response voices for different voices. For example, when the designated voice is a voice for inquiry, the server can determine the reply voice corresponding to the designated voice as the response voice matching the designated voice.

[0055] Controlling the vehicle-mounted device to broadcast the response voice can enhance the child's willingness to interact with the vehicle by voice. In this case, the child's fun of riding in the vehicle and the child's novelty of riding in the vehicle will be enhanced, and thus the child's willingness to ride in the vehicle will also be enhanced.

[0056] In one example, in order to further enhance the fun and novelty of children riding in a car, when controlling the vehicle-mounted device to broadcast a response voice, a target voice broadcast mode matching the child can be obtained from a plurality of pre-configured voice broadcast modes. Then, the vehicle-mounted device is controlled to broadcast the response voice using the target voice broadcast mode.

[0057] In a possible implementation, when the passengers turn on the child interaction mode, the child action interaction module is configured to be turned on. In this case, the specific interaction instruction can be triggered based on the specified physical action identified for the child. When the specific interaction instruction is triggered based on the specified physical action identified for the child, in response to the specific interaction instruction triggered by the child, controlling the vehicle-mounted device to perform the target interaction action can mean first responding to the specific interaction instruction, determining the response action that matches the specified physical action, and determining the response action as the target interaction action. Then, the vehicle-mounted device is controlled to perform the response action. The specified physical action is determined using the image frame captured by the vehicle-mounted image acquisition device.

[0058] In the embodiment of the present application, corresponding response actions can be configured in advance for different body movements for the vehicle-mounted device. When the vehicle-mounted device is a vehicle-mounted robotic arm, a corresponding response action "shaking left and right" can be configured for the body movement "waving hands", and a corresponding response action "moving up and down" can also be configured for the body movement "nodding". In this case, if the vehicle-mounted device is a vehicle-mounted robotic arm and the designated body movement is "waving hands", the response action is "shaking left and right". At this time, controlling the vehicle-mounted device to perform the response action means controlling the vehicle-mounted robotic arm to shake left and right.

[0059] In the embodiment of the present application, when the vehicle-mounted device is a vehicle-mounted mechanical arm, the response action of the vehicle-mounted mechanical arm can also be preset to imitate the body movements of the child. In this case, if the body movement of the child is "a dance movement", the server will control the vehicle-mounted mechanical arm to imitate the dance movement of the child.

[0060] In addition, when the vehicle-mounted device is a vehicle-mounted screen, a corresponding response action "switch cartoon characters" can be configured for the body action "waving the palm in front of the face", and a corresponding response action "make the cartoon character nod" can be configured for the body action "nodding". In this case, if the vehicle-mounted device is a vehicle-mounted screen and the designated body action is "waving the palm in front of the face", the response action is "switch cartoon characters". At this time, controlling the vehicle-mounted device to execute the response action means controlling the vehicle-mounted screen to switch cartoon characters.

[0061] In the embodiment of the present application, the response action can also be pre-set as "switch animation", "switch music" or "switch picture, etc." For example, when the vehicle-mounted device is a vehicle-mounted multimedia playback device, the response action corresponding to the body movement "swinging the palm to the left" can be pre-configured as "switch to the previous animation" or "switch to the previous music", and the response action corresponding to the body movement "swinging the palm to the right" can be pre-configured as "switch to the next animation" or "switch to the next music". In this case, if it is determined that the child's body movement is "swinging the palm to the left", the server will control the vehicle-mounted multimedia playback device to switch to the previous animation or the previous music.

[0062] In addition, the response actions corresponding to the body movements can also be pre-configured as "turn up the volume", "turn down the volume", "turn on the lights", "turn off the lights", "turn on the air conditioner", "turn off the air conditioner" and "switch sound effects". For example, when the vehicle-mounted device is a vehicle-mounted multimedia playback device, the response action corresponding to the body movement "slide the finger up" can be pre-configured as "turn up the volume", and the response action corresponding to the body movement "slide the finger down" can be pre-configured as "turn down the volume". In this case, if it is determined that the child's body movement is "slide the finger up", the server will control the vehicle-mounted multimedia playback device to turn up the volume. For example, when the vehicle-mounted device is a vehicle-mounted multimedia playback device, the response action corresponding to the body movement "shake head left and right" can be pre-configured as "switch sound effects". In this case, if it is determined that the child's body movement is "shake head left and right", the server will control the vehicle-mounted multimedia playback device to switch the playback sound effects. For another example, when the vehicle-mounted device is a vehicle-mounted air conditioner, the response action corresponding to the body movement "single high-five" can be pre-configured as "turn on the air conditioner", and the response action corresponding to the body movement "double high-five" can be pre-configured as "turn off the air conditioner". In this case, if it is determined that the child's body movement is "single high-five", the server will control the vehicle-mounted air conditioner to turn on.

[0063] It should be noted that the specific type of the vehicle-mounted device is not specifically limited in the embodiments of the present application. Relevant personnel can pre-configure the type of vehicle-mounted device and the response actions corresponding to different body movements based on interaction needs.

[0064] Controlling the vehicle-mounted device to perform a response action can increase the child's willingness to interact with the vehicle through physical movements. In this case, the child's fun of riding in the vehicle and the child's novelty of riding in the vehicle will be increased, so the child's willingness to ride in the vehicle will also be increased.

[0065] In addition, it should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0066] Corresponding to the human-vehicle interaction method provided in the embodiment of the present application, the embodiment of the present application also provides a human-vehicle interaction device, the device is as follows Figure 3 shown. Figure 3 The structure block diagram of a human-vehicle interaction device 300 provided in an embodiment of the present application is shown. The human-vehicle interaction device 300 may include:

[0067] A child determination module 301 is used to determine whether the vehicle passengers include children when the vehicle starts the child interaction mode;

[0068] The interactive action execution module 302 is used to control the vehicle-mounted device to execute a target interactive action in response to a specific interactive instruction triggered by a child when the child determination module 301 determines that the passengers include a child.

[0069] In a possible implementation, the child determination module 301 includes:

[0070] A designated biometric information collection submodule is used to collect designated biometric information of passengers when the vehicle turns on the child interaction mode;

[0071] The child determination module 301 submodule is used to determine whether the passengers include children based on the specified biometric information.

[0072] In a possible implementation, the interactive action execution module 302 includes:

[0073] The seating time determination submodule is used to determine whether the seating time of the child reaches a specified time when the child determination module 301 determines that the passengers include a child;

[0074] The first target interactive action execution submodule is used to control the vehicle-mounted device to execute the target interactive action in response to a specific interactive instruction when the seating time reaches a specified duration.

[0075] In a possible implementation, the specific interactive instruction is triggered based on a designated voice collected by the vehicle-mounted voice collection device for the child; the interactive action execution module 302 includes:

[0076] A first target interactive action determination submodule is used to determine a response voice matching a specified voice in response to a specific interactive instruction, and determine the broadcast response voice as a target interactive action;

[0077] The second target interactive action execution submodule is used to control the vehicle-mounted device to broadcast a response voice to execute the target interactive action.

[0078] In a possible implementation, the second target interactive action execution submodule includes:

[0079] A target voice broadcast mode acquisition submodule is used to acquire a target voice broadcast mode that matches the child from among a plurality of pre-configured voice broadcast modes;

[0080] The response voice broadcast submodule is used to control the vehicle-mounted device to broadcast the response voice using the target voice broadcast mode.

[0081] In a possible implementation, the specific interactive instruction is triggered based on a designated physical movement identified for the child; the designated physical movement is determined using an image frame captured by an onboard image acquisition device; and the interactive action execution module 302 includes:

[0082] A second target interactive action determination submodule is used to determine a response action that matches the specified body action in response to a specific interactive instruction, and determine the response action as a target interactive action;

[0083] The response action execution submodule is used to control the vehicle-mounted device to execute the response action.

[0084] In a possible implementation, the device further includes:

[0085] A greeting voice acquisition module is used to randomly acquire a target voice broadcast mode that matches the child from among a plurality of pre-configured voice broadcast modes before controlling the vehicle-mounted device to perform a target interactive action in response to a specific interactive command triggered by the child, and to acquire a greeting voice corresponding to the target voice broadcast mode;

[0086] The greeting voice broadcast module is used to control the vehicle-mounted device to broadcast the corresponding greeting voice using the target voice broadcast mode.

[0087] The functions of each module in each device in the embodiments of the present application can be found in the corresponding description in the above method, and have corresponding beneficial effects, which will not be repeated here.

[0088] Figure 4 FIG. 1 is a block diagram of an electronic device used to implement an embodiment of the present application. Figure 4As shown, the electronic device includes: a memory 401 and a processor 402. The memory 401 stores a computer program that can be run on the processor 402. When the processor 402 executes the computer program, the method in the above embodiment is implemented. The number of the memory 401 and the processor 402 can be one or more.

[0089] The electronic device also includes:

[0090] The communication interface 403 is used to communicate with external devices and perform data exchange transmission.

[0091] If the memory 401, the processor 402 and the communication interface 403 are implemented independently, the memory 401, the processor 402 and the communication interface 403 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0092] Optionally, in a specific implementation, if the memory 401, the processor 402 and the communication interface 403 are integrated on a chip, the memory 401, the processor 402 and the communication interface 403 can communicate with each other through an internal interface.

[0093] An embodiment of the present application provides a computer-readable storage medium storing a computer program, which implements the method provided in the embodiment of the present application when the program is executed by a processor.

[0094] An embodiment of the present application also provides a chip, which includes a processor for calling and executing instructions stored in the memory from the memory, so that a communication device equipped with the chip executes the method provided by the embodiment of the present application.

[0095] An embodiment of the present application also provides a chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method provided in the embodiment of the application.

[0096] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the Advanced RISC Machines (ARM) architecture.

[0097] Further, optionally, the above-mentioned memory may include a read-only memory and a random access memory, and may also include a non-volatile random access memory. The memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may include a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (DR RAM).

[0098] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.

[0099] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.

[0100] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0101] Any process or method description in the flow chart or otherwise described herein can be understood to represent a module, fragment or portion of a code including one or more executable instructions for implementing the steps of a specific logical function or process. And the scope of the preferred embodiment of the present application includes other implementations, in which the functions may not be performed in the order shown or discussed, including in a substantially simultaneous manner or in a reverse order according to the functions involved.

[0102] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, which can be embodied in any computer-readable medium for use by an instruction execution system, apparatus or device (such as a computer-based system, a system including a processor or other system that can fetch instructions from an instruction execution system, apparatus or device and execute instructions), or used in combination with these instruction execution systems, apparatuses or devices.

Claims

1. A human-vehicle interaction method, comprising: When the vehicle is in child interaction mode, determine whether the passengers include children; When it is determined that the passengers include the child, in response to a specific interaction instruction triggered by the child, the vehicle-mounted device is controlled to execute a target interaction action.

2. The method according to claim 1, wherein: In the case where the vehicle starts the child interaction mode, determining whether the passengers include children includes: When the vehicle turns on the child interaction mode, collecting designated biometric information of the passenger; Based on the designated biometric information, it is determined whether the passengers include the child.

3. The method according to claim 1, wherein: When it is determined that the vehicle passengers include the child, in response to the specific interaction instruction triggered by the child, controlling the vehicle-mounted device to perform the target interaction action includes: When it is determined that the passengers include the child, determining whether the child's seat time reaches a specified time; When the seating time reaches the specified duration, in response to the specific interaction instruction, the vehicle-mounted device is controlled to execute the target interaction action.

4. The method according to claim 1, wherein: The specific interactive instruction is triggered based on a designated voice collected by the vehicle-mounted voice collection device for the child; In response to the specific interaction instruction triggered by the child, controlling the vehicle-mounted device to perform the target interaction action includes: In response to the specific interaction instruction, determining a response voice matching the designated voice, and determining broadcasting the response voice as the target interaction action; The vehicle-mounted device is controlled to broadcast the response voice to execute the target interactive action.

5. The method according to claim 4, wherein: The controlling the vehicle-mounted device to broadcast the response voice comprises: Acquire a target voice broadcast mode matching the child from among a plurality of pre-configured voice broadcast modes; The vehicle-mounted device is controlled to broadcast the response voice using the target voice broadcast mode.

6. The method according to claim 1, wherein: The specific interaction instruction is triggered based on a designated physical movement identified for the child; the designated physical movement is determined using an image frame captured by an on-board image acquisition device; In response to the specific interaction instruction triggered by the child, controlling the vehicle-mounted device to perform the target interaction action includes: In response to the specific interaction instruction, determining a response action that matches the specified body movement, and determining the response action as the target interaction action; Control the vehicle-mounted device to execute the response action.

7. The method according to claim 1, wherein: Before controlling the vehicle-mounted device to perform a target interactive action in response to the specific interactive instruction triggered by the child, the method further includes: Randomly obtain a target voice broadcast mode that matches the child from among the pre-configured multiple voice broadcast modes, and obtain a greeting voice corresponding to the target voice broadcast mode; The vehicle-mounted device is controlled to broadcast the corresponding greeting voice using the target voice broadcast mode.

8. A human-vehicle interaction device, comprising: A child determination module, used to determine whether the passengers include children when the vehicle turns on the child interaction mode; The interactive action execution module is used to control the vehicle-mounted device to execute a target interactive action in response to a specific interactive instruction triggered by the child when the child determination module determines that the passengers include the child.

9. An electronic device comprising a memory, a processor and a computer program stored in the memory, wherein the processor implements the method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images