Human-computer interaction method of vehicle, nonvolatile storage medium and vehicle

Abstract

The application discloses a kind of man-machine interaction method of vehicle, nonvolatile storage medium and vehicle.Therein, the method includes: starting the man-machine interaction mode of vehicle, wherein, man-machine interaction mode is used to indicate the mode between vehicle and the user located outside vehicle interaction;Interaction information corresponding to man-machine interaction mode is projected to the first preset area on vehicle;Select information corresponding to interaction information is projected to the second preset area located outside vehicle;Determine the target scene parameter corresponding to man-machine interaction mode, wherein, target scene parameter is obtained by at least one scene parameter being selected by target selection item in at least one selection item by user;Target device is controlled based on target scene parameter, wherein, target device is used to create the atmosphere of the scene where vehicle is currently located according to target scene parameter.The present application solves the technical problem that the experience of user interaction control of the scene outside the vehicle in the related art is relatively low.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction, and more specifically, to a human-computer interaction method for a vehicle, a non-volatile storage medium, and a vehicle. Background Technology

[0002] As vehicle intelligence continues to advance, cars are no longer just a means of transportation. With the continuous progress and widespread application of sensing and artificial intelligence technologies in vehicles, they are gradually evolving into mobile intelligent terminals. Currently, the integration of artificial intelligence technologies such as vision and voice are widely used within the cockpit, but few of these applications have yet extended to the outside of the vehicle, creating engaging and effective interactions.

[0003] There is currently no effective solution to the above problems. Summary of the Invention

[0004] This invention provides a human-computer interaction method for vehicles, a non-volatile storage medium, and a vehicle, to at least solve the technical problem in the related art where the user's interactive control of the external scene has a low user experience.

[0005] According to one aspect of the present invention, a human-machine interaction method for a vehicle is provided, comprising: activating a human-machine interaction mode of the vehicle, wherein the human-machine interaction mode is used to represent a mode of interaction between the vehicle and a user located outside the vehicle; projecting interaction information corresponding to the human-machine interaction mode onto a first preset area on the vehicle, wherein the interaction information includes at least one scene parameter; projecting selection information corresponding to the interaction information onto a second preset area located outside the vehicle, wherein the selection information includes at least one selection item; determining a target scene parameter corresponding to the human-machine interaction mode, wherein the target scene parameter is obtained by the user selecting at least one scene parameter through a target selection item among at least one selection item; and controlling a target device based on the target scene parameter, wherein the target device is used to create an atmosphere of the scene in which the vehicle is currently located according to the target scene parameter.

[0006] Furthermore, the method further includes: in response to receiving a preset gesture made by a user in a third preset area located outside the vehicle, determining a target selection item corresponding to the preset gesture from at least one selection item, wherein the interval between the third preset area outside the vehicle and the second preset area outside the vehicle is less than a preset distance; and determining a target scene parameter corresponding to the target selection item from at least one scene parameter.

[0007] Furthermore, the method also includes: in response to receiving a preset position of the user in a second preset area, determining a target selection item corresponding to the preset position from at least one selection item; and determining a target scene parameter corresponding to the target selection item from at least one scene parameter.

[0008] Furthermore, the human-machine interaction mode includes: a first preset mode, which is a mode that is passively triggered by the user.

[0009] Furthermore, the human-machine interaction mode includes: a second preset mode, and the human-machine interaction mode for starting the vehicle includes: responding to receiving a first instruction from the terminal to start the second preset mode of the vehicle, wherein the second preset mode is a single-person interaction mode actively triggered by the user.

[0010] Furthermore, the human-machine interaction mode includes: a third preset mode, which is a human-machine interaction mode for starting the vehicle, including: responding to receiving a second instruction from the terminal to start the third preset mode of the vehicle, wherein the third preset mode is a multi-person interaction mode actively triggered by the user.

[0011] Furthermore, the target device includes: auxiliary lighting equipment, which is driven based on target scene parameters, including: acquiring current light information of the scene in which the vehicle is currently located; and controlling the auxiliary lighting equipment based on the current light information and preset light information.

[0012] Furthermore, the auxiliary lighting equipment is controlled based on the current light information and the preset light information, including: turning on the auxiliary lighting equipment when the current light information is less than the preset light information; and prohibiting the auxiliary lighting equipment from turning on when the current light information is greater than or equal to the preset light information.

[0013] According to another aspect of the present invention, a human-machine interaction device for a vehicle is also provided, comprising: a mode activation module for activating a human-machine interaction mode of the vehicle, wherein the human-machine interaction mode represents a mode of interaction between the vehicle and a user located outside the vehicle; an interaction information projection module for projecting interaction information corresponding to the human-machine interaction mode onto a first preset area on the vehicle, wherein the interaction information includes at least one scene parameter; a selection information projection module for projecting selection information corresponding to the interaction information onto a second preset area located outside the vehicle, wherein the selection information includes at least one selection item; a scene parameter determination module for determining a target scene parameter corresponding to the human-machine interaction mode, wherein the target scene parameter is obtained by the user selecting at least one scene parameter through a target selection item from at least one selection item; and a device control module for controlling a target device based on the target scene parameter, wherein the target device is used to create the atmosphere of the scene in which the vehicle is currently located according to the target scene parameter.

[0014] According to another aspect of the present invention, a vehicle is also provided, including one or more processors and a storage device, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to perform the above-described human-machine interaction method for the vehicle.

[0015] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein, when the program is executed, it controls the device where the computer-readable storage medium is located to perform the above-described human-machine interaction method for a vehicle.

[0016] According to another aspect of the present invention, a processor is also provided, which is used to run a program, wherein the program executes the above-described human-machine interaction method for vehicles when it runs.

[0017] In this embodiment of the invention, the human-machine interaction mode of the vehicle is activated, wherein the human-machine interaction mode represents the mode of interaction between the vehicle and a user located outside the vehicle; the interaction information corresponding to the human-machine interaction mode is projected onto a first preset area on the vehicle, wherein the interaction information includes at least one scene parameter; the selection information corresponding to the interaction information is projected onto a second preset area located outside the vehicle, wherein the selection information includes at least one selection item; a target scene parameter corresponding to the human-machine interaction mode is determined, wherein the target scene parameter is obtained by the user selecting at least one scene parameter through a target selection item in at least one selection item; a target device is controlled based on the target scene parameter, wherein the target device is used to create the atmosphere of the scene in which the vehicle is currently located according to the target scene parameter. It is easy to see that by projecting the interactive information corresponding to the human-computer interaction mode onto the window display area and the selection information onto the ground selection area, the atmosphere of the current scene of the vehicle can be created based on the scene parameters corresponding to the user's selected option, according to the current scene of the vehicle. This achieves the goal of projecting interactive information to different areas to realize different interactive experiences for users, increasing the fun of interaction, and satisfying the user's experience of interactive control of the external scene. This solves the technical problem of low user experience when interactively controlling the external scene in related technologies. Attached Figure Description

[0018] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0019] Figure 1 This is a flowchart of a human-computer interaction method for a vehicle according to an embodiment of the present invention;

[0020] Figure 2This is a schematic diagram of the effect setting process of a human-computer interaction method for a vehicle according to an embodiment of the present invention;

[0021] Figure 3 This is an external information interaction diagram of a human-computer interaction method for a vehicle according to an embodiment of the present invention;

[0022] Figure 4 This is a diagram of the external scene interaction system architecture of a human-computer interaction method for a vehicle according to an embodiment of the present invention;

[0023] Figure 5 This is a flowchart illustrating a human-computer interaction method for vehicles according to an embodiment of the present invention, used in a user scenario.

[0024] Figure 6 This is a schematic diagram of a human-machine interaction device for a vehicle according to an embodiment of the present invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] Example 1

[0028] According to an embodiment of the present invention, an embodiment of a human-machine interaction method for a vehicle is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0029] Figure 1 This is a flowchart of a human-computer interaction method for a vehicle according to an embodiment of the present invention, such as... Figure 1 As shown, the method includes the following steps:

[0030] Step S102: Activate the vehicle's human-machine interaction mode, wherein the human-machine interaction mode is used to represent the mode of interaction between the vehicle and a user located outside the vehicle.

[0031] Specifically, the aforementioned human-computer interaction mode refers to the interaction mode between a user located outside the vehicle and the vehicle. Based on the human-computer interaction mode, users outside the vehicle can customize the scene management of the vehicle, enabling the vehicle to provide an atmosphere suitable for the current environment without the user needing to enter the vehicle.

[0032] In one optional embodiment, the activation method of the human-machine interaction mode includes several methods, including automatic vehicle-mounted activation, where the human-machine interaction system automatically starts when the user starts the vehicle, triggering the corresponding human-machine interaction mode so that the user can interact with the vehicle when outside the vehicle. Alternatively, it may include user-triggered activation, where the user can manually activate the human-machine interaction system to trigger the corresponding human-machine interaction mode. It should be noted that the activation method of the human-machine interaction mode is not specifically limited and can be set according to the user's choice.

[0033] In another optional embodiment, the interaction distance between the user and the vehicle that triggers the human-computer interaction mode must meet a preset distance threshold. Within the preset distance threshold, interaction between the user and the vehicle can be achieved. Conversely, if the preset distance threshold is not met, the distance between the user and the vehicle needs to be adjusted to enable interaction. The preset distance threshold can be set according to specific vehicle models, vehicle configurations, and other parameters, and is not limited to a single parameter here.

[0034] Step S104: Project the interaction information corresponding to the human-computer interaction mode onto the first preset area on the vehicle, wherein the interaction information includes at least one scene parameter.

[0035] Specifically, the aforementioned interactive information can be understood as the lighting and music information used for interaction.

[0036] In one optional embodiment, the interactive information includes multiple results. It can be interactive information where the user pre-edits the lighting and music information through the mode editing interface of the human-computer interaction system and stores it on the cloud server; or it can be interactive information where the user pre-edits the scene through the scene editing interface of the human-computer interaction system and stores it on the cloud server. The pre-edited scene includes editing various possible scenes and extracting key elements from each pre-edited scene. Based on the key element extraction results, the user searches the resource database in the cloud to add the atmosphere elements (lighting, music) to each pre-edited scene.

[0037] The lighting information from the above interactive information can be displayed in a list, and each lighting item in the list can be numbered to obtain a lighting information list. Similarly, the music information from the interactive information can be displayed in a list, and each music item in the list can be numbered to obtain a music information list.

[0038] For example, in a pre-edited scene of a snowy day, the key factors extracted include: snow, white, and romance, and the corresponding atmosphere elements retrieved include the aforementioned information such as snow, white, and romance.

[0039] The aforementioned first preset area can be understood as the area where the aforementioned interactive information is projected, including the coverage area such as the front windshield.

[0040] At least one of the aforementioned scene parameters can be understood as parameters corresponding to a scene during human-computer interaction; that is, different scenes are distinguished by different parameters. By displaying the parameters for each human-computer interaction scene, users can quickly determine the parameters corresponding to the current scene.

[0041] In one optional embodiment, when the interactive information corresponding to the human-computer interaction mode is projected onto the vehicle, the projection timing (i.e., when to project the interactive information onto the vehicle) can have multiple outcomes. It could be achieved by using the vehicle's front-view camera (communicating with the human-computer interaction system) to capture video of the user within a preset distance threshold in front of the vehicle, obtaining video information containing the user. Based on the video information, it could be determined whether the user's time within the preset distance threshold meets a preset time limit. If so, in response to the projection command from the human-computer interaction system, the interactive information can be projected onto the vehicle. Alternatively, it could be achieved by monitoring the vehicle's driving status, and when the vehicle remains stationary and a preset stationary time threshold is reached, in response to the projection command from the human-computer interaction system, the interactive information can be projected onto the vehicle. In summary, there are multiple possible projection timings, and no single limitation is made here. It could be a single projection timing or a combination of multiple projection timings.

[0042] In another optional embodiment, when projecting the interactive information corresponding to the human-computer interaction mode onto the vehicle, the corresponding projection method also includes multiple results. It could be that the visibility of the projection area is detected to determine whether the visibility of the projection area meets a preset visibility level. If it does, then in response to the projection command of the human-computer interaction system, the interactive information is projected onto the projection area. If it does not meet the preset visibility level, an auxiliary projection device is used to optimize the light source of the projection area to ensure that the visibility of the projection area reaches the preset visibility level, and then the interactive information is projected onto the projection area.

[0043] Step S106: Project the selection information corresponding to the interaction information onto a second preset area located outside the vehicle, wherein the selection information includes at least one selection item;

[0044] Specifically, the selection information mentioned above can be understood as a prompt to confirm the selection of interactive information.

[0045] In short, the selection information can be viewed as a remote control guide. Based on specific symbols on the remote control guide, such as up, down, left, right, confirm, return, and mode switch, you can customize the selection of the above-mentioned light information list and music information list.

[0046] The aforementioned second preset area can be understood as the area where the selected information is projected, and also the area where the user selects the selected information. It should be noted that the second preset area is located on the outer side of the vehicle and extends within the direction of the interactive information projection.

[0047] In one optional embodiment, the selection information corresponding to the interactive information can be projected onto a second preset area according to the projection command of the human-computer interaction system, allowing the user to select the interactive information in the second preset area. During the process of projecting the selection information onto the second preset area, the vehicle's forward-facing camera is used to collect data on the surface flatness of the second preset area and determine whether the surface flatness meets a preset flatness requirement. If it does, the interactive information is projected onto the second preset area; otherwise, if it does not, the forward-facing camera can be used to collect images of a preset circumference range of the second preset area to determine the projection area that meets the preset flatness requirement. Here, the preset flatness requirement can be understood as the flatness of the projection surface being sufficient to clearly display the selected information.

[0048] At least one of the aforementioned options includes the number of possible choices for the user's interaction information, and it must be guaranteed that there is at least one option for the user to choose from. Each option corresponds to one of the aforementioned scenario parameters.

[0049] Step S108: Determine the target scene parameters corresponding to the human-computer interaction mode, wherein the target scene parameters are obtained by the user selecting at least one scene parameter through at least one target selection option;

[0050] Specifically, the aforementioned target scenario parameters can be understood as the parameters corresponding to the target scenario selected by the user based on the current scenario of the vehicle.

[0051] In one optional embodiment, there are multiple possibilities for determining the target scene parameters. On one hand, within the selection area corresponding to the second preset area, the user can customize the interactive information corresponding to the first preset area. That is, the user determines the target lighting information in the corresponding lighting information list and the target music information in the music information list by selecting specific symbols in the information. It should be noted that after the user determines the corresponding target lighting information and target music information, they need to maintain their positions at the first projection position corresponding to the target lighting information and the second projection position corresponding to the target music information. For example, they can maintain their positions at the corresponding projection positions for at least 2 seconds to allow the vehicle's forward-facing camera to capture the first and second projection positions and transmit the captured projection position images back to the human-computer interaction system. Using visual technology, the first and second projection positions are identified to determine the corresponding user-customized target scene information (including target lighting information and target music information). By performing feature fusion on the target scene information, the final target scene parameters are obtained.

[0052] On the other hand, within the selection area corresponding to the second preset area, users can customize the pre-edited scene corresponding to the first preset area. That is, users determine the parameters of the target scene within the pre-edited scene by selecting specific symbols from the selection information. Simultaneously, users must remain in the projection position corresponding to the target scene parameters for at least 2 seconds to allow the vehicle's forward-facing camera to capture the projection position. Visual technology is then used to analyze the projection position to determine the corresponding user-defined target scene parameters (including parameters corresponding to a specific scene within the pre-edited scene).

[0053] Step S110: Control the target device based on the target scene parameters, wherein the target device is used to create the atmosphere of the scene in which the vehicle is currently located according to the target scene parameters.

[0054] Specifically, the aforementioned target devices can be understood as a set of devices that create the atmosphere of the current scene where the vehicle is located, based on target scene parameters. These can include lighting devices, music devices, etc. Lighting devices include, but are not limited to, LED (light-emitting diode) multi-color lights, vehicle headlights, etc., while music devices include, but are not limited to, external speakers, etc. It should be noted that any device with lighting and music playback functions can be considered as the aforementioned target devices.

[0055] In one optional embodiment, after determining the target scene parameters based on the vision technology of the human-computer interaction system, the human-computer interaction system can generate control commands. Based on the control commands, the human-computer interaction system controls and drives the target device, that is, based on the target scene parameters, the target device creates the atmosphere of the scene in which the vehicle is currently located. The human-computer interaction system and the target device are communicatively connected, and the two transmit commands through a data transmission protocol.

[0056] In another optional embodiment, supportive control can also be applied to the target device. A user state analysis system can be embedded into the human-computer interaction system to collect and analyze the user's posture and facial expression information (not limited to analysis methods, but can include algorithm analysis, survey analysis, model analysis, etc.) to obtain the user's state parameters adapted to the current scene. At the same time, the threshold of the atmosphere parameter of the current scene of the vehicle is determined, and it is judged whether the user's state parameters have reached the threshold. If not, auxiliary supportive control can be applied to the target device. This can be achieved by controlling the flashing frequency and brightness of the lighting equipment, and controlling the music playback speed and sound effects of the music equipment to provide supportive rendering of the current scene, thereby improving the user's adaptability to the current scene of the vehicle and making the interaction between people and vehicles, vehicles and scenery, and people and scenery more integrated.

[0057] In summary, based on the human-computer interaction system, interactive information is projected into a first preset area, and selected information is projected into a second preset area. Users can determine the interactive information in the first preset area based on the vehicle's current scene, using the selection information in the second preset area. This allows for the determination of corresponding target scene parameters, which are then used to control target devices, creating the atmosphere of the vehicle's current environment. This achieves the technical effect of enabling users to interact with the vehicle outside the vehicle using light and sound effects based on a human-computer interaction mode, creating a multi-functional atmosphere and providing users with a surprisingly pleasant outdoor experience.

[0058] Optionally, the method further includes: in response to receiving a preset gesture made by a user in a third preset area located outside the vehicle, determining a target selection item corresponding to the preset gesture from at least one selection item, wherein the interval between the third preset area outside the vehicle and the second preset area outside the vehicle is less than a preset distance; and determining a target scene parameter corresponding to the target selection item from at least one scene parameter.

[0059] Specifically, the aforementioned third preset area can be understood as an action recognition area, meaning that the vehicle's front-view camera needs to recognize a certain gesture made by the user within the third preset area in order to determine the user's selection corresponding to that gesture.

[0060] The aforementioned preset poses are the poses the user assumes within the third preset area. It's important to note that the user needs to maintain the pose for several seconds to allow the front-facing camera to capture and analyze it. Furthermore, the preset poses are not limited to hand poses, leg poses, or overall poses.

[0061] The aforementioned target selection options can be understood as the interactive information items corresponding to the preset posture determined by the user from at least one selection option.

[0062] The aforementioned target scene parameters can be understood as the scene parameters corresponding to the target selection item determined by the user from at least one scene parameter, based on the target selection item.

[0063] In one optional embodiment, the user can edit their gestures or postures via a cloud-based mode, simultaneously recording the edited gestures into a gesture library and the edited postures into a posture library. The edited information in the gesture and posture libraries is then customized and continuously trained. For example, information in the gesture library can be customized to user-defined lighting or music, and information in the posture library can also be customized to user-defined lighting or music. No single, definitive definition is made for any pairwise relationships. Furthermore, the vehicle's forward-facing camera collects preset postures of the user in a third preset area and, based on the gesture and / or posture libraries, filters the preset postures to obtain the corresponding lighting and / or music information, which can correspond to the aforementioned target selection items. This determines the target scene parameters corresponding to the target selection items.

[0064] In another alternative embodiment, as described above, one option corresponds to one scene parameter. Therefore, an option-scene parameter correspondence sequence can be constructed. In determining the target scene parameter corresponding to the target option, the scene parameter corresponding to the target option can be determined by inputting the target option into the constructed option-scene parameter correspondence sequence; this is the aforementioned target scene parameter.

[0065] By recognizing the user's gestures and / or postures in the third preset area, the target scene parameters corresponding to the user's preset postures can be determined based on different pre-trained gesture libraries and / or posture libraries. This allows the atmosphere of the current scene of the vehicle to be created based on the target scene parameters, thus achieving the purpose of recognizing the user's interactive intentions through gestures and postures.

[0066] Optionally, the method further includes: in response to receiving a preset position of the user in a second preset area, determining a target selection item corresponding to the preset position from at least one selection item; and determining a target scene parameter corresponding to the target selection item from at least one scene parameter.

[0067] Specifically, the aforementioned preset location can be understood as the user's location within the second preset area.

[0068] In one optional embodiment, the vehicle's forward-facing camera can capture a user's preset position and, based on at least one selection option, match the captured preset position to determine the target selection option corresponding to the preset position. The list of at least one selection option can be displayed on the central control screen of the human-machine interface system. The human-machine interface system analyzes the preset position captured by the forward-facing camera to determine its position in the item list, and then matches the corresponding target selection option based on that position. It should be noted that the lighting mode and music mode can be switched using the specific symbols used for mode switching. Ultimately, user-defined ambient data can be obtained.

[0069] The above target selection options are the ambient data (including lighting and music information) that the user customizes based on the current scene of the vehicle.

[0070] Based on the constructed sequence of options and scene parameters, the target scene parameters corresponding to the target options are determined. This has been explained in detail above and will not be repeated here.

[0071] Optionally, the human-machine interaction mode includes: a first preset mode, which is a mode that is passively triggered by the user.

[0072] The human-machine interaction mode includes: a second preset mode, and a human-machine interaction mode for starting the vehicle, which includes: responding to receiving a first instruction from the terminal to start the second preset mode of the vehicle, wherein the second preset mode is a single-person interaction mode actively triggered by the user.

[0073] The human-machine interaction mode includes: a third preset mode, which is a human-machine interaction mode for starting the vehicle, including: responding to a second instruction received from the terminal to start the third preset mode of the vehicle, wherein the third preset mode is a multi-person interaction mode actively triggered by the user.

[0074] Specifically, the first preset mode mentioned above is the surprise mode, which can be understood as only supporting corresponding external gesture interactions (users can select corresponding gestures from the gesture and posture library to trigger user-defined music and LED light effects). Since the surprise mode is the result of the user triggering the interaction system without any purpose, and is not subjective, the first preset mode can also be understood as a mode passively triggered by the user.

[0075] The second preset mode mentioned above is the dance floor mode, which can be understood as supporting external posture mode and external LED interaction mode (users can select music and lighting by interacting in the selection area or by using standard movements in the posture library). Since the dance floor mode is the result of the user's subjective command to trigger the interaction system, the second preset mode can also be understood as a user-initiated single-person interaction mode.

[0076] The third preset mode mentioned above is the party mode, which can be understood as supporting two-person gesture interaction (function switching can be triggered by two-person gestures such as making a heart shape or battling). Similarly, since the party mode is the result of the user's subjective command to trigger the interactive system, the third preset mode can also be understood as a multi-person interaction mode actively triggered by the user.

[0077] The first instruction mentioned above is used to activate the vehicle's human-machine interaction mode and enter the dance floor mode.

[0078] The second instruction mentioned above is used to activate the vehicle's human-machine interaction mode and enter party mode.

[0079] Figure 2 This is a schematic diagram illustrating the effect setting process of a human-computer interaction method for a vehicle according to an embodiment of the present invention. Figure 2 As shown: Based on OTA (Over-the-Air Technology), users first synchronize the latest gesture and posture library information to the vehicle's infotainment system; at the same time, they can use their mobile phones or the vehicle's infotainment system to edit the corresponding lights and music triggered by gestures and postures; furthermore, users can set corresponding modes for lights and music, including surprise mode, dance floor mode, and party mode.

[0080] The modes are as follows: Surprise Mode: This mode only supports interaction with corresponding external gesture information. Users can select a gesture from the gesture library to trigger pre-set music and LED lighting effects. Dance Floor Mode: This mode supports interaction with both external gesture and external LED information (the brightness of the external LEDs is checked before interaction). Users can select music and lighting effects through interaction in the selection area or by using standard actions from the gesture library. Party Mode: This mode supports two-person gesture interaction. Users can switch between music and LED lighting effects by using two-person gestures such as making a heart shape or battling. After confirming the three modes and their trigger methods, users can select the corresponding music and lighting effects. Finally, users must confirm the selected mode to complete the setup.

[0081] In one optional embodiment, when the vehicle is in a powered-on, stationary state, the user is located outside the vehicle, and the vehicle's front-view camera recognizes a certain action performed by the user outside the vehicle. This action can be used to trigger the vehicle's interactive system to enter a "surprise" mode (i.e., the interactive system enters "surprise" mode after recognizing the user's action, without the user consciously activating the interactive mode). Once the interactive system is confirmed to be in surprise mode, the latest gesture and posture library information can be synchronized to the vehicle's infotainment system. Simultaneously, the user can edit the corresponding lights and music triggered by the gestures and postures using their mobile phone or the vehicle's infotainment system. At this time, the gesture and posture library information can be projected onto a first preset area via the vehicle's internal projection device. Simultaneously, the user can select a corresponding posture in a second preset area. After the vehicle's front-view camera captures the user's selected posture, the interactive system can match the selected posture and trigger the user-defined music and LED lighting effects based on the matching result. This allows the user to interact with the light and sound effects from outside the vehicle by playing music through external speakers and displaying LED lights using multi-color LEDs and other lighting display devices.

[0082] In another optional embodiment, the user can send a first command to the vehicle terminal via their mobile phone to activate the vehicle's interactive system and enter dance mode. Once the interactive system is confirmed to be in dance mode, the latest gesture and posture library information can be synchronized to the vehicle's infotainment system. Simultaneously, the user can use their mobile phone or the vehicle's infotainment system to edit the corresponding lights and music triggered by gestures and postures. To meet the atmosphere requirements of dance mode, the brightness of the vehicle's current environment must also be assessed. This brightness status is fed back to the interactive system. After triggering the user-defined music and LED lighting effects based on the matching results, the user must also interact with external LED lighting information through the interactive system to determine the corresponding music and lighting effects, thus achieving the dynamic dance floor atmosphere function.

[0083] In another optional embodiment, the user can send a second command to the vehicle terminal via their mobile phone to activate the vehicle's interactive system and enter party mode. Once the interactive system is confirmed to be in party mode, the latest gesture and posture library information can be synchronized to the vehicle's infotainment system. Simultaneously, the user can edit the corresponding lights and music triggered by the gestures and postures using their mobile phone or the vehicle's infotainment system. To meet the atmosphere requirements of party mode, after projecting the gesture and posture library information onto a first preset area, multiple users in a third preset area can switch functions by triggering corresponding music and LED lights through a series of interactive gestures, including two-person heart gestures and battles. For example, a user making a two-person heart gesture in the third preset area can switch between music and lights; a user performing a two-person battle gesture in the third preset area can switch between lights and music, etc. By switching the music and LED lights, corresponding music and lighting effects can be selected to achieve the atmosphere of a surprise party.

[0084] Optionally, the target device includes: auxiliary lighting equipment. The target device is driven based on the target scene parameters. Step S110 includes: acquiring the current light information of the scene where the vehicle is currently located; and controlling the auxiliary lighting equipment based on the current light information and preset light information.

[0085] Optionally, the auxiliary lighting equipment is controlled based on the current light information and preset light information, including: turning on the auxiliary lighting equipment when the current light information is less than the preset light information; and disabling the auxiliary lighting equipment when the current light information is greater than or equal to the preset light information.

[0086] Specifically, the aforementioned auxiliary lighting equipment can be understood as equipment used to assist in controlling the brightness of the ambient light in which the vehicle is currently located, including but not limited to auxiliary lighting equipment such as vehicle headlights.

[0087] The above current lighting information reflects the lighting conditions in the current environment in which the vehicle is located.

[0088] The aforementioned preset lighting information can be understood as a light brightness threshold pre-set by the interactive system, which requires that the external environment of the vehicle can be clearly identified.

[0089] In one optional embodiment, the light level of the vehicle's current environment can be determined by the forward-facing camera. If the current light level is less than the preset light level, it means that the current light level is not yet sufficient to identify the external environment, and auxiliary lighting equipment can be turned on to supplement the light. Conversely, if the current light level is greater than or equal to the preset light level, it means that the current light level is sufficient to identify the external environment, and there is no need to turn on the auxiliary lighting equipment.

[0090] In another alternative embodiment, there are multiple ways to obtain the current lighting information of the vehicle's current environment. One method is to use a light sensor installed around the vehicle to monitor the lighting in the vehicle's current environment and then transmit the monitoring data back to the interactive system. Another method is to invoke the vehicle's current navigation system and use the navigation system to filter information about the lighting in the vehicle's current environment.

[0091] To provide a detailed illustrated explanation of the human-machine interaction methods for vehicles, the following can be described:

[0092] Figure 3 This is an external information interaction diagram of a vehicle human-machine interaction method according to an embodiment of the present invention. For example... Figure 3 As shown, the information area is the first preset area mentioned above, which is the area where interactive information is projected, including the coverage area such as the front windshield; the selection area is the second preset area mentioned above, which is the area where selection information is projected, and also the area where the user selects the selection information; the action recognition area is the third preset area mentioned above, which is the area where a certain gesture made by the user is recognized.

[0093] Figure 4 This is a diagram of an external scene interaction system architecture for a vehicle human-computer interaction method according to an embodiment of the present invention. Figure 4 As shown in the diagram, the interactive system architecture includes a cloud module and a multimedia control module. The cloud module allows for mode editing via a mobile phone, while the multimedia control module allows for mode editing via the vehicle's infotainment system. Simultaneously, the latest gesture and posture libraries are synchronized between the mobile phone and the vehicle's infotainment system. Using the gesture and posture libraries trained in the cloud module, corresponding music or lighting is edited and defined, creating a music library and a lighting library. After activating the external interaction function, the vehicle's forward-facing camera can perform selection recognition, gesture recognition, and posture recognition on the user, thus entering the corresponding mode management based on the different recognition results. Each interaction mode includes selection area management, information area management, lighting management, and music management. Specifically, selection area management and information area management are responsible for projection driving, i.e., projecting the information area onto the car window and the selection area onto the ground; lighting management is responsible for driving the LED multi-color lights and the vehicle's headlights; and music management is responsible for driving the external speakers.

[0094] Figure 5 This is a flowchart illustrating a human-computer interaction method for vehicles according to an embodiment of the present invention, used in a user scenario.

[0095] like Figure 5 As shown:

[0096] Step S502: Activate the external interaction function via the vehicle or mobile phone;

[0097] Step S504: Enter the corresponding function according to the mode set by the user;

[0098] Step S506: Use the forward-facing camera to determine the light level and confirm whether the headlights need to be turned on.

[0099] Step S508: In addition to the passive triggering method corresponding to the surprise mode, after the user actively triggers the interaction command to make the vehicle's interaction mode enter the dance floor mode or party mode, the corresponding information prompts need to be displayed through the front window information projection.

[0100] In step S510, the user can select music and lights by making corresponding body movements in the motion recognition area or by standing in different positions in the selection area.

[0101] Step S512: Create the lighting and music atmosphere specified by the user through the vehicle's exterior LED multicolor lights and external speakers.

[0102] In summary, by utilizing artificial intelligence's visual technology as the main interaction channel, and through visual recognition of user information selection actions (i.e., different positions in the selection area), user gestures, and two-person body movements, the system uses a front-view camera to achieve dynamic dance floor and surprise party atmosphere functions through internal projection devices, external multi-color LED lights, and external speakers, bringing users a surprising outdoor experience.

[0103] Example 2

[0104] According to an embodiment of the present invention, a human-machine interaction device for a vehicle is also provided. This device can execute a human-machine interaction method for a vehicle provided in Embodiment 1 above. The specific implementation method and preferred application scenario are the same as those in Embodiment 1 above, and will not be repeated here.

[0105] Figure 6 This is a schematic diagram of a human-machine interaction device for a vehicle according to an embodiment of the present invention, such as... Figure 6 As shown, the device includes:

[0106] The mode activation module 602 is used to activate the vehicle's human-machine interaction mode, wherein the human-machine interaction mode is used to represent the mode of interaction between the vehicle and a user located outside the vehicle.

[0107] The interactive information projection module 604 is used to project interactive information corresponding to the human-computer interaction mode onto a first preset area on the vehicle, wherein the interactive information includes at least one scene parameter.

[0108] The selection information projection module 606 is used to project the selection information corresponding to the interactive information onto a second preset area located outside the vehicle, wherein the selection information includes at least one selection item.

[0109] The scene parameter determination module 608 is used to determine the target scene parameters corresponding to the human-computer interaction mode, wherein the target scene parameters are obtained by the user selecting at least one scene parameter through at least one target selection option;

[0110] The device control module 610 is used to control the target device based on the target scene parameters, wherein the target device is used to create the atmosphere of the scene in which the vehicle is currently located according to the target scene parameters.

[0111] Optionally, the device further includes: a preset posture determination module, configured to determine a target selection item corresponding to the preset posture from at least one selection item in response to receiving a preset posture made by a user in a third preset area located outside the vehicle, wherein the interval between the third preset area outside the vehicle and the second preset area outside the vehicle is less than a preset distance; and a scene parameter determination module, configured to determine a target scene parameter corresponding to the target selection item from at least one scene parameter.

[0112] Optionally, the device further includes: a preset position determination module, configured to determine a target selection item corresponding to the preset position from at least one selection item in response to receiving a preset position of the user in a second preset area; and a scene parameter determination module, configured to determine a target scene parameter corresponding to the target selection item from at least one scene parameter.

[0113] Optionally, the mode activation module 602 includes: a first mode activation module, used to activate a first preset mode of the vehicle in response to receiving a preset gesture from the user, wherein the first preset mode is a mode passively triggered by the user.

[0114] Optionally, the mode activation module 602 includes: a second mode activation module, used to activate a second preset mode of the vehicle in response to receiving a first instruction from the terminal, wherein the second preset mode is a single-person interaction mode actively triggered by the user.

[0115] Optionally, the mode activation module 602 includes: a third mode activation module, used to activate a third preset mode of the vehicle in response to receiving a second instruction from the terminal, wherein the third preset mode is a multi-user interactive mode actively triggered by the user.

[0116] Optionally, the device control module 610 includes: a light acquisition module for acquiring current light information of the scene where the vehicle is currently located; and an auxiliary lighting device control module for controlling the auxiliary lighting device based on the current light information and preset light information.

[0117] Optionally, the auxiliary lighting equipment control module includes: an equipment activation unit for activating the auxiliary lighting equipment when the current light information is less than the preset light information; and an equipment deactivation unit for disabling the auxiliary lighting equipment when the current light information is greater than or equal to the preset light information.

[0118] Example 3

[0119] According to an embodiment of the present invention, a vehicle is also provided, including one or more processors and a storage device, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to perform the above-described human-machine interaction method for the vehicle.

[0120] Example 4

[0121] According to an embodiment of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein, when the program is executed, it controls the device where the computer-readable storage medium is located to perform the above-described human-machine interaction method for a vehicle.

[0122] Example 5

[0123] According to an embodiment of the present invention, a processor is also provided, which is used to run a program, wherein the program executes the above-described human-machine interaction method for vehicles when it runs.

[0124] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0125] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0126] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0127] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0128] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0129] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0130] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A human-computer interaction method for a vehicle, characterized in that, include: Activate the vehicle's human-machine interaction mode, wherein the human-machine interaction mode is used to represent the mode of interaction between the vehicle and a user located outside the vehicle; The interactive information corresponding to the human-computer interaction mode is projected onto a first preset area on the vehicle, wherein the interactive information includes at least one scene parameter; The selection information corresponding to the interactive information is projected onto a second preset area located outside the vehicle, wherein the selection information includes at least one selection item; Determine the target scene parameters corresponding to the human-computer interaction mode, wherein the target scene parameters are obtained by the user selecting the at least one scene parameter through the target selection option among the at least one selection options; The target device is controlled based on the target scene parameters, wherein the target device is used to create the atmosphere of the scene in which the vehicle is currently located according to the target scene parameters; The method further includes: In response to receiving a preset gesture made by the user in a third preset area located outside the vehicle, the target selection item corresponding to the preset gesture is determined from the at least one selection item, wherein the interval between the third preset area outside the vehicle and the second preset area outside the vehicle is less than a preset distance. The target scene parameter corresponding to the target selection item is determined from the at least one scene parameter; The method further includes: In response to receiving a preset location of the user in the second preset area, the target selection item corresponding to the preset location is determined from the at least one selection item; The target scene parameter corresponding to the target selection item is determined from the at least one scene parameter.

2. The human-computer interaction method for vehicles according to claim 1, characterized in that, The human-machine interaction mode includes: a first preset mode, which activates the vehicle's human-machine interaction mode, including: In response to receiving the user's preset gesture, the vehicle's first preset mode is activated, wherein the first preset mode is a mode passively triggered by the user.

3. The human-computer interaction method for vehicles according to claim 1, characterized in that, The human-machine interaction mode includes: a second preset mode, and a human-machine interaction mode for starting the vehicle, including: In response to receiving a first instruction from the terminal, the second preset mode of the vehicle is activated, wherein the second preset mode is a single-person interaction mode actively triggered by the user.

4. The human-computer interaction method for vehicles according to claim 1, characterized in that, The human-machine interaction mode includes: a third preset mode, which activates the vehicle's human-machine interaction mode, including: In response to receiving a second instruction from the terminal, the third preset mode of the vehicle is activated, wherein the third preset mode is a multi-user interaction mode actively triggered by the user.

5. The human-computer interaction method for vehicles according to claim 1, characterized in that, The target device includes: auxiliary lighting equipment, which drives the target device based on the target scene parameters, including: Obtain the current lighting information of the scene in which the vehicle is currently located; The auxiliary lighting equipment is controlled based on the current light information and the preset light information.

6. The human-computer interaction method for a vehicle according to claim 5, characterized in that, Controlling the auxiliary lighting device based on the current light information and preset light information includes: When the current light information is less than the preset light information, the auxiliary lighting device is turned on; If the current light information is greater than or equal to the preset light information, the auxiliary lighting device shall be prohibited from being turned on.

7. A non-volatile storage medium, characterized in that, The non-volatile storage medium includes a stored program, wherein, when the program is executed, it controls the execution of the human-machine interaction method of the vehicle according to any one of claims 1 to 6 in the processor of the device.

8. A vehicle, characterized in that, include: One or more processors; Storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors perform the human-machine interaction method for the vehicle as described in any one of claims 1 to 6.

Images