Human-vehicle interaction methods, devices, systems, computer devices, and storage media

Abstract

This disclosure relates to a method, apparatus, system, computer device, and storage medium for human-vehicle interaction. It pertains to human-machine interaction technology for intelligent vehicles, addressing the problems of poor interactivity, fixed and monotonous implementation methods, and negative impacts on user experience associated with interactive systems such as welcome lights. The method includes: acquiring and verifying the identity information of a person approaching the vehicle; if the identity information is verified, acquiring the person's interaction strategy; and executing the interaction strategy. The technical solution provided by this disclosure is applicable to intelligent vehicle interaction systems, enabling flexible and personalized human-vehicle interaction.

Description

Technical Field

[0001] This disclosure relates to human-machine interaction technology for intelligent vehicles, and more particularly to a human-vehicle interaction method, device, system, computer device, and storage medium. Background Technology

[0002] As automobiles become increasingly intelligent, their functions are becoming more diverse. Many cars are equipped with various human-machine interaction systems, such as in-car infotainment systems, voice control, and welcome light systems, which greatly contribute to enriching vehicle functionality, enhancing the driving experience, and improving safety. Welcome light systems typically use ground projection lights or digital headlights. The basic working principle of this type of system is: after the vehicle is unlocked, the body control module or a dedicated lighting controller receives a signal and drives the projection device to illuminate a preset, fixed pattern, commonly such as brand logos, model names, or so-called "welcome light carpet" effects.

[0003] Welcome light systems still have several obvious shortcomings in practical applications, such as only being able to illuminate fixed patterns and only activating the system in response to vehicle unlocking signals. Their implementation is simplistic and fixed, lacking user interaction and failing to adapt to user needs, thus impacting the user experience. Summary of the Invention

[0004] To overcome the problems existing in related technologies, this disclosure provides a method, apparatus, system, computer device, and storage medium for human-vehicle interaction. By actively acquiring and verifying the identity of personnel approaching the vehicle, and executing corresponding interaction strategies based on the verified personnel identity, it solves the problems of poor interactivity, fixed and monotonous implementation methods, and negative impact on user experience of interactive systems such as welcome lights. It achieves flexible and personalized human-vehicle interaction, thereby improving the user experience.

[0005] According to a first aspect of the present disclosure, a human-vehicle interaction method is provided, comprising: Obtain and verify the identity information of the person approaching the vehicle; If the identity information is verified, obtain the person's interaction strategy; Execute the aforementioned interaction strategy.

[0006] Furthermore, the step of obtaining and verifying the identity information of the person approaching the vehicle includes: The system is activated when it detects personnel entering a pre-defined detection area. Collect one or more of the following biometric information of the person: Facial information, voice information, and fingerprint information; Extract biological features from the biometric information to generate the identity information; The identity information is compared with at least one preset authentication user feature template, each of which contains at least one biological feature of an authenticated user; If a user authentication feature template that matches the identity information exists, the person is determined to have passed authentication.

[0007] Furthermore, after the step of comparing the identity information with at least one preset authenticated user feature template, the method further includes: If no matching user signature template exists for the identity information, the system confirms the user's identity verification has failed and remains silent.

[0008] Furthermore, the step of obtaining the interaction strategy of the authenticated user when the identity information matches a preset authenticated user includes: If a matching authentication user feature template is obtained through comparison, the corresponding authenticated user is acquired. Obtain the interaction policy of the authenticated user, wherein the interaction policy includes at least one or more of the following: Exterior projection strategy, window projection strategy, headlight control strategy, sound strategy, unlocking strategy. The vehicle exterior projection strategy includes at least projection device information and projection content; the vehicle window projection strategy includes at least projection device information and projection content; the sound strategy includes at least sound content and playback device information; and the unlocking strategy includes at least unlocking operation or further verification operation. Furthermore, the interaction strategy includes an exterior projection strategy, which at least includes projection device information and projection content. The steps for executing the interaction strategy include: Obtain the projected content; The corresponding projection device is activated based on the projection device information, and the projection content is projected onto the target location.

[0009] Furthermore, the step of projecting the projection content to the target location includes: The system acquires real-time ambient light detection data from an ambient light sensor, adjusts the projection parameters of the projection device, and projects the data onto the target location.

[0010] According to a second aspect of the embodiments of this disclosure, a human-vehicle interaction device is provided, comprising: The identity verification module is used to obtain and verify the identity information of people approaching the vehicle; The strategy acquisition module is used to acquire the interaction strategy of the person when the identity information is verified. The strategy execution module is used to execute the interaction strategy.

[0011] According to a third aspect of the embodiments of this disclosure, a human-vehicle interaction system is provided, including a storage unit, a sensing unit, a processing unit, and an execution unit; The processing unit is configured to collect information through the sensing unit, obtain the identity information of the person approaching the vehicle, verify the identity information of the person based on at least one authenticated user feature template stored in the storage unit, and, if the identity information passes the authentication, obtain the interaction strategy of the person from the storage unit and control the execution unit to execute the interaction strategy. The sensing unit includes at least one or more of the following modules: Low-power radar module, infrared imaging module, The sensing unit is used to acquire the identity information of people approaching the vehicle and / or ambient light detection information; The execution unit is used to execute the interaction strategy.

[0012] According to a fourth aspect of the embodiments of the present disclosure, a computer apparatus is provided, comprising: processor; Memory used to store processor-executable instructions; The processor is configured to execute the human-vehicle interaction method provided in the embodiments of this disclosure.

[0013] According to a fifth aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein instructions in the storage medium, when executed by a computer's processor, enable the computer to perform the human-vehicle interaction method provided by the embodiments of the present disclosure.

[0014] The technical solutions provided by the embodiments of this disclosure can include the following beneficial effects: acquiring and verifying the identity information of personnel approaching the vehicle; acquiring the interaction strategy of the personnel if the identity information passes the identity verification; and executing the interaction strategy. By actively acquiring and verifying the identity of personnel approaching the vehicle, and executing the corresponding interaction strategy according to the verified identity of the personnel, the problems of poor interactivity, fixed and single implementation methods, and negative impact on user experience of interactive systems such as welcome lights are solved, achieving flexible and personalized human-vehicle interaction and improving user experience.

[0015] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0016] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0017] Figure 1 This is a flowchart illustrating a human-vehicle interaction method according to an exemplary embodiment.

[0018] Figure 2 This is a flowchart illustrating yet another human-vehicle interaction method according to an exemplary embodiment.

[0019] Figure 3 This is a flowchart illustrating yet another human-vehicle interaction method according to an exemplary embodiment.

[0020] Figure 4 This is a flowchart illustrating yet another human-vehicle interaction method according to an exemplary embodiment.

[0021] Figure 5 This is a block diagram illustrating a human-vehicle interaction device according to an exemplary embodiment.

[0022] Figure 6 This is a block diagram illustrating a human-vehicle interaction system according to an exemplary embodiment.

[0023] Figure 7 This is a flowchart illustrating yet another human-vehicle interaction method according to an exemplary embodiment. Detailed Implementation

[0024] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0025] Welcome light systems and other vehicle-to-everything (V2X) interaction systems still have several significant shortcomings in practical applications. First, their functions are highly homogenized; the welcome effect is limited to fixed patterns preset by the manufacturer, failing to provide personalized display content based on different user identities, and thus failing to meet users' growing demand for personalized and emotional interaction. Second, the system's operating logic is passive and simplistic, merely responding to vehicle unlocking signals and lacking the ability to proactively identify user identities and engage in intelligent interaction. Furthermore, the system cannot distinguish between different users, resulting in a lack of differentiation and personalization in the welcome experience. Finally, it has poor environmental adaptability; in daylight or under strong light conditions, the projection brightness is insufficient and the clarity decreases, severely impacting the visibility of the welcome effect and the user experience.

[0026] To address the aforementioned issues, embodiments of this disclosure provide a method, apparatus, system, computer device, and storage medium for human-vehicle interaction. By actively acquiring and verifying the identity of personnel approaching the vehicle, and executing corresponding interaction strategies based on the verified personnel identity, this solves the problems of poor interactivity, fixed and monotonous implementation methods, and negative impacts on user experience associated with interactive systems such as welcome lights. It achieves flexible and personalized human-vehicle interaction, thereby enhancing the user experience.

[0027] An exemplary embodiment of this disclosure provides a human-vehicle interaction method, the process of which provides interactive services even when the user has not entered the vehicle is as follows: Figure 1 As shown, it includes: Step 101: Obtain and verify the identity information of the person approaching the vehicle.

[0028] In this step, the sensing unit monitors the environment around the vehicle. When a person approaches, the system starts collecting their information and identity details. The system then verifies the identity. If verification is successful, the person is a registered and authenticated user, and appropriate interaction can be provided. If verification fails, the person is not a registered and authenticated user, and the system remains silent.

[0029] Step 102: If the identity information is verified, obtain the person's interaction strategy.

[0030] In this embodiment, interaction policies for different users can be pre-configured. Specifically, this can be achieved by associating and storing the user information of authenticated users with interaction policies. Once the identity information is verified, the authenticated user is identified, and the corresponding interaction policy is obtained.

[0031] Step 103: Execute the interaction strategy.

[0032] In this step, the interaction strategy is implemented to provide interactive services to authenticated users.

[0033] By automatically detecting and identifying people approaching the vehicle, and providing corresponding interaction strategies after confirming that they are certified users, a customized execution plan for human-vehicle interaction has been realized, improving the user experience.

[0034] An exemplary embodiment of this disclosure also provides a human-vehicle interaction method, wherein the steps of obtaining and verifying the identity information of a person approaching the vehicle using this method include: Step 201: When a person is detected entering the preset detection area, the system is activated.

[0035] In this step, the system is activated when personnel are detected entering the detection area.

[0036] According to one exemplary embodiment, monitoring of the detection area is achieved in this step through a sensing unit. The sensing unit includes a low-power radar module, an infrared imaging module, and an ambient light sensor.

[0037] The low-power radar module includes ultra-wideband (UWB) radar or millimeter-wave radar. It monitors the detection area to detect approaching personnel, for example, within a 3-5 meter radius of the low-power radar module. The low-power radar module continues to operate when the vehicle is locked and in sleep mode. When the low-power radar module detects a user entering the preset detection area, it sends a signal to the vehicle domain controller, waking up the entire vehicle system and activating the sensing unit to collect biometric information.

[0038] Step 202: Collect the biometric information of the personnel.

[0039] In this step, one or more of the following biometric information of the person will be collected: Facial information, voice information, and fingerprint information.

[0040] According to one exemplary embodiment, the sensing unit includes an infrared imaging module for acquiring biological information. The infrared imaging module includes an infrared camera, a supplementary light, etc. The supplementary light adjusts the lighting conditions of the subject, and the infrared camera captures the image, eliminating the dependence on ambient visible light inherent in traditional visible light photography. Utilizing the characteristic of infrared light to penetrate everyday light interference, accurate capture of biological information of the subject can be achieved in bright midday light, low-light environments such as nighttime, or basements.

[0041] Basic biometric information is obtained by capturing images of a person's face, fingerprints, or palm prints using an infrared camera.

[0042] According to one exemplary embodiment, the sensing unit includes a sound acquisition device and a sound acquisition module. The sound acquisition device includes a microphone or microphone array, and the sound acquisition module acquires the sound information of a person entering the detection range through the sound acquisition device. The sound information can be used alone as biometric information, serving as a source of voiceprint features; it can also be combined with image information acquired by the infrared imaging module to constitute the person's biometric information, using sound as auxiliary information for facial or fingerprint information to construct a dual verification mechanism of sound and image, or as a supplementary means after image verification fails.

[0043] Step 203: Extract the biological features from the biometric information to generate the identity information.

[0044] This step uses facial image acquisition as an example of biometric information. The acquired facial image is first preprocessed, including grayscale conversion, noise filtering, and lighting compensation, to eliminate interfering information and ensure clear facial features. Then, a face detection algorithm is used to locate facial regions, such as the contours of facial features and the distribution of feature points. Next, a biometric feature extraction algorithm is used to convert the biometric information into biological features (specifically, biometric feature vectors). Finally, identity information containing these biological features is generated.

[0045] According to one exemplary implementation, a data structure for biometric vectors can be pre-configured.

[0046] Step 204: Compare the identity information with at least one preset authentication user feature template.

[0047] Each of the authenticated user feature templates contains at least one biological feature of an authenticated user. Biological features include, but are not limited to, the following: Facial features, fingerprint features, and voiceprint features.

[0048] According to one exemplary implementation, authentication user feature templates and corresponding interaction strategies for different users can be configured in advance.

[0049] For example, during the personalized content setup phase, authenticated users can access the welcome function settings interface via the in-vehicle central control screen or mobile app to sequentially complete facial information registration and bind interactive strategies such as projected content. This includes: 1. Facial Information Enrollment: The system guides users to complete facial information registration. Facing the external camera, the system uses infrared liveness detection technology to collect the user's facial feature points and converts them into an encrypted, authenticated user feature template, which is then stored in the vehicle's secure local storage area.

[0050] 2. Interactive Strategy Binding: Supports verified users to customize interactive strategies for their registered identities, such as welcome projection content. Welcome projection content includes one or more combinations of system preset patterns (such as stars and hearts), custom text (custom initials, nicknames, and welcome messages entered by the user), custom images (user-uploaded signature logos, simple drawings, or family photos), and dynamic effects (such as flashing, gradients, and scrolling appearance).

[0051] Step 205: If a user authentication feature template that matches the identity information exists, determine that the person has passed the identity verification.

[0052] In this step, if there is an authentication user feature template that matches the identity information, it indicates that the person is an authenticated user. After identity verification, the process of invoking and executing the subsequent interaction strategy is initiated.

[0053] Step 206: If no authentication user feature template matching the identity information exists, the system confirms that the identity verification of the person has failed and remains silent.

[0054] In this step, if no matching authentication user feature template exists, it indicates that the person is not an authenticated user and has not registered their identity in this vehicle. Therefore, the system remains silent and does not perform any further processing. In other words, there are no external lights indicating that the vehicle is not aware of anyone approaching, thus protecting privacy and avoiding disturbance to strangers.

[0055] If the user subsequently unlocks the vehicle normally via physical key, smart key, or mobile phone Bluetooth / UWB, this unlocking action will trigger the system to execute the default welcome projection scheme (such as projecting the brand logo) to provide basic welcome feedback.

[0056] By detecting and identifying people approaching the vehicle, the system automatically completes identity authentication and directly invokes interaction strategies upon successful authentication. This enables convenient human-vehicle interaction outside the vehicle, significantly enhancing the user experience. Furthermore, the widespread availability of external infrared cameras and supplementary lighting in vehicles allows for identity verification based on facial or fingerprint images without incurring additional hardware costs.

[0057] An exemplary embodiment of this disclosure also provides a human-vehicle interaction method. Using this method, when the identity information matches a preset authenticated user, the process of obtaining the interaction strategy of the authenticated user is as follows: Figure 3 As shown, it includes: Step 301: If a matching authentication user feature template is obtained through comparison, the corresponding authenticated user is acquired.

[0058] If a matching authentication user feature template is found after comparison, the person is confirmed as an authenticated user.

[0059] Step 302: Obtain the interaction strategy of the authenticated user.

[0060] In this step, the interaction policy of the currently identified authenticated user is obtained based on the pre-configured association between authenticated users and interaction policies.

[0061] The interaction strategy includes at least one or more of the following: Exterior projection strategy, window projection strategy, headlight control strategy, sound strategy, unlocking strategy. The vehicle exterior projection strategy includes at least projection device information and projection content; the vehicle window projection strategy includes at least projection device information and projection content; the sound strategy includes at least sound content and playback device information; and the unlocking strategy includes at least an unlocking operation or a further verification operation.

[0062] According to one exemplary implementation, the projection device information of the vehicle window projection strategy includes the projection device and the projection position, wherein the projection position includes vehicle window information. Based on the user's location, the corresponding vehicle window can be triggered as the projection location. The vehicle window projection strategy can also be implemented based on a self-illuminating vehicle window solution, configuring a vehicle window with an integrated display layer (e.g., a flexible transparent display panel) to directly display the projected content on the vehicle window glass.

[0063] According to one exemplary implementation, the playback device information in the sound strategy can point to an audio device inside or outside the vehicle, such as an external directional sound device, to play sound content (which can be personalized voice information customized for the user), further enhancing the exclusive experience of human-vehicle interaction.

[0064] According to one exemplary implementation, the interaction strategy includes an unlocking strategy. The vehicle can be unlocked directly upon confirming that the person approaching the vehicle is an authenticated user, or further verification operations can be initiated (e.g., requiring the user to indicate unlocking with voice, verifying the voice and the content of the instruction).

[0065] An exemplary embodiment of this disclosure also provides a human-vehicle interaction method, wherein the interaction strategy includes an external projection strategy, the external projection strategy including at least projection device information and projection content, and the process of executing the external projection interaction strategy is as follows: Figure 4 As shown, it includes: Step 401: Obtain the projected content.

[0066] In this step, the projected content is a welcome projection customized by the verified user. The content includes one or more combinations of system preset patterns (such as stars and hearts), custom text (custom initials, nicknames, and welcome messages entered by the user), custom images (signature logos, simple drawings, or family photos uploaded by the user), and dynamic effects (such as flashing, fading, and scrolling).

[0067] Step 402: Activate the corresponding projection device according to the projection device information and project the content to the target location.

[0068] In this step, real-time ambient light detection data fed back by the ambient light sensor is obtained, the projection parameters of the projection device are adjusted, and the projection is projected onto the target location to achieve adaptive adjustment of its projection parameters according to ambient light conditions.

[0069] According to one exemplary implementation, the controller reads ambient brightness data from the ambient light sensor of the execution unit and dynamically adjusts the output power of the projection device based on the ambient brightness to ensure that the ground projection is clearly visible during the day and not glaring at night. The controller sends the final projection command to the projection device, projecting a customized welcome image onto the ground area on the side of the vehicle, which fades out after a period of time (e.g., 10 seconds).

[0070] An exemplary embodiment of this disclosure also provides a human-vehicle interaction device, the structure of which is as follows: Figure 5 As shown, it includes: The identity verification module 501 is used to obtain and verify the identity information of the person approaching the vehicle; The strategy acquisition module 502 is used to acquire the interaction strategy of the person when the identity information is verified. The strategy execution module 503 is used to execute the interaction strategy.

[0071] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0072] An exemplary embodiment of this disclosure also provides a human-vehicle interaction system, such as Figure 6 As shown, it includes a storage unit, a sensing unit, a processing unit, and an execution unit; The processing unit is configured to collect information through the sensing unit, obtain the identity information of the person approaching the vehicle, verify the identity information of the person based on at least one authenticated user feature template stored in the storage unit, and, if the identity information passes the authentication, obtain the interaction strategy of the person from the storage unit and control the execution unit to execute the interaction strategy. The sensing unit includes at least one or more of the following modules: Low-power radar module, infrared imaging module, The sensing unit is used to acquire the identity information of people approaching the vehicle and / or ambient light detection information; The execution unit is used to execute the interaction strategy.

[0073] According to one exemplary embodiment, the sensing unit includes a low-power radar module (such as UWB radar or millimeter-wave radar) and an infrared imaging module for detecting a user's approach and acquiring facial images. The low-power radar module is located inside the vehicle's B-pillar or exterior rearview mirror, preferably using UWB radar or millimeter-wave radar. It can continuously monitor user approach behavior within a range of approximately 3 to 5 meters while the vehicle is in sleep mode, and its ultra-low power consumption ensures that it does not affect the vehicle's static battery level. The infrared imaging module includes an infrared camera and an infrared fill light, which activates after the radar wakes up the system to acquire user facial information. This infrared technology ensures that the system can still operate stably at night or in low-light environments and has resistance to everyday visible light interference.

[0074] The processing unit includes a vehicle domain controller, which runs facial recognition algorithms and logical judgment processes, and is responsible for communicating with other control modules in the vehicle; it also includes a feature extraction and matching module, which extracts and authenticates identity information.

[0075] The execution unit includes an exterior welcome projection light and an ambient light sensor, used to realize the projection function and to sense the ambient light intensity in real time, respectively. The welcome projection light preferably uses a DLP digital light processing projector or a high-resolution LED matrix headlight, capable of projecting complex graphics, text, and animations. The ambient light sensor detects the ambient light intensity in real time, providing an input signal for adjusting the projection brightness.

[0076] The storage unit securely stores the authentication user feature templates of registered users and the associated interactive strategies containing personalized projection schemes. The authentication user feature templates contain biometric vectors (such as facial feature vectors, voice feature vectors, etc.). Facial feature vectors are saved in encrypted form; the original facial image is not retained. Multiple authentication user feature templates for different users can be stored through an encrypted facial feature template library; multiple interactive strategies can be stored through a personalized projection scheme library.

[0077] The workflow of the human-vehicle interaction system is as follows: Figure 7 As shown: Step 701, Sensing and Wake-up: When the vehicle is in locked sleep mode, the low-power UWB radar continues to operate. When the radar detects a user entering the preset sensing area, it sends a signal to the vehicle domain controller to wake up the entire vehicle system and activate the infrared camera and auxiliary lights.

[0078] Step 702, Facial Image Acquisition and Processing: The infrared camera acquires the user's facial image. The vehicle domain controller preprocesses the image (including grayscale conversion, noise filtering, and light compensation), and uses a face detection algorithm to locate the facial region, thereby extracting biometric vectors for comparison as identity information.

[0079] Step 703, Identity Recognition and Matching: The extracted biometric vector is quickly compared with the locally stored library of authenticated user feature templates. If the similarity exceeds a preset threshold, authentication is successful, and the authenticated user's identity is identified.

[0080] Step 704, Personalized Content Mapping and Execution Judgment: If authentication is successful, the system immediately retrieves the interaction strategy uniquely bound to the user's identity from the storage module. Specifically, this could be a personalized projection scheme, which controls the projection lamp to execute the personalized projection.

[0081] If authentication fails, the system will not perform any projection operation and will remain silent. There will be no external light indicators on the vehicle, as if no one is aware of the approach, thus protecting privacy and avoiding disturbance to strangers. If the user subsequently unlocks the vehicle normally via physical key, smart key, or mobile phone Bluetooth / UWB, this unlocking action will trigger the system to execute the default welcome projection scheme (such as projecting the brand logo) to provide basic welcome feedback.

[0082] Step 705, Environmental Adaptation and Projection Execution: The controller reads data from the ambient light sensor and dynamically adjusts the output power of the projection lamp according to the ambient brightness, ensuring that the ground projection is clearly visible during the day and not glaring at night. The controller sends the final projection command to the projection lamp, projecting a customized welcome image onto the ground area on the side of the vehicle, which fades and turns off after a period of time (e.g., 10 seconds).

[0083] During the system's real-time phase, users can make personalized settings, as follows: During the personalized content setting phase, certified users can access the welcome function settings interface through the in-vehicle central control screen or mobile terminal APP to complete the facial information registration and projection content binding in sequence.

[0084] 1. Facial Information Enrollment: The system guides users to complete facial information registration. Facing the external camera, the system uses infrared liveness detection technology to collect the user's facial feature points and converts them into an encrypted, authenticated user feature template, which is then stored in the vehicle's secure local storage area.

[0085] 2. Projection Content Binding: Supports users to customize welcome projection content for their registered identities. The content includes one or more combinations of system preset patterns (such as stars and hearts), custom text (custom initials, nicknames, and welcome messages entered by the user), custom images (user-uploaded signature logos, simple drawings, or family photos), and dynamic effects (such as flashing, gradients, and scrolling appearance).

[0086] An exemplary embodiment of this disclosure also provides a computer apparatus, including: processor; Memory used to store processor-executable instructions; The processor is configured to execute the human-vehicle interaction method provided in the embodiments of this disclosure.

[0087] An exemplary embodiment of this disclosure also provides a non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a computer's processor, enable the computer to perform the human-vehicle interaction method provided in the embodiments of this disclosure.

[0088] This invention achieves truly personalized and seamless welcome lighting through a facial recognition-based exterior welcome light projection system, significantly enhancing user experience and emotional connection. The system proactively completes identity verification and projection content matching without user intervention, resulting in a smooth and natural process. While enhancing user exclusivity and a premium experience, it effectively improves the vehicle's market differentiation and the brand's technological image. Furthermore, the system only responds to successfully authenticated users, remaining silent to unauthorized personnel, avoiding invalid prompts and privacy risks, thus balancing intelligence and security.

[0089] Embodiments of this disclosure provide a method, apparatus, system, computer device, and storage medium for human-vehicle interaction. The method involves acquiring and verifying the identity information of a person approaching a vehicle; if the identity information is verified, acquiring the person's interaction strategy; and executing the interaction strategy. By actively acquiring and verifying the identity of a person approaching a vehicle, and executing the corresponding interaction strategy based on the verified identity, this method solves the problems of poor interactivity, fixed and monotonous implementation methods, and negative impacts on user experience associated with interactive systems such as welcome lights. It achieves flexible and personalized human-vehicle interaction, thereby improving the user experience.

[0090] First, the system can proactively identify the user's identity without any human intervention. Second, based on the identified user's identity information, it dynamically matches and projects personalized lighting content associated with that user. Furthermore, by providing a highly customized welcome experience, it significantly enhances the emotional connection and interaction quality between the user and the vehicle. Finally, the system can also sense the ambient lighting conditions in real time and automatically adjust the projection brightness accordingly, ensuring a clear and comfortable visual effect in different lighting environments.

[0091] By integrating biometric recognition, personalized configuration, and photoelectric control technologies, an intelligent welcome projection function is achieved. User identity is seamlessly authenticated through facial recognition, and pre-set personalized projection content is automatically matched based on the identity information. Combined with ambient light sensing, the projection brightness is adaptively adjusted, thereby enhancing the intelligence and personalized experience of the welcome scene, strengthening the emotional interaction between people and vehicles, and enhancing brand differentiation competitiveness.

[0092] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this disclosure can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented in hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the described functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this disclosure.

[0093] Furthermore, the term “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as advantageous compared to other aspects or designs. Rather, the use of the term “exemplary” is intended to present the concept in a concrete manner. As used herein, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from the context, “X applies A or B” is intended to mean any of the natural inclusive arrangements. That is, “X applies A or B” satisfies any of the foregoing instances if X applies A; X applies B; or both X applies A and B. Additionally, unless otherwise specified or clear from the context to refer to the singular form, the articles “a” and “an” as used in this application and the appended claims are generally understood to mean “one or more.”

[0094] Similarly, although this disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding this specification and the accompanying drawings. This disclosure includes all such modifications and variations and is limited only by the scope of the claims. In particular, with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terminology used to describe such components is intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if structurally not equivalent to the disclosed structure. Furthermore, although specific features of this disclosure may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations, as may be desired and advantageous to any given or particular application. Moreover, with regard to the terms “comprising,” “owning,” “having,” “having,” or variations thereof as used in the detailed description or claims, such terms are intended to be inclusive in a manner similar to the term “including.”

[0095] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0096] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for human-vehicle interaction, characterized in that, include: Obtain and verify the identity information of the person approaching the vehicle; If the identity information is verified, obtain the person's interaction strategy; Execute the aforementioned interaction strategy.

2. The human-vehicle interaction method according to claim 1, characterized in that, The steps for obtaining and verifying the identity information of the person approaching the vehicle include: The system is activated when it detects personnel entering a pre-defined detection area. Collect one or more of the following biometric information of the person: Facial information, voice information, and fingerprint information; Extract biological features from the biometric information to generate the identity information; The identity information is compared with at least one preset authentication user feature template, each of which contains at least one biological feature of an authenticated user; If a user authentication feature template that matches the identity information exists, the person is determined to have passed authentication.

3. The human-vehicle interaction method according to claim 2, characterized in that, After the step of comparing the identity information with at least one preset authenticated user feature template, the method further includes: If no matching user signature template exists for the identity information, the system confirms the user's identity verification has failed and remains silent.

4. The human-vehicle interaction method according to claim 1, characterized in that, The step of obtaining the interaction strategy of the authenticated user when the identity information matches the preset authenticated user includes: If a matching authentication user feature template is obtained through comparison, the corresponding authenticated user is acquired. Obtain the interaction policy of the authenticated user, wherein the interaction policy includes at least one or more of the following: Exterior projection strategy, window projection strategy, headlight control strategy, sound strategy, unlocking strategy. The vehicle exterior projection strategy includes at least projection device information and projection content; the vehicle window projection strategy includes at least projection device information and projection content; the sound strategy includes at least sound content and playback device information; and the unlocking strategy includes at least an unlocking operation or a further verification operation.

5. The human-vehicle interaction method according to claim 1, characterized in that, The interaction strategy includes an external vehicle projection strategy, which at least includes projection device information and projection content. The steps for executing the interaction strategy include: Obtain the projected content; The corresponding projection device is activated based on the projection device information, and the projection content is projected onto the target location.

6. The human-vehicle interaction method according to claim 5, characterized in that, The step of projecting the projection content to the target location includes: The system acquires real-time ambient light detection data from an ambient light sensor, adjusts the projection parameters of the projection device, and projects the data onto the target location.

7. A human-vehicle interaction device, characterized in that, include: The identity verification module is used to obtain and verify the identity information of people approaching the vehicle; The strategy acquisition module is used to acquire the interaction strategy of the person when the identity information is verified. The strategy execution module is used to execute the interaction strategy.

8. A human-vehicle interaction system, characterized in that, It includes storage units, sensing units, processing units, and execution units; The processing unit is configured to collect information through the sensing unit, obtain the identity information of the person approaching the vehicle, verify the identity information of the person based on at least one authenticated user feature template stored in the storage unit, and, if the identity information passes the authentication, obtain the interaction strategy of the person from the storage unit and control the execution unit to execute the interaction strategy. The sensing unit includes at least one or more of the following modules: Low-power radar module, infrared imaging module, The sensing unit is used to acquire the identity information of people approaching the vehicle and / or ambient light detection information; The execution unit is used to execute the interaction strategy.

9. A computer device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to perform the human-vehicle interaction method as described in any one of claims 1 to 6.

10. A non-transitory computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of a computer, the computer is able to perform the human-vehicle interaction method as described in any one of claims 1 to 6.

Images