User interaction method and device of vehicle-mounted intelligent cabin, vehicle and medium

Abstract

The invention relates to a user interaction method and device for a vehicle-mounted intelligent cabin, a vehicle and a medium, and the method comprises the steps: obtaining the rear-row user information of a current vehicle; capturing face images of a plurality of users from the back-row user information, and judging whether a user meeting a preset child age condition exists in the plurality of users according to the face images; and extracting feature data meeting a preset condition from the face image, matching a 3D cartoon image corresponding to the user by using the feature data, generating game content of the current age group of the user, and projecting the game content to the target display area to execute at least one game action interacting with the 3D cartoon image. According to the method, the facial expression of the child is obtained through the vehicle-mounted camera, the facial expression action of the child is extracted by using the image recognition technology, and the cartoon version image of the facial expression of the child is presented on the projection in combination with the 3D technology, so that the purpose of interaction with the child is achieved, the interactivity and interestingness are improved, and the riding experience of the child is improved.

Description

Technical Field

[0001] This application relates to the field of smart cockpit child facial recognition image and game interaction technology, and in particular to a user interaction method, device, vehicle and medium for an in-vehicle smart cockpit. Background Technology

[0002] In recent years, with the rapid development of AI technology in smart cockpits and the introduction of entertainment-related applications in cockpit products, the interactivity between people and vehicles has been greatly enriched, and the fun of driving and riding in the car has been enhanced.

[0003] In related technologies, in-vehicle entertainment systems for children's interaction are basically one-way content playback, such as playing cartoons, nursery rhymes, and stories.

[0004] However, the relevant technologies lack two-way interaction with children, making children easily bored while riding in the car. The cabin is mainly based on the entertainment and interactive experience of the driver and passengers, lacking entertainment and interactive applications based on children's companionship. Children do not experience much fun in the cabin system, affecting their user experience choices, and this needs to be improved urgently. Summary of the Invention

[0005] This application provides a user interaction method, device, vehicle, and medium for an in-vehicle smart cockpit to address issues such as the lack of two-way interaction with children in related technologies, children easily feeling bored while riding in a car, the cockpit mainly focusing on the entertainment and interactive experience of drivers and passengers, lacking entertainment and interactive applications based on children's companionship, and children's poor experience of fun in the cockpit system, which affects user experience choices.

[0006] The first aspect of this application provides a user interaction method for an in-vehicle intelligent cockpit, comprising the following steps: acquiring rear-seat user information of the current vehicle; capturing facial images of multiple users from the rear-seat user information, and determining whether there are users among the multiple users who meet a preset child age condition based on the facial images; if there are users among the multiple users who meet the preset child age condition, extracting feature data that meets the preset condition from the facial images, matching the feature data with a 3D cartoon character corresponding to the user, generating game content for the user's current age group based on the 3D cartoon character, and projecting the game content onto a target display area to perform at least one game action interacting with the 3D cartoon character, thereby generating a user interaction result.

[0007] Optionally, in one embodiment of this application, the step of projecting the game content onto a target display area to perform at least one game action interacting with the 3D comic character and generating a user interaction result includes: obtaining the user's touch point position, gesture trajectory, or body movement information on the target display area; and interacting the touch point position, gesture trajectory, or body movement information with the projection to perform at least one game action interacting with the 3D comic character and generating a user interaction result.

[0008] Optionally, in one embodiment of this application, after generating the user interaction result, the method further includes: obtaining the user's personalized needs; determining the user's interest type in the game based on the user interaction result and the personalized needs; and adjusting the content and difficulty of the game according to the interest type.

[0009] Optionally, in one embodiment of this application, the step of extracting feature data that meets preset conditions from the face image includes: identifying facial key points in the face image; determining the user's expression state based on the facial key points; and generating the feature data that meets the preset conditions based on the expression state.

[0010] Optionally, in one embodiment of this application, the step of matching the 3D cartoon image corresponding to the user using the feature data includes: analyzing the user's facial structure and feature point changes based on the feature data to determine the user's current age group; and generating the corresponding 3D cartoon image based on the user's current age group and facial expression state.

[0011] A second aspect of this application provides a user interaction device for an in-vehicle intelligent cockpit, comprising: an acquisition module for acquiring rear-seat user information of the current vehicle; an extraction module for capturing facial images of multiple users from the rear-seat user information and determining, based on the facial images, whether there is a user among the multiple users who meets a preset child age condition; and an interaction module for, if there is a user among the multiple users who meets the preset child age condition, extracting feature data that meets the preset condition from the facial images, matching the feature data with a 3D cartoon character corresponding to the user, generating game content for the user's current age group based on the 3D cartoon character, and projecting the game content onto a target display area to execute at least one game action interacting with the 3D cartoon character, thereby generating a user interaction result.

[0012] Optionally, in one embodiment of this application, the interaction module includes: an acquisition unit, used to acquire the user's touch point position, gesture trajectory, or body movement information on the target display area; and an execution unit, used to interact the touch point position, the gesture trajectory, or the body movement information with the projection to execute at least one game action interacting with the 3D cartoon character, and generate a user interaction result.

[0013] Optionally, in one embodiment of this application, it further includes: a demand acquisition module, used to acquire the user's personalized demand after generating the user interaction result; a determination module, used to determine the user's interest type in the game based on the user interaction result and the personalized demand; and an adjustment module, used to adjust the content and difficulty of the game according to the interest type.

[0014] Optionally, in one embodiment of this application, the extraction module includes: a recognition unit for recognizing facial key points in the face image; and a generation unit for determining the user's expression state based on the facial key points and generating feature data that meets preset conditions based on the expression state.

[0015] Optionally, in one embodiment of this application, the interaction module includes: an analysis unit, configured to analyze the user's facial structure and feature point changes based on the feature data to determine the user's current age group; and an image generation unit, configured to generate a corresponding 3D cartoon image based on the user's current age group and expression state.

[0016] A third aspect of this application provides an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. The processor executes the program to implement the user interaction method of the in-vehicle smart cockpit as described in the above embodiments.

[0017] A fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described user interaction method for an in-vehicle intelligent cockpit.

[0018] This application embodiment can acquire children's facial expressions using an in-vehicle camera, extract the children's facial expression movements using image recognition technology, and combine 3D technology to present a cartoon version of the children's facial expressions on a projection, thereby achieving interaction with children, improving interactivity and fun, and enhancing children's riding experience. This solves the problems of related technologies lacking two-way interaction with children, children easily feeling bored while riding, the cabin primarily focusing on the entertainment and interaction experience of drivers and passengers, lacking entertainment and interaction applications based on child companionship, and children's poor experience of fun in the cabin system, affecting user experience choices.

[0019] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0020] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0021] Figure 1 This is a flowchart illustrating a user interaction method for an in-vehicle intelligent cockpit according to an embodiment of this application;

[0022] Figure 2 This is an overall flowchart of a user interaction method for an in-vehicle smart cockpit according to an embodiment of this application;

[0023] Figure 3 This is a schematic diagram of the structure of a user interaction device for an in-vehicle intelligent cockpit according to an embodiment of this application;

[0024] Figure 4 This is a structural schematic diagram of a vehicle provided according to an embodiment of this application. Detailed Implementation

[0025] The embodiments of this application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0026] The following description, with reference to the accompanying drawings, outlines a user interaction method, device, vehicle, and medium for an in-vehicle smart cockpit according to embodiments of this application. Addressing the issues mentioned in the background art, such as the lack of two-way interaction with children, children easily becoming bored while traveling, the cockpit primarily focusing on entertainment for drivers and passengers and lacking entertainment applications for children's companionship, resulting in poor user experience and negatively impacting children's choice of experience, this application provides a user interaction method for an in-vehicle smart cockpit. In this method, a child's facial expressions can be captured using an in-vehicle camera, and image recognition technology can be used to extract the child's facial expression movements. Combined with 3D technology, a cartoon version of the child's facial expressions is projected onto a screen to achieve interaction with the child, improving interactivity and fun, and enhancing the child's travel experience. This solves the problems of related technologies lacking two-way interaction with children, children easily becoming bored while traveling, the cockpit primarily focusing on entertainment for drivers and passengers and lacking entertainment applications for children's companionship, resulting in poor user experience and negatively impacting children's choice of experience.

[0027] Specifically, Figure 1This is a flowchart illustrating a user interaction method for an in-vehicle smart cockpit provided in an embodiment of this application.

[0028] like Figure 1 As shown, the user interaction method of this in-vehicle intelligent cockpit includes the following steps:

[0029] In step S101, the rear passenger information of the current vehicle is obtained.

[0030] It is understood that in the embodiments of this application, an OMS (Occupancy Monitoring System) camera can be installed inside the vehicle, typically in the center of the roof, with a field of view of 150° × 80°, to collect information on rear passengers.

[0031] This application embodiment can obtain the rear-seat user information of the current vehicle, thereby providing support for subsequently obtaining children's facial expressions and improving the intelligence of children's interaction.

[0032] In step S102, the facial images of users are captured from the user information in the back row, and it is determined from the facial images whether there are any users among the multiple users who meet the preset child age condition.

[0033] It is understood that the users with the preset child age condition in this application embodiment can be children aged 1-12.

[0034] In this embodiment, the facial images of children can be captured from the information of rear passengers, and the facial images can be used to determine whether there are users among multiple users who meet certain age conditions. For example, if a user is identified as 8 years old and another user is identified as 20 years old based on the facial images, it can be determined that there are users among multiple users who meet certain age conditions, thereby providing a basis for achieving the purpose of interaction with children and enhancing the fun.

[0035] It should be noted that the preset age conditions for children can be set by those skilled in the art according to the actual situation, and no specific restrictions are imposed here.

[0036] Optionally, in one embodiment of this application, extracting feature data that meets preset conditions from a face image includes: identifying facial key points in the face image; determining the user's expression state based on the facial key points; and generating feature data that meets preset conditions based on the expression state.

[0037] It is understood that the facial key points in the embodiments of this application can be eyes, mouth, eyebrows, etc.

[0038] In actual implementation, this application embodiment can identify facial key points in the captured child's face image, determine the child's expression state based on the facial key points, and perform expression recognition algorithm (cheek lifting) + (corner of mouth stretching) based on the child's different expressions (happy, laughing, funny face, etc.) to identify feature information, generate feature data that meets certain conditions, and transmit the identified feature data to the cockpit 3D comic module based on interactive feedback.

[0039] This application embodiment can determine a child's facial expression state based on facial key points and generate feature data that meets certain conditions based on the expression state, thereby providing support for matching 3D cartoon characters, further enhancing the interactivity and fun of the game, and exhibiting high intelligence and practicality.

[0040] In step S103, if there is a user among the multiple users who meets the preset child age condition, feature data that meets the preset condition is extracted from the face image, the feature data is used to match the 3D cartoon image corresponding to the user, game content for the user's current age group is generated based on the 3D cartoon image, and the game content is projected onto the target display area to perform at least one game action that interacts with the 3D cartoon image, thereby generating user interaction results.

[0041] It is understood that the 3D cartoon characters in this application embodiment include, but are not limited to, boys, girls, toddlers, and cartoon characters; the target display area can be a sunroof, rear sunshade, or car window; the feature data that meets the preset conditions in this application embodiment can be data after feature information recognition based on different facial expressions of children.

[0042] Specifically, in this application embodiment, when a user among multiple users meets certain age criteria, feature data meeting certain conditions is extracted from facial images. For example, image recognition technology can be used to extract facial expressions and actions of children. For instance, when an 8-year-old child is identified, feature data is extracted from the 8-year-old child's facial image, and this feature data is used to match a corresponding 3D cartoon character, including boys, girls, toddlers, and cartoon characters, along with various interactive expressions such as laughing, making faces, and being angry. The feature data from facial expression recognition is then combined for 3D rendering and output. Based on the 3D cartoon character and the user information identified by the facial recognition module, game content suitable for the child's current age group is generated, and the generated game content image is projected onto the sunroof, rear sunshade, or window for display. This application offers multiple options and can be configured according to vehicle characteristics and user needs, displaying the content and providing feedback on the child's touch point position to the game module. This application can execute at least one game action interacting with the 3D cartoon character, generating user interaction results, i.e., generating children's game interaction results, and can provide feedback on the child's touch point position to the game module.

[0043] For example, the game in this embodiment could be: a child touching an animal image on a projected screen triggers a 3D anatomical model display; connecting number balloons via touch controls forms a valid equation; the calculation result is verified in real time; and the projected light spot moves in sync with the child's touch and clicks to the rhythm of the music. This solution achieves real-time interaction through multi-sensor fusion and a low-latency communication protocol. Projection calibration requires quadratic surface fitting based on the screen curvature parameters. A modular design is recommended to facilitate adaptation to different sizes of sunroofs and car window structures.

[0044] This application embodiment improves interactivity and fun, and enhances children's riding experience by changing the in-vehicle entertainment system's mode from one-way output of content to children to two-way interaction by combining the child's age and facial expressions to select suitable games.

[0045] Optionally, in one embodiment of this application, matching a 3D cartoon image corresponding to a child using feature data includes: analyzing the user's facial structure and feature point changes based on feature data to determine the user's current age group; and generating a corresponding 3D cartoon image based on the user's current age group and facial expression state.

[0046] It is understood that the current age range of the user in this application embodiment can be 1-3 years old, 4-5 years old, or 7-12 years old.

[0047] For example, embodiments of this application can analyze changes in a child's facial structure and feature points based on feature data to determine the current age group of a child aged 1-3, 4-5, or 7-12, and generate a corresponding 3D cartoon character based on the child's current age group and expression state.

[0048] This application embodiment can achieve accurate age classification through facial feature analysis, and at the same time enhance the interactivity and fun of the game by using 3D cartoon characters as the main characters.

[0049] Optionally, in one embodiment of this application, the game content is projected onto a target display area to perform at least one game action that interacts with a 3D comic character, generating a user interaction result, including: obtaining the user's touch point position, gesture trajectory, or body movement information on the target display area; and interacting the touch point position, gesture trajectory, or body movement information with the projection to perform at least one game action that interacts with a 3D comic character, generating a user interaction result.

[0050] It is understood that the embodiments of this application can incorporate various interactive effects into the projection display module, such as interactive gestures with the projection, which will further enhance children's fun experience.

[0051] In this embodiment, the system can acquire the location of a child's touch point, gesture trajectory, or body movement information on the target display area, and interact with the projection to execute at least one game action interacting with a 3D cartoon character, generating a child's game interaction result.

[0052] For example, for 1-3 year olds, small dots that follow the light are generated, which children can grab with their hands. When they grab them, they gather together, and when they release them, they scatter. For 4-5 year olds, there are small dots that cut a watermelon. Then, the robot image can also be selected according to the child's gestures, such as: robot, Ultraman, and small animals. For 4-6 year olds, there are single-point touch color recognition games that guide children to try to classify items of different colors or select specific colors from many colors. For 7-12 year olds, there are multi-point touch + gesture control educational games, such as connecting the same animal patterns together using a touchpad.

[0053] This application embodiment can interact with the projection using touch point location, gesture trajectory, or body movement information to perform at least one game action that interacts with a 3D cartoon character, thereby exercising children's memory and observation skills, and the interactive effect will further enhance children's fun experience.

[0054] Optionally, in one embodiment of this application, after generating user interaction, the method further includes: obtaining the user's personalized needs; determining the user's interest type in the game based on the user interaction results and the personalized needs; and adjusting the game content and difficulty according to the interest type.

[0055] In actual implementation, the embodiments of this application can determine the child's personalized needs based on the child's age, gender, and known interests. Based on the child's game interaction results, the child's interest type in the game is determined according to the personalized needs, such as music games, math games, and spatial games. The content and difficulty of the game are adjusted according to the interest type to ensure that it always fits the child's developmental stage and preferences.

[0056] This application embodiment can better match children's cognitive level and developmental stage by customizing game content, providing diversified services according to interest types, improving interactivity and fun, and enhancing children's riding experience.

[0057] Specifically, it can be combined with Figure 2 As shown, the working principle of the user interaction method of the in-vehicle intelligent cockpit in this application embodiment is explained in detail with a specific embodiment.

[0058] like Figure 2 As shown, embodiments of this application may include the following steps:

[0059] Step S201: Collect images of children in the back row.

[0060] Step S202: Identify the child's age and facial expression.

[0061] Step S203: Generate facial feature values ​​for children.

[0062] Step S204: Output user characteristic information.

[0063] Step S205: Generate a 3D cartoon character.

[0064] Step S206: Generate games suitable for the appropriate age group.

[0065] Step S207: Synthesize action interaction.

[0066] Step S208: Projection display.

[0067] Step S209: Projection touch data acquisition.

[0068] The user interaction method for an in-vehicle smart cockpit proposed in this application can acquire children's facial expressions through an in-vehicle camera, extract children's facial expression movements using image recognition technology, and combine 3D technology to present a cartoon version of the children's facial expressions on a projection, thereby achieving interaction with children, improving interactivity and fun, and enhancing children's riding experience. This solves the problems of related technologies lacking two-way interaction with children, children easily feeling bored while riding in a car, and cockpits primarily focusing on the entertainment and interaction experience of drivers and passengers, lacking entertainment and interaction applications based on children's companionship, resulting in poor fun for children in the cockpit system and affecting user experience choices.

[0069] Next, the user interaction device for an in-vehicle intelligent cockpit proposed according to an embodiment of this application is described with reference to the accompanying drawings.

[0070] Figure 3 This is a schematic diagram of the user interaction device of the in-vehicle intelligent cockpit according to an embodiment of this application.

[0071] like Figure 3 As shown, the user interaction device 10 of the in-vehicle intelligent cockpit includes: an acquisition module 100, an extraction module 200, and an interaction module 300.

[0072] Specifically, module 100 acquires the rear-seat user information of the current vehicle;

[0073] The extraction module 200 is used to capture the facial images of users from the user information in the back row, and to determine whether there are users among the multiple users who meet the preset child age conditions based on the facial images;

[0074] The interaction module 300 is used to extract feature data that meets the preset conditions from the facial image when there are users among multiple users who meet the preset age conditions, use the feature data to match the 3D cartoon image corresponding to the user, generate game content for the user's current age group based on the 3D cartoon image, and project the game content onto the target display area to perform at least one game action that interacts with the 3D cartoon image, thereby generating user interaction results.

[0075] Optionally, in one embodiment of this application, the interaction module 300 includes:

[0076] The acquisition unit is used to acquire the user's touch point location, gesture trajectory, or body movement information on the target display area.

[0077] An execution unit is used to interact with the projection by inputting touch point position, gesture trajectory or body movement information to perform at least one game action that interacts with a 3D cartoon character and generate user interaction results.

[0078] Optionally, in one embodiment of this application, the user interaction device 10 of the in-vehicle smart cockpit further includes: a demand acquisition module, a determination module, and an adjustment module.

[0079] The requirement acquisition module is used to acquire users' personalized requirements after generating user interaction results.

[0080] The determination module is used to determine the user's interest type in the game based on the user interaction results and personalized needs.

[0081] The adjustment module is used to adjust the game's content and difficulty based on user interests.

[0082] Optionally, in one embodiment of this application, the extraction module 200 includes an identification unit and a generation unit.

[0083] The recognition unit is used to identify facial key points in a face image.

[0084] The generation unit is used to determine the user's facial expression state based on facial key points and generate feature data that meets preset conditions based on the facial expression state.

[0085] Optionally, in one embodiment of this application, the interaction module 300 includes an analysis unit and an image generation unit.

[0086] The analysis unit is used to analyze changes in a user's facial structure and feature points based on feature data to determine the user's current age group.

[0087] The character generation unit is used to generate a corresponding 3D cartoon character based on the user's current age group and facial expression.

[0088] It should be noted that the foregoing explanation of the user interaction method embodiment for the in-vehicle intelligent cockpit also applies to the user interaction device of the in-vehicle intelligent cockpit in this embodiment, and will not be repeated here.

[0089] The user interaction device for an in-vehicle smart cockpit proposed in this application can acquire children's facial expressions through an in-vehicle camera, extract children's facial expression movements using image recognition technology, and combine 3D technology to present a cartoon version of the children's facial expressions on a projection, thereby achieving interaction with children, improving interactivity and fun, and enhancing children's riding experience. This solves the problems of related technologies lacking two-way interaction with children, children easily feeling bored while riding in a car, the cockpit primarily focusing on the entertainment and interaction experience of drivers and passengers, lacking entertainment and interaction applications based on children's companionship, and children's poor experience of fun in the cockpit system, thus affecting user experience choices.

[0090] Figure 4 A schematic diagram of the structure of a vehicle provided in an embodiment of this application. The vehicle may include:

[0091] The memory 401, the processor 402, and the computer program stored on the memory 401 and capable of running on the processor 402.

[0092] When the processor 402 executes the program, it implements the user interaction method of the in-vehicle intelligent cockpit provided in the above embodiments.

[0093] Furthermore, the vehicle also includes:

[0094] Communication interface 403 is used for communication between memory 401 and processor 402.

[0095] The memory 401 is used to store computer programs that can run on the processor 402.

[0096] The memory 401 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0097] If the memory 401, processor 402, and communication interface 403 are implemented independently, then the communication interface 403, memory 401, and processor 402 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be divided into address buses, data buses, control buses, etc. For ease of representation, Figure 4 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0098] Optionally, in a specific implementation, if the memory 401, processor 402, and communication interface 403 are integrated on a single chip, then the memory 401, processor 402, and communication interface 403 can communicate with each other through an internal interface.

[0099] Processor 402 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0100] This embodiment also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described user interaction method for an in-vehicle intelligent cockpit.

[0101] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0102] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0103] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0104] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). In addition, computer-readable media can even be paper or other suitable media on which programs can be printed, because programs can be obtained electronically by optically scanning paper or other media, then editing, interpreting or otherwise processing them as necessary, and then storing them in computer memory.

[0105] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0106] Those skilled in the art will understand that all or part of the steps of the methods described in the above embodiments can be implemented by a program instructing related hardware, and the program can be stored in a computer-readable storage medium. When executed, the program includes one or a combination of the steps of the method embodiments.

[0107] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0108] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A user interaction method for an in-vehicle intelligent cockpit, characterized in that, The following steps are involved: Obtain information about the rear-seat occupants of the current vehicle; Capture facial images of multiple users from the back row user information, and determine whether there are any users among the multiple users who meet the preset child age condition based on the facial images; If among the multiple users there is a user who meets the preset child age condition, then feature data that meets the preset condition is extracted from the facial image, the feature data is used to match the 3D cartoon image corresponding to the user, game content for the user's current age group is generated based on the 3D cartoon image, and the game content is projected onto the target display area to perform at least one game action that interacts with the 3D cartoon image, thereby generating a user interaction result.

2. The method according to claim 1, characterized in that, The step of projecting the game content onto the target display area to execute at least one game action interacting with the 3D cartoon character and generating user interaction results includes: Obtain the user's touch point location, gesture trajectory, or body movement information on the target display area; The touch point location, gesture trajectory, or body movement information are interacted with the projection to execute at least one game action that interacts with the 3D cartoon character, generating user interaction results.

3. The method according to claim 1, characterized in that, After generating the user interaction result, the process also includes: Obtain the user's personalized needs; Based on the user interaction results, the user's interest type in the game is determined according to the personalized needs; Adjust the content and difficulty of the game according to the stated interest type.

4. The method according to claim 1, characterized in that, The step of extracting feature data that meets preset conditions from the face image includes: Identify key facial features in the face image; The user's facial expression state is determined based on the facial key points, and feature data that meets the preset conditions is generated based on the facial expression state.

5. The method according to claim 4, characterized in that, The process of matching the 3D cartoon character corresponding to the user using the feature data includes: Based on the aforementioned feature data, the changes in the user's facial structure and feature points are analyzed to determine the user's current age group; The corresponding 3D cartoon character is generated based on the user's current age group and facial expression.

6. A user interaction device for an in-vehicle intelligent cockpit, characterized in that, include: The acquisition module is used to acquire information about the rear-seat occupants of the current vehicle. The extraction module is used to capture facial images of multiple users from the back row user information, and determine whether there are any users among the multiple users who meet the preset child age condition based on the facial images; The interaction module is used to extract feature data that meets the preset conditions from the facial image when there is a user among the multiple users who meets the preset child age condition, use the feature data to match the 3D cartoon image corresponding to the user, generate game content for the user's current age group based on the 3D cartoon image, and project the game content to the target display area to perform at least one game action that interacts with the 3D cartoon image, thereby generating a user interaction result.

7. The apparatus according to claim 6, characterized in that, The interactive modules include: The acquisition unit is used to acquire the user's touch point position, gesture trajectory, or body movement information on the target display area; An execution unit is used to interact with the projection by the touch point position, the gesture trajectory, or the body movement information to execute at least one game action that interacts with the 3D cartoon character and generate user interaction results.

8. The apparatus according to claim 6, characterized in that, Also includes: The requirement acquisition module is used to acquire the user's personalized requirements after generating the user interaction results; A determination module is used to determine the user's interest type in the game based on the user interaction results and according to the personalized needs; An adjustment module is used to adjust the content and difficulty of the game according to the interest type.

9. A vehicle, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the user interaction method of the in-vehicle intelligent cockpit as described in any one of claims 1-5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to implement the user interaction method of the in-vehicle smart cockpit as described in any one of claims 1-5.

Images