Vehicle-mounted digital human display method, controller and vehicle

Abstract

The present disclosure relates to a vehicle-mounted digital human display method, a controller and a vehicle, and relates to the technical fields of intelligent cockpits and computers, and can display a complete digital human in linkage in an intelligent body and a display screen. The vehicle-mounted digital human display method comprises: displaying a head state of a digital human in an intelligent body on a vehicle; and displaying a trunk feature of the digital human in a target area in a display screen on the vehicle, wherein the intelligent body is detachably installed on a frame of the display screen, and the target area in the display screen is located on an extension line of a central axis of the intelligent body and adjacent to the frame where the intelligent body is located.

Description

Technical Field

[0001] This disclosure relates to the fields of intelligent cockpit and computer technology, specifically to an in-vehicle digital human display method, controller, and vehicle. Background Technology

[0002] In the automotive ecosystem, anthropomorphic in-vehicle digital humans and smart dashboards enhance the driving experience and provide emotional value to users, alleviating the tension of drivers and passengers.

[0003] In related technologies, an in-vehicle intelligent agent is installed in the vehicle. Drivers and passengers interact with the intelligent agent through voice interaction, and the facial expressions of the in-vehicle digital human are displayed on the intelligent agent. However, there is a lack of interaction with other parts of the digital human, and the interaction between drivers and passengers and the digital human is monotonous. As a result, the digital human has low appeal to drivers and passengers and is easy to cause fatigue. Summary of the Invention

[0004] To address the shortcomings of related technologies, this disclosure provides a method for displaying a digital human in a vehicle, a controller, and a vehicle.

[0005] To achieve the above objectives, in a first aspect, this disclosure provides a method for displaying a vehicle-mounted digital human, comprising: Displaying the head status of a digital human within an intelligent agent on a vehicle; The torso features of the digital human are displayed in a target area on a display screen on the vehicle, wherein the intelligent agent is detachably mounted on the frame of the display screen, and the target area on the display screen is located on the extension line of the central axis of the intelligent agent and adjacent to the frame where the intelligent agent is located.

[0006] Secondly, this disclosure provides an in-vehicle digital human display device, comprising: The first execution module is configured to display the head state of the digital human in the intelligent agent on the vehicle; The second execution module is configured to display the torso features of the digital human in a target area on a display screen on the vehicle, wherein the intelligent agent is detachably mounted on the bezel of the display screen, and the target area on the display screen is located on the extension line of the central axis of the intelligent agent and adjacent to the bezel where the intelligent agent is located.

[0007] Thirdly, this disclosure provides a controller, including: A memory on which computer programs are stored; A processor for executing the computer program in the memory to implement the method described in the first aspect.

[0008] Fourthly, this disclosure provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the method described in the first aspect.

[0009] Fifthly, this disclosure provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the method described in the first aspect.

[0010] Through the above technical solution, while the intelligent agent displays the digital human's head state, the vehicle's display simulates the digital human's torso features. This coordinated presentation of head and torso features makes the digital human more closely resemble real human communication, achieving anthropomorphic expression. Furthermore, the head and torso are displayed in separate but logically related areas, each with different refresh rates or rendering precision, ensuring visual smoothness while saving vehicle system computing power. In addition, it supports personalized adaptation for multiple scenarios. This achieves an organic integration and interconnection between the vehicle system and the intelligent agent, providing users with more ways to interact with the digital human and enhancing its entertainment attributes.

[0011] Other features and advantages of this disclosure will be described in detail in the following detailed description section. Attached Figure Description

[0012] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the following detailed description to explain the present disclosure, but do not constitute a limitation thereof. In the drawings: Figure 1 This is a flowchart illustrating an in-vehicle digital human display method according to an exemplary embodiment of the present disclosure.

[0013] Figure 2 This is a schematic diagram of the assembly of an intelligent agent and a display according to an exemplary embodiment of the present disclosure.

[0014] Figure 3 This is a schematic diagram illustrating the assembly of a headdress, an intelligent agent, and a display according to an exemplary embodiment of this disclosure.

[0015] Figure 4 This is a schematic diagram illustrating the signal connection between a headdress, an intelligent agent, and a display according to an exemplary embodiment of this disclosure.

[0016] Figure 5a This is a schematic diagram illustrating the display states of the headdress, the intelligent agent, and the display according to an exemplary embodiment of this disclosure.

[0017] Figure 5b This is another schematic diagram illustrating the display state of the headdress, the intelligent agent, and the display according to an exemplary embodiment of this disclosure.

[0018] Figure 5c This is yet another schematic diagram illustrating the display state of the headdress, the intelligent agent, and the display according to an exemplary embodiment of this disclosure.

[0019] Figure 5d This is another schematic diagram illustrating the display state of the headdress, the intelligent agent, and the display according to an exemplary embodiment of the present disclosure.

[0020] Figure 5e This is another schematic diagram illustrating the display state of the headdress, the intelligent agent, and the display according to an exemplary embodiment of the present disclosure.

[0021] Figure 6a This is a schematic diagram illustrating the positional relationship between an intelligent agent and a display according to an exemplary embodiment of this disclosure.

[0022] Figure 6b This is a schematic diagram illustrating another positional relationship between the agent and the display according to an exemplary embodiment of this disclosure.

[0023] Figure 6c This is another schematic diagram illustrating the positional relationship between the intelligent agent and the display according to an exemplary embodiment of this disclosure.

[0024] Figure 7 This is a software architecture diagram of the vehicle system and intelligent agent shown according to an exemplary embodiment of this disclosure.

[0025] Figure 8 This is another flowchart illustrating an in-vehicle digital human display method according to an exemplary embodiment of the present disclosure.

[0026] Figure 9 This is a block diagram illustrating an in-vehicle digital human display device according to an exemplary embodiment of the present disclosure.

[0027] Figure 10 This is a block diagram of a controller according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0028] The specific embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for illustration and explanation only and are not intended to limit this disclosure.

[0029] Figure 1 This is a flowchart illustrating an in-vehicle digital human display method according to an exemplary embodiment of this disclosure. This in-vehicle digital human display method can be applied to vehicles equipped with intelligent agents. Figure 1 As shown, the in-vehicle digital human display method may include: In step S11, the head state of the digital human is displayed in the intelligent agent 1 on the vehicle; In step S12, the torso features of the digital human are displayed in the target area 21 of the display screen 2 on the vehicle.

[0030] Among them, such as Figure 2 As shown, the intelligent agent 1 is detachably mounted on the frame 22 of the display screen 2. The target area 21 in the display screen 2 is located on the extension line of the central axis of the intelligent agent 1 and is adjacent to the frame where the intelligent agent 1 is located.

[0031] It is worth noting that the height and width of the target area can be dynamically adjusted according to the torso features to be displayed. The digital human can be any virtual character, such as a virtual male, virtual female, or virtual pet. This disclosure does not impose any limitations on this.

[0032] In the aforementioned technical solution, while the intelligent agent displays the digital human's head state, the vehicle's display simulates the digital human's torso features. Through the coordinated presentation of the head state and torso features, the digital human more closely resembles the communication style of real humans, achieving anthropomorphic expression. Furthermore, the head and torso are displayed in separate but logically related areas, each with different refresh rates or rendering precision, ensuring visual smoothness while saving vehicle system computing power. In addition, it supports personalized adaptation for multiple scenarios. This achieves an organic integration and interconnection between the vehicle system and the intelligent agent, providing users with more ways to interact with the digital human and enhancing its entertainment attributes.

[0033] To facilitate a better understanding of the digital human display method provided in this disclosure by those skilled in the art, the method is described in detail below.

[0034] In one feasible embodiment, such as Figure 3 As shown, the intelligent agent 1 is detachably equipped with a headpiece 3, which displays the digital human's head state within the intelligent agent on the vehicle. This headpiece may include: Obtain the feature information of the headdress 3 currently installed on the intelligent agent 1, determine the appearance features of the digital human's head UI (User Interface) based on the feature information of the headdress 3, and display the appearance features of the digital human's head UI in the intelligent agent 1. The appearance features of the head UI include at least one of face shape, facial feature layout, and micro-expressions related to personality. The in-vehicle digital human display method may also include: Display the torso features of the digital human under the head UI appearance features in the target area. The torso features include at least one of skin color, body shape, clothing and posture.

[0035] It is worth noting that the headdress can integrate an RFID (Radio Frequency Identification) card, which contains characteristic information related to the headdress. This characteristic information represents the personality traits of the digital human to be displayed. Therefore, by wearing different headdresses on the intelligent agent, the image of the digital human displayed on the intelligent agent and the display screen can be switched, including the digital human's body movements, clothing, facial expressions, etc.

[0036] The assembly method of the headdress, intelligent agent and display is as follows Figure 4 As shown, when the intelligent agent is wearing a headdress, it can interact with the RFID card inside the headdress via NFC (Near Field Communication) to read the headdress's feature information. The display screen has multiple PogoPin interfaces, allowing the intelligent agent to connect to the screen. The display screen can locate the PogoPin interfaces using impedance positioning, thus determining the specific installation position of the intelligent agent. The target area on the display screen is then laid out according to this position. Associating the display screen with the installation position of the intelligent agent allows for automatic matching of the intelligent agent's installation location, and the digital human can be displayed in conjunction with the intelligent agent at an appropriate position on the display screen.

[0037] For example, such as Figure 5a As shown, if the headdress's features include long, straight black hair representing gentleness, maturity, and an artistic temperament, then a virtual female image representing gentleness, maturity, and an artistic temperament will be jointly displayed in the display area on both the intelligent agent and the screen. For example... Figure 5b As shown, if the headdress's features include long, wavy hair that evokes charm, romance, and allure, then a virtual female image embodying charm, romance, and allure will be jointly displayed in the display areas of both the intelligent agent and the screen. For example... Figure 5c As shown, if the headdress's features include a lively, cute, and casual curly hairstyle, then a virtual female image with a lively, cute, and casual temperament will be jointly displayed in the display areas of the intelligent agent and the display screen. Figure 5d As shown, if the headdress's features include a Japanese-style collarbone-length hairstyle that evokes a lazy, understanding, and slightly absent-minded personality, then a virtual female character embodying this type will be jointly displayed in the display area on both the intelligent agent and the screen. For example... Figure 5e As shown, if the headdress features include a neat, decisive, and independent short haircut, then a virtual female image of the neat, decisive, and independent type will be jointly displayed in the display area on the intelligent agent and the display screen.

[0038] In the aforementioned technical method, different headwear is worn on the intelligent agent to switch the digital human image displayed on the screen and in conjunction with the intelligent agent, thus achieving coordinated control between the screen and the intelligent agent. Furthermore, the entire process is logically simple, requires no extensive data computation, and saves computing power on the vehicle's infotainment system.

[0039] In one feasible embodiment, the in-vehicle digital human display method may further include: Based on the installation position of the intelligent agent on the display screen, the central axis of the intelligent agent is determined to be an extension line of the display screen, wherein the target area in the display screen extends symmetrically to both sides with the extension line as the central axis.

[0040] It is worth noting that the intelligent agent 1 can be installed on the frame 22 of the display screen 2 on which it is based. The central axis of the intelligent agent 1 is perpendicular to the frame 22 of the display screen 2 on which it is based, and the extension line of the central axis extending into the display screen can be the center line of the target area. The target area extends symmetrically to both sides of this central axis, and the height and width of the target area can be dynamically adjusted according to the digital human to be displayed.

[0041] In one feasible embodiment, the in-vehicle digital human display method may further include: If the intelligent agent 1 is installed on the left edge of the display screen 2, then the target area 21 in the display screen 2 is adjacent to the left edge of the display screen 2. If the intelligent agent 1 is installed on the upper edge of the display screen 2, then the target area 21 in the display screen 2 is adjacent to the upper edge of the display screen 2. If the intelligent agent 1 is installed on the right side of the display screen 2, then the target area 21 in the display screen 2 is adjacent to the right side of the display screen 2.

[0042] For example, such as Figure 6b As shown, if agent 1 is installed on the left edge of display screen 2, the central axis of agent 1 is perpendicular to the left edge of display screen 2, and the extension line of this central axis into the display screen can be the center line of the target area. The target area 21 extends symmetrically to both sides of this central axis and is adjacent to the left edge of display screen 2. Figure 6a As shown, if agent 1 is installed on the upper frame of display screen 2, the central axis of agent 1 is perpendicular to the upper frame of display screen 2, and the extension line of this central axis into the display screen can be the center line of the target area. The target area 21 extends symmetrically to both sides of this central axis and is adjacent to the upper frame of display screen 2. Figure 6c As shown, if the intelligent agent 1 is installed on the right side of the display screen 2, the central axis of the intelligent agent 1 is perpendicular to the right side of the display screen 2, and the extension line of the central axis into the display screen can be the center line of the target area. The target area 21 extends symmetrically to both sides of this central axis and is adjacent to the right side of the display screen 2.

[0043] In the above technical solution, the physical orientation of the intelligent agent is perfectly aligned with the center line of the target area on the display screen, which can automatically guide the user's gaze from the intelligent agent to the target area on the display screen, achieving a natural connection of gaze. In addition, the target area extends symmetrically to both sides along the central axis, which can evenly distribute information density within the limited screen and avoid overload or blank waste on one side of the display screen.

[0044] In one feasible embodiment, the in-vehicle digital human display method may further include: In response to a user's touch operation on the touch area on the torso of the digital human in the target area 21, the limb movements of the digital human displayed in the target area 21 of the display screen 2 are adjusted. The touch area includes at least one of the shoulder, elbow, wrist and spine. Adjust the head position of the digital human displayed in the intelligent agent based on touch operations and body movements.

[0045] It is worth noting that when a digital human is already displayed on the smart agent and the screen, if the user touches different parts of the digital human's torso on the screen, the user can control the digital human to change its movements according to the touch location. At the same time, the touched part and the digital human's movement information are sent to the smart agent. The smart agent adjusts the digital human's head movement according to the touched part and the digital human's movement information and provides corresponding sound feedback, realizing the linkage and interaction between the smart agent and the screen.

[0046] It should be understood that during the process of the display screen controlling the digital human to move, the digital human's skin naturally deforms along with the skeleton, and the associated muscles contract and relax, simulating the process of human movement. The intelligent agent adjusts the digital human's head movements, including adjusting the digital human's head orientation and facial expressions. For example, when the display screen controls the digital human's torso to turn its head, raise its hand, or move its body, the digital human's head orientation and facial expressions in the intelligent agent change with the torso.

[0047] In the above technical solution, users can interact with the intelligent agent and the digital human displayed on the screen through voice, touch and other means. The digital human will respond and provide feedback, which can meet the interaction needs of different users and different scenarios, realize multimodal interaction between users and digital humans, and upgrade digital humans from display objects to intelligent partners that can be talked to, touched and perceived.

[0048] In one feasible embodiment, the in-vehicle digital human display method may further include: Acquire multi-source perception information and convert it into corresponding structured labels. The multi-source perception information includes at least one of the following: user interaction information with the digital human, vehicle status information, vehicle environment information, user status inside the vehicle, and digital human personality information. The structured labels are input into the decision model to obtain the structured instructions output by the decision model, which is trained based on a large language model. Based on structured instructions, adjust the head state of the digital human in the intelligent agent and the torso features of the digital human in the target area on the display screen.

[0049] It should be understood that the intelligent agent is responsible for displaying the digital human's head movements and facial expressions, while the display screen is responsible for displaying the digital human's torso features and limb movements. The image of the digital human displayed in conjunction with the intelligent agent can be dynamically adjusted based on multi-source sensory information, allowing the intelligent agent and display screen to present a highly human-like digital human image that can interact with users in a multimodal manner, enhancing the digital human's entertainment attributes and increasing its appeal to users.

[0050] It is worth noting that, such as Figure 7 As shown, the system can be configured with a multi-source perception input layer, a scene state fusion layer, an LLM (Large Language Model) intelligent decision-making layer, and a vehicle-mounted digital human performance layer. The multi-source perception layer is used to acquire multi-source perception information, including touch interaction, dialogue context, vehicle status, surrounding environment, user status, and digital human personality profile; the scene state fusion layer is used to convert multi-source perception information into structured labels; the LLM intelligent decision-making layer is used to output structured instructions for controlling the state of the digital human based on the structured labels; the vehicle-mounted digital human performance layer is used to control the state of the intelligent agent and the digital human displayed on the screen based on the structured instructions, including TTS (Text-To-Speech) emotional voice playback, body movements, digital human expressions, head movements, compliant driving constraints, and background linkage.

[0051] It is worth noting that the presentation method of the in-vehicle digital human's presentation layer can be seen in Table 1 below: Table 1

[0052] In one feasible embodiment, the user's interaction information with the digital human includes touch screen interaction and / or voice interaction. Converting multi-source sensory information into corresponding structured tags may include: Convert touchscreen interactions into touch tags, which include touch method, touch area, touch pressure, and touch duration; and / or, Convert voice interactions into dialogue tags, which include question semantics, dialogue mood, dialogue topic, and dialogue context; and / or, Touchscreen interactions are converted into touch tags, voice interactions are converted into dialogue tags, and touch tags and dialogue tags are merged to obtain fused tags.

[0053] It should be noted that, for the multi-source perception information and the corresponding structured labels, reference may be made to Table 2 below: Table 2

[0054] In a feasible embodiment, converting the multi-source perception information into the corresponding structured labels may include: If the multi-source perception information includes one type of information among the interaction information between the user and the digital human, the state information of the vehicle, the environment information where the vehicle is located, the user state inside the vehicle, and the personality information of the digital human, the multi-source perception information is converted into the corresponding structured label; If the multi-source perception information includes multiple types of information among the interaction information between the user and the digital human, the state information of the vehicle, the environment information where the vehicle is located, the user state inside the vehicle, and the personality information of the digital human, each type of information is separately converted into a corresponding label, and all labels are fused to obtain the structured label corresponding to the multi-source perception information.

[0055] It should be noted that, the digital human jointly displayed by the intelligent agent and the display screen can be linked and controlled according to the structured label corresponding to any type of data in the multi-source perception information; the digital human jointly displayed by the intelligent agent and the display screen can also be linked and controlled according to the structured labels corresponding to multiple types of data in the multi-source perception information; on the basis of realizing data-driven precise linkage response, the richness and subtlety of the digital human's expression are greatly improved. In addition, by using the structured label as an intermediate bridge, a complex control strategy can be realized through label combination logic, which significantly reduces code redundancy and maintenance cost. Moreover, users or administrators are allowed to bind personal preferences to a specific label combination, making the digital human a user-exclusive personalized partner.

[0056] The vehicle-mounted digital human display method provided by the present disclosure will be described below with a complete embodiment, as shown in Figure 8 the figure, which may include: I. The display screen reads the access information of the intelligent agent, and determines the basic information and access position of the intelligent agent, wherein the intelligent agent is connected to the vehicle machine through PogoPin.

[0057] II. It is judged whether the intelligent agent has read the feature information of the headwear, if yes, step III is executed, and if no, step IV is executed.

[0058] III. The default head state of the digital human is displayed on the intelligent agent, and the torso feature corresponding to the default head state of the digital human is displayed in the target area of the display screen, and step V is executed.

[0059] IV. Determine the head UI appearance features of the digital human based on the feature information of the headdress, display the head appearance features of the digital human on the intelligent agent, and send the feature information of the headdress to the display screen; determine the torso features of the digital human corresponding to the head UI appearance features, display the torso features of the digital human in the target area of ​​the display screen, and execute step V.

[0060] V. Respond to user interaction by adjusting the head state of the digital human displayed on the intelligent agent and / or the torso features of the digital human displayed in the target area of ​​the display screen.

[0061] The above technical solution organically combines the vehicle system, the intelligent agent, and the intelligent agent's headdress, linking them together into a whole. The vehicle system virtually displays other parts of the human body or a cute pet for the intelligent agent, and the display screen is configured with interactive and realistic environmental scenes, making the digital human more human-like, enhancing its entertainment attributes, and bringing more emotional value and experience to users.

[0062] Based on the same inventive concept, this disclosure also provides an in-vehicle digital human display device, such as... Figure 9 As shown, the vehicle-mounted digital human display device includes: The first execution module 901 is configured to display the head state of the digital human in the intelligent agent on the vehicle; The second execution module 902 is configured to display the torso features of the digital human in a target area on a display screen on the vehicle, wherein the intelligent agent is detachably mounted on the bezel of the display screen, and the target area on the display screen is located on the extension line of the central axis of the intelligent agent and adjacent to the bezel where the intelligent agent is located.

[0063] Optionally, the intelligent agent is detachably equipped with a headdress. The first execution module 901 is configured to acquire the feature information of the headdress currently installed on the intelligent agent, determine the head UI appearance features of the digital human based on the feature information of the headdress, and display the head UI appearance features of the digital human in the intelligent agent. The head UI appearance features include at least one of face shape, facial feature layout, and micro-expressions related to personality. Accordingly, the second execution module 902 is configured to display the torso features of the digital human under the head UI appearance features in the target area, the torso features including at least one of skin color, body shape, clothing and posture.

[0064] Optionally, the second execution module 902 is configured to determine the extension line of the central axis of the intelligent agent on the display screen based on the installation position of the intelligent agent on the display screen, wherein the target area in the display screen extends symmetrically to both sides with the extension line as the central axis.

[0065] Optionally, if the intelligent agent is installed on the left edge of the display screen, then the target area in the display screen is adjacent to the left edge of the display screen; If the intelligent agent is installed on the upper bezel of the display screen, then the target area in the display screen is adjacent to the upper bezel of the display screen; If the intelligent agent is installed on the right edge of the display screen, then the target area in the display screen is adjacent to the right edge of the display screen.

[0066] Optionally, the second execution module 902 is configured to adjust the limb movements of the digital human displayed in the target area in response to a user's touch operation on a touch area on the torso of the digital human in the target area, wherein the touch area includes at least one of the shoulder, elbow, wrist and spine. The first execution module 901 is configured to adjust the head state of the digital human displayed in the smart agent based on the touch operation and the limb movement.

[0067] Optionally, the in-vehicle digital human display device further includes a third execution module, which is configured to acquire multi-source perception information and convert the multi-source perception information into corresponding structured tags. The multi-source perception information includes at least one of the following: user interaction information with the digital human, vehicle status information, vehicle environment information, user status inside the vehicle, and personality information of the digital human. The structured labels are input into the decision model to obtain the structured instructions output by the decision model, which is trained based on a large language model; According to the structured instructions, the head state of the digital human in the intelligent agent and the torso features of the digital human in the target area of ​​the display screen are adjusted.

[0068] Optionally, the user's interaction information with the digital human includes touch screen interaction and / or voice interaction. The third execution module is configured to convert the touch screen interaction into touch tags, the touch tags including touch mode, touch area, touch pressure, and touch duration; and / or, The voice interaction is converted into dialogue tags, which include question semantics, dialogue emotion, dialogue topic, and dialogue context; and / or, The touch screen interaction is converted into touch tags, the voice interaction is converted into dialogue tags, and the touch tags and dialogue tags are fused to obtain fused tags.

[0069] Optionally, the third execution module is configured to convert the multi-source perception information into corresponding structured tags if the multi-source perception information includes one of the following: user interaction information with the digital human, vehicle status information, vehicle environment information, user status inside the vehicle, and digital human personality information. If the multi-source perception information includes multiple types of information such as user interaction information with the digital human, vehicle status information, vehicle environment information, user status inside the vehicle, and digital human personality information, then each type of information is converted into a corresponding label, and all labels are fused to obtain the structured label corresponding to the multi-source perception information.

[0070] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0071] Based on the same inventive concept, this disclosure also provides a controller, including: A memory on which computer programs are stored; A processor is configured to execute the computer program in the memory to implement the above-described in-vehicle digital human display method.

[0072] Figure 10 This is a block diagram illustrating an electronic device 1000 according to an exemplary embodiment. For example... Figure 10As shown, the electronic device 1000 may include a processor 1001 and a memory 1002. The electronic device 1000 may also include one or more of a multimedia component 1003, an input / output (I / O) interface 1004, and a communication component 1005. The processor 1001 controls the overall operation of the electronic device 1000 to complete all or part of the steps in the above-described in-vehicle digital human display method. The memory 1002 stores various types of data to support the operation of the electronic device 1000. This data may include, for example, instructions for any application or method operating on the electronic device 1000, and application-related data such as head state, torso features, installation location, touch operations, multi-source sensory information, structured tags, and structured instructions, etc. The memory 1002 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The multimedia component 1003 may include a screen and an audio component. The screen may be, for example, a touchscreen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in the memory 1002 or transmitted via the communication component 1005. The audio component also includes at least one speaker for outputting audio signals. I / O interface 1004 provides an interface between processor 1001 and other interface modules, such as keyboards, mice, and buttons. These buttons can be virtual or physical. Communication component 1005 is used for wired or wireless communication between the electronic device 1000 and other devices. Wireless communication includes, for example, Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, or 4G, or a combination thereof. Therefore, the corresponding communication component 1005 may include a Wi-Fi module, a Bluetooth module, and an NFC module.

[0073] In an exemplary embodiment, the electronic device 1000 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described vehicle-mounted digital human display method.

[0074] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, which, when executed by a processor, implement the steps of the above-described in-vehicle digital human display method. For example, the computer-readable storage medium may be the memory 1002 including the program instructions, which may be executed by the processor 1001 of the electronic device 1000 to complete the above-described animation rendering optimization method.

[0075] In another exemplary embodiment, a computer program product is also provided, which includes a computer program executable by a processor, which, when executed by the processor, implements the steps of the above-described in-vehicle digital human display method.

[0076] Based on the same inventive concept, this disclosure also provides a vehicle including the aforementioned controller.

[0077] The preferred embodiments of this disclosure have been described in detail above with reference to the accompanying drawings. However, this disclosure is not limited to the specific details of the above embodiments. Within the scope of the technical concept of this disclosure, various simple modifications can be made to the technical solutions of this disclosure, and these simple modifications all fall within the protection scope of this disclosure.

[0078] It should also be noted that the various specific technical features described in the above embodiments can be combined in any suitable manner without contradiction. To avoid unnecessary repetition, this disclosure will not describe the various possible combinations separately.

[0079] Furthermore, various different embodiments of this disclosure can be combined in any way, as long as they do not violate the spirit of this disclosure, they should also be regarded as the content disclosed in this disclosure.

Claims

1. A method for displaying a digital human in a vehicle, characterized in that, include: Displaying the head status of a digital human within an intelligent agent on a vehicle; The torso features of the digital human are displayed in a target area on a display screen on the vehicle, wherein the intelligent agent is detachably mounted on the frame of the display screen, and the target area on the display screen is located on the extension line of the central axis of the intelligent agent and adjacent to the frame where the intelligent agent is located.

2. The vehicle-mounted digital human display method according to claim 1, characterized in that, The intelligent agent is detachably equipped with a headdress, and the display of the digital human's head state in the intelligent agent on the vehicle includes: The feature information of the headdress currently installed on the intelligent agent is obtained, the head UI appearance features of the digital human are determined according to the feature information of the headdress, and the head UI appearance features of the digital human are displayed in the intelligent agent. The head UI appearance features include at least one of face shape, facial feature layout, and micro-expressions related to personality. The method further includes: The target area displays the torso features of the digital human under the head UI appearance features, and the torso features include at least one of skin color, body shape, clothing and posture.

3. The in-vehicle digital human display method according to claim 1, characterized in that, The method further includes: Based on the installation position of the intelligent agent on the display screen, the extension line of the central axis of the intelligent agent on the display screen is determined, wherein the target area in the display screen extends symmetrically to both sides with the extension line as the central axis.

4. The vehicle-mounted digital human display method according to claim 3, characterized in that, The method further includes: If the intelligent agent is installed on the left edge of the display screen, then the target area in the display screen is adjacent to the left edge of the display screen; If the intelligent agent is installed on the upper bezel of the display screen, then the target area in the display screen is adjacent to the upper bezel of the display screen; If the intelligent agent is installed on the right edge of the display screen, then the target area in the display screen is adjacent to the right edge of the display screen.

5. The vehicle-mounted digital human display method according to any one of claims 1-4, characterized in that, The method further includes: In response to a user's touch operation on a touch area on the torso of the digital human in the target area, the limb movements of the digital human displayed in the target area of ​​the display screen are adjusted, wherein the touch area includes at least one of the shoulder, elbow, wrist, and spine; The head state of the digital human displayed in the intelligent agent is adjusted according to the touch operation and the body movement.

6. The vehicle-mounted digital human display method according to any one of claims 1-4, characterized in that, The method further includes: Acquire multi-source perception information and convert the multi-source perception information into corresponding structured tags. The multi-source perception information includes at least one of the following: user interaction information with the digital human, vehicle status information, vehicle environment information, user status inside the vehicle, and digital human personality information. The structured labels are input into the decision model to obtain the structured instructions output by the decision model, which is trained based on a large language model; According to the structured instructions, the head state of the digital human in the intelligent agent and the torso features of the digital human in the target area of ​​the display screen are adjusted.

7. The vehicle-mounted digital human display method according to claim 6, characterized in that, The user's interaction information with the digital human includes touch screen interaction and / or voice interaction, and the conversion of the multi-source sensory information into corresponding structured tags includes: The touchscreen interaction is converted into touch tags, the touch tags including touch mode, touch area, touch pressure, and touch duration; and / or, The voice interaction is converted into dialogue tags, which include question semantics, dialogue emotion, dialogue topic, and dialogue context; and / or, The touch screen interaction is converted into touch tags, the voice interaction is converted into dialogue tags, and the touch tags and dialogue tags are fused to obtain fused tags.

8. The vehicle-mounted digital human display method according to claim 6, characterized in that, Converting the multi-source sensing information into corresponding structured labels includes: If the multi-source perception information includes one of the following: user interaction information with the digital human, vehicle status information, vehicle environment information, user status inside the vehicle, and digital human personality information, then the multi-source perception information is converted into corresponding structured tags. If the multi-source perception information includes multiple types of information such as user interaction information with the digital human, vehicle status information, vehicle environment information, user status inside the vehicle, and digital human personality information, then each type of information is converted into a corresponding label, and all labels are fused to obtain the structured label corresponding to the multi-source perception information.

9. A controller, characterized in that, include: A memory on which computer programs are stored; A processor for executing the computer program in the memory to implement the method of any one of claims 1-8.

10. A vehicle, characterized in that, Includes the controller as described in claim 9.

Images