Digital human display method, device and display equipment

By obtaining face images and coordinate information, and adjusting the digital human display angle in real time, the problem of delay in adjusting the angle of digital human in the existing technology is solved, and the realistic and intelligent presentation effect is improved.

CN113900525BActive Publication Date: 2024-12-03SHENZHEN TCL DIGITAL TECH CO LTD
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
CN202111272764.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-29
Publication Date
2024-12-03
Estimated Expiration
2041-10-29

AI Technical Summary

Technical Problem

When existing 3D digital people are displayed on display devices, the angle adjustment is delayed and cannot be changed in real time, resulting in the rendering effect being unrealistic.

Method used

By obtaining the face image, obtaining its current coordinate information, and processing the face bias angle based on the preset screen reference coordinate information, adjusting the display angle of the digital human image in real time, so that the digital human always faces the human.

Benefits of technology

Real-time adjustment of the digital human angle is realized, improving the authenticity and intelligence of the presentation effect, making the digital human always face people at different positions, and enhancing the interactive experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113900525B_ABST
    Figure CN113900525B_ABST
Patent Text Reader

Abstract

The present application relates to a method, device and display equipment for displaying digital human beings. The method comprises: obtaining a face image; obtaining the current coordinate information of the corresponding face image according to the face image, and activating the digital human image; processing the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle; adjusting the display angle of the digital human image according to the face deflection angle, so as to adjust the display angle of the digital human image in real time according to the face angle, making the digital human on TV more intelligent and the presentation effect of the picture more realistic. The present application activates the digital human through the face image, and when displaying the 3D digital human on the TV, the angle can be updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person, and the digital human presentation effect is more intelligent and realistic.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a digital human display method, device and display equipment. Background Art

[0002] With the development of display technology, the presentation scenarios of digital humans are becoming more and more extensive. Digital humans refer to 3D digital human images that are created through 3D graphic character modeling, sound cloning technology and action drive, and that combine artificial intelligence with productivity that can interact in real time and have deep learning capabilities, and use information science methods to virtually simulate the human body's form and function at different levels.

[0003] In the prior art, when a 3D digital human is displayed on a display device (such as a TV, etc.), the display angle or specific action is generally set according to given parameters. When the position of the human changes, there is a delay in adjusting the angle of the digital human, and the angle of the digital human cannot be changed in real time, resulting in an unrealistic presentation effect. Summary of the invention

[0004] Based on this, it is necessary to provide a digital human display method, device and display device that can optimize the angle adjustment of the digital human in real time so that the digital human always faces the direction of the human in order to address the problems in the above-mentioned traditional display devices that there is a delay in the angle adjustment of the digital human, the angle of the digital human cannot be changed in real time, and the presentation effect of the displayed picture is not realistic.

[0005] In a first aspect, the present application provides a digital human display method, comprising:

[0006] Get face image;

[0007] According to the face image, obtain the current coordinate information of the corresponding face image and activate the digital human image;

[0008] According to the preset screen reference coordinate information, the current coordinate information is processed to obtain the face deflection angle;

[0009] Adjust the display angle of the digital human image according to the face deviation angle.

[0010] Optionally, the step of obtaining current coordinate information of the corresponding face image according to the face image includes:

[0011] Each group of coordinate information corresponding to the face image is obtained, and each group of coordinate information is processed by distance comparison. According to the processing result, the coordinate information closest to the digital human image is confirmed as the current coordinate information.

[0012] Optionally, the step of performing distance comparison processing on each set of coordinate information and confirming the coordinate information corresponding to the closest distance to the digital human image as the current coordinate information according to the processing result includes:

[0013] Obtaining first position coordinate information and second position coordinate information of each group of corresponding coordinate information;

[0014] Obtaining distance information of each image according to the first position coordinate information and the second position coordinate information;

[0015] The distance information of each image is compared and processed, and the coordinate information of the image distance information corresponding to the maximum value is confirmed as the current coordinate information.

[0016] Optionally, the step of processing the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle includes:

[0017] Get the screen resolution;

[0018] Obtaining face center information according to first position coordinate information and second position coordinate information corresponding to current coordinate information;

[0019] The face deviation angle is obtained according to the screen resolution and the face center point information.

[0020] Optionally, the first position coordinate information and the second position coordinate information are diagonal coordinate information.

[0021] Optionally, the step of obtaining a face image includes:

[0022] Get the current video stream data, process the current video stream data, and get the face image.

[0023] Optionally, after the step of obtaining the current video stream data, the following steps are included:

[0024] The current video stream data is processed, and according to the processing result, when no face image is detected in the current video stream data, the digital human image is hidden.

[0025] Optionally, the digital human display method further includes:

[0026] Get the current video stream data, process the current video stream data, and get the gesture information;

[0027] According to the gesture information, the query obtains the response information, and the response information is fed back through the digital human image.

[0028] In a second aspect, the present application provides a digital human display device, comprising:

[0029] A face image acquisition unit, used for acquiring a face image;

[0030] A face image processing unit, used to obtain the current coordinate information of the corresponding face image according to the face image, and activate the digital human image;

[0031] A deflection angle processing unit, used to process current coordinate information according to preset screen reference coordinate information to obtain a face deflection angle;

[0032] The angle adjustment unit is used to adjust the display angle of the digital human image according to the deflection angle of the human face.

[0033] In a third aspect, the present application provides a display device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the steps of the above-mentioned digital human display method when executing the computer program.

[0034] One of the above technical solutions has the following advantages and beneficial effects:

[0035] In the above-mentioned digital human display method, a face image is obtained; based on the face image, the current coordinate information of the corresponding face image is obtained, and the digital human image is activated; based on the preset screen reference coordinate information, the current coordinate information is processed to obtain the face deflection angle; based on the face deflection angle, the display angle of the digital human image is adjusted, so that the display angle of the digital human image can be adjusted in real time according to the face angle, making the TV digital human more intelligent and the presentation effect of the picture more realistic. This application activates the digital human through the face image, and when displaying the 3D digital human on the TV, the angle can be updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person, and the digital human presentation effect is more intelligent and realistic. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 This is a diagram of the application environment of the digital human display method in the embodiment of the present application.

[0037] Figure 2 This is a schematic diagram of the first process of the digital human display method in the embodiment of the present application.

[0038] Figure 3 Schematic diagram of the process of processing the current coordinate information in the embodiment of the present application.

[0039] Figure 4 Schematic diagram of the process of face angle processing in the embodiment of the present application.

[0040] Figure 5 This is a second flow chart of the digital human display method in the embodiment of the present application.

[0041] Figure 6 Schematic diagram of the flow of gesture information processing steps in the embodiment of the present application.

[0042] Figure 7 4 is a structural block diagram of a digital human display device in an embodiment of the present application.

[0043] Figure 8 It is a diagram showing the internal structure of the device in the embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] The digital human display method provided in this application can be applied to Figure 1 In the application environment shown. Among them, the display device 10 includes a processor 102, a memory 104 and a display screen 106. The processor 102 can be used to obtain a face image; according to the face image, obtain the current coordinate information of the corresponding face image and activate the digital human image; according to the preset screen reference coordinate information, process the current coordinate information to obtain the face deflection angle; according to the face deflection angle, adjust the display angle of the digital human image. The display screen 106 can be used to display the digital human image, and the display screen 106 can be, but not limited to, an LCD (Liquid Crystal Display) display screen 106 or an LED (Light-Emitting Diode) display screen 106. The memory 104 can be used to store screen reference coordinate information and digital human image information. The display device 10 can be, but not limited to, various personal computers, laptops, smart phones, tablet computers, televisions and conference tablets with a display screen 106.

[0046] In one embodiment, Figure 2 As shown, a digital human display method is provided, and the method is applied to Figure 1 The processor 102 in FIG. 1 is used as an example to illustrate, including:

[0047] Step S210, obtaining a face image.

[0048] Among them, a camera module may be provided on the display device, and the camera module may collect image data of the current environment in real time, and transmit the collected image data to the processor, and then the processor may obtain the corresponding face image. Exemplarily, the processor may also actively send an image acquisition request to the camera module, and then the camera module may send the corresponding face image to the processor according to the image acquisition request.

[0049] In one example, after the processor obtains the image data generated by the camera module, it can process the image data to obtain a corresponding facial image.

[0050] Step S220, according to the face image, obtaining the current coordinate information of the corresponding face image, and activating the digital human image.

[0051] The face image may include face information, such as coordinate information. A digital human image refers to an image that is displayed on a display screen by using information science methods to virtually simulate the morphology and functions of the human body at different levels based on the execution of a digital human program. The digital human image may be a 3D digital human image.

[0052] Exemplarily, the processor may perform recognition processing on the acquired face image, thereby obtaining face information. The processor may perform analysis processing on the face information, thereby obtaining corresponding current coordinate information. The processor may also activate the digital human image according to the acquired face image, so that the digital human image is displayed on the display screen.

[0053] In addition, the processor can recognize and process the face image through the face recognition module, identify the face features in the face image, and output the corresponding face information. The processor can establish a coordinate system for the face image so that each pixel on the face image corresponds to a coordinate point, and then obtain the current coordinate information of the corresponding face feature in the face drawing.

[0054] Step S230, processing the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle.

[0055] The face deflection angle refers to the deflection angle of the face relative to the front of the display screen. The preset screen reference coordinate information may be the coordinate information corresponding to the center of the display screen, that is, the face deflection angle is the deflection angle of the face relative to the center of the display screen. The current coordinate information may include at least 2 coordinate point information on the facial features.

[0056] Exemplarily, the processor may process the current coordinate information according to preset screen reference coordinate information to obtain the face deflection angle, and further know the deflection angle of the face in the face image relative to the front of the display screen.

[0057] Step S240: adjusting the display angle of the digital human image according to the face deflection angle.

[0058] The processor can adjust the display angle of the digital human image in real time according to the size of the face deflection angle. For example, if the face in the current face image is deflected to the left relative to the front of the display screen, the digital human image is adjusted to face the user's face, so that the digital human in the digital human image is turned to face the user's face, and the angle of the digital human image is updated in real time according to the different standing positions of the user, so that the digital human converted from the digital human image always faces the direction of the user's face.

[0059] In the above embodiment, by obtaining a face image; according to the face image, obtaining the current coordinate information of the corresponding face image, and activating the digital human image; according to the preset screen reference coordinate information, processing the current coordinate information to obtain the face deflection angle; according to the face deflection angle, adjusting the display angle of the digital human image, to achieve real-time adjustment of the display angle of the digital human image according to the face angle, making the TV digital human more intelligent and the presentation effect of the picture more realistic. This application activates the digital human through the face image, and when displaying the 3D digital human on the TV, the angle can be updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person, and the digital human presentation effect is more intelligent and realistic.

[0060] In order to optimize the facial features in the facial image, confirm the facial information closest to the screen, and improve the accuracy of the angle adjustment of the digital human, in one example, the step of obtaining the current coordinate information of the corresponding facial image according to the facial image includes:

[0061] Each group of coordinate information corresponding to the face image is obtained, and each group of coordinate information is processed by distance comparison. According to the processing result, the coordinate information closest to the digital human image is confirmed as the current coordinate information.

[0062] Among them, when the face image includes multiple face information, each face information can be judged separately, the face closest to the digital human image is selected as the nearest face information, and the coordinate information corresponding to the nearest face information is confirmed as the current coordinate information.

[0063] Exemplarily, the processor performs face recognition processing on the acquired face image to obtain face information in the face image. For example, if there are three faces in the face image, the three face information in the face image is obtained. The processor processes the three face information respectively to obtain three corresponding sets of coordinate information, performs distance comparison processing on the three sets of coordinate information, determines the coordinate information closest to the digital human image in the three sets of coordinate information, and confirms the closest coordinate information as the current coordinate information. Then, the processor processes the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle; and adjusts the display angle of the digital human image according to the face deflection angle, so as to adjust the display angle of the digital human image in real time according to the face angle, making the TV digital human more intelligent and the presentation effect of the picture more realistic. The digital human is activated by the face image, and when the 3D digital human is displayed on the TV, the angle can be updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person, and the digital human presentation effect is more intelligent and realistic.

[0064] In one example, if Figure 3As shown, the steps of performing distance comparison processing on each set of coordinate information and confirming the coordinate information closest to the digital human image as the current coordinate information according to the processing result include:

[0065] Step S310, obtaining the first position coordinate information and the second position coordinate information of each group of corresponding coordinate information.

[0066] The processor may select facial features from the facial image based on a preset window, and obtain first position coordinate information and second position coordinate information based on facial information in the preset window. In one example, the first position coordinate information and the second position coordinate information are diagonal coordinate information. The first position coordinate information may be the upper left corner coordinate in the facial information, and the second position coordinate information may be the upper right corner coordinate in the facial information.

[0067] The processor performs face recognition processing on the acquired face image to obtain each face information in the face image. The processor processes each face information based on the coordinate system model to obtain the coordinate information of each group of corresponding face information. The processor can confirm the coordinates of the upper left corner pixel in the face information as the first position coordinate information, and confirm the coordinates of the lower right corner pixel in the face information as the second position coordinate information.

[0068] Step S320, obtaining distance information of each image according to the first position coordinate information and the second position coordinate information.

[0069] The image distance information may be the distance between the first position coordinate information and the second position coordinate information.

[0070] The processor may process the acquired first position coordinate information and second position coordinate information, confirm the distance between the first position coordinate information and the second position coordinate information, and further obtain image distance information of the corresponding face information.

[0071] Step S330 , comparing the distance information of each image, and confirming the coordinate information of the image distance information corresponding to the maximum value as the current coordinate information.

[0072] The processor can compare and process the distance information of each image in the same face image, and then confirm the image distance information with the largest distance among the image distance information, and confirm the coordinate information of the image distance information corresponding to the maximum value as the current coordinate information, so as to confirm the face information closest to the digital human image in the face image, that is, to confirm the face information closest to the display screen, and then the processor processes the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle; and adjust the display angle of the digital human image according to the face deflection angle, so as to adjust the display angle of the digital human image in real time according to the face angle, making the TV digital human more intelligent and the presentation effect of the picture more realistic. The digital human is activated through the face image, and when the 3D digital human is displayed on the TV, the angle can be updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person, making the digital human presentation effect more intelligent and realistic.

[0073] In order to improve the accuracy of real-time adjustment of the digital human image, the 3D digital human is always facing the direction of the user's face. Figure 4 As shown, the step of processing the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle includes:

[0074] Step S410, obtaining screen resolution.

[0075] The screen resolution refers to the resolution of the display screen, and the processor can obtain the screen resolution by querying the resolution currently used by the display screen. For example, the screen resolution is (width, height).

[0076] Step S420, obtaining the face center point information according to the first position coordinate information and the second position coordinate information corresponding to the current coordinate information.

[0077] Among them, the face center point information can be used to indicate the center position information of the face, the first position coordinate information is (left1, top1), and the second position coordinate information is (right1, bottom1).

[0078] The processor can process the first position coordinate information and the second position coordinate information corresponding to the current coordinate information to calculate the center point of the nearest face in the horizontal direction, that is, to obtain the face center point information face_center=(right+left) / 2.

[0079] Step S430, obtaining the face deviation angle according to the screen resolution and the face center point information.

[0080] The processor can process the screen resolution (width, height) and the face center point information face_center, and then obtain the face deflection angle angle = ((width / 2-face_center) / (width / 2))*45. For example, the deflection angle in the middle of the screen is 0, the left side of the screen is positive, and the right side of the screen is negative. When the face is facing the display screen, the face deflection angle is 0; when the face is tilted to the left side of the display screen, the face deflection angle is positive; when the face is tilted to the right side of the display screen, the face deflection angle is negative.

[0081] In the above embodiment, the digital human is activated by a face image, and when the 3D digital human is displayed on a TV, the deflection angle between the face and the front of the screen is calculated, and the angle is updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person, making the digital human presentation more intelligent and realistic.

[0082] In one example, if Figure 5 As shown, a digital human display method is provided, and the method is applied to Figure 1 The processor 102 in FIG. 1 is used as an example to illustrate, including:

[0083] Step S510, obtaining current video stream data, processing the current video stream data, and obtaining a face image.

[0084] The current video stream data can be detected by the camera module. The camera module can monitor the video data of the current environment in real time, and transmit the detected current video stream data to the processor, and then the processor can obtain the current video stream data and process the obtained current video stream data to obtain the face image.

[0085] Step S520, according to the face image, obtain the current coordinate information of the corresponding face image, and activate the digital human image.

[0086] Step S530, processing the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle.

[0087] Step S540: adjusting the display angle of the digital human image according to the face deflection angle.

[0088] The processor can process the acquired current video stream data to obtain a face image. The processor can obtain the current coordinate information of the corresponding face image based on the face image and activate the digital human image; process the current coordinate information based on the preset screen reference coordinate information to obtain the face deflection angle; adjust the display angle of the digital human image based on the face deflection angle, and adjust the display angle of the digital human image in real time according to the face angle, making the TV digital human smarter and the presentation effect of the picture more realistic. The digital human is activated through the face image, and when the 3D digital human is displayed on the TV, the angle can be updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person, making the digital human presentation effect more intelligent and realistic.

[0089] In order to further enhance the intelligence and authenticity of 3D digital humans, in one example, Figure 5 As shown, after the step of obtaining the current video stream data, it includes:

[0090] Step S550, processing the current video stream data, and based on the processing result, hiding the digital human image when no face image is detected in the current video stream data.

[0091] The processor can obtain the current video stream data transmitted by the camera module and process the current video stream data, for example, intercepting an image from the current video stream data based on a preset period, and performing face recognition processing on the intercepted image to determine whether the intercepted image contains face information. When the processor does not detect a face image in the current video stream data, the digital human image is hidden.

[0092] In the above embodiment, the digital human is activated by a facial image, and when the 3D digital human is displayed on the TV, the angle can be updated in real time according to the different standing positions of the person, so that the digital human always faces the direction of the person. When the facial image is not detected, the digital human image is hidden, making the digital human presentation more intelligent and realistic.

[0093] In one example, if Figure 6 As shown, the digital human display method also includes:

[0094] Step S610, obtaining current video stream data, processing the current video stream data, and obtaining gesture information.

[0095] The gesture information refers to the user's gesture information. In one example, a sign language recognition module is provided in the display device, and the sign language recognition module can recognize the user's sign language from the current video stream data detected by the camera module, for example, the gesture information is: "What will the weather be like tomorrow?".

[0096] It should be noted that the sign language recognition module can be composed of an image acquisition module, an image recognition module, a semantic conversion module and a semantic output module, which converts sign language into electrical signals and then into text.

[0097] Step S620: query and obtain response information according to the gesture information, and feed back the response information through the digital human image.

[0098] The processor can obtain response information corresponding to the gesture information by querying the database or the cloud server according to the gesture information, and feed back the response information to the user through the digital human image. For example, the processor can call the digital human API interface to set the question raised by the user through gestures (such as "What will the weather be like tomorrow?"). The digital human receives the text recognized by the sign language, and after querying and searching, returns the result of the question raised by the gesture to the user in the form of text and voice, making the 3D digital human of the display device smarter and reaching a wider audience.

[0099] It should be understood that although Figure 2-6 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2-6 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0100] In one embodiment, Figure 7 As shown, a digital human display device is provided, comprising:

[0101] The face image acquisition unit 710 is used to acquire a face image.

[0102] The face image processing unit 720 is used to obtain the current coordinate information of the corresponding face image according to the face image, and activate the digital human image.

[0103] The deflection angle processing unit 730 is used to process the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle.

[0104] The angle adjustment unit 740 is used to adjust the display angle of the digital human image according to the face deflection angle.

[0105] In one embodiment, the face image processing unit 720 is further used to obtain each set of coordinate information corresponding to the face image, perform distance comparison processing on each set of coordinate information, and confirm the coordinate information closest to the digital human image as the current coordinate information based on the processing result.

[0106] In one embodiment, the face image processing unit 720 is also used to obtain the first position coordinate information and the second position coordinate information of each group of corresponding coordinate information; obtain each image distance information according to the first position coordinate information and the second position coordinate information; compare and process each image distance information, and confirm the coordinate information of the image distance information corresponding to the maximum value as the current coordinate information.

[0107] In one embodiment, the deflection angle processing unit 730 is also used to obtain the screen resolution; obtain the face center point information according to the first position coordinate information and the second position coordinate information corresponding to the current coordinate information; and obtain the face deflection angle according to the screen resolution and the face center point information.

[0108] In one embodiment, the face image acquisition unit 710 is further used to acquire current video stream data, process the current video stream data, and obtain a face image.

[0109] In one embodiment, the digital human display device is further used to process the current video stream data, and based on the processing result, hide the digital human image when no face image is detected in the current video stream data.

[0110] In one embodiment, the digital human display device is further used to obtain current video stream data, process the current video stream data, and obtain gesture information; query and obtain response information based on the gesture information, and feed back the response information through the digital human image.

[0111] For the specific definition of the digital human display device, please refer to the definition of the digital human display method above, which will not be repeated here. Each module in the above digital human display device can be implemented in whole or in part by software, hardware and their combination. The above modules can be embedded in or independent of the processor in the display device in the form of hardware, or can be stored in the memory of the display device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0112] In one embodiment, a display device is provided. The display device may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, televisions, and conference tablets with display screens. The internal structure diagram of the display device may be as follows: Figure 8As shown. The display device includes a processor, a memory and a display screen connected through a system bus; the display device may also include a network interface and an input device. Among them, the processor of the display device is used to provide computing and control capabilities. The memory of the display device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the display device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a brightness adjustment method is implemented. The display screen of the display device can be a liquid crystal display screen, and the input device of the display device can be a touch layer covering the display screen, or a key, trackball or touchpad set on the display device housing, or an external keyboard, touchpad or mouse, etc.

[0113] Those skilled in the art will understand that Figure 8 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the display device to which the scheme of the present application is applied. The specific display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0114] In one embodiment, a display device is provided, the display device comprising a memory and a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

[0115] Acquire a face image; based on the face image, obtain the current coordinate information of the corresponding face image and activate the digital human image; based on the preset screen reference coordinate information, process the current coordinate information to obtain the face deflection angle; based on the face deflection angle, adjust the display angle of the digital human image.

[0116] Exemplarily, the display device may include a camera module, which is used to detect video data of the current environment and obtain current video stream data. The camera module may be integrated on the display device, for example, the camera module may be set in the middle of the upper frame of the display screen of the display device.

[0117] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0118] Each group of coordinate information corresponding to the face image is obtained, and each group of coordinate information is processed by distance comparison. According to the processing result, the coordinate information closest to the digital human image is confirmed as the current coordinate information.

[0119] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0120] The first position coordinate information and the second position coordinate information of each group of corresponding coordinate information are obtained; the distance information of each image is obtained according to the first position coordinate information and the second position coordinate information; the distance information of each image is compared and processed, and the coordinate information of the image distance information corresponding to the maximum value is confirmed as the current coordinate information.

[0121] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0122] Obtain screen resolution; obtain face center information based on first position coordinate information and second position coordinate information corresponding to current coordinate information; obtain face deflection angle based on screen resolution and face center information.

[0123] In one embodiment, when the processor executes the computer program, the processor further implements the following steps: acquiring current video stream data, processing the current video stream data, and obtaining a face image.

[0124] In one embodiment, when the processor executes the computer program, the following steps are also implemented: processing the current video stream data, and based on the processing result, hiding the digital human image when no face image is detected in the current video stream data.

[0125] In one embodiment, when the processor executes the computer program, the following steps are also implemented: acquiring current video stream data, processing the current video stream data, and obtaining gesture information; querying and obtaining response information according to the gesture information, and feeding back the response information through the digital human image.

[0126] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0127] Acquire a face image; based on the face image, obtain the current coordinate information of the corresponding face image and activate the digital human image; based on the preset screen reference coordinate information, process the current coordinate information to obtain the face deflection angle; based on the face deflection angle, adjust the display angle of the digital human image.

[0128] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0129] Each group of coordinate information corresponding to the face image is obtained, and each group of coordinate information is processed by distance comparison. According to the processing result, the coordinate information closest to the digital human image is confirmed as the current coordinate information.

[0130] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0131] The first position coordinate information and the second position coordinate information of each group of corresponding coordinate information are obtained; the distance information of each image is obtained according to the first position coordinate information and the second position coordinate information; the distance information of each image is compared and processed, and the coordinate information of the image distance information corresponding to the maximum value is confirmed as the current coordinate information.

[0132] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0133] Obtain screen resolution; obtain face center information based on first position coordinate information and second position coordinate information corresponding to current coordinate information; obtain face deflection angle based on screen resolution and face center information.

[0134] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining current video stream data, processing the current video stream data, and obtaining a face image.

[0135] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: processing the current video stream data, and based on the processing result, hiding the digital human image when no face image is detected in the current video stream data.

[0136] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: acquiring current video stream data, processing the current video stream data, and obtaining gesture information; querying and obtaining response information based on the gesture information, and feeding back the response information through the digital human image.

[0137] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0138] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0139] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be construed as limiting the scope of the patent application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent application shall be subject to the attached claims.

Claims

1. A digital human display method, It is characterized in that include: Get face image; According to the face image, obtaining current coordinate information corresponding to the face image, and activating the digital human image; The digital human image is a virtual simulation of the human body's form and function at different levels, and is displayed on a display screen; Processing the current coordinate information according to the preset screen reference coordinate information to obtain a face deflection angle; the face deflection angle refers to a deflection angle of the face in the face image relative to the front of the display screen; According to the face deflection angle, adjusting the display angle of the digital human image; The step of processing the current coordinate information according to the preset screen reference coordinate information to obtain the face deflection angle includes: Get the screen resolution; Obtaining face center point information according to the first position coordinate information and the second position coordinate information corresponding to the current coordinate information; The face deflection angle is obtained according to the screen resolution and the face center point information; the calculation formula of the face deflection angle is: Angle represents the face deflection angle, width represents the screen width corresponding to the screen resolution, and face _ Center represents the center point information of the face.

2. The digital human display method according to claim 1, It is characterized in that The step of obtaining current coordinate information corresponding to the face image according to the face image comprises: Each group of coordinate information corresponding to the face image is obtained, and each group of coordinate information is subjected to distance comparison processing, and according to the processing result, the coordinate information corresponding to the closest distance to the digital human image is confirmed as the current coordinate information.

3. The digital human display method according to claim 2, It is characterized in that The step of performing distance comparison processing on each group of coordinate information and confirming the coordinate information closest to the digital human image as the current coordinate information according to the processing result includes: Acquire the first position coordinate information and the second position coordinate information corresponding to each group of the coordinate information; Obtaining distance information of each image according to the first position coordinate information and the second position coordinate information; The image distance information is compared and processed, and the coordinate information of the image distance information corresponding to the maximum value is confirmed as the current coordinate information.

4. The digital human display method according to claim 1, It is characterized in that The first position coordinate information and the second position coordinate information are diagonal coordinate information to each other.

5. The digital human display method according to claim 1, It is characterized in that The step of obtaining a face image comprises: The current video stream data is acquired, and the current video stream data is processed to obtain the face image.

6. The digital human display method according to claim 5, It is characterized in that After the steps of obtaining the current video stream data, it includes: The current video stream data is processed, and according to the processing result, when no face image is detected in the current video stream data, the digital human image is hidden.

7. The digital human display method according to any one of claims 1 to 6, It is characterized in that Also includes: Acquire current video stream data, process the current video stream data, and obtain gesture information; According to the gesture information, response information is queried and fed back through the digital human image.

8. A digital human display device, It is characterized in that include: A face image acquisition unit, used for acquiring a face image; A face image processing unit, used to obtain current coordinate information corresponding to the face image according to the face image, and activate a digital human image; the digital human image is an image that performs virtual simulation of the human body at different levels of form and function and is displayed on a display screen; A deflection angle processing unit, used to process the current coordinate information according to preset screen reference coordinate information to obtain a face deflection angle; the face deflection angle refers to a deflection angle of the face in the face image relative to the front of the display screen; An angle adjustment unit, used to adjust the display angle of the digital human image according to the face deflection angle; The deflection angle processing unit is further used to: obtain screen resolution; obtain face center information according to the first position coordinate information and the second position coordinate information corresponding to the current coordinate information; obtain the face deflection angle according to the screen resolution and the face center information; the calculation formula of the face deflection angle is: Angle represents the face deflection angle, width represents the screen width corresponding to the screen resolution, and face _ Center represents the center point information of the face.

9. A display device, It is characterized in that The display device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the digital human display method described in any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Face recognition based 3D (three dimension) display self-adaptive adjusting method and face recognition based 3D display self-adaptive adjusting device

    CN102917232A

  • Screen rotation control method and system

    CN104125327A

  • Face image correction method and device and face recognition method and system

    CN105279473A

  • Face image correction method

    CN107358207A

  • Mobile end 3D face augmented reality realization method

    CN107958479A