Digital human model generation method and system, computer and storage medium

Abstract

The invention provides a digital human model generation method and system, a computer and a storage medium, and the method comprises the steps: obtaining the position of VR head-mounted equipment, and determining an area where a user is located according to the position of the VR head-mounted equipment; judging whether the area where the user is located enters a demonstration area or not; if yes, obtaining a picture collected by the VR head-mounted device; judging whether the picture acquired by the VR head-mounted equipment is matched with the target area or not; if yes, generating a digital human model of the corresponding target area, and displaying the digital human model in the VR head-mounted device; the VR head-mounted device is controlled in real time to recognize eyeballs of the user, determine pupil positions and pupil sizes, and interact with the digital human model according to the pupil positions and the pupil sizes, so that the digital human can perform personalized services, and the satisfaction degree of the user is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of digital human model generation, and in particular relates to a digital human model generation method, system, computer and storage medium. Background Art

[0002] Digital human models are the specific application of digital technology in the field of human body simulation, aiming to create digital human images close to human images through computer technology. These models not only strive to be realistic in appearance, but also have rich interactive capabilities and intelligent features.

[0003] Among them, digital human models have broad application prospects in multiple fields, including but not limited to the entertainment industry, education, medical health, financial services, and cultural tourism and museums. It should be noted that the current cultural relics museums basically explain the cultural relics manually. Some cultural relics museums broadcast by wearing smart headsets, that is, when users wearing smart headsets enter the preset area, the cultural relics explanation in that area is automatically played. Only a very small number of cultural relics museums use digital human models, and the digital human models only demonstrate and explain in fixed areas, and play in a loop, resulting in a poor user experience. Summary of the invention

[0004] Based on this, the embodiments of the present invention provide a digital human model generation method, system, computer and storage medium, aiming to solve the problem in the prior art that the digital human models used for explaining cultural relics in cultural relics museums have a low degree of intelligence, resulting in poor user experience.

[0005] A first aspect of an embodiment of the present invention provides a method for generating a digital human model, which is applied to a scenario of a VR head mounted device with eye recognition, wherein the VR head mounted device is used to display the digital human model, and the method includes:

[0006] Obtaining the position of the VR head mounted device, and determining the area where the user is located according to the position of the VR head mounted device;

[0007] Determine whether the area where the user is located has entered the demonstration area;

[0008] If yes, then obtain the images captured by the VR headset;

[0009] Determine whether the image captured by the VR headset matches the target area;

[0010] If yes, a digital human model of the corresponding target area is generated and displayed in the VR head mounted device;

[0011] The VR head mounted device is controlled in real time to recognize the user's eyeballs, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size.

[0012] Furthermore, the step of obtaining the position of the VR head mounted device and determining the area where the user is located according to the position of the VR head mounted device includes:

[0013] Establish a plan view of a preset area and a rectangular coordinate system corresponding to the plan view in advance, and divide the plan view into regions according to actual needs;

[0014] The coordinate position of the VR head mounted device is obtained, and the area falling into the plane diagram is determined according to the coordinate position and a plane rectangular coordinate system to determine the area where the user is located.

[0015] Furthermore, the step of determining whether the image captured by the VR head mounted device matches the target area includes:

[0016] Determine whether the user's demonstration area is unique;

[0017] If it is determined that the demonstration area where the user is located is unique, a first pattern of a preset shape is generated based on the image captured by the VR head mounted device according to the demonstration area, the first pattern changes dynamically as the coordinate position of the VR head mounted device changes, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern being relatively fixed in position to the display screen of the VR head mounted device;

[0018] If it is determined that the demonstration area where the user is located is not unique, a third pattern with a preset shape and transparency is generated respectively according to the demonstration area on the basis of the picture collected by the VR head-mounted device. When the user gradually approaches any demonstration area, the third pattern of the corresponding demonstration area is controlled to gradually become opaque to obtain the first pattern, and the third patterns of other demonstration areas gradually become transparent. At the same time, a second pattern matching the first pattern and with a fixed size is generated, and the second pattern is relatively fixed to the display screen of the VR head-mounted device.

[0019] determining whether the first image and the second image overlap;

[0020] If it is determined that the first image and the second image overlap, it means that the image captured by the VR head-mounted device is matched with the target area.

[0021] Furthermore, in the step of generating a digital human model of the corresponding target area and displaying it in the VR head mounted device, the image of the digital human model is pre-established according to the information carried in the target area.

[0022] Furthermore, the step of controlling the VR head mounted device to recognize the user's eyeballs in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size includes:

[0023] Controlling the generation of preset collection points in the display screen of the VR head mounted device, wherein the preset collection points are used to collect eye information of the user when observing different positions, wherein the eye information includes pupil position and pupil size, and obtaining the pupil position and pupil size at the preset collection points;

[0024] A user's visual focusing model is established based on preset acquisition points and corresponding pupil positions and pupil sizes. The visual focusing model is used to determine the focusing point based on the acquired pupil positions and pupil sizes.

[0025] Furthermore, before the step of controlling the VR head mounted device in real time to recognize the user's eyeballs, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size, the step also includes:

[0026] Marking each target object in the target area to obtain a first target sub-area representing a cultural relic entity;

[0027] A first mapping relationship between the first target sub-region and the audio corresponding to the text content is established.

[0028] Furthermore, the step of interacting with the digital human model according to the pupil position and pupil size includes:

[0029] Inputting the current pupil position and the current pupil size into the visual focus model to determine the current focus point of the user;

[0030] Determining whether the current focus point is within the first target sub-area;

[0031] If it is determined that the current focus point is within the first target sub-area, then according to the first mapping relationship, the audio is retrieved and expressed through the digital human model;

[0032] Obtaining the dwell time of the current focus point, and determining whether the dwell time is greater than a threshold;

[0033] If it is determined that the dwell time is greater than a threshold, an image is captured of a preset area of ​​the current focus point and the image is enlarged and presented;

[0034] Determine whether the captured image contains an allusion triggering area;

[0035] If it is determined that the captured image contains an allusion triggering area, the digital human model is controlled to display the allusion plot according to the allusion information corresponding to the allusion triggering area.

[0036] A second aspect of an embodiment of the present invention provides a digital human model generation system, which is used to implement the digital human model generation method provided in the first aspect, and the system includes:

[0037] A first acquisition module is used to acquire the position of the VR head mounted device, and determine the area where the user is located according to the position of the VR head mounted device;

[0038] The first judgment module is used to judge whether the area where the user is located enters the demonstration area;

[0039] The second acquisition module is used to acquire the images collected by the VR head-mounted device when it is determined that the area where the user is located enters the demonstration area;

[0040] The second judgment module is used to judge whether the picture collected by the VR head-mounted device matches the target area;

[0041] A generation module, for generating a digital human model of the corresponding target area and displaying it in the VR head mounted device when it is determined that the image captured by the VR head mounted device matches the target area;

[0042] The interaction module is used to control the VR head mounted device to recognize the user's eyeballs in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size.

[0043] A third aspect of an embodiment of the present invention provides a storage medium on which a computer program is stored. When the program is executed by a processor, the digital human model generation method provided in the first aspect is implemented.

[0044] A fourth aspect of an embodiment of the present invention provides a computer, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the digital human model generation method provided in the first aspect is implemented.

[0045] A method, system, computer and storage medium for generating a digital human model provided in an embodiment of the present invention, wherein the method obtains the position of a VR head mounted device, and determines the area where the user is located according to the position of the VR head mounted device; determines whether the area where the user is located enters a demonstration area; if so, obtains a picture collected by the VR head mounted device; determines whether the picture collected by the VR head mounted device matches the target area; if so, generates a digital human model of the corresponding target area and displays it in the VR head mounted device; controls the VR head mounted device to recognize the user's eyeballs in real time, determines the pupil position and pupil size, and interacts with the digital human model according to the pupil position and pupil size, so that the digital human can provide personalized services and improve user satisfaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A flowchart of a method for generating a digital human model according to the first embodiment of the present invention;

[0047] Figure 2 A structural block diagram of a digital human model generation system provided in Embodiment 2 of the present invention;

[0048] Figure 3 This is a structural block diagram of a computer provided in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0049] In order to facilitate the understanding of the present invention, the present invention will be described more fully below with reference to the relevant drawings. Several embodiments of the present invention are given in the drawings. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present invention more thorough and comprehensive.

[0050] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may be a central element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be a central element at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only.

[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art of the present invention. The terms used herein in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more related listed items.

[0052] Embodiment 1

[0053] According to an embodiment of the present invention, a method for generating a digital human model is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0054] In the first embodiment of the present invention, a method for generating a digital human model is provided, which can be used in an electronic device, such as a computer. It should be noted that the method is applied to a scenario of a VR head-mounted device with eye recognition, and the VR head-mounted device is used to display the digital human model. It should be noted that the VR head-mounted device can also have the function of playing audio, and the audio is transmitted to the user's ears through headphones.

[0055] See also Figure 1 , Figure 1 The flowchart of the implementation of a digital human model generation method provided in the first embodiment of the present invention is shown, which specifically includes steps S01 to S06.

[0056] Step S01, obtaining the position of the VR head mounted device, and determining the area where the user is located according to the position of the VR head mounted device.

[0057] Among them, the position of the VR head-mounted device can be determined by the positioning function of the VR head-mounted device. Specifically, the positioning function can be realized by GPS. Furthermore, in order to determine the area where the user is located, in this embodiment, a plan view of a preset area and a plane rectangular coordinate system corresponding to the plan view are pre-established. Exemplarily, the plan view may be a plan view of a cultural relics museum, and according to actual needs, the plan view is divided into areas, such as dividing areas for specific cultural relics; the coordinate position of the VR head-mounted device is obtained, and the area falling into the plan view is determined according to the coordinate position and the plane rectangular coordinate system to determine the area where the user is located.

[0058] In some other embodiments of the present invention, the VR head-mounted device may also be integrated with a radio frequency module. The radio frequency module in the VR head-mounted device matches the radio frequency modules in each area, that is, one receives signals and the other sends information. The demonstration area where the user is located is determined by radio frequency. It can be understood that the demonstration area where the user is located can also be determined by using coordinates and radio frequency methods at the same time.

[0059] Step S02, determine whether the area where the user is located enters the demonstration area, if so, execute step S03.

[0060] Step S03: obtaining images captured by the VR head mounted device.

[0061] Step S04, determine whether the image captured by the VR head-mounted device matches the target area. If so, execute step S05.

[0062] Specifically, it is determined whether the demonstration area where the user is located is unique. It can be understood that when the coordinate position of the user falls within the unique demonstration area, it means that the demonstration area where the user is located is unique;

[0063] If it is determined that the demonstration area where the user is located is unique, a first pattern of a preset shape is generated based on the picture collected by the VR head-mounted device according to the demonstration area, the first pattern changes dynamically as the coordinate position of the VR head-mounted device changes, and a second pattern matching the first pattern and having a fixed size is generated, and the second pattern is relatively fixed to the display screen position of the VR head-mounted device. It should be noted that, taking the VR head-mounted device as VR glasses as an example, the VR glasses are provided with a front camera for collecting pictures, wherein the collected pictures are equivalent to the pictures seen by human eyes, and by identifying the preset mark in the picture, a first pattern of a preset shape is generated according to the preset mark, such as a rectangular pattern, and the position of the rectangular pattern and the preset mark is relatively fixed. As the user walks into the rectangular pattern, the rectangular pattern displayed in the VR glasses will also be enlarged. The rectangular pattern can be set according to the outline of the display cabinet or other outlines that can surround the exhibits. The purpose of setting the first pattern is to allow the user to approach the exhibits and stand at the preset position for visiting. Correspondingly, the second pattern is also a rectangular pattern, but with a fixed size. When the first pattern overlaps with the second pattern, it indicates that the user is standing at a suitable position for visiting;

[0064] If it is determined that the demonstration area where the user is located is not unique, a third pattern with a preset shape and transparency is generated respectively according to the demonstration area based on the picture collected by the VR head-mounted device. When the user gradually approaches any demonstration area, the third pattern of the corresponding demonstration area is controlled to gradually become opaque to obtain the first pattern, and the third patterns of other demonstration areas gradually become transparent. At the same time, a second pattern matching the first pattern and with a fixed size is generated, and the second pattern is relatively fixed to the display screen of the VR head-mounted device.

[0065] Determining whether the first image and the second image overlap;

[0066] If it is determined that the first image and the second image coincide with each other, it means that the image captured by the VR head mounted device matches the target area;

[0067] In some other embodiments of the present invention, the VR head-mounted devices of all users are interconnected and electrically connected to a common controller, and a plurality of different patterns can be set to separate the users' standing positions. It can be understood that different patterns correspond to different visiting positions to avoid congestion and at the same time will not affect the visiting experience.

[0068] Step S05: generating a digital human model of the corresponding target area and displaying it in the VR head mounted device.

[0069] Specifically, the image of the digital human model is pre-established according to the information carried in the target area. For example, if the exhibit is the "Sword of Goujian", the digital human model of "King Goujian of Yue" is pre-established. When the user visits the "Sword of Goujian", the story is told through the digital human model of "King Goujian of Yue".

[0070] Step S06, controlling the VR head mounted device to recognize the user's eyeballs in real time, determining the pupil position and pupil size, and interacting with the digital human model according to the pupil position and pupil size.

[0071] It should be noted that the eye recognition of the VR headset can be achieved through the built-in Iris ID sensor or other eye recognition technologies. First, the display screen of the VR headset is controlled to generate preset collection points, which are used to collect the eye information of the user when observing different positions. The eye information includes the pupil position and pupil size, and the pupil position and pupil size at the preset collection points are obtained;

[0072] A user's visual focus model is established based on the preset collection points and the corresponding pupil position and pupil size. The visual focus model is used to determine the focus point based on the acquired pupil position and pupil size. Specifically, the visual focus model can be established using a mapping relationship, which requires arranging collection points of different distances in at least four directions, namely, up, down, left, and right, within the range of the display screen, and then obtaining the visual focus model through fitting.

[0073] At the same time, each target object in the target area is marked to obtain a first target sub-area representing the cultural relic entity, and the first target sub-area is also the outer contour of the cultural relic entity;

[0074] A first mapping relationship between the first target sub-region and the audio corresponding to the text content is established.

[0075] Subsequently, the current pupil position and the current pupil size are input into the visual focus model to determine the user's current focus point;

[0076] Determine whether the current focus point is within the first target sub-region;

[0077] If it is determined that the current focus point is within the first target sub-area, the audio is retrieved according to the first mapping relationship and expressed through the digital human model;

[0078] Get the dwell time of the current focus point and determine whether the dwell time is greater than a threshold;

[0079] If it is determined that the dwell time is greater than the threshold, it means that the user is observing carefully at this time, and an image is captured of the preset area of ​​the current focus point and enlarged for presentation so that the user can see more clearly, wherein the preset area of ​​the current focus point can be a circular area drawn with the current focus point as the center and a preset radius;

[0080] Determine whether the captured image contains an allusion triggering area, where the allusion triggering area may be the image outline of a specific person or object. When the captured image covers the allusion triggering area of ​​a preset area, it is considered to contain the allusion triggering area;

[0081] If it is determined that the captured image contains an allusion triggering area, the digital human model is controlled to display the allusion plot according to the allusion information corresponding to the allusion triggering area, wherein the display of the digital human model is pre-designed.

[0082] In summary, the digital human model generation method in the above-mentioned embodiment of the present invention obtains the position of the VR head-mounted device, and determines the area where the user is located according to the position of the VR head-mounted device; determines whether the area where the user is located enters the demonstration area; if so, obtains the picture collected by the VR head-mounted device; determines whether the picture collected by the VR head-mounted device matches the target area; if so, generates a digital human model of the corresponding target area and displays it in the VR head-mounted device; controls the VR head-mounted device in real time to recognize the user's eyeballs, determines the pupil position and pupil size, and interacts with the digital human model according to the pupil position and pupil size, so that the digital human can provide personalized services and improve user satisfaction.

[0083] Embodiment 2

[0084] See also Figure 2 , Figure 2 1 is a block diagram of a digital human model generation system provided in the second embodiment of the present invention. The digital human model generation system 200 is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0085] Specifically, the digital human model generation system 200 includes: a first acquisition module 21, a first judgment module 22, a second acquisition module 23, a second judgment module 24, a generation module 25 and an interaction module 26, wherein:

[0086] A first acquisition module 21 is used to acquire the position of the VR head mounted device, and determine the area where the user is located according to the position of the VR head mounted device;

[0087] The first judging module 22 is used to judge whether the area where the user is located enters the demonstration area;

[0088] The second acquisition module 23 is used to acquire the picture collected by the VR head-mounted device when it is determined that the area where the user is located enters the demonstration area;

[0089] The second judgment module 24 is used to judge whether the image captured by the VR head-mounted device matches the target area;

[0090] A generation module 25 is used to generate a digital human model of the corresponding target area when it is determined that the image captured by the VR head-mounted device matches the target area, and display it in the VR head-mounted device, wherein the image of the digital human model is pre-established according to the information carried in the target area;

[0091] The interaction module 26 is used to control the VR head mounted device to recognize the user's eyeballs in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size.

[0092] Further, in some optional embodiments of the present invention, the first acquisition module 21 includes:

[0093] A division unit is used to pre-establish a plan view of a preset area and a rectangular coordinate system corresponding to the plan view, and divide the plan view into regions according to actual needs;

[0094] The first acquisition unit is used to acquire the coordinate position of the VR head-mounted device, and determine the area falling into the plane diagram according to the coordinate position and a plane rectangular coordinate system to determine the area where the user is located.

[0095] Further, in some optional embodiments of the present invention, the second determination module 24 includes:

[0096] A first judging unit, used to judge whether the demonstration area where the user is located is unique;

[0097] A first generating unit is configured to generate a first pattern of a preset shape based on the image captured by the VR head mounted device according to the demonstration area if it is determined that the demonstration area where the user is located is unique, wherein the first pattern changes dynamically as the coordinate position of the VR head mounted device changes, and generate a second pattern matching the first pattern and having a fixed size, wherein the second pattern is relatively fixed to the display screen position of the VR head mounted device;

[0098] The second generating unit is used for generating, if it is determined that the demonstration area where the user is located is not unique, third patterns with a preset shape and transparency respectively according to the demonstration area and on the basis of the images collected by the VR head mounted device; when the user gradually approaches any demonstration area, the third pattern of the corresponding demonstration area is controlled to gradually become opaque to obtain the first pattern, and the third patterns of other demonstration areas are gradually turned transparent; at the same time, a second pattern matching the first pattern and having a fixed size is generated, and the second pattern is relatively fixed to the display screen position of the VR head mounted device;

[0099] A second determination unit, configured to determine whether the first image and the second image overlap;

[0100] If it is determined that the first image and the second image overlap, it means that the image captured by the VR head-mounted device is matched with the target area.

[0101] Furthermore, in some optional embodiments of the present invention, the digital human model generation system 200 includes:

[0102] A control module, used to control the generation of preset collection points in the display screen of the VR head mounted device, wherein the preset collection points are used to collect eye information of the user when observing different positions, wherein the eye information includes pupil position and pupil size, and obtain the pupil position and pupil size at the preset collection points;

[0103] The visual focus model establishment module is used to establish the user's visual focus model based on preset acquisition points and the corresponding pupil position and pupil size. The visual focus model is used to determine the focus point based on the acquired pupil position and pupil size.

[0104] Furthermore, in some optional embodiments of the present invention, the digital human model generation system 200 further includes:

[0105] A marking module, used for marking each target object in the target area to obtain a first target sub-area representing a cultural relic entity;

[0106] The first mapping relationship establishing module is used to establish a first mapping relationship between the first target sub-region and the audio corresponding to the text content.

[0107] Further, in some optional embodiments of the present invention, the interaction module 26 includes:

[0108] a determination unit, configured to input the current pupil position and the current pupil size into the visual focus model to determine the current focus point of the user;

[0109] A third judging unit, used to judge whether the current focus point is within the first target sub-area;

[0110] A first expression unit is used to retrieve audio according to the first mapping relationship and express it through the digital human model if it is determined that the current focus point is within the first target sub-area;

[0111] a fourth judgment unit, configured to obtain a dwell time of the current focus point and judge whether the dwell time is greater than a threshold;

[0112] An image capture unit, configured to capture an image of a preset area of ​​the current focus point and enlarge and present the image if it is determined that the dwell time is greater than a threshold;

[0113] A fifth judging unit, used for judging whether the captured image contains an allusion triggering area;

[0114] The display unit is used to control the digital human model to display the allusion plot according to the allusion information corresponding to the allusion triggering area if it is determined that the intercepted image contains the allusion triggering area.

[0115] Embodiment 3

[0116] Another aspect of the present invention provides a computer. Figure 3 , shown is a computer in Embodiment 3 of the present invention, including a memory 20, a processor 10, and a computer program 30 stored in the memory and executable on the processor. When the processor 10 executes the computer program 30, the digital human model generation method as described above is implemented.

[0117] In some embodiments, the processor 10 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor or other data processing chip, used to run program codes or process data stored in the memory 20, such as executing access restriction programs.

[0118] The memory 20 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., an SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. In some embodiments, the memory 20 may be an internal storage unit of a computer, such as a hard disk of the computer. In other embodiments, the memory 20 may also be an external storage device of a computer, such as a plug-in hard disk equipped on a computer, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Further, the memory 20 may also include both an internal storage unit of a computer and an external storage device. The memory 20 may be used not only to store the application software and various types of data of the computer, but also to temporarily store data that has been output or is to be output.

[0119] It should be pointed out that Figure 3 The structure shown does not constitute a limitation on the computer. In other embodiments, the computer may include fewer or more components than shown in the figure, or combine certain components, or arrange the components differently.

[0120] The embodiment of the present invention further provides a storage medium, that is, a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the digital human model generation method as described above is implemented.

[0121] Those skilled in the art will appreciate that the logic and / or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in conjunction with such instruction execution systems, devices or apparatuses. For purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in conjunction with such instruction execution systems, devices or apparatuses.

[0122] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0123] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or a combination thereof: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0124] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0125] The above embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present invention. It should be pointed out that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention patent shall be subject to the attached claims.

Claims

1. A method for generating a digital human model, characterized in that: Applied in a scenario of a VR head mounted device with eyeball recognition, the VR head mounted device is used to display a digital human model, and the method includes: Obtaining the position of the VR head mounted device, and determining the area where the user is located according to the position of the VR head mounted device; Determine whether the area where the user is located has entered the demonstration area; If yes, then obtain the images captured by the VR headset; Determine whether the image captured by the VR headset matches the target area; If yes, a digital human model of the corresponding target area is generated and displayed in the VR head mounted device; The VR head mounted device is controlled in real time to recognize the user's eyeballs, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size.

2. The method for generating a digital human model according to claim 1, characterized in that: The step of obtaining the position of the VR head mounted device and determining the area where the user is located according to the position of the VR head mounted device comprises: Establish a plan view of a preset area and a rectangular coordinate system corresponding to the plan view in advance, and divide the plan view into regions according to actual needs; The coordinate position of the VR head mounted device is obtained, and the area falling into the plane diagram is determined according to the coordinate position and a plane rectangular coordinate system to determine the area where the user is located.

3. The method for generating a digital human model according to claim 2, characterized in that: The step of determining whether the image captured by the VR head mounted device matches the target area comprises: Determine whether the user's demonstration area is unique; If it is determined that the demonstration area where the user is located is unique, a first pattern of a preset shape is generated based on the image captured by the VR head mounted device according to the demonstration area, the first pattern changes dynamically as the coordinate position of the VR head mounted device changes, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern being relatively fixed in position to the display screen of the VR head mounted device; If it is determined that the demonstration area where the user is located is not unique, a third pattern with a preset shape and transparency is generated respectively according to the demonstration area on the basis of the picture collected by the VR head-mounted device. When the user gradually approaches any demonstration area, the third pattern of the corresponding demonstration area is controlled to gradually become opaque to obtain the first pattern, and the third patterns of other demonstration areas gradually become transparent. At the same time, a second pattern matching the first pattern and with a fixed size is generated, and the second pattern is relatively fixed to the display screen of the VR head-mounted device. determining whether the first image and the second image overlap; If it is determined that the first image and the second image overlap, it means that the image captured by the VR head-mounted device is matched with the target area.

4. The method for generating a digital human model according to claim 3, characterized in that: In the step of generating a digital human model of the corresponding target area and displaying it in the VR head mounted device, the image of the digital human model is pre-established according to the information carried in the target area.

5. The method for generating a digital human model according to claim 4, characterized in that: The step of controlling the VR head mounted device to recognize the user's eyeballs in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size includes: Controlling the generation of preset collection points in the display screen of the VR head mounted device, wherein the preset collection points are used to collect eye information of the user when observing different positions, wherein the eye information includes pupil position and pupil size, and obtaining the pupil position and pupil size at the preset collection points; A user's visual focusing model is established based on preset acquisition points and corresponding pupil positions and pupil sizes. The visual focusing model is used to determine the focusing point based on the acquired pupil positions and pupil sizes.

6. The method for generating a digital human model according to claim 5, characterized in that: Before the step of controlling the VR head mounted device to recognize the user's eyeballs in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size, the step also includes: Marking each target object in the target area to obtain a first target sub-area representing a cultural relic entity; A first mapping relationship between the first target sub-region and the audio corresponding to the text content is established.

7. The method for generating a digital human model according to claim 6, characterized in that: The step of interacting with the digital human model according to the pupil position and pupil size comprises: Inputting the current pupil position and the current pupil size into the visual focus model to determine the current focus point of the user; Determining whether the current focus point is within the first target sub-area; If it is determined that the current focus point is within the first target sub-area, the audio is retrieved according to the first mapping relationship and expressed through the digital human model; Obtaining the dwell time of the current focus point, and determining whether the dwell time is greater than a threshold; If it is determined that the dwell time is greater than a threshold, an image is captured of a preset area of ​​the current focus point and the image is enlarged and presented; Determine whether the captured image contains an allusion triggering area; If it is determined that the captured image contains an allusion triggering area, the digital human model is controlled to display the allusion plot according to the allusion information corresponding to the allusion triggering area.

8. A digital human model generation system, characterized in that: Used to implement the digital human model generation method according to any one of claims 1 to 7, the system comprises: A first acquisition module is used to acquire the position of the VR head mounted device, and determine the area where the user is located according to the position of the VR head mounted device; The first judgment module is used to judge whether the area where the user is located enters the demonstration area; The second acquisition module is used to acquire the images collected by the VR head-mounted device when it is determined that the area where the user is located enters the demonstration area; The second judgment module is used to judge whether the picture collected by the VR head-mounted device matches the target area; A generation module, for generating a digital human model of the corresponding target area and displaying it in the VR head mounted device when it is determined that the image captured by the VR head mounted device matches the target area; The interaction module is used to control the VR head mounted device to recognize the user's eyeballs in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size.

9. A storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the digital human model generation method as described in any one of claims 1 to 7 is implemented.

10. A computer, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for generating a digital human model according to any one of claims 1 to 7 is implemented.

Images