A digital human model generation method, system, computer and storage medium

Abstract

The application provides a digital human model generation method and system, a computer and a storage medium, the method comprises the following steps: acquiring the position of a VR head-mounted device; determining the area where the user is located according to the position of the VR head-mounted device; judging whether the area where the user is located enters a demonstration area; if yes, acquiring a picture collected by the VR head-mounted device; judging whether the picture collected by the VR head-mounted device is matched with a target area; if yes, generating a digital human model corresponding to the target area and displaying the digital human model in the VR head-mounted device; controlling the VR head-mounted device to recognize the eyeballs of the user in real time, determining the pupil position and the pupil size, and interacting with the digital human model according to the pupil position and the pupil size, so that the digital human can provide personalized services and improve the user satisfaction.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of digital human model generation, and particularly relates to a digital human model generation method and system, a computer and a storage medium. BACKGROUND

[0002] A digital human model is a specific application of digital technology in the field of human simulation, aiming to create a digital character image close to human image through computer technology. These models not only strive for realistic appearance, but also have rich interactive ability and intelligent characteristics.

[0003] Among them, the digital human model has wide application prospects in many fields, including but not limited to the entertainment industry, the education field, medical health, financial services, and cultural tourism and cultural relics museums. It should be noted that the current cultural relics museum basically explains cultural relics through artificial means, and some cultural relics museums broadcast through wearing smart earphones, that is, when the user wearing the smart earphone enters the preset area, the cultural relics explanation of the area is automatically played. Only a small part of cultural relics museums use digital human models, and the digital human models only demonstrate and explain in fixed areas and in a loop playing mode, resulting in poor user experience. SUMMARY

[0004] Therefore, in the embodiments of the present application, a digital human model generation method, system, computer and storage medium are provided to solve the problem of low intelligence of the digital human model for cultural relics explanation in the cultural relics museum in the prior art, resulting in poor user experience.

[0005] The first aspect of the embodiment of the present application provides a digital human model generation method applied to a scene with eye recognition of a VR head-mounted device, the VR head-mounted device being used to display a digital human model, and the method comprising:

[0006] obtaining the position of the VR head-mounted device, and determining the area where the user is located according to the position of the VR head-mounted device;

[0007] determining whether the area where the user is located enters a demonstration area;

[0008] if yes, obtaining a picture collected through the VR head-mounted device;

[0009] determining whether the picture collected through the VR head-mounted device matches a target area;

[0010] if yes, generating a digital human model corresponding to the target area and displaying it in the VR head-mounted device;

[0011] Real-time control of the VR head-mounted device on the user's eyeball recognition, determine the pupil position and pupil size, and according to the pupil position and pupil size, interact with the digital human model.

[0012] Further, the step of acquiring the position of the VR head-mounted device, determining the area where the user is located according to the position of the VR head-mounted device comprises:

[0013] The plan of the preset area is established in advance, and the plan is divided into areas according to actual needs;

[0014] The coordinate position of the VR head-mounted device is acquired, and the area falling into the plan is determined according to the coordinate position and the plan rectangular coordinate system, so as to determine the area where the user is located.

[0015] Further, the step of judging whether the picture collected by the VR head-mounted device matches the target area comprises:

[0016] Judge whether the demonstration area where the user is located is unique;

[0017] If it is judged that the demonstration area where the user is located is unique, a first pattern of a preset shape is generated on the basis of the picture collected by the VR head-mounted device according to the demonstration area, the first pattern dynamically changes with the coordinate position of the VR head-mounted device, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern is relatively fixed with the display screen position of the VR head-mounted device;

[0018] If it is judged that the demonstration area where the user is located is not unique, a third pattern of a preset shape with transparency is generated on the basis of the picture collected by the VR head-mounted device according to the demonstration area, when the user gradually approaches any demonstration area, the third pattern of the corresponding demonstration area is controlled to gradually become opaque to obtain the first pattern, the third pattern of other demonstration areas gradually becomes transparent, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern is relatively fixed with the display screen position of the VR head-mounted device;

[0019] Judge whether the first image and the second image coincide;

[0020] If it is judged that the first image and the second image coincide, it means that the picture collected by the VR head-mounted device matches the target area.

[0021] Further, in the step of generating a digital human model corresponding to the target area and displaying in the VR head-mounted device, the image of the digital human model is established in advance according to the information carried in the target area.

[0022] Further, the step of real-time controlling the VR head-mounted device to recognize the eyeballs of the user, determining the pupil position and the pupil size, and interacting with the digital human model according to the pupil position and the pupil size further comprises:

[0023] controlling a preset collection point to be generated in a display screen of the VR head-mounted device, the preset collection point being used to collect eyeball information of the user when observing different positions, the eyeball information including the pupil position and the pupil size, and the pupil position and the pupil size at the preset collection point being acquired;

[0024] establishing a visual focus model of the user according to the preset collection point and the corresponding pupil position and pupil size, the visual focus model being used to determine a focus point according to the acquired pupil position and pupil size.

[0025] Further, the step of real-time controlling the VR head-mounted device to recognize the eyeballs of the user, determining the pupil position and the pupil size, and interacting with the digital human model according to the pupil position and the pupil size further comprises:

[0026] labeling each target object in the target area to obtain a first target sub-area representing the cultural relic entity;

[0027] establishing a first mapping relationship between the first target sub-area and audio corresponding to the text content.

[0028] Further, the step of interacting with the digital human model according to the pupil position and the pupil size comprises:

[0029] inputting the current pupil position and the current pupil size into the visual focus model to determine the current focus point of the user;

[0030] determining whether the current focus point is in the first target sub-area;

[0031] if it is determined that the current focus point is in the first target sub-area, retrieving the audio according to the first mapping relationship and expressing the audio through the digital human model;

[0032] acquiring a dwell time of the current focus point and determining whether the dwell time is greater than a threshold value;

[0033] if it is determined that the dwell time is greater than the threshold value, performing image cropping on a preset area of the current focus point and enlarging the image;

[0034] determining whether the cropped image contains an allusion trigger area;

[0035] if it is determined that the cropped image contains the allusion trigger area, controlling the digital human model to display an allusion plot according to allusion information corresponding to the allusion trigger area.

[0036] The second aspect of the embodiment of the present application provides a digital human model generation system for implementing the digital human model generation method provided by the first aspect, and the system comprises:

[0037] The first acquisition module is configured to acquire the position of the VR head-mounted device, and determine the area where the user is located according to the position of the VR head-mounted device.

[0038] The first judgment module is configured to judge whether the area where the user is located enters the demonstration area.

[0039] The second acquisition module is configured to acquire the picture collected by the VR head-mounted device when it is judged that the area where the user is located enters the demonstration area.

[0040] The second judgment module is configured to judge whether the picture collected by the VR head-mounted device is matched with the target area.

[0041] The generation module is configured to generate the digital human model of the corresponding target area and display it in the VR head-mounted device when it is judged that the picture collected by the VR head-mounted device is matched with the target area.

[0042] The interaction module is configured to control the eyeball recognition of the user by the VR head-mounted device in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size.

[0043] The third aspect of the embodiment of the present application provides a storage medium having a computer program stored thereon, and the program is executed by a processor to implement the digital human model generation method provided by the first aspect.

[0044] The fourth aspect of the embodiment of the present application provides a computer comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the digital human model generation method provided by the first aspect when executing the program.

[0045] The digital human model generation method, system, computer and storage medium provided by the embodiment of the present application acquire the position of the VR head-mounted device, determine the area where the user is located according to the position of the VR head-mounted device, judge whether the area where the user is located enters the demonstration area, acquire the picture collected by the VR head-mounted device if the area where the user is located enters the demonstration area, judge whether the picture collected by the VR head-mounted device is matched with the target area, generate the digital human model of the corresponding target area and display it in the VR head-mounted device if the picture collected by the VR head-mounted device is matched with the target area, control the eyeball recognition of the user by the VR head-mounted device in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size, so that the digital human can provide personalized service and improve user satisfaction. BRIEF DESCRIPTION OF DRAWINGS

[0046] Figure 1 An implementation flow chart of a digital human model generation method provided for embodiment one of the present application is shown in FIG. 1.

[0047] Figure 2 A structural block diagram of a digital human model generation system provided for embodiment two of the present application is shown in FIG. 2.

[0048] Figure 3 A structural block diagram of a computer provided for embodiment three of the present application is shown in FIG. 3. DETAILED DESCRIPTION

[0049] In order to facilitate the understanding of the present application, the present application will be described in more detail below with reference to the relevant drawings. The drawings show several embodiments of the present application. However, the present application can be implemented in many different forms, and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0050] It should be noted that when an element is referred to as being "fixedly attached" to another element, it can be directly on the other element or there can be an intervening element. When an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements can be present. As used herein the terms "vertical", "horizontal", "left", "right", and the like are merely used for the purpose of illustration.

[0051] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0052] Embodiment one

[0053] According to the embodiments of the present application, a digital human model generation method is provided. It should be noted that the steps shown in the flow chart of the drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flow chart, in some cases, the steps shown or described herein can be executed in an order different from that shown herein.

[0054] The embodiment one of the present application provides a digital human model generation method, which can be used in an electronic device, such as a computer, and needs to be explained that the method is applied to the scene of a VR head-mounted device with eyeball recognition, and the VR head-mounted device is used for displaying a digital human model, and it needs to be explained that the VR head-mounted device can also have the function of playing audio, and the audio is transmitted to the ears of the user through earphones.

[0055] Please refer to Figure 1 , Figure 1 An implementation flowchart of the digital human model generation method provided by the embodiment one of the present application is shown, and specifically includes steps S01 to S06.

[0056] In step S01, the position of the VR head-mounted device is acquired, and the area where the user is located is determined according to the position of the VR head-mounted device.

[0057] In the embodiment, the position of the VR head-mounted device can be determined through the positioning function of the VR head-mounted device, and specifically, the positioning function can be realized through GPS, and further, in order to determine the area where the user is located, a plan of a preset area and a plan rectangular coordinate system corresponding to the plan are established in advance in the embodiment, and the plan can be the plan of a cultural relic museum, and the plan is divided into areas according to actual needs, for example, the area of a specific cultural relic is divided; the coordinate position of the VR head-mounted device is acquired, and the area falling into the plan is determined according to the coordinate position and the plan rectangular coordinate system, so as to determine the area where the user is located.

[0058] In some other embodiments of the present application, the VR head-mounted device can also be integrated with a radio frequency module, and the radio frequency module in the VR head-mounted device is matched with the radio frequency module of each area, that is, one receives a signal and one sends information, and the area where the user is located is determined through the radio frequency, and it can be understood that the method of using coordinates and radio frequency can also be used to determine the demonstration area where the user is located.

[0059] In step S02, it is judged whether the area where the user is located enters a demonstration area, and if yes, step S03 is executed.

[0060] In step S03, the picture collected through the VR head-mounted device is acquired.

[0061] In step S04, it is judged whether the picture collected through the VR head-mounted device is matched with a target area, and if yes, step S05 is executed.

[0062] Specifically, it is judged whether the demonstration area where the user is located is unique, and it can be understood that when the coordinate position of the user falls into a unique demonstration area, it is indicated that the demonstration area where the user is located is unique.

[0063] If it is judged that the demonstration area where the user is located is unique, a first pattern of a preset shape is generated on the basis of the picture collected by the VR head-mounted device according to the demonstration area, the first pattern dynamically changes with the coordinate position of the VR head-mounted device, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern is relatively fixed with the display screen position of the VR head-mounted device. It should be noted that the VR head-mounted device is taken as a VR glasses for example, the front camera is arranged on the VR glasses, which is used to collect the picture, wherein the collected picture is equivalent to the picture seen by the human eye, the first pattern of the preset shape is generated by recognizing the preset identifier in the picture, for example, a rectangular pattern, which is relatively fixed with the position of the preset identifier, and the rectangular pattern displayed in the VR glasses will be enlarged as the user walks into the rectangular pattern. The rectangular pattern can be set according to the showcase contour or other contours that can surround the exhibits. The purpose of setting the first pattern is to let the user approach the exhibits and stand at a preset position for visiting. Correspondingly, the second pattern is also a rectangular pattern, but the size is fixed. When the first pattern coincides with the second pattern, it indicates that the user stands at a suitable position for visiting.

[0064] If it is judged that the demonstration area where the user is located is not unique, a third pattern having a transparency of a preset shape is generated on the basis of the picture collected by the VR head-mounted device according to the demonstration area, when the user gradually approaches any demonstration area, the third pattern of the corresponding demonstration area is controlled to gradually become opaque to obtain the first pattern, the third patterns of other demonstration areas gradually become transparent, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern is relatively fixed with the display screen position of the VR head-mounted device.

[0065] It is judged whether the first image coincides with the second image.

[0066] If it is judged that the first image coincides with the second image, it indicates that the picture collected by the VR head-mounted device is matched with the target area.

[0067] In some other embodiments of the application, the VR head-mounted devices of all users are interconnected and electrically connected with a common controller, different patterns can be set to separate the standing positions of the users. It can be understood that different patterns correspond to different visiting positions to avoid congestion and also do not affect the visiting experience.

[0068] In step S05, a digital human model corresponding to the target area is generated and displayed in the VR head-mounted device.

[0069] Specifically, the image of the digital human model is pre-established according to the information carried in the target area. For example, if the exhibit is the "Goujian Sword", a digital human model of "King Goujian" is pre-established. When the user visits the "Goujian Sword", the digital human model of "King Goujian" is used to tell the story.

[0070] In step S06, the VR headset is controlled to identify the eyeballs of the user in real time, determine the pupil position and pupil size, and interact with the digital human model according to the pupil position and pupil size.

[0071] It should be noted that the eyeball recognition of the VR headset can be achieved by an Iris ID sensor or other eyeball recognition technology. First, a preset collection point is generated in the display screen of the VR headset. The preset collection point is used to collect eyeball information when the user observes different positions. The eyeball information includes the pupil position and the pupil size. The pupil position and the pupil size at the preset collection point are obtained.

[0072] According to the preset collection point and the corresponding pupil position and pupil size, a visual focus model of the user is established. The visual focus model is used to determine the focus point according to the obtained pupil position and pupil size. Specifically, the visual focus model can be established by a mapping relationship. Collection points with different distances in at least four directions (up, down, left, and right) within the range of the display screen are arranged. The visual focus model is obtained by fitting.

[0073] Meanwhile, each target object in the target area is marked to obtain a first target sub-area representing the cultural relic entity. The first target sub-area is the outer contour of the cultural relic entity.

[0074] A first mapping relationship between the first target sub-area and the audio corresponding to the text content is established.

[0075] Subsequently, the current pupil position and the current pupil size are input into the visual focus model to determine the current focus point of the user.

[0076] It is determined whether the current focus point is within the first target sub-area.

[0077] If it is determined that the current focus point is within the first target sub-area, the audio is retrieved according to the first mapping relationship, and the digital human model is used to express the audio.

[0078] The residence time of the current focus point is obtained, and it is determined whether the residence time is greater than a threshold value.

[0079] If it is determined that the residence time is greater than the threshold value, it indicates that the user is carefully observing at this time. The image of the preset area of the current focus point is intercepted and enlarged for presentation, so that the user can see more clearly. The preset area of the current focus point can be a circular area with the current focus point as the center and a preset radius.

[0080] determine whether the intercepted image contains a classic trigger area, the classic trigger area can be an image contour of a certain specific person or object, and when the intercepted image covers a preset area of the classic trigger area, it is considered to contain the classic trigger area;

[0081] If it is determined that the intercepted image contains the classic trigger area, the digital human model is controlled to display the classic plot according to the classic information corresponding to the classic trigger area, wherein the display of the digital human model is pre-designed.

[0082] In summary, the digital human model generation method in the above embodiments of the present application, the method acquires the position of the VR headset, determines the area where the user is located according to the position of the VR headset, determines whether the area where the user is located enters the demonstration area, acquires the picture collected by the VR headset if it does, determines whether the picture collected by the VR headset matches the target area, generates the digital human model of the corresponding target area and displays it in the VR headset if it does, controls the VR headset to recognize the user's eyeballs in real time, determines the pupil position and pupil size, and interacts with the digital human model according to the pupil position and pupil size, so that the digital human can provide personalized service and improve user satisfaction.

[0083] Embodiment Two

[0084] Please refer to Figure 2 , Figure 2 is a structural block diagram of a digital human model generation system provided by the second embodiment of the present application, which is used to realize the above embodiments and preferred embodiments, and details have been described. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, hardware or a combination of software and hardware is also possible and is contemplated.

[0085] Specifically, the digital human model generation system 200 includes a first acquisition module 21, a first judgment module 22, a second acquisition module 23, a second judgment module 24, a generation module 25, and an interaction module 26, wherein:

[0086] The first acquisition module 21 is configured to acquire the position of the VR headset, and determine the area where the user is located according to the position of the VR headset;

[0087] The first judgment module 22 is configured to determine whether the area where the user is located enters the demonstration area;

[0088] The second acquisition module 23 is configured to acquire the picture collected by the VR headset when it is determined that the area where the user is located enters the demonstration area.

[0089] The second judging module 24 is configured to judge whether the picture collected by the VR head-mounted device matches the target area;

[0090] The generating module 25 is configured to generate a digital human model of the corresponding target area and display the digital human model in the VR head-mounted device when it is judged that the picture collected by the VR head-mounted device matches the target area, wherein the image of the digital human model is established in advance according to the information carried in the target area.

[0091] The interaction module 26 is configured to control the VR head-mounted device to recognize the eyeballs of the user in real time, determine the pupil position and the pupil size, and interact with the digital human model according to the pupil position and the pupil size.

[0092] Further, in some optional embodiments of the present application, the first obtaining module 21 comprises:

[0093] The dividing unit is configured to pre-establish a plan view of a preset area and a plan rectangular coordinate system corresponding to the plan view, and divide the plan view into regions according to actual needs;

[0094] The first obtaining unit is configured to obtain the coordinate position of the VR head-mounted device, and determine the region falling into the plan view according to the coordinate position and the plan rectangular coordinate system, so as to determine the region where the user is located.

[0095] Further, in some optional embodiments of the present application, the second judging module 24 comprises:

[0096] The first judging unit is configured to judge whether the demonstration region where the user is located is unique.

[0097] The first generating unit is configured to generate a first pattern of a preset shape on the basis of the picture collected by the VR head-mounted device according to the demonstration region if it is judged that the demonstration region where the user is located is unique, the first pattern dynamically changes with the change of the coordinate position of the VR head-mounted device, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern is relatively fixed with the position of the display screen of the VR head-mounted device.

[0098] The second generating unit is configured to generate a third pattern of a preset shape having transparency on the basis of the picture collected by the VR head-mounted device according to the demonstration region if it is judged that the demonstration region where the user is located is not unique, the third pattern of the corresponding demonstration region gradually becomes opaque when the user gradually approaches the demonstration region, so as to obtain the first pattern, the third pattern of the other demonstration region gradually becomes transparent, and a second pattern matching the first pattern and having a fixed size is generated, the second pattern is relatively fixed with the position of the display screen of the VR head-mounted device.

[0099] a second determining unit, configured to determine whether the first image and the second image coincide;

[0100] If it is determined that the first image and the second image coincide, it indicates that the picture collected by the VR head-mounted device and the target region are matched.

[0101] Further, in some optional embodiments of the present application, the digital human model generation system 200 comprises:

[0102] a control module, configured to control a preset collection point to be generated in a display screen of the VR head-mounted device, the preset collection point being used to collect eyeball information of the user when observing different positions, the eyeball information comprising a pupil position and a pupil size, and the control module is further configured to acquire the pupil position and the pupil size at the preset collection point;

[0103] a visual focus model establishing module, configured to establish a visual focus model of the user according to the preset collection point and the corresponding pupil position and pupil size, the visual focus model being used to determine a focus point according to the acquired pupil position and pupil size.

[0104] Further, in some optional embodiments of the present application, the digital human model generation system 200 further comprises:

[0105] a marking module, configured to mark each target object in the target region to obtain a first target sub-region representing a cultural relic entity;

[0106] a first mapping relationship establishing module, configured to establish a first mapping relationship between the first target sub-region and audio corresponding to the text content.

[0107] Further, in some optional embodiments of the present application, the interaction module 26 comprises:

[0108] a determining unit, configured to input a current pupil position and a current pupil size into the visual focus model to determine a current focus point of the user;

[0109] a third determining unit, configured to determine whether the current focus point is in the first target sub-region;

[0110] a first expression unit, configured to, if it is determined that the current focus point is in the first target sub-region, retrieve audio according to the first mapping relationship and express the audio through the digital human model;

[0111] a fourth determining unit, configured to acquire a staying time of the current focus point and determine whether the staying time is greater than a threshold value;

[0112] An image intercepting unit is configured to intercept an image of a preset area of the current focus point and present the image in an enlarged manner if the stay time is greater than the threshold.

[0113] A fifth judging unit is configured to judge whether the intercepted image contains the allusion trigger area.

[0114] A presentation unit is configured to control the digital human model to present the allusion plot according to the allusion information corresponding to the allusion trigger area if the intercepted image contains the allusion trigger area.

[0115] Embodiment three

[0116] Another aspect of the present application also provides a computer, please refer to Figure 3 , which is a computer in the embodiment three of the present application, comprising a memory 20, a processor 10 and a computer program 30 stored in the memory and executable on the processor, the processor 10 executes the computer program 30 to realize the digital human model generation method as described above.

[0117] In some embodiments, the processor 10 can be a central processing unit (CPU), a controller, a microcontroller, a microprocessor or other data processing chip, used to run the program code stored in the memory 20 or process data, for example, to execute the access restriction program.

[0118] In some embodiments, the memory 20 can be an internal storage unit of the computer, for example, the hard disk of the computer. In other embodiments, the memory 20 can also be an external storage device of the computer, for example, the plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc. equipped on the computer. Further, the memory 20 can include both the internal storage unit and the external storage device of the computer. The memory 20 can be used not only to store the application software and various data of the computer, but also to temporarily store the data that has been output or will be output.

[0119] It should be noted that Figure 3 The structure shown does not constitute a limitation on the computer, in other embodiments, the computer can include fewer or more components than shown, or combine certain components, or different component arrangements.

[0120] The embodiment of the present application also provides a storage medium, namely a computer readable storage medium, which stores a computer program. The program is executed by a processor to implement the digital human model generation method.

[0121] Those skilled in the art can understand that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a list of executable instructions for implementing the logic function, which can be specifically implemented in any computer readable medium for use by an instruction execution system, device or apparatus, such as a computer-based system, a system including a processor or other system that can fetch and execute instructions from the instruction execution system, device or apparatus, or in conjunction with these instructions execution system, device or apparatus. For the present specification, the "computer readable medium" can be any device that can contain, store, communicate, propagate or transport programs for use by an instruction execution system, device or apparatus or in conjunction with these instruction execution system, device or apparatus.

[0122] More specific examples (a non-exhaustive list) of the computer readable medium include the following: an electrical connection having one or more wires (electrical devices), a portable computer diskette (magnetic devices), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium can even be paper or other suitable medium on which the program is printed, as the program can be electronically obtained, for example, by optical scanning of the paper or other medium, followed by electronic conversion of the obtained program into a computer readable medium, and then storing the program in a computer memory.

[0123] It should be understood that parts of the present application can be realized in hardware, software, firmware or a combination thereof. In the above-described embodiments, a plurality of steps or methods can be realized by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if realized in hardware, and as in another embodiment, any one or a combination of the following technologies known in the art can be used: discrete logic circuit with logic gate circuit for implementing logic function on data signal, application specific integrated circuit with suitable combination logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA), etc.

[0124] In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "an example", "a specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the present specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any appropriate manner in one or more embodiments or examples.

[0125] The above embodiments only express several implementation manners of the present application, which are described in a more specific and detailed manner, but cannot be understood as the limitation of the patent scope of the present application. It should be noted that, for those skilled in the art, several modifications and improvements can be made without departing from the concept of the present application, which are all within the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A digital human model generation method, characterized by, The method is applied to a scene of a VR head-mounted device with eye recognition, the VR head-mounted device is used to display a digital human model, and the method comprises the following steps: acquiring a position of the VR head-mounted device, determining an area where a user is located according to the position of the VR head-mounted device; determining whether the area where the user is located enters a demonstration area; if yes, acquiring a picture collected by the VR head-mounted device; determining whether the picture collected by the VR head-mounted device is matched with a target area; if yes, generating a digital human model corresponding to the target area and displaying the digital human model in the VR head-mounted device; controlling eye recognition of the VR head-mounted device on the user in real time, determining a pupil position and a pupil size, and interacting with the digital human model according to the pupil position and the pupil size. The step of determining whether the picture collected by the VR head-mounted device is matched with the target area comprises the following steps: determining whether the demonstration area where the user is located is unique; if it is determined that the demonstration area where the user is located is unique, generating a first pattern of a preset shape on the basis of the picture collected by the VR head-mounted device according to the demonstration area, the first pattern dynamically changing with a coordinate position of the VR head-mounted device, and generating a second pattern matched with the first pattern and fixed in size, the second pattern being relatively fixed with a display screen position of the VR head-mounted device; if it is determined that the demonstration area where the user is located is not unique, generating a third pattern of a preset shape with transparency on the basis of the picture collected by the VR head-mounted device according to the demonstration area, the third pattern of the corresponding demonstration area gradually becoming opaque when the user gradually approaches any demonstration area to obtain the first pattern, the third pattern of the other demonstration areas gradually becoming transparent, and generating a second pattern matched with the first pattern and fixed in size, the second pattern being relatively fixed with the display screen position of the VR head-mounted device; determining whether the first pattern and the second pattern are coincident; if it is determined that the first pattern and the second pattern are coincident, it is indicated that the picture collected by the VR head-mounted device is matched with the target area.

2. The digital human model generation method of claim 1, wherein, The step of acquiring the position of the VR head-mounted device and determining the area where the user is located according to the position of the VR head-mounted device comprises the following steps: pre-establishing a plan of a preset area and a plan rectangular coordinate system corresponding to the plan, and dividing the plan into areas according to actual requirements; acquiring a coordinate position of the VR head-mounted device, and determining an area falling into the plan according to the coordinate position and the plan rectangular coordinate system to determine the area where the user is located.

3. The digital human model generation method of claim 2, wherein, In the step of generating the digital human model corresponding to the target area and displaying the digital human model in the VR head-mounted device, an image of the digital human model is pre-established according to information carried in the target area.

4. The digital human model generation method of claim 3, wherein, The step of controlling eye recognition of the VR head-mounted device on the user in real time, determining a pupil position and a pupil size, and interacting with the digital human model according to the pupil position and the pupil size comprises the following steps: Control a preset collection point to be generated in a display screen of the VR headset, the preset collection point being used to collect eye information of the user when observing different positions, the eye information including a pupil position and a pupil size, and obtain the pupil position and the pupil size at the preset collection point; According to the preset collection point and the corresponding pupil position and pupil size, a visual focus model of the user is established, the visual focus model being used to determine a focus point according to the obtained pupil position and pupil size.

5. The digital human model generation method of claim 4, wherein, The step of real-time controlling the VR headset to recognize the eye of the user, determining the pupil position and the pupil size, and interacting with the digital human model according to the pupil position and the pupil size further includes: Marking each target object in the target area to obtain a first target sub-area representing the cultural relic entity; Establishing a first mapping relationship between the first target sub-area and audio corresponding to the text content.

6. The digital human model generation method of claim 5, wherein, The step of interacting with the digital human model according to the pupil position and the pupil size includes: Inputting the current pupil position and the current pupil size into the visual focus model to determine the current focus point of the user; Determining whether the current focus point is in the first target sub-area; If it is determined that the current focus point is in the first target sub-area, retrieving the audio according to the first mapping relationship and expressing through the digital human model; Obtaining a dwell time of the current focus point and determining whether the dwell time is greater than a threshold value; If it is determined that the dwell time is greater than the threshold value, performing image cropping on a preset area of the current focus point and enlarging the presentation; Determining whether the cropped image contains a classical allusion trigger area; If it is determined that the cropped image contains a classical allusion trigger area, controlling the digital human model to display a classical allusion plot according to classical allusion information corresponding to the classical allusion trigger area.

7. A digital human model generation system, characterized by, The system for implementing the digital human model generation method according to any one of claims 1-6, the system comprising: A first obtaining module for obtaining a position of the VR headset and determining an area where the user is located according to the position of the VR headset; A first determining module for determining whether the area where the user is located enters a demonstration area; A second obtaining module for obtaining a picture collected through the VR headset when it is determined that the area where the user is located enters the demonstration area; A second determining module for determining whether the picture collected through the VR headset matches a target area; A generating module for generating a digital human model of the corresponding target area and displaying the digital human model in the VR headset when it is determined that the picture collected through the VR headset matches the target area; An interaction module for real-time controlling the VR headset to recognize the eye of the user, determining the pupil position and the pupil size, and interacting with the digital human model according to the pupil position and the pupil size; The second determining module comprises: A first determining unit for determining whether the demonstration area where the user is located is unique; The first generation unit is configured to, if it is determined that the presentation area where the user is located is unique, generate a first pattern of a preset shape on the basis of a picture collected by the VR headset according to the presentation area, the first pattern dynamically changing with a coordinate position of the VR headset, and generate a second pattern matching the first pattern and fixed in size, the second pattern being relatively fixed with a display screen position of the VR headset; The second generation unit is configured to, if it is determined that the presentation area where the user is located is not unique, generate a third pattern of a preset shape with transparency on the basis of a picture collected by the VR headset according to the presentation area, the third pattern gradually changing to be opaque when the user gradually approaches any presentation area to obtain the first pattern, the third pattern of other presentation areas gradually changing to be transparent, and generate a second pattern matching the first pattern and fixed in size, the second pattern being relatively fixed with a display screen position of the VR headset; The second judgment unit is configured to judge whether the first pattern and the second pattern coincide. If it is determined that the first pattern and the second pattern coincide, it is determined that the picture collected by the VR headset and the target area are matched.

8. A storage medium having stored thereon a computer program, characterized in that The program is executed by the processor to implement the digital human model generation method of any one of claims 1-6.

9. A computer, characterized in that The computer program is stored in the memory and executable on the processor, and the processor implements the digital human model generation method of any one of claims 1-6 when executing the program.

Images