An immersive digital display method and system based on virtual reality

Abstract

The present invention provides an immersive digital display method and system based on virtual reality, which relates to the technical field of virtual reality. Among them, the method includes: extracting media objects from the digital media files to be displayed, collecting multi-dimensional feature information of the media objects to generate a media feature information set; performing display according to the media objects and the media feature information set, and adjusting the media feature information set by analyzing and evaluating the current display effect to optimize the digital display effect. The present invention solves the technical problem in the prior art that the digital display of virtual reality cannot perform adaptive optimization of the display effect according to the user experience, so that the display effect of virtual reality meets the user experience, and achieves the technical effect that when performing immersive digital display based on virtual reality, the user has a good visual experience and a high acceptance degree of the displayed information.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and particularly to an immersive digital display method and system based on virtual reality. Background Art

[0002] Virtual reality uses computer technology to simulate and construct a "virtual world" with three-dimensional space. Through a simulator, it simulates senses such as vision, hearing, and touch to enable users to have the feeling of being in the real world. At the same time, based on algorithm programs, it realizes the interaction between the user and the virtual world. With the continuous development of virtual reality technology, this technology has been gradually widely applied in fields such as games, medical treatment, and teaching.

[0003] Currently, the common ways to construct virtual reality include two types: digital display of virtual reality constructed by collecting and transmitting data based on real objects, and directly constructing virtual reality digital display based on data program algorithms.

[0004] When constructing virtual reality based on real objects, due to the differences in the accuracy of image and data collection of the displayed objects. In the prior art, when digitally displaying real objects based on virtual reality, the display effect cannot be adaptively optimized according to the user experience, resulting in the technical problem that the display effect of virtual reality cannot meet the user experience. Summary of the Invention

[0005] The present application provides an immersive digital display method and system based on virtual reality, which is used to solve the technical problem that in the prior art, when digitally displaying real objects based on virtual reality, the display effect cannot be adaptively optimized according to the user experience, resulting in the display effect of virtual reality not meeting the user experience.

[0006] In view of the above problems, the present application provides an immersive digital display method and system based on virtual reality.

[0007] In the first aspect of the present application, an immersive digital display method based on virtual reality is provided. The method includes: obtaining a digital media file that needs to be displayed currently; extracting media objects from the digital media file to obtain a plurality of media objects; collecting multi-dimensional feature information of the plurality of media objects to obtain a plurality of media feature information sets, where the multi-dimensional feature information includes geometric feature information, functional feature information, and position feature information; performing the current display according to the plurality of media objects and the plurality of media feature information sets to obtain a current display result; analyzing and evaluating the display effect of the current display result; adjusting the plurality of media feature information sets according to the display effect to obtain an adjusted display method and perform the display.

[0008] In the second aspect of the present application, an immersive digital display system based on virtual reality is provided. The system includes: a display information acquisition module for acquiring a digital media file that needs to be displayed currently; a media object extraction module for extracting media objects from the digital media file to obtain a plurality of media objects; a feature information collection module for collecting multi-dimensional feature information of the plurality of media objects to obtain a plurality of media feature information sets, where the multi-dimensional feature information includes geometric feature information, functional feature information, and position feature information; a digital display generation module for performing the current display according to the plurality of media objects and the plurality of media feature information sets to obtain a current display result; a display effect evaluation module for analyzing and evaluating the display effect of the current display result; and a display effect adjustment module for adjusting the plurality of media feature information sets according to the display effect to obtain an adjusted display method and perform the display.

[0009] One or more technical solutions provided in the present application have at least the following technical effects or advantages:

[0010] The method provided in the embodiment of the present application extracts media objects from the digital media file that needs to be displayed currently to obtain a plurality of media objects, thereby realizing the splitting of the complex digital media file to be displayed into a relatively simple structure, which is convenient for subsequent feature analysis and data information collection; collects multi-dimensional feature information of the plurality of media objects to obtain a plurality of media feature information sets, and performs the current display according to the plurality of media objects and the plurality of media feature information sets to obtain a current display result. By splitting the digital media file, the difficulty of collecting information of the digital media file is reduced, and virtual reality digital display generation is performed based on the collected digital media file, so that the generated digital display can restore and reproduce the structural and functional characteristics of the real digital media file; analyzes and evaluates the current digital display result based on the feedback of the audience participating in the virtual reality digital display, adjusts the plurality of media feature information sets according to the display effect obtained from the analysis and evaluation to obtain an adjusted display method, and performs the display. It achieves the technical effect that when performing immersive digital display based on virtual reality, the digital display effect can be optimized according to user feedback, so that the user has a good visual experience and a high acceptance degree of the display information. Description of the Drawings

[0011] Figure 1 It is a schematic flowchart of a method for immersive digital display based on virtual reality provided by the present application;

[0012] Figure 2 It is a schematic flowchart of obtaining the current display result in a method for immersive digital display based on virtual reality provided by the present application;

[0013] Figure 3Schematic flow diagram for obtaining information on adjusting the display viewing effect in an immersive digital display method based on virtual reality provided by this application;

[0014] Figure 4 Schematic structural diagram of an immersive digital display system based on virtual reality provided by this application;

[0015] Explanation of reference numerals: Display information acquisition module 11, media object extraction module 12, feature information collection module 13, digital display generation module 14, display effect evaluation module 15, display effect adjustment module 16. Detailed implementation manners

[0016] This application provides an immersive digital display method and system based on virtual reality, which are used to solve the technical problem in the prior art that when digitally displaying real objects based on virtual reality, the adaptability optimization of the display effect cannot be carried out according to the user experience, resulting in the display effect of virtual reality not meeting the user experience.

[0017] In response to the above technical problem, the general idea of the technical solution provided by this application is as follows:

[0018] Extract media objects from the digital media file that needs to be displayed currently to obtain multiple media objects; collect multi-dimensional feature information of the multiple media objects to obtain multiple media feature information sets, and perform the current display according to the multiple media objects and the multiple media feature information sets to obtain the current display result; analyze and evaluate the display effect of the current display result; adjust the multiple media feature information sets according to the display effect to obtain an adjusted display method, and perform the adjustment of the digital display to complete the optimization of the display effect of the current digital display. When performing immersive digital display based on virtual reality, the digital display effect can be optimized according to user feedback, so as to achieve the technical effect that the user has a good visual experience and a high acceptance degree of the display information.

[0019] Embodiment 1

[0020] As Figure 1 shown, this application provides an immersive digital display method based on virtual reality, and the method includes:

[0021] S100: Obtain the digital media file that needs to be displayed currently;

[0022] Specifically, the virtual reality is to convert the data obtained in real life into computer-recognizable electronic signals, construct a virtual reality three-dimensional real scene through a computer, and combine it with various output devices to convert it into a quasi-real virtual scene that can be felt by the user. The user can perform interactive operations with the items in the virtual reality scene.

[0023] The digital media file is a real object that exists in real life and is used for digital display in the immersive scene constructed for the virtual reality technology plan in this embodiment. The volume size, structural form complexity, and whether it has mobility or operability of the digital media file are not overly restricted in this embodiment. The digital media file can be any item such as experimental equipment, buildings, cars, etc.

[0024] In this embodiment, the digital media file is preferably a device with small volume, complex structural form, mobility, operability, and difficult to perform data acquisition, such as a microscope, mechanical connection parts, etc.

[0025] S200: Extract media objects from the digital media file to obtain multiple media objects;

[0026] Specifically, the media object extraction is to disassemble the digital media file according to the structural complexity of the digital media file, so as to reduce the difficulty of subsequent feature extraction of the digital media file to construct the corresponding virtual reality digital display.

[0027] Specifically, the disassembly of the digital media file for media object extraction can be carried out based on features such as structural features, composition methods, geometric features, connection relationships, and usage methods.

[0028] By analyzing the features of the digital media file, the digital media file is disassembled into a structure that is convenient for detailed feature collection for media object extraction, obtaining multiple media objects, which is convenient for subsequent acquisition of feature information of the digital media file and construction of digital display in virtual reality.

[0029] When the digital media file has a simple structure or fewer details, then for media object extraction, the fewer times the digital media file is disassembled, the simpler the disassembly method, and the fewer the obtained media objects. On the contrary, when the digital media file has a complex structure and many detailed components, then for media object extraction, the more times the digital media file is disassembled, the more complex the disassembly method.

[0030] Exemplarily, when the digital media file is a utensil with regular shape and decorative patterns such as bowls and dishes, the scheme for media object extraction can be to directly obtain a set of media features of the bowls and dishes to form media objects. When the digital media file is a device with a complex structure and strong operability such as a microscope, the scheme for media object extraction can be to divide the microscope into multiple parts and components according to the assembly structure and the connection relationship between movable and immovable parts during use, so as to complete the media object extraction and obtain multiple media objects.

[0031] S300: Collect multi-dimensional feature information of multiple media objects to obtain multiple media feature information sets. Among them, the multi-dimensional feature information includes geometric feature information, functional feature information, and location feature information.

[0032] Specifically, the geometric feature information includes the size data, overall shape of the media object, image information of each view surface, and structural relationship information between the media object and other media objects with an adjacency relationship.

[0033] The functional feature information includes two aspects. On the one hand, it is the role that the media object can play alone in the data media file and the role that the media object can play in combination with other media objects in the data media file obtained based on the operation characteristics of the data media file itself. On the other hand, it is one or more operation function feature information such as moving, deleting, rotating, sectional view, and removing that can be performed on the media object during virtual reality digital display generated based on the operation characteristics of the data media file itself.

[0034] The location feature information includes the spatial position relationship, connection method, direction and distance of relative displacement that can occur, and spatial position information of the media object in the digital media file between the media object and other media objects.

[0035] Obtain multi-dimensional image data of the multiple media objects through an image acquisition device and a ranging device, and combine the actual application method of the digital media file in the actual use process to analyze and determine the multi-dimensional feature information of the multiple media objects including the geometric feature information, functional feature information, and location feature information.

[0036] Based on the geometric feature information, functional feature information, and location feature information, it is convenient to build an interactive feedback for subsequent users to experience virtual reality and interact with the digital display of the corresponding digital media file, and generate a reference for the text introduction content of the digital display.

[0037] By digitalizing the geometric feature information, functional feature information, and location feature information, and using computer technology to simulate and construct a "virtual world" with a three-dimensional space, the digital media file generates a corresponding digital display in virtual reality. The user wears visual, tactile, and auditory simulation sensors to interact with the digital display, such as simulating the opening and closing, disassembly of the device that controls the digital media file.

[0038] S400: Perform the current display according to the multiple media objects and the multiple media feature information sets to obtain the current display result.

[0039] Specifically, according to the media feature information that has a one-to-one correspondence with the media object, the multiple media objects are spliced and merged to form digital display data for projection in a virtual reality scene, and based on the digital display data, the current digital display is performed to obtain the current display result.

[0040] The current display result is constructed with reference to the digital media file in the real world. Specifically, for the partial feature information such as the proportional relationship between the current display result and the digital media file, the color decoration of the media object, etc., which does not affect the accurate reproduction of the true function of the digital media file, this embodiment does not impose any restrictions here. When actually constructing the digital display in virtual reality, technicians can set it according to actual needs.

[0041] The user observes the digital display in the virtual reality or conducts interactions by wearing a sensory simulator, just as if observing and interacting with the digital media file in the real world as if on the spot. Meanwhile, based on a preset program, when the user's interaction behavior with the digital display is incorrect, the digital display will not respond to the interaction and will project a voice or subtitle reminder for the incorrect behavior. The user can also obtain the introduction and description of some media objects that make up the digital display based on the operation. The content source of this introduction and description is the multi-dimensional feature information obtained in step S300, including geometric feature information, functional feature information, and position feature information. Based on the multi-dimensional feature information, the user can learn more information about the current digital display.

[0042] S500: Analyze and evaluate the display effect of the current display result;

[0043] Specifically, based on the multiple media files and the set of media feature information that has a one-to-one correspondence with the multiple media files, a virtual reality digital display that can reproduce the various functions of the digital media file is generated through existing virtual reality technologies. The user "enters" the virtual reality world through a sensory simulator to observe the digital display or perform interaction operations, just as if interacting with the real digital media file in the real world.

[0044] During the process of observation and interaction, due to the different interaction behaviors and observation methods of different audiences participating in the digital display observation, different evaluations of the display effect of the digital display in the virtual reality world, different defect detections and cognitions of the current virtual reality digital display, therefore, this embodiment evaluates the display effect of the current digital display result based on the interaction usage experiences of different real audience users with the digital display in the virtual reality.

[0045] The above analysis and evaluation is to obtain an evaluation result of the observation and interaction effect based on the interaction of the audience with the current digital display or the observation of the current digital display in the virtual reality world. After data analysis and processing based on the evaluation results of the observation and interaction effects of a large number of audiences, an evaluation result of the display effect of the digital display is generated. The specific generation method of the analysis and evaluation is not limited in this embodiment and can be set as needed in actual applications.

[0046] S600: Adjust the multiple media feature information sets according to the display effect, obtain an adjusted display method, and perform the display.

[0047] Specifically, the adjusted display method is a specific method for optimizing the display effect of the currently generated digital display, including but not limited to extracting media objects of digital media files again for multi-faceted information such as geometric feature information, functional feature information, and position feature information of each media object constituting the digital display itself, refining the feature information, and refining the text content of introductions, popular science, prompt warnings of the digital display or enlarging the font, and adjusting the display method such as the size of reminder, warning, and introduction volumes.

[0048] Generate adjustment and optimization discoveries and optimization content for the adjusted display through the display effect obtained from the analysis and evaluation, thereby obtaining an adjusted display method to adjust the multiple media feature information sets, generating an optimized digital display object, and performing the display.

[0049] In this embodiment, by extracting media objects from the digital media file to be displayed currently, multiple media objects are obtained, thereby realizing the splitting of the complex digital media file to be displayed into a relatively simple structure, which is convenient for subsequent feature analysis and data information collection; collecting multi-dimensional feature information of multiple media objects to obtain multiple media feature information sets, and performing the current display according to the multiple media objects and the multiple media feature information sets to obtain the current display result. The difficulty of collecting information of the digital media file is reduced by splitting the digital media file, and based on the collected digital media file, a virtual reality digital display is generated, so that the generated digital display can restore and reproduce the structural and functional characteristics of the real digital media file; analyzing and evaluating the current digital display result based on the feedback of the audience participating in the virtual reality digital display, adjusting the multiple media feature information sets according to the display effect obtained from the analysis and evaluation, obtaining an adjusted display method, and performing the display. The technical effect is achieved that when performing immersive digital display based on virtual reality, the digital display effect can be optimized according to user feedback, so that the user has a good visual experience and a high acceptance degree of the display information.

[0050] Further, as Figure 2 shown, the obtaining of the current display result, the method step S400 provided in this embodiment includes:

[0051] S410: Determine the set of viewers currently undergoing the display, where the set of viewers includes multiple viewers.

[0052] S420: Collect the display viewing effect information of multiple said viewers.

[0053] S430: Use the display viewing effect information of multiple said viewers as the current display result.

[0054] Specifically, the viewers are users participating in virtual reality digital displays, and the viewers are people with good sensory abilities and some sensory abilities of vision, touch, and hearing. The viewing of the current digital display by the viewers includes visual viewing, tactile perception or operation interaction, listening to and / or the voice introduction and text prompt content of the digital display.

[0055] There are no restrictions on the composition of the viewers in the set of viewers in this embodiment. It can be a set of viewers composed of multiple age groups with a large age gap, including school-age children to octogenarians, or a set of viewers composed of people with a large educational background gap, including junior high school and high school education to doctoral education, or a mixed set of viewers with various ages, educational backgrounds, and comprehension abilities. In this embodiment, the set of viewers is preferably a mixed set of viewers with a large age difference and a large educational background gap.

[0056] The specific method of collecting the display viewing effect information of multiple said viewers is to generate a questionnaire based on the display content of the digital display, distribute the questionnaire before the digital display starts, and the process of completing the questionnaire is synchronized with the current digital display or after the current digital display ends, distribute the questionnaire for closed-book answering, generate the display viewing effect information of the viewers according to the correct rate of answering each question in the questionnaire, and use the display viewing effect information of multiple said viewers as the current display result. The current display result covers the advantages of the current digital display generated based on virtual reality and the specific project content information to be optimized and improved.

[0057] In this embodiment, by obtaining the display effect feedback of the current digital display from the perspective of the user viewers participating in the virtual reality digital display, obtaining the display effect from the usage side, and collecting the display effect information of multiple usage sides, the subjectivity of the display effect evaluation is reduced, and the technical effect of obtaining a relatively objective display effect evaluation that can be used as a reference to obtain the true current digital display effect is achieved.

[0058] Further, as Figure 3 shown, after collecting the display viewing effect information of multiple said viewers, the method step S420 provided by this application further includes:

[0059] S421: Collect and obtain the viewing importance information of multiple said audiences;

[0060] S422: Perform weight allocation according to the multiple said viewing importance information to obtain a weight allocation result;

[0061] S423: Use the weight allocation result to perform weighted adjustment on the multiple said display viewing effect information to obtain multiple adjusted display viewing effect information;

[0062] S424: Use the multiple said adjusted display viewing effect information as the current display result.

[0063] Specifically, it should be understood that whether it is a digital display in virtual reality or a real exhibition activity, it has a display theme and a preset portrait of the participating users. Based on different display themes and preset portraits of the participating users, for the participating users who do not belong to the preset portrait of the participating users, when viewing the display, they may not be able to accurately understand the knowledge and / or information conveyed by the display due to knowledge barriers or understanding deviations. For the participating users who do not belong to the scope of the preset portrait of the participating users, the exhibition organizers usually do not have overly high expectations for the exhibition effect.

[0064] In this embodiment, the viewing importance information is the viewing importance information generated by comparing the similarity between the actual viewing users and the preset portrait of the participating users with the preset portrait of the participating users of the current digital display as a reference.

[0065] Specifically, when the current digital display is of the display type with the theme of biological instruments or biological science, it is determined that the viewing importance of the participating audiences with a professional cultural background in humanities and social sciences, a lower education level, and a lower understanding ability due to old age is lower. On the contrary, for the participating audiences with a professional cultural background related to biology or with a biological foundation, the viewing importance is determined to be higher.

[0066] In this embodiment, first, a preset portrait of the participating users of the current digital display is generated. The specific content of the preset portrait of the participating users includes but is not limited to the education level, understanding ability, age range, visual ability, auditory ability, and operation ability of the preset users.

[0067] Perform weight allocation according to the multiple said viewing importance information to obtain a weight allocation result. Specifically, perform weight value allocation according to the different viewing importance information of different audiences. The weight value can be directly determined by using the weight value provided by the existing technology as the weight allocation result, or the weight values corresponding to different viewing importance information can be obtained by using methods such as the analytic hierarchy process, the fuzzy method, the fuzzy analytic hierarchy process, and the expert evaluation method as the weight allocation result.

[0068] According to the different characteristics of the observation focus and comprehension of the digital display of virtual reality based on the different viewing importance information of different audiences, the embodiments of the present application perform weighted adjustment on a plurality of the display viewing effect information by using the weight distribution result to obtain a plurality of adjusted display viewing effect information; and use the plurality of adjusted display viewing effect information as the current display result to obtain a more objective display result that can represent the true display effect of the digital display.

[0069] When performing virtual reality digital display by combining with reality in this embodiment, due to the characteristic that the display purpose and target users of the display content are targeted, the audiences participating in the digital display are classified, and the feedback of the audiences on the digital display effect is weighted, so as to obtain the display result information that can better represent the true display effect of the digital display, achieving the technical effect of accurately reflecting the display effect of the current digital display, providing a reference basis for subsequent targeted display effect optimization, and improving the observation experience and information reception effect of the participating users.

[0070] Further, for analyzing and evaluating the display effect of the current display result, the method step S500 provided by the present application further includes:

[0071] S510: Set the viewing effect criteria for a plurality of the audiences;

[0072] S520: Adjust the plurality of viewing effect criteria according to the cognitive levels of the plurality of audiences to obtain a plurality of adjusted viewing effect criteria;

[0073] S530: Analyze whether the plurality of adjusted display viewing effect information meets the plurality of adjusted viewing effect criteria respectively. If not, analyze the degree of non - compliance to obtain a plurality of analysis results and obtain the display effect.

[0074] Specifically, the viewing effect criteria is the comprehension ability of the current digital display, which can be divided into shallow comprehension and deep comprehension. Taking an optical microscope as an example of the digital display, shallow comprehension includes the understanding of non - theoretical aspects such as the composition structure and application method of the digital display, which are more practical and application - oriented, such as the operation method of the microscope, the adjustment method of the eyepiece and objective lens, and the operation - type and observation - type knowledge such as the placement and start of the stage and slide; deep comprehension includes the calculation method of the magnification of the objective lens and eyepiece, the observable content of the microscope, the observation principle of the microscope, and the preparation standard of the slide, etc., which are knowledge that is more theoretical and requires systematic learning.

[0075] Taking the preset portrait of the exhibition visitors as a reference, setting the viewing effect criteria for multiple said audiences, and adjusting the multiple said viewing effect criteria according to the cognitive level of multiple said audiences actually participating in the exhibition, so as to obtain multiple adjusted viewing effect criteria. That is, it is preset that for the exhibition visitors who meet a certain education level, comprehension ability, age range, visual ability, auditory ability, and operation ability, whether the score of completing the questionnaire reaches a predetermined value. In this embodiment, in order to improve the objectivity of the display effect reflected by the questionnaire, a higher passing score value of the questionnaire is set for users with stronger abilities in all aspects, and a lower passing score value of the questionnaire is set for users with weaker abilities in all aspects; respectively analyze whether multiple said adjusted display viewing effect information (actual scores of the questionnaire) meet multiple said adjusted viewing effect criteria (passing score lines), if not, analyze the degree of non - satisfaction to obtain multiple analysis results, and obtain the said display effect.

[0076] In this embodiment, the viewing effect criteria are adjusted according to the cognitive level of the exhibition visitors, avoiding the use of the same set of criteria for exhibition visitors with different cognitive levels, which may result in the inclusion of non - universal feedback results of low - cognitive - level exhibition visitors to form the display effect feedback, leading to excessive and ineffective adjustment of the optimization details during the subsequent display optimization. It achieves the technical effect of providing an accurate adjustment and optimization space for the subsequent adjustment of the multimedia feature information set based on the display effect.

[0077] Further, for the adjustment of multiple said media feature information sets according to the said display effect, the method step S600 provided in this application further includes:

[0078] S610: Randomly adjust the multi - dimensional feature information in multiple said media feature information sets according to the said display effect to obtain multiple adjusted media feature information sets;

[0079] S620: Perform global optimization among multiple said adjusted media feature information sets to obtain the optimal adjusted media feature information set;

[0080] S630: Based on the optimal adjusted media feature information set, obtain the adjusted display method and perform the display.

[0081] Specifically, in this embodiment, the multi-dimensional feature information of multiple media objects corresponding to the current digital display is reversely determined according to the display effect, including geometric feature information, functional feature information, and position feature information. An adjusted media optimization space is constructed according to the geometric feature information, functional feature information, and position feature information of the multi-dimensional feature information. A dimensional particle swarm of adjustable items can be generated according to these three parameters of the geometric feature information, functional feature information, and position feature information. The geometric feature dimensional particle swarm includes multiple geometric feature values, the functional feature dimensional particle swarm includes multiple functional feature values, and the position feature dimensional particle swarm includes multiple position feature values.

[0082] Feature value points are randomly selected and connected in each dimension of the adjusted media optimization space to generate multiple sets of the adjusted media feature information. In the multiple sets of the adjusted media feature information, global optimization is performed to obtain the optimal set of the adjusted media feature information. The global optimization method can be to randomly select a set of the adjusted media feature information as the initial feature information to obtain the corresponding display effect, continuously iteratively compare the pros and cons of the display effects corresponding to the adjusted media feature information with similar other feature parameters and the initial / secondary iterative display effects, and finally determine the optimal set of the adjusted media feature information after n iterations. Based on the optimal set of the adjusted media feature information, the adjusted display method is obtained for display.

[0083] In this embodiment, by obtaining multiple sets of the adjusted media feature information, performing global optimization, and obtaining the optimal set of the adjusted media feature information, the adjusted display method for the current display structure is determined for display adjustment, achieving the technical effect of obtaining the optimal display effect adjustment scheme based on a large amount of feature information.

[0084] Further, for the global optimization in the multiple sets of the adjusted media feature information, the method step S620 provided in this application further includes:

[0085] S621: Calculate the display effects of the multiple sets of the adjusted media feature information to obtain multiple adjusted display effects;

[0086] S622: Traverse all the adjusted display effects to obtain the optimal adjusted display effect;

[0087] S623: Obtain the set of the adjusted media feature information corresponding to the optimal adjusted display effect as the optimal set of the adjusted media feature information.

[0088] Further, for the calculation of the display effects of the multiple sets of the adjusted media feature information, the method step S622 provided in this application further includes:

[0089] S622-1: Calculate the display viewing effect information of multiple audiences under multiple sets of the adjusted media feature information, and obtain multiple sets of display viewing effect information;

[0090] S622-2: Use the weight assignment result to perform weighted adjustment on the adjusted display viewing effect information of multiple audiences in multiple sets of the display viewing effect information, and obtain multiple adjusted display effects.

[0091] Specifically, in this embodiment, each set of adjusted media feature information has a corresponding display effect, and the display effect of the virtual reality digital display is the ultimate display purpose. Therefore, it is determined whether each set of adjusted media feature information can be used to adjust the current display result based on the comparison of the quality of the display effects. Calculate the display effects of multiple sets of the adjusted media feature information to obtain multiple adjusted display effects. Specifically, calculate the display viewing effect information of multiple audiences under multiple sets of the adjusted media feature information to obtain multiple sets of display viewing effect information; use the weight assignment result obtained in step S420 to perform weighted adjustment on the adjusted display viewing effect information of multiple audiences in multiple sets of the display viewing effect information, and obtain multiple adjusted display effects. Traverse all the adjusted display effects, perform digital quantization comparison on the multiple adjusted display effects, and obtain the optimal adjusted display effect.

[0092] Obtain the set of adjusted media feature information corresponding to the optimal adjusted display effect based on the optimal adjusted display effect as the optimal adjusted media feature information set, and adjust the initial display result according to the specific geometric feature information, functional feature information, and position feature information in the optimal adjusted media feature information set.

[0093] This embodiment obtains multiple sets of adjusted media feature information, performs global optimization, obtains the optimal adjusted media feature information set, and thus determines the display adjustment method for adjusting the current display structure, achieving the technical effect of obtaining the optimal display effect adjustment scheme based on a large amount of feature information.

[0094] Embodiment 2

[0095] Based on the same inventive concept as the virtual reality-based immersive digital display method in the foregoing embodiment, as Figure 4 shown, the present application provides a virtual reality-based immersive digital display system, wherein the system includes:

[0096] A display information acquisition module 11, which acquires the digital media file that needs to be displayed currently;

[0097] The media object extraction module 12 is used to extract media objects from the digital media file to obtain a plurality of media objects;

[0098] The feature information acquisition module 13 is used to collect multi-dimensional feature information of a plurality of media objects to obtain a plurality of media feature information sets, wherein the multi-dimensional feature information includes geometric feature information, functional feature information, and position feature information;

[0099] The digital display generation module 14 is used to perform a current display according to the plurality of media objects and the plurality of media feature information sets to obtain a current display result;

[0100] The display effect evaluation module 15 is used to analyze and evaluate the display effect of the current display result;

[0101] The display effect adjustment module 16 is used to adjust the plurality of media feature information sets according to the display effect to obtain an adjusted display method and perform the display.

[0102] Further, the digital display generation module 14 further includes:

[0103] The display audience determination unit is used to determine the audience set for the current display, wherein the audience set includes a plurality of audiences;

[0104] The viewing effect acquisition unit is used to collect the display viewing effect information of the plurality of audiences;

[0105] The display result generation unit is used to use the display viewing effect information of the plurality of audiences as the current display result.

[0106] Further, the viewing effect acquisition unit further includes:

[0107] The importance degree information acquisition unit is used to collect and obtain the viewing importance degree information of the plurality of audiences;

[0108] The weight assignment determination unit is used to perform weight assignment according to the plurality of viewing importance degree information to obtain a weight assignment result;

[0109] The weighted calculation unit is used to perform weighted adjustment on the plurality of display viewing effect information by using the weight assignment result to obtain a plurality of adjusted display viewing effect information;

[0110] The display result conversion unit is used to use the plurality of adjusted display viewing effect information as the current display result.

[0111] Further, the display effect evaluation module 15 further includes:

[0112] A viewing effect standard generation unit for setting the viewing effect standards of multiple said viewers;

[0113] A viewing effect standard adjustment unit for adjusting the multiple said viewing effect standards according to the cognitive levels of multiple said viewers to obtain multiple adjusted viewing effect standards;

[0114] A viewing effect judgment unit for respectively analyzing whether the multiple said adjusted display viewing effect information meets the multiple said adjusted viewing effect standards. If not, analyzing the degree of non - meeting to obtain multiple analysis results and obtaining the said display effect.

[0115] Further, the display effect adjustment module 16 further includes:

[0116] A display effect generation unit for randomly adjusting the multi - dimensional feature information in the multiple said media feature information sets according to the said display effect to obtain multiple adjusted media feature information sets;

[0117] A display effect optimization unit for performing global optimization in the multiple said adjusted media feature information sets to obtain an optimal adjusted media feature information set;

[0118] An adjusted display method determination unit for obtaining the said adjusted display method based on the optimal adjusted media feature information set and performing the display.

[0119] Further, the display effect optimization unit further includes:

[0120] A display effect simulation unit for calculating the display effects of the multiple said adjusted media feature information sets to obtain multiple adjusted display effects;

[0121] A display effect comparison unit for traversing all the said adjusted display effects to obtain an optimal adjusted display effect;

[0122] A display effect determination unit for obtaining the adjusted media feature information set corresponding to the optimal adjusted display effect as the optimal adjusted media feature information set.

[0123] Further, the display effect simulation unit further includes:

[0124] A viewing effect simulation unit for calculating the display viewing effect information of multiple said viewers under the multiple said adjusted media feature information sets to obtain multiple display viewing effect information sets;

[0125] A weight adjustment calculation unit for weighted - adjusting the adjusted display viewing effect information of multiple said viewers in the multiple said display viewing effect information sets by using the said weight distribution result to obtain multiple said adjusted display effects.

[0126] In summary, by adopting an immersive digital display method and system based on virtual reality according to the present invention, a digital display of virtual reality is directly constructed, and combined with the feedback information of different audiences on the display effect of the current digital display, the display effect of the virtual reality digital display is optimized specifically, and a virtual reality digital display product that can better meet the viewing experience of the viewing audience is obtained. When performing immersive digital display based on virtual reality, the digital display effect can be optimized according to user feedback, so as to achieve the technical effect that the user has a good visual experience and a high acceptance degree of the displayed information.

[0127] Any of the above-described methods or steps can be stored as computer instructions or programs in various types of computer memories, and the computer instructions or programs are recognized by various types of computer processors, thereby implementing any of the above-described methods or steps.

[0128] Based on the above specific embodiments of the present invention, any improvements and modifications made to the present invention by those skilled in the art without departing from the principle of the present invention shall fall within the scope of patent protection of the present invention.

Claims

1. An immersive digital display method based on virtual reality, characterized in that The method includes: Obtain the digital media file that needs to be displayed currently; Extract media objects from the digital media file to obtain multiple media objects; Collect multi-dimensional feature information of multiple media objects to obtain multiple media feature information sets, where the multi-dimensional feature information includes geometric feature information, functional feature information, and position feature information; Perform the current display according to the multiple media objects and the multiple media feature information sets to obtain the current display result; Analyze and evaluate the display effect of the current display result; Adjust the multiple media feature information sets according to the display effect to obtain an adjusted display method and perform the display; The obtaining of the current display result includes: Determine the set of viewers for the current display, where the set of viewers includes multiple viewers; Collect the display viewing effect information of the multiple viewers; Use the display viewing effect information of the multiple viewers as the current display result; After collecting the display viewing effect information of the multiple viewers, it further includes: Collect and obtain the viewing importance information of the multiple viewers; Perform weight assignment according to the multiple viewing importance information to obtain a weight assignment result; Use the weight assignment result to perform weighted adjustment on the multiple display viewing effect information to obtain multiple adjusted display viewing effect information; Use the multiple adjusted display viewing effect information as the current display result.

2. The method according to claim 1, wherein The analyzing and evaluating the display effect of the current display result includes: Set the viewing effect criteria for the multiple viewers; Adjust the multiple viewing effect criteria according to the cognitive levels of the multiple viewers to obtain multiple adjusted viewing effect criteria; Analyze whether the multiple adjusted display viewing effect information meets the multiple adjusted viewing effect criteria respectively. If not, analyze the degree of non-compliance to obtain multiple analysis results and obtain the display effect.

3. The method according to claim 2, wherein The adjusting the multiple media feature information sets according to the display effect includes: Randomly adjust the multi-dimensional feature information in the multiple media feature information sets according to the display effect to obtain multiple adjusted media feature information sets; Perform global optimization among the multiple adjusted media feature information sets to obtain the optimal adjusted media feature information set; Based on the optimal adjusted media feature information set, obtain the adjusted display method and perform the display.

4. The method according to claim 3, wherein The performing global optimization among the multiple adjusted media feature information sets includes: Calculate the display effects of the multiple adjusted media feature information sets to obtain multiple adjusted display effects; Traverse all the adjusted display effects to obtain the optimal adjusted display effect; Obtain the adjusted media feature information set corresponding to the optimal adjusted display effect as the optimal adjusted media feature information set.

5. The method according to claim 4, wherein The calculating the display effects of the multiple adjusted media feature information sets includes: Calculate the display viewing effect information of the multiple viewers under the multiple adjusted media feature information sets to obtain multiple display viewing effect information sets; Perform weighted adjustment on the adjusted display viewing effect information of multiple audiences in multiple display viewing effect information sets by using the weight allocation result to obtain multiple adjusted display effects.

6. An immersive digital display system based on virtual reality, characterized in that, The system includes: A display information acquisition module for acquiring a digital media file that needs to be currently displayed; A media object extraction module for extracting media objects from the digital media file to obtain multiple media objects; A feature information collection module for collecting multi-dimensional feature information of multiple media objects to obtain multiple media feature information sets, where the multi-dimensional feature information includes geometric feature information, functional feature information, and position feature information; A digital display generation module for performing the current display according to the multiple media objects and the multiple media feature information sets to obtain a current display result; A display effect evaluation module for analyzing and evaluating the display effect of the current display result; A display effect adjustment module for adjusting the multiple media feature information sets according to the display effect to obtain an adjusted display method and perform the display; Further, the digital display generation module further includes: A display audience determination unit for determining a set of audiences for which the current display is performed, where the set of audiences includes multiple audiences; A viewing effect collection unit for collecting display viewing effect information of the multiple audiences; A display result generation unit for using the display viewing effect information of the multiple audiences as the current display result; Further, the viewing effect collection unit further includes: An importance degree information collection unit for collecting and obtaining the viewing importance degree information of the multiple audiences; A weight allocation determination unit for performing weight allocation according to the multiple viewing importance degree information to obtain a weight allocation result; A weighted calculation unit for performing weighted adjustment on the multiple display viewing effect information by using the weight allocation result to obtain multiple adjusted display viewing effect information; A display result conversion unit for using the multiple adjusted display viewing effect information as the current display result.

Images