Image effect enhancement method, device, equipment and computer readable storage medium

By constructing and dynamically adjusting the three-dimensional model and superimposing it with real-life scene information, the lack of flexibility in 3D model creation in existing AR technology is solved, and user-defined 3D model projection and dynamic augmented reality effects are realized.

CN114494660BActive Publication Date: 2025-03-18BEIJING SUPERHEXA CENTURY TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210130892.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-02-12
Publication Date
2025-03-18
Estimated Expiration
2042-02-12

AI Technical Summary

Technical Problem

Existing AR technology lacks flexibility when projecting 3D models, and users cannot create 3D models based on their own needs.

Method used

By obtaining the image data of the object to be enhanced from multiple angles, building a body model, and superimposing it with the current real scene information, dynamically adjusting the three-dimensional model to achieve enhanced effect.

Benefits of technology

It realizes the function of freely creating 3D models on demand, enhances the interactive experience between users and dioramas, and provides an augmented reality experience with dynamic effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114494660B_ABST
    Figure CN114494660B_ABST
Patent Text Reader

Abstract

The present application relates to an image effect enhancement method, device, equipment and computer-readable storage medium, which are applied to the field of augmented reality technology. The method is applied to a head-mounted display device, and includes: obtaining image data of an object to be enhanced at multiple angles; constructing a stereoscopic model of the object to be enhanced based on the image data of the object to be enhanced at multiple angles; obtaining current real scene information; superimposing the stereoscopic model with the current real scene information to obtain an effect-enhanced image; and displaying the effect-enhanced image. The present application has the effect of realizing the flexibility of freely creating 3D models on demand.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of augmented reality, and in particular to an image effect enhancement method, device, equipment and computer-readable storage medium. Background Art

[0002] With the continuous development of social economy and the continuous advancement of science and technology, more and more scientific and technological products are used in daily life. In recent years, augmented reality technology, namely AR technology, has frequently appeared in the public eye. Augmented reality technology is a technology that cleverly integrates virtual information with the real world. It widely uses multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and other technical means to simulate computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and then apply them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.

[0003] However, the 3D models currently projected using AR technology are fixed, that is, all 3D models are preset fixed models, and users cannot create 3D models according to their own needs. There is an urgent need for a technology that can freely create 3D models on demand based on real-world scene information. Summary of the invention

[0004] In order to realize the free creation of 3D models on demand, the present application provides an image effect enhancement method, device, equipment and computer-readable storage medium.

[0005] In a first aspect, the present application provides an image effect enhancement method, which adopts the following technical solution:

[0006] A method for enhancing image effects, applied to a head mounted display device, comprising:

[0007] Acquire image data of the object to be enhanced at multiple angles;

[0008] Building a stereoscopic model of the object to be enhanced based on the image data of the object to be enhanced at multiple angles;

[0009] Get the current real scene information;

[0010] Superimposing the three-dimensional model with the current real scene information to obtain an effect-enhanced image;

[0011] The effect-enhanced image is displayed.

[0012] By adopting the above technical solution, the objects in the currently displayed real scene are three-dimensionally modeled, and a three-dimensional model consistent with the appearance of the objects in the currently displayed real scene is constructed. The three-dimensional model is established according to the characteristics of the objects in the currently displayed real scene required by the user, and the created three-dimensional model is projected into the current real scene to obtain an enhanced image, rather than projecting the inherent 3D model into the currently displayed real scene, thereby realizing the free creation of 3D models on demand.

[0013] Optionally, constructing a stereoscopic model of the object to be enhanced based on the image data of the object to be enhanced at multiple angles includes:

[0014] Performing feature extraction on the image data of the object to be enhanced at the multiple angles to obtain multiple image features of the object to be enhanced;

[0015] Matching the multiple image features with 3D models in a feature library to obtain a 3D model that matches the multiple image features;

[0016] Splitting the multiple image features based on a 3D part splitting rule;

[0017] The split image features are filled into corresponding 3D parts in the 3D model to obtain the three-dimensional model.

[0018] Optionally, the 3D model includes a basic model and an incremental model; matching the multiple image features with the 3D models in the feature library to obtain a 3D model matching the multiple image features includes:

[0019] Acquire multiple basic models in the feature library, match the multiple image features with the multiple basic models, and output basic models that match the multiple image features;

[0020] Acquire multiple incremental models corresponding to the basic model that matches the image features, match the multiple image features with the multiple incremental models, and output incremental models that match the multiple image features.

[0021] Optionally, after displaying the effect-enhanced image, the method further includes:

[0022] In response to a user's action instruction, dynamically adjusting the three-dimensional model in the effect-enhanced image;

[0023] The dynamically adjusted three-dimensional model is superimposed on the current real scene information to obtain an effect-enhanced image with dynamic effects;

[0024] The effect-enhanced image with the dynamic effect is displayed.

[0025] By adopting the above technical solution, the user can issue dynamic adjustment instructions to the three-dimensional model through the head-mounted display device, that is, control the three-dimensional model to move, thereby enhancing the user's experience of interacting with the three-dimensional model.

[0026] Optionally, the three-dimensional model includes at least one characteristic part, each of the characteristic part corresponds to at least one action information, and each of the action information corresponds to at least one preset dynamic parameter; and in response to the action instruction of the user, dynamically adjusting the three-dimensional model in the effect-enhanced image includes:

[0027] Acquire the current feature part and current action information contained in the action instruction of the user;

[0028] Acquire corresponding preset dynamic parameters based on the current feature part and current action information;

[0029] The current characteristic part of the three-dimensional model is dynamically adjusted based on the preset dynamic parameters.

[0030] Optionally, before obtaining the current feature part and current action information included in the action instruction of the user, the method further includes:

[0031] Obtaining the action information name of the at least one action information;

[0032] The action information name is displayed.

[0033] Optionally, after displaying the effect-enhanced image with dynamic effect, the method further includes:

[0034] Video recording and storage are performed on the effect-enhanced image with dynamic effect.

[0035] In a second aspect, the present application provides an image effect enhancement device, which adopts the following technical solution:

[0036] An image effect enhancement device, comprising:

[0037] A data acquisition module, used to acquire image data of the object to be enhanced at multiple angles;

[0038] a model building module, for building a stereoscopic stereo model of the object to be enhanced based on the image data of the object to be enhanced at the plurality of angles;

[0039] Information acquisition module, used to obtain current real scene information;

[0040] An information superposition module, used for superimposing the three-dimensional model with the current real scene information to obtain an effect-enhanced image;

[0041] An image display module is used to display the effect-enhanced image.

[0042] By adopting the above technical solution, the objects in the currently displayed real scene are three-dimensionally modeled, and a three-dimensional model consistent with the appearance of the objects in the currently displayed real scene is constructed. The three-dimensional model is established according to the characteristics of the objects in the currently displayed real scene required by the user, and the created three-dimensional model is projected into the current real scene to obtain an enhanced image, rather than projecting the inherent 3D model into the currently displayed real scene, thereby realizing the free creation of 3D models on demand.

[0043] In a third aspect, the present application provides a head-mounted display device, which adopts the following technical solution:

[0044] A head mounted display device comprises a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes the image effect enhancement method described in any one of the first aspects.

[0045] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution:

[0046] A computer-readable storage medium stores a computer program that can be loaded by a processor and execute the image effect enhancement method described in any one of the first aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 It is a flowchart of an image effect enhancement method provided in an embodiment of the present application.

[0048] Figure 2 It is a schematic diagram of the process of constructing a three-dimensional model provided in an embodiment of the present application.

[0049] Figure 3 It is a structural block diagram of an image effect enhancement device provided in an embodiment of the application.

[0050] Figure 4 It is a structural block diagram of a head-mounted display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] The present application is further described in detail below in conjunction with the accompanying drawings.

[0052] Figure 1 A flowchart of an image effect enhancement method provided in an embodiment of the present application.

[0053] like Figure 1 As shown, the main process of the method is described as follows (steps S101 to S105):

[0054] Step S101, acquiring image data of the object to be enhanced at multiple angles;

[0055] Step S102, constructing a three-dimensional model of the object to be enhanced based on the image data of the object to be enhanced at multiple angles;

[0056] Optional, such as Figure 2 As shown, the schematic diagram of the process of constructing a three-dimensional model provided in the embodiment of the present application, step S102 includes (steps S1021 to S1024):

[0057] Step S1021, extracting features from the image data of the object to be enhanced at multiple angles to obtain multiple image features of the object to be enhanced;

[0058] Step S1022, matching the multiple image features with the 3D models in the feature library to obtain a 3D model matching the multiple image features;

[0059] Specifically, the 3D model includes a basic model and an incremental model; multiple basic models are obtained from the feature library, multiple image features are matched with the multiple basic models, and the basic models matching the multiple image features are output; multiple incremental models corresponding to the basic models matching the image features are obtained, multiple image features are matched with the multiple incremental models, and the incremental models matching the multiple image features are output.

[0060] Step S1023, splitting the multiple image features based on the 3D part splitting rule.

[0061] Step S1024, filling the split image features into corresponding 3D parts in the 3D model to obtain a three-dimensional model.

[0062] Step S103, obtaining current real scene information;

[0063] Step S104: superimpose the three-dimensional model with the current real scene information to obtain an effect-enhanced image.

[0064] Step S105: displaying the enhanced image.

[0065] In this embodiment, in response to the user's action instructions, the three-dimensional model in the effect-enhanced image is dynamically adjusted; the dynamically adjusted three-dimensional model is superimposed with the current real scene information to obtain an effect-enhanced image with dynamic effects; and the effect-enhanced image with dynamic effects is displayed.

[0066] Specifically, the three-dimensional model includes at least one characteristic part, each characteristic part corresponds to at least one action information, and each action information corresponds to at least one preset dynamic parameter; the current characteristic part and the current action information included in the user's action instruction are obtained; based on the current characteristic part and the current action information, the corresponding preset dynamic parameters are obtained; and the current characteristic part of the three-dimensional model is dynamically adjusted based on the preset dynamic parameters.

[0067] In this embodiment, the action information name of at least one action information is obtained; and the action information name is displayed.

[0068] In this embodiment, video recording is performed on the effect-enhanced image with dynamic effect and the image is stored.

[0069] In this embodiment, the user uses a head mounted display device to take multiple images of the object to be enhanced at different angles, the image data of the object to be enhanced includes at least 3 photos of the object to be enhanced at different angles and / or at least 3 videos of the object to be enhanced at different angles, and the multiple photos of the object to be enhanced or the videos of the object to be enhanced taken should contain the overall image of the object to be enhanced as much as possible. Multiple image features are extracted from the image data of the multiple objects to be enhanced.

[0070] For example, when the object to be enhanced is an animal, features of the animal species are extracted, wherein the multiple image features include feature information of the animal's body, head, limbs, tail, etc., which has the function of distinguishing the animal species.

[0071] Match multiple image features of the object to be enhanced with the 3D model in the feature library. The 3D model includes multiple basic models and incremental models, wherein the incremental model is an additional model of the basic model, that is, a model generated by further refining and classifying the basic model.

[0072] For example, when the object to be enhanced is an animal, multiple basic models are divided into mammal models, fish models, bird models, etc. according to the animal species. The incremental model is a small classification model that further refines the mammal model by dividing the mammal model into dog models, cat models, etc.

[0073] It should be noted that after the basic model is further refined to obtain an incremental model, the incremental model can be further refined. For example, when the object to be enhanced is an animal, after the mammal model is refined into a dog model and a cat model according to the above-mentioned model division and placement, it can also be divided according to the specific types of dogs or cats, and multiple type models can be established for each type.

[0074] In this embodiment, multiple image features of the object to be enhanced are matched with multiple basic models. After matching the basic models that meet the multiple image features, the multiple image features are matched with multiple incremental models belonging to the basic models to obtain matching incremental models, that is, a 3D model that matches the image features is obtained.

[0075] In this embodiment, after obtaining a 3D model that matches multiple image features of the object to be enhanced, the multiple image features of the object to be enhanced are split according to the 3D part splitting rule, and the split image features are filled into the corresponding 3D parts in the 3D model. After the filling is completed, the 3D model is a three-dimensional model consistent with the image data of the object to be enhanced. Among them, the 3D part splitting rule is a feature splitting rule formulated according to the image features of the object to be enhanced, that is, the image data of the object to be enhanced is split into multiple independent image features according to the image features.

[0076] In this embodiment, the 3D model is only a model framework. In order to create a three-dimensional model consistent with the image features of the object to be enhanced, the object to be enhanced needs to be split according to the 3D part splitting rules, and the multiple image features obtained by the splitting are filled into the 3D parts of the 3D model corresponding to the image part features. The filled 3D parts will have features consistent with the image features of the object to be enhanced.

[0077] In this embodiment, the three-dimensional model includes at least one characteristic part, and the 3D parts of the three-dimensional model are split according to the part features to obtain multiple characteristic part models, each characteristic part model includes a characteristic part, each characteristic part corresponds to at least one action information, each action information corresponds to at least one preset dynamic parameter, and each action information is provided with an action information name corresponding to the characteristic part. The user controls the characteristic part model to dynamically adjust according to the dynamic parameters by selecting the action information name, that is, controls the characteristic part model to make corresponding actions, and the execution order of the actions is consistent with the user's selection order. The action results of each characteristic part model of the three-dimensional model executed according to the dynamic parameters are combined with the current real scene information, that is, the three-dimensional model that is dynamically adjusted is projected into the current real scene collected by the user through the head-mounted display device, and the user can watch the effect-enhanced image with dynamic effects established according to his own needs through the head-mounted display device, and the effect-enhanced image with dynamic effects can be recorded and stored as a video.

[0078] In this embodiment, the preset dynamic parameter may be sound, color, shape, position, etc., which is not specifically limited here.

[0079] The image effect enhancement method in step S101 to step S105 is specifically described by using an example:

[0080] The user uses a head mounted display device to take three photos of a puppy from different angles as image data, where the image features include the puppy's body, head, limbs, tail, etc. The multiple image features of the puppy, i.e., the puppy's body, head, limbs, tail, etc., are matched with multiple basic models in the feature library to obtain a mammal model in the basic model that meets the puppy's image features, and then further matched with the incremental model belonging to the mammal model to obtain a dog model of the incremental model that meets the puppy's image features, thereby obtaining a model framework of the dog model.

[0081] The captured puppy image data is split into multiple part features according to the puppy's features, and the split body, head, limbs, tail, etc. are filled into the body, head, limbs, and tail model frames corresponding to the 3D model. The 3D model after filling is the three-dimensional model of the captured puppy.

[0082] The characteristic parts of the puppy three-dimensional model are split to obtain multiple characteristic part models, namely, a body model, a head model, a limb model, a tail model, etc. Each characteristic part model is configured with dynamic parameters belonging to the characteristics of the part.

[0083] The motion information of the body model includes preset dynamic parameters for controlling the twisting of the body and is named body twisting, etc. The motion information of the head model includes preset dynamic parameters for controlling the nodding and shaking of the head, head clicking, head shaking, etc. The motion information of the limb model includes preset dynamic parameters for controlling the walking and sitting movements of the limbs and is named walking, sitting, etc. The motion information of the tail model includes preset dynamic parameters for controlling the swinging frequency of the tail and is named fast swinging, slow swinging, etc., without specific limitation here.

[0084] The user controls the puppy 3D model to execute the above action instructions by selecting the names of action information such as twisting the body, nodding the head, walking, and quickly swinging. The user can watch the puppy 3D model dynamically adjust in the current displayed real scene through the head-mounted display device, and the entire dynamic adjustment process can be recorded to obtain a video with the action effects of the puppy 3D model, which is convenient for repeated viewing.

[0085] In this embodiment, only the case where the preset dynamic parameter is an action is explained. The preset dynamic parameter may include sound, color, shape, etc. For example, the action information of the tail model of the puppy model may also include a preset dynamic parameter for changing the color, and it is named color adjustment, and the color name is displayed at the same time. No further examples are given here.

[0086] It should be noted that the creation of three-dimensional models is not limited to animals, but can also be buildings, plants, cars, etc., and no specific limitation is made here.

[0087] In this embodiment, if the acquisition object of the image data is a building, the characteristic parts of the building three-dimensional model are split to obtain multiple characteristic part models, such as a building model, a window model, a gate model, etc. Each characteristic part model is configured with preset dynamic parameters belonging to the characteristics of the part. For example, the action information of the building model includes preset dynamic parameters for controlling the rotation and translation of the building and is named building rotation, building translation, etc. The action information of the window model includes preset dynamic parameters for controlling the opening and closing of the window and is named window opening, window closing, etc. The action information of the gate model includes preset dynamic parameters for controlling the opening and closing of the gate and is named gate opening, gate closing, etc., and no specific limitation is made here.

[0088] In this embodiment, if the image data collection object is a plant, the characteristic parts of the plant three-dimensional model are split to obtain multiple characteristic part models, such as a rhizome model, a leaf model, a flower model, a fruit model, etc. Each characteristic part model is configured with preset dynamic parameters belonging to the characteristics of the part. For example, the action information of the rhizome model includes preset dynamic parameters for controlling the elongation and shortening of the rhizome and is named plant growth, plant shrinkage, etc. The action information of the leaf model includes preset dynamic parameters for controlling the stretching and curling of the leaves and is named leaf stretching, leaf curling, etc. The action information of the flower model includes preset dynamic parameters for controlling the opening and closing actions of the flowers and is named flower blooming, flower contraction, etc. The action information of the fruit model includes preset dynamic parameters for controlling the growth and color change of the fruit and is named fruit ripening, fruit color change, etc., and no specific limitation is made here.

[0089] It should be noted that the creation of the three-dimensional model and the setting of the preset dynamic parameters are related to the acquisition object of the image data, but the rules adopted in the creation process and the specific parameter setting method are the same, and examples will not be given here.

[0090] Figure 3 A structural block diagram of an image effect enhancement device 200 provided in an embodiment of the application.

[0091] like Figure 3 As shown, the image effect enhancement device 200 mainly includes:

[0092] The data acquisition module 201 is used to acquire image data of the object to be enhanced at multiple angles;

[0093] A model building module 202 for building a stereoscopic stereo model of the object to be enhanced based on the image data of the object to be enhanced at multiple angles;

[0094] Information acquisition module 203, used to acquire current real scene information;

[0095] The information superposition module 204 is used to superimpose the three-dimensional model with the current real scene information to obtain an effect-enhanced image;

[0096] The image display module 205 is used for displaying the enhanced image.

[0097] As an optional implementation of this embodiment, the model building module 202 is specifically used for:

[0098] A feature extraction module is used to extract features from image data of the object to be enhanced at multiple angles to obtain multiple image features of the object to be enhanced;

[0099] A model matching module is used to match multiple image features with 3D models in a feature library to obtain a 3D model that matches the multiple image features;

[0100] A feature splitting module is used to split multiple image features based on 3D part splitting rules;

[0101] The feature filling module is used to fill the split image features into the corresponding 3D parts in the 3D model to obtain a three-dimensional model.

[0102] In this optional embodiment, the model matching module is specifically used to obtain multiple basic models in the feature library, match multiple image features with the multiple basic models, and output basic models that match the multiple image features; obtain multiple incremental models corresponding to the basic models that match the image features, match multiple image features with the multiple incremental models, and output incremental models that match the multiple image features.

[0103] As an optional implementation of this embodiment, the device is also specifically used to dynamically adjust the three-dimensional model in the effect-enhanced image in response to the user's action instructions; superimpose the dynamically adjusted three-dimensional model with the current real scene information to obtain an effect-enhanced image with dynamic effects; and display the effect-enhanced image with dynamic effects.

[0104] As an optional implementation of this embodiment, the device is also specifically used to obtain the current feature part and current action information contained in the user's action instruction; obtain corresponding preset dynamic parameters based on the current feature part and current action information; and dynamically adjust the current feature part of the three-dimensional model based on the preset dynamic parameters.

[0105] As an optional implementation of this embodiment, the device is further specifically used to obtain an action information name of at least one action information; and display the action information name.

[0106] As an optional implementation of this embodiment, the device is also specifically used to record and store the video of the effect-enhanced image with dynamic effect.

[0107] In one example, the module in any of the above devices can be one or more integrated circuits configured to implement the above methods, such as: one or more application specific integrated circuits (ASICs), or, one or more digital signal processors (DSPs), or, one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.

[0108] For another example, when the modules in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call a program. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0109] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0110] Figure 4 This is a structural block diagram of a head mounted display device 300 provided in an embodiment of the present application.

[0111] like Figure 4 As shown, the head mounted display device 300 includes a processor 301 and a memory 302 , and may further include an information input / information output (I / O) interface 303 , one or more of a communication component 304 , and a communication bus 305 .

[0112] The processor 301 is used to control the overall operation of the head mounted display device 300 to complete all or part of the steps of the above-mentioned image effect enhancement method; the memory 302 is used to store various types of data to support the operation of the head mounted display device 300, and these data may include, for example, instructions for any application or method operated on the head mounted display device 300, and data related to the application. The memory 302 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), programmable read-only memory (Programmable Read-Only Memory, PROM), read-only memory (Read-Only Memory, ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0113] The I / O interface 303 provides an interface between the processor 301 and other interface modules, and the above-mentioned other interface modules can be keyboards, mice, buttons, etc. These buttons can be virtual buttons or physical buttons. The communication component 304 is used for wired or wireless communication between the head-mounted display device 300 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G or 4G, or a combination of one or more of them, so the corresponding communication component 104 can include: Wi-Fi components, Bluetooth components, NFC components.

[0114] The head-mounted display device 300 can be implemented by one or more application-specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), controllers, microcontrollers, microprocessors or other electronic components to execute the image effect enhancement method given in the above embodiment.

[0115] The communication bus 305 may include a path to transmit information between the above components. The communication bus 305 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The communication bus 305 may be divided into an address bus, a data bus, a control bus, etc.

[0116] The head mounted display device 300 may include but is not limited to smart glasses, and may also be any device that can achieve an augmented reality effect.

[0117] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned image effect enhancement method are implemented.

[0118] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0119] The terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed, or also includes elements inherent to such process, method, article, or apparatus.

[0120] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of application involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned application concept. For example, the above features are replaced with (but not limited to) technical features with similar functions applied in the present application.

Claims

1. A method for enhancing image effects, characterized in that: Applied to a head mounted display device, the method comprises: Acquire image data of the object to be enhanced at multiple angles; Building a stereoscopic model of the object to be enhanced based on the image data of the object to be enhanced at multiple angles; Get the current real scene information; Superimposing the three-dimensional model with the current real scene information to obtain an effect-enhanced image; displaying the effect-enhanced image; After displaying the effect-enhanced image, the method further includes: In response to a user's action instruction, dynamically adjusting the three-dimensional model in the effect-enhanced image; The dynamically adjusted three-dimensional model is superimposed with the current real scene information to obtain an effect-enhanced image with dynamic effects; Displaying the effect-enhanced image with dynamic effect; The three-dimensional model includes at least one characteristic part, each of the characteristic parts corresponds to at least one action information, and each of the action information corresponds to at least one preset dynamic parameter; the dynamic adjustment of the three-dimensional model in the effect-enhanced image in response to the action instruction of the user includes: Acquire the current feature part and current action information contained in the action instruction of the user; Acquire corresponding preset dynamic parameters based on the current feature part and current action information; The current characteristic part of the three-dimensional model is dynamically adjusted based on the preset dynamic parameters.

2. The method according to claim 1, characterized in that The step of constructing a stereoscopic model of the object to be enhanced based on the image data of the object to be enhanced at multiple angles comprises: Performing feature extraction on the image data of the object to be enhanced at the multiple angles to obtain multiple image features of the object to be enhanced; Matching the multiple image features with 3D models in a feature library to obtain a 3D model that matches the multiple image features; Splitting the multiple image features based on a 3D part splitting rule; The split image features are filled into corresponding 3D parts in the 3D model to obtain the three-dimensional model.

3. The method according to claim 2, characterized in that The 3D model includes a basic model and an incremental model; matching the multiple image features with the 3D model in the feature library to obtain a 3D model matching the multiple image features includes: Acquire multiple basic models in the feature library, match the multiple image features with the multiple basic models, and output basic models that match the multiple image features; Acquire multiple incremental models corresponding to the basic model that matches the multiple image features, match the multiple image features with the multiple incremental models, and output incremental models that match the multiple image features.

4. The method according to claim 1, characterized in that: Before obtaining the current characteristic part and the current action information contained in the action instruction of the user, the method further includes: Obtaining an action information name of the at least one action information; The action information name is displayed.

5. The method according to claim 1, characterized in that: After displaying the effect-enhanced image with dynamic effect, the method further includes: Video recording and storage are performed on the effect-enhanced image with dynamic effect.

6. An image effect enhancement device, characterized in that: include: A data acquisition module, used to acquire image data of the object to be enhanced at multiple angles; a model building module, for building a stereoscopic stereo model of the object to be enhanced based on the image data of the object to be enhanced at the multiple angles; Information acquisition module, used to obtain current real scene information; An information superposition module, used for superimposing the three-dimensional model with the current real scene information to obtain an effect-enhanced image; An image display module, used for displaying the effect-enhanced image; The method further comprises: after displaying the effect-enhanced image, in response to a user's action instruction, dynamically adjusting the stereoscopic model in the effect-enhanced image; superimposing the dynamically adjusted stereoscopic model with the current real scene information to obtain an effect-enhanced image with dynamic effects; and displaying the effect-enhanced image with dynamic effects; In response to the user's action instruction, dynamically adjusting the three-dimensional model in the effect-enhanced image includes: obtaining the current feature part and current action information contained in the user's action instruction; obtaining corresponding preset dynamic parameters based on the current feature part and current action information; and dynamically adjusting the current feature part of the three-dimensional model based on the preset dynamic parameters; The three-dimensional model includes at least one characteristic part, each of the characteristic parts corresponds to at least one action information, and each of the action information corresponds to at least one preset dynamic parameter.

7. A head mounted display device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Image processing method and device

    CN105701863A

  • Display method and device, display equipment and computer readable storage medium

    CN111897431A