Augmented reality and digital product fusion display system

Abstract

The invention discloses an augmented reality and digital product fusion display system, which can identify preset identifiers such as a two-dimensional code, a graphic code and a radio frequency identification tag through an identifier identification module, is integrated on an intelligent terminal or augmented reality equipment, is convenient for a user to operate at any time, improves the use convenience, and improves the user experience. The three-dimensional model database stores appearance structures, internal components and interactive function data, provides comprehensive product information for users and meets diversified requirements, the scene fusion calculation module realizes accurate positioning and reasonable proportion zooming of a three-dimensional model in a real scene by means of a virtual reality fusion degree calculation formula, dislocation and disproportionality are avoided, and the user experience is improved. The interactive display module supports multi-mode interaction modes such as gestures, voice instructions and equipment sensors, rich and natural interactive experience is provided, the real-time interaction function enables a user to see the influence of operation on the model in real time, interactivity and feedback are enhanced, and the digital product display effect and the user experience are integrally improved.

Description

Technical Field

[0001] The present invention relates to the technical field of digital product display, and in particular to a display system integrating augmented reality and digital products. Background Art

[0002] In today's era of rapid digitalization and informatization, the integrated display of digital products and augmented reality (AR) technology has become a field with great potential and application value. However, existing digital product display methods have many limitations and cannot meet users' needs for immersive and interactive experiences. Traditional digital product displays mainly rely on two-dimensional images or videos. Users can only understand the products through static or simple dynamic images, and cannot obtain the product's spatial information, real texture, or the effect of integration with real scenes. For example, on e-commerce platforms, users can only understand the products through pictures and text descriptions, and it is difficult to intuitively experience the product's size, material, and actual usage effect. Summary of the Invention

[0003] In view of this, the present invention proposes an augmented reality and digital product fusion display system, which can effectively solve the defect of the existing technology that digital products can only be understood through static or simple dynamic images.

[0004] The technical solution of the present invention is achieved as follows:

[0005] An augmented reality and digital product integrated display system, comprising:

[0006] An identification module, used to identify a preset identification associated with a digital product, wherein the preset identification includes at least one of a QR code, a graphic code, or a radio frequency identification tag. This module is integrated into the user's smart terminal or augmented reality device;

[0007] A three-dimensional model database, used to store three-dimensional model data of a digital product associated with the preset identifier, the three-dimensional model data including appearance structure data, internal component data, and interactive function data of the product;

[0008] The scene fusion calculation module is used to fuse the 3D model data with the real scene when the user's smart terminal or augmented reality device scans the preset logo based on the virtual reality fusion degree calculation formula, ensuring the accurate positioning, reasonable scaling and lighting effect matching of the 3D model in the real scene;

[0009] The interactive display module is used to render the three-dimensional model after scene fusion calculation to the display interface of the smart terminal or augmented reality device held by the user. The user interacts with the three-dimensional model in real time through gestures, voice commands or device sensors.

[0010] As a further optional solution of the augmented reality and digital product fusion display system, the virtual reality fusion degree calculation formula is specifically as follows:

[0011] F=α×S accuracy +β×I interaction +γ×P positioning ;

[0012] Among them, F is the comprehensive score of virtual reality fusion, S accuracy is the geometric matching accuracy coefficient between the 3D model and the real scene, I interaction is the interactive response speed coefficient of function demonstration and virtual trial, P positioning is the spatial positioning accuracy coefficient, and α, β, and γ are the corresponding weight coefficients respectively.

[0013] As a further optional solution of the augmented reality and digital product fusion display system, the geometric matching accuracy coefficient S accuracy The interactive response speed coefficient I is calculated by comparing the size ratio and spatial position relationship between the three-dimensional model and the reference object in the real scene. interaction The spatial positioning accuracy coefficient P is evaluated based on the time interval from the user interaction instruction to the completion of the three-dimensional model response action. positioning It is determined by analyzing the positioning error value of the user equipment in real-world scenarios.

[0014] As a further optional solution of the augmented reality and digital product fusion display system, the geometric matching accuracy coefficient S accuracy The calculation is done by comparing the size ratio and spatial position relationship between the 3D model and the reference objects in the real scene, including:

[0015] Determine at least one reference object from the real scene through image recognition or sensor positioning, where the reference object is an entity that has a clear spatial association with the digital product;

[0016] Extract key size parameters and spatial coordinates of reference objects;

[0017] Calling a virtual reference object model associated with the reference object in a three-dimensional model database to obtain its theoretical size parameters;

[0018] Calculating the size ratio error between the real reference object and the virtual reference object in at least two orthogonal directions;

[0019] Based on the spatial coordinates of the real reference object and the virtual reference object, the relative position deviation between the two in the real scene is calculated;

[0020] Calculate the position fit coefficient based on the ratio of the relative position deviation to the size of the actual reference object;

[0021] The geometric matching accuracy coefficient is calculated by combining the size ratio error value and the position fit coefficient.

[0022] As a further optional solution of the augmented reality and digital product fusion display system, the interactive response speed coefficient I interaction The evaluation is based on the time interval between the issuance of a user interaction command and the completion of the 3D model's response action, specifically including:

[0023] Monitor the triggering behavior of user interaction instructions in real time through the interactive input interface of the user device and record the triggering timestamp of the interaction instructions;

[0024] Track the current state of the 3D model in real time. When the key frame completion signal of the target response action is detected, the response action completion timestamp is recorded.

[0025] Based on the trigger timestamp and the response action completion timestamp, calculate the time interval from the triggering of the interaction instruction to the completion of the response action;

[0026] The interaction response speed coefficient is calculated based on the time interval from the triggering of the interaction instruction to the completion of the response action.

[0027] A method for displaying the integration of augmented reality and digital products, comprising:

[0028] Scan and analyze a preset identifier associated with the digital product through an identifier recognition module of a smart terminal or augmented reality device held by the user, wherein the preset identifier includes at least one of a QR code, a graphic code, or a radio frequency identification tag;

[0029] Based on the preset identifier, the smart terminal or augmented reality device establishes a communication connection with the cloud server to obtain information associated with the digital product bound to the identifier;

[0030] Retrieving three-dimensional model data of the digital product corresponding to the unique identifier from a three-dimensional model database, the three-dimensional model data including appearance structure data, internal component data, and interactive function data of the product;

[0031] Based on the VR fusion calculation formula, the 3D model data is integrated with the real scene when the user's smart terminal or augmented reality device scans the preset logo, ensuring the accurate positioning, reasonable scaling and lighting effect matching of the 3D model in the real scene;

[0032] Rendering the three-dimensional model after scene fusion calculation to the display interface of the user's smart terminal or augmented reality device;

[0033] Users interact with the 3D model in real time through gestures, voice commands, or device sensors.

[0034] A computing device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the above-mentioned method for fusion display of augmented reality and digital products are implemented.

[0035] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the above-mentioned method for fusion display of augmented reality and digital products.

[0036] The beneficial effects of the present invention are as follows: the identification recognition module can recognize at least one preset identification including a QR code, a graphic code or a radio frequency identification tag. This diversified identification recognition capability enables the system to adapt to different scenarios and application requirements. The module is integrated into the smart terminal or augmented reality device held by the user, which is convenient for the user to perform identification operations anytime and anywhere without the need for additional special equipment, thereby improving the convenience of use. The three-dimensional model database stores the appearance structure data, internal component data and interactive function data of the digital product, providing users with a full range of product information. The appearance structure data allows users to intuitively understand the appearance characteristics of the product. The internal component data is very valuable for some users who need to understand the internal structure of the product. The interactive function data supports users to interact with the three-dimensional model, enhancing the fun and practicality of the display. Based on the virtual reality fusion degree calculation formula, the scene fusion calculation module can ensure the precise positioning and reasonable scaling of the three-dimensional model in the real scene, which means that the virtual three-dimensional model can be accurately placed in the corresponding position in the real scene and maintain a suitable proportional relationship with the surrounding environment, avoiding the misalignment or disproportion between the model and the real scene, thereby providing users with a more realistic and natural visual experience. The interactive display module supports users to interact with the three-dimensional model in real time through gestures, voice commands or device sensors. This multimodal interaction method meets the usage habits and needs of different users and provides a richer and more natural interactive experience. The real-time interaction function enables users to immediately see the impact of their operations on the three-dimensional model, enhancing the interactivity and feedback between users and the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0038] Figure 1This is a schematic diagram of the composition of an augmented reality and digital product integrated display system of the present invention;

[0039] Figure 2 This is a flow chart of a method for displaying the integration of augmented reality and digital products according to the present invention;

[0040] Figure 3 A schematic diagram of the composition of a computing device according to the present invention. DETAILED DESCRIPTION

[0041] The following is a clear and complete description of the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0042] refer to Figures 1 to 3 , an augmented reality and digital product fusion display system, comprising:

[0043] An identification module, used to identify a preset identification associated with a digital product, wherein the preset identification includes at least one of a QR code, a graphic code, or a radio frequency identification tag. This module is integrated into the user's smart terminal or augmented reality device;

[0044] A three-dimensional model database, used to store three-dimensional model data of a digital product associated with the preset identifier, the three-dimensional model data including appearance structure data, internal component data, and interactive function data of the product;

[0045] The scene fusion calculation module is used to fuse the 3D model data with the real scene when the user's smart terminal or augmented reality device scans the preset logo based on the virtual reality fusion degree calculation formula, ensuring the accurate positioning, reasonable scaling and lighting effect matching of the 3D model in the real scene;

[0046] The interactive display module is used to render the three-dimensional model after scene fusion calculation to the display interface of the smart terminal or augmented reality device held by the user. The user interacts with the three-dimensional model in real time through gestures, voice commands or device sensors.

[0047] In this embodiment, the identification recognition module can recognize at least one preset identification including a QR code, a graphic code or a radio frequency identification tag. This diversified identification recognition capability enables the system to adapt to different scenarios and application requirements. The module is integrated into the smart terminal or augmented reality device held by the user, so that the user can perform identification operations anytime and anywhere without the need for additional dedicated equipment, thereby improving the convenience of use. The three-dimensional model database stores the appearance structure data, internal component data and interactive function data of the digital product, providing users with a full range of product information. The appearance structure data allows users to intuitively understand the appearance characteristics of the product. The internal component data is very valuable for some users who need to understand the internal structure of the product. The interactive function data supports users to interact with the three-dimensional model, enhancing the fun and practicality of the display. Based on the virtual reality fusion degree calculation formula, the scene fusion calculation module can ensure the precise positioning and reasonable scaling of the three-dimensional model in the real scene, which means that the virtual three-dimensional model can be accurately placed in the corresponding position in the real scene and maintain a suitable proportional relationship with the surrounding environment, avoiding the misalignment or disproportion between the model and the real scene, thereby providing users with a more realistic and natural visual experience. The interactive display module supports users to interact with the three-dimensional model in real time through gestures, voice commands or device sensors. This multimodal interaction method meets the usage habits and needs of different users and provides a richer and more natural interactive experience. The real-time interaction function enables users to immediately see the impact of their operations on the three-dimensional model, enhancing the interactivity and feedback between users and the system.

[0048] Preferably, the virtual reality fusion degree calculation formula is specifically:

[0049] F=α×S accuracy +β×I interaction +γ×P positioning ;

[0050] Among them, F is the comprehensive score of virtual reality fusion, S accuracy is the geometric matching accuracy coefficient between the 3D model and the real scene, I interaction is the interactive response speed coefficient of function demonstration and virtual trial, P positioning is the spatial positioning accuracy coefficient, and α, β, and γ are the corresponding weight coefficients respectively.

[0051] Preferably, the geometric matching accuracy coefficient S accuracy The interactive response speed coefficient I is calculated by comparing the size ratio and spatial position relationship between the three-dimensional model and the reference object in the real scene. interaction The spatial positioning accuracy coefficient P is evaluated based on the time interval from the user interaction instruction to the completion of the three-dimensional model response action.positioning It is determined by analyzing the positioning error value of the user equipment in real-world scenarios.

[0052] In this embodiment, the virtual reality fusion degree calculation formula can accurately quantify the degree of fusion between the three-dimensional model and the real scene. The coefficients are considered from key dimensions such as geometric matching accuracy, interactive response speed, and spatial positioning accuracy. This makes the evaluation of the fusion effect no longer limited to subjective feelings, but has objective and quantitative standards. accuracy The coefficient focuses on the geometric matching between the 3D model and the real scene. In digital product display, accurate geometric matching can ensure that the virtual model and the real environment are perfectly matched in terms of size, shape, position, etc. For example, in the industrial design review scenario, accurate geometric matching allows designers to intuitively see the placement effect of the product model in the actual environment, avoid misjudgment due to dimensional deviation, and improve design efficiency and accuracy. interaction The coefficient focuses on the interactive response speed of function demonstration and virtual trial. Fast-response interaction can bring users a smooth and natural experience and enhance the user's sense of interaction with the virtual model. For example, in the virtual try-on scene, when the user operates the virtual clothing, the fast response allows the user to see the operation effect in time, which improves the fun and practicality of the try-on and increases user participation and satisfaction. positioning The coefficient ensures the precise positioning of the three-dimensional model in the real scene. Accurate spatial positioning is the basis for the integration of virtual models and real scenes. It enables the virtual model to be accurately placed at the designated location in the real environment, avoiding problems such as model drift and dislocation.

[0053] It should be noted that the weight coefficients α, β, and γ in the formula can be dynamically adjusted according to the needs of different application scenarios. This enables the system to flexibly optimize the fusion effect according to specific application goals, such as whether to focus more on geometric accuracy or interactive experience, and α+β+γ=1.

[0054] Preferably, the geometric matching accuracy coefficient S accuracy The calculation is done by comparing the size ratio and spatial position relationship between the 3D model and the reference objects in the real scene, including:

[0055] Determine at least one reference object in the real scene through image recognition or sensor positioning. The reference object is an entity with a clear spatial association with the digital product (such as a product packaging box, the edge of a display stand, a feature pattern on a background wall, or an auxiliary positioning marker of known size);

[0056] Extract key dimensional parameters (such as length, width, height) and spatial coordinates (such as the three-dimensional position vector relative to the scanning device) of the reference object;

[0057] Calling a virtual reference object model associated with the reference object in a three-dimensional model database to obtain its theoretical size parameters;

[0058] Calculating the size ratio error between the real reference object and the virtual reference object in at least two orthogonal directions;

[0059] Based on the spatial coordinates of the real reference object and the virtual reference object, the relative position deviation between the two in the real scene is calculated;

[0060] Calculate the position fit coefficient based on the ratio of the relative position deviation to the size of the actual reference object;

[0061] The geometric matching accuracy coefficient is calculated by combining the size ratio error value and the position fit coefficient.

[0062] In this embodiment, at least one entity with a clear spatial association with the digital product is determined from the real scene through image recognition or sensor positioning as a reference object, and its key size parameters and spatial coordinates are extracted. This process ensures the rationality of the reference object selection and the accuracy of the parameter extraction, and provides reliable basic data for subsequent calculations. For example, when displaying a furniture product, the wall, floor or other fixed furniture in the room can be selected as a reference object, and its size and position information can be accurately obtained through image recognition technology; the virtual reference object model associated with the reference object in the three-dimensional model database is called to obtain its theoretical size parameters, and the size ratio error values ​​between the real reference object and the virtual reference object in at least two orthogonal directions are calculated. This multi-directional size ratio error calculation can comprehensively evaluate the degree of size matching between the virtual model and the real reference object, avoiding the problem of single-direction calculation. It can bring about one-sidedness. For example, when evaluating a mechanical part model, by calculating its dimensional ratio error in orthogonal directions such as length, width and height, the geometric similarity between the model and the real part can be judged more accurately; based on the spatial coordinates of the real reference object and the virtual reference object, the relative position deviation of the two in the real scene is calculated, and the position fit coefficient is calculated according to the ratio of the relative position deviation to the size of the real reference object. This step can accurately measure the positioning accuracy of the virtual model in the real scene and ensure that the virtual model can be accurately placed in the corresponding position in the real environment; combining the dimensional ratio error value and the position fit coefficient, calculate the geometric matching accuracy coefficient. This comprehensive evaluation method comprehensively considers the matching between the virtual model and the real reference object in two key aspects of size and position, and can more accurately reflect the degree of geometric matching between the three-dimensional model and the real scene.

[0063] It should be noted that the calculation formula for calculating the size ratio error value E between the real reference object and the virtual reference object in at least two orthogonal directions is:

[0064]

[0065] Among them, L real,i is the measured size of the real reference object in the i-th direction, L virtual,i is the theoretical size of the virtual reference model in the corresponding direction, k is the initial scaling factor, which is automatically estimated based on the scanning distance, and n is the number of calculation directions;

[0066] Calculate the relative position deviation between the two in the real scene. The calculation formula is:

[0067]

[0068] in, is the position vector of the real reference object in the scanning device coordinate system, is the theoretical position vector of the virtual reference model;

[0069] Calculate the position fit coefficient, the calculation formula is:

[0070]

[0071] Calculate the geometric matching accuracy coefficient using the following formula:

[0072] S accuracy =1-(w1·E+w2·E position );

[0073] Among them, w1 and w2 are weight coefficients, and satisfy w1+w2=1. Their values ​​are dynamically adjusted according to the emphasis of the application scenario on dimensional accuracy and position accuracy.

[0074] Preferably, the interactive response speed coefficient I interaction The evaluation is based on the time interval between the issuance of a user interaction command and the completion of the 3D model's response action, specifically including:

[0075] Monitor the triggering behavior of user interaction instructions in real time through the interactive input interface of the user device and record the triggering timestamp Tinput of the interaction instructions;

[0076] Track the current state of the 3D model in real time. When the keyframe completion signal of the target response action is detected, the response action completion timestamp Tresponse is recorded.

[0077] Based on the trigger timestamp and the response action completion timestamp, calculate the time interval from the triggering of the interaction instruction to the completion of the response action;

[0078] The interaction response speed coefficient is calculated based on the time interval from the triggering of the interaction instruction to the completion of the response action.

[0079] In this embodiment, the triggering behavior of the user interaction instruction is monitored in real time through the interactive input interface of the user device, and the triggering timestamp of the interaction instruction is recorded. This process ensures that the system can capture the user's interaction intention in a timely and accurate manner, and provides a precise starting time point for the subsequent response speed evaluation. For example, when the user operates the three-dimensional model through gestures or voice commands, the system can immediately record the moment the instruction is issued, avoiding the response speed evaluation error caused by untimely monitoring or inaccurate recording; the current state of the three-dimensional model is tracked in real time, and when the key frame completion signal of the target response action is detected, the response action completion timestamp is recorded. This real-time tracking of the model state and key frame detection mechanism can accurately determine the completion moment of the model response action, providing a precise end time point for the response speed evaluation. For example, when the user tries on virtual clothing, the system can monitor the deformation and fitting process of the clothing model in real time. When the expected try-on effect is achieved (i.e., key frame completion), it is accurately recorded. Record the completion time; based on the trigger timestamp and the response action completion timestamp, calculate the time interval from the triggering of the interaction instruction to the completion of the response action. This calculation process objectively and directly reflects the system's response speed to the user's interaction instructions, avoiding the influence of subjective factors on the evaluation results. Through accurate time interval calculation, we can clearly understand the system's response performance in different interaction scenarios, providing strong data support for performance optimization; based on the time interval from the triggering of the interaction instruction to the completion of the response action, calculate the interaction response speed coefficient. This coefficient provides a quantitative indicator for the system response speed, allowing the response speeds of different systems or the same system under different conditions to be intuitively compared and evaluated. For example, by comparing the response speed coefficients under different interaction methods (such as gestures, voice, sensors, etc.), we can find the interaction method with a slower response speed and then optimize it in a targeted manner.

[0080] It should be noted that the time interval ΔT from the triggering of the interaction instruction to the completion of the response action is calculated using the following formula:

[0081] ΔT = Tresponse - Tinput;

[0082] Calculate the interactive response speed coefficient. The specific calculation formula is:

[0083] I interaction =e -λΔT .

[0084] In addition, a quantitative evaluation is performed by analyzing the positioning error value of the user equipment in a real-world scenario, which specifically includes the following steps:

[0085] Step S1, multi-source positioning data fusion collection:

[0086] The composite positioning module of the user's smart terminal or augmented reality device simultaneously collects multi-dimensional positioning data, including:

[0087] Visual Inertial Odometry (VIO) data: Generates the relative motion trajectory of the device in the real scene based on the fused positioning information of the device camera and IMU sensor;

[0088] Spatial anchor point data: Obtain absolute spatial coordinates by scanning preset positioning markers in real-world scenarios (such as QR code arrays, high-contrast feature point maps, or pre-deployed UWB base station signals);

[0089] Environmental feature matching data: Utilize SLAM algorithms to extract 3D point clouds or semantic features of real-world scenes (such as walls and furniture edges) and compare and locate them with pre-built scene maps.

[0090] Perform timestamp alignment and spatial coordinate system conversion on multi-source positioning data to generate positioning data stream of the device in a unified reference coordinate system in is the three-dimensional position vector of the device at time t;

[0091] Step S2, dynamic calculation of positioning error value:

[0092] If high-precision positioning anchors are deployed in the real scene (such as reflective markers of optical motion capture systems or laser radar scanning benchmarks), the device positioning data and anchor point truth Compare and calculate the instantaneous positioning error Specifically:

[0093]

[0094] A method for displaying the integration of augmented reality and digital products, comprising:

[0095] Scan and analyze a preset identifier associated with the digital product through an identifier recognition module of a smart terminal or augmented reality device held by the user, wherein the preset identifier includes at least one of a QR code, a graphic code, or a radio frequency identification tag;

[0096] Based on the preset identifier, the smart terminal or augmented reality device establishes a communication connection with the cloud server to obtain information related to the digital product bound to the identifier;

[0097] Retrieving three-dimensional model data of the digital product corresponding to the unique identifier from a three-dimensional model database, the three-dimensional model data including appearance structure data, internal component data, and interactive function data of the product;

[0098] Based on the VR fusion calculation formula, the 3D model data is integrated with the real scene when the user's smart terminal or augmented reality device scans the preset logo, ensuring the accurate positioning, reasonable scaling and lighting effect matching of the 3D model in the real scene;

[0099] Rendering the three-dimensional model after scene fusion calculation to the display interface of the user's smart terminal or augmented reality device;

[0100] Users interact with the 3D model in real time through gestures, voice commands, or device sensors.

[0101] A computing device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the above-mentioned method for fusion display of augmented reality and digital products are implemented.

[0102] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the above-mentioned method for fusion display of augmented reality and digital products.

[0103] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. An augmented reality and digital product fusion display system, characterized in that: include: An identification module, used to identify a preset identification associated with a digital product, wherein the preset identification includes at least one of a QR code, a graphic code, or a radio frequency identification tag. This module is integrated into the user's smart terminal or augmented reality device; A three-dimensional model database, used to store three-dimensional model data of a digital product associated with the preset identifier, the three-dimensional model data including appearance structure data, internal component data, and interactive function data of the product; The scene fusion calculation module is used to fuse the 3D model data with the real scene when the user's smart terminal or augmented reality device scans the preset logo based on the virtual reality fusion degree calculation formula, ensuring the accurate positioning, reasonable scaling and lighting effect matching of the 3D model in the real scene; The interactive display module is used to render the three-dimensional model after scene fusion calculation to the display interface of the smart terminal or augmented reality device held by the user. The user interacts with the three-dimensional model in real time through gestures, voice commands or device sensors.

2. The augmented reality and digital product fusion display system according to claim 1, characterized in that: The virtual reality fusion degree calculation formula is specifically: F=α×Saccuracy+β×Iinteraction+γ×Ppositioning; Among them, F is the comprehensive score of virtual reality fusion, Saccuracy is the geometric matching accuracy coefficient between the three-dimensional model and the real scene, Iinteraction is the interactive response speed coefficient of function demonstration and virtual trial, Ppositioning is the spatial positioning accuracy coefficient, and α, β, and γ are the corresponding weight coefficients respectively.

3. The augmented reality and digital product integrated display system according to claim 2, characterized in that: The geometric matching accuracy coefficient Saccuracy is calculated by comparing the size ratio and spatial position relationship between the three-dimensional model and the reference object in the real scene. The interactive response speed coefficient Iinteraction is evaluated based on the time interval from the issuance of the user interaction command to the completion of the three-dimensional model response action. The spatial positioning accuracy coefficient Ppositioning is determined by analyzing the positioning error value of the user device in the real scene.

4. The augmented reality and digital product integrated display system according to claim 3, characterized in that: The geometric matching accuracy coefficient Saccuracy is calculated by comparing the size ratio and spatial position relationship between the three-dimensional model and the reference object in the real scene, specifically including: Determine at least one reference object from the real scene through image recognition or sensor positioning, where the reference object is an entity that has a clear spatial association with the digital product; Extract key size parameters and spatial coordinates of reference objects; Calling a virtual reference object model associated with the reference object in a three-dimensional model database to obtain its theoretical size parameters; Calculating the size ratio error between the real reference object and the virtual reference object in at least two orthogonal directions; Based on the spatial coordinates of the real reference object and the virtual reference object, the relative position deviation between the two in the real scene is calculated; Calculate the position fit coefficient based on the ratio of the relative position deviation to the size of the actual reference object; The geometric matching accuracy coefficient is calculated by combining the size ratio error value and the position fit coefficient.

5. The augmented reality and digital product integrated display system according to claim 4, characterized in that: The interaction response speed coefficient Iinteraction is evaluated based on the time interval from the issuance of the user interaction instruction to the completion of the 3D model's response action, specifically including: Monitor the triggering behavior of user interaction instructions in real time through the interactive input interface of the user device and record the triggering timestamp of the interaction instructions; Track the current state of the 3D model in real time. When the key frame completion signal of the target response action is detected, the response action completion timestamp is recorded. Based on the trigger timestamp and the response action completion timestamp, calculate the time interval from the triggering of the interaction instruction to the completion of the response action; The interaction response speed coefficient is calculated based on the time interval from the triggering of the interaction instruction to the completion of the response action.

6. A method for displaying the integration of augmented reality and digital products, characterized in that: Specifically include: Scan and analyze a preset identifier associated with the digital product through an identifier recognition module of a smart terminal or augmented reality device held by the user, wherein the preset identifier includes at least one of a QR code, a graphic code, or a radio frequency identification tag; Based on the preset identifier, the smart terminal or augmented reality device establishes a communication connection with the cloud server to obtain information related to the digital product bound to the identifier; Retrieving three-dimensional model data of the digital product corresponding to the unique identifier from a three-dimensional model database, the three-dimensional model data including appearance structure data, internal component data, and interactive function data of the product; Based on the VR fusion calculation formula, the 3D model data is integrated with the real scene when the user's smart terminal or augmented reality device scans the preset logo, ensuring the accurate positioning, reasonable scaling and lighting effect matching of the 3D model in the real scene; Rendering the three-dimensional model after scene fusion calculation to the display interface of the user's smart terminal or augmented reality device; Users interact with the 3D model in real time through gestures, voice commands, or device sensors.

7. A computing device, characterized in that The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the method implements the steps of the method for displaying the fusion of augmented reality and digital products as claimed in claim 6.

8. A computer-readable storage medium, characterized in that The storage medium stores a computer program, which, when executed by the processor, implements the steps of the method for displaying the fusion of augmented reality and digital products as claimed in claim 6.

Images