Cross-platform visual communication immersive media interaction method based on augmented reality

Abstract

The invention discloses a cross-platform visual communication immersive media interaction method based on augmented reality, and belongs to the technical field of media interaction. A content adaptation layer is constructed, cross-terminal hardware and operation environment parameters are collected, a content adaptation configuration package with annotations is generated, and a standardized content frame architecture unified rendering basis is compiled; a scene rendering layer is constructed, and a dynamic to-be-rendered visual architecture is generated through an interface calling configuration package in combination with a scene database; constructing an interaction response layer, and forming a unified interaction instruction by using the sub-instructions to realize cross-platform testing; establishing a cross-end adaptation regulation and control center, and collecting test data to generate an interaction sample set and a sub-instruction group set; and building a content adaptation configuration package replacement model, optimizing the configuration package by rendering the adaptation degree, and screening the optimal visual architecture according to the test sharing degree. According to the invention, the problems of poor cross-platform adaptation, insufficient immersion and low test efficiency of the existing AR media are solved, and the cross-terminal interaction consistency and the user immersion experience are improved.

Description

Technical Field

[0001] This invention relates to the field of media interaction technology, specifically to an immersive media interaction method based on augmented reality and cross-platform visual communication. Background Technology

[0002] With the deep penetration of augmented reality (AR) technology in the media field, AR visual communication, with its characteristics of "virtual-real fusion and real-time interaction," has become a core technological support for scenarios such as advertising and marketing, education and popular science, and museum exhibitions. Currently, AR media interaction technologies mostly focus on single-terminal development, while in practical applications, user terminals exhibit characteristics of "multiple types and multiple parameters," including smartphones (iOS / Android dual systems, resolutions from 1080P to 4K), AR smart glasses (field of view 45°-120°, tracking accuracy 0.1mm-1mm), and tablets (screen size 7-13 inches, RAM 4GB-16GB), etc. The significant differences in terminal hardware parameters and operating environments (system version, network bandwidth, ambient light intensity) lead to the following shortcomings in existing technologies: Existing AR media content is mostly developed based on fixed terminal parameters, without establishing a dynamic adaptation mechanism between terminals and content. For example, a 100,000-facet high-definition home appliance model developed for high-end AR glasses only achieves a frame rate of 12-15fps on mid-range Android phones, resulting in noticeable stuttering and texture loss. Meanwhile, a simplified 50,000-facet model optimized for mobile phones displays blurry images on AR glasses (detail recognition rate <60%), failing to meet the visual needs of different terminals and ensuring consistent cross-platform user experience. Existing technologies use a scene rendering mode of "fixed template + preset parameters", which cannot be dynamically adjusted according to terminal characteristics and environmental conditions. For example, in the AR advertising scene in a shopping mall, the advertising content with a fixed brightness (1.0cd / m²) is too reflective in a strong light environment, and the visibility is only 40%. In a low light environment, the lack of brightness causes the loss of details and the virtual-real effect is not good. Moreover, the AR scene is not compatible with the display characteristics of the terminal (such as the wide-angle display of AR glasses and the narrow screen display of mobile phones), and the user's "immersion" is significantly different from the real scene experience. Because of the fundamental differences in AR interaction protocols and logic between different terminals, existing technologies require writing separate test instructions for each type of terminal. For example, to test the "AR model rotation" interaction, five independent scripts need to be developed for five types of terminals, with a testing cycle of 10-15 days. The instruction sharing rate is insufficient. Furthermore, due to the lack of unified instructions, the success rate of cross-terminal interaction is also reduced, resulting in high development costs and maintenance difficulties. Summary of the Invention

[0003] The purpose of this invention is to provide a cross-platform visual communication immersive media interaction method based on augmented reality to solve at least one of the problems mentioned in the background art.

[0004] To solve the above-mentioned technical problems, the present invention provides the following technical solution: An immersive media interaction method for cross-platform visual communication based on augmented reality, comprising the following steps: Construct a content adaptation layer, collect hardware parameters and operating environment parameters of cross-platform visual augmented reality terminals, and generate content adaptation configuration packages in code. By compiling a standardized content frame architecture before media interaction, the basic rendering rules of visual media content are instructed. Construct a scene rendering layer, set up a standardized content frame architecture content adaptation configuration package communication interface and scene database, and call the content adaptation configuration package through the communication interface to generate several visual media content architectures to be rendered after media interaction based on the standardized content frame architecture. An interactive response layer is constructed, and sub-instructions are set based on the basic presentation logic of visual media content. These sub-instructions constitute a unified cross-platform interactive instruction, which is then matched with each content frame to be rendered in the visual media content architecture to be rendered, in order to test the cross-platform interactive operation of the visual media content architecture to be rendered. A cross-platform adaptation control center is established to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and to generate an interactive sample set. Under cross-platform interactive operation test, the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered in order to generate a set of sub-instructions for the visual media content architecture to be rendered. Build a replacement model for the content adaptation configuration package, replace and optimize the content adaptation configuration package, and evaluate the test sharing degree of the interaction instructions after the replacement and optimization are completed in order to select the optimal visual communication architecture after media interaction.

[0005] As a preferred embodiment of the present invention, the specific implementation process of constructing the content adaptation layer includes: The hardware parameters and operating environment parameters of the cross-platform visual augmented reality terminal are retrieved, the hardware parameters and operating environment parameters are coded and parameter comments are added to obtain a content adaptation configuration package. Each content adaptation configuration package corresponds to a combination of hardware parameters and operating environment parameters. The content adaptation configuration package is uniformly coded, and the parameter comments include parameter types and parameter field values. Based on the fundamental presentation logic of visual media content, a standardized content frame architecture is developed before media interaction. The standardized content frame architecture is used to instruct the basic rendering rules of visual media content, and a content adaptation configuration package corresponds to a visual requirement of the standardized content frame. The rendering parameters of the standardized content frame are defined through the content adaptation configuration package to meet the visual requirement.

[0006] As a preferred embodiment of the present invention, the specific implementation process of constructing the scene rendering layer includes: The scene rendering layer is used to implement the dynamic scene-based construction of the standardized content frame architecture, and calls the content adaptation configuration package through the set standardized content frame architecture content adaptation configuration package communication interface to realize the dynamic scene-based construction. The scene rendering layer has a built-in scene database, which is used to store various content adaptation configuration packages. When each standardized content frame in the standardized content frame architecture connects to the scene database through the communication interface and realizes the call of the content adaptation configuration package, several visual media content architectures to be rendered after media interaction are obtained.

[0007] As a preferred embodiment of the present invention, the specific implementation process of constructing the interactive response layer includes: The interactive response layer is based on the basic presentation logic of visual media content, sets and stores unified cross-platform interactive instructions, and tests the cross-platform interactive operation of the visual media content architecture to be rendered through the interactive instructions; the interactive instructions contain several sub-instructions, wherein each sub-instruction corresponds to testing a content adaptation configuration package; The sub-instruction is set with an identifier code that is associated with the parameter annotation of the content adaptation configuration package. The sub-instruction is uniformly encoded by the identifier code or parameter annotation, and the identifier code is used to match each content frame to be rendered in the visual media content architecture to be rendered.

[0008] As a preferred embodiment of the present invention, the specific implementation process of step S4 includes: When conducting cross-platform interactive tests on the standardized content frames corresponding to the visual media content architecture to be rendered, several content frames generated corresponding to the visual media content architecture to be rendered are collected, and an interactive sample set is generated, denoted as . ,in, This represents the set of interactive samples generated corresponding to the i-th visual media content architecture to be rendered. This indicates the content adaptation configuration package set called for the e-th content frame to be rendered, where E represents the total number of content frames to be rendered. , This represents the r-th content adaptation configuration package, where R represents the total number of content adaptation configuration packages. In cross-platform interactive operation testing, once the identifier code of the sub-instruction matches the parameter comments of the content adaptation configuration package of the content frame to be rendered, the interactive instruction is extracted to generate a content adaptation configuration package set. The set of sub-instructions, denoted as The subinstruction set contains several subinstructions.

[0009] As a preferred embodiment of the present invention, the specific implementation process of replacing and optimizing the content adaptation configuration package includes: When dynamically generating the i-th visual media content architecture to be rendered, run each content adaptation configuration package in the content adaptation configuration package set and record the content adaptation configuration packages. Rendering fit in the e-th content frame to be rendered In the formula, Indicates the runtime content adaptation configuration package The m-th actual rendering parameter of the content frame to be rendered generated at that time. This field represents the rendering parameters of the normalized content frame corresponding to the content frame to be rendered. If the actual rendering parameters... Belongs to the rendering parameter field In the middle, then order Otherwise , where n represents the total number of actual rendering parameters; Preset content adaptation threshold; if rendering adaptation... If the content adaptation threshold is less than or equal to the content adaptation configuration package, then adjust the content adaptation configuration package accordingly. Replace and re-integrate into the content adaptation configuration package. In the process, the rendering adaptability after replacement will continue to be evaluated until the rendering adaptability is less than or equal to the content adaptability threshold; if the rendering adaptability... If the result exceeds the content adaptation threshold, then proceed to the next content adaptation configuration package for rendering adaptation evaluation.

[0010] As a preferred embodiment of the present invention, the specific implementation process of evaluating the test sharing degree of interactive instructions to select the optimal visual communication architecture after media interaction includes: When the interaction sample set After each content adaptation configuration package participates in the rendering compatibility evaluation and is replaced, the cross-platform interactive operation of the visual media content architecture to be rendered is tested using interactive commands. The test shareability of the interactive commands is then evaluated. In the formula, Represents the interactive sample set Content adaptation configuration packages Corresponding sub-instruction set The number of sub-instructions contained in the union set. It is the mean, and , Let the variance be, and g represents the total number of visual media content architectures to be rendered, corresponding to the standardized content frame architecture; Select the visual media content architecture to be rendered corresponding to the maximum test sharing degree. As the optimal visual communication architecture after media interaction.

[0011] An augmented reality-based cross-platform visual communication immersive media interaction system includes a storage unit and a processor. The storage unit stores a program for an augmented reality-based cross-platform visual communication immersive media interaction method. The processor executes the program for the augmented reality-based cross-platform visual communication immersive media interaction method. The processor also integrates a media interaction processing module and a cross-platform control and analysis module. The media interaction processing module is used to construct a content adaptation layer, a scene rendering layer, and an interaction response layer. The content adaptation layer collects hardware and operating environment parameters of the cross-platform augmented reality terminal and generates a content adaptation configuration package in code. It then compiles a standardized content frame architecture before media interaction to instruct the basic rendering rules of the visual media content. The scene rendering layer sets up a communication interface for the standardized content frame architecture's content adaptation configuration package and a scene database. It calls the content adaptation configuration package through the communication interface to generate several visual media content architectures to be rendered after media interaction. The interaction response layer sets sub-instructions based on the basic presentation logic of the visual media content, and these sub-instructions constitute a unified cross-platform interaction instruction. It then matches each content frame to be rendered in the visual media content architecture to test the cross-platform interactive operation of the visual media content architecture to be rendered. The cross-platform control and analysis module is used to build a cross-platform adaptation control center and a replacement model for the content adaptation configuration package. The cross-platform adaptation control center is used to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and generate an interaction sample set. Under cross-platform interactive operation test, the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered to generate a sub-instruction set of the visual media content architecture to be rendered. The replacement model of the content adaptation configuration package is used to replace and optimize the content adaptation configuration package. After the replacement and optimization is completed, the test sharing degree of the interaction instructions is evaluated to select the optimal visual communication architecture after media interaction.

[0012] As a preferred embodiment of the present invention, the media interaction processing module includes a content adaptation layer unit, a scene rendering layer unit, and an interaction response layer unit. The content adaptation layer unit is used to retrieve the hardware parameters and operating environment parameters of the cross-platform visual augmented reality terminal to obtain the content adaptation configuration package, and to compile a standardized content frame architecture before media interaction through the basic presentation logic of visual media content. The scene rendering layer unit is used to call the content adaptation configuration package through the content adaptation configuration package communication interface of the set standardized content frame architecture, so as to realize the dynamic scene-based construction of the standardized content frame architecture and obtain several visual media content architectures to be rendered after media interaction. The interactive response layer unit is used to set and store cross-platform unified interactive instructions, and to test the cross-platform interactive operation of the visual media content architecture to be rendered through the interactive instructions; and the interactive instructions include sub-instructions, set the identification code of the sub-instructions, and match each content frame to be rendered in the visual media content architecture to be rendered by recognizing the identification code.

[0013] As a preferred embodiment of the present invention, the cross-end control analysis module includes an interactive sample set generation unit, a sub-instruction set generation unit, a rendering adaptation analysis unit, and a test sharing analysis unit. The interactive sample set generation unit is used to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and generate an interactive sample set. The sub-instruction set generation unit is used to generate a sub-instruction set of the visual media content architecture to be rendered after the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered. The rendering adaptation analysis unit is used to analyze and record the rendering adaptation degree of the content adaptation configuration package under the content frame to be rendered, so as to realize the replacement and optimization of the content adaptation configuration package. The test sharing analysis unit is used to evaluate the test sharing degree of interactive instructions in order to screen the visual media content architecture to be rendered.

[0014] Compared with existing technologies, the beneficial effects achieved by this invention are as follows: Cross-platform AR media optimization is achieved through five core logic layers, including: constructing a content adaptation layer, collecting cross-terminal hardware and operating environment parameters and generating annotated content adaptation configuration packages, and compiling a standardized content frame architecture to unify the rendering foundation; constructing a scene rendering layer, generating a dynamic visual architecture to be rendered by combining the configuration package with a scene database through interface calls; constructing an interaction response layer, using sub-instructions to form unified interaction commands to achieve cross-platform testing; building a cross-terminal adaptation control center, collecting test data to generate interaction sample sets and sub-instruction sets; and building a content adaptation configuration package replacement model, optimizing the configuration package through rendering adaptation and selecting the optimal visual architecture based on test sharing. The system includes a memory and a processor integrating a media interaction processing module and a cross-terminal control analysis module. This invention solves the pain points of poor cross-platform adaptation, insufficient immersion, and low testing efficiency in existing AR media, improving cross-terminal interaction consistency and user immersion experience, and can be widely applied to AR advertising and marketing, AR educational courseware, AR virtual exhibitions, and other scenarios. Attached Figure Description

[0015] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used together with the embodiments of the invention to explain the invention and do not constitute a limitation thereof.

[0016] Figure 1This is a schematic diagram illustrating the steps of an immersive media interaction method for cross-platform visual communication based on augmented reality, according to the present invention. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] Please see Figure 1 In this first embodiment: a cross-platform visual communication immersive media interaction method based on augmented reality is provided, which includes the following steps: Construct a content adaptation layer, collect hardware parameters and operating environment parameters of cross-platform visual augmented reality terminals, and generate content adaptation configuration packages in code. By compiling a standardized content frame architecture before media interaction, the basic rendering rules of visual media content are instructed. It should be noted that the content adaptation layer is the core foundation of cross-platform adaptation. Its logic is "parameter coding + rendering rule standardization". For example, hardware parameters (screen resolution, processor model, field of view) and runtime environment parameters (system version, network bandwidth) are collected through the terminal SDK interface. The parameters are converted into structured configuration packages (such as JSON format) with "type + field value" annotations to ensure that each terminal parameter can be accurately identified. At the same time, a standardized content frame architecture is compiled based on the basic AR content presentation logic (such as PBR physical rendering, 30fps frame rate). The rendering parameters of the frame architecture are defined through configuration packages (such as 100,000 face count for AR glasses and 50,000 face count for mobile phones), realizing "the same content framework, adapted to different terminals", eliminating the basic differences in cross-terminal rendering from the source. For example, building a content adaptation layer also includes the following steps: The hardware parameters and runtime environment parameters of the cross-platform visual augmented reality terminal are retrieved, the hardware parameters and runtime environment parameters are coded and parameter comments are added to obtain a content adaptation configuration package. Each content adaptation configuration package corresponds to a combination of hardware parameters and runtime environment parameters. The content adaptation configuration package is uniformly coded, and the parameter comments include parameter types and parameter field values. Based on the basic presentation logic of visual media content, a standardized content frame architecture is developed before media interaction. The standardized content frame architecture is used to instruct the basic rendering rules of visual media content, and one content adaptation configuration package corresponds to one visual requirement of the standardized content frame. The rendering parameters of the standardized content frame are defined through the content adaptation configuration package to meet the visual requirements. For example, a home appliance company needs to build an AR virtual exhibition and sales event to realize AR interactive display of 8 types of home appliances such as refrigerators, washing machines, and air conditioners, covering 6 types of core terminals. Users can complete 3 types of interactions through the terminal: "model rotation, parameter viewing, and function demonstration". The hardware and runtime environment parameters of the six types of terminals are retrieved through the terminal SDK interface (ARKit SDK for iOS, ARCore SDK for Android, and dedicated Perception SDK for AR glasses). The parameters are coded in JSON format and annotated with "parameter type + field value range". Based on the rendering requirements of AR home appliances, basic rendering rules are defined (lighting model: PBR, frame rate: 30fps, texture format: PNG, model format: GLB), and visual requirements are matched for each configuration package (e.g., ACP_003 corresponds to "wide-angle high-definition rendering", defining a model with 100,000 faces and a texture of 4096×4096; ACP_002 corresponds to "balanced rendering", defining a model with 50,000 faces and a texture of 2048×2048).

[0019] Construct a scene rendering layer, set up a standardized content frame architecture content adaptation configuration package communication interface and scene database, and call the content adaptation configuration package through the communication interface to generate several visual media content architectures to be rendered after media interaction based on the standardized content frame architecture. It should be noted that the scene rendering layer is based on the standardized frame architecture of the content adaptation layer. It achieves dynamic scene generation through "interface calls + database support". For example, a REST API interface (response time ≤100ms) is set to connect to the scene database. The database stores the configuration packages and basic scene resources (such as environment models and lighting parameters) of all terminals. When the standardized content frame calls the configuration package of the corresponding terminal through the interface, the scene rendering parameters can be dynamically adjusted (such as 0.6cd / m² for strong light environment and 1.2cd / m² for weak light environment). This transforms the AR scene from a "fixed template" into a dynamic carrier of "terminal-environment dual adaptation", improving the immersive feeling of virtual and real integration. For example, constructing the scene rendering layer also includes the following steps: The scene rendering layer is used to implement the dynamic scene-based construction of the standardized content frame architecture, and calls the content adaptation configuration package through the interface of the set standardized content frame architecture to achieve dynamic scene-based construction. The scene rendering layer has a built-in scene database, which is used to store the content adaptation configuration packages. When each standardized content frame in the standardized content frame architecture connects to the scene database through the communication interface and realizes the call of the content adaptation configuration package, several visual media content architectures to be rendered after media interaction are obtained. For example, the communication interface is set up using a REST API interface, and the scene database is built using a MySQL database, storing 6 configuration packages and basic resources for the exhibition (shopping mall environment model, lighting resources, background textures). The standardized content frame architecture contains 50 interactive nodes (such as "refrigerator display frame" and "washing machine operation frame"). Each node calls the corresponding terminal configuration package through the REST API to generate 6 visual architectures to be rendered (corresponding to 6 types of terminals).

[0020] An interactive response layer is constructed, and sub-instructions are set based on the basic presentation logic of visual media content. These sub-instructions constitute a unified cross-platform interactive instruction, which is then matched with each content frame to be rendered in the visual media content architecture to be rendered, in order to test the cross-platform interactive operation of the visual media content architecture to be rendered. It should be noted that the core of the interactive response layer is "sub-command splitting + identifier code association". For example, complex interactive requirements are split into several sub-commands (such as "rotate clockwise" and "parameter view"), and each sub-command corresponds to the test requirements of a configuration package. The sub-commands are assigned identifier codes with associated attributes (such as UUID encoding), and the identifier codes are bound to the parameter comments of the configuration package (such as "rotation parameter field value") to achieve "one code matching multiple terminals". There is no need to design independent instructions for different terminals. The test requirements of all terminals can be covered by a unified sub-command, which greatly reduces the test complexity. For example, building an interactive response layer also includes the following steps: The interactive response layer is based on the basic presentation logic of visual media content. It sets and stores unified cross-platform interactive instructions and tests the cross-platform interactive operation of the visual media content architecture to be rendered through the interactive instructions. Each interactive instruction contains several sub-instructions, and each sub-instruction corresponds to testing a content adaptation configuration package. Set the identifier code of the sub-instruction. The identifier code is related to the parameter comments of the content adaptation configuration package. The sub-instruction is uniformly encoded by the identifier code or parameter comments. The identifier code is used to match each content frame to be rendered in the visual media content architecture to be rendered. For example, three sets of core instructions are designed ("Instruction 1 - Model Rotation", "Instruction 2 - Parameter Viewing", "Instruction 3 - Function Demonstration"), each set contains two sub-instructions (such as "Instruction 1" containing "Clockwise Rotation" and "Counterclockwise Rotation"), for a total of six sub-instructions (SUB_001~SUB_006), and each sub-instruction corresponds one-to-one with the configuration package.

[0021] A cross-platform adaptation control center is established to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and to generate an interactive sample set. Under cross-platform interactive operation test, the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered in order to generate a set of sub-instructions for the visual media content architecture to be rendered. It should be noted that the cross-end control center serves as a bridge between "data collection and instruction matching". For example, it collects all content frames to be rendered in the architecture to be rendered, generates an interactive sample set containing configuration package sets, and realizes centralized management of test data. At the same time, based on the matching relationship between sub-instruction identifier codes and configuration package parameter annotations, it extracts and generates sub-instruction sets, clarifies the test instructions corresponding to each configuration package, provides accurate data support for subsequent optimization, and avoids the disconnect between test data and optimization requirements. For example, building a cross-platform adaptation control center also includes the following steps: When conducting cross-platform interactive tests on the standardized content frames corresponding to the visual media content architecture to be rendered, several content frames generated corresponding to the visual media content architecture to be rendered are collected, and an interactive sample set is generated, denoted as . ,in, This represents the set of interactive samples generated corresponding to the i-th visual media content architecture to be rendered. This indicates the content adaptation configuration package set called for the e-th content frame to be rendered, where E represents the total number of content frames to be rendered. , This represents the r-th content adaptation configuration package, where R represents the total number of content adaptation configuration packages. In cross-platform interactive operation testing, once the identifier code of the sub-instruction matches the parameter comments of the content adaptation configuration package of the content frame to be rendered, the interactive instruction is extracted to generate a content adaptation configuration package set. The set of sub-instructions, denoted as The subinstruction set contains several subinstructions.

[0022] Build a replacement model for the content adaptation configuration package, replace and optimize the content adaptation configuration package, and evaluate the test sharing degree of the interaction instructions after the replacement and optimization are completed in order to select the optimal visual communication architecture after media interaction. It should be noted that the replacement model achieves closed-loop optimization through "quantitative evaluation-iterative screening". For example, firstly, the effect of the configuration package is quantified by the rendering adaptability formula (the matching rate between the actual rendering parameters and the standard parameter domain). Configuration packages with unsatisfactory adaptability (such as <0.8) are replaced to ensure that each configuration package meets the terminal requirements. Then, the reusability of the interaction commands is evaluated by the test sharing formula (the correlation between the number of sub-commands and the mean and variance). The architecture with the highest sub-command reusability and the most stable interaction effect is selected as the optimal solution, forming an automated closed loop of "testing-evaluation-optimization-screening" that can achieve dynamic iteration without manual intervention. For example, building a replacement model for the content adaptation configuration package also includes the following steps: When dynamically generating the i-th visual media content architecture to be rendered, run each content adaptation configuration package in the content adaptation configuration package set and record the content adaptation configuration packages. Rendering fit in the e-th content frame to be rendered In the formula, Indicates the runtime content adaptation configuration package The m-th actual rendering parameter of the content frame to be rendered generated at that time. This field represents the rendering parameters of the normalized content frame corresponding to the content frame to be rendered. If the actual rendering parameters... Belongs to the rendering parameter field In the middle, then order Otherwise , where n represents the total number of actual rendering parameters; Preset content adaptation threshold; if rendering adaptation... If the content adaptation threshold is less than or equal to the content adaptation configuration package, then adjust the content adaptation configuration package accordingly. Replace and re-integrate into the content adaptation configuration package. In the process, the rendering adaptability after replacement will continue to be evaluated until the rendering adaptability is less than or equal to the content adaptability threshold; if the rendering adaptability... If the content adaptation threshold is exceeded, the rendering adaptation of the next content adaptation configuration package will be evaluated. For example, with a preset adaptation threshold of 0.8, 7 out of the 8 actual parameters in frame 35 belong to the standard parameter domain (H_004), CA(ACP_004)=7 / 8=0.875>0.8, so no replacement is needed; When the interaction sample set After each content adaptation configuration package participates in the rendering compatibility evaluation and is replaced, the cross-platform interactive operation of the visual media content architecture to be rendered is tested using interactive commands. The test shareability of the interactive commands is then evaluated. In the formula, Represents the interactive sample set Content adaptation configuration packages Corresponding sub-instruction set The number of sub-instructions contained in the union set. It is the mean, and , Let the variance be, and g represents the total number of visual media content architectures to be rendered, corresponding to the standardized content frame architecture; Select the visual media content architecture to be rendered corresponding to the maximum test sharing degree. As the optimal visual communication architecture after media interaction.

[0023] In this second embodiment: an augmented reality-based cross-platform visual communication immersive media interaction system is provided. The system includes: a storage device and a processor. The storage device is used to store a program for the augmented reality-based cross-platform visual communication immersive media interaction method. The processor is used to execute the program for the augmented reality-based cross-platform visual communication immersive media interaction method. The processor also integrates a media interaction processing module and a cross-platform control and analysis module.

[0024] The media interaction processing module is used to construct a content adaptation layer, a scene rendering layer, and an interaction response layer. The content adaptation layer collects hardware and operating environment parameters from cross-platform augmented reality terminals and generates a content adaptation configuration package in code. It then uses a standardized content frame architecture before media interaction to instruct the basic rendering rules of the visual media content. The scene rendering layer sets up the communication interface for the standardized content frame architecture's content adaptation configuration package and a scene database. It calls the content adaptation configuration package through the communication interface to generate several visual media content architectures to be rendered after media interaction. The interaction response layer sets sub-instructions based on the basic presentation logic of the visual media content, and these sub-instructions constitute a unified cross-platform interaction instruction. It then matches each content frame to be rendered in the visual media content architecture to test the cross-platform interactive operation of the visual media content architecture. The media interaction processing module includes a content adaptation layer unit, a scene rendering layer unit, and an interaction response layer unit. The content adaptation layer unit is used to retrieve the hardware parameters and operating environment parameters of the cross-platform visual augmented reality terminal to obtain the content adaptation configuration package, and compile a standardized content frame architecture before media interaction through the basic presentation logic of visual media content. The scene rendering layer unit is used to call the content adaptation configuration package through the interface of the standardized content frame architecture, so as to realize the dynamic scene construction of the standardized content frame architecture and obtain several visual media content architectures to be rendered after media interaction. The interactive response layer unit is used to set and store cross-platform unified interactive instructions, and to test the cross-platform interactive operation of the visual media content architecture to be rendered through the interactive instructions; moreover, the interactive instructions contain sub-instructions, and the identification code of the sub-instructions is set, and the identification code is used to match each content frame to be rendered in the visual media content architecture to be rendered.

[0025] The cross-platform control and analysis module is used to build a cross-platform adaptation control center and a replacement model for the content adaptation configuration package. The cross-platform adaptation control center is used to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and generate an interaction sample set. Under cross-platform interactive operation test, the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered to generate a sub-instruction set of the visual media content architecture to be rendered. The replacement model of the content adaptation configuration package is used to replace and optimize the content adaptation configuration package. After the replacement and optimization is completed, the test sharing degree of the interaction instructions is evaluated to select the optimal visual communication architecture after media interaction. The cross-platform control and analysis module includes an interactive sample set generation unit, a sub-instruction set generation unit, a rendering adaptation analysis unit, and a test sharing analysis unit. The interactive sample set generation unit is used to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and generate an interactive sample set. The sub-instruction set generation unit is used to generate a sub-instruction set of the visual media content architecture to be rendered after the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered. The rendering adaptation analysis unit is used to analyze and record the rendering adaptation degree of the content adaptation configuration package under the content frame to be rendered, so as to realize the replacement and optimization of the content adaptation configuration package. The test sharing analysis unit is used to evaluate the test sharing degree of interactive commands in order to screen the architecture of the visual media content to be rendered.

[0026] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0027] Finally, it should be noted that the above descriptions are merely preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A cross-platform visual communication immersive media interaction method based on augmented reality, characterized in that, include: Construct a content adaptation layer, collect hardware parameters and operating environment parameters of cross-platform visual augmented reality terminals, and generate content adaptation configuration packages in code. By compiling a standardized content frame architecture before media interaction, the basic rendering rules of visual media content are instructed. Construct a scene rendering layer, set up a standardized content frame architecture content adaptation configuration package communication interface and scene database, and call the content adaptation configuration package through the communication interface to generate several visual media content architectures to be rendered after media interaction based on the standardized content frame architecture. An interactive response layer is constructed, and sub-instructions are set based on the basic presentation logic of visual media content. These sub-instructions constitute a unified cross-platform interactive instruction, which is then matched with each content frame to be rendered in the visual media content architecture to be rendered, in order to test the cross-platform interactive operation of the visual media content architecture to be rendered. A cross-platform adaptation control center is established to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and to generate an interactive sample set. Under cross-platform interactive operation test, the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered in order to generate a set of sub-instructions for the visual media content architecture to be rendered. Build a replacement model for the content adaptation configuration package, replace and optimize the content adaptation configuration package, and evaluate the test sharing degree of the interaction instructions after the replacement and optimization are completed in order to select the optimal visual communication architecture after media interaction.

2. The cross-platform visual communication immersive media interaction method based on augmented reality according to claim 1, characterized in that, The specific implementation process of constructing the content adaptation layer includes: The hardware parameters and operating environment parameters of the cross-platform visual augmented reality terminal are retrieved, the hardware parameters and operating environment parameters are coded and parameter comments are added to obtain a content adaptation configuration package. Each content adaptation configuration package corresponds to a combination of hardware parameters and operating environment parameters. The content adaptation configuration package is uniformly coded, and the parameter comments include parameter types and parameter field values. Based on the fundamental presentation logic of visual media content, a standardized content frame architecture is developed before media interaction. The standardized content frame architecture is used to instruct the basic rendering rules of visual media content, and a content adaptation configuration package corresponds to a visual requirement of the standardized content frame. The rendering parameters of the standardized content frame are defined through the content adaptation configuration package to meet the visual requirement.

3. The cross-platform visual communication immersive media interaction method based on augmented reality according to claim 1, characterized in that, The specific implementation process for constructing the scene rendering layer includes: The scene rendering layer is used to implement the dynamic scene-based construction of the standardized content frame architecture, and calls the content adaptation configuration package through the set standardized content frame architecture content adaptation configuration package communication interface to realize the dynamic scene-based construction. The scene rendering layer has a built-in scene database, which is used to store various content adaptation configuration packages. When each standardized content frame in the standardized content frame architecture connects to the scene database through the communication interface and realizes the call of the content adaptation configuration package, several visual media content architectures to be rendered after media interaction are obtained.

4. The cross-platform visual communication immersive media interaction method based on augmented reality according to claim 1, characterized in that, The specific implementation process for constructing the interactive response layer includes: The interactive response layer is based on the basic presentation logic of visual media content, sets and stores unified cross-platform interactive instructions, and tests the cross-platform interactive operation of the visual media content architecture to be rendered through the interactive instructions; the interactive instructions contain several sub-instructions, wherein each sub-instruction corresponds to testing a content adaptation configuration package; The sub-instruction is set with an identifier code that is associated with the parameter annotation of the content adaptation configuration package. The sub-instruction is uniformly encoded by the identifier code or parameter annotation, and the identifier code is used to match each content frame to be rendered in the visual media content architecture to be rendered.

5. The cross-platform visual communication immersive media interaction method based on augmented reality according to claim 1, characterized in that, The specific implementation process of step S4 includes: When conducting cross-platform interactive tests on the standardized content frames corresponding to the visual media content architecture to be rendered, several content frames generated corresponding to the visual media content architecture to be rendered are collected, and an interactive sample set is generated, denoted as . ,in, This represents the set of interactive samples generated corresponding to the i-th visual media content architecture to be rendered. This indicates the content adaptation configuration package set called for the e-th content frame to be rendered, where E represents the total number of content frames to be rendered. , This represents the r-th content adaptation configuration package, where R represents the total number of content adaptation configuration packages. In cross-platform interactive operation testing, once the identifier code of the sub-instruction matches the parameter comments of the content adaptation configuration package of the content frame to be rendered, the interactive instruction is extracted to generate a content adaptation configuration package set. The set of sub-instructions, denoted as The subinstruction set contains several subinstructions.

6. The cross-platform visual communication immersive media interaction method based on augmented reality according to claim 5, characterized in that, The specific implementation process for replacing and optimizing the content adaptation configuration package includes: When dynamically generating the i-th visual media content architecture to be rendered, run each content adaptation configuration package in the content adaptation configuration package set and record the content adaptation configuration packages. Rendering fit in the e-th content frame to be rendered In the formula, Indicates the runtime content adaptation configuration package The m-th actual rendering parameter of the content frame to be rendered generated at that time. This field represents the rendering parameters of the normalized content frame corresponding to the content frame to be rendered. If the actual rendering parameters... Belongs to the rendering parameter field In the middle, then order Otherwise , where n represents the total number of actual rendering parameters; Preset content adaptation threshold; if rendering adaptation... If the content adaptation threshold is less than or equal to the content adaptation configuration package, then adjust the content adaptation configuration package accordingly. Replace and re-integrate into the content adaptation configuration package. In the process, the rendering adaptability after replacement will continue to be evaluated until the rendering adaptability is less than or equal to the content adaptability threshold; if the rendering adaptability... If the result exceeds the content adaptation threshold, then proceed to the next content adaptation configuration package for rendering adaptation evaluation.

7. The cross-platform visual communication immersive media interaction method based on augmented reality according to claim 6, characterized in that, The specific implementation process for evaluating the test sharing degree of interactive instructions to select the optimal visual communication architecture after media interaction includes: When the interaction sample set After each content adaptation configuration package participates in the rendering compatibility evaluation and is replaced, the cross-platform interactive operation of the visual media content architecture to be rendered is tested using interactive commands. The test shareability of the interactive commands is then evaluated. In the formula, Represents the interactive sample set Content adaptation configuration packages Corresponding sub-instruction set The number of sub-instructions contained in the union set. It is the mean, and , Let the variance be, and g represents the total number of visual media content architectures to be rendered, corresponding to the standardized content frame architecture; Select the visual media content architecture to be rendered corresponding to the maximum test sharing degree. As the optimal visual communication architecture after media interaction.

8. The immersive media interaction method for cross-platform visual communication based on augmented reality according to claim 1, characterized in that, The augmented reality-based cross-platform visual communication immersive media interaction method is integrated into a storage device in the form of a program. The storage device is built into the augmented reality-based cross-platform visual communication immersive media interaction system. The system also includes a processor for executing the program of the augmented reality-based cross-platform visual communication immersive media interaction method. The processor also integrates a media interaction processing module and a cross-end control and analysis module. The media interaction processing module is used to construct a content adaptation layer, a scene rendering layer, and an interaction response layer. The content adaptation layer is used to collect the hardware parameters and operating environment parameters of the cross-platform visual augmented reality terminal, and generate a content adaptation configuration package in code. By compiling a standardized content frame architecture before media interaction, it instructs the basic rendering rules of visual media content. The scene rendering layer is used to set up the content adaptation configuration package communication interface and scene database of the standardized content frame architecture. By calling the content adaptation configuration package through the communication interface, it generates several visual media content architectures to be rendered after media interaction based on the standardized content frame architecture. The interactive response layer sets sub-instructions based on the basic presentation logic of visual media content, and the sub-instructions constitute a unified cross-platform interactive instruction. It also matches each content frame to be rendered in the visual media content architecture to be rendered, so as to test the cross-platform interactive operation of the visual media content architecture to be rendered. The cross-platform control and analysis module is used to build a replacement model for the cross-platform adaptation control center and the content adaptation configuration package; the cross-platform adaptation control center is used to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and generate an interactive sample set. Under cross-platform interactive operation test, the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered to generate a sub-instruction set of the visual media content architecture to be rendered. The replacement model of the content adaptation configuration package is used to replace and optimize the content adaptation configuration package. After the replacement and optimization are completed, the test sharing degree of the interaction instructions is evaluated in order to select the optimal visual communication architecture after media interaction.

9. The immersive media interaction method for cross-platform visual communication based on augmented reality according to claim 8, characterized in that, The media interaction processing module includes a content adaptation layer unit, a scene rendering layer unit, and an interaction response layer unit. The content adaptation layer unit is used to retrieve the hardware parameters and operating environment parameters of the cross-platform visual augmented reality terminal to obtain the content adaptation configuration package, and to compile a standardized content frame architecture before media interaction through the basic presentation logic of visual media content. The scene rendering layer unit is used to call the content adaptation configuration package through the content adaptation configuration package communication interface of the set standardized content frame architecture, so as to realize the dynamic scene-based construction of the standardized content frame architecture and obtain several visual media content architectures to be rendered after media interaction. The interactive response layer unit is used to set and store cross-platform unified interactive instructions, and to test the cross-platform interactive operation of the visual media content architecture to be rendered through the interactive instructions; and the interactive instructions include sub-instructions, set the identification code of the sub-instructions, and match each content frame to be rendered in the visual media content architecture to be rendered by recognizing the identification code.

10. The immersive media interaction method for cross-platform visual communication based on augmented reality according to claim 8, characterized in that, The cross-end control and analysis module includes an interactive sample set generation unit, a sub-instruction set generation unit, a rendering adaptation analysis unit, and a test sharing analysis unit. The interactive sample set generation unit is used to collect several content frames to be rendered corresponding to a visual media content architecture to be rendered, and generate an interactive sample set. The sub-instruction set generation unit is used to generate a sub-instruction set of the visual media content architecture to be rendered after the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered. The rendering adaptation analysis unit is used to analyze and record the rendering adaptation degree of the content adaptation configuration package under the content frame to be rendered, so as to realize the replacement and optimization of the content adaptation configuration package. The test sharing analysis unit is used to evaluate the test sharing degree of interactive instructions in order to screen the visual media content architecture to be rendered.

Images