AI-based integrated media data processing method and system

Through the user side, the AI ​​generation server and virtual reality technology are used to dynamically adjust educational resources, the problem of mismatch in educational resources in the existing system is solved, and efficient educational resource recommendation and immersive learning experience are achieved.

CN118643174BActive Publication Date: 2025-08-26XIJING UNIV
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410618519.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-05-17
Publication Date
2025-08-26
Estimated Expiration
2044-05-17

AI Technical Summary

Technical Problem

The existing educational resource recommendation system cannot be dynamically adjusted according to the user environment and needs in real time, resulting in poor user experience, educational resources do not match user needs, and lack of immersion.

Method used

The user side collects surrounding environment information, uses AI resources to generate educational resources, combines environmental information to make dynamic adjustments, and builds virtual characters and resource presentation methods in the virtual reality environment to achieve dynamic matching and optimization of educational resources.

Benefits of technology

It improves the matching degree of educational resources and user immersion, meets users' personalized needs, and improves the efficiency and quality of educational resources utilization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118643174B_ABST
    Figure CN118643174B_ABST
Patent Text Reader

Abstract

The present invention provides an AI-based integrated media data processing method and system, which generates educational resource requirements based on user needs and the surrounding environment; then uses the educational resource requirements to generate multiple educational resources; dynamically adjusts and optimizes the multiple educational resources in combination with the surrounding environment information to obtain multiple final educational resources, then constructs a virtual reality environment that matches the final educational resources and determines the presentation method of the final educational resources, and uses user portraits to construct a virtual character that explains the final educational resources; in response to user operations, the final educational resources are presented by the virtual character in the virtual reality environment. The present invention generates multiple educational resources based on the surrounding environment and then optimizes them to obtain the final educational resources, generates multiple virtual reality scenes combined with virtual characters, and finally presents the final educational resources to the user, thereby increasing the user's sense of immersion, and the generated educational resources can better meet user needs, thereby achieving efficient utilization of educational resources and improving quality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of digital educational resource recommendation, and specifically relates to an AI-based integrated media data processing method and system. Background Art

[0002] Education has evolved from traditional blackboard teaching to multimedia, where educators use multimedia to impart knowledge to students. The development of software technology has spawned numerous educational resource recommendation software or systems, allowing students to select educational resources of their interest for free or for a fee, thereby satisfying their educational needs.

[0003] While educational resource recommendation software attracts numerous scholars with diverse teaching methods, key factors for continued engagement are the quality of the content, its ability to pique their interest, and their ability to engage in interactive learning. Most existing solutions focus on generating profiles based on scholars' preferences and interests, using various recommendation algorithms to recommend teaching sessions, or on attracting users with lectures from renowned scholars, video quality, or interactive animations.

[0004] While these solutions have increased the appeal of educational resources to users to a certain extent, most of them present relevant educational resources by searching a database. Users often want to find the educational resources that best suit them, and have them dynamically adjusted to be immersive. Therefore, the content displayed by existing solutions is not what users want, and the real-time performance is not strong, resulting in a poor user experience. Summary of the Invention

[0005] In order to solve the above problems existing in the prior art, the present invention provides an AI-based integrated media data processing method and system. The technical problem to be solved by the present invention is achieved through the following technical solutions:

[0006] In a first aspect, the present invention provides an AI-based converged media data processing system comprising: a user terminal, an AI resource generation server, and an environment integration server;

[0007] The user terminal is used to collect surrounding environment information and generate educational resource requirements based on user operations and the surrounding environment information;

[0008] The AI ​​resource generation server is configured to extract educational resource information from the educational resource demand and input the educational resource information into multiple AI generation models to generate multiple educational resources; dynamically adjust and optimize the multiple educational resources in combination with the surrounding environment information to obtain multiple final educational resources;

[0009] The environment integration server is configured to construct a virtual reality environment that matches the final educational resource based on the surrounding environment information, determine a presentation method for the final educational resource in the virtual reality environment, and construct a virtual character that explains the final educational resource using a user portrait; and recommend the virtual reality environment and the virtual character to the user terminal;

[0010] The user terminal is used to respond to user operations; based on the positioning relationship among the virtual reality environment, the virtual character and the final educational resource, the final educational resource is presented by the virtual character in the virtual reality environment.

[0011] In a second aspect, the present invention provides an AI-based integrated media data processing method, comprising collecting surrounding environment information and generating educational resource requirements based on user operations and the surrounding environment information;

[0012] Extracting educational resource information from the educational resource demand, and inputting the educational resource information into multiple AI generation models to generate multiple educational resources; dynamically adjusting and optimizing the multiple educational resources in combination with the surrounding environment information to obtain multiple final educational resources;

[0013] Constructing a virtual reality environment that matches the final educational resource based on the surrounding environment information, determining a presentation method for the final educational resource in the virtual reality environment, and constructing a virtual character that explains the final educational resource using the user portrait; and recommending the virtual reality environment and the virtual character to the user terminal;

[0014] In response to user operations, the final educational resource is presented by the virtual character in the virtual reality environment according to the positioning relationship among the virtual reality environment, the virtual character and the final educational resource. Beneficial effects

[0015] The present invention provides an AI-based integrated media data processing method and system, wherein a user terminal collects surrounding environment information and generates educational resource requirements based on user operations and the surrounding environment information; an AI resource generation server extracts educational resource information from the educational resource requirements and inputs the educational resource information into multiple AI generation models to generate multiple educational resources; the multiple educational resources are dynamically adjusted and optimized based on the surrounding environment information to obtain multiple final educational resources; the environment integration server constructs a virtual reality environment that matches the final educational resources based on the surrounding environment information, determines the presentation method of the final educational resources in the virtual reality environment, and uses user portraits to construct a virtual character that explains the final educational resources; the virtual reality environment and the virtual character are recommended to the user terminal; the user terminal responds to the user operation; and the final educational resource is presented by the virtual character in the virtual reality environment based on the positioning relationship between the virtual reality environment, the virtual character, and the final educational resource. The present invention generates multiple educational resources based on the user's surrounding environment and then optimizes them to obtain the final educational resource, generates multiple virtual reality scenes combined with virtual characters, and finally presents the final educational resource to the user, thereby increasing the user's sense of immersion and the generated educational resources can better meet user needs.

[0016] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 Schematic diagram of the AI-based media convergence data processing system provided by the present invention;

[0018] Figure 2 It is a schematic diagram of the process of extracting educational resource information provided by the present invention;

[0019] Figure 3a It is a schematic diagram of a process for generating multiple educational resources provided by the present invention;

[0020] Figure 3b It is a flowchart of the main contents corresponding to each target chromosome provided by the present invention;

[0021] Figure 4 It is a schematic diagram of the process of obtaining the final educational resources provided by the present invention;

[0022] Figure 5 It is a schematic diagram of the process of constructing a virtual reality environment and a virtual character provided by the present invention;

[0023] Figure 6 It is a flow chart of presenting the final educational resources provided by the present invention. DETAILED DESCRIPTION

[0024] The present invention will be further described in detail below with reference to specific examples, but the embodiments of the present invention are not limited thereto.

[0025] First, as Figure 1 As shown, an embodiment of the present invention provides an AI-based converged media data processing system, including: a user terminal, an AI resource generation server, and an environment integration server;

[0026] The user terminal is used to collect surrounding environment information and generate educational resource requirements based on user operations and the surrounding environment information;

[0027] Among them, the user end is provided with an acquisition module, an AR module, a VR module and a display module, and the acquisition module is used to: use the plane of the current scene as the shooting plane to obtain multiple plane images; wherein, the current scene is composed of multiple target areas; the AR module is used to use the entrance of the user into the current scene as the coordinate origin, and use the multiple planes to construct a two-dimensional plane map; use the stereo parameter information of the current environment to construct a virtual reality environment on the two-dimensional plane map; the VR module is used to enhance the virtual reality environment, and enhance the matching degree between the virtual character and the virtual reality environment when the virtual character is in the virtual reality environment.

[0028] It is worth noting that the user terminal of the present invention can be a head-mounted device, and the head-mounted device can also be provided with a collector for collecting the user's brain wave signals, so that the user's mental state can be determined based on the user's brain wave transformation. When collecting the surrounding environment information of the current scene, the user can also go around in a circle to obtain a video image, thereby first constructing a two-dimensional plane map. If there are many objects in a certain target area, the stay time can be longer. The present invention can divide the current scene into multiple target areas, distinguish between target areas with complex states and target areas with simple states, so as to improve the collection efficiency.

[0029] VR and AR technologies are both relatively mature existing technologies, so using the corresponding modules of these two technologies can display virtual reality scenes and virtual characters. Of course, the display method of virtual characters and educational resources can be changed according to user needs to improve the user experience.

[0030] The AI ​​resource generation server is configured to extract educational resource information from the educational resource demand and input the educational resource information into multiple AI generation models to generate multiple educational resources; dynamically adjust and optimize the multiple educational resources in combination with the surrounding environment information to obtain multiple final educational resources;

[0031] The multiple AI generation models belong to different AI platforms, each AI platform is set with access rights, and the AI ​​resource generation server applies for registration with each AI platform; during the registration process, a key generation interval is set according to the resource type of the auxiliary educational resource, and a key is generated using the key generation interval; when requesting to generate educational resources from the AI ​​platform, the key is used to complete the authentication process;

[0032] Among them, the AI ​​resource generation server organizes all AI platforms into a blockchain according to generation efficiency, and each AI platform is responsible for generating educational resources in its own block; the key generation interval is divided into multiple sub-intervals according to the number of AI platforms, and each AI platform searches and generates content within its own sub-interval.

[0033] It is worth noting that the AI ​​models adopted by various product vendors have different focuses, and there may be differences when generating educational resources online. Since some major AI platforms are free and some require payment, you can establish contact with the platform in advance to agree on communication matters. After the agreement is completed, the system of this application will generate a key when registering. If all AI platforms use the same key, the security is low, and if different keys are used, the efficiency is low. This application can set a key generation interval according to the resource type, and divide the key generation interval into multiple sub-intervals. Each AI platform authenticates the key of the sub-interval, so that security and efficiency are balanced.

[0034] The environment integration server is configured to construct a virtual reality environment that matches the final educational resource based on the surrounding environment information, determine a presentation method for the final educational resource in the virtual reality environment, and construct a virtual character that explains the final educational resource using a user portrait; and recommend the virtual reality environment and the virtual character to the user terminal;

[0035] Among them, the virtual reality scene is a virtual scene reconstructed by simulating the real scene using AR and VR technology. Because the degree of restoration is almost the same as the real scene, it is a virtual reality scene.

[0036] The user terminal is used to respond to user operations; based on the positioning relationship among the virtual reality environment, the virtual character and the final educational resource, the final educational resource is presented by the virtual character in the virtual reality environment.

[0037] The present invention provides an AI-based integrated media data processing system, in which a user terminal collects surrounding environment information and generates educational resource requirements based on user operations and the surrounding environment information; an AI resource generation server extracts educational resource information from the educational resource requirements and inputs the educational resource information into multiple AI generation models to generate multiple educational resources; the multiple educational resources are dynamically adjusted and optimized in combination with the surrounding environment information to obtain multiple final educational resources; the environment integration server constructs a virtual reality environment matching the final educational resources based on the surrounding environment information, determines the presentation method of the final educational resources in the virtual reality environment, and uses user portraits to construct a virtual character that explains the final educational resources; the virtual reality environment and the virtual character are recommended to the user terminal; the user terminal responds to the user operation; and based on the positioning relationship among the virtual reality environment, the virtual character and the final educational resource, the final educational resource is presented by the virtual character in the virtual reality environment. The present invention generates multiple educational resources based on the user's surrounding environment and then optimizes them to obtain the final educational resources, generates multiple virtual reality scenes combined with virtual characters, and finally presents the final educational resources to the user. Therefore, it can increase the user's sense of immersion, and the generated educational resources can better meet user needs, promote the innovative development in the field of integrated media education, and realize the efficient use of educational resources and the improvement of education quality.

[0038] As an optional embodiment of the present invention, refer to Figure 2 The AI ​​resource generation server is configured to extract educational resource information from the educational resource requirements, including:

[0039] S21, extracting user basic information related to the user and educational content related information related to the demand from the educational resource demand; the educational content related information includes the type of educational resource required by the user and the content description of the educational resource required by the user; the user basic information includes user preferences, user age, user location, user history, and user history browsing resource information;

[0040] It's worth noting that examples of educational resource types include basic subjects like math and English, as well as technical subjects like programming and software applications. Users can provide a brief description of the educational resources they need, such as C language education, entry-level, easy to understand, and interesting. Content such as "taught by teacher XX" can also be included.

[0041] S22, using a machine learning or deep learning model to perform in-depth mining and analysis on the educational content-related information to obtain key content related to the educational resource demand;

[0042] It is worth noting that: this step can use existing machine learning models or deep learning models to mine the content, and these models are all trained models. The training process is the same as the existing technology and will not be repeated here.

[0043] S23, searching for educational resource types related to the key content in its own database;

[0044] S24, comparing the educational resource type found in the database with the educational resource type required by the user to determine whether they are similar or identical;

[0045] S25: If the type of the educational resource found in the database is similar to or the same as the type of the educational resource required by the user, the similar or the same educational resource in the database is used as an auxiliary educational resource.

[0046] It's worth noting that the database may contain multiple educational resource types. If the type of educational resource is the same or similar to the one a user needs, it means that a user has previously obtained similar educational resources. However, similar educational resources may not meet the current user's resource needs. Therefore, similar or identical educational resources can be used as supplementary educational resources.

[0047] As an optional embodiment of the present invention, refer to Figure 3a , inputting the educational resource information into multiple AI generation models to generate multiple educational resources includes:

[0048] S31, sending an educational resource generation request to each AI platform, so that each AI platform sends a resource authentication response to the AI ​​resource generation server;

[0049] S32, upon receiving the resource authentication response, sending the key generated during registration and the educational resource information to the AI ​​platform, and obtaining the initial educational resources generated by each AI platform after completing authentication based on the key;

[0050] S33, using a content search algorithm to identify, from among the multiple initial educational resources, excellent educational resources that meet the resource requirements and whose content matching degree exceeds a matching degree threshold;

[0051] In this step, resource requirements include resource type, size, and content. Content matching is calculated based on the initial educational resources and the resource requirements entered by the user. The content is first segmented into words and sentences, and the matching degree of the entire paragraph is calculated. This calculation process is based on existing techniques and will not be further described here.

[0052] S34, extract the main content of each excellent educational resource and organize all the main contents into a content space;

[0053] S35, using a chromosome genetic algorithm to search for multiple target chromosomes with fitness exceeding a threshold in the content space, and determining the main content corresponding to each target chromosome;

[0054] S36, randomly combining the main contents to form key contents, and inputting the key contents into each AI platform to obtain multiple educational resources.

[0055] The purpose of this embodiment is to conduct a secondary screening of the initial educational resources output by each AI platform, because the initial educational resources output by each AI platform have their own advantages and disadvantages. Therefore, the content search algorithm is first used to determine the excellent educational resources that meet the needs of users, extract their content, and then form a content space. The main content searched out in the content space is the most important key content. The reason is that even if the AI ​​model algorithms of the AI ​​platforms are different, they all show their own advantages when adapting to customer needs. By re-entering the main content searched out in this content space into the AI ​​platform, it is possible to optimize and obtain multiple educational resources.

[0056] As an optional embodiment of the present invention, refer to Figure 3b , S35 includes:

[0057] S351, each major content is considered a chromosome in the population;

[0058] S352, calculate the fitness of each chromosome;

[0059] S353, performing crossover mutation on the chromosomes in any generation population, selecting a mutation probability from the memory space during the mutation; selecting main content from the content space with a second probability to update the population;

[0060] S354, updates the chromosomes whose fitness is lower than the threshold in the cache space;

[0061] S355, repeating S352-S354 until the update iteration number is reached, and obtaining multiple chromosomes in the cache space;

[0062] S356 , selecting a target chromosome whose fitness exceeds a threshold from the multiple chromosomes in the cache space, and determining the main content corresponding to each target chromosome.

[0063] This implementation continuously updates the chromosomes in the cache space, filtering out chromosomes with lower fitness, i.e., the primary content. This approach, through repeated genetic updates, yields superior chromosomes. This implementation utilizes a genetic algorithm to filter and cross-mutate the primary content, improving its adaptability and highlighting its key points.

[0064] As an optional embodiment of the present invention, refer to Figure 4 The dynamic adjustment and optimization of the plurality of educational resources in combination with the surrounding environment information to obtain the final educational resources includes:

[0065] S41, traversing the plurality of educational resources to obtain resource information of each educational resource; the resource information includes main content, required resource size, resource type and format;

[0066] S42, determining target resources for constructing a virtual reality environment required for each educational resource based on the surrounding environment information;

[0067] It's worth noting that the present invention requires the construction of multiple virtual reality environments to accommodate each educational resource. However, resources are a crucial consideration for every solution. If resources are large or resource scheduling is complex, the construction process will take longer and consume more resources. This often goes against user expectations, so the present invention takes this factor into account.

[0068] S43, matching the target resource with a plurality of pre-stored sub-environment templates, so as to split the scheduling process of generating a virtual reality environment using the target resource into scheduling paths of the sub-environment templates;

[0069] S44, introducing the scheduling path as a constraint condition, and using the constraint condition to determine a content adjustment range;

[0070] S45, adjusting the contents of the plurality of educational resources and the plurality of educational resources after the content order is adjusted within the content adjustment range;

[0071] It's worth noting that the present invention matches target resources with multiple pre-stored sub-environment templates to determine the required order of sub-environment templates for constructing a virtual reality environment. This allows the scheduling process to be broken down into simple scheduling paths. The scheduling context then serves as a constraint to adjust the educational resource content, such as which content to simplify and which content to place where.

[0072] S46, combining the adjusted multiple educational resources into multiple resource combinations;

[0073] S47, using the quartile method to calculate the difference between any two resource combinations, and eliminating resource combinations whose difference exceeds a difference threshold to obtain the remaining resource combinations;

[0074] It is worth noting that: after adjusting the content, there may be anomalies in the educational resources, so combining and then using the quartile method to remove the difference values ​​can improve efficiency.

[0075] S48, selecting the educational resource with the highest frequency of occurrence from the remaining resource combinations as the final educational resource.

[0076] As an optional embodiment of the present invention, refer to Figure 5 The steps of constructing a virtual reality environment matching the final educational resource based on the surrounding environment information, determining a presentation method of the final educational resource in the virtual reality environment, and constructing a virtual character explaining the final educational resource using a user portrait include:

[0077] S51, constructing a basic virtual reality environment for the final educational resource;

[0078] S52, determining three-dimensional parameters of real objects in the surrounding environment according to the surrounding environment information, and creating virtual objects corresponding to the real objects in the basic virtual reality environment according to the three-dimensional parameters to obtain a virtual reality environment;

[0079] S53, determining a presentation mode for each of the final educational resources in the virtual reality environment based on the user's historical form habits; the presentation modes include two-dimensional image presentation, three-dimensional video presentation, two-dimensional animation presentation, three-dimensional animation presentation, two-dimensional character dialogue presentation, and three-dimensional character dialogue;

[0080] S54, construct multiple virtual characters of multiple types using user portraits;

[0081] S55, determining the matching degree between the plurality of virtual characters and the virtual reality environment;

[0082] S56: Using the virtual character with the highest matching degree as the virtual character for explaining the final educational resource, and reconstructing the virtual character in the virtual reality environment.

[0083] It is worth noting that: this embodiment first constructs a basic virtual reality environment, and this environment needs to be adjusted according to the information collected by the user end. In this way, the virtual reality environment is more compatible with the user environment. Afterwards, it is necessary to take into account the user's behavioral habits and determine the final presentation method of the educational resources to improve the user experience. The presentation method of the educational resources of the present invention is not limited to flat image display, stereoscopic video display, flat animation display, stereoscopic animation display, flat character dialogue display and stereoscopic character dialogue, etc. Afterwards, it is necessary to match the virtual character with the virtual reality environment, and reconstruct the virtual character with the highest matching degree into the virtual reality environment to increase the adaptability of the virtual character and the virtual reality environment and enhance the user's sense of immersion.

[0084] As an optional embodiment of the present invention, refer to Figure 6 The presenting of the final educational resource by the virtual character in the virtual reality environment according to the positioning relationship among the virtual reality environment, the virtual character, and the final educational resource includes:

[0085] S61, determining a specific location of the final educational resource in the virtual reality environment by using the presentation method of the final educational resource;

[0086] S62, determining the specific location of the virtual character and a method for explaining the final educational resource based on the specific location in S61, wherein the explanation method includes a dialogue explanation between virtual characters, a separate video explanation of the virtual character, an explanation by the virtual character imitating a real person, and a static display explanation of the virtual character;

[0087] S63, placing the final educational resource at the determined specific location, and placing the virtual character within a preset range of the final educational resource;

[0088] S64, synchronizing the content of the final educational resource and the display actions of the virtual character according to the explanation method of the virtual character and the presentation method of the final educational resource;

[0089] S65 , in response to a user operation, the final educational resource is presented by a synchronized virtual character in the virtual reality environment.

[0090] It's worth noting that this implementation aims to determine the presentation method for educational resources based on user needs, and then further adjust the virtual character's explanation method to better match user needs. Even so, the final combination of virtual characters, educational resources, and explanation methods is possible, thus responding to user actions and ultimately allowing users to complete the selection process, thereby enhancing user interaction and experience.

[0091] The embodiment of the present invention provides an AI-based integrated media data processing method, which includes collecting surrounding environment information and generating educational resource requirements based on user operations and the surrounding environment information;

[0092] Extracting educational resource information from the educational resource demand, and inputting the educational resource information into multiple AI generation models to generate multiple educational resources; dynamically adjusting and optimizing the multiple educational resources in combination with the surrounding environment information to obtain multiple final educational resources;

[0093] Constructing a virtual reality environment that matches the final educational resource based on the surrounding environment information, determining a presentation method for the final educational resource in the virtual reality environment, and constructing a virtual character that explains the final educational resource using the user portrait; and recommending the virtual reality environment and the virtual character to the user terminal;

[0094] In response to user operations, the final educational resource is presented by the virtual character in the virtual reality environment according to the positioning relationship among the virtual reality environment, the virtual character and the final educational resource.

[0095] The present invention also provides an AI-based integrated media education resource recommendation platform, which can communicate with the AI-based integrated media data processing system and is used to display recommendation information on a display interface to recommend educational resources.

[0096] The present invention can adopt microservice architecture, containerization technology, etc. to design and develop a new scalable and easy-to-maintain system platform for communication between user terminals, AI resource generation servers, and environment integration servers. The present invention can also integrate all modules on the platform to perform system-level performance testing. Through stress testing, stability testing, etc., the performance and stability of the system are ensured. User testing and feedback collection are also carried out, and the system is optimized and adjusted based on user feedback to improve the user experience. Once the system is officially launched, continuous operation, maintenance and iteration will be carried out. Through user data analysis and user feedback, the system functions and performance are continuously optimized to ensure the long-term stable operation of the system.

[0097] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature identified as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, "plurality" means two or more, unless otherwise specifically defined.

[0098] Although the present application is described herein with reference to various embodiments, those skilled in the art will be able to understand and implement other variations of the disclosed embodiments in practicing the claimed application by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality.

[0099] The above is a further detailed description of the present invention in conjunction with specific preferred embodiments, and the specific implementation of the present invention should not be considered to be limited to these descriptions. For those skilled in the art of the present invention, without departing from the concept of the present invention, several simple deductions or substitutions can be made, which should be considered to fall within the scope of protection of the present invention.

Claims

1. An AI-based integrated media data processing system, characterized in that: include: User end, AI resource generation server and environment integration server; The user terminal is used to collect surrounding environment information and generate educational resource requirements based on user operations and the surrounding environment information; The AI ​​resource generation server is configured to extract educational resource information from the educational resource demand and input the educational resource information into multiple AI generation models to generate multiple educational resources; dynamically adjust and optimize the multiple educational resources in combination with the surrounding environment information to obtain multiple final educational resources; The environment integration server is configured to construct a virtual reality environment that matches the final educational resource based on the surrounding environment information, determine a presentation method for the final educational resource in the virtual reality environment, and construct a virtual character that explains the final educational resource using a user portrait; and recommend the virtual reality environment and the virtual character to the user terminal; The user terminal is configured to respond to user operations and present the final educational resource by the virtual character in the virtual reality environment according to the positioning relationship among the virtual reality environment, the virtual character, and the final educational resource; The multiple AI generation models belong to different AI platforms, each of which is provided with access rights. The AI ​​resource generation server applies for registration with each of the AI ​​platforms. During the registration process, a key generation interval is set according to the resource type of the auxiliary educational resource, and a key is generated using the key generation interval. When requesting to generate educational resources from the AI ​​platform, the key is used to complete the authentication process. The AI ​​resource generation server organizes all AI platforms into a blockchain based on generation efficiency, with each AI platform responsible for generating educational resources for its own block. The key generation interval is divided into multiple subintervals based on the number of AI platforms, with each AI platform performing content search and generation within its own subinterval. Inputting the educational resource information into multiple AI generation models to generate multiple educational resources includes: S31, sending an educational resource generation request to each AI platform, so that each AI platform sends a resource authentication response to the AI ​​resource generation server; S32, upon receiving the resource authentication response, sending the key generated during registration and the educational resource information to the AI ​​platform, and obtaining the initial educational resources generated by each AI platform after completing authentication based on the key; S33, using a content search algorithm to identify, from among the multiple initial educational resources, excellent educational resources that meet the resource requirements and whose content matching degree exceeds a matching degree threshold; S34, extract the main content of each excellent educational resource and organize all the main contents into a content space; S35, using a chromosome genetic algorithm to search for multiple target chromosomes with fitness exceeding a threshold in the content space, and determining the main content corresponding to each target chromosome; S36, randomly combining the main contents to form key contents, and inputting the key contents into each AI platform to obtain multiple educational resources.

2. The AI-based media convergence data processing system according to claim 1, characterized in that: The user terminal is provided with an acquisition module, an AR module, a VR module and a display module. The acquisition module is used to: obtain multiple planar images using the plane of the current scene as the shooting plane; wherein the current scene is composed of multiple target areas; the AR module is used to use the entrance of the user into the current scene as the coordinate origin, and use the multiple planes to construct a two-dimensional plane map; use the stereo parameter information of the current environment to construct a virtual reality environment on the two-dimensional plane map; the VR module is used to enhance the virtual reality environment and enhance the matching degree between the virtual character and the virtual reality environment when the virtual character is in the virtual reality environment.

3. The AI-based media convergence data processing system according to claim 1, characterized in that: The AI ​​resource generation server is configured to extract educational resource information from the educational resource requirements, including: S21, extracting user basic information related to the user and educational content related information related to the demand from the educational resource demand; the educational content related information includes the type of educational resource required by the user and the content description of the educational resource required by the user; the user basic information includes user preferences, user age, user location, user history, and user history browsing resource information; S22, using a machine learning or deep learning model to perform in-depth mining and analysis on the educational content-related information to obtain key content related to the educational resource demand; S23, searching for educational resource types related to the key content in its own database; S24, comparing the educational resource type found in the database with the educational resource type required by the user to determine whether they are similar or identical; S25: If the type of the educational resource found in the database is similar to or the same as the type of the educational resource required by the user, the similar or the same educational resource in the database is used as an auxiliary educational resource.

4. The AI-based media convergence data processing system according to claim 1, characterized in that: S35 includes: S351, each major content is considered a chromosome in the population; S352, calculate the fitness of each chromosome; S353, performing crossover mutation on the chromosomes in any generation population, selecting a mutation probability from the memory space during the mutation; selecting main content from the content space with a second probability to update the population; S354, updates the chromosomes whose fitness is lower than the threshold in the cache space; S355, repeating S352-S354 until the update iteration number is reached, and obtaining multiple chromosomes in the cache space; S356 , selecting a target chromosome whose fitness exceeds a threshold from the multiple chromosomes in the cache space, and determining the main content corresponding to each target chromosome.

5. The AI-based media convergence data processing system according to claim 1, characterized in that: The dynamically adjusting and optimizing the plurality of educational resources in combination with the surrounding environment information to obtain the final educational resources includes: S41, traversing the plurality of educational resources to obtain resource information of each educational resource; the resource information includes main content, required resource size, resource type and format; S42, determining target resources for constructing a virtual reality environment required for each educational resource based on the surrounding environment information; S43, matching the target resource with a plurality of pre-stored sub-environment templates, so as to split the scheduling process of generating a virtual reality environment using the target resource into scheduling paths of the sub-environment templates; S44, introducing the scheduling path as a constraint condition, and using the constraint condition to determine a content adjustment range; S45, adjusting the contents of the plurality of educational resources and the plurality of educational resources after the content order is adjusted within the content adjustment range; S46, combining the adjusted multiple educational resources into multiple resource combinations; S47, using the quartile method to calculate the difference between any two resource combinations, and eliminating resource combinations whose difference exceeds a difference threshold to obtain the remaining resource combinations; S48, selecting the educational resource with the highest frequency of occurrence from the remaining resource combinations as the final educational resource.

6. The AI-based media convergence data processing system according to claim 1, characterized in that: The step of constructing a virtual reality environment matching the final educational resource based on the surrounding environment information, determining a presentation method of the final educational resource in the virtual reality environment, and constructing a virtual character explaining the final educational resource using a user portrait includes: S51, constructing a basic virtual reality environment for the final educational resource; S52, determining three-dimensional parameters of real objects in the surrounding environment according to the surrounding environment information, and creating virtual objects corresponding to the real objects in the basic virtual reality environment according to the three-dimensional parameters to obtain a virtual reality environment; S53, determining a presentation mode for each of the final educational resources in the virtual reality environment based on the user's historical form habits; the presentation modes include two-dimensional image presentation, three-dimensional video presentation, two-dimensional animation presentation, three-dimensional animation presentation, two-dimensional character dialogue presentation, and three-dimensional character dialogue; S54, construct multiple virtual characters of multiple types using user portraits; S55, determining the matching degree between the plurality of virtual characters and the virtual reality environment; S56: Using the virtual character with the highest matching degree as the virtual character for explaining the final educational resource, and reconstructing the virtual character in the virtual reality environment.

7. The AI-based media convergence data processing system according to claim 6, characterized in that: The presenting of the final educational resource by the virtual character in the virtual reality environment according to the positioning relationship among the virtual reality environment, the virtual character, and the final educational resource includes: S61, determining a specific location of the final educational resource in the virtual reality environment by using the presentation method of the final educational resource; S62, determining the specific location of the virtual character and a method for explaining the final educational resource based on the specific location in S61, wherein the explanation method includes a dialogue explanation between virtual characters, a separate video explanation of the virtual character, an explanation by the virtual character imitating a real person, and a static display explanation of the virtual character; S63, placing the final educational resource at the determined specific location, and placing the virtual character within a preset range of the final educational resource; S64, synchronizing the content of the final educational resource and the display actions of the virtual character according to the explanation method of the virtual character and the presentation method of the final educational resource; S65 , in response to a user operation, the final educational resource is presented by a synchronized virtual character in the virtual reality environment.

8. An AI-based integrated media data processing method, characterized in that: include: Collecting surrounding environment information and generating educational resource requirements based on user operations and the surrounding environment information; Extracting educational resource information from the educational resource demand, and inputting the educational resource information into multiple AI generation models to generate multiple educational resources; dynamically adjusting and optimizing the multiple educational resources in combination with the surrounding environment information to obtain multiple final educational resources; Constructing a virtual reality environment that matches the final educational resource based on the surrounding environment information, determining a presentation method for the final educational resource in the virtual reality environment, and constructing a virtual character that explains the final educational resource using the user portrait; and recommending the virtual reality environment and the virtual character to the user terminal; In response to a user operation, the virtual character presents the final educational resource in the virtual reality environment according to the positioning relationship among the virtual reality environment, the virtual character, and the final educational resource; The multiple AI generation models belong to different AI platforms, each of which is provided with access rights. The AI ​​resource generation server applies for registration with each of the AI ​​platforms; during the registration process, a key generation interval is set according to the resource type of the auxiliary educational resource, and a key is generated using the key generation interval; when requesting to generate educational resources from the AI ​​platform, the key is used to complete the authentication process; The AI ​​resource generation server organizes all AI platforms into a blockchain based on generation efficiency, with each AI platform responsible for generating educational resources for its own block. The key generation interval is divided into multiple subintervals based on the number of AI platforms, with each AI platform performing content search and generation within its own subinterval. Inputting the educational resource information into multiple AI generation models to generate multiple educational resources includes: S31, sending an educational resource generation request to each AI platform, so that each AI platform sends a resource authentication response to the AI ​​resource generation server; S32, upon receiving the resource authentication response, sending the key generated during registration and the educational resource information to the AI ​​platform, and obtaining the initial educational resources generated by each AI platform after completing authentication based on the key; S33, using a content search algorithm to identify, from among the multiple initial educational resources, excellent educational resources that meet the resource requirements and whose content matching degree exceeds a matching degree threshold; S34, extract the main content of each excellent educational resource and organize all the main contents into a content space; S35, using a chromosome genetic algorithm to search for multiple target chromosomes with fitness exceeding a threshold in the content space, and determining the main content corresponding to each target chromosome; S36, randomly combining the main contents to form key contents, and inputting the key contents into each AI platform to obtain multiple educational resources.

Citation Information

Patent Citations

  • AI intelligent interactive lesson system and method based on large language model

    CN117114933A

  • Knowledge representation construction method and system for virtual training examination

    CN117910564A