A digital media information fusion transmission method, device and system

Abstract

The present invention relates to the field of data processing technology, and in particular to a method, device and system for fusion transmission of digital media information. The method comprises: obtaining a user's route in a target venue, and determining the user's first attention to different object categories on the route; obtaining a target object within the user's current line of sight, and determining the user's second attention to the target object based on the first attention of the object category of the target object; obtaining digital media information of the target object, and determining the importance of each digital media information; determining the preloaded information of the target object based on the second attention and the importance of the digital media information, and preloading the digital media information of the target object based on the preloaded information; and displaying the digital media information of the target object to the user based on the preloaded information in response to the user's information request operation.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a digital media information fusion transmission method, device and system. Background Art

[0002] With the continuous development of network and information technology, technologies such as 5G, big data and cloud computing have promoted the innovation of digital media content. The business model of the digital media industry has also continued to evolve, providing users with unprecedented interaction and participation.

[0003] In the related technology, the integrated transmission of digital media information is mainly achieved through the following methods: receiving user instructions; obtaining relevant text, picture and video materials based on user quality, and integrating and transmitting the obtained data to achieve the integrated transmission of digital media information.

[0004] However, the above process performs fusion transmission of relevant information after obtaining user instructions. Due to the large transmission data capacity, the network requirements are high, and it is impossible to ensure that users can obtain information in a timely manner. In addition, when the digital media information obtained by the user is relatively complex, it may cause the user to be unable to efficiently obtain the required information, which is not conducive to the user's viewing experience. Summary of the invention

[0005] In order to solve the problem that users cannot obtain required information efficiently and timely in the related art, the purpose of the present invention is to provide a digital media information fusion transmission method, device and system, and the technical solution adopted is as follows:

[0006] According to a first aspect of the present invention, a method for fusion transmission of digital media information is provided, comprising: obtaining a user's route in a target venue, and determining the user's first attention to different object categories on the route; obtaining a target object within the user's current field of vision, and determining the user's second attention to the target object based on the first attention of the object category to which the target object belongs; obtaining digital media information of the target object, and determining the importance of each piece of digital media information of the target object; determining preloading information of the target object based on the second attention and the importance of each piece of digital media information, and preloading the digital media information of the target object based on the preloading information; and displaying the digital media information of the target object to the user based on the preloading information in response to the user's information request operation.

[0007] In an exemplary embodiment of the present invention, the method further includes: obtaining the object information of each of the target objects in the target site; obtaining association information between the objects, and establishing an object relationship map corresponding to each of the objects based on the association information.

[0008] In an exemplary embodiment of the present invention, determining the user's first attention level to different object categories on the route includes: obtaining the length of time the user stays at each object on the route; determining the object category of each object on the route based on the object relationship graph; determining data extraction information for each object category; and determining the user's first attention level to the object category based on the data extraction information and the length of time the user stays at each object in the object category.

[0009] In an exemplary embodiment of the present invention, determining the user's second attention level to the target object based on the first attention level to the object category to which the target object belongs includes: determining the object category to which the target object belongs based on the object relationship graph; determining the association coefficient of the target object based on the position information and connection relationship of the target object in the object relationship graph; and determining the user's second attention level to the target object based on the association coefficient of the target object and the first attention level to the object category to which the target object belongs.

[0010] In an exemplary embodiment of the present invention, determining the importance of each of the digital media information includes: obtaining the access frequency, evaluation information and content information of each of the digital media information; the content information includes the memory usage, information depth, update frequency and information diversity of the digital media information, and the information diversity is used to characterize the number of data types contained in the digital media information; determining the information richness of the digital media information based on the content information; determining the importance of the digital media information based on the access frequency, the evaluation information and the information richness.

[0011] In an exemplary embodiment of the present invention, determining the preloading information of the target object based on the second attention level and the importance of each digital media information includes: obtaining the number of visits to the digital media information of different data types by the user, and determining a correction coefficient based on the number of visits to the digital media information of different data types by the user; correcting the importance of the digital media information based on the correction coefficient; sorting the importance of the corrected digital media information, and determining the amount of preloaded data based on the second attention level to obtain the preloading information; preloading the digital media information of the target object based on the preloading information includes: preloading the digital media information according to the sorting result of the importance of the digital media information based on the preloaded data amount.

[0012] In an exemplary embodiment of the present invention, in response to the information request operation of the user, displaying the digital media information of the target object to the user based on the preloaded information includes: in response to the information request operation of the user, sending the preloaded digital media information to the user device of the user to display the digital media information in the user device interface.

[0013] In an exemplary embodiment of the present invention, presenting the digital media information in a user equipment interface includes: in response to an interaction operation performed by the user on the user equipment interface, presenting the digital media information to the user based on the interaction operation.

[0014] According to a second aspect of the present invention, there is provided a digital media information fusion transmission device, comprising: an acquisition module, used to acquire a user's route in a target venue, and determine the user's first attention to different object categories on the route; a determination module, used to acquire a target object within the user's current field of vision, and determine the user's second attention to the target object based on the first attention of the object category to which the target object belongs; the determination module, further used to acquire digital media information of the target object, and determine the importance of each piece of digital media information of the target object; a loading module, used to determine preloaded information of the target object based on the second attention and the importance of each piece of digital media information, and preload the digital media information of the target object based on the preloaded information; and a display module, used to display the digital media information of the target object to the user based on the preloaded information in response to the user's information request operation.

[0015] According to a third aspect of the present invention, a digital media information fusion transmission system is provided, the digital media information fusion transmission system comprising a user device and a server, the server comprising an acquisition unit, a determination unit, a loading unit and a display unit: the user device is used to send an information request operation to the server; and the digital media information of the target object corresponding to the information request operation is displayed to the user; the acquisition unit is used to acquire the user's travel route in the target venue and determine the user's first attention to different object categories on the travel route; the determination unit is used to acquire the target object within the user's current visual range, and determine the user's second attention to the target object based on the first attention of the object category to which the target object belongs; and the digital media information of the target object is acquired and the importance of each digital media information is determined; the loading unit is used to determine the preload information of the target object based on the second attention and the importance of each digital media information, and preload the digital media information of the target object based on the preload information; the display unit is used to respond to the user's information request operation and display the digital media information of the target object to the user based on the preload information.

[0016] The present invention has the following beneficial effects:

[0017] In the digital media information fusion transmission method provided by the present invention, a user's travel route in a target venue is obtained, and the user's first attention to different object categories on the travel route is determined; a target object within the user's current field of vision is obtained, and based on the first attention of the object category to which the target object belongs, the user's second attention to the target object is determined; digital media information of the target object is obtained, and the importance of each digital media information is determined; preloaded information of the target object is determined based on the second attention and the importance of each digital media information, and the object information of the target object is preloaded based on the preloaded information; in response to the user's information request operation, the object information of the target object is displayed to the user based on the preloaded information. The present invention analyzes the user's first attention to various objects on the travel route, determines the user's second attention to the target object in the current field of view based on the first attention, and determines the importance of each digital media information of the target object, so that pre-loading information can be generated based on the second attention and the importance of each digital media information, and the important information of the target object is pre-fused and pre-loaded based on the pre-loaded information, so that when the user accesses the information, it can be transmitted quickly, and personalized loading of the transmitted information can be achieved according to the user's situation, thereby optimizing the efficiency of information fusion transmission and improving the user's visiting experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A method flow chart of a digital media information fusion transmission method provided by an embodiment of the present invention;

[0020] Figure 2 A flow chart of a method for determining an object relationship map of objects in a target site provided by an embodiment of the present invention;

[0021] Figure 3 A flow chart of a method for determining a user's first attention level to different object categories on a travel route provided by one embodiment of the present invention;

[0022] Figure 4 A flow chart of a method for determining a second degree of attention of a user to a target object based on the first degree of attention provided by an embodiment of the present invention;

[0023] Figure 5 A flow chart of a method for determining the importance of each digital media information of a target object provided by an embodiment of the present invention;

[0024] Figure 6 A flow chart of a method for preloading digital media information of a target object based on preload information provided by an embodiment of the present invention;

[0025] Figure 7 A method flow chart of another digital media information fusion transmission method provided by an embodiment of the present invention;

[0026] Figure 8 A block diagram of a digital media information fusion transmission device provided by an embodiment of the present invention;

[0027] Fig. 9 A block diagram of a digital media information fusion transmission system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the following is a detailed description of the specific implementation method, structure, features and effects of a digital media information fusion transmission method proposed by the present invention in combination with the accompanying drawings and preferred embodiments. In the following description, different "one embodiment" or "another embodiment" does not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics in one or more embodiments may be combined in any suitable form.

[0029] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0030] The high speed and low latency of 5G networks have greatly improved data transmission capabilities, making high-definition video streaming, real-time interaction, and large-scale online collaboration possible; the application of big data technology enables content providers to analyze user behavior more accurately, achieve personalized recommendations, and more effective advertising; cloud computing provides elastic and scalable solutions for the storage, processing, and distribution of media content, reducing costs and improving efficiency. The comprehensive application of these technologies has promoted the innovation of digital media content, including the development of immersive experiences such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), providing users with unprecedented interaction and participation. At the same time, the business model of the digital media industry is also evolving, shifting from traditional subscription and advertising models to data-driven personalized services and intelligent recommendation systems.

[0031] In the related technology, a request is sent to a server by obtaining a user's instruction to obtain relevant text, picture and video materials, and then the data is integrated and transmitted to achieve the integrated transmission of digital media information.

[0032] However, the above process performs fusion transmission of relevant information after obtaining user instructions. Due to the large transmission data capacity, the network requirements are high, and it is impossible to ensure that users can obtain information in a timely manner. In addition, when the digital media information obtained by the user is relatively complex, it may cause the user to be unable to efficiently obtain the required information, which is not conducive to the user's viewing experience.

[0033] In order to solve the above problems, the present invention provides a digital media information fusion transmission method, device and system. Preload information is generated based on the user's attention to the target object and the importance of each digital media information of the target object, and the important information of the target object is pre-fused and pre-loaded based on the preload information, so that when the user accesses the information, it can be transmitted quickly, and the transmitted information can be personalized according to the user's situation, which optimizes the efficiency of information fusion transmission and improves the user's visiting experience.

[0034] A specific scheme of a digital media information fusion transmission method provided by the present invention is described in detail below with reference to the accompanying drawings.

[0035] See also Figure 1 , which shows a method flow chart of a digital media information fusion transmission method provided by an embodiment of the present invention, such as Figure 1 As shown, the above digital media information fusion transmission method includes the following steps:

[0036] S110: Acquire a user's travel route in the target site, and determine the user's first attention to different object categories on the travel route.

[0037] In some embodiments of the present invention, the target scene is the scene that the user is currently in. Exemplarily, the target scene may be a museum, an art gallery, or a historical site.

[0038] In some embodiments of the present invention, the above-mentioned route is the route of the user in the target site. For example, the above-mentioned route can be a tour route of the user visiting a museum or historical sites.

[0039] In some embodiments of the present invention, the object categories are object categories obtained by dividing objects in the target site. For example, the object categories may be categories obtained by dividing exhibits in a museum.

[0040] In some embodiments of the present invention, the first attention level is the user's attention level to each object category on the travel route. For example, after the exhibits in the museum are divided into different categories, the user's attention level to each category can be determined respectively.

[0041] In some embodiments of the present invention, an object relationship map of each object in the target site may also be determined, and the object relationship map is used to characterize the relationship between each object in the target site. Figure 2 As shown, the process can be implemented by the following steps S210 and S220:

[0042] S210: Obtaining object information of each object in the target site.

[0043] In some embodiments of the present invention, the object information is information used to describe each object in the target site, and may include the name of the object, an explanation video, a 3D model, and information related to the object. For example, taking a museum exhibit as an example, the object information of the exhibit may include the name of the exhibit, a video explaining the exhibit, a 3D model of the exhibit, and historical event information related to the exhibit.

[0044] In some embodiments of the present invention, taking the target site as a museum as an example, the above-mentioned acquisition of object information of each target object in the target site can be implemented as follows: acquiring object information of target exhibits, including exhibit 3D models, related historical events, video explanations, etc.; preprocessing the acquired object information of the exhibits to remove false information therein; optimizing the object information of the exhibits after removing the false information, for example, optimizing 3D modeling quality, optimizing video quality, etc.

[0045] S220: Obtain association information between objects, and establish an object relationship map based on the association information.

[0046] In some embodiments of the present application, the above-mentioned association information is used to indicate the relationship between the objects, and can be any information that can link different objects together. Taking the above-mentioned target venue as a museum as an example, the above-mentioned association information can be the dynasty of the exhibits, related historical events, etc., that is, the association information between two exhibits can be that they belong to the same dynasty, or are related to the same historical time, etc.

[0047] In some embodiments of the present application, taking the target site as a museum as an example, the above-mentioned acquisition of the association information between the objects and the establishment of the object relationship map based on the association information can be implemented as follows: for each exhibit, the association information between the current exhibit and other exhibits in the museum is obtained, and the exhibition hall exhibit relationship map is constructed, that is, the above-mentioned object relationship map. Optionally, when constructing the exhibition hall exhibit relationship map, the digital media information of the exhibits and the exhibit relationship map can also be stored in the server or cloud platform and backed up. Exemplarily, the exhibit information of each exhibit in the above-mentioned museum and the association information between the current exhibit and other exhibits can be obtained based on the existing knowledge base, which can be a non-shared rule set applied by the specific expert system design, including the facts and data associated with the rules, and all of them constitute a knowledge base, or it can be a shared knowledge base with consulting nature. In addition, in addition to being directly obtained through the knowledge base, the association information between the above-mentioned current exhibit and other exhibits can also be obtained based on the obtained exhibit information of each exhibit.

[0048] In some embodiments of the present invention, the process of determining the user's first attention to different object categories on the route is as follows: Figure 3 As shown, it can be implemented by the following steps S310 to S340:

[0049] S310: Obtain the duration of the user's stay at each object on the travel route.

[0050] In some embodiments of the present invention, the above-mentioned dwelling time refers to the dwelling time of a user at a certain object on the travel route. For example, the dwelling time may be the dwelling time of a user in front of each exhibit on the tour route when visiting a museum.

[0051] In some embodiments of the present invention, the above-mentioned acquisition of the length of time a user stays at each object on the route can be achieved as follows: through augmented reality (AR), sensors built into devices such as mobile phones, global positioning systems (GPS), visual systems (AR glasses), and Wi-Fi networks, etc., the current visitor's visiting path is acquired; and the length of time a user stays in front of each object on the visiting path is acquired.

[0052] S320: Determine the object category of each object on the travel route according to the object relationship map.

[0053] In some embodiments of the present invention, after obtaining the object relationship map through the above steps S210 and S220, the object category of each object on the travel route can be determined according to the object relationship map. For example, in a museum scenario, the exhibits on the user's visiting path can be classified according to the above exhibit relationship map. Specifically, the exhibits can be classified according to different properties, such as related events, exhibit types, etc.

[0054] S330: Determine data extraction information for each object category.

[0055] In some embodiments of the present invention, the data extraction information is used to represent the information extraction probability of each object category. Exemplarily, for a certain object category, the data extraction information can be determined by the number of objects whose digital media information is extracted from the object category and the total number of objects in the object category. The digital media information is media information used to describe the object, which can be a combination of one or more of text, pictures, audio and video, etc. Through the digital media information, the user can understand the object information and background story of the object.

[0056] S340: Determine a first degree of attention of the user to the object category based on the data extraction information and the length of time the user stays at each object of the object category.

[0057] Below, taking the museum scene as an example, the process of determining the first attention level is described in detail. Specifically, it can be achieved through the following steps:

[0058] S1: Combine the sensors, GPS, visual system (AR glasses) and Wi-Fi network (indoor environment of museums) of AR devices, mobile phones and other devices to obtain the user's visiting path;

[0059] S2: Determine the user's attention to different types of exhibits based on the exhibits placed on the visiting path. Specifically, it can be achieved as follows;

[0060] S21: Get the user's first The length of time spent in front of each exhibit .

[0061] In some embodiments of the present invention, the user first The length of time spent in front of each exhibit The longer it is, the more attention the exhibit will receive.

[0062] S22: Classify the exhibits on the visiting path according to the exhibit relationship map.

[0063] In some embodiments of the present invention, this step may classify the exhibits according to different properties, such as historical events related to the exhibits, exhibit types, etc.

[0064] S23: Combine the user's extraction record of digital media information of exhibits on the tour path to obtain the user's first attention to a certain type of exhibits. The first attention of the exhibits It can be determined by the following formula:

[0065] ;

[0066] Among them, the above The function is a linear normalization function. Indicates the first The probability of extracting information about the exhibits, that is, the above data extraction information, Indicates The number of exhibits from which digital media information was extracted. Indicates Total number of exhibits in the category of exhibits; Indicates that the user is The average length of stay of exhibits in this category, Indicated in The first The length of time you stay in front of each exhibit. The greater the probability of extracting the exhibits and the longer the stay time, the higher the attention The bigger.

[0067] Step S120: Acquire a target object within the user's current visual range, and determine the user's second attention level to the target object based on the first attention level of the object category to which the target object belongs.

[0068] In some embodiments of the present invention, the target object is an object within the user's current visual range, that is, the object the user is currently looking at. For example, the target object can be identified by a visual system of an AR device or a camera system of a mobile phone.

[0069] In some embodiments of the present invention, after obtaining the user's first attention to each object category, the user's second attention to the target object can be determined based on the first attention. For example, Figure 4 As shown, the process can be implemented by following steps S410 to S430:

[0070] S410: Determine the object category to which the target object belongs based on the object relationship graph.

[0071] In some embodiments of the present invention, the object category to which the target object belongs can be determined by the above-mentioned object relationship graph. Exemplarily, the object category to which the target object belongs can be determined by the distance of the target object from the central node of each object relationship graph. The closer the target object is to the central node of a certain type of object relationship graph, the higher the probability that the target object belongs to the object relationship graph of that type. The object category corresponding to the object relationship graph with the closest distance can be determined as the object category to which the target object belongs.

[0072] S420: Determine a correlation coefficient of the target object based on the position information and connection relationship of the target object in the object relationship graph.

[0073] In some embodiments of the present invention, the above-mentioned correlation coefficient is determined based on the above-mentioned object relationship graph, which describes the closeness between the target object and other objects in the object category to which it belongs, and can be determined by the distance between the current target object and the central node of the object relationship graph and the number of node connections.

[0074] S430: Determine the user's second attention level to the target object based on the correlation coefficient of the target object and the first attention level of the object category to which the target object belongs.

[0075] In some embodiments of the present invention, the second attention level is the user's attention level to the target object. Exemplarily, the second attention level can be determined by the average of the first attention levels.

[0076] In the following, in a museum scenario, the process of determining the second attention level is described in detail. Exemplarily, the following steps may be included:

[0077] S1: Identify the exhibit that the user is currently visiting, i.e. the target object mentioned above, through the visual system of the AR device or the camera system of the mobile phone ;

[0078] S2: Determine the type of exhibits to which the user's current exhibit belongs on the user's visiting path based on the exhibit relationship graph , calculate the exhibits that the user is currently visiting and the types of exhibits they belong to The close relationship coefficient, that is, the above correlation coefficient ;

[0079] ;

[0080] Among them, the above The function is a linear normalization function. Display exhibits On display The shortest distance from the central node in the exhibit relationship graph; Display exhibits On display The number of node connections in the exhibit relationship graph.

[0081] S3: Calculate the user's second attention to the current exhibit , that is, calculate the average attention value of the exhibit category;

[0082] ;

[0083] in, is the number of exhibits in the corresponding exhibit category, is the correlation coefficient calculated above, It is the first degree of user's attention to the exhibit category obtained by the above calculation.

[0084] S130: Acquire digital media information of the target object, and determine the importance of each digital media information of the target object.

[0085] In some embodiments of the present invention, the digital media information is media information used to describe an object, and can be a combination of one or more of text, pictures, audio, and video. Through the digital media information, the user can understand the object information and background story of the object. The digital media information of the target object is media information used to describe the target object. Exemplarily, the digital media information can be obtained from the collected object information.

[0086] In some embodiments of the present invention, the importance of the digital media information is used to indicate the importance of the digital media information in describing the object. Exemplarily, the importance of the digital media information is affected by factors such as data accuracy, user acceptance, and number of views.

[0087] In some embodiments of the present invention, the above process of determining the importance of each digital media information of the target object is as follows: Figure 5As shown, this can be achieved by following the steps below:

[0088] S510: Obtain access frequency, evaluation information, and content information of each digital media information.

[0089] In some embodiments of the present invention, the access frequency is used to describe the access frequency of the corresponding digital media information. The more frequent the access, the more important or more accepted the digital media information. No. The access frequency of relevant digital media information can be expressed as .

[0090] In some embodiments of the present invention, the evaluation information is the praise rate of the corresponding digital media information. The higher the praise rate of the user, the better the explanation effect of the information. No. The favorable comment rate of relevant digital media information can be expressed as .

[0091] In some embodiments of the present invention, the above-mentioned content information may include the memory usage, information depth, update frequency and information diversity of the digital media information.

[0092] In some embodiments of the present invention, the above-mentioned information depth may be evaluated by experts to describe the degree to which the digital media information describes the object. A higher information depth may help users to more deeply understand the importance and complexity of the object.

[0093] In some embodiments of the present invention, the above information diversity is used to characterize the number of data types contained in the digital media information. Higher information diversity can provide users with richer sensory experience by including multimedia elements such as pictures, videos, audio and 3D models.

[0094] In some embodiments of the present invention, The memory usage of digital media information can be expressed as , the information depth can be expressed as , the update frequency can be expressed as , information diversity can be expressed as .

[0095] S520: Determine information richness of the digital media information based on the content information.

[0096] In some embodiments of the present invention, the information richness of the digital media information may be determined based on the content information obtained above. For example, the memory usage of the digital media information may be determined based on the actual scenario. , information depth , Update frequency and information diversity , and perform weighted summation to obtain the above information richness.

[0097] The following is a detailed description of the process of determining the information richness of digital media information based on content information in a museum scenario:

[0098] S1: Acquisition of exhibits No. Frequency of access to relevant digital media information ;

[0099] S2: Acquisition of exhibits No. The rate of favorable comments on relevant digital media information ;

[0100] S3: Exhibits No. Quantifying the content richness of relevant digital media, specifically, may include the following steps:

[0101] S31: Get the The memory usage of digital media information , Information Depth , Update frequency , Information Diversity ;

[0102] S32: For the Set weights for different dimensions of digital media information and obtain weights ;

[0103] In some embodiments of the present invention, since a higher information depth can help users understand the importance and complexity of exhibits more deeply, and a higher information diversity can provide a richer sensory experience, the information depth and information diversity in the parameters of the above content information can be set to a higher weight. For example, the parameter weights of the above content information can be set as follows: Memory usage Weight ; Information depth Weight ; Update frequency Weight ; Information diversity Weight .

[0104] S4: Computational Exhibits No. Content richness of relevant digital media ;

[0105] ;

[0106] S530: Determine the importance of the digital media information based on the access frequency, the evaluation information, and the information richness.

[0107] In some embodiments of the present invention, taking a museum scenario as an example, the process of determining the importance of digital media information based on visit frequency, evaluation information, and information richness can be implemented as follows:

[0108] Computing Exhibits No. The importance of the content of relevant digital media :

[0109] ;

[0110] in, is the exhibit calculated above No. The content richness of relevant digital media, It is an exhibit No. The access frequency of relevant digital media information, It is an exhibit No. The positive review rate of relevant digital media information.

[0111] Step S140: determining the preloading information of the target object based on the second attention level and the importance of each digital media information, and preloading the digital media information of the target object based on the preloading information.

[0112] In some embodiments of the present invention, the pre-loading information is used to determine the loading priority of the digital media information of the target object.

[0113] In some embodiments of the present invention, illustratively, Figure 6 As shown, the above-mentioned determination of the preloaded information of the target object based on the second attention degree and the importance of each digital media information can be implemented through the following steps S610 to S630, and after step S630, the above-mentioned preloading of the digital media information of the target object based on the preloaded information can also be implemented through step S640:

[0114] S610: Obtain the amount of access to digital media information of different data types by the user, and determine a correction coefficient based on the amount of access to digital media information of different data types by the user.

[0115] In some embodiments of the present invention, the correction coefficient is used to correct the importance of the digital media information calculated in step 530 .

[0116] In some embodiments of the present invention, the correction coefficient may be determined by the amount of access by users to digital media information of different data types, wherein the digital media information of different data types may be one or more types such as text, picture or video.

[0117] In some embodiments of the present invention, the above-mentioned determination of the correction coefficient based on the user's access to digital media information of different data types can be implemented as follows: calculate the user's access ratio to different types of digital media information, that is, the ratio of the type of information access to the total information access, to obtain the above-mentioned correction coefficient.

[0118] S620: Correct the importance of the digital media information based on the correction coefficient.

[0119] In some embodiments of the present invention, after obtaining the correction coefficient, the importance of each digital media information of the target object can be corrected based on the correction coefficient. Through this step, the influence of the type of digital media information on the user's adoption degree is taken into account.

[0120] S630: Sort the importance of the corrected digital media information, and determine the amount of preloaded data based on the second attention level to obtain preload information.

[0121] In some embodiments of the present invention, after the importance of the digital media information of the target object is corrected, the digital media information may be sorted based on the corrected importance, so that more important digital media information can be obtained.

[0122] In some embodiments of the present invention, the preloaded data volume is the data volume of the digital media information of the target object loaded in advance.

[0123] In some embodiments of the present invention, the above-mentioned preloading information includes the importance ranking of digital media information and the amount of preloaded data. By selectively preloading data according to the preloading priority of different data, and temporarily caching the preloaded data in a database, the speed of data transmission can be accelerated and the user experience can be improved when the user views the digital media information of the target object.

[0124] S640: Preload the digital media information based on the preloaded data volume and according to the ranking result of the importance of the digital media information.

[0125] Next, in the museum scenario, the process of determining the preloaded information of the target object based on the second attention level and the importance of each digital media information, and preloading the object information of the target object based on the preloaded information is described in detail:

[0126] S1: Calculate the proportion of users' access to different types of digital media information, that is, the ratio of the number of visits to different types of information to the total number of visits to information ; Among them, the type of the above-mentioned digital media information can be one or more of text, picture or video.

[0127] S2: Access ratio of different types of digital media information , corrected exhibits No. The importance of the content of relevant digital media ,get ;

[0128] ;

[0129] S3: According to the revised exhibits Importance of digital media information content , sort the digital media information of the target object from large to small;

[0130] S4: Based on the user's The second attention , set the amount of preloaded data:

[0131] ;

[0132] in, Display exhibits The total amount of digital media information owned. The higher the user's second attention to the target object, the more preloaded data The more.

[0133] S5: Based on the amount of preloaded data , pre-load the sorted related digital media information in order.

[0134] Step S150: In response to the user's information request operation, display the object information of the target object to the user based on the preloaded information.

[0135] In some embodiments of the present invention, the above-mentioned information request operation can be an interactive operation performed by a user on a user device interface. For example, the user can interact with the exhibits through the interactive operation, for example, triggering different viewing angles of the exhibits, rotating or enlarging specific parts to view details, etc.

[0136] In some embodiments of the present invention, after receiving the above-mentioned information request operation, the user device can send the information request operation to the server to trigger a data request; after receiving the data request, the server queries the preloaded data and retrieves the data requested by the information request operation; the server encapsulates the retrieved preloaded data into a response packet and prepares to send it; the server transmits the preloaded data in the database to the user device through a local area network, a 5G network, etc., so that after receiving the data, the user device parses the received digital media information and processes the parsed data to adapt it to the user's mobile device. For example, for AR applications, the rendering engine superimposes virtual information on the real world and displays it on the user device interface in the form of graphics, text, 3D models or videos. Optionally, the user can further interact with the user device interface, such as clicking on the target object to view detailed information, or interacting with virtual content through AR.

[0137] In the embodiment of the present invention, the digital media information that the user may need is preloaded according to the importance and user preferences, thereby ensuring that the user can obtain the required information in the first time, improving the efficiency of digital media information fusion transmission, and providing users with more personalized services.

[0138] Next, taking a museum scene as an example, in another embodiment, the above digital media information fusion transmission method is described in detail. Figure 7 As shown, the digital media information fusion transmission method includes the following steps:

[0139] S710: Collect relevant information of all exhibits in the museum.

[0140] In some embodiments of the present invention, the above-mentioned process of collecting relevant information of all exhibits in the museum can be implemented as follows: obtaining information about the exhibits, including 3D models of the exhibits, historical events experienced, video explanations, etc.; identifying the obtained exhibit information and removing false information therein; optimizing the obtained information, for example, optimizing 3D modeling quality, optimizing video quality, etc.; obtaining the connection between the current exhibit and other exhibits in the museum or historical sites, and constructing a relationship map of the exhibition hall exhibits; storing the obtained digital media information of the exhibits and the exhibit relationship map in a server or cloud platform, and backing up them.

[0141] S720: Preload the digital media information of the exhibit for fusion transmission. Exemplarily, the process may include the following steps:

[0142] S7201: Analyze visitor routes and analyze the relevance of exhibits visited.

[0143] During the visit, some tourists will visit according to the recommended route of the museum, and some tourists will visit selectively according to their own preferences. In both cases, tourists will focus on visiting exhibits, such as the different stay time in front of different exhibits or whether to obtain digital media information. By locating the user's AR device and obtaining the user's tour route through intelligent recognition, the user's visit preferences can be obtained based on the exhibits visited on the user's tour route, and based on the importance of different exhibits and the relationship between exhibits, support can be provided for preloading of digital media information of exhibits. Specifically, the following can be achieved:

[0144] S7201a: Combines sensors, GPS, visual systems (AR glasses), and Wi-Fi networks (indoor environments of museums) on AR devices, mobile phones, etc. to obtain the current visitor's tour path;

[0145] S7201b: Analyze visitors’ attention to different exhibits based on the exhibits placed along the tour route ;

[0146] S7201c: Get the visitor's first Time spent in front of each exhibit ;

[0147] S7201d: Classifying the exhibits on the visiting path according to the exhibit relationship map. For example, the exhibits may be classified according to different properties, such as events related to the exhibits, exhibit types, etc.;

[0148] S7201e: Combine the visitor's extraction record of the digital media information of the exhibits on the visiting path, that is, the above data extraction information, to obtain the first attention of a certain type of exhibits:

[0149] ;

[0150] Among them, the above The function is a linear normalization function. Indicates the first The probability of information extraction of class exhibits, Indicates The amount of information extracted from the exhibits, Indicates Total number of exhibits in this category; Expressing the The average length of stay for exhibits of this type, Indicated in The first The length of time you spend in front of an exhibit.

[0151] S7201f: Identify the exhibits that visitors are currently visiting through the visual system of the AR device or the camera system of the mobile phone ;

[0152] S7201g: Determine the type of exhibits on the visitor's tour path based on the exhibit relationship map , calculate its close relationship coefficient ;

[0153] ;

[0154] Among them, the above The function is a linear normalization function. Display exhibits On display The shortest distance from the central node in the exhibit relationship graph; Display exhibits On display The number of node connections in the exhibit relationship graph.

[0155] S7201h: Calculate the visitor's second attention to the current exhibit , that is, calculate the average attention value of the exhibit category;

[0156] ;

[0157] S7202: Obtain the importance of digital media information content.

[0158] When preloading digital media information of exhibits, priority should be given to more important and comprehensive content, that is, priority should be given to accurate data that can summarize the exhibit information, so that visitors can more easily understand the background story of the exhibit. At the same time, in the preloading process, attention should also be paid to the external characteristics of different digital media information, such as the frequency of browsing of a certain information, the popularity of different digital media information, etc., and combined with these data, digital media information that is easier for visitors to receive can be selected to enhance their immersion in the visiting process.

[0159] Specifically, the above-mentioned acquisition of the importance of digital media information content can be achieved as follows:

[0160] S7202a: Acquisition of exhibits No. Frequency of access to relevant digital media information ;

[0161] S7202b: Acquisition of exhibits No. The rate of favorable comments on relevant digital media information ;

[0162] S7202c: Exhibits No. Specifically, the content richness of the relevant digital media is quantified; specifically, this step can be implemented as follows:

[0163] S7202c1: Get the The memory usage of digital media information , Information Depth , Update frequency , Information Diversity ;

[0164] S7202c2: For the Set weights for different dimensions of digital media information and obtain weights ;

[0165] It should be noted that since higher information depth can help users understand the importance and complexity of exhibits more deeply, and higher information diversity can provide richer sensory experience, therefore, information depth plays an important role in the above parameters. and information diversity The weight is higher. For example, the weight setting can be as follows: Weight ; Information depth Weight ; Update frequency Weight ; Information diversity Weight .

[0166] S7202c3: Computing Exhibits No. Content richness of relevant digital media ;

[0167] ;

[0168] S7202d: Computing Exhibits No. The importance of the content of relevant digital media .

[0169] ;

[0170] S7203: Obtain preloading priority of digital media information.

[0171] This step is used to combine the above-mentioned user's personalized information and the internal and external features of the exhibit information to obtain the preloading priority of an exhibit for the current visitor, selectively preload the data according to the preloading priority of different data, and temporarily cache the preloaded data in the database. Specifically, it can be implemented as follows:

[0172] S7203a: Calculate the proportion of visitors' visits to different types of digital media information, that is, the ratio of visits to different types of information to visits to total information ;

[0173] S7203b: According to the access proportion of different types of digital media information , corrected exhibits No. The importance of the content of relevant digital media ,get ;

[0174] ;

[0175] S7203c: According to the revised exhibits The importance of relevant digital media information content , sort them from large to small;

[0176] S7203d: Based on visitors’ opinions on the exhibits Possible attention , set the amount of preloaded data, that is, the higher the attention, the more preloaded data The more;

[0177] ;

[0178] in, Display exhibits The total amount of digital media information owned.

[0179] S7203e: According to the amount of preloaded data , pre-load the sorted digital media information in sequence.

[0180] S730: Transmission and display of the digital media information are realized based on the interaction between the user equipment and the server.

[0181] After the above steps are performed to preload the digital media information of the exhibits in front of the user and temporarily cache the preloaded data in the database, when the user uses interactive operations to obtain the digital media information of the current exhibits, the following steps can be performed to transmit and display the data:

[0182] S7301: A user accesses an exhibit through a mobile device or an AR device, triggering a data request;

[0183] S7302: After receiving the request, the server queries the preloaded data in the database and retrieves the requested data;

[0184] S7303: The server encapsulates the retrieved preloaded data into a response packet and prepares to send it;

[0185] S7304: Transmitting the preloaded data in the database to the user device via a local area network, a 5G network, etc.;

[0186] S7305: The user device receives the data and parses the digital media information in the user device;

[0187] S7306: Process the parsed data to adapt it to the user's mobile device. For example, for an AR application, a rendering engine overlays virtual information onto the real world.

[0188] S7307: Display the exhibit information on the user interface in the form of pictures, text, 3D models or videos;

[0189] S7308: Receive user interaction operations, such as clicking on an exhibit to view detailed information, or interacting with virtual content through AR.

[0190] In the above embodiments, on the one hand, by fusion transmission of digital media information and combining different forms of information with actual scenes or exhibits, for example, by overlaying video clips on specific historical sites through AR technology, or displaying relevant historical photos near exhibits, visitors are provided with a richer and more vivid visiting experience. On the other hand, by preloading digital media information that users may need according to their importance and user preferences, it is ensured that users can obtain the required information in the first place, while improving the efficiency of fusion transmission of digital media information, allowing users to obtain more personalized services.

[0191] It should be noted that although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0192] The embodiment of the present invention also provides a digital media information fusion transmission device, referring to Figure 8As shown, the digital media information fusion transmission device 800 may include an acquisition module 810, a determination module 820, a loading module 830 and a display module 840, wherein:

[0193] An acquisition module 810 is used to acquire a user's travel route in a target venue and determine a first degree of attention of the user to different object categories on the travel route;

[0194] A determination module 820 is used to obtain a target object within the current visual range of the user, and determine a second degree of attention of the user to the target object based on a first degree of attention of an object category to which the target object belongs;

[0195] The determination module 820 is further used to obtain digital media information of the target object and determine the importance of each digital media information of the target object;

[0196] A loading module 830, configured to determine preloading information of the target object based on the second attention level and the importance of each digital media information, and preload the object information of the target object based on the preloading information;

[0197] The display module 840 is used to display the object information of the target object to the user based on the preloaded information in response to the user's information request operation.

[0198] In addition, the specific implementation details of the above-mentioned digital media information fusion transmission device have been described in detail in the corresponding position of the digital media information fusion transmission method, so they will not be repeated here.

[0199] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0200] The embodiment of the present invention also provides a digital media information fusion transmission system, referring to Fig. 9 As shown, the digital media information fusion transmission system includes a user device and a server, wherein the server includes an acquisition unit, a determination unit, a loading unit and a display unit.

[0201] Exemplarily, the acquisition unit is used to acquire the user's route in the target venue and determine the user's first attention level to different object categories on the route; the determination unit is used to acquire the target object within the user's current field of vision and determine the user's second attention level to the target object based on the first attention level of the object category to which the target object belongs; and, to acquire digital media information of the target object and determine the importance of each piece of digital media information; the loading unit is used to determine the preloaded information of the target object based on the second attention level and the importance of each piece of digital media information, and preload the object information of the target object based on the preloaded information; and the display unit is used to display the object information of the target object to the user based on the preloaded information in response to the user's information request operation.

[0202] Exemplarily, the above-mentioned user device is used to send an information request operation to the server; and, to display the digital media information of the target object corresponding to the information request operation to the user; specifically, the process of the above-mentioned user device obtaining the pre-loaded digital media information of the target object through server interaction can be implemented as follows: the user accesses the exhibit through a mobile device or an AR device, triggering a data request; after receiving the request, the server queries the pre-loaded data in the database and retrieves the requested data; the server encapsulates the retrieved pre-loaded data into a response package and prepares to send it; the pre-loaded data in the database is transmitted to the user device through a local area network, a 5G network, etc.; the user device receives the data and parses the digital media information in the user's device; the parsed data is processed to adapt it to the user's mobile device, for example, for AR applications, the rendering engine superimposes virtual information on the real world; the exhibit information is displayed on the user interface in the form of pictures, text, 3D models or videos; user interaction operations are received, such as clicking on the exhibit to view detailed information, or interacting with virtual content through AR.

[0203] In addition, the specific implementation details of the above-mentioned digital media information fusion transmission system have been described in detail in the corresponding position of the digital media information fusion transmission method, so they will not be repeated here.

[0204] It should be noted that the sequence of the above embodiments of the present invention is for description only and does not represent the advantages and disadvantages of the embodiments. The processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0205] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

Claims

1. A digital media information fusion transmission method, characterized in that: The method comprises: Acquiring a user's travel route in a target venue, and determining the user's first attention level to different object categories on the travel route; Acquire a target object within the current visual range of the user, and determine a second degree of attention of the user to the target object based on the first degree of attention of the object category to which the target object belongs; Acquire digital media information of the target object, and determine the importance of each digital media information of the target object; Determining the preloading information of the target object based on the second attention level and the importance of each of the digital media information, and preloading the digital media information of the target object based on the preloading information; In response to the information request operation of the user, displaying the digital media information of the target object to the user based on the preloaded information; the method further includes: Obtaining object information of each object in the target site; Acquire association information between the objects, and establish an object relationship map based on the association information; The determining the first degree of attention of the user to different object categories on the travel route includes: Obtaining the length of time the user stays at each of the objects on the route; Determining the object category of each of the objects on the travel route according to the object relationship map; determining data extraction information for each of the object categories; Determining the first degree of attention of the user to the object category based on the data extraction information and the length of time the user stays at each of the objects in the object category; The determining, based on the first attention level of the object category to which the target object belongs, a second attention level of the user to the target object includes: Determining the object category to which the target object belongs based on the object relationship graph; Determine the correlation coefficient of the target object based on the position information and connection relationship of the target object in the object relationship map; The second degree of attention of the user to the target object is determined based on the association coefficient of the target object and the first degree of attention of the object category to which the target object belongs.

2. The digital media information fusion transmission method according to claim 1, characterized in that: The determining the importance of each digital media information includes: Obtaining access frequency, evaluation information and content information of each of the digital media information; the content information includes memory usage, information depth, update frequency and information diversity of the digital media information, and the information diversity is used to characterize the number of data types contained in the digital media information; determining the information richness of the digital media information based on the content information; The importance of the digital media information is determined based on the access frequency, the evaluation information, and the information richness.

3. The digital media information fusion transmission method according to claim 2, characterized in that: The determining the preloading information of the target object based on the second attention degree and the importance of each of the digital media information includes: Acquire the number of visits to the digital media information of different data types by the user, and determine a correction coefficient based on the number of visits to the digital media information of different data types by the user; Correcting the importance of the digital media information based on the correction coefficient; sorting the corrected importance of the digital media information, and determining the amount of preloaded data based on the second importance, to obtain the preloaded information; The preloading of the digital media information of the target object based on the preloading information includes: Based on the preloaded data amount, the digital media information is preloaded according to the ranking result of the importance of the digital media information.

4. The digital media information fusion transmission method according to any one of claims 1 to 3, characterized in that: The step of displaying the digital media information of the target object to the user based on the preloaded information in response to the information request operation of the user includes: In response to the information request operation of the user, the preloaded digital media information is sent to the user equipment of the user, so as to display the digital media information in the user equipment interface.

5. The digital media information fusion transmission method according to claim 4, characterized in that: The displaying of the digital media information in the user equipment interface includes: In response to an interaction operation performed by the user on the user equipment interface, the digital media information is presented to the user based on the interaction operation.

6. A digital media information fusion transmission device, characterized in that: The digital media information fusion transmission device is used to implement the digital media information fusion transmission method according to any one of claims 1 to 5, and the digital media information fusion transmission device includes: An acquisition module, used to acquire a user's travel route in a target site, and determine a first degree of attention of the user to different object categories on the travel route; a determination module, configured to obtain a target object within a current visual range of the user, and determine a second degree of attention of the user to the target object based on the first degree of attention of the object category to which the target object belongs; The determination module is further used to obtain the digital media information of the target object and determine the importance of each digital media information of the target object; a loading module, configured to determine the preloading information of the target object based on the second attention degree and the importance of each of the digital media information, and preload the digital media information of the target object based on the preloading information; A display module is used to display the digital media information of the target object to the user based on the preloaded information in response to the information request operation of the user.

7. A digital media information fusion transmission system, characterized in that: The digital media information fusion transmission system is used to implement the digital media information fusion transmission method according to any one of claims 1 to 5, and the digital media information fusion transmission system includes a user device and a server, and the server includes an acquisition unit, a determination unit, a loading unit and a display unit: The user equipment is used to send an information request operation to the server; and, displaying digital media information of a target object corresponding to the information request operation to the user; The acquisition unit is used to acquire a user's travel route in a target site, and determine the user's first attention degree to different object categories on the travel route; The determination unit is configured to obtain the target object within the current visual range of the user, and determine the second attention level of the user to the target object based on the first attention level of the object category to which the target object belongs; and obtain the digital media information of the target object and determine the importance level of each digital media information of the target object; The loading unit is used to determine the preloading information of the target object based on the second attention level and the importance of each of the digital media information, and preload the digital media information of the target object based on the preloading information; The display unit is used to display the digital media information of the target object to the user based on the preloaded information in response to the information request operation of the user.

Images