A data updating method and system for multi-source short videos
By updating the correlation mapping between storage space and short video data source database on the short video platform, the problem of reducing storage and recommendation efficiency caused by the surge in short video data is solved, and more efficient short video data management and recommendation effects are achieved.
Patent Information
- Application Number
- CN202411452429.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-17
- Publication Date
- 2025-02-18
- Estimated Expiration
- 2044-10-17
AI Technical Summary
With the surge in data volume of short video platforms, it is difficult for the existing technology to effectively manage the storage efficiency of short video data, resulting in slowing down storage and recommendation efficiency, and lag and recommendation flow.
By identifying that when the short video data source database stored on the short video platform occurs, the target customer group of the incremental short video data source is collected, the list of the associated mappings between the storage space and the short video data source database is updated, and the user is given based on the list. Short videos from short video shooting terminals are distributed.
It has achieved the rational management of short video data storage efficiency in the case of a surge in the amount of short video data, improve the targetedness and effectiveness of short video recommendations, and avoid lag and recommendation flow.
Smart Images

Figure CN118964666B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a data updating method and system for multi-source short videos. Background Art
[0002] There can be many specific services in short videos. For example, there can be a service for pushing recommended content. The server obtains the user's historical click records, determines the type of content that the user likes based on the historical click records, searches for content related to the type, and pushes the related content as recommended content to the terminal display interface for the user to browse.
[0003] At present, with the increase of a large number of short videos on short video platforms, the storage and recommendation efficiency of short videos often slows down. Due to the huge amount of data, freezes and streamlined recommendations often occur.
[0004] How to reasonably manage the storage efficiency of short video data and improve the pertinence and effectiveness of short video recommendations when the amount of short video data is exploding is a problem that needs to be urgently solved by existing technologies. Summary of the invention
[0005] To achieve the above objectives, this application provides the following technical solutions:
[0006] According to a first aspect of the present invention, the present invention claims protection for a data updating method for multi-source short videos, comprising:
[0007] When an increase in the short video data source library stored in the short video platform is identified, the target customer group of the incremental short video data source is collected;
[0008] Update the list of association mappings between storage space and short video data source library through the target customer group of the incremental short video data source;
[0009] The short videos that need to be uploaded by the user's short video shooting terminal are distributed through the updated list of association mappings between the storage space and the short video data source library.
[0010] Furthermore, the method for constructing a list of association mappings between the storage space and the short video data source library includes the following steps:
[0011] Post a query request;
[0012] Collecting the access load reported by each short video data source library connected to the short video platform, wherein the access load includes the storage space and the maximum number of visitors of the short video data source library;
[0013] The association mapping between the storage space and the short video data source library is obtained through the access load reported by each short video data source library.
[0014] Furthermore, the distribution of the short video to be uploaded by the user's short video shooting terminal through the association mapping between the updated storage space and the short video data source library includes:
[0015] When a newly recorded short video is collected, the newly recorded short video is decomposed to obtain multiple sub-short videos;
[0016] For any sub-short video, a short video data source library with storage space for the sub-short video is searched in the association mapping between the updated storage space and the short video data source library to obtain a short video data source library set; and the real-time maximum number of visitors status of each short video data source library in the short video data source library set is collected respectively; through the real-time maximum number of visitors status of each short video data source library in the short video data source library set, the short video data source library for the sub-short video is filtered out in the short video data source library set;
[0017] Traverse all sub-short videos and obtain the distributed short video data source library of each sub-short video.
[0018] Furthermore, the real-time maximum number of visitors status includes the real-time maximum number of parallel visitors and the proportion of the real-time maximum number of visitors; the real-time maximum number of visitors status of each short video data source library in the short video data source library set, filtering out the distribution short video data source library of the sub short video in the short video data source library set includes:
[0019] Filter out the candidate short video data source library with the highest number of real-time parallel visitors from the short video data source library;
[0020] When there is only one candidate short video data source library filtered out, the candidate short video data source library is used as the distribution short video data source library of the sub short video;
[0021] When there are multiple candidate short video data source libraries filtered out, the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is selected from the multiple candidate short video data source libraries, and the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is used as the distribution short video data source library of the sub-short video.
[0022] Furthermore, the short video to be uploaded by the user's short video shooting terminal is distributed through the updated list of association mappings between the storage space and the short video data source library, including:
[0023] After the adjustment instruction of the real-time sub-short video is collected, the maximum number of visitors required for the real-time sub-short video is collected;
[0024] In the association mapping between the updated storage space and the short video data source library, a short video data source library with storage space for the sub-short video is searched to obtain a short video data source library set; and the real-time maximum number of visitors status of each short video data source library in the short video data source library set is collected respectively; through the real-time maximum number of visitors status of each short video data source library in the short video data source library set and the maximum number of visitors requirement of the real-time sub-short video, the distribution short video data source library of the sub-short video is filtered out in the short video data source library set.
[0025] Furthermore, filtering out the distribution short video data source library of the sub-short video in the short video data source library set from the distribution short video data source library of the sub-short video in the short video data source library set includes:
[0026] Filter out the candidate short video data source library with the highest number of real-time parallel visitors from the short video data source library;
[0027] When there is only one candidate short video data source library filtered out, the filtered candidate short video data source library is used as the distribution short video data source library of the sub short video;
[0028] When there are multiple candidate short video data source libraries filtered out, the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is selected from the multiple candidate short video data source libraries, and the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is used as the distribution short video data source library of the real-time sub-short video;
[0029] Collect the first hotspot duration period of the short video data source library where the real-time short sub-video is located before translation;
[0030] The second hotspot duration period of the distribution short video data source library after the real-time sub-short video is translated to the distribution short video data source library is estimated through the real-time parallel maximum number of visitors of the distribution short video data source library and the maximum number of visitors of the real-time sub-short video;
[0031] When the duration period of the second hotspot is greater than that of the first hotspot, the real-time sub-short video is translated to the distributed short video data storage library.
[0032] Furthermore, the updating of the list of association mappings between the storage space and the short video data source library through the target customer group of the incremental short video data source includes:
[0033] Collecting identification information of an incremental short video data source and storage space of the incremental short video data source;
[0034] Using the identification information of the incremental short video data source and the storage space of the incremental short video data source to form an association mapping;
[0035] The list of association mappings between the storage space and the short video data source library is updated through the association mapping.
[0036] According to a second aspect of the present invention, the present invention claims protection for a data update system for multi-source short videos, comprising:
[0037] A collection unit, configured to collect a target customer group of the incremental short video data source when an incremental amount of the short video data source library stored in the short video platform is identified;
[0038] An updating unit, configured to update a list of association mappings between storage space and a short video data source library through a target customer group of the incremental short video data source;
[0039] A distribution unit, used to distribute the short videos that need to be uploaded by the user's short video shooting terminal through the updated list of association mappings between the storage space and the short video data source library;
[0040] The data update system for multi-source short videos is used to execute the data update method for multi-source short videos.
[0041] The present application relates to the field of data processing technology, and in particular to a data update method and system for multi-source short videos. When an increment is identified in a short video data source library stored in a short video platform, a target customer group of the incremental short video data source is collected; a list of association mappings between storage space and the short video data source library is updated through the target customer group of the incremental short video data source; and short videos that need to be uploaded by a user's short video shooting terminal are distributed through the updated list of association mappings between storage space and the short video data source library. The present invention is applied to major short video platforms, and can reasonably manage the storage efficiency of short video data in the case of a surge in the amount of short video data, thereby improving the pertinence and effectiveness of short video recommendations. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 A workflow diagram of a data updating method for multi-source short videos claimed in an embodiment of the present application;
[0043] Figure 2 A second workflow diagram of a data updating method for multi-source short videos claimed in an embodiment of the present application;
[0044] Figure 3 A third workflow diagram of a data updating method for multi-source short videos claimed in an embodiment of the present application;
[0045] Figure 4A fourth workflow diagram of a data updating method for multi-source short videos claimed in an embodiment of the present application;
[0046] Figure 5 A structural module diagram of a data update system for multi-source short videos as claimed in an embodiment of the present application. DETAILED DESCRIPTION
[0047] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0048] The terms "first", "second" and "third" in this application are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined as "first", "second" and "third" can explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "multiple" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined. All directional indications (such as up, down, left, right, front, back...) in the embodiments of this application are only used to explain the relative position relationship, movement, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication also changes accordingly. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices.
[0049] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or candidate embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0050] According to the first embodiment of the present invention, the present invention claims a data updating method for multi-source short videos, referring to Figure 1 ,include:
[0051] When an increase in the short video data source library stored in the short video platform is identified, the target customer group of the incremental short video data source is collected;
[0052] Update the list of association mappings between storage space and short video data source library through the target customer group of the incremental short video data source;
[0053] The short videos that need to be uploaded by the user's short video shooting terminal are distributed through the updated list of association mappings between the storage space and the short video data source library.
[0054] This embodiment is applied to a short video viewing platform, where the amount of short video data grows rapidly. Multiple databases are usually used to store and manage short videos of different types and for different customer groups.
[0055] In this embodiment, when an increment is detected in the short video data source library stored in the short video platform, it is generally obtained by uploading and identifying the short video after the short video shooting user shoots it;
[0056] When collecting the target customer group of the incremental short video data source, the increment is matched to the short video data source library of the target customer group through the storage content of the short video data source library stored on the short video platform and customer clustering;
[0057] For example, when it is identified that the incremental short videos are animations, the short video data source library corresponding to the target customer group is the children customer group;
[0058] The list of association mappings between the storage space and the short video data source library is updated through the target customer group of the incremental short video data source, indicating that there is an association relationship mapping between the short video data source library and the storage space of the target customer group, which is used to indicate the specific viewing short video content of a certain type of specific target customer, so as to facilitate subsequent updates and recommendations;
[0059] The short videos that need to be uploaded by the user's short video shooting terminal are distributed through the list of updated association mappings between the storage space and the short video data source library. This means that after the association relationship is established, video distribution recommendations can be made based on the association relationship mapping between the short video data source library and the storage space of the target customer group.
[0060] Further, refer to Figure 2 The method for constructing a list of association mappings between the storage space and the short video data source library comprises the following steps:
[0061] Post a query request;
[0062] Collecting the access load reported by each short video data source library connected to the short video platform, wherein the access load includes the storage space and the maximum number of visitors of the short video data source library;
[0063] The association mapping between the storage space and the short video data source library is obtained through the access load reported by each short video data source library.
[0064] Among them, in this embodiment, due to the limitation of the size of the storage space and the network performance, for the short video data source library to which different short videos are uploaded, a corresponding relationship needs to be established based on the specific number of visitors.
[0065] Further, refer to Figure 3 , the distribution of the short video to be uploaded by the user's short video shooting terminal through the association mapping between the updated storage space and the short video data source library includes:
[0066] When a newly recorded short video is collected, the newly recorded short video is decomposed to obtain multiple sub-short videos;
[0067] For any sub-short video, a short video data source library with storage space for the sub-short video is searched in the association mapping between the updated storage space and the short video data source library to obtain a short video data source library set; and the real-time maximum number of visitors status of each short video data source library in the short video data source library set is collected respectively; through the real-time maximum number of visitors status of each short video data source library in the short video data source library set, the short video data source library for the sub-short video is filtered out in the short video data source library set;
[0068] Traverse all sub-short videos and obtain the distributed short video data source library of each sub-short video.
[0069] Among them, in this embodiment, decomposing the newly recorded short video to obtain multiple sub-short videos is generally aimed at short videos with multiple sub-items of a collective nature. For example, the short video of "Top Ten Golden Songs of the Year" can be divided into ten sub-short videos.
[0070] Furthermore, the real-time maximum number of visitors status includes the real-time maximum number of parallel visitors and the proportion of the real-time maximum number of visitors; the real-time maximum number of visitors status of each short video data source library in the short video data source library set, filtering out the distribution short video data source library of the sub short video in the short video data source library set includes:
[0071] Filter out the candidate short video data source library with the highest number of real-time parallel visitors from the short video data source library;
[0072] When there is only one candidate short video data source library filtered out, the candidate short video data source library is used as the distribution short video data source library of the sub short video;
[0073] When there are multiple candidate short video data source libraries filtered out, the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is selected from the multiple candidate short video data source libraries, and the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is used as the distribution short video data source library of the sub-short video.
[0074] Furthermore, the short video to be uploaded by the user's short video shooting terminal is distributed through the updated list of association mappings between the storage space and the short video data source library, including:
[0075] After the adjustment instruction of the real-time sub-short video is collected, the maximum number of visitors required for the real-time sub-short video is collected;
[0076] In the association mapping between the updated storage space and the short video data source library, a short video data source library with storage space for the sub-short video is searched to obtain a short video data source library set; and the real-time maximum number of visitors status of each short video data source library in the short video data source library set is collected respectively; through the real-time maximum number of visitors status of each short video data source library in the short video data source library set and the maximum number of visitors requirement of the real-time sub-short video, the distribution short video data source library of the sub-short video is filtered out in the short video data source library set.
[0077] Furthermore, filtering out the distribution short video data source library of the sub-short video in the short video data source library set from the distribution short video data source library of the sub-short video in the short video data source library set includes:
[0078] Filter out the candidate short video data source library with the highest number of real-time parallel visitors from the short video data source library;
[0079] When there is only one candidate short video data source library filtered out, the filtered candidate short video data source library is used as the distribution short video data source library of the sub short video;
[0080] When there are multiple candidate short video data source libraries filtered out, the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is selected from the multiple candidate short video data source libraries, and the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is used as the distribution short video data source library of the real-time sub-short video;
[0081] Collect the first hotspot duration period of the short video data source library where the real-time short sub-video is located before translation;
[0082] The second hotspot duration period of the distribution short video data source library after the real-time sub-short video is translated to the distribution short video data source library is estimated by using the real-time parallel maximum number of visitors of the distribution short video data source library and the maximum number of visitors of the real-time sub-short video;
[0083] When the duration period of the second hotspot is greater than that of the first hotspot, the real-time sub-short video is translated to the distributed short video data storage library.
[0084] Further, refer to Figure 4 , the list of association mappings between the storage space and the short video data source library is updated through the target customer group of the incremental short video data source, including:
[0085] Collecting identification information of an incremental short video data source and storage space of the incremental short video data source;
[0086] Using the identification information of the incremental short video data source and the storage space of the incremental short video data source to form an association mapping;
[0087] The list of association mappings between the storage space and the short video data source library is updated through the association mapping.
[0088] According to the second embodiment of the present invention, the present invention claims a data update system for multi-source short videos, referring to Figure 5 ,include:
[0089] A collection unit, configured to collect a target customer group of the incremental short video data source when an incremental amount of the short video data source library stored in the short video platform is identified;
[0090] An updating unit, configured to update a list of association mappings between storage space and a short video data source library through a target customer group of the incremental short video data source;
[0091] A distribution unit, used to distribute the short videos that need to be uploaded by the user's short video shooting terminal through the updated list of association mappings between the storage space and the short video data source library;
[0092] The data update system for multi-source short videos is used to execute the data update method for multi-source short videos.
[0093] In the several embodiments provided in the present application, it should be understood that the disclosed systems, systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of systems or units, which can be electrical, mechanical or other forms.
[0094] In addition, each functional unit in each embodiment of the present application can be integrated into an upload unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. The above is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the specification and drawings of this application, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.
[0095] The specific implementation methods of the invention are described in detail above, but they are only examples, and the present application is not limited to the specific implementation methods described above. For those skilled in the art, any equivalent modification or substitution of the invention is also within the scope of the present application, and therefore, the equalization, modification, and improvement made without departing from the spirit and principle of the present application should be included in the scope of the present application.
Claims
1. A data updating method for multi-source short videos, characterized in that: include: When an increase in the short video data source library stored in the short video platform is identified, the target customer group of the incremental short video data source is collected; Update the list of association mappings between storage space and short video data source library through the target customer group of the incremental short video data source; The short videos that need to be uploaded by the user's short video shooting terminal are distributed through the updated list of association mappings between the storage space and the short video data source library; The method for constructing a list of association mappings between the storage space and the short video data source library comprises the following steps: Post a query request; Collecting the access load reported by each short video data source library connected to the short video platform, wherein the access load includes the storage space and the maximum number of visitors of the short video data source library; Obtaining an association mapping between the storage space and the short video data source library through the access load reported by each short video data source library; The distributing of the short videos to be uploaded by the user's short video shooting terminal through the updated list of association mappings between the storage space and the short video data source library includes: After the adjustment instruction of the real-time sub-short video is collected, the maximum number of visitors required for the real-time sub-short video is collected; In the association mapping between the updated storage space and the short video data source library, a short video data source library with storage space for the sub-short video is searched to obtain a short video data source library set; and the real-time maximum number of visitors status of each short video data source library in the short video data source library set is collected respectively; through the real-time maximum number of visitors status of each short video data source library in the short video data source library set and the maximum number of visitors requirement of the real-time sub-short video, the distribution short video data source library of the sub-short video is filtered out in the short video data source library set; According to the real-time maximum number of visitors status of each short video data source library in the short video data source library set and the maximum number of visitors requirement of the real-time sub-short video, filtering out the distribution short video data source library of the sub-short video in the short video data source library set includes: Filter out the candidate short video data source library with the highest number of real-time parallel visitors from the short video data source library; When there is only one candidate short video data source library filtered out, the filtered candidate short video data source library is used as the distribution short video data source library of the sub short video; When there are multiple candidate short video data source libraries filtered out, the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is selected from the multiple candidate short video data source libraries, and the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is used as the distribution short video data source library of the real-time sub-short video; Collect the first hotspot duration period of the short video data source library where the real-time short sub-video is located before translation; The second hotspot duration period of the distribution short video data source library after the real-time sub-short video is translated to the distribution short video data source library is estimated through the real-time parallel maximum number of visitors of the distribution short video data source library and the maximum number of visitors of the real-time sub-short video; When the duration period of the second hotspot is greater than the duration period of the first hotspot, the real-time sub-short video is translated to the distributed short video data source library; The updating of the list of association mappings between the storage space and the short video data source library through the target customer group of the incremental short video data source includes: Collecting identification information of an incremental short video data source and storage space of the incremental short video data source; Using the identification information of the incremental short video data source and the storage space of the incremental short video data source to form an association mapping; The list of association mappings between the storage space and the short video data source library is updated through the association mapping.
2. The method according to claim 1, characterized in that The distribution of the short video to be uploaded by the user's short video shooting terminal through the association mapping between the updated storage space and the short video data source library includes: When a newly recorded short video is collected, the newly recorded short video is decomposed to obtain multiple sub-short videos; For any sub-short video, a short video data source library with storage space for the sub-short video is searched in the association mapping between the updated storage space and the short video data source library to obtain a short video data source library set; and the real-time maximum number of visitors status of each short video data source library in the short video data source library set is collected respectively; through the real-time maximum number of visitors status of each short video data source library in the short video data source library set, the short video data source library for the sub-short video is filtered out in the short video data source library set; Traverse all sub-short videos and obtain the distributed short video data source library of each sub-short video.
3. The method according to claim 2, characterized in that The real-time maximum number of visitors status includes the real-time parallel maximum number of visitors and the proportion of the real-time maximum number of visitors; the real-time maximum number of visitors status of each short video data source library in the short video data source library set, filtering out the distribution short video data source library of the sub short video in the short video data source library set includes: Filter out the candidate short video data source library with the highest number of real-time parallel visitors from the short video data source library; When there is only one candidate short video data source library filtered out, the candidate short video data source library is used as the distribution short video data source library of the sub short video; When there are multiple candidate short video data source libraries filtered out, the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is selected from the multiple candidate short video data source libraries, and the candidate short video data source library with the lowest proportion of the maximum number of real-time visitors is used as the distribution short video data source library of the sub-short video.
4. A data update system for multi-source short videos, characterized in that: include: A collection unit, configured to collect a target customer group of the incremental short video data source when an incremental amount of the short video data source library stored in the short video platform is identified; An updating unit, configured to update a list of association mappings between storage space and a short video data source library through a target customer group of the incremental short video data source; A distribution unit, used to distribute the short videos that need to be uploaded by the user's short video shooting terminal through the updated list of association mappings between the storage space and the short video data source library; The data update system for multi-source short videos is used to execute the method described in any one of claims 1-3.
Citation Information
Patent Citations
System and method of distributing tokens
CA3012211A1
General data source access method and device for composite data item tag
CN110347739A