Video abstract internet-of-things data distributed storage method and system

Abstract

The invention discloses a distributed storage method and system for video abstract Internet of Things data, and the method comprises the steps: obtaining the access amount of each piece of video abstract Internet of Things data in a first storage server, sorting each piece of video abstract Internet of Things data according to the access amount, and obtaining hot video abstract Internet of Things data; obtaining an internet protocol address of each access user of the hotspot video abstract Internet of Things data, and sorting the internet protocol addresses according to the number of the access users corresponding to the internet protocol addresses to obtain a hotspot user area; and determining a geographic position corresponding to the hotspot user area, selecting a server of the corresponding area as a second storage server for distributed storage according to the geographic position, storing the hotspot video abstract Internet of Things data to the second storage server, and updating an index table for accessing the hotspot video abstract Internet of Things data. According to the invention, the distributed storage and access mechanism of the video abstract Internet of Things data can be optimized, and the access efficiency of the user is improved.

Description

Technical Field

[0001] This invention belongs to the field of distributed storage technology, specifically relating to a method and system for distributed storage of video summarization IoT data. Background Technology

[0002] With the development of big data and artificial intelligence (AI), the Internet of Things (IoT) is showing an AIoT trend, and IoT infrastructure is gradually becoming the next generation of information infrastructure. A crucial aspect of this is the collection, storage, analysis, mining, and intelligent application of video summarization IoT data generated by IoT infrastructure. However, due to the high-concurrency writing, time-series characteristics, and heterogeneous devices of video summarization IoT data, traditional centralized storage architectures are unable to meet the demands of video summarization IoT data in terms of scalability, fault tolerance, and cost efficiency.

[0003] Therefore, it is necessary to provide improved technical solutions to overcome the above-mentioned technical problems existing in the prior art. Summary of the Invention

[0004] The purpose of this application is to provide a method and system for distributed storage of video summary IoT data. By real-time statistics on the access volume and user regional distribution of video summary IoT data, the system can dynamically migrate video summary IoT data, optimize the distributed storage and access mechanism of video summary IoT data, and improve the efficiency of user access to video summary IoT data.

[0005] To achieve the above objectives: In a first aspect, embodiments of this application provide a method for distributed storage of video summary IoT data, including: The access volume of each video summary IoT data in the first storage server is obtained, and each video summary IoT data is sorted according to the access volume to obtain hot video summary IoT data. Obtain the Internet Protocol address of each accessing user of the hot video summary IoT data, and sort the Internet Protocol addresses according to the number of accessing users corresponding to the Internet Protocol addresses to obtain the hot user area; Determine the geographical location corresponding to the hotspot user area, select a server in the corresponding region as a second storage server for distributed storage based on the geographical location, store the hotspot video summary IoT data in the second storage server, and update the index table used to access the hotspot video summary IoT data.

[0006] In one embodiment, before obtaining the access volume of each video summary IoT data in the first storage server, the method further includes: Acquire real-time video image data and analyze abnormal events in the real-time video image data; If the abnormal event is determined to exist, video summary IoT data corresponding to the abnormal event is generated and stored in the first storage server.

[0007] In one embodiment, generating the video summary IoT data corresponding to the abnormal event includes: Generate at least one of the following video summary IoT data: summary sequence number, video clip, video screenshot, video summary, original video sequence number, camera sequence number, and recording time.

[0008] In one embodiment, after acquiring the video summary IoT data corresponding to the abnormal event, the method further includes: Generate an index table for accessing the video summary IoT data. The index table includes at least one of the following: summary serial number, video screenshot, video summary IoT data storage server serial number, video summary IoT data storage server Internet Protocol address, camera serial number, camera name, camera geographical location, abnormal event type, original video serial number, and original video storage path. In one embodiment, the method further includes: In response to the user obtaining the index table of the video summary IoT data, user identification is performed; If the user is identified as a member, the user will be added to a multicast group, and the index table of the video summary IoT data will be sent directly through the multicast group.

[0009] In one embodiment, prior to performing user identification, the method further includes: Obtain the corresponding user permissions and perform permission calculations.

[0010] In one embodiment, adding the user to the multicast group includes: The user is added to a multicast group to obtain the storage server address and storage path of the video summary IoT data in real time.

[0011] Secondly, embodiments of this application provide a system for distributed storage of video summary IoT data, comprising: The video summary IoT data acquisition module is used to acquire the access volume of each video summary IoT data in the first storage server, and sort each video summary IoT data according to the access volume to obtain hot video summary IoT data. The user area acquisition module is used to acquire the Internet Protocol address of each accessing user of the hot video summary IoT data, and sort the Internet Protocol addresses according to the number of accessing users corresponding to the Internet Protocol addresses to obtain the hot user areas. The migration storage module is used to determine the geographical location corresponding to the hotspot user area, select a server in the corresponding region as a second storage server for distributed storage based on the geographical location, store the hotspot video summary IoT data in the second storage server, and update the index table used to access the hotspot video summary IoT data.

[0012] In one embodiment, the system further includes a management server.

[0013] This application provides a method and system for distributed storage of video summarizing IoT data. The method includes: obtaining the access volume of each video summarizing IoT data in a first storage server, and sorting each video summarizing IoT data according to the access volume to obtain hot video summarizing IoT data; obtaining the Internet Protocol address (IPA) of each user accessing the hot video summarizing IoT data, and sorting the IPA according to the number of users corresponding to the IPA to obtain hot user regions; determining a second storage server for distributed storage based on the hot user regions, and storing the hot video summarizing IoT data in the second storage server. This application dynamically migrates video summarizing IoT data by real-time statistics of access volume and user region distribution, thereby optimizing the distributed storage and access mechanism of video summarizing IoT data and improving the efficiency of user access to video summarizing IoT data. Attached Figure Description

[0014] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is a flowchart illustrating a method for distributed storage of video summary IoT data provided in an embodiment of the present invention.

[0016] Figure 2 This is a schematic diagram of the structure of a distributed storage system for video summarization IoT data provided in an embodiment of the present invention. Detailed Implementation

[0017] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of systems and methods consistent with some aspects of this application as detailed in the appended claims.

[0018] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element. Furthermore, components, features, and elements with the same names in different embodiments of this application may have the same meaning or different meanings, the specific meaning of which must be determined by its interpretation in that specific embodiment or further in conjunction with the context of that specific embodiment.

[0019] It should be understood that although the terms first, second, third, etc., may be used herein to describe various information, such information should not be limited to these terms. These terms are used only to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if," as used herein, can be interpreted as "when," "when," or "in response to determination." Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to also include the plural forms unless the context indicates otherwise. It should be further understood that the terms "comprising," "including," indicate the presence of the stated feature, step, operation, element, component, item, kind, and / or group, but do not exclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, kinds, and / or groups. The terms "or" and "and / or" as used herein are to be interpreted as inclusive, or mean any one or any combination thereof. Therefore, "A, B, or C" or "A, B, and / or C" means "any one of the following: A; B; C; A and B; A and C; B and C; A, B, and C". Exceptions to this definition will only occur if the combination of elements, functions, steps, or operations is inherently mutually exclusive in some way.

[0020] It should be understood that although the steps in the flowcharts of this application's embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0021] It should be noted that step designations such as S110 and S120 are used in this document for the purpose of more clearly and concisely describing the corresponding content, and do not constitute a substantial limitation on the order. In specific implementation, those skilled in the art may execute S120 first and then S110, etc., but these should all be within the protection scope of this application.

[0022] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0023] In the relevant embodiments of this application, video summary IoT data generated from agricultural video image data is used as an example for illustration, and will not be repeated hereafter.

[0024] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustration and has no specific meaning in itself. Therefore, "module," "part," or "unit" may be used interchangeably.

[0025] See Figure 1 This application provides a method for distributed storage of video summarizing IoT data. This method can be executed by a system for distributed storage of video summarizing IoT data provided in this application. This system can be implemented using software and / or hardware. In this embodiment, the system for distributed storage of video summarizing IoT data is taken as the executing entity. The method for distributed storage of video summarizing IoT data provided in this embodiment includes the following steps: Step S110: Obtain the access volume of each video summary IoT data in the first storage server, and sort each video summary IoT data according to the access volume to obtain hot video summary IoT data.

[0026] It is understandable that the real-time generated video summary IoT data is stored in the local first storage server. However, the users who frequently access the data may not be located in the region to which the first storage server belongs (for example, the users who frequently access the data may be from the first region, and similar hot events may occur in the first region, causing users in the first region to pay attention to similar hot events, while the first storage server is located in the second region). This will cause a large number of cross-regional accesses to the video summary IoT data, and the response speed of cross-regional access will directly affect the user's access experience.

[0027] Specifically, based on the information in the user access information, the access volume of each video summary IoT data and the corresponding user's location are statistically analyzed in real time to generate hot video summary IoT data. For example, the top ten video summary IoT data in terms of access volume are selected as hot video summary IoT data.

[0028] In one embodiment, before obtaining the access volume of each video summary IoT data in the first storage server, the method further includes: The system acquires real-time video image data and analyzes any abnormal events within it. If an abnormal event is identified, it generates corresponding video summary IoT data and stores it in the first storage server.

[0029] It is understood that agricultural video image data captured by smart IoT terminal cameras is pushed to the first storage server for storage and recording of the original video index. The agricultural video image data is then analyzed in real time using artificial intelligence analysis algorithms. When a specific farmland event is detected (e.g., crop sowing, spraying pesticides, fertilizing, harvesting, picking, wind-blown lodging, burning straw, etc.), video summary IoT data corresponding to the agricultural event is generated and written to the first storage server.

[0030] In one implementation, generating video summary IoT data corresponding to the abnormal event includes: Generate at least one of the following video summary IoT data: summary sequence number, video clip, video screenshot, video summary, original video sequence number, camera sequence number, and recording time.

[0031] It is understandable that video segments (e.g., the first 10 seconds of the video segment) where the abnormal event occurred, video screenshots (e.g., a screenshot during the abnormal event), video summaries (a simplified video segment of the entire abnormal event after removing redundant frames), original video sequence numbers, camera sequence numbers, and recording times are extracted to generate video summary IoT data.

[0032] In one embodiment, after acquiring the video summary IoT data corresponding to the abnormal event, the method further includes: Generate an index table for accessing video summary IoT data. The index table includes at least one of the following: summary serial number, video screenshot, video summary IoT data storage server serial number, video summary IoT data storage server Internet Protocol address, camera serial number, camera name, camera geographical location, abnormal event type, original video serial number, and original video storage path. It is understandable that relevant information from video summary IoT data is extracted and recorded in an index table. This index table includes the summary sequence number, video screenshot, video summary IoT data storage server sequence number, video summary IoT data storage server Internet Protocol address, camera sequence number, camera name, camera geographical location, abnormal event type (e.g., crop sowing, spraying, fertilizing, harvesting, picking, wind-blown lodging, burning straw, etc.), original video sequence number, and original video storage path.

[0033] In one embodiment, it further includes: In response to a user retrieving an index table of video summary IoT data, user identification is performed; if the user is identified as a member, the user is added to a multicast group, and the index table of video summary IoT data is sent directly through the multicast group.

[0034] It is understandable that users accessing trending video summary IoT data need to first obtain the Internet Protocol address and storage path of the summary storage server, increasing service bottlenecks and processing latency, directly impacting the user experience. This application addresses this by dividing users into regular users and VIP users based on their access levels, adding VIP users to specific multicast groups (e.g., via DHCP or static configuration), and automatically receiving multicast traffic. This allows VIP users to directly receive updates to trending video summary IoT data through the multicast group and automatically join the multicast group to obtain the storage server address and storage path of the video summary IoT data in real time, reducing relay latency and improving access efficiency.

[0035] In one embodiment, prior to user identification, the method further includes: Obtain the corresponding user permissions and perform permission calculations.

[0036] It is understandable that the management department determines and conducts evaluations based on internal management plans, identifying specific users (such as supervisors and managers) and users with higher access scores as member users.

[0037] Preferably, member users can log in to a designated client to receive multicast address update instructions, and join a new multicast group according to the new multicast address, port number, and other information in the instructions, while simultaneously updating the multicast address, port number, and other information recorded locally. During the compatibility period of reserving the old address, member users can continue to receive data by listening to the old multicast address. After the switch is completed, they will automatically receive data packets from the new address, ensuring data continuity.

[0038] Furthermore, when a member user logs out, the multicast forwarding rules on the user's port are cleared via the switch management interface (such as SNMP / NetConf), reducing network resource consumption. Additionally, the system can query the management server for currently valid multicast addresses every minute; if a locally monitored address is found to be invalid, the user automatically leaves the old multicast group and joins a new one.

[0039] Step S120: Obtain the Internet Protocol address of each accessing user of the hot video summary IoT data, and sort the Internet Protocol addresses according to the number of accessing users corresponding to the Internet Protocol addresses to obtain the hot user area.

[0040] It is understandable that the number of users in the region to which the user accessed the video summary is statistically analyzed based on IoT data, and then sorted by the number of users in the region from largest to smallest. The region corresponding to the largest number of users in a user's region is the hot user region.

[0041] Step S130: Determine the geographical location corresponding to the hotspot user area, select the server in the corresponding region as the second storage server for distributed storage based on the geographical location, store the hotspot video summary IoT data in the second storage server, and update the index table used to access the hotspot video summary IoT data.

[0042] It is understandable that the storage server corresponding to the hotspot user area, obtained by combining the hotspot user area with the IP address matching method, is designated as the second storage server. Preferably, the storage server corresponding to the area where the user accessing the hotspot video summary IoT data is located is determined as the second storage server.

[0043] In one embodiment, adding the user to the multicast group includes: The user is added to a multicast group to obtain the storage server address and storage path of the video summary IoT data in real time.

[0044] It's understandable that by using an Internet Protocol (IP) geolocation database or an online Application Programming Interface (API), an Internet address can be resolved into a general city or region, thus obtaining the corresponding geographical location. By using the semi-versus-sine values ​​of the latitude and longitude coordinates of each hotspot user's region and the addresses of all storage servers, the storage server corresponding to the minimum value is the second closest storage server.

[0045] Furthermore, after storing the hot video summary IoT data in the second storage server, the video summary IoT data and related information are extracted, and the corresponding index table is updated. Specifically, the video summary IoT data storage server serial number and video summary IoT data storage server Internet Protocol address in the index table are updated according to the second storage server.

[0046] In summary, the implementation method of this application automatically detects agricultural events based on artificial intelligence algorithms, extracts relevant information from video summaries, and counts the access volume and user regional distribution of video summary IoT data in real time, thereby dynamically migrating video summary IoT data, optimizing the distributed storage and access mechanism of video summary IoT data, and improving the efficiency of user access to video summary IoT data by combining multicast notification to member users.

[0047] Based on the first embodiment of this application, a system for distributed storage of video summarizing IoT data is provided in this embodiment, see reference. Figure 2 The system includes: The video summary IoT data acquisition module 21 is used to acquire the access volume of each video summary IoT data in the first storage server, and sort each video summary IoT data according to the access volume to obtain hot video summary IoT data.

[0048] User area acquisition module 22 is used to acquire the Internet Protocol address of each accessing user of hot video summary IoT data, and sort the Internet Protocol addresses according to the number of accessing users corresponding to the Internet Protocol addresses to obtain the hot user areas.

[0049] The migration storage module 23 is used to determine the geographical location corresponding to the hot user area, select the server in the corresponding region as the second storage server for distributed storage based on the geographical location, store the hot video summary IoT data in the second storage server, and update the index table used to access the hot video summary IoT data.

[0050] In one embodiment, the system also includes a management server.

[0051] It should be noted that the description of the system aspect of the video summarizing IoT data distributed storage above is similar to the description of the method aspect of the video summarizing IoT data distributed storage above. The beneficial effects of the same method will not be repeated. For technical details not disclosed in the system aspect of the video summarizing IoT data distributed storage embodiment of the present invention, please refer to the description of the method aspect of the video summarizing IoT data distributed storage embodiment of the present invention.

[0052] In this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions are generally described in detail only when they appear for the first time. When they appear again, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, the same or similar terms, concepts, technical solutions and / or application scenario descriptions that are not described in detail later can be referred to their previous relevant detailed descriptions.

[0053] In this application, the descriptions of the various embodiments have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0054] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0055] The above description is merely a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. For those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for distributed storage of video summarization IoT data, characterized in that, The method includes: The access volume of each video summary IoT data in the first storage server is obtained, and each video summary IoT data is sorted according to the access volume to obtain hot video summary IoT data. Obtain the Internet Protocol address of each accessing user of the hot video summary IoT data, and sort the Internet Protocol addresses according to the number of accessing users corresponding to the Internet Protocol addresses to obtain the hot user area; Determine the geographical location corresponding to the hotspot user area, select a server in the corresponding region as a second storage server for distributed storage based on the geographical location, store the hotspot video summary IoT data in the second storage server, and update the index table used to access the hotspot video summary IoT data.

2. The method for distributed storage of video summarization IoT data according to claim 1, characterized in that, Before obtaining the access volume of each video summary IoT data in the first storage server, the method further includes: Acquire real-time video image data and analyze abnormal events in the real-time video image data; If the abnormal event is determined to exist, video summary IoT data corresponding to the abnormal event is generated and stored in the first storage server.

3. The method for distributed storage of video summarization IoT data according to claim 2, characterized in that, The IoT data for generating the video summary corresponding to the abnormal event includes: Generate at least one of the following video summary IoT data: summary sequence number, video clip, video screenshot, video summary, original video sequence number, camera sequence number, and recording time.

4. The method for distributed storage of video summarization IoT data according to claim 3, characterized in that, After obtaining the video summary IoT data corresponding to the abnormal event, the method further includes: Generate an index table for accessing the video summary IoT data. The index table includes at least one of the following: summary serial number, video screenshot, video summary IoT data storage server serial number, video summary IoT data storage server Internet Protocol address, camera serial number, camera name, camera geographical location, abnormal event type, original video serial number, and original video storage path.

5. The method for distributed storage of video summarization IoT data according to claim 4, characterized in that, The method further includes: In response to the user obtaining the index table of the video summary IoT data, user identification is performed; If the user is identified as a member, the user will be added to a multicast group, and the index table of the video summary IoT data will be sent directly through the multicast group.

6. The method for distributed storage of video summarization IoT data according to claim 5, characterized in that, Prior to user identification, the following is also included: Obtain the corresponding user permissions and perform permission calculations.

7. The method for distributed storage of video summarization IoT data according to claim 5, characterized in that, Adding the user to the multicast group includes: The user is added to a multicast group to obtain the storage server address and storage path of the video summary IoT data in real time.

8. A system for distributed storage of video summarization IoT data, characterized in that, The system includes: The video summary IoT data acquisition module is used to acquire the access volume of each video summary IoT data in the first storage server, and sort each video summary IoT data according to the access volume to obtain hot video summary IoT data. The user area acquisition module is used to acquire the Internet Protocol address of each accessing user of the hot video summary IoT data, and sort the Internet Protocol addresses according to the number of accessing users corresponding to the Internet Protocol addresses to obtain the hot user areas. The migration storage module is used to determine the geographical location corresponding to the hotspot user area, select a server in the corresponding region as a second storage server for distributed storage based on the geographical location, store the hotspot video summary IoT data in the second storage server, and update the index table used to access the hotspot video summary IoT data.

9. The system for distributed storage of video summarization IoT data according to claim 8, characterized in that, The system also includes a management server.

Images