Data management method, data management system and equipment
By building a distributed storage cluster in the fiber optic access network and utilizing a cluster of devices formed by multiple gateway devices, the problems of insufficient storage capacity and complex configuration of home NAS devices are solved, achieving efficient, secure, and low-cost data management, and improving user experience and network performance.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2026-03-10
AI Technical Summary
Existing home NAS devices suffer from insufficient storage capacity and data read/write capabilities, complex and costly configurations, and high power consumption when online for extended periods, failing to meet users' needs for convenient and efficient data storage.
In a fiber optic access network, a distributed storage cluster is built, which is formed by multiple gateway devices. The network-attached storage function is configured, and the data view information of the first gateway device is managed by the second gateway device, so as to achieve efficient data storage and access, avoid direct configuration of NAS devices, and reduce user operation complexity and cost.
It enables efficient and flexible data storage and access, improves data transmission performance and computing power, reduces the security risks exposed to devices, reduces user operation complexity and cost, and meets the needs of a high-speed, stable, and fully covered network environment.
Smart Images

Figure CN121644583A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of optical fiber communication technology, and in particular to a data management method, a data management system, and a device. Background Technology
[0002] With the increasing richness of digital life, users' multimedia data such as photos and videos are growing rapidly, making the demand for convenient and efficient data storage and access more and more urgent. Against this backdrop, network attached storage (NAS), as a core component of the home data center, is becoming increasingly important. Home NAS devices not only have embedded dedicated operating systems, such as embedded Linux, but also occupy a dedicated local area network (LAN) node, enabling users to read and store data by providing network file service protocols.
[0003] However, existing lightweight NAS devices have limited capabilities (storage capacity and data read / write capabilities), while high-configuration NAS devices, although capable of meeting user needs, have many drawbacks, such as high cost and complex configuration (e.g., configuring the NAS's IP address, network interface, network protocol, firewall, etc.). Furthermore, NAS devices, being devices that are constantly online, also suffer from high power consumption. Summary of the Invention
[0004] This application provides a data management method, a data management system, and a device, offering a network-attached storage solution that meets storage requirements without the drawbacks of high cost and complex configuration.
[0005] To achieve the above objectives, this application adopts the following technical solution:
[0006] Firstly, this application provides a data management method applied to an optical fiber access network. The optical fiber access network includes multiple first gateway devices and at least one second gateway device. The multiple first gateway devices are used to store data from terminal devices within the optical fiber access network. The at least one second gateway device is used to store view information of the data stored in the multiple first gateway devices. The method is executed by the second gateway device. Specifically, the method includes: firstly, receiving a first request from a terminal device, the first request requesting view information of first data, wherein the view information is a virtual mapping of the data in the first gateway devices onto the second gateway device; the first data is stored in at least one first gateway device. Then, in response to the first request, returning the view information of the first data to the terminal device. The view information of the first data is used by the terminal device to perform preset data operations on the first data, and the view information of the first data can be metadata corresponding to the first data. The preset data operations can be data deletion operations, data writing operations, data acquisition operations, etc.
[0007] As can be seen from the above, based on the characteristic of existing fiber optic access networks where multiple gateway devices form a device cluster, configuring network-attached storage functionality for each gateway device enables multiple gateway devices to form a distributed storage cluster. On the one hand, it eliminates the need for additional NAS devices, achieving network-attached storage functionality while omitting the user's NAS network configuration process, reducing user operational complexity and equipment costs. On the other hand, it fully utilizes the resources of each gateway device, achieving a significant improvement in data transmission performance and computing power. Compared to implementing network-attached storage functionality with a single NAS node, distributed storage clusters can better handle scenarios with large data volumes and high concurrency, providing users with a smoother and more efficient network experience. Furthermore, fiber optic access networks use fiber optic cables directly to rooms or areas. Compared to traditional networking methods, the fiber optic access network in this application has advantages such as high speed, stability, full coverage, and high scalability, significantly improving the user's network experience and meeting the urgent needs of families for a high-speed, stable, and fully covered network environment.
[0008] In one possible implementation, the preset data operation includes a data acquisition operation; the view information of the first data includes the storage location information of the first data, and the storage location information is used by the terminal device to send a data request to the first gateway device, the data request being used by the terminal device to request the first gateway device to return the first target data in the first data.
[0009] In this implementation, the view information of the first data contains the storage location information of the first data. Through this view information, the terminal device can quickly locate the data, which greatly reduces the time for data retrieval and location. At the same time, the terminal device directly accesses the required data through the first gateway device without involving data forwarding between multiple devices, which improves the overall efficiency of data access, significantly shortens the user's waiting time, and enhances user experience satisfaction.
[0010] In one possible implementation, the view information of the data includes the storage location information of the data, and the preset data operation includes a data acquisition operation; the method further includes: receiving the data acquisition operation of the terminal device; the data acquisition operation is used to indicate the acquisition of the first target data in the first data; in response to the data acquisition operation, the first target data is acquired from the first gateway device where the first target data is located according to the storage location information of the first target data; and the first target data is returned to the terminal device.
[0011] In this implementation, the data view information includes the data storage location information. By receiving data acquisition operations from the terminal device and based on the storage location information of the first target data, the second gateway device can directly locate the first gateway device and quickly obtain the required first target data, improving the efficiency of data acquisition. Furthermore, the terminal device indirectly obtains data from the first gateway device through the second gateway device. Compared to the method where the terminal device directly obtains data from the first gateway device, this application uses the second gateway device as an intermediary for communication between the data management system and external devices, effectively isolating the first gateway device. This avoids information interaction between the first gateway device and devices outside the data management system, reduces the risk of the first gateway device being directly exposed to the external network, thereby reducing the possibility of malicious attacks and improving the security of the data management system.
[0012] In one possible implementation, the view information of the data includes the storage location information of the data, and the preset data operation includes a data deletion operation; the method further includes: receiving a data deletion operation from a terminal device, the data deletion operation instructing the deletion of second target data in the first data; in response to the data deletion operation, instructing a first gateway device where the second target data is located to delete the second target data according to the storage location information of the second target data.
[0013] In this implementation, the second gateway device receives the data deletion operation from the terminal device and, based on the storage location information of the second target data, can accurately instruct the first gateway device to delete the specified data, ensuring that only the target data is deleted, avoiding accidental or missed deletion, thereby protecting the integrity and accuracy of the data.
[0014] In one possible implementation, the method further includes: receiving a second request from a terminal device, the second request being used to request storage space for second data, the second request carrying the amount of data of the second data; in response to the second request, determining a target storage area whose capacity matches the amount of data of the second data; returning response information containing location information of the target storage area to the terminal device, the location information of the target storage area being used by the terminal device to send a storage request to a first gateway device, the storage request being used by the terminal device to request the first gateway device to store the second data in the target storage area.
[0015] In this implementation, when a user stores second data, the second gateway device allocates a target storage area based on the amount of data, ensuring that the allocated storage space is neither too large nor too small. This avoids wasting storage resources in the first gateway device, and this on-demand allocation strategy helps maximize the utilization of storage resources. Furthermore, as the amount of data that users need to store continues to grow, the flexibility and scalability of the fiber optic access network can be enhanced by adding more first gateway devices or expanding the storage capacity of existing first gateway devices, thereby improving user satisfaction.
[0016] In one possible implementation, before receiving the first request from the terminal device, the method further includes: obtaining an access request from the first gateway device, the access request being used to request access to the fiber optic access network, the access request carrying device information of the first gateway device, the device information including device identifier and disk information; in response to the access request, sending configuration information to the first gateway device according to the device information, the configuration information including verification information, the verification information being used by the first gateway device to verify the legitimacy of requests from other devices to access the disk.
[0017] In this implementation, by issuing configuration information containing verification information to the first gateway device, it can be ensured that only verified devices can access the disk resources in the first gateway device. This legitimacy verification mechanism effectively prevents unauthorized access and potential security threats, avoids data leakage in the first gateway device, and enhances data security.
[0018] In one possible implementation, before receiving the first request from the terminal device, the method further includes: obtaining view information of the data in the disk of the first gateway device based on the disk information of the first gateway device.
[0019] In one possible implementation, the method further includes: sending a data analysis request to a first gateway device, the data analysis request being used to request a target analysis operation on the data in the first gateway device; and obtaining the execution result of the target analysis operation by the first gateway device.
[0020] In this implementation, the first gateway device performs target analysis operations on the data in the first gateway device. Compared with centralizing all data to the second gateway device for target analysis, this distributed data analysis method not only improves the flexibility of data analysis, but also reduces the latency of the first gateway device transmitting data to the second gateway device. When network bandwidth is limited or the data volume is large, delegating the target analysis operation to the first gateway device reduces the data transmission burden and shortens the total data analysis time.
[0021] In one possible implementation, the plurality of first gateway devices includes at least one second gateway device.
[0022] In this implementation, the second gateway device can be used to return view information of the first data to the terminal device, and it can also serve as the first gateway device with storage capabilities. Depending on the actual situation, one or more of the multiple first gateway devices can be used as the second gateway device, which enhances the flexibility of the fiber optic access network storage function. When a second gateway device fails, other first gateway devices in normal condition can perform the relevant functions of the second gateway, thereby improving the reliability of the fiber optic access network storage function.
[0023] Secondly, a data management method is provided, applied to an optical fiber access network. The optical fiber access network includes multiple first gateway devices and at least one second gateway device. The multiple first gateway devices are used to store data from terminal devices in the optical fiber access network. The at least one second gateway device is used to store view information of the data in the multiple first gateway devices. The method is executed by the first gateway devices and includes: receiving a data acquisition operation sent by a terminal device based on storage location information of first target data; the first target data is stored in a local first disk; the data acquisition operation is used to indicate the acquisition of the first target data; the storage location information of the first target data is determined by the terminal device based on view information obtained from the second gateway device; and returning the first target data to the terminal device.
[0024] In one possible implementation, the method further includes: receiving a data deletion instruction sent by a second gateway device in response to a data deletion operation of a terminal device, the data deletion instruction indicating the deletion of second target data; the second target data being stored in a local second disk; and deleting the second target data in response to the data deletion instruction.
[0025] In one possible implementation, the method further includes: receiving a data storage request sent by a terminal device based on the location information of a target storage area, the data storage request being used to request that the second data be stored in the target storage area; the target storage area being allocated by the terminal device based on the amount of the second data; the target storage area being a region in a local disk; and writing the second data into the target storage area in response to the data storage request.
[0026] In one possible implementation, the method further includes: receiving a second request from the terminal device, the second request being used to request storage space for second data, the second request carrying the amount of data of the second data; and sending the second request to the second gateway device.
[0027] In one possible implementation, the method further includes: sending an access request to a second gateway device, the access request being used to request access to the fiber optic access network, the access request carrying device information of the first gateway device, the device information including device identifier and disk information; and receiving configuration information issued by the second gateway device, the configuration information including verification information, the verification information being used by the first gateway device to verify the legitimacy of requests from other devices to access the disk.
[0028] In one possible implementation, the method further includes: receiving a data analysis request sent by a second gateway device, the data analysis request being used to request a target analysis operation on data in the first gateway device; responding to the data analysis request, performing a target analysis operation on the data in the first gateway device; and sending the execution result of the target analysis operation to the second gateway device.
[0029] Thirdly, a data management method is provided. This method is executed by terminal equipment in a fiber optic access network, which includes multiple first gateway devices and at least one second gateway device. The multiple first gateway devices are used to store data from the terminal equipment in the fiber optic access network; the at least one second gateway device is used to store view information of the data in the multiple first gateway devices. The method includes: sending a first request to request view information of first data; storing the first data in the at least one first gateway device; receiving the view information of the first data returned by the second gateway device; and using the view information of the first data to perform a preset data operation on the first data.
[0030] Fourthly, an electronic device is provided, comprising: a processor and a memory, the processor being connected to the memory. The memory is used to store computer-executable instructions, and the processor executes the computer-executable instructions stored in the memory, thereby implementing any one of the methods provided in the first, second, or third aspects.
[0031] Fifthly, a data management system is provided for use in an optical fiber access network. The system includes: a plurality of first gateway devices and at least one second gateway device; the plurality of first gateway devices are used to store data from terminal devices in the optical fiber access network; the at least one second gateway device is used to store view information of the data in the plurality of first gateway devices; and is also used to receive a first request from a terminal device, the first request being for requesting view information of first data; the first data is stored in at least one first gateway device; and in response to the first request, the view information of the first data is returned to the terminal device, the view information of the first data being used by the terminal device to perform a preset data operation on the first data.
[0032] In a sixth aspect, a computer-readable storage medium is provided, storing computer-executable instructions that, when executed on a computer, cause the computer to perform any of the methods provided in the first, second, or third aspect above.
[0033] In a seventh aspect, a computer program product is provided, including computer execution instructions that, when executed on a computer, cause the computer to perform any one of the methods provided in the first, second, or third aspect described above.
[0034] The technical effects of any of the implementation methods in aspects two through seven can be found in the technical effects of different implementation methods in aspect one, and will not be repeated here. Attached Figure Description
[0035] Figure 1 This is a schematic diagram of a fiber-to-the-room (FTTH) network.
[0036] Figure 2 This is a network diagram of a network-attached storage system in a home.
[0037] Figure 3 A system architecture diagram of a data management system provided in this application embodiment;
[0038] Figure 4 This is a schematic diagram of the software framework of a gateway device provided in an embodiment of this application;
[0039] Figure 5 A flowchart illustrating a data management method provided in an embodiment of this application;
[0040] Figure 6 A schematic diagram of the view information of the first data provided in the embodiments of this application;
[0041] Figure 7 This is an information interaction diagram for obtaining data from the first gateway device provided in an embodiment of this application;
[0042] Figure 8 This is a schematic diagram illustrating view information of the first data packet containing the first target data, provided in an embodiment of this application.
[0043] Figure 9 This application provides an information interaction diagram for deleting data from the first gateway device according to an embodiment of the present application.
[0044] Figure 10 A schematic diagram of the display interface of a data management system provided in an embodiment of this application;
[0045] Figure 11 This application provides an embodiment of an information interaction diagram for storing data to a first gateway device.
[0046] Figure 12 This is a schematic diagram of the structure of a data management system provided in an embodiment of this application;
[0047] Figure 13 This is a schematic diagram illustrating a scenario where a remote device accesses data in a first gateway device, as provided in an embodiment of this application.
[0048] Figure 14 This is a schematic diagram illustrating a scenario where a terminal device operates on data in multiple first gateway devices in parallel, as provided in an embodiment of this application.
[0049] Figure 15 This is a schematic diagram illustrating a scenario where a first gateway device is added to a data management system, as provided in an embodiment of this application.
[0050] Figure 16 This application provides an embodiment of an information interaction diagram for configuring a first gateway device with a second gateway device.
[0051] Figure 17 An information interaction diagram illustrating data analysis among gateway devices in a fiber optic access network provided in this embodiment of the application;
[0052] Figure 18 A schematic diagram illustrating the scenarios in which various gateway devices implement data analysis, as provided in the embodiments of this application;
[0053] Figure 19 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0054] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.
[0055] In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can mean A or B. "And / or" in this application is merely a description of the relationship between the related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. A and B can be singular or plural.
[0056] Furthermore, in the description of this application, unless otherwise stated, "multiple" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of a single item or a plurality of items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0057] Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that "first" and "second" are not necessarily different. Meanwhile, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is being used as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.
[0058] The following describes the terminology used in the embodiments of this application.
[0059] Fiber optic access networks refer to a networking method that uses optical fiber as the transmission medium to bring network signals from the outside into a business or home, and then distributes the network signals to the business or home through optical fiber and gateway equipment to achieve network coverage. Taking fiber to the room (FTTR) technology as an example, FTTR technology lays optical fiber directly into every room of a home, thereby achieving whole-house network signal coverage and solving problems such as many wireless network dead zones and poor network signal in home networks. Figure 1 This is a schematic diagram of an FTTR network. FTTR networks typically involve a main gateway device and multiple optical splitters (such as...). Figure 1 In the configuration, there are splitters 1, 2, ..., n) and multiple slave gateway devices (such as... Figure 1 The network consists of slave gateway devices 1, 2, ..., n. The master gateway device connects to the slave gateways via an optical splitter. The master gateway device is the core device in the FTTR network and is typically deployed in a home distribution box. Slave gateway devices, as extension devices in the FTTR network, are typically deployed in various rooms of the home.
[0060] Data view information refers to the information associated with data obtained by virtually mapping data. In this embodiment, data view information refers to the metadata of the data obtained by virtually mapping data in the first gateway device to the second gateway device. The metadata describes the data in the first gateway device, such as the data type, identifier, storage location, and data volume.
[0061] First, the application scenarios of the embodiments of this application will be introduced by way of example.
[0062] With the rapid increase in users' photos, videos, and social media data (such as images and videos in chat logs), network attached storage (NAS) has become increasingly important as a data management tool. NAS provides data storage capabilities and has a built-in operating system. As an independent node in a local area network (LAN), it can be a near-end or remote device that interacts with the NAS via protocols such as Network File System (NFS), Common Internet File System (CIFS), File Transfer Protocol (FTP), and Fiber to the Premises (FTTP) to perform data read and write operations. Here, a near-end device refers to a terminal device within the LAN's coverage area, while a remote device refers to a terminal device connected to the LAN via a wide area network (WAN). In this embodiment, the LAN refers to a fiber optic access network. Terminal devices can be computers (such as desktop computers, laptops, and tablets), mobile phones, smart home devices, smart wearable devices, network printers, smart TVs, multimedia devices (such as network speakers), etc.
[0063] Figure 2 This is a network diagram illustrating the topology of a network-attached storage system in a home. For example... Figure 2 As shown, in a local area network (LAN), the NAS device acts as an independent node, connected to other terminal devices (such as laptops, mobile phones, tablets, smart home devices, etc.) within the LAN via a switch or router. Near-end devices (such as computers, mobile phones, tablets, etc., within the LAN's coverage area) can read and store data on the NAS device through the LAN. Furthermore, remote devices connect to the NAS device on the LAN via a wide area network (WAN), enabling remote reading and storage of data from the NAS device.
[0064] Existing lightweight NAS devices have limited capabilities (storage capacity and data read / write capabilities), while high-configuration NAS devices, although capable of meeting user needs, have many drawbacks, such as high cost and complex configuration (e.g., configuring the NAS's IP address, network interface, network protocol, firewall, etc.). Furthermore, NAS devices, being devices that are constantly online, also suffer from high power consumption.
[0065] Therefore, the main objective of this application is to provide a network-attached storage solution that meets the requirements and does not suffer from the aforementioned drawbacks. Based on the characteristic of multiple gateway devices forming a device cluster in a fiber optic access network, network-attached storage functionality is configured for each gateway device, enabling multiple gateway devices to form a distributed storage cluster in a home. As a distributed storage cluster, multiple gateway devices (referred to as first gateway devices, such as slave gateway devices) can provide storage capacity, and at least one gateway device (referred to as second gateway devices, such as master gateway devices) has the ability to manage other devices.
[0066] Specifically, this application provides a data management method applied to an optical fiber access network. The optical fiber access network includes multiple first gateway devices and at least one second gateway device. The multiple first gateway devices store data from terminal devices (such as mobile phones, tablets, and other user terminals) within the optical fiber access network; the at least one second gateway device stores view information of the data stored in the multiple first gateway devices. The view information may include metadata about the data stored in the first gateway devices, such as data classification and data storage location. The second gateway device provides the view information of the data stored in the first gateway devices to the terminal devices. Based on this view information, the user of the terminal device can manage and operate on the data stored in the first gateway devices, such as retrieving required data.
[0067] Firstly, this approach eliminates the need for additional NAS devices, achieving network-attached storage functionality while simplifying NAS network configuration for users, thus reducing operational complexity and equipment costs. Secondly, it fully utilizes the resources of each gateway device, significantly improving data transmission performance and computing power. Compared to implementing network-attached storage with a single NAS node, the distributed storage cluster comprised of multiple gateway devices in this application better handles scenarios involving large data volumes and high concurrency, providing users with a smoother and more efficient network experience. Thirdly, the fiber optic access network uses fiber optic cables directly to the home or area, offering advantages such as high speed, stability, full coverage, and high scalability compared to traditional networking methods, significantly enhancing the user's network experience and meeting the urgent needs of businesses and families for a high-speed, stable, and fully covered network environment.
[0068] In some embodiments, the data management method provided in this application specifically includes: a second gateway device receiving a first request from a terminal device, the first request being for requesting view information of first data. The first data is stored in at least one first gateway device. In response to the first request, the second gateway device returns the view information of the first data to the terminal device. The view information of the first data is used by the terminal device to perform preset data operations on the first data. These preset data operations include, but are not limited to, data acquisition operations, data deletion operations, data writing operations, etc.
[0069] The data management method provided in this application embodiment centrally manages the view information of data stored in multiple first gateway devices through a second gateway device and provides it to a terminal device. The terminal device can browse the data stored in the first gateway devices based on the view information of the data, and can also perform management operations such as obtaining and deleting the data.
[0070] For example, the view information of the data indicates the storage location of the data. This allows terminal devices to directly interact with the corresponding first gateway device to retrieve the data based on its storage location, thereby improving data access efficiency and making data storage and access in fiber optic access networks more flexible and efficient. Simultaneously, the centralized management of the view information reduces the overall complexity of the fiber optic access network, lessening the operational burden on users.
[0071] Furthermore, with the increase in terminal devices and data volume in the fiber optic access network, the data management method provided in this application embodiment can easily expand storage capacity and computing power, and meet the ever-growing data storage and access needs of users by increasing the number of first gateway devices or improving the performance of a single first gateway device.
[0072] The system architecture of the embodiments of this application will be described below by way of example.
[0073] This application provides a data management system. Figure 3 This application provides a system architecture diagram for a data management system. The data management system includes multiple first gateway devices and at least one second gateway device. Each first gateway device and each second gateway device constitutes an optical fiber access network. The second gateway device can be either a master gateway device or a slave gateway device in the optical fiber access network. Similarly, each first gateway device can be either a master gateway device or a slave gateway device in the optical fiber access network. In the following embodiments, an example is provided where the first gateway device is a slave gateway device in the optical fiber access network and the second gateway device is a master gateway device in the optical fiber access network.
[0074] In this data management system, the first gateway device is used to store data from terminal devices in the fiber optic access network. These terminal devices can be user terminals such as mobile phones and tablets. The data from these terminal devices can be files, images, audio, video, etc., without specific limitations.
[0075] At least one second gateway device is used to store view information of data from multiple first gateway devices. This view information includes metadata corresponding to the data in the first gateway devices.
[0076] For example, the view information includes data name, data storage location, data type, etc. Users obtain the view information of the data in the first gateway device through their terminal devices, thus gaining access to the key content of the data in the first gateway device.
[0077] In some embodiments, a user sends a first request through a terminal device, the first request being used to request view information of first data. The first data is stored in at least one first gateway device. A second gateway device responds to the first request by returning the view information of the first data to the terminal device, the view information of the first data being used by the terminal device to perform preset data operations on the first data. The user performs the preset data operations on the first data according to the view information in the terminal device.
[0078] In one possible implementation, the preset data operations include, but are not limited to, data acquisition operations, data deletion operations, data writing operations, data renaming operations, data copying operations, and so on.
[0079] Optionally, the data acquisition operation refers to the user obtaining the first target data stored in the first gateway device through the terminal device.
[0080] For example, if the view information includes storage location information for the data to be retrieved, the terminal device directly retrieves the first target data from the location indicated by the storage location information. In this way, the terminal device directly accesses the required data through the first gateway device, avoiding data forwarding between multiple devices, thus improving the overall efficiency of data access, significantly reducing user waiting time, and enhancing user experience satisfaction.
[0081] Of course, the terminal device can also indirectly obtain the first target data through the second gateway device. For example, the second gateway device retrieves the data from the first gateway device corresponding to the storage location information based on the data's storage location information, and then returns the data to the terminal device. In this way, the terminal device indirectly obtains data from the first gateway device through the second gateway device. Compared to the method where the terminal device directly obtains data from the first gateway device, this embodiment of the application uses the second gateway device as an intermediary for communication between the first gateway device and external devices, effectively isolating the first gateway device, avoiding information interaction between the first gateway device and devices outside the data management system, reducing the risk of the first gateway device being directly exposed to the external network, thereby reducing the possibility of malicious attacks and improving the security of the data management system.
[0082] Optionally, the data deletion operation refers to the user instructing the deletion of the second target data in the first data through a terminal device.
[0083] For example, after receiving the data deletion operation from the terminal device, the second gateway device instructs the first gateway device where the second target data is located to delete the second target data based on the storage location information of the second target data.
[0084] Optionally, a data write operation refers to a user storing secondary data in the data management system via a terminal device.
[0085] For example, a user sends a second request to a second gateway device via a terminal device. This second request requests storage space for second data and carries the data volume of the second data. Upon receiving the second request from the terminal device, the second gateway device determines a target storage area whose capacity matches the data volume of the second data. It then returns response information containing the location information of the target storage area to the terminal device, enabling the terminal device to store the second data in the target storage area. The data volume can be represented by the storage space required, typically measured in units such as bytes (Byte), kilobytes (KB), megabytes (MB), gigabytes (GB), and terabytes (TB). Alternatively, the user can also send a second request to a first gateway device via the terminal device. The first gateway device, acting as a relay, forwards the second request to the second gateway device, allowing the second gateway device to determine the target storage area.
[0086] Similarly, users can send initial requests, data retrieval operations, data deletion operations, etc., to the first gateway device. If the first gateway device is unable to execute these requests, it forwards them to the second gateway device, which then executes them. In this way, every gateway device in the data management system can respond to user requests, and users can directly send second requests to the nearest gateway device, thereby improving the system's response time and enhancing the user experience.
[0087] Of course, data management systems can also perform operations such as copying and pasting on data, and no specific limitations are made here.
[0088] In some embodiments, the user may send the first request directly on the second gateway device instead of through the terminal device. The second gateway device responds to the first request and displays the view information of the first data to the user.
[0089] Of course, users can directly perform preset data operations on the first data on the second gateway device without going through the terminal device as an intermediary, thus eliminating the information interaction between the terminal device and the second gateway device and improving data management efficiency.
[0090] In one possible implementation, the second gateway device includes input devices, such as a touchscreen display, microphone, and keyboard, through which the user sends requests. For example, the user can send a request to the second gateway device by performing touch or key operations on the display. Alternatively, the user can send a request to the second gateway device by inputting a voice command through the microphone.
[0091] In some embodiments, the plurality of first gateway devices includes at least one second gateway device. Thus, the second gateway device can both return view information of the first data to the terminal device and also possess storage capabilities as a first gateway device.
[0092] In one possible implementation, when the second gateway device has storage capabilities, when a user performs operations such as acquiring, deleting, or analyzing the data stored in the second gateway device, the second gateway device does not need to interact with other first gateway devices; the second gateway device directly operates on the data stored in the second gateway device.
[0093] In one possible implementation, one or more of the multiple first gateway devices can be used as second gateway devices, depending on the actual situation, thereby enhancing the flexibility of the fiber optic access network's storage function. When a second gateway device fails, other normal second gateway devices can be used to manage the first gateway devices, thus improving the reliability of the fiber optic access network's storage function.
[0094] In some embodiments, the first gateway device includes a storage device for storing data from terminal devices in the fiber optic access network. Exemplary examples may include magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks, SSDs). This application does not impose specific limitations on the specific form of the storage device in the first gateway device; a suitable storage device can be selected to implement the storage function according to actual conditions.
[0095] In some embodiments, a schematic diagram of the software framework of the first gateway device or the second gateway device is shown below. Figure 4 As shown. In Figure 4In a network architecture, a gateway device comprises a user layer, a kernel layer, and a device layer. The user layer includes applications. For a local gateway device, the user layer includes local applications; for gateway devices other than the local one, the user layer includes remote applications. The kernel layer contains multiple driver modules (such as WiFi drivers, Android Pie (PIE) drivers, and Non-volatile Memory Host Controller Interface (NVMe) drivers), protocol modules (such as Transmission Control Protocol / Internet Protocol (TCP / IP), Samba / Common Internet File System (CIFS), and Fourth Extended File System (Ext4 FS)), etc. The device layer includes buffer areas, storage areas (such as SSDs), wireless (such as WiFi) modules, and passive optical network (PON) modules.
[0096] In this embodiment, the user sends the data to be stored to the NVMe driver in the kernel layer of the first gateway device via a remote application (such as a user's mobile application) through the TCP / IP protocol stack and Samba / cifs in the kernel layer of the terminal device. The NVMe driver in the kernel layer of the first gateway device directly stores the data in the storage area. Compared to related technologies, where the user stores the data to be stored in the cache area of the device layer of the first gateway device via a remote application (such as a user's mobile application) through the TCP / IP protocol stack and Samba / cifs in the kernel layer of the terminal device, and the NVMe driver in the kernel layer of the first gateway device stores the data in its device layer cache area, this embodiment does not use the cache area in the device layer of the first gateway device during the data storage process, reducing the number of storage operations, significantly reducing the computing power consumption of the first gateway device, and improving the storage performance of the first gateway device.
[0097] In some embodiments, the gateway devices communicate with each other through lightweight protocols, such as the Network File System (NFS) protocol, the Server Message Block (SMB) protocol, the Web-based Distributed Authoring and Versioning (WebDAV) protocol, the New Technology File System (NTFS) protocol, the Message Queuing Telemetry Transport (MQTT) protocol, and so on.
[0098] It should be noted that the system architecture and application scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.
[0099] The following embodiments of this application will be divided into three parts to exemplarily describe the data management method.
[0100] Part One, Combination Figures 5 to 15 This paper introduces the data management method provided in the embodiments of this application, aiming to illustrate the specific process by which users perform preset data operations through the data management system.
[0101] Part Two, Combination Figure 16 This application introduces a data management method provided in its embodiments, aiming to illustrate the implementation of gateway devices in a configuration data management system.
[0102] Part Three, Combining Figure 17 , Figure 18 This application introduces a data management method provided in its embodiments, aiming to illustrate the specific process of configuring a gateway device in a data management system to perform data analysis.
[0103] In some embodiments, leveraging the characteristic of multiple gateway devices forming a device cluster within a fiber optic access network, network-attached storage (NAS) functionality is configured for each gateway device, enabling them to form a distributed storage cluster. In this fiber optic access network, multiple first gateway devices provide data storage capabilities, while at least one second gateway device provides the ability to manage other devices. This eliminates the need for additional NAS devices, implementing NAS functionality while simplifying the user's NAS network configuration process, reducing user complexity and equipment costs. Furthermore, the master-slave distributed model of the gateway devices fully utilizes the resources of each gateway device, significantly improving data transmission performance and computing power. Compared to implementing NAS functionality on a single node, the distributed model better handles scenarios with large data volumes and high concurrency, providing users with a smoother and more efficient network experience.
[0104] Figure 5 This is a flowchart illustrating a data management method according to an exemplary embodiment. The method is performed by a second gateway device. Exemplarily, the method includes the following S501-S502.
[0105] S501: The second gateway device receives the first request from the terminal device.
[0106] The first request is used to request view information of the first data. The first data is stored in at least one first gateway device.
[0107] The view information of the first data is used by the terminal device to perform preset data operations on the first data.
[0108] In one possible implementation, the terminal device can send a first request to the second gateway device through the display interface of the data management system.
[0109] For example, a "Send Request" button can be set in the display interface of the data management system, and the user can send the first request to the second gateway device by clicking the button.
[0110] For example, a drop-down menu can be set in the display interface of the data management system, containing multiple request types for the first request. The user sends the user request to the second gateway device by selecting the response request type.
[0111] For example, shortcut keys can also be set in the display interface of the data management system. When the user presses the preset shortcut key, the first request is sent to the second gateway device.
[0112] Of course, users can also send the first request to the second gateway device through voice control or other means.
[0113] In one possible implementation, the first data can be a document, audio, video, image, etc., without any specific restrictions.
[0114] In one possible implementation, the view information includes classification information. This classification information indicates the category of the data, such as images, videos, audio, etc.
[0115] In one possible implementation, the view information includes data identification information. This data identification information is used to indicate data in the first gateway device; for example, the data identification information can be a data name, etc.
[0116] In one possible implementation, the view information includes storage location information. This storage location information indicates which first gateway device the first data is stored on.
[0117] For example, Figure 6 This is a schematic diagram of the view information of the first data presented on the terminal device. The terminal device's display screen shows the view information of the first data returned by the second gateway device. This view information includes information about four data items identified as Image 1, Image 2, Image 3, and Image 4. Taking Image 1 as an example, Image 1 is categorized as a photograph, and Image 1 is stored on the first gateway device 1.
[0118] S502: In response to the first request, the second gateway device returns view information of the first data to the terminal device.
[0119] After receiving the view information, the terminal device presents it to the user. The user then uses the terminal device to perform operations such as reading, writing, deleting, renaming, copying, and pasting on the data stored in the fiber optic access network based on the first view information. In this application, the user's operations on the data stored by each first gateway device through the terminal device include various implementation scenarios. The following are exemplified by scenarios 1 to 3.
[0120] Scenario 1: The user retrieves data stored by the first gateway device. In this scenario, the preset data operations include data retrieval.
[0121] In some examples, where the view information of the first data includes the storage location information of the first data, the terminal device directly obtains the first target data from the first gateway device corresponding to the storage location information.
[0122] In one possible implementation, the terminal device sends a data request to the first gateway device represented by the storage location information. In response to the data request, the first gateway device sends the first target data from the first data to the terminal device.
[0123] In this way, the view information of the first data contains the storage location information of the first data. Through this view information, the terminal device can quickly locate the data, thereby reducing the time for data retrieval and location. At the same time, the terminal device can directly access the required data through the first gateway device without involving data forwarding between multiple devices, which improves the overall efficiency of data access, significantly shortens the user's waiting time, and enhances user experience satisfaction.
[0124] In other examples, the terminal device obtains data stored in the first gateway device through communication with the second gateway device.
[0125] Figure 7 This is an information interaction diagram illustrating the acquisition of data from a first gateway device according to an exemplary embodiment. The method includes the following steps S701-S705:
[0126] S701: The terminal device sends a first request to the second gateway device.
[0127] The first request is used to request view information for the first data.
[0128] In one possible implementation, the first data is stored in at least one first gateway device. That is, the first data can be stored on one gateway device or simultaneously on multiple first gateway devices. Having multiple first gateway devices storing the first data improves the security of the first data; even if one of the first gateway devices fails, the user can still obtain the first data through other first gateway devices. This application does not impose a specific limit on the number of first gateway devices storing the first data; it can be limited according to actual circumstances.
[0129] S702: In response to the first request, the second gateway device returns view information of the first data to the terminal device.
[0130] The view information of the first data is used by the terminal device to perform data acquisition operations on the first data.
[0131] In this embodiment of the application, the view information of the data includes the storage location information of the data.
[0132] S703: The terminal device sends a data acquisition operation to the second gateway device.
[0133] The data acquisition operation is used to indicate the acquisition of the first target data from the first data.
[0134] Figure 8This is a schematic diagram illustrating view information containing the first target data in the first data packet. The terminal device's display shows view information of the first data returned by the second gateway device. This view information includes information about two folders identified as Folder 1 and Folder 2. Folder 1 contains two files identified as File 1 and File 2, both stored in the first gateway device 1. Folder 2 contains one file, File 3, stored in the first gateway device 2. For example, the data acquisition operation involves acquiring the target data, File 3, from Folder 2.
[0135] S704: In response to the data acquisition operation, the second gateway device acquires the first target data from the first gateway device where the first target data is located, based on the storage location information of the first target data.
[0136] In one possible implementation, the second gateway device obtains the first target data by reading the storage area in the first gateway device.
[0137] In addition, the second gateway device can also send an instruction to the first gateway device to obtain the first target data, and the first gateway device will send the first target data to the second gateway device after receiving the instruction.
[0138] S705: The second gateway device returns the first target data to the terminal device.
[0139] In this way, the data view information includes the data storage location information. By receiving data acquisition operations from the terminal device and based on the storage location information of the first target data, the second gateway device can directly locate the first gateway device and quickly obtain the required first target data, improving the efficiency of data acquisition. Furthermore, the terminal device indirectly obtains data from the first gateway device through the second gateway device. Compared to the method where the terminal device directly obtains data from the first gateway device, this embodiment uses the second gateway device as an intermediary for communication between the data management system and external devices, effectively isolating the first gateway device. This avoids information interaction between the first gateway device and devices outside the data management system, reduces the risk of the first gateway device being directly exposed to the external network, thereby reducing the possibility of malicious attacks and improving the security of the data management system.
[0140] Scenario 2: The user deletes data stored on the first gateway device. In this scenario, the default data operation includes data deletion.
[0141] In some examples, when a user needs to delete data in the first gateway device, the user instructs the first gateway device, which stores the data, to perform the data deletion operation through the second gateway device.
[0142] Figure 9 This is an information interaction diagram illustrating the deletion of data in a first gateway device according to an exemplary embodiment. The method includes the following steps S901-S905:
[0143] S901: The terminal device sends a first request to the second gateway device.
[0144] S902: In response to the first request, the second gateway device returns view information of the first data to the terminal device.
[0145] The view information of the data includes the data's storage location information.
[0146] The implementation methods of S901-S902 are similar to those of S701-S702, and will not be described in detail here.
[0147] S903: The terminal device sends a data deletion operation to the second gateway device.
[0148] The data deletion operation specifies the deletion of the second target data from the first data.
[0149] Figure 10 This is a schematic diagram of the display interface of a data management system, specifically the data deletion operation interface. In this interface, the user selects the second target data to be deleted and executes the data deletion operation by clicking the delete button. Additionally, this display interface also allows for operations such as data copying. Figure 10 In the process, the user selects image 4 as the second target data and sends a data deletion operation by clicking the delete button on the display interface.
[0150] S904: In response to the data deletion operation, the second gateway device sends a data deletion command to the first gateway device corresponding to the storage location information of the second target data.
[0151] The data deletion command instructs the deletion of the second target data.
[0152] S905: The first gateway device responds to the data deletion command and deletes the second target data.
[0153] In this scenario, the second gateway device receives the data deletion operation from the terminal device and, based on the storage location information of the second target data, can accurately instruct the first gateway device to delete the specified data, ensuring that only the target data is deleted, avoiding accidental or missed deletion, thereby protecting the integrity and accuracy of the data.
[0154] In other examples, when a user needs to delete data in the first gateway device, the user can directly instruct the first gateway device to delete the data based on the storage location information of the data in the view information. This eliminates the need for data interaction between the user and the second gateway device, and between the second gateway device and the first gateway device, simplifying the data management process, shortening the response time of the data management system, and improving data management efficiency.
[0155] In one possible implementation, the first gateway device has a touch-enabled display screen. A user can instruct the first gateway device to delete the data by performing a touch operation on the display screen of the first gateway device, which stores the location information.
[0156] Of course, the process of renaming or modifying data in the first gateway device is similar to deleting data in the first gateway device, and will not be elaborated here.
[0157] Scenario 3: User stores data in the first gateway device. In this scenario, the preset data operations include data write operations.
[0158] Figure 11 This is an information interaction diagram illustrating data storage to a first gateway device according to an exemplary embodiment. The method includes the following steps S1101-S1107:
[0159] S1101: The terminal device sends a first request to the second gateway device.
[0160] S1102: The second gateway device responds to the first request and returns view information of the first data to the terminal device.
[0161] Understandably, in this scenario, the view information of the first set of data does not include the view information of the data that the user is about to store.
[0162] The implementation methods of S1101-S1102 are similar to those of S701-S702, and will not be described in detail here.
[0163] S1103: The terminal device sends a second request to the second gateway device.
[0164] The second request is used to request storage space for the second data, and the second request carries the amount of data for the second data.
[0165] In another implementation, the terminal device can also send a request (such as a second request) to the first gateway device. After receiving the request, the first gateway device can forward it to the second gateway device. In this way, each gateway device in the data management system can respond to user requests. The user can directly send the second request to the nearest gateway device, thereby improving the system's response time to user requests and enhancing the user experience.
[0166] S1104: The second gateway device responds to the second request and determines a target storage area whose capacity matches the amount of data in the second data.
[0167] S1105: The second gateway device returns response information containing the location information of the target storage area to the terminal device.
[0168] The location information of the target storage area is used by the terminal device to store the second data in the target storage area.
[0169] S1106: The terminal device sends a storage request to the first gateway device corresponding to the target storage area.
[0170] The storage request is used to request the first gateway device to store the second data in the target storage area.
[0171] S1107: In response to the storage request, the first gateway device corresponding to the target storage area stores the second data.
[0172] In this way, when a user stores second data through a terminal device, the second gateway device will allocate a target storage area for it according to the amount of data in the second data, thereby ensuring that the storage space allocated for the second data is neither too large nor too small, thus avoiding the waste of storage resources in the first gateway device. This on-demand allocation strategy helps to maximize the utilization of storage resources.
[0173] Figure 12 This is a schematic diagram of the structure of a data management system. Figure 12In this system, the first gateway device stores data from terminal devices in the fiber optic access network, providing data storage capabilities. The second gateway device manages the first gateway device and stores view information of the data in each first gateway device. For near-end devices (terminal devices located in the local area network of the fiber optic access network), they can directly interact with the first gateway device through the view information provided by the second gateway device (specifically displayed through the corresponding application of the data management system), performing operations such as reading, deleting, and storing data. Near-end devices can also indirectly interact with the first gateway device through the second gateway device as an intermediary. For remote devices (terminal devices connected to the data management system via a wide area network), they operate on the data in the data management system through the wide area network. Specifically, remote devices connect to the data management system through Peer-to-Peer Network Address Translation Traversal (P2P NAT) in the wide area network and Internet Protocol Security Encryption for Layer 2 Data (IPSEC) to operate on the data in the data management system. Similarly, remote devices can directly interact with the first gateway device without involving data forwarding from the second gateway device, or they can use the second gateway device as an intermediary to achieve indirect data interaction with the first gateway device. Furthermore, view information from the second gateway device can be stored in a cloud server, and remote devices can retrieve this view information from the cloud server and perform preset data operations on the data in the data management system based on this view information.
[0174] Figure 13 This is a schematic diagram illustrating a scenario where a remote device accesses data in the first gateway device. When the second gateway device is not the primary gateway device in the fiber optic access network, the remote device connects to the primary gateway device in the fiber optic access network via Network Address Translation (NAT) in the peer-to-peer network. The remote device can directly connect to the first gateway device through the primary gateway device in the fiber optic access network and perform preset data operations on the data in the first gateway device. Alternatively, the remote device can connect to the second gateway device sequentially through the primary gateway device in the fiber optic access network, and indirectly perform preset data operations on the data in the first gateway device through the second gateway device.
[0175] Figure 14 This is a schematic diagram illustrating a scenario where terminal devices operate on data from multiple first gateway devices in parallel. The data management system comprised of the first and second gateway devices is a distributed storage system; therefore, multiple first gateway devices can process their respective data simultaneously. Figure 14 In this embodiment, the terminal device simultaneously performs data operations on data stored in both the first gateway device 1 and the first gateway device 2. Compared to related technologies that perform data operations from a single storage device, this parallel data processing method significantly improves data processing speed. Furthermore, because the data is distributed across multiple first gateway devices, the data management system can more effectively balance the load, preventing overload of any single device and thus enhancing system stability.
[0176] Of course, as the amount of data that users need to store continues to grow, the flexibility and scalability of the fiber optic access network can be enhanced by adding first gateway devices or expanding the storage capacity of existing first gateway devices, thereby increasing user satisfaction.
[0177] Figure 15 This is a schematic diagram illustrating a scenario where a first gateway device is added to a data management system. The original data management system includes one second gateway device and one first gateway device. When the original data management system has limited storage capacity or wireless coverage, adding a first gateway device can enhance both storage capacity and fiber optic access network coverage. If a single first gateway device has a storage capacity of 1TB, adding another first gateway device expands the new data management system's storage capacity from 1TB to 2TB, thus meeting the user's storage requirements.
[0178] In the first part of this application's embodiments, by centrally managing view information through a second gateway device, terminal devices can quickly locate the data storage location, thereby improving data access efficiency. This design avoids the inefficiency of traditional methods where terminal devices need to traverse all storage nodes to find data. This data management approach makes data storage and access in fiber optic access networks more flexible and efficient. Simultaneously, due to the centralized management of view information, the overall system complexity is reduced, lessening the user's operational burden. Furthermore, as the number of terminal devices and the amount of data increase in the fiber optic access network, the data management method can easily expand storage capacity and computing power. By increasing the number of first gateway devices or improving the performance of individual devices, the ever-growing demands for data storage and access can be met.
[0179] The above is the first part of the embodiments of this application. The following, in conjunction with... Figure 16 This application introduces a data management method provided in its embodiments, aiming to illustrate the implementation of gateway devices in a configuration data management system.
[0180] Figure 16 This is an information interaction diagram illustrating the configuration of a first gateway device by a second gateway device according to an exemplary embodiment. Exemplarily, the method includes the following steps S1601-S1604.
[0181] S1601: The first gateway device sends an access request to the second gateway device to access the fiber optic access network.
[0182] The access request carries the device information of the first gateway device, which includes the device identifier and disk information.
[0183] For example, the device identifier can be the device name, device ID, device media access control address (MAC), etc., without specific restrictions.
[0184] For example, disk information includes, but is not limited to, disk model, disk encryption key, disk capacity, disk physical type (such as hard disk drive (HDD) or solid-state drive (SSD)), disk serial number (as disk identifier), disk operating speed, etc. The encryption key is used to verify the identity of other devices accessing the disks in the first gateway device.
[0185] S1602: In response to the access request, the second gateway device sends configuration information to the first gateway device based on the device information.
[0186] The configuration information includes verification information, which is used by the first gateway device to verify the legitimacy of requests from other devices to access the disk.
[0187] In one possible implementation, the verification information can be an encryption key.
[0188] For example, when another device sends a request to the first gateway device to access the disk, the request must include an encryption key. The first gateway device will determine whether the encryption key is consistent with the encryption key issued by the second gateway device. Only if they are consistent will the first gateway device allow the other device to access its disk.
[0189] Of course, the verification information can also be a timestamp. The first gateway device will check whether the timestamps provided by other devices are within the preset time range. Only if the timestamps provided by other devices are within the preset time range will the first gateway device allow other devices to access its disk.
[0190] In this way, by sending configuration information containing verification information to the first gateway device, it can be ensured that only verified devices can access the disk resources in the first gateway device. This legitimacy verification mechanism effectively prevents unauthorized access and potential security threats, avoids data leakage in the first gateway device, and enhances data security.
[0191] In one possible implementation, the configuration information also includes network parameters of the first gateway device in the fiber optic access network, such as IP address, subnet mask, gateway, etc.
[0192] S1603: The first gateway device completes the configuration according to the configuration information and starts the network file system.
[0193] For example, network file systems can be SMB, NFS, WebDAV, etc., without specific limitations.
[0194] S1604: The second gateway device obtains view information of the data in the disk of the first gateway device based on the disk information of the first gateway device.
[0195] In one possible implementation, the second gateway device performs view mapping on the data of the first gateway device to obtain view information of the data on the disk of the first gateway device.
[0196] Optionally, the view information of the data in the disk of the first gateway device can be stored in the first gateway device. In this way, when the amount of view information is large, the storage space of the second gateway device can be saved.
[0197] Optionally, the aforementioned view information can also be stored in the second gateway device. Storing the view information in the second gateway device eliminates the need for the second gateway device to obtain video information from the first gateway device, thus shortening the time it takes for the second gateway device to respond to terminal device requests for view information.
[0198] For example, after obtaining the view information from the first gateway device, the second gateway device can determine whether to provide the view information by setting a view service identifier. When the view service identifier is used to instruct the second gateway device to provide view information, the second gateway device can return the view information to the terminal device upon receiving a first request from the terminal device, enabling the user to manipulate the data in the first gateway device.
[0199] In the second part of this application's embodiments, in a fiber optic access network, a second gateway device has the ability to manage a first gateway device. The second gateway device manages the stored data in the first gateway device and provides data view information to terminal devices. Thus, by initiating a network file system, the first gateway device can share disk resources with other devices (such as terminal devices), promoting the effective utilization and sharing of storage resources in the fiber optic access network and improving the user experience.
[0200] The above is the second part of the embodiments of this application. The following, in conjunction with... Figure 17 , Figure 18This paper introduces the data management method provided in the embodiments of this application, aiming to describe the specific process of configuring gateway devices in the data management system to perform data analysis.
[0201] In some embodiments, after a user stores data in a first gateway device via a terminal device, when analysis of the data in the first gateway device is required, the second gateway device can distribute the data analysis task to the first gateway device storing the data, leveraging the distributed storage features of the data management system. The first gateway device then executes the data analysis task. Because the data analysis task is distributed to the first gateway device storing the data, unnecessary data transmission and copying operations can be reduced, thereby lowering network load and shortening the total data analysis time.
[0202] Figure 17 This is an information interaction diagram illustrating data analysis implemented by various gateway devices in a fiber optic access network according to an exemplary embodiment. Exemplarily, the method includes the following steps S1701-S1703.
[0203] S1701: The second gateway device sends a data analysis request to the first gateway device.
[0204] The data analysis request is used to request target analysis operations on the data in the first gateway device.
[0205] In one possible implementation, the data in the first gateway device can be photos, files, videos, audio, etc.
[0206] For example, when the data in the first gateway device is a photograph, the target analysis operation can identify objects in the photograph (such as people, animals, vehicles, buildings, etc.) and classify the photograph according to the object category. The target analysis operation can also analyze parameters such as the photograph's sharpness and color saturation to evaluate the photograph's image quality.
[0207] For example, when the data in the first gateway device is a file, the target analysis operation can identify the file format (such as text, table, etc.) and classify the file according to the file's metadata (such as creation date, file size, etc.).
[0208] For example, when the data in the first gateway device is video, the target analysis operation can identify key information in the video, such as intrusion by personnel or parking of vehicles. The target analysis operation can also track moving targets in the video, analyzing their trajectory and speed.
[0209] S1702: The first gateway device responds to the data analysis request and performs target analysis operations.
[0210] S1703: And return the execution result of the target analysis operation to the second gateway device.
[0211] Figure 18 This is a schematic diagram illustrating the data analysis scenarios implemented by various gateway devices. Figure 18 In this configuration, first gateway device 1 and first gateway device 2 are connected to second gateway device. When a user sends a data analysis request to second gateway device via a terminal device, second gateway device will distribute the data analysis task corresponding to the data analysis request to first gateway device, which stores the data involved in the data analysis request. For example... Figure 18 As shown, the data involved in the data analysis request is stored on disk 1 of the first gateway device 1 and disk 2 of the second gateway device 2. Therefore, the second gateway device divides the data analysis task into data analysis task 1 and data analysis task 2, and sends data analysis task 1 to the first gateway device 1 and data analysis task 2 to the first gateway device 2. The first gateway device 1 executes data analysis task 1 based on the data in disk 1, and the first gateway device 2 executes data analysis task 2 based on the data in disk 2.
[0212] In this way, by using the first gateway device to perform target analysis operations on the data in the first gateway device, compared to centralizing all the data to the second gateway device for target analysis, this distributed data analysis method not only improves the flexibility of data analysis, but also reduces the latency of the first gateway device transmitting data to the second gateway device. When network bandwidth is limited or the data volume is large, delegating the target analysis operation to the first gateway device reduces the data transmission burden and shortens the total data analysis time.
[0213] This application also provides an electronic device 100. For example... Figure 19 As shown, the computing device 100 includes a bus 102, a processor 104, a memory 106, and a communication interface 108. The processor 104, the memory 106, and the communication interface 108 communicate with each other via the bus 102. The electronic device 100 can be a server or a terminal device. It should be understood that this application does not limit the number of processors and memories in the electronic device 100.
[0214] Bus 102 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, Figure 19The bus 102 may be represented by a single line, but this does not mean that there is only one bus or one type of bus. The bus 102 may include a path for transmitting information between various components of the electronic device 100 (e.g., memory 106, processor 104, communication interface 108).
[0215] The processor 104 may include any one or more processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).
[0216] Memory 106 may include volatile memory, such as random access memory (RAM). Processor 104 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid state drive (SSD).
[0217] The memory 106 stores executable program code, and the processor 104 executes the executable program code to implement the functions of the aforementioned data management system, thereby realizing the data management method. That is, the memory 106 stores instructions for executing the data management method.
[0218] The communication interface 108 uses transceiver modules such as, but not limited to, network interface cards and transceivers to enable communication between the electronic device 100 and other devices or communication networks.
[0219] This application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that an electronic device can store, or a data storage device such as a data center that includes one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive). The computer-readable storage medium includes instructions that instruct the electronic device to perform a data management method, or instruct the electronic device to perform a data management method.
[0220] This application also provides a chip. The chip integrates a control circuit for implementing the functions of the aforementioned electronic device and one or more ports. Optionally, the functions supported by the chip can be referred to above, and will not be repeated here. Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium. The aforementioned storage medium can be a read-only memory, random access memory, etc. The aforementioned processing unit or processor can be a central processing unit, a general-purpose processor, an application-specific integrated circuit (ASIC), a microprocessor (digital signal processor, DSP), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof.
[0221] This application also provides a computer program product containing instructions. The computer program product may be a software or program product containing instructions, capable of running on an electronic device or stored on any usable medium. When the computer program product is run on at least one electronic device, it causes the at least one electronic device to perform a data management method.
[0222] It should be noted that the devices for storing computer instructions or computer programs provided in the embodiments of this application, such as but not limited to the memory, computer-readable storage medium and communication chip, are all non-transitory.
[0223] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software programs, implementation can be, in whole or in part, in the form of a computer program product. This computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device containing one or more servers, data centers, etc., that can be integrated with the medium. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks, SSDs).
[0224] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, the disclosure, and the appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple instances. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.
[0225] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely exemplary illustrations of this application as defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from the spirit and scope of this application. Thus, if such modifications and modifications of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and modifications.
Claims
1. A data management method characterized by, The application is applied to an optical fiber access network, the optical fiber access network comprises a plurality of first gateway devices and at least one second gateway device, the plurality of first gateway devices are used for storing data from terminal devices in the optical fiber access network; the at least one second gateway device is used for storing view information of data in the plurality of first gateway devices, the view information is a virtual mapping of the data in the first gateway device on the second gateway device; The method is executed by the second gateway device, comprising: Receiving a first request of the terminal device, the first request is used for requesting view information of first data; the first data is stored in at least one first gateway device; In response to the first request, the view information of the first data is returned to the terminal device, and the view information of the first data is used for the terminal device to execute a preset data operation on the first data.
2. The data management method according to claim 1, characterized by, The preset data operation comprises a data acquisition operation; the view information of the first data comprises storage location information of the first data, and the storage location information is used for the terminal device to send a data request to the first gateway device, and the data request is used for the terminal device to request the first gateway device to return first target data in the first data.
3. The data management method of claim 1, wherein, The view information of the data comprises storage location information of the data, and the preset data operation comprises a data acquisition operation; the method further comprises: Receiving a data acquisition operation of the terminal device; the data acquisition operation is used for indicating to acquire first target data in the first data; In response to the data acquisition operation, the first target data is acquired from the first gateway device where the first target data is located according to the storage location information of the first target data; The first target data is returned to the terminal device.
4. The data management method according to any one of claims 1 to 3, characterized by, The view information of the data comprises storage location information of the data, and the preset data operation comprises a data deletion operation; the method further comprises: Receiving a data deletion operation of the terminal device, the data deletion operation indicates to delete second target data in the first data; In response to the data deletion operation, the second target data is deleted from the first gateway device where the second target data is located according to the storage location information of the second target data.
5. The data management method according to any one of claims 1 to 4, characterized by, The method further comprises: Receiving a second request of the terminal device, the second request is used for applying for a storage space for second data, and the second request carries a data amount of the second data; In response to the second request, a target storage area with a capacity matching the data amount of the second data is determined; Response information containing location information of the target storage area is returned to the terminal device, and the location information of the target storage area is used for the terminal device to send a storage request to the first gateway device, and the storage request is used for the terminal device to request the first gateway device to store the second data to the target storage area.
6. The data management method according to any one of claims 1 to 5, characterized by, Before the receiving the first request of the terminal device, the method further comprises: obtaining an access request of the first gateway device, the access request being used to request access to the fiber access network, the access request carrying device information of the first gateway device, the device information including device identification and disk information; in response to the access request, issuing configuration information to the first gateway device according to the device information, the configuration information including verification information, the verification information being used for the first gateway device to perform legitimacy verification on a request of the first gateway device to access a disk of another device.
7. The data management method of claim 6, wherein, Before the receiving of the first request of the terminal device, the method further includes: obtaining view information of data in the disk of the first gateway device according to the disk information of the first gateway device.
8. The data management method according to any one of claims 1 to 7, characterized by, The method further includes: sending a data analysis request to the first gateway device, the data analysis request being used to request a target analysis operation on data in the first gateway device; obtaining an execution result of the target analysis operation by the first gateway device.
9. The data management method according to any one of claims 1 to 8, characterized by, The plurality of first gateway devices includes the at least one second gateway device.
10. A data management method characterized by, Applied to a fiber access network, the fiber access network includes a plurality of first gateway devices and at least one second gateway device, the plurality of first gateway devices being used to store data from a terminal device of the fiber access network; the at least one second gateway device being used to store view information of data in the plurality of first gateway devices; The method is executed by the first gateway device and includes: receiving a data acquisition operation sent by the terminal device according to storage location information of first target data; the first target data is stored in a local first disk; the data acquisition operation is used to instruct to acquire the first target data; the storage location information of the first target data is determined by the terminal device according to view information obtained from the second gateway device; returning the first target data to the terminal device.
11. The data management method of claim 10, wherein, The method further includes: receiving a data deletion instruction sent by the second gateway device in response to a data deletion operation of the terminal device, the data deletion instruction instructing to delete second target data; the second target data is stored in a local second disk; in response to the data deletion instruction, deleting the second target data.
12. The data management method according to claim 11 or 10, characterized by, The method further includes: receiving a data storage request sent by the terminal device according to location information of a target storage area, the data storage request being used to request to store second data to the target storage area; the target storage area is allocated by the terminal device according to a data amount of the second data; the target storage area is an area in a local disk; in response to the data storage request, writing the second data to the target storage area.
13. The data management method according to any one of claims 10-12, characterized by, The method further includes: receiving a second request of the terminal device, the second request being used to apply for storage space for second data, the second request carrying a data amount of the second data; sending the second request to the second gateway device.
14. The data management method according to any one of claims 10-13, characterized by, The method further includes: sending an access request to the second gateway device, the access request being used to request access to the fiber access network, the access request carrying device information of the first gateway device, the device information including device identification and disk information; receiving configuration information issued by the second gateway device, the configuration information including verification information, the verification information being used for the first gateway device to verify the legality of a request of another device to access a disk.
15. The data management method according to any one of claims 10-14, characterized by, The method further includes: receiving a data analysis request sent by the second gateway device, the data analysis request being used to request a target analysis operation on data in the first gateway device; performing the target analysis operation on the data in the first gateway device in response to the data analysis request; sending an execution result of the target analysis operation to the second gateway device.
16. A data management method characterized by, executed by a terminal device of a fiber access network, the fiber access network including a plurality of first gateway devices and at least one second gateway device, the plurality of first gateway devices being used to store data from terminal devices of the fiber access network; the at least one second gateway device being used to store view information of data in the plurality of first gateway devices; The method includes: sending a first request, the first request being used to request view information of first data; the first data being stored in at least one of the first gateway devices; receiving the view information of the first data returned by the second gateway device; the view information of the first data being used to perform a preset data operation on the first data.
17. An electronic device, comprising: including: a processor and a memory; the processor is connected with the memory, the memory is used to store computer execution instructions, and the processor executes the computer execution instructions stored in the memory to enable the electronic device to implement the method in any one of claims 1-16.
18. A data management system, characterized by The system includes a plurality of first gateway devices and at least one second gateway device in a fiber access network; the plurality of first gateway devices are used to store data from terminal devices of the fiber access network; the at least one second gateway device is used to store view information of data in the plurality of first gateway devices; and is also used to receive a first request of the terminal device, the first request being used to request view information of first data; the first data is stored in at least one of the first gateway devices; in response to the first request, the view information of the first data is returned to the terminal device, and the view information of the first data is used by the terminal device to perform a preset data operation on the first data.