Data reading method and device, computer equipment and storage medium

Abstract

The invention provides a data reading method and device, computer equipment and a storage medium, and belongs to the technical field of computers. The method comprises the steps of determining first data and second data in response to a data acquisition request of a target application program for target data; obtaining second data and third data from the local storage space; and caching the third data, and returning the target data to the target application program. According to the technical scheme, the associated data of the target data is added into the cache in advance, so that the cached associated data can be directly returned when the next data acquisition request for the associated data arrives, and compared with a traditional data reading method, frequent access to a storage space is avoided by using the method, so that the data reading efficiency is improved. Therefore, the influence of the working load is small, and the data reading efficiency is higher.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data reading method, device, computer equipment and storage medium. Background Art

[0002] Data reading in the system is an important step in data processing. According to the usage of data, data can be divided into hot data and cold data. By caching hot data in memory and persistently storing cold data in the hard disk, hot data can be directly read from the memory when reading data, which improves the efficiency of data reading. However, the existing data reading method is greatly affected by the workload. When the workload is relatively large, it may cause the problem of reduced data reading efficiency. Therefore, a data reading method that is less affected by the workload is urgently needed. Summary of the invention

[0003] The embodiment of the present application provides a data reading method, device, computer equipment and storage medium, which can add the associated data of the target data to the cache in advance, so that when the next data acquisition request for the associated data arrives, the cached associated data can be directly returned. Compared with the traditional data reading method, the use of this method avoids frequent access to the storage space, so it is less affected by the workload and the data reading efficiency is higher. The technical solution is as follows:

[0004] In one aspect, a data reading method is provided, the method comprising:

[0005] In response to a data acquisition request of a target application for target data, determining first data and second data, the target application being the application that sends the data acquisition request, the first data being a cached portion of the target data, and the second data being a non-cached portion of the target data;

[0006] Acquire the second data and third data from the local storage space, wherein the third data is data associated with the target data;

[0007] The third data is cached, and the target data is returned to the target application.

[0008] In another aspect, a data reading device is provided, the device comprising:

[0009] a determination module, configured to determine first data and second data in response to a data acquisition request of a target application for target data, wherein the target application is an application that sends the data acquisition request, the first data is a cached portion of the target data, and the second data is a non-cached portion of the target data;

[0010] An acquisition module, configured to acquire the second data and third data from a local storage space, wherein the third data is data associated with the target data;

[0011] The return module is used to cache the third data and return the target data to the target application.

[0012] In some embodiments, the determination module is used to determine the portion of the cached data that is identical to the target data as the first data in response to a data acquisition request for the target data; and determine the portion of the target data other than the first data as the second data.

[0013] In some embodiments, the acquisition module includes:

[0014] A first acquiring unit, configured to acquire the second data from a local storage space;

[0015] A determining unit, configured to determine the third data based on a data relationship list, wherein the data relationship list is used to record association relationships between data;

[0016] The second acquiring unit is configured to acquire the third data from a local storage space.

[0017] In some embodiments, the target data includes data in a plurality of files;

[0018] The determination unit is used to determine at least one file associated with the multiple files based on a program relationship list of the target application, wherein the program relationship list is used to store association relationships between files involved in the target application; and determine the at least one file as the third data.

[0019] In some embodiments, the target data includes data in a plurality of files;

[0020] The determination unit is used to determine at least one target program relationship list from multiple program relationship lists of the target application based on the file types of the multiple files, the program relationship list being used to store the association relationship between files involved in the target application, and each program relationship list corresponding to a file type; for any file, based on the target program relationship list to which the file belongs, determine at least one file associated with the file; and determine at least one file associated with the multiple files as the third data.

[0021] In some embodiments, the target data is at least one subfile in the target file;

[0022] The determination unit is used to determine at least one target sub-file associated with the target data based on a file relationship list of the target file, wherein the file relationship list is used to store the association relationship between the sub-files of the target file; and determine the at least one target sub-file as the third data.

[0023] In some embodiments, the target data is at least one subfile in the target file;

[0024] The determination unit is used to determine at least one file associated with the target file based on a program relationship list of the target application, wherein the program relationship list is used to store the association relationship between different files involved in the target application; determine at least one target sub-file associated with the target data based on a file relationship list of the target file, wherein the file relationship list is used to store the association relationship between sub-files of the target file; and determine at least one file and the at least one target sub-file as the third data.

[0025] In some embodiments, the returning module is used to return the third data in the cached data to the target application in response to a data acquisition request of the target application for the third data.

[0026] On the other hand, a computer device is provided, which includes a processor and a memory, wherein the memory is used to store at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the data reading method in the embodiment of the present application.

[0027] On the other hand, a computer-readable storage medium is provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the data reading method in the embodiment of the present application.

[0028] On the other hand, a computer program product is provided, including a computer program, wherein the computer program is executed by a processor to implement the data reading method in the embodiment of the present application.

[0029] The present application provides a data reading method, which adds the associated data of the target data to the cache in advance, so that when the next data acquisition request for the associated data arrives, the cached associated data can be directly returned. Compared with the traditional data reading method, the use of this method avoids frequent access to the storage space, so it is less affected by the workload and the data reading efficiency is higher. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0031] Figure 1 It is a schematic diagram of an implementation environment of a data reading method provided according to an embodiment of the present application;

[0032] Figure 2 is a flow chart of a data reading method provided according to an embodiment of the present application;

[0033] Figure 3 is a flow chart of another data reading method provided according to an embodiment of the present application;

[0034] Figure 4 is a schematic diagram of a program relationship list provided according to an embodiment of the present application;

[0035] Figure 5 is a schematic diagram of a file relationship list provided according to an embodiment of the present application;

[0036] Figure 6 is a schematic diagram of a list of different types of program relationships provided according to an embodiment of the present application;

[0037] Figure 7 is a schematic diagram of a data reading process provided according to an embodiment of the present application;

[0038] Figure 8 is a schematic diagram of a data reading module provided according to an embodiment of the present application;

[0039] Fig. 9 is a flowchart of a modular data reading method provided according to an embodiment of the present application;

[0040] Fig.10 is a flowchart of another modular data reading method provided according to an embodiment of the present application;

[0041] Fig.11 is a block diagram of a data reading device provided according to an embodiment of the present application;

[0042] Fig.12 is a block diagram of another data reading device provided according to an embodiment of the present application;

[0043] Fig.13 is a schematic diagram of the structure of a terminal provided according to an embodiment of the present application;

[0044] Fig.14It is a structural diagram of a server provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0045] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0046] In this application, the terms "first", "second", etc. are used to distinguish identical or similar items with basically the same effects and functions. It should be understood that there is no logical or temporal dependency between "first", "second", and "nth", nor is there any limitation on quantity and execution order.

[0047] In the present application, the term "at least one" means one or more, and the term "plurality" means two or more.

[0048] The terms involved in this application are explained below.

[0049] PDF format, the full name is Portable Document Format, which is portable document format.

[0050] DOC format, the full name of which is Document, is a file that can contain text, pictures, tables and other contents.

[0051] The TXT format, full name of which is Plain text, is a standard text document that contains only unformatted text such as words, symbols, numbers, and line breaks.

[0052] The JPEG format, full name of Joint Photographic Experts Group, is an image format that can compress image files to the smallest size.

[0053] BMP format, full name Bitmap, is a standard image file format.

[0054] PNG format, full name Portable Network Graphics, is a lossless compressed bitmap graphic format.

[0055] GIF format, the full name of which is Graphics Interchange Format, is a public image file format standard.

[0056] MPEG format, the full name is Movin Picture Expert Group, which is the moving picture expert group format.

[0057] AVI format, the full name is Audio Video Interleaved, which is audio and video interleaved format.

[0058] MKV format, full name MKV file format, is a multimedia container file.

[0059] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the target data and third data involved in this application are obtained with full authorization.

[0060] Figure 1 Schematic diagram of an implementation environment of a data reading method provided according to an embodiment of the present application. Figure 1 The implementation environment includes a terminal 101 and a server 102. The terminal 101 and the server 102 can be directly or indirectly connected via wired or wireless communication, which is not limited in this application.

[0061] In some embodiments, the terminal 101 is a mobile phone, a desktop computer, a laptop computer, a tablet computer, a smart watch, and other types of terminals. An application can be installed and run on the terminal 101, and the application can send a data acquisition request to request target data and display the acquired target data. The user can log in to the application to view the reading results of the data reading. The application is associated with the server 102, and the server 102 provides background services to the terminal 101.

[0062] In some embodiments, server 102 is an independent physical server, or it can be a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.

[0063] In some embodiments, the server 102 undertakes the main computing work and the terminal 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work and the terminal 101 undertakes the main computing work; or, the server 102 and the terminal 101 adopt a distributed computing architecture to perform collaborative computing.

[0064] Figure 2is a flowchart of a data reading method provided according to an embodiment of the present application, the method is executed by a computer device, see Figure 2 , the method comprises the following steps:

[0065] 201. In response to a data acquisition request for target data from a target application, determine first data and second data, where the target application is the application that sends the data acquisition request, the first data is a cached portion of the target data, and the second data is a non-cached portion of the target data.

[0066] In an embodiment of the present application, in response to a data acquisition request for target data, the terminal traverses the cached data in the system to determine the first data and the second data. The data acquisition request is sent by an application in the system. The cached data refers to the data that has been cached in the system. The target data may be all or part of the data in a file, or all of the data in multiple files, or part of the data in multiple files. The files in the system may be document types, and the formats of document type files include PDF, DOC, and TXT, etc.; they may also be image types, and the formats of image type files include JPEG, BMP, PNG, and GIF, etc.; they may also be video types, and the formats of video type files include MPEG, AVI, and MKV, etc. The data in the system may be stored in the cache or in the local storage space. The first data is the data in the target data stored in the cache, and the second data is the data in the target data stored in the local storage space.

[0067] 202. Acquire second data and third data from a local storage space, where the third data is data associated with the target data.

[0068] In an embodiment of the present application, the terminal obtains the second data and the third data from the local storage space. The local storage space refers to the space used to store data when the data is stored on a storage device such as a local disk, a mobile hard disk, or an optical disk. The use of the local storage space can store a large amount of data without affecting the performance of the server. The data in the local storage space will not disappear after a power outage and will still be stored in the storage device.

[0069] The third data is data associated with the target data. For example, if the target data is any subfile in a document, the third data may be other subfiles in the document except the subfile; if the target data is any image in an album, the third data may be other images adjacent to the image.

[0070] 203. Cache the third data, and return the target data to the target application.

[0071] In an embodiment of the present application, the terminal caches the third data and returns the target data. The cache is used to temporarily store data, and the stored data will disappear after power failure. After the third data is added to the cache, when the next data acquisition request for the third data arrives, the third data is directly returned from the cache. Compared with returning the third data from the local storage space, the above method is more efficient.

[0072] The embodiment of the present application provides a data reading method, which adds the associated data of the target data to the cache in advance, so that when the next data acquisition request for the associated data arrives, the cached associated data can be directly returned. Compared with the traditional data reading method, the use of this method avoids frequent access to the storage space, so it is less affected by the workload and has higher data reading efficiency.

[0073] Figure 3 is a flowchart of another data reading method provided according to an embodiment of the present application, the method is executed by a computer device, see Figure 3 , the method comprises the following steps:

[0074] 301. In response to a data acquisition request for target data from a target application, determine first data and second data, where the target application is the application that sends the data acquisition request, the first data is a cached portion of the target data, and the second data is a non-cached portion of the target data.

[0075] In the embodiment of the present application, in response to a data acquisition request for target data, the terminal traverses cached data in the system to determine the first data and the second data.

[0076] The data acquisition request is sent by the application in the system. Cache data refers to the data that has been cached in the system. The target data can be all or part of the data in a file, all the data in multiple files, or part of the data in multiple files. The files in the system can be document types, and the formats of document type files include PPT, WORD, EXCEL, TXT, etc.; they can also be image types, and the formats of image type files include JPG, BMP, PNG, GIF, etc.; they can also be video types, and the formats of video type files include MP4, MOV, MKV, etc. The data in the system can be stored in the cache or in the local storage space.

[0077] The first data is the data in the target data stored in the cache, that is, the part of the target data that is the same as the cache data. The second data is the data in the target data stored in the local storage space, that is, the part of the target data other than the first data. The first data can be empty, and the second data can also be empty, but the first data and the second data will not be empty at the same time.

[0078] It should be noted that in the embodiment of the present application, the terminal mainly refers to a terminal equipped with an Android system, including a mobile phone, a tablet, and a computer, etc. Optionally, terminals equipped with other systems can also use this method, and the embodiment of the present application does not limit this.

[0079] Optionally, when the same application reads files of the same type but different formats, the reading methods are not completely the same; when the same application reads files of different types, the reading methods are not completely the same; when different applications read files of the same type, the reading methods are not completely the same.

[0080] For example, when the first application reads document type files of different formats, there are differences in the reading methods. When the first application reads a 10M PPT format file, all readings are completed after 1000 reads; when the first application reads a 10M TXT format file, all readings are completed after 100 reads. In addition, when the first application reads document type files of different formats, there are differences in the reading positions. When the first application reads a TXT format file, the probability of sequential reading and writing is higher, and the probability of random reading and writing is lower; when the first application reads a PPT format file, the probability of random reading and writing is higher, and the probability of sequential reading and writing is lower. Similarly, there may be differences in the reading methods when the first application reads document type files and video type files. When the second application and the first application both read the same type of file, there may also be differences in the reading methods.

[0081] In some embodiments, the terminal may first determine the first data and then determine the second data. Accordingly, in response to a data acquisition request for the target data, the terminal matches the target data with the cached data, and determines the portion of the cached data that is identical to the target data as the first data; the terminal determines the portion of the target data other than the first data as the second data. In the above manner, it is possible to determine which data in the target data is not cached, and then quickly acquire the uncached data, i.e., the second data.

[0082] For example, the data acquisition request sent by the file manager is a request to obtain any document. After receiving the data acquisition request, the terminal traverses the cached data in the memory, determines the portion of the cached data that is the same as the document data as the first data, and determines the portion of the document data other than the first data as the second data. The data acquisition request sent by the photo album is a request to obtain the first image and the second image. After receiving the data acquisition request, the terminal traverses the cached data in the memory, determines the first image in the cached data as the first data, and determines the second image as the second data.

[0083] 302. Acquire second data from the local storage space.

[0084] In an embodiment of the present application, the terminal obtains the second data from the local storage space. The local storage space refers to the space used to store data when the data is stored on the storage device. The local storage space can be used to store a large amount of data without affecting the performance of the server. The data in the local storage space will not disappear after power failure and will still be stored in the storage device. The storage device includes a local disk, a mobile hard disk, a memory card, and an optical disk. For example, an image is obtained from the memory card of a mobile phone.

[0085] In some embodiments, in response to a data acquisition request for target data, the terminal traverses cached data, where the cached data refers to data that has been cached in the system; in response to the cached data including the target data, the terminal returns the target data.

[0086] For example, the data acquisition request sent by the album is a request to acquire the first image, the terminal traverses the cached data, and in response to the cached data including the first image, the terminal returns the first image.

[0087] In some embodiments, before the terminal returns the target data, it can also cache the associated data of the target data, so that when the next data acquisition request for the associated data arrives, the cached associated data can be directly returned, thereby improving the data reading efficiency. For ease of explanation, the above-mentioned associated data is referred to as the third data. The process of caching the third data is shown in steps 303 to 307 below.

[0088] 303. Determine at least one file associated with the target file based on a program relationship list of the target application, where the program relationship list is used to store association relationships between different files involved in the application.

[0089] In the embodiment of the present application, the target data is taken as at least one sub-file in the target file as an example for explanation. At this time, the terminal determines the program relationship list of the target application and determines at least one file associated with the target file based on the program relationship list.

[0090] Optionally, each application corresponds to a program relationship list, and the program relationship list is used to store the relationship between different files involved in the application. The different files involved in the application may refer to the files called by the application at runtime. For example, the different files involved in the album may be images and videos in the album; the different files involved in the file manager may be images, videos, and documents, etc. Optionally, an application may also correspond to multiple program relationship lists, each program relationship list corresponding to a file type. Accordingly, the program relationship list in this step may be a program relationship list corresponding to the file type to which the target file belongs.

[0091] It should be noted that a program relationship list can be established only for commonly used applications. For example, a program relationship list is established for a file manager that is frequently accessed, and a program relationship list is established for video software that is used for a long time. There is no need to establish a program relationship list for photo albums that are rarely accessed and used for a short time. This embodiment of the present application does not limit this. It should be noted that the program relationship list can also be used to indicate the association relationship between the target application and all files in the system, and this embodiment of the present application does not limit this.

[0092] To make the structure of the program relationship list clearer, see Figure 4 As shown, Figure 4 It is a schematic diagram of a program relationship list provided according to an embodiment of the present application. Among them, there are application programs such as APP1, APP2 and APPn in the system, and the program relationship list corresponding to APP1 stores the relationship between files such as file 1, file 2 and file n, the program relationship list corresponding to APP2 stores the relationship between files such as file 1, file 2 and file n, and the program relationship list corresponding to APPn stores the relationship between files such as file 1, file 2 and file n.

[0093] It should be noted that file 1 in the program relationship list corresponding to applications such as APP1, APP2, and APPn is only a synonym, which can refer to the same file in the system or different files in the system. The embodiment of the present application does not require this, and the same applies to file 2 and file n. For example, the program relationship list corresponding to the photo album stores the relationship between file 1 and other files, in which case file 1 refers to the first image; the program relationship list corresponding to the file manager stores the relationship between file 1 and other files, in which case file 1 can refer to the first image or the first document.

[0094] For example, see Figure 4 As shown, APP1 sends a data acquisition request for target data, where the target data refers to sub-file 1 in file 1. At this time, the terminal determines file 2 associated with file 1 based on the program relationship list of APP1.

[0095] 304. Determine at least one target sub-file associated with the target data based on the file relationship list of the target file, where the file relationship list is used to store the association relationship between the sub-files of the target file.

[0096] In an embodiment of the present application, the terminal determines a file relationship list of the target file, and determines at least one target sub-file associated with the target data based on the file relationship list.

[0097] Among them, each file corresponds to a file relationship list, and the file relationship list of any file is used to store the association relationship between the sub-files of the file. The sub-files of a file may refer to the data segments that make up the file, and the sub-files are obtained by dividing the file in equal proportions. The way of dividing the sub-files is determined based on the reading ability of the terminal. When the reading ability of the terminal is poor, the file can be divided into more sub-files, that is, the size of a single sub-file is smaller; when the reading ability of the terminal is good, the file can be divided into fewer sub-files, that is, the size of a single sub-file is larger.

[0098] For example, a 1M file, that is, a 1024KB file, can be divided into 16 parts, that is, the sub-file size can be defined as 64KB. The sub-file is in KB, and the interval of sub-file 1 is described as [0, 64KB), the interval of sub-file 2 is described as [64KB, 128KB), and the subsequent sub-files are similar.

[0099] To make the structure of the file relationship list clearer, see Figure 5 As shown, Figure 5 This is a schematic diagram of a file relationship list provided according to an embodiment of the present application. In the system, there are files such as file 1, file 2, and file n. The file relationship list corresponding to file 1 stores the file relationship between sub-files such as sub-file 1, sub-file 2, and sub-file n. The file relationship list corresponding to file 2 stores the file relationship between sub-files such as sub-file 1, sub-file 2, and sub-file n. The file relationship list corresponding to file n stores the file relationship between sub-files such as sub-file 1, sub-file 2, and sub-file n.

[0100] It should be noted that the sub-file 1 in the file relationship list corresponding to the files such as file 1, file 2 and file n is only a pseudonym, referring to the corresponding data segments in the files such as file 1, file 2 and file n, respectively, and the same applies to file 2 and file n. For example, the file relationship list corresponding to file 1 stores the relationship between sub-file 1 and other sub-files, and in this case, sub-file 1 refers to a part of the data segment in file 1; the file relationship list corresponding to file 2 stores the relationship between sub-file 1 and other sub-files, and in this case, sub-file 1 refers to a part of the data segment in file 2.

[0101] For example, see Figure 5 As shown, APP1 sends a data acquisition request for target data, where the target data refers to subfile 1 in file 1. At this time, the terminal determines subfile 2 associated with subfile 1 based on the file relationship list of file 1.

[0102] 305. Determine at least one file and at least one target sub-file as third data.

[0103] In the embodiment of the present application, the terminal determines at least one file and at least one target sub-file as third data.

[0104] For example, see Figure 4 and Figure 5 As shown, APP1 sends a data acquisition request for target data, and the target data refers to subfile 1 in file 1. The terminal determines file 2 associated with file 1 based on the program relationship list of APP1; the terminal determines subfile 2 associated with subfile 1 based on the file relationship list of file 1. The terminal determines file 2 and subfile 2 as third data.

[0105] In some embodiments, the target data includes data in multiple files, and the terminal determines the third data based on the program relationship list of the target application. Accordingly, the terminal determines at least one file associated with the multiple files based on the program relationship list of the target application, and the program relationship list is used to store the association relationship between the files involved in the target application; the terminal determines the at least one file as the third data. The target data may include all the data in the multiple files, or may include part of the data in the multiple files.

[0106] For example, see Figure 4 and Figure 5 As shown, APP1 sends a data acquisition request for target data. The target data may be file 1 and file 2. At this time, the terminal determines at least one file associated with file 1 and file 2 as the third data based on the program relationship list of APP1; the target data may be any sub-file in file 1 and any sub-file in file 2. At this time, the terminal determines at least one file associated with file 1 and file 2 as the third data based on the program relationship list of APP1.

[0107] In some embodiments, the target data includes data in multiple files, and each program relationship list corresponds to a file type. Accordingly, the terminal determines at least one target program relationship list from multiple program relationship lists of the target application based on the file types of the multiple files, and the program relationship list is used to store the association relationship between files involved in the target application, and each program relationship list corresponds to a file type; for any file, the terminal determines at least one file associated with the file based on the target program relationship list to which the file belongs; the terminal determines at least one file associated with the multiple files as the third data.

[0108] To make the list of different types of program relationships more clearly structured, see Figure 6 As shown, Figure 6It is a schematic diagram of a program relationship list of different types provided according to an embodiment of the present application. Among them, any APP has program relationship lists of types such as type 1, type 2 and type 3. The program relationship list of type 1 stores the relationship between files such as file 1, file 2 and file 3, the program relationship list of type 2 stores the relationship between files such as file a, file b and file c, and the program relationship list of type 3 stores the relationship between files such as file A, file B and file C.

[0109] For example, see Figure 5 and Figure 6 As shown, APP sends a data acquisition request for target data. APP has multiple program relationship lists of multiple types such as type 1, type 2 and type 3. The target data is file 1 belonging to type 1 and file 2 belonging to type 1. At this time, the terminal determines the program relationship list of type 1 from the above multiple program relationship lists, and determines at least one file associated with file 1 and file 2 as the third data; the target data is file 1 belonging to type 1 and file a belonging to type 2. At this time, the terminal determines the program relationship list corresponding to type 1 and the program relationship list corresponding to type 2 from the above multiple program relationship lists, and determines at least one file associated with file 1 and at least one file associated with file a as the third data.

[0110] In some embodiments, the target data is at least one subfile in the target file, and the terminal determines the third data based on the file relationship list of the target file. Accordingly, the terminal determines at least one target subfile associated with the target data based on the file relationship list of the target file, and the file relationship list is used to store the association relationship between the subfiles of the target file; the terminal determines the at least one target subfile as the third data.

[0111] For example, see Figure 4 and Figure 5 As shown, APP1 sends a data acquisition request for target data. The target data refers to subfile 1 in file 1. At this time, based on the file relationship list of file 1, the terminal determines subfile 2 associated with subfile 1 as the third data.

[0112] It should be noted that the above exemplary illustrates an optional processing method for obtaining the third data when the target data is at least one sub-file in the target file and the target data is data in multiple files. Accordingly, those skilled in the art can freely combine the above methods, including but not limited to first determining the target program relationship list based on the file type, then determining the associated file, and then determining the associated sub-file based on the file relationship list, which will not be repeated here.

[0113] It should be noted that the third data can be determined according to the workload of the system, and the workload refers to the request response time and the system memory, etc. For example, when the system memory is small, the third data can be determined for at least one target sub-file based only on the file relationship list of the target file; when the system memory is large, the at least one file and at least one target sub-file can be determined as the third data based on both the program relationship list of the target application and the file relationship list of the target file. The embodiments of the present application are not limited to this.

[0114] 306. Acquire third data from the local storage space.

[0115] In an embodiment of the present application, the terminal obtains the third data from the local storage space. The local storage space refers to the space used to store data when the data is stored on a storage device such as a local disk, a mobile hard disk, or an optical disk. The local storage space can be used to store a large amount of data without affecting the performance of the server. The data in the local storage space will not disappear after a power outage and will still be stored in the storage device.

[0116] 307. Cache the third data, and return the target data to the target application.

[0117] In an embodiment of the present application, the terminal caches the third data and returns the target data. The cache is used to temporarily store data, and the stored data will disappear after power failure. After the third data is added to the cache, when the next data acquisition request for the third data arrives, the third data is directly returned from the cache. Compared with returning the third data from the local storage space, the above method is more efficient.

[0118] See also Figure 7 As shown, Figure 7 is a schematic diagram of a data reading process provided according to an embodiment of the present application. Figure 7 The process of obtaining target data in response to a data acquisition request of the Android system is taken as an example. The entire system architecture is divided into user space and kernel space.

[0119] Among them, the two main objects in the user state are the application (APP) and the media provider component (hereinafter referred to as component 1). The application is the client, that is, the request initiator, such as the photo album and file manager; component 1 is the server, that is, it is used to respond to requests. Among them, the system call (syscall) is used to provide a communication interface between the user state and the kernel state. Mounting (Fuse mount) means that after connecting a file to a virtual disk or a virtual folder, the file can be used by accessing the virtual disk or virtual folder. The kernel layer (VFS, Virtual FileSystem) is used to provide a common kernel interface between the kernel and the file system. The request transfer module (Fuse driver) is used to transfer requests. The user space daemon (Fuse Daemon) is used to run in the background and implement request responses. The user space library (libfuse) is used to provide the functions required to read data. The read callback (Read callback) is used to implement data reading.

[0120] See also Figure 7 As shown, under the premise that the user space daemon has been successfully mounted as a file system, process 1 refers to when the application initiates a data acquisition request for the mounted target data, through the system call, through the kernel layer, to the request transfer module for processing; process 2 refers to the request transfer module forwarding the request to the user space daemon, the user space daemon relies on the user space library, implements the read callback in the user space system, and obtains the target data; process 3 refers to the user space daemon returning the target data to the request transfer module; process 4 refers to the request transfer module returning the target data to the application.

[0121] Among them, a data reading module (Cold and hot datamanger) is added to the user space daemon in component 1, and the client application is not modified. Component 1 after adding the data reading module can realize accelerated processing of data reading. For example, when the album accelerates the display of batch image thumbnails, the delay is lower; when the file manager copies files in batches, the rate is increased; when the video player plays ultra-high-definition videos, there is no lag. It should be noted that in addition to the above application scenarios, any scenario that requires data reading through component 1 will be optimized.

[0122] See also Figure 8 As shown, Figure 8: This is a schematic diagram of a data reading module provided according to an embodiment of the present application. The main components inside the data reading module are a data management module, a request processing module, and a cache management module. The data management module is used to manage program relationship lists and file relationship lists; the request processing module is used to interact with other modules and obtain data from local storage space; the cache management module is used to cache data and return target data.

[0123] To make the process of reading data using the above data management module clearer, see Fig. 9 As shown, Fig. 9 It is a flowchart of a modular data reading method provided according to an embodiment of the present application.

[0124] In response to the arrival of the data acquisition request in step 901, step 902 is executed, and the cache management module determines whether the cache data includes all the target data. If the cache data includes all the target data, step 903 is executed to notify the request processing module to process; step 905 is executed, and the cache management module caches the third data; then step 908 is executed, and the cache management module returns the target data. If the cache data does not include all the target data, that is, the cache data includes part of the target data or does not include the target data at all, step 904 is executed to notify the request processing module to process; step 906 is executed, and the request processing module obtains the second data from the local storage space; step 907 is executed, and the cache management module caches the third data; then step 908 is executed, the third data is cached, and the cache management module returns the target data.

[0125] To make the process of reading data using the above data management module clearer, see Fig.10 As shown, Fig.10 It is a flowchart of another modular data reading method provided according to an embodiment of the present application.

[0126] In which, in response to the arrival of the step data acquisition request, the cache management module executes step 1001 to determine whether the cache data includes all the target data. In response to the cache data not including all the target data, the cache management module executes step 1002 to send a data acquisition request for the second data to the request processing module. In response to receiving the data acquisition request, the request processing module executes step 1003 to obtain the second data from the local storage space. The data management module executes step 1004 to determine the third data based on the program relationship list and the file relationship list. The data management module executes step 1005 to send a data acquisition request for the third data to the request processing module. The data management module executes step 1006 to update the program relationship list and the file relationship list. The request processing module executes step 1007 to obtain the third data from the local storage space. The request processing module executes step 1008 to send a cache add request for the third data and a data return request for the target data to the cache management module. The cache management module executes step 1009 to cache the third data and return the target data.

[0127] 308. In response to the data acquisition request of the target application for the third data, return the third data in the cache data to the target application.

[0128] In the embodiment of the present application, when the target application requests to obtain the third data, since the third data has been added to the cache data, the terminal directly returns the third data in the cache data to the target application. Compared with the method of directly reading the third data from the storage space, this method is less affected by the workload and has a higher reading rate.

[0129] The embodiment of the present application provides a data reading method, which adds the associated data of the target data to the cache in advance, so that when the next data acquisition request for the associated data arrives, the cached associated data can be directly returned. Compared with the traditional data reading method, the use of this method avoids frequent access to the storage space, so it is less affected by the workload and has higher data reading efficiency.

[0130] Fig.11 is a block diagram of a data reading device provided according to an embodiment of the present application. The device is used to execute the steps of the above-mentioned data reading method. Fig.11 The data reading device includes: a determination module 1101, an acquisition module 1102 and a return module 1103.

[0131] A determination module 1101 is used to determine first data and second data in response to a data acquisition request of a target application for target data, wherein the target application is an application that sends a data acquisition request, the first data is a cached portion of the target data, and the second data is a non-cached portion of the target data;

[0132] An acquisition module 1102 is used to acquire second data and third data from a local storage space, where the third data is data associated with the target data;

[0133] The return module 1103 is used to cache the third data and return the target data to the target application.

[0134] In some embodiments, the determination module 1101 is also used to determine the portion of the cached data that is identical to the target data as the first data in response to a data acquisition request for the target data by the target application; and to determine the portion of the target data other than the first data as the second data.

[0135] In some embodiments, Fig.12 is a block diagram of another data reading device provided according to an embodiment of the present application. Fig.12 As shown, the device also includes:

[0136] In some embodiments, the acquisition module 1102 includes:

[0137] The first acquisition unit 1201 is used to acquire second data from the local storage space;

[0138] A determining unit 1202 is used to determine third data based on a data relationship list, where the data relationship list is used to record association relationships between data;

[0139] The second acquiring unit 1203 is configured to acquire third data from the local storage space.

[0140] In some embodiments, the target data includes data in a plurality of files;

[0141] The determining unit 1202 is used to determine at least one file associated with multiple files based on a program relationship list of the target application, where the program relationship list is used to store association relationships between files involved in the target application; and determine the at least one file as third data.

[0142] In some embodiments, the target data includes data in a plurality of files;

[0143] The determination unit 1202 is further used to determine at least one target program relationship list from multiple program relationship lists of the target application based on the file types of multiple files, where the program relationship list is used to store the association relationship between files involved in the target application, and each program relationship list corresponds to a file type; for any file, based on the target program relationship list to which the file belongs, determine at least one file associated with the file; and determine at least one file associated with the multiple files as third data.

[0144] In some embodiments, the target data is at least one subfile in the target file;

[0145] The determining unit 1202 is further configured to determine at least one target sub-file associated with the target data based on a file relationship list of the target file, wherein the file relationship list is used to store the association relationship between sub-files of the target file; and determine the at least one target sub-file as the third data.

[0146] In some embodiments, the target data is at least one subfile in the target file;

[0147] The determination unit 1202 is further used to determine at least one file associated with the target file based on a program relationship list of the target application, the program relationship list being used to store the association relationship between different files involved in the target application; determine at least one target sub-file associated with the target data based on a file relationship list of the target file, the file relationship list being used to store the association relationship between sub-files of the target file; and determine at least one file and at least one target sub-file as third data.

[0148] The present application provides a data reading device, which adds the associated data of the target data to the cache in advance, so that when the next data acquisition request for the associated data arrives, the cached associated data can be directly returned. Compared with the traditional data reading method, the use of this method avoids frequent access to the storage space, so it is less affected by the workload and has higher data reading efficiency.

[0149] It should be noted that: the data reading device provided in the above embodiment is only illustrated by the division of the above functional modules when running an application program. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the terminal is divided into different functional modules to complete all or part of the functions described above. In addition, the data reading device provided in the above embodiment and the data reading method embodiment belong to the same concept, and the specific implementation process is shown in the method embodiment, which will not be repeated here.

[0150] Fig.131 is a schematic diagram of a terminal structure provided according to an embodiment of the present application. The terminal 1300 may be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The terminal 1300 may also be referred to as a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0151] Typically, the terminal 1300 includes a processor 1301 and a memory 1302 .

[0152] The processor 1301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1301 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1301 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0153] The memory 1302 may include one or more computer-readable storage media, which may be non-transitory. The memory 1302 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1302 is used to store at least one computer program, which is used to be executed by the processor 1301 to implement the data reading method provided in the method embodiment of the present application.

[0154] In some embodiments, the terminal 1300 may further optionally include: a peripheral device interface 1303 and at least one peripheral device. The processor 1301, the memory 1302 and the peripheral device interface 1303 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1303 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1304, a display screen 1305, a camera assembly 1306, an audio circuit 1307 and a power supply 1308.

[0155] The peripheral device interface 1303 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1301 and the memory 1302. In some embodiments, the processor 1301, the memory 1302, and the peripheral device interface 1303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1301, the memory 1302, and the peripheral device interface 1303 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0156] The radio frequency circuit 1304 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1304 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1304 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. In some embodiments, the radio frequency circuit 1304 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1304 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1304 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0157] The display screen 1305 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1305 is a touch display screen, the display screen 1305 also has the ability to collect touch signals on the surface or above the surface of the display screen 1305. The touch signal can be input to the processor 1301 as a control signal for processing. At this time, the display screen 1305 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1305 can be one, set on the front panel of the terminal 1300; in other embodiments, the display screen 1305 can be at least two, respectively set on different surfaces of the terminal 1300 or in a folding design; in other embodiments, the display screen 1305 can be a flexible display screen, set on a curved surface or a folding surface of the terminal 1300. Even, the display screen 1305 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1305 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0158] The camera assembly 1306 is used to capture images or videos. In some embodiments, the camera assembly 1306 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal, and the rear camera is disposed on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and the VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1306 may also include a flash. The flash may be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0159] The audio circuit 1307 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1301 for processing, or input them into the radio frequency circuit 1304 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 1300. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1301 or the radio frequency circuit 1304 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1307 may also include a headphone jack.

[0160] The power supply 1308 is used to power various components in the terminal 1300. The power supply 1308 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1308 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0161] In some embodiments, the terminal 1300 further includes one or more sensors 1309 , including but not limited to: an acceleration sensor 1310 , a gyroscope sensor 1311 , a pressure sensor 1312 , an optical sensor 1313 , and a proximity sensor 1314 .

[0162] The acceleration sensor 1310 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 1300. For example, the acceleration sensor 1310 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 1301 can control the display screen 1305 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 1310. The acceleration sensor 1310 can also be used to collect motion data of games or users.

[0163] The gyro sensor 1311 can detect the body direction and rotation angle of the terminal 1300, and the gyro sensor 1311 can cooperate with the acceleration sensor 1310 to collect the user's 3D actions on the terminal 1300. The processor 1301 can implement the following functions based on the data collected by the gyro sensor 1311: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0164] The pressure sensor 1312 can be set on the side frame of the terminal 1300 and / or the lower layer of the display screen 1305. When the pressure sensor 1312 is set on the side frame of the terminal 1300, it can detect the user's holding signal of the terminal 1300, and the processor 1301 performs left and right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1312. When the pressure sensor 1312 is set on the lower layer of the display screen 1305, the processor 1301 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 1305. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0165] The optical sensor 1313 is used to collect the ambient light intensity. In one embodiment, the processor 1301 can control the display brightness of the display screen 1305 according to the ambient light intensity collected by the optical sensor 1313. Optionally, when the ambient light intensity is high, the display brightness of the display screen 1305 is increased; when the ambient light intensity is low, the display brightness of the display screen 1305 is decreased. In another embodiment, the processor 1301 can also dynamically adjust the shooting parameters of the camera assembly 1309 according to the ambient light intensity collected by the optical sensor 1313.

[0166] The proximity sensor 1314, also called a distance sensor, is disposed on the front panel of the terminal 1300. The proximity sensor 1314 is used to collect the distance between the user and the front of the terminal 1300. In one embodiment, when the proximity sensor 1314 detects that the distance between the user and the front of the terminal 1300 is gradually decreasing, the processor 1301 controls the display screen 1305 to switch from the screen-on state to the screen-off state; when the proximity sensor 1314 detects that the distance between the user and the front of the terminal 1300 is gradually increasing, the processor 1301 controls the display screen 1305 to switch from the screen-off state to the screen-on state.

[0167] Those skilled in the art will understand that Fig.13 The structure shown in the figure does not constitute a limitation on the terminal 1300, and the terminal 1300 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0168] Fig.14It is a structural diagram of a server provided according to an embodiment of the present application. The server 1400 may have relatively large differences due to different configurations or performances, and may include one or more processors (Central Processing Units, CPU) 1401 and one or more memories 1402, wherein the memory 1402 stores at least one computer program, and the at least one computer program is loaded and executed by the processor 1401 to implement the data reading method provided by the above-mentioned various method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output, and the server may also include other components for implementing device functions, which will not be repeated here.

[0169] The embodiment of the present application also provides a computer-readable storage medium, in which at least one computer program is stored, and the at least one computer program is loaded and executed by a processor to implement the data reading method in the above embodiment. For example, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device.

[0170] The embodiment of the present application also provides a computer program product, including a computer program, which is executed by a processor to implement the data reading method in the embodiment of the present application.

[0171] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0172] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A data reading method, characterized in that: The method comprises: In response to a data acquisition request of a target application for target data, determining first data and second data, the target application being the application that sends the data acquisition request, the first data being a cached portion of the target data, and the second data being a non-cached portion of the target data; Acquire the second data and third data from the local storage space, wherein the third data is data associated with the target data; The third data is cached, and the target data is returned to the target application.

2. The method according to claim 1, characterized in that The determining of the first data and the second data in response to a data acquisition request of the target application for the target data comprises: In response to a data acquisition request of a target application for target data, determining a portion of the cached data that is identical to the target data as the first data; A portion of the target data except the first data is determined as the second data.

3. The method according to claim 1, characterized in that The acquiring the second data and the third data from the local storage space includes: Acquire the second data from the local storage space; Determine the third data based on a data relationship list, wherein the data relationship list is used to record association relationships between data; The third data is acquired from the local storage space.

4. The method according to claim 3, characterized in that The target data includes data in multiple files; The determining the third data based on the data relationship list includes: Determining at least one file associated with the plurality of files based on a program relationship list of the target application, wherein the program relationship list is used to store association relationships between files involved in the target application; The at least one file is determined as the third data.

5. The method according to claim 3, characterized in that: The target data includes data in multiple files; The determining the third data based on the data relationship list includes: Based on the file types of the multiple files, determining at least one target program relationship list from the multiple program relationship lists of the target application, the program relationship list being used to store association relationships between files involved in the target application, each program relationship list corresponding to one file type; For any file, based on the target program relationship list to which the file belongs, determining at least one file associated with the file; At least one file associated with the plurality of files is determined as the third data.

6. The method according to claim 3, characterized in that The target data is at least one subfile in the target file; The determining the third data based on the data relationship list includes: Determine at least one target sub-file associated with the target data based on a file relationship list of the target file, wherein the file relationship list is used to store the association relationship between the sub-files of the target file; The at least one target sub-file is determined as the third data.

7. The method according to claim 3, characterized in that The target data is at least one subfile in the target file; The determining the third data based on the data relationship list includes: Determining at least one file associated with the target file based on a program relationship list of the target application, wherein the program relationship list is used to store association relationships between different files involved in the target application; Determine at least one target sub-file associated with the target data based on a file relationship list of the target file, wherein the file relationship list is used to store the association relationship between the sub-files of the target file; At least one file and the at least one target sub-file are determined as the third data.

8. The method according to claim 1, characterized in that The method further comprises: In response to the data acquisition request of the target application for the third data, the third data in the cache data is returned to the target application.

9. A data reading device, characterized in that: The device comprises: a determination module, configured to determine first data and second data in response to a data acquisition request of a target application for target data, wherein the target application is an application that sends the data acquisition request, the first data is a cached portion of the target data, and the second data is a non-cached portion of the target data; An acquisition module, configured to acquire the second data and third data from a local storage space, wherein the third data is data associated with the target data; The return module is used to cache the third data and return the target data to the target application.

10. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory is used to store at least one computer program, and the at least one computer program is loaded by the processor to execute the data reading method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store at least one computer program, and the at least one computer program is used to execute the data reading method according to any one of claims 1 to 8.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the data reading method according to any one of claims 1 to 8 is implemented.

Images