A method and device for visual detection of serialized data, a terminal and a medium

Abstract

The application relates to a method and device for visualizing detection of serialized data, a terminal and a medium. The application preloads serialized data structures and deserialization methods of serialized data application; the serialized data is deserialized and parsed by the deserialization method to determine each serialized data structure contained in the serialized data and / or a data area that cannot be deserialized; different serialized data structures and members in the serialized data structures are represented by different color block icons, and the data area that cannot be deserialized is represented by a fault icon; according to the order of each serialized data structure and / or the data area that cannot be deserialized in the serialized data, each block icon and / or the fault icon is combined to form a visual sequence diagram. The application can more intuitively display the composition and design defects of the serialized data and improve analysis efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of serialized data detection, and in particular to a serialized data visualization detection method and device, a terminal and a medium. BACKGROUND

[0002] In various software, there are many processes that need to serialize and deserialize data, such as intermediate data saved by software, cache, etc. The serialization process is to process data according to certain rules, and then used for transmission or storage.

[0003] In the serialization process, the originally visible and practically meaningful data becomes a set of chaotic and practically meaningless serialized data stream. Even if the data is correctly serialized, if it is stored in a disk file, it will be difficult to analyze the composition of the data again. For both developers and maintenance personnel, it is very difficult to modify the form of data serialization or analyze whether the content in the serialized file is normal. The most effective form of current analysis of serialized files is debugging, which analyzes the composition or error of the serialized file through debugging. If the content of the serialized file is large and the structure is complex, debugging requires a lot of time to reason and judge. Especially for later developers, they do not know how the predecessors designed, and need to spend a long time to analyze without a good method. But even through debugging, it is difficult to locate the error place of the serialized content and the data causing the error. SUMMARY

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present application provides a serialized data visualization detection method, device, terminal and medium.

[0005] In a first aspect, the present application provides a serialized data visualization detection method, comprising: preloading target serialization data structure and target deserialization method of serialization data application; performing deserialization analysis processing on the serialization data by the target deserialization method, and determining that the serialization data contains a deserialization-unable data region and the target serialization data structure, and the arrangement order of the deserialization-unable data region and the target serialization data structure by matching the analysis content with the preloaded target serialization data structure; representing different target serialization data structures and members in the target serialization data structure by different color box icons, and representing the deserialization-unable data region by a set fault icon; and combining each box icon and the fault icon according to the arrangement order of each target serialization data structure and the deserialization-unable data region in the serialization data to form a visual serialization diagram.

[0006] Further, a database containing a plurality of loadable serialization data structures and deserialization methods is pre-configured, the name of the target serialization data structure and the name of the target deserialization method of the serialization data to be tested are obtained, and the corresponding serialization data structure and deserialization method are matched from the database using the target serialization data structure and the target deserialization method to load.

[0007] Further, the content defined in the serialization data structure includes:

[0008] The members contained in the serialization data structure, the members being one or more of the serialization data structures of the set form data structure or other serialization data structure class instantiation;

[0009] The offset of each member, the length of the member;

[0010] The total length of the serialization data structure.

[0011] Further, the different target serialization data structures and members in the target serialization data structure are represented by different color box icons, including:

[0012] The members defined in the target serialization data structure, the member offset are obtained;

[0013] A first box icon named after the target serialization data structure name is constructed, a second box icon named after the member name is nested in the first box icon, and each second box icon is arranged in the order of the members defined by the member offset;

[0014] The mapping relationship in the dynamic mapping table is matched to obtain the corresponding color; the first box icon and the second box icon are rendered with the obtained color.

[0015] Further, a dynamic mapping table containing the mapping relationship between the serialization data structure and the color and the mapping relationship between the member and the color is constructed; when a new target serialization data structure and / or member is parsed from the serialization data, the mapping relationship between the new target serialization data structure and / or member and the color not configured in the dynamic mapping table is established, and the mapping relationship is added to the dynamic mapping table; when new serialization data is detected, the dynamic mapping table is cleared.

[0016] Further, the offset and length of each target serialization data structure are displayed in the visualization sequence diagram.

[0017] Further, the fault icon is configured with a fault identifier different from the box icon.

[0018] In a second aspect, the present application provides a device for visualizing detection of serialized data, comprising: a database module configured to configure a serialized data structure and a deserialization method;

[0019] a serialized data collection module configured to collect serialized data to be detected;

[0020] a parsing module configured to pre-load a target serialized data structure and a target deserialization method of an application of the serialized data to be detected from the database module, to perform deserialization and parsing processing on the serialized data by using the target deserialization method, and to determine, by matching the parsed content with the pre-loaded target serialized data structure, that the serialized data contains a data region that cannot be deserialized and the target serialized data structure, and an arrangement order of the data region that cannot be deserialized and the target serialized data structure;

[0021] a visualization module configured to represent different target serialized data structures and members in the target serialized data structures by using different color block icons, to represent the data region that cannot be deserialized by using a set fault icon, and to form a visual sequence diagram by combining each block icon and / or the fault icon according to an arrangement order of each target serialized data structure and the data region that cannot be deserialized in the serialized data.

[0022] In a third aspect, the present application provides a terminal for visualizing detection of serialized data, comprising: at least one processing unit, a storage unit, a bus unit, an input unit and an output unit, wherein the bus unit is connected to the processing unit, the output unit, the input unit and the storage unit, the storage unit stores a computer program and serialized data to be detected, and the processing unit executes the computer program to realize the method for visualizing detection of serialized data.

[0023] In a fourth aspect, the present application provides a storage medium for realizing a method for visualizing detection of serialized data, wherein the storage medium stores a computer program, and the computer program is executed by a processor to realize the method for visualizing detection of serialized data.

[0024] Compared with the prior art, the above technical solution provided by the embodiments of the present application has the following advantages:

[0025] After the serialized data is deserialized, the different serialized data structures and members in the serialized data structures are represented by different color block icons, and the data area that cannot be deserialized is represented by a set fault icon, and the visual sequence diagram formed by the block icons and the fault icon intuitively displays the serialized data structure composition of the serialized data and the error position. For the software or application applied to the serialized data, the application can quickly analyze the serialized data through the visual sequence diagram, determine the serialized data composition and design defects, provide a more intuitive method and means for troubleshooting, improve efficiency, and analyze the serialization process in a more intuitive way to reduce learning costs. BRIEF DESCRIPTION OF DRAWINGS

[0026] The accompanying drawings, which are incorporated herein and form part of the specification, illustrate embodiments consistent with the present application and, together with the description, further serve to explain the principles of the application.

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, those skilled in the art can obtain other drawings according to these drawings without any creative effort.

[0028] Figure 1 A flowchart of a visual detection method of serialized data provided by an embodiment of the present application;

[0029] Figure 2 A flowchart of a target serialized data structure and a target deserialization method preloaded in a serialized data application provided by an embodiment of the present application;

[0030] Figure 3 A flowchart of different target serialized data structures and members in the target serialized data structures represented by different color block icons provided by an embodiment of the present application;

[0031] Figure 4 A flowchart of matching the target serialized data structure and the members in the dynamic mapping table to obtain the corresponding color provided by an embodiment of the present application;

[0032] Figure 5 A schematic diagram of a visual sequence diagram provided by an embodiment of the present application;

[0033] Figure 6 A schematic diagram of a visual detection device of serialized data provided by an embodiment of the present application;

[0034] Figure 7 A schematic diagram of a visual detection terminal of serialized data provided by an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative effort belong to the scope of protection of the present application.

[0036] It should be noted that, in this document, the terms "comprising", "containing" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device that includes a list of elements not only includes those elements, but also includes other elements not explicitly listed, or further includes elements inherent in such a process, method, article or device. Without more limitations, the element defined by the phrase "comprising a" does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.

[0037] Embodiment 1

[0038] The embodiments of the present application provide a visual detection method for serialized data, which aims to visually display the serialized data structure composition and error position of the serialized data by forming a visual sequence diagram of a box icon and a fault icon, by representing different serialized data structures and members in the serialized data structure by different color box icons, and representing data areas that cannot be deserialized by a set fault icon.

[0039] Referring to Figure 1 The visual detection method for serialized data provided by the embodiments of the present application includes the following steps:

[0040] S100, preloading a target serialized data structure and a target deserialization method of a serialized data application;

[0041] In the specific implementation process, referring to Figure 2 The step S100 includes: encapsulating the visual detection method for serialized data as a detection tool; preconfiguring a database containing a plurality of loadable serialized data structures and deserialization methods for the detection tool; inputting the name of the target serialized data structure of the serialized data application to be detected and the name of the target deserialization method through an input interface; and the detection tool loads the corresponding serialized data structure class and deserialization method from the database by using the name of the target serialized data structure and the name of the target deserialization method.

[0042] Specifically, the content defined in the serialized data structure includes:

[0043] The members contained in the serialized data structure are one or more of the serialized data structures instantiated by the data structure in fixed form or other serialized data structure class; wherein the fixed form member defines the length of the member;

[0044] The offset of each member is defined in the serialized data structure class;

[0045] The total length is defined in the serialized data structure class.

[0046] A serialized data structure (Struct1) containing members (Member1, Member2) and other serialized data structures (Struct3) is defined as follows:

[0047]

[0048] A serialized data structure (Struct2) containing only members (Member3, Member4) is defined as follows:

[0049]

[0050] The serialized data to be detected can be the serialized data in the memory during the debugging process of the program to be debugged, or the serialized data file generated during the running of the program. The detection tool is configured with an API interface for directly collecting serialized data in the memory and a script for traversing the serialized data file and reading the content of each traversed serialized data file, and the script supports batch processing of serialized data files. For serialized data in the memory, the API interface is directly called to read data from the memory storing the serialized data, and for serialized data files, the script is used to obtain the serialized data.

[0051] S200, the serialized data is deserialized and parsed by the target deserialization method.

[0052] S300, the parsed content is matched with the preloaded target serialized data structure to determine the data region that cannot be deserialized in the serialized data, the target serialized data structure, and the arrangement order of the data region that cannot be deserialized and the target serialized data structure.

[0053] S400, different target serialized data structures and members in the target serialized data structures are represented by different color box icons, and the data region that cannot be deserialized is represented by a set fault icon.

[0054] In the implementation, referring to Figure 3 As shown in the figure, the different target serialized data structures and the members in the target serialized data structures are represented by different color block icons, which include:

[0055] S401, obtaining the members and member offsets defined in each target serialized data structure in the serialized data.

[0056] S402, for each target serialized data structure, constructing a first block icon named after the target serialized data structure.

[0057] S403, nesting a second block icon named after a member in the first block icon, and arranging each second block icon according to the member order defined by the member offset.

[0058] S404, obtaining the corresponding color by matching the mapping relationship in the dynamic mapping table between the target serialized data structure and the member. The dynamic mapping table contains the mapping relationship between the serialized data structure and the color and the mapping relationship between the member and the color. Referring to Figure 4 As shown in the figure, the process of step S404 includes:

[0059] determining whether new serialized data is detected;

[0060] if new serialized data is detected, clearing the mapping relationship recorded in the dynamic mapping table;

[0061] if no new serialized data is detected, determining whether a new target serialized data structure and / or member is parsed from the serialized data in the process of parsing the serialized data, where the new target serialized data structure and / or member refers to a target serialized data structure and / or member that is not recorded in the dynamic mapping table;

[0062] if a new target serialized data structure and / or member is parsed, establishing a mapping relationship between the new target serialized data structure and / or member and a color that is not configured in the dynamic mapping table, adding the mapping relationship to the dynamic mapping table, obtaining the color in the mapping relationship, and performing S405;

[0063] if no new target serialized data structure and / or member is parsed, matching the parsed target serialized data and / or member with the mapping relationship in the dynamic mapping table to obtain the corresponding color and performing S405.

[0064] S405, rendering the first block icon and the second block icon with the obtained color to form the block icon of the target serialized data structure.

[0065] In a preferred embodiment, the fault icon is configured to be distinguished from the fault identification of the block icon.

[0066] The present application assigns different colors to different target serialization data structures and members in the same serialized data through a dynamic mapping table, ensures that the same color does not represent different objects, and does not need to manually configure colors for different serialization data structures and members, and is more suitable for color configuration of block icons in multi-serialization data detection.

[0067] S500, according to the arrangement order of each target serialization data structure and the data area that cannot be deserialized in the serialization data, corresponding combination of each block icon and the fault icon forms a visual sequence diagram.

[0068] Referring to Figure 5 As shown, the visual sequence diagram includes: a single visual sequence diagram containing only one serialization data structure; a composite visual sequence diagram containing at least two serialization data structures; and an abnormal visual sequence diagram containing a fault icon.

[0069] In a preferred embodiment, the offset and length of each target serialization data structure are displayed in the visual sequence diagram by the total length of the serialization data structure defined in the target serialization data structure corresponding to the block icon, and the ordering of each target serialization data structure in the serialization data.

[0070] Embodiment 2

[0071] Embodiment 2 discloses a device for visual detection of serialization data corresponding to the above-mentioned embodiment, for the virtual device structure of the above-mentioned embodiment, please refer to Figure 6 As shown, a visual detection device for serialization data includes:

[0072] A database module is configured to configure serialization data structures and deserialization methods.

[0073] A serialization data acquisition module is configured to acquire serialization data to be detected.

[0074] An analysis module is configured to pre-load target serialization data structures and target deserialization methods applied to the serialization data to be detected from the database module, to perform deserialization analysis processing on the serialization data by using the target deserialization method, and to determine the serialization data containing the data area that cannot be deserialized and the target serialization data structure, and the arrangement order of the data area that cannot be deserialized and the target serialization data structure by matching the analysis content with the pre-loaded target serialization data structure.

[0075] Preferably, the parsing module acquires the name of the target serialization data structure and the name of the target deserialization method of the serialization data to be tested, and loads the corresponding serialization data structure and deserialization method from the database by using the target serialization data structure and the target deserialization method.

[0076] The visualization module represents different target serialization data structures and members in the target serialization data structure by different color block icons, and represents the un-deserializable data area by a set fault icon, and forms a visual sequence diagram by combining each block icon and / or the fault icon according to the arrangement order of each target serialization data structure and the un-deserializable data area in the serialization data. Preferably, the visualization module acquires the members and member offsets defined in the target serialization data structure, constructs a first block icon named by the name of the target serialization data structure, nests a second block icon named by the name of the member in the first block icon, arranges each second block icon according to the member order defined by the member offset, acquires the corresponding color by matching the target serialization data structure and the member with the mapping relationship in the dynamic mapping table, and renders the first block icon and the second block icon by using the acquired color. Preferably, the visualization module maintains the dynamic mapping table, establishes the mapping relationship between the new target serialization data structure and / or member and the color not configured in the dynamic mapping table when a new target serialization data structure and / or member is parsed from the serialization data, adds the mapping relationship to the dynamic mapping table, and clears the dynamic mapping table when new serialization data is detected. Preferably, the visualization module displays the offset and length of each target serialization data structure in the visual sequence diagram.

[0077] Embodiment 3

[0078] The embodiment of the present application provides a serialization data visual detection terminal, which comprises at least one processing unit, a storage unit, a bus unit, an input unit and an output unit, the bus unit is connected with the processing unit, the output unit, the input unit and the storage unit, the storage unit stores a computer program and serialization data to be tested, and the processing unit executes the computer program to realize the serialization data visual detection method.

[0079] The storage unit, as a computer readable storage medium, can be used to store software programs, computer executable programs and modules, such as the software programs, computer executable programs and modules (for example, a database module, a serialized data collection module, an analysis module and a visualization module in a serialized data visualization device) corresponding to the serialized data visualization method in the embodiment of the present application. The processing unit realizes the above-mentioned serialized data visualization method by running the software programs, computer executable programs and modules stored in the storage unit.

[0080] The storage unit can mainly include a program storage area and a data storage area. The program storage area can store an operating system and application programs required by at least one function; and the data storage area can store serialized data to be tested and the like. In addition, the storage unit can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device or other non-volatile solid-state storage device. In some examples, the storage unit can further include a memory remotely arranged with respect to the processing unit, and these remote memories can be connected to the electronic device through a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0081] The input unit can be used to input the name of the target serialized data structure of the serialized data application to be tested and the name of the target deserialization method. The output unit includes a display device such as a display screen, to display the obtained visualization sequence diagram and the like.

[0082] Embodiment 4

[0083] The embodiment 4 of the present application also provides a storage medium for realizing the serialized data visualization method, and the computer program is executed by the processor to realize the serialized data visualization method. The method comprises the following steps of:

[0084] Preloading the target serialized data structure of the serialized data application and the target deserialization method; performing deserialization analysis processing on the serialized data by using the target deserialization method, matching the analysis content with the preloaded target serialized data structure to determine the order of the target serialized data structure contained in the serialized data and the data area that cannot be deserialized; using different color block icons to represent different target serialized data structures and members in the target serialized data structure, and using a set fault icon to represent the data area that cannot be deserialized; and combining each block icon and the fault icon according to the arrangement order of each target serialized data structure and the data area that cannot be deserialized in the serialized data to form a visualization sequence diagram.

[0085] Of course, the storage medium for implementing the method for visualizing detection of serialized data provided by the embodiments of the present application stores a computer program that is not limited to the method operations described above, and can also perform related operations in the method for visualizing detection of serialized data provided by any of the embodiments of the present application.

[0086] From the above description of the embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software and necessary universal hardware, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which can be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH, a hard disk, or an optical disc, and includes a number of instructions for causing an electronic device (which can be a mobile phone, a personal computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present application.

[0087] In the embodiments provided by the present application, it should be understood that the disclosed structure and method can be implemented in other ways. For example, the above-described structural embodiments are only illustrative, and for example, the division of the units is only a logical function division, and there can be another division manner in actual implementation, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, structures or units, and can be electrical, mechanical or other forms.

[0088] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., they can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the present embodiment.

[0089] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware, or in the form of a software functional unit.

[0090] The foregoing is considered as illustrative only of the principles of the application. Numerous modifications and changes will readily occur to those skilled in the art, and it is intended to embrace all such modifications and changes that fall within the scope of the application. Accordingly, the application is not to be restricted in scope to the specific embodiments disclosed herein but is to be accorded the full scope that the principles and novel features request appropriately granted.

Claims

1. A method for visually detecting serialized data, characterized in that, include: A pre-configured database containing various loadable serialization data structures and deserialization methods; Obtain the name of the target serialization data structure and the name of the target deserialization method for the serialized data application to be tested; use the name of the target serialization data structure and the name of the target deserialization method to match the corresponding serialization data structure and deserialization method from the database and load them; The serialized data is deserialized and parsed using the target deserialization method. The parsed content is matched with a preloaded target serialized data structure to determine the undeserializable data regions and the target serialized data structure contained in the serialized data, as well as the arrangement order of the undeserializable data regions and the target serialized data structure. The serialized data structure includes the following defined contents: members contained in the serialized data structure, the offset of each member, the length of each member, and the total length of the serialized data structure. The members are one or more of a data structure of a specified form or a serialized data structure instantiated from another serialized data structure class. Different colored boxes represent different target serialized data structures and their members, and a set fault icon represents the data area that cannot be deserialized; wherein, the different colored boxes representing different target serialized data structures and their members include: Obtain the members and member offsets defined in the target serialized data structure; construct a first box icon named after the target serialized data structure, nesting second box icons named after the members within the first box icon, with each second box icon arranged according to the member order defined by the member offset; match the target serialized data structure and members with the mapping relationship in the dynamic mapping table to obtain the corresponding color; render the first box icon and the second box icon with the obtained color; wherein, construct a dynamic mapping table containing the mapping relationship between serialized data structure and color, and between members and color; when a new target serialized data structure and / or member is parsed from the serialized data, establish a mapping relationship between the new target serialized data structure and / or member and a color not configured in the dynamic mapping table, and add the mapping relationship to the dynamic mapping table; when new serialized data is detected, the dynamic mapping table is cleared; according to the arrangement order of each target serialized data structure and the undeservable data area in the serialized data, combine each box icon and the fault icon to form a visual sequence diagram.

2. The method for visually detecting serialized data according to claim 1, characterized in that, The visual sequence diagram displays the offset and length of each target serialized data structure.

3. The method for visually detecting serialized data according to claim 1, characterized in that, The fault icon configuration is different from the fault identifier of the box icon.

4. A visualization detection device for serialized data, characterized in that, include: The database module is used to configure the serialization data structure and deserialization method; A serialized data acquisition module, which is used to acquire serialized data to be detected; The parsing module preloads the target serialized data structure and target deserialization method of the serialized data application to be tested from the database module. The database module is pre-configured with multiple loadable serialized data structures and deserialization methods. It obtains the name of the target serialized data structure and the name of the target deserialization method of the serialized data application to be tested. Using the names of the target serialized data structure and the target deserialization method, it matches the corresponding serialized data structure and deserialization method from the database module and loads them. It then performs deserialization parsing on the serialized data using the target deserialization method. The parsed content is matched against the preloaded target serialized data structure to determine the non-deserializable data regions and the target serialized data structure contained in the serialized data, as well as the order of these non-deserializable data regions and the target serialized data structure. The serialized data structure includes: members, which are one or more of a data structure of a specified form or an instance of another serialized data structure class; the offset of each member; the length of each member; and the total length of the serialized data structure. A visualization module uses different colored box icons to represent different target serialized data structures and their members, and uses set fault icons to represent data areas that cannot be deserialized. The visualization module combines the box icons and / or fault icons in the order of the target serialized data structures and their undeserialized data areas to form a visualization sequence diagram. The use of different colored box icons to represent different target serialized data structures and their members includes: Obtain the members and member offsets defined in the target serialized data structure; construct a first box icon named after the target serialized data structure, nesting second box icons named after the members within the first box icon, with each second box icon arranged in the member order defined by the member offset; match the target serialized data structure and members with the mapping relationship in the dynamic mapping table to obtain the corresponding color; render the first box icon and the second box icon with the obtained color; wherein, a dynamic mapping table containing the mapping relationship between the serialized data structure and color, and between members and color is constructed; when a new target serialized data structure and / or member is parsed from the serialized data, establish a mapping relationship between the new target serialized data structure and / or member and a color not configured in the dynamic mapping table, and add the mapping relationship to the dynamic mapping table; when new serialized data is detected, the dynamic mapping table is cleared.

5. A visualization detection terminal for serialized data, characterized in that, include: The system includes at least one processing unit, a storage unit, a bus unit, an input unit, and an output unit. The bus unit connects the processing unit, the output unit, the input unit, and the storage unit. The storage unit stores a computer program and serialized data to be tested. The processing unit executes the computer program to implement the visualization detection method for serialized data as described in any one of claims 1-3.

6. A storage medium for implementing a visual detection method for serialized data, the storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the visualization detection method for serialized data as described in any one of claims 1-3.

Images