Data display method and data display system
The data display method and system accelerate data display by generating a second database from a first database and displaying a subset of data, addressing slow data display issues and enabling real-time processing visibility.
Patent Information
- Application Number
- JP2021090456
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-05-28
- Publication Date
- 2025-01-20
- Estimated Expiration
- 2041-05-28
AI Technical Summary
Existing data display methods are slow due to the amount of data being processed, and depend on computer specifications, making real-time data display challenging.
A data display method and system that includes a storage step, generation of a second database from a first database based on conditions, user interaction, execution of processes on the second database, and display of results on a display unit, enabling faster data display through a sampling approach.
Enables faster data display by processing and displaying a subset of data, allowing users to see processing results in real-time without waiting for full data processing to complete.
Smart Images

Figure 0007617562000001 
Figure 0007617562000002 
Figure 0007617562000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a method and system for displaying results of a user performing a predetermined process on a plurality of data. [Background technology]
[0002] Conventionally, when integrating multiple data that are managed in a distributed manner on a daily basis (for example, master data such as store and product data and individual data such as sales data by store) for a specific purpose such as sales analysis, data corrections (for example, cleansing processes) such as eliminating duplicates between data and merging data are carried out in advance.
[0003] Cleansing processing is often performed periodically by batch processing, but a technology has been disclosed that performs cleansing processing in real time in response to a user request and executes data integration (Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2017-068475 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, when the data after the above-mentioned data processing is to be checked or further processed, it may take time to display the data depending on the amount of data. Also, the drawing ability for displaying the data depends on the specifications of the computer.
[0006] Therefore, an object of the present disclosure is to provide a data display method and system that enables faster data display. [Means for solving the problem]
[0007] According to the invention, a storage step in which a first database is stored; A generating step of extracting a predetermined amount of data from the first database in accordance with a predetermined condition to generate a second database; a receiving step of receiving a predetermined process for the data stored in the first database from a user; an execution step of executing the predetermined processing on the data stored in the second database; a display step of displaying the data after the execution on a display unit; Includes A method for providing data is provided. Effect of the Invention
[0008] According to the present disclosure, it is possible to provide a data display method and system that enables faster data display. [Brief description of the drawings]
[0009] [Figure 1] 1 is a block diagram showing a data processing system according to a first embodiment of the present disclosure. [Diagram 2] 2 is a functional block diagram showing the server device 100 of FIG. 1. [Diagram 3] 1 is a diagram showing an overview of a data display system according to a first embodiment of the present disclosure. [Figure 4] 2 is a functional block diagram showing a terminal device 200 of FIG. 1. [Diagram 5] 2 is a schematic diagram showing an example of processing target data stored in a server 100. FIG. [Figure 6] 1 is an example of a user interface displayed on a terminal device 200 according to the first embodiment of the present disclosure. [Figure 7] 4 is an example of a flowchart of data processing according to the first embodiment of the present disclosure. [Figure 8] 13 is an example of a flowchart of data processing according to a second embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the embodiments described below do not unduly limit the contents of the present disclosure described in the claims. In addition, not all components shown in the embodiments are necessarily essential components of the present disclosure.
[0011] [Item 1] a storage step in which the first database is stored; A generating step of extracting a predetermined amount of data from the first database in accordance with a predetermined condition to generate a second database; a receiving step of receiving a predetermined process for the data stored in the first database from a user; an execution step of executing the predetermined processing on the data stored in the second database; a display step of displaying the data after the execution on a display unit; Includes How data is provided. [Item 2] The data providing method according to item 1, further comprising an updating step of extracting a predetermined amount of data from the first database according to a predetermined condition and updating the contents of the second database; How data is provided. [Item 3] The data providing method according to item 1 or 2, updating the second database when the first database is updated. How data is provided.
[0012] (Embodiment 1) <Configuration> FIG. 1 is a block diagram showing a data display system 1 relating to a data display method according to a first embodiment of the present disclosure. The data processing system 1 is a system for performing data processing and correction (for example, cleansing processing) on distributed data for a predetermined purpose (for example, marketing analysis), executing data integration, and outputting and displaying the data as a marketing report. Note that the purpose of marketing analysis and the output of a marketing report are examples, and are not limited thereto, and may be a report for another purpose. In addition, the number of distributed data managed may be small or large, and is not limited, as long as at least two or more pieces of data are managed separately as the distributed data. In addition, the data format is also not limited to this, although a CSV file is given below as an example.
[0013] The data processing system 1 includes a server device (data processing device) 100, a terminal device 200, and a network NW. The server device 100 and the terminal device 200 are connected via the network NW. The network NW is configured by the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), or the like.
[0014] The server device 100 is a device that processes data, and may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.
[0015] The terminal device 200 is an information processing device such as a personal computer or tablet terminal owned by a user who uses the data processing system 1, but may also be configured as a smartphone, mobile phone, PDA, or the like.
[0016] In this embodiment, the data processing system 1 is described as having a server device 100 and a terminal device 200, and is configured to perform operations on the server device 100 using the terminal device 200, but the server device 100 may be configured as a stand-alone device, and the server device 100 itself may have a function for a user to perform operations.
[0017] Fig. 2 is a functional block diagram showing the server device 100 of Fig. 1. The server device 100 includes a communication unit 110, a storage unit 120, a control unit 130, a display control unit 140, and a display unit 150.
[0018] The communication unit 110 is a communication interface for communicating with the terminal device 200 and the Web server 300 via the network NW, and communication is performed according to a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).
[0019] The storage unit 120 stores programs for executing various control processes and functions in the control unit 130, input data, etc., and is composed of a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The storage unit 120 also has a processing target data storage unit 121 that stores data to be processed, an icon data storage unit 122 that stores icon data to be displayed on a user interface, and a processing flow storage unit 123 that associates and sequentially manages individual data processes. Furthermore, the storage unit 120 temporarily stores data communicated with the terminal device 200 and the Web server 300. A database (not shown) that stores data used in each process may be constructed outside the storage unit 120.
[0020] The control unit 130 controls the overall operation of the server device 100 by executing a program stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc. Functions of the control unit 130 include an instruction receiving unit 131 from the user's terminal device 120, a data processing unit 132, and an image generating unit 133. The instruction receiving unit 131, the data processing unit 132, and the image generating unit 133 are started by the program stored in the storage unit 120 and executed by the server device 100, which is a computer (electronic calculator).
[0021] The instruction receiving unit 131 receives instructions from the terminal device 200 via the communication unit 110 when the user makes a specific request (such as by pressing a specific icon) via a user interface such as a web screen provided by the server 100 and displayed on the terminal device 200.
[0022] When the user's request is related to data processing (for example, data cleansing, etc.), the data processing unit 132 executes the corresponding data processing.
[0023] The image generating unit 133 generates image information for constructing a user interface to be displayed on the terminal device 200. In particular, based on the icon data stored in the storage unit 120, the image generating unit 133 arranges various icons in a predetermined area on the user interface and generates images for displaying a screen for the user to perform other data processing instruction operations. The processing related to the image generating unit 133 can also be executed by a GPU (Graphics Processing Unit).
[0024] <Data display> The display control unit 140 has a function for displaying the data to be processed on the display unit 150. The display control unit 140 includes an extraction unit 142 that extracts data to be displayed on the display unit 150, a generation unit 144 that generates a sampling table (not shown) from the extracted data, and an update unit 146 that updates the contents of the sampling table.
[0025] The display unit 150 is a display device. Various display devices can be appropriately adopted.
[0026] <Example of data processing> 4 is a diagram showing an overview of the processing of the sampling table according to this embodiment. As shown in the figure, for example, data C is stored in the data to be processed. Data C may be any kind of data. A part C1 of such data C is extracted as sample data to generate a sampling table. The sampling table contains the part of data C1. The contents of this sampling table are displayed on the display unit 150.
[0027] Normally, if the data to be processed is output and displayed directly on a display unit, it may take a long time to display depending on the amount of data. In this embodiment, a portion of the data to be processed is extracted to generate a sampling table, and the contents of the sampling table are displayed, allowing for high-speed display.
[0028] Fig. 4 is a functional block diagram showing the terminal device 200 of Fig. 1. The terminal device 200 includes a communication unit 210, a display operation unit 220, a storage unit 230, and a control unit 240.
[0029] The communication unit 210 is a communication interface for communicating with the server device 100 via the network NW, and communication is performed according to a communication protocol such as TCP / IP.
[0030] The display operation unit 220 is a user interface used for inputting instructions by the user and displaying text, images, etc. according to input data from the control unit 240, and is composed of a display, a keyboard, and a mouse when the terminal device 200 is configured as a personal computer, and is composed of a touch panel, etc. when the terminal device 200 is configured as a tablet terminal. This display operation unit 220 is started up by a control program stored in the storage unit 230 and executed by the terminal device 200, which is a computer (electronic calculator).
[0031] The storage unit 230 stores programs for executing various control processes and functions in the control unit 240, input data, etc., and is composed of a RAM, a ROM, etc. The storage unit 230 also temporarily stores the contents of communication with the server device 100.
[0032] The control unit 240 controls the overall operation of the terminal device 200 by executing the programs stored in the storage unit 230, and is composed of a CPU, a GPU, and the like.
[0033] The server device 100 may have the function of a display operation unit, in which case the terminal device 200 may not be included.
[0034] FIG. 5 is a schematic diagram showing an example of processing target data stored in the storage unit 120 of the server 100. As shown in FIG.
[0035] The data to be processed is stored as, for example, a CSV file, and as shown in FIG. 4, data included in a single CSV file is managed by item. Here, an "item" corresponds to a column in the CSV file, and in the example shown in FIG. 4, values are input across multiple lines for each item according to a predetermined data type. Data types include integers (e.g., 0, 1, 2, 3), decimals (e.g., 0, 1.1, 2.2, 4.4), booleans (e.g., t (true), f (false), and text (e.g., hoge, hogehoge). Input values for each item include, for example, store ID, store name, member ID, member name, member rank, date of birth, address, age, sex, and sales amount. As data to be processed, the processing data storage unit 121 can store multiple CSV files managed by item.
[0036] FIG. 6 is an example of a user interface displayed on the terminal device 200 according to the first embodiment of the present disclosure.
[0037] First, as shown in FIG. 6(a), the user interface has an area 301 for arranging a plurality of operation icons for instructing the server device 100 to perform a specified data processing operation so that the user can perform the specified data processing operation, and an area 302 for displaying data items that are candidates for processing.
[0038] Arranged in area 301 are a row operation icon group 303 for performing operations on rows of data items, a data operation icon group 304 for performing operations on data included in data items, and a data item operation icon group 305 for performing operations on data items. Here, the icon group includes multiple operation icons, but may also be composed of a single icon.
[0039] 6, for example, the row operation icon group 303 is composed of “narrow down” icons for narrowing down data items. The row operation icons are icons for selecting (narrowing down) data items to be subjected to data processing among the multiple data items displayed in the area 302.
[0040] The data operation icon group 304 also includes, for example, a "replace" icon for replacing data (values) included in a data item, a "type conversion" icon for converting the data type of data included in a data item, an "extract" icon for extracting part of data from the data included in a data item, and a "remove" icon for removing part of data from the data included in a data item. Note that type conversion also includes data format conversion such as time zone conversion of data.
[0041] In addition, the item operation icon group 305 includes, for example, a “connect” icon that connects data items together, a “divide” icon that divides a data item into multiple data items, an “arithmetic operation” icon that performs arithmetic operations on a data item, and an “IF statement” icon that creates another data item based on a data item as a condition.
[0042] 6(a), the user first places the cursor or the like on the data item for which data processing is to be performed, and selects "item_4" from the multiple data items displayed in area 302. In this way, the user can select the data item to be processed while visually grasping what the multiple displayed data items are.
[0043] Next, the user selects, for example, a "Replace" icon from the data operation icon group 304 to request replacement processing for the data included in data item 4. Then, as shown in Fig. 6(b), a replacement operation screen is displayed by a pop-up on the user interface. In this way, by displaying the operation screen visually distinct from the background screen, the user can focus on the operation that he or she is about to perform.
[0044] As shown in FIG. 6(b), the replacement operation screen displays an item for specifying conditions for the data (character string) included in the data item, and the user can set the character string to be replaced and the replacement character string. In this example, "hoge" is set as the character string to be replaced, and "hogehoge" is set as the replacement character string. In addition, an item for setting the item name after the replacement operation is displayed. The user makes the necessary input in each item, and finally presses the "Execute" button to execute the data replacement process.
[0045] Here, as shown in Fig. 6(c), the user can increase the number of condition specification items as necessary by selecting the "+Add" button on the replacement operation screen. In addition to the "character string", for example, a blank item can be selected as the replacement target and a condition can be specified.
[0046] A typical example of replacement processing would be when correcting variations in the spelling of a company name to match the names. For example, if the input for the official name "ABC Co., Ltd." is made as the character string "ABC Co., Ltd." or "(Stock) ABC" in addition to "ABC Co., Ltd.", a replacement process for the data item can be requested, and on the replacement operation screen, "ABC Co., Ltd." and "(Stock) ABC" can be specified as the replacement target, and the replacement character string can be specified to be "ABC Co., Ltd.".
[0047] In this way, a user can request a specific data processing via an operation icon and can proceed while visually understanding a series of data processing steps, so that the disclosure of this embodiment makes it possible to provide a data processing system and method that are easy to operate.
[0048] <Processing flow> The flow of processing of the data processing method executed by the data processing system 1 of this embodiment will be described with reference to Fig. 7. Fig. 6 is an example of a flowchart showing the data processing method according to the first embodiment of the present disclosure.
[0049] To use the data processing system 1, the user accesses the server device 100 using an Internet browser or the like of the terminal device 200, and logs in after undergoing a predetermined authentication such as inputting an ID and password, and then the system can be used. After this authentication, a user interface such as that shown in Fig. 5 is provided via a web screen or the like, and the process proceeds to step S101 shown in Fig. 6.
[0050] First, in the process of step S101, the server device 100 accepts an operation request. For example, when a user operates the terminal device 200 to select data to be processed (e.g., a csv file) and selects a specific operation icon from a group of operation icons in a user interface as shown in Fig. 5, the instruction accepting unit 131 of the control unit 130 of the server device 100 receives a data addition instruction request from the terminal device 200 via the communication unit 110.
[0051] In step S102, the server device 100 determines which process the accepted operation request is related to. As described above, the operation icons include a row operation icon group, a data operation icon group, and an item operation icon group, and each icon group further includes each operation icon, so the instruction accepting unit 131 of the server device 100 determines a specific operation request from an identifier or the like included in the operation request.
[0052] If the operation request content in S102 is related to a row operation (in the example shown in FIG. 5, a "narrow down" operation), the server device 100 performs row operation processing as processing in step S103. For example, the data processing unit 132 of the control unit 130 of the server device 100 further provides, as the row operation, a selection screen for selecting a specific row in the data items to the user's terminal device 200, accepts a narrow down request from the user, and performs processing to narrow down to the selected data items.
[0053] If the operation request content in S102 is related to a data operation (in the example shown in FIG. 5, a "replace" operation), the server device 100 performs data operation processing as processing in step S104. For example, the data processing unit 132 of the control unit 130 of the server device 100 further provides a replacement operation screen for replacing data in a data item to the user's terminal device 200 as a data operation, accepts a replacement operation request for data included in a data item from the user (for example, a condition specification for replacing a character string "hoge" with "hogehoge"), and performs the requested replacement processing. Other examples of data operation processing include type conversion processing (converting the data type of an item), extraction processing (extracting some data from the data of an item), exclusion processing (removing some data from the data of an item), format processing (adjusting the format of the data of an item), name matching processing (matching using the value of an arbitrary item as a key), column sorting processing (rearranging the order of columns), etc.
[0054] If the operation request content in S102 is related to an item operation (in the example shown in FIG. 5, a "link" operation), the server device 100 performs item operation processing as processing in step S105. For example, the data processing unit 132 of the control unit 130 of the server device 100 further provides a data item selection screen for linking data items to the user's terminal device 200 as an item operation, accepts a data item selection request from the user (e.g., data item 1 and data item 2), and performs linking processing of the requested data items. Another example of linking processing is combining an item in which the month has been input with an item in which the day has been input with a hyphen. Other examples of item operations include basic processing (converting a serial value into a date and time), split processing (splitting a specific data item into multiple items), arithmetic operations (performing arithmetic operations on a specified data item), "IF statement" processing (creating another item based on a specified data item as a condition), append processing (adding a data item), delete processing (deleting a data item), "ranking" processing (ranking by a specific data item), reference processing (creating the first row value, last row value, previous row value, next row value, and nth value based on a ranking assigned by sorting by a specific item), and aggregation processing (aggregating records to obtain sums, counts, unique counts, maximum values, minimum values, averages, medians, deviations, displacements, concatenations, etc.).
[0055] In step S106, the server device 100 checks whether or not a further operation request has been received, and if there is no operation request, ends the process, but if an operation request has been received, returns to S102 and checks the process content.
[0056] As described above, data processing requests can be accepted via operation icons and data processing can be provided to the user through a means that is visually easy to understand. Therefore, the disclosure of this embodiment makes it possible to provide a data processing system and method that are highly user-friendly.
[0057] As described above, even if the data to be processed has been processed in some way, the data displayed is the contents of the sampling table, so that the state after processing can be previewed quickly. In other words, from the user's perspective, it is possible to have the user feel as if processing is being performed on the data to be processed, and in fact a sampling table (described later) is displayed in which the processing is synchronously reflected.
[0058] (Embodiment 2) 8, the second embodiment of the present invention has a function of updating the contents of the sampling table. That is, after the processing process described above is performed on the data to be processed, or when the data itself stored in the data to be processed is updated, the contents of the sampling table are updated in synchronization with the change.
[0059] This allows the user to carry out processing and view the results of processing as if he or she were always viewing the most recent data to be processed.
[0060] The amount of data in the sampling table can be set as appropriate, but for example, information on the display unit or a device having a display unit may be acquired, and the amount of data in the sampling table may be determined according to the information. This makes it possible to speed up the display of data on any device.
[0061] Although the disclosed embodiments have been described above, they can be implemented in various other forms and can be implemented with various omissions, substitutions, and modifications. These embodiments and modifications, as well as omissions, substitutions, and modifications, are included in the technical scope of the claims and their equivalents. [Explanation of symbols]
[0062] 1 Data display system 100 Server device, 110 Communication unit, 120 Storage unit, 130 Control unit, 200 Terminal device, NW Network
Claims
1. a storage step in which the first database is stored; a generating step of extracting a part of the data stored in the first database as sample data to generate a second database different from the first database; a receiving step of receiving a predetermined process for the data stored in the first database from a user; an execution step of executing the predetermined processing on the sample data stored in the second database; a display step of displaying the sample data after the execution on a display unit; The computer executes How data is provided.
2. The data providing method according to claim 1, an updating step, performed by the computer, of extracting a predetermined amount of data from the first database in accordance with a predetermined condition and updating the contents of the second database; How data is provided.
3. The data providing method according to claim 1 or 2, The computer further executes a step of updating the second database when the first database is updated. How data is provided.
Citation Information
Patent Citations
Duplicate data managing system for distributed data base management system
JP1988201844A
Update data confirmation system
JP2009271674A
Database coordination system and database coordination program
JP2017068475A
Data processing system
JP2020170439A