Analytical device, analytical method, and analytical program

The analysis device uses secure calculation to sort and delete records based on specified keys, addressing the challenge of unpredictable duplicate deletion in secure computing systems by ensuring desired records are retained.

JP2024160620APending Publication Date: 2024-11-14NTT COMM CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023075832
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-01
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Conventional secure computing systems face challenges in specifying which records to keep when deleting duplicates from a table, leading to unpredictable outcomes.

Method used

An analysis device that utilizes secure calculation to sort and delete records based on a specified key, ensuring that only the desired records are retained during duplicate deletion.

Benefits of technology

Enables precise control over which records are kept during duplicate deletion in secure computing environments, maintaining data confidentiality while achieving accurate results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024160620000001_ABST
    Figure 2024160620000001_ABST
Patent Text Reader

Abstract

To provide an analytical device for designating records to be left when a duplicate is deleted in a table by a secure computation.SOLUTION: An analytical device includes a sort section and a deletion section. The sort section sorts records of a table including records in which values of a first key (duplicate deletion key) are duplicated by a second key (sort key) different from the first key by a secure computation. The deletion section deletes the records other than one record at a predetermined position among each set of the records in which the first keys are duplicated in the table sorted by the sort section by the secure computation.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an analysis device, an analysis method, and an analysis program. [Background technology]

[0002] Conventionally, there is known a secure computation system that performs statistical computations while keeping data secret and provides the statistical values ​​obtained as a result of the computations to a user. For example, the secure computation system may be used for analyzing data in the medical field, etc., which handles important personal information.

[0003] Also, a method of manipulating a table using secure computation is known (see, for example, Patent Document 3). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2019 / 124260 [Patent Document 2] JP 2020-042128 A [Patent Document 3] JP 2014-139640 A [Non-patent literature]

[0005] [Non-Patent Document 1] Nippon Telegraph and Telephone Corporation, Secure Computation System and Its Principles, [online], [Retrieved November 24, 2022], Internet<URL:https: / / www.rd.ntt / sil / project / sc / secure_computation.html> Summary of the Invention [Problem to be solved by the invention]

[0006] However, in conventional techniques, when deleting duplicates in a table using secure computation, it may not be possible to specify which records to keep.

[0007] Fig. 6 is a diagram explaining the conventional procedure for deleting duplicates. Here, records with duplicates in the "Employee ID" column and the "Department Code" column (hereinafter, duplicate deletion keys) are deleted except for one. Therefore, record group 61a and record group 62a in table 51a in Fig. 6 are the targets of duplicate deletion.

[0008] The records included in the record group to be deleted have a common duplicate deletion key, but the values ​​in the "Entry Date" column, for example, are different. For this reason, when deleting duplicates, it is conceivable that there is a desire to keep, for example, the record with the most recent "Entry Date."

[0009] On the other hand, in conventional duplicate deletion, the records to be deleted may be randomly determined from among the records to be deleted, which may result in the desired records not remaining after duplicate deletion. [Means for solving the problem]

[0010] In order to solve the above-mentioned problems and achieve the object, the analysis device of the present invention is characterized in having a sorting unit that sorts records of a table including records with duplicate values ​​of a first key using a second key different from the first key through secret calculation, and a deletion unit that deletes, through secret calculation, all records other than one record located at a predetermined position in each set of records with duplicate values ​​of the first key included in the table sorted by the sorting unit. Effect of the Invention

[0011] According to the present invention, when deleting duplicates in a table using secure computation, it is possible to specify which records to keep. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an analysis system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of the analysis device according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating a procedure for deleting duplicates according to the embodiment. [Figure 4] FIG. 4 is a flowchart showing a process flow of the analysis device according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of a computer that executes an analysis program. [Figure 6] FIG. 6 is a diagram for explaining a conventional procedure for deleting duplicates. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of an analysis device, an analysis method, and an analysis program according to the present application will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiment described below.

[0014] First, the configuration of the analysis system will be described with reference to Figure 1. The analysis system is a system for analyzing data using secure computation.

[0015] 1, the analysis system 1 includes a secure computation system 10. The secure computation system 10 is connected to a providing device 20 and a providing device 30 via a network N. For example, the network N is the Internet. The secure computation system 10 is also connected to a terminal device 40.

[0016] The providing device 20 and the providing device 30 are devices on the data provider side. The providing device 20 and the providing device 30 provide (register) data to the secure computing system 10.

[0017] The data provided by the providing device 20 and the providing device 30 includes information that is desirably kept secret (for example, personal information such as an individual's name and address). For example, the providing device 20 and the providing device 30 provide data related to receipts and DPC (Diagnosis Procedure Combination) used in medical institutions.

[0018] The secure computation system 10 includes a data storage unit 11 and a data processing unit 12. The data storage unit 11 includes a plurality of storage devices (storage device 111, storage device 112, storage device 113) that store data by secret sharing. The data processing unit 12 includes a plurality of computation devices (computation device 121, computation device 122, computation device 123) that process data by secure computation. Note that the number of storage devices and the number of computation devices are not limited to the example shown in FIG. 1.

[0019] The secure computation system 10 can perform secret sharing and secure computation according to the method described in Non-Patent Document 1 (URL: https: / / www.rd.ntt / sil / project / sc / secure_computation.html).

[0020] First, data provided to the secure computing system 10 is divided (fragmented) into a plurality of shares. Then, each of the plurality of shares is distributed and stored in a plurality of storage devices included in the data storage unit 11. In the example of Fig. 1, the provided data is divided into three shares. Then, storage device 111, storage device 112, and storage device 113 each store one share.

[0021] Data processing unit 12 performs secure computation on the shares accumulated in data accumulation unit 11. Data processing unit 12 performs secure computation by multi-party computation using multiple computing devices. In the example of FIG. 1, data processing unit 12 performs secure computation by computing device 121, computing device 122, and computing device 123.

[0022] The data processing unit 12 can perform various statistical calculations without restoring the shares. For example, the data processing unit 12 can perform table operations such as sorting and joining, tallying the number of records, calculating statistics such as sums, averages, maximum values, minimum values, and sample variances, and performing statistical tests such as t-tests. Furthermore, the data processing unit 12 can perform statistical analyses such as regression analysis and principal component analysis.

[0023] The analysis device 13 analyzes the data by using the data processing unit 12. The analysis device 13 provides the analysis result to the terminal device 40 on the data user side based on the result of the secure computation executed by the data processing unit 12. The user can obtain the data analysis result via the terminal device 40.

[0024] For example, the secure computing system 10 may be provided with data on the attributes and physical state of each individual. The data on the attributes and physical state is personal information that is preferably kept confidential. The data on the attributes and physical state includes, for example, age, sex, height, weight, etc. The data storage unit 11 stores the provided data into fragmented shares in each storage device.

[0025] Each share is meaningless on its own. Therefore, it is not possible to restore the original data from a single share. However, by collecting multiple shares, it is possible to restore the original data.

[0026] Although users of the data cannot view the registered data itself, they can view the results of data analysis via the analysis device 13 and the terminal device 40. For example, if the data includes the gender and weight of individuals, the users cannot view the gender and weight of each individual, but can view the "average weight of men," which is the result of the data analysis.

[0027] As an example, the data storage unit 11 can perform secret sharing using a technique known as Shamir's threshold secret sharing scheme. In this case, the data storage unit 11 stores, as shares, three coordinates passing through a polynomial with the original data as an intercept in each server. In addition, since the slope of the polynomial is determined randomly, the shares are not necessarily the same each time even if the original data is the same. The original data may be a numerical value, or may be data that has already been converted into a numerical value.

[0028] The secure computation system 10 can restore the original data from multiple shares. If the polynomial is a linear expression, the secure computation system 10 can find an intercept (corresponding to the original data) from the intersection of a line connecting two coordinates (corresponding to shares) and the axis. On the other hand, since a line cannot be determined from a single coordinate, the original data cannot be restored.

[0029] As described above, the data processing unit 12 can perform secure computation on the original data without recovering the shares. For example, the result of adding the shares represented by coordinates corresponds to the share resulting from adding the original data of each share.

[0030] The analysis device 13 causes the data processing unit 12 to execute processing using secure computation in response to a request from the terminal device 40. Note that the data processing unit 12 or the terminal device 40 may realize functions equivalent to those of the analysis device 13. For example, the analysis system 1 may be configured not to include the analysis device 13. In that case, the terminal device 40 is connected to the data processing unit 12 and executes processing equivalent to that of the analysis device 13. Furthermore, statistical computation based on shares may be executed by the terminal device 40 instead of the data processing unit 12.

[0031] In the first embodiment, an example will be described in which the analysis device 13 performs duplicate deletion on a table by secure computation. Note that the table targeted for duplicate deletion by the analysis device 13 is, for example, a table included in a relational database (RDB) in which multiple tables are associated with each other.

[0032] As already explained with reference to Fig. 6, the conventional technology has a problem that it may not be possible to specify which records to keep when deleting duplicates. In contrast, the analysis device 13 of the first embodiment can perform deduplication of a table by secure computation while leaving the specified records.

[0033] The configuration of the analysis device 13 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the analysis device according to the embodiment.

[0034] The following describes each part of the analysis device 13. As shown in FIG.

[0035] The communication unit 131 communicates data with other devices. For example, the communication unit 131 is a network interface card (NIC). The communication unit 131 can transmit and receive data with other devices.

[0036] The input unit 132 is an interface for receiving input of data, and is connected to input devices such as a mouse and a keyboard.

[0037] The output unit 133 is an interface for outputting data, and is connected to input devices such as a display and a speaker.

[0038] The storage unit 134 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk, etc. The storage unit 134 may be a semiconductor memory in which data can be rewritten, such as a random access memory (RAM), a flash memory, or a non-volatile static random access memory (NVSRAM). The storage unit 134 stores an operating system (OS) and various programs executed by the analysis device 13.

[0039] The control unit 135 controls the entire analysis device 13. The control unit 135 is, for example, an electronic circuit such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a GPU (Graphics Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 135 also has an internal memory for storing programs that define various processing procedures and control data, and executes each process using the internal memory.

[0040] The control unit 135 functions as various processing units by the operation of various programs. For example, the control unit 135 includes a determination unit 1351, a sorting unit 1352, and a deletion unit 1353.

[0041] The procedure for deleting duplicates will be described with reference to Fig. 3, along with the function of each processing unit of the control unit 135. Fig. 3 is a diagram for explaining the procedure for deleting duplicates according to the embodiment. For the sake of explanation, Fig. 3 shows the contents of each table in a state in which they can be read as natural language, but in reality, the process shown in Fig. 3 is performed by secure computation on tables accumulated in an unreadable share state (for example, a list of numerical values ​​that appear meaningless).

[0042] Table 51 in Fig. 3 is the table that is the target of duplicate deletion. Here, records with duplicates in the "Employee ID" column and the "Department Code" column (hereinafter, duplicate deletion keys) are deleted except for one. Therefore, record group 61 and record group 62 in table 51 in Fig. 3 are the targets of duplicate deletion.

[0043] The determination unit 1351 determines a duplicate deletion key, a sort key, and a sort order. The duplicate deletion key and the sort key are a set of one or more columns. The sort key is used in the sorting process described later.

[0044] The determination unit 1351 can determine a duplicate deletion key and a sort key in response to a request from a user received via the terminal device 40. However, the duplicate deletion key and the sort key are assumed to be different.

[0045] For example, consider a case where the determination unit 1351 receives a request to "delete records with duplicate 'employee ID' and 'department code', leaving only the record with the oldest 'entry date'." In this case, the determination unit 1351 determines the "employee ID" column and the "department code" column as duplicate deletion keys. The determination unit 1351 also determines the "entry date" column as the sort key. The determination unit 1351 also determines the sort order to be ascending.

[0046] If the record requested to be kept is the record with the smallest value (which is equivalent to the oldest in the case of date and time), the determination unit 1351 determines the sort order to be ascending. Conversely, if the record requested to be kept is the record with the largest value (which is equivalent to the newest in the case of date and time), the determination unit 1351 determines the sort order to be descending.

[0047] The sorting unit 1352 sorts the records of table 51, including records with duplicate deletion key values, by secure computation using the sort key. The sorting unit 1352 also sorts the records of the table in a specified order of ascending order or descending order. Table 52 is the table after the sorting unit 1352 sorts table 51.

[0048] The determination unit 1351 has determined that the "Entry Date" column is the sort key, and the sort order is ascending. Therefore, the sort unit 1352 sorts the records in table 51 in ascending order of the "Entry Date" column. In this case, as shown in table 52, records with smaller values ​​in the "Entry Date" column (older dates and times) are placed higher.

[0049] The deletion unit 1353 deletes, by secure computation, all records except one record located at a predetermined position in each set of records with duplicate deletion keys included in the table 52 sorted by the sorting unit 1352. For example, in the example of Fig. 3, the deletion unit 1353 deletes all records except one record located at the top of the set.

[0050] Record group 61 and record group 62 in table 52 are both collections of records with duplicate deletion keys. The deletion unit 1353 deletes the record at the bottom of the records included in record group 61 (the record whose "Entry Date" column value is "2022 / 9 / 3") and leaves the other records (the records whose "Entry Date" column value is "2022 / 9 / 2").

[0051] In the example of FIG. 3, the records included in each record group in the sorted table 52 are adjacent to each other, but the records included in each record group do not have to be adjacent to each other.

[0052] Furthermore, the deletion unit 1353 may delete the record so as to leave the lowest record instead of the top record. In this case, the determination unit 1351 determines the order opposite to that described above. That is, when the record requested to be left is the record with the smallest value (which in the case of date and time, corresponds to the oldest), the determination unit 1351 determines the sort order to be descending. Conversely, when the record requested to be left is the record with the largest value (which in the case of date and time corresponds to the newest), the determination unit 1351 determines the sort order to be ascending.

[0053] The output control unit 1354 deletes the records and outputs the table 52. The output control unit 1354 may also output the results of further statistical analysis performed using the table 52 from which the records have been deleted.

[0054] Fig. 4 is a flowchart showing the flow of processing of the analysis device according to the embodiment. As shown in Fig. 4, first, the analysis device 13 determines a duplicate deletion key, a sort key, and a sort order based on a request from a user (step S101). The analysis device 13 sorts the records of the table based on the determined duplicate deletion key and order by secure computation (step S102).

[0055] Next, the analysis device 13 acquires a set of records having duplicate deletion keys from the sorted table (step S103).The analysis device 13 then selects one of the unprocessed sets of records (step S104).

[0056] The analysis device 13 deletes all records except the topmost record from the selected record group by secure computation (step S105).

[0057] If there are unselected record groups (step S106, Yes), the analysis device 13 returns to step S104 and repeats the process. If there are no unselected record groups (step S106, No), the analysis device 13 outputs the finally obtained table (step S107).

[0058] [Effects of the embodiment] As described above, the analysis device 13 includes a sorting unit 1352 and a deleting unit 1353. The sorting unit 1352 sorts records of a table including records with duplicate values ​​of a first key (duplicate deletion key) by a second key (sort key) different from the first key, by secure computation. The deleting unit 1353 deletes, by secure computation, all records except one record located at a predetermined position in each set of records with duplicate first keys included in the table sorted by the sorting unit 1352. This allows the analysis device 13 to specify records to be kept by sorting such that the records to be kept when deleting duplicates are located at a predetermined position.

[0059] The sorting unit 1352 sorts the records in the table in a specified order of ascending order or descending order. The deleting unit 1353 deletes all records in the set except for one record at the top or bottom. This allows the analysis device 13 to place the record that is not to be deleted at the user's request at the top or bottom, and delete the other records.

[0060] [System configuration, etc.] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or a part of it can be functionally or physically distributed or integrated in any unit according to various loads, usage conditions, etc. Furthermore, each processing function performed by each device can be realized in whole or in any part by a CPU (Central Processing Unit) and a program analyzed and executed by the CPU, or can be realized as hardware by wired logic. Note that the program may be executed not only by the CPU but also by other processors such as a GPU.

[0061] Furthermore, among the processes described in this embodiment, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified.

[0062] [program] In one embodiment, the analysis device 13 can be implemented by installing an analysis program that executes the above-mentioned analysis processing as package software or online software on a desired computer. For example, the above-mentioned analysis program can be executed by an information processing device, thereby making the information processing device function as the analysis device 13. The information processing device here includes desktop and notebook personal computers. In addition, the information processing device also includes mobile communication terminals such as smartphones, mobile phones, and PHS (Personal Handyphone System), and further slate terminals such as PDA (Personal Digital Assistant), etc.

[0063] Furthermore, the analysis device 13 can be implemented as an analysis server device that provides services related to the above-mentioned analysis processing to a client, the client being a terminal device used by a user. For example, the analysis server device is implemented as a server device that provides an analysis service that receives a table to be deleted for duplicates as input and outputs a table after duplicates have been deleted.

[0064] 5 is a diagram showing an example of a computer that executes an analysis program. The computer 1000 includes, for example, a memory 1010 and a CPU 1020. The computer 1000 also includes a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.

[0065] The memory 1010 includes a read only memory (ROM) 1011 and a random access memory (RAM) 1012. The ROM 1011 stores a boot program such as a basic input output system (BIOS). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium such as a magnetic disk or an optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to a mouse 1110 and a keyboard 1120, for example. The video adapter 1060 is connected to a display 1130, for example.

[0066] The hard disk drive 1090 stores, for example, an OS 1091, an application program 1092, a program module 1093, and program data 1094. That is, a program that defines each process of the analysis device 13 is implemented as a program module 1093 in which computer-executable code is written. The program module 1093 is stored, for example, in the hard disk drive 1090. For example, a program module 1093 for executing the same process as the functional configuration of the analysis device 13 is stored in the hard disk drive 1090. The hard disk drive 1090 may be replaced by an SSD (Solid State Drive).

[0067] Furthermore, setting data used in the processing of the above-described embodiment is stored as program data 1094, for example, in the memory 1010 or the hard disk drive 1090. Then, the CPU 1020 reads out the program module 1093 or the program data 1094 stored in the memory 1010 or the hard disk drive 1090 into the RAM 1012 as necessary, and executes the processing of the above-described embodiment.

[0068] Note that the program module 1093 and the program data 1094 are not limited to being stored in the hard disk drive 1090, but may be stored in, for example, a removable storage medium and read by the CPU 1020 via the disk drive 1100 or the like. Alternatively, the program module 1093 and the program data 1094 may be stored in another computer connected via a network (such as a local area network (LAN) or wide area network (WAN)). The program module 1093 and the program data 1094 may then be read by the CPU 1020 from the other computer via the network interface 1070. [Explanation of symbols]

[0069] 1. Analysis system 10. Secure Computing System 11 Data Storage Section 12 Data Processing Section 13 Analyzer 131 Communications Department 132 Input section 133 Output section 134 Storage section 135 Control Unit 1351 Decision Section 1352 Sorting section 1353 Deleted

Claims

1. a sorting unit that sorts records of a table including records having duplicate values ​​of a first key by a second key different from the first key through secure computation; a deletion unit that deletes, by secure computation, records other than one record located at a predetermined position in each set of records having duplicate first keys included in the table sorted by the sort unit; An analytical device comprising:

2. 2. The analysis device according to claim 1, wherein the sorting unit sorts the records in the table in a specified order out of ascending order and descending order.

3. The deletion unit deletes records other than one record at the top or bottom of the set.

3. The analysis device according to claim 1 or 2.

4. An analytical method performed by an analytical device, comprising: a sorting step of sorting records of a table including records having duplicate values ​​of a first key by a second key different from the first key through secure computation; a deleting step of deleting, by secure computation, records other than one record located at a predetermined position in each set of records having duplicate first keys included in the table sorted by the sorting step; An analytical method comprising the steps of:

5. a sorting step of sorting records of a table including records having duplicate values ​​of a first key by a second key different from the first key through secure computation; a deleting step of deleting, by secure computation, records other than one record located at a predetermined position in each set of records having duplicate first keys included in the table sorted by the sorting step; An analysis program characterized by causing a computer to execute the above.

Citation Information

Patent Citations

  • Equal coupling system and method of table by secret calculation

    JP2014139640A

  • Secret statistic processing system, method, statistical processing apparatus, and program

    JP2020042128A

  • Secure computation system and method

    WO2019124260A1