Analysis device, analysis method, and analysis program

The analysis device employs secure calculation to sort and delete records, allowing users to control which records are kept during duplicate deletion, addressing the unpredictability of conventional methods by ensuring desired records are retained.

WO2024228294A1PCT designated stage expired Publication Date: 2024-11-07NTT COMM CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/007990
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-01
Filing Date
2024-03-04
Publication Date
2024-11-07

AI Technical Summary

Technical Problem

Conventional secure calculation systems cannot specify which records to keep when deleting duplicates, leading to unpredictable outcomes where desired records may be lost during the process.

Method used

An analysis device that uses secure calculation to sort records by a secondary key and delete all but one record with a predetermined position, allowing for controlled duplicate deletion based on user-defined criteria.

Benefits of technology

Enables the user to specify which records to retain during duplicate deletion in secure calculation systems, ensuring that desired records are preserved in the output.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024007990_07112024_PF_FP_ABST
    Figure JP2024007990_07112024_PF_FP_ABST
Patent Text Reader

Abstract

An analysis device according to an embodiment of the present invention comprises a sorting unit and a deletion unit. The sorting unit sorts records in a table that includes records for which the values of a first key (duplication deletion key) are duplicated, via secure computation and using a second key (sorting key) differing from the first key. For each set of records which are included in the table sorted by the sorting unit and for which the first key is duplicated, the deletion unit deletes, via secure computation, records other than one record in a position which is set in advance in the set.
Need to check novelty before this filing date? Find Prior Art

Description

Analytical device, analytical method, and analytical program

[0001] The present invention relates to an analysis device, an analysis method, and an analysis program.

[0002] A secure computation system is known that performs statistical computations on data while keeping the data secret and provides the resulting statistics to users. For example, the secure computation system is sometimes used to analyze data in fields such as the medical field, which handles important personal information.

[0003] Also, a method for manipulating a table using secure computation is known (see, for example, Patent Document 3).

[0004] International Publication No. 2019 / 124260 JP 2020-042128 A JP 2014-139640 A

[0005] Nippon Telegraph and Telephone Corporation, Secure Computation System and Its Principles, [online], [Retrieved November 24, 2022], Internet <URL: https: / / www.rd.ntt / sil / project / sc / secure_computation.html>

[0006] However, with conventional techniques, when deleting duplicates in a table using secure computation, it may not be possible to specify which records to keep.

[0007] Figure 6 is a diagram explaining the conventional procedure for deleting duplicates. In this example, records with duplicates in the "Employee ID" column and the "Department Code" column (hereinafter referred to as the duplicate deletion key) are deleted except for one. Therefore, record group 61a and record group 62a in table 51a in Figure 6 are the targets of duplicate deletion.

[0008] The records included in the set of records to be deleted for duplicate deletion share the same duplicate deletion key, but have different values ​​in the "Entry Date" column, for example. For this reason, when deleting duplicates, you may want to keep the record with the most recent "Entry Date," for example.

[0009] On the other hand, with conventional duplicate deletion, the records to be deleted are sometimes randomly determined from the records included in the target duplicate deletion set, which can result in the desired records not remaining after the duplicate deletion.

[0010] In order to solve the above-mentioned problems and achieve the object, the analysis device of the present invention is characterized by having a sorting unit that sorts records of a table including records with duplicate values ​​of a first key by a second key different from the first key using secure computation, and a deletion unit that deletes, by secure computation, all records except for one record located at a predetermined position in each set of records with duplicate values ​​of the first key included in the table sorted by the sorting unit.

[0011] According to the present invention, when deleting duplicates in a table using secure computation, it is possible to specify which records to keep.

[0012] FIG. 1 is a diagram illustrating an example of the configuration of an analysis system according to an embodiment. FIG. 2 is a diagram illustrating an example of the configuration of an analysis device according to an embodiment. FIG. 3 is a diagram illustrating a procedure for deleting duplicates according to an embodiment. FIG. 4 is a flowchart illustrating a processing flow of the analysis device according to an embodiment. FIG. 5 is a diagram illustrating an example of a computer that executes an analysis program. FIG. 6 is a diagram illustrating a conventional procedure for deleting duplicates.

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below with reference to the accompanying drawings, in which: FIG. 1 is a block diagram showing an analysis apparatus, an analysis method, and an analysis program according to an embodiment of the present invention;

[0014] First, the configuration of the analysis system will be described with reference to Fig. 1. The analysis system is a system for analyzing data using secure computation.

[0015] 1 , the analysis system 1 includes a secure computation system 10. The secure computation system 10 is connected to a providing device 20 and a providing device 30 via a network N. For example, the network N is the Internet. The secure computation system 10 is also connected to a terminal device 40.

[0016] The providing device 20 and the providing device 30 are devices on the data provider side. The providing device 20 and the providing device 30 provide (register) data to the secure computing system 10.

[0017] The data provided by the providing device 20 and the providing device 30 includes information that is desirably kept confidential (e.g., personal information such as an individual's name and address). For example, the providing device 20 and the providing device 30 provide data related to medical receipts and DPCs (Diagnosis Procedure Combinations) used in medical institutions.

[0018] The secure computation system 10 has a data storage unit 11 and a data processing unit 12. The data storage unit 11 includes a plurality of storage devices (storage device 111, storage device 112, storage device 113) that store data by secret sharing. The data processing unit 12 includes a plurality of computation devices (computation device 121, computation device 122, computation device 123) that process data by secure computation. Note that the number of storage devices and the number of computation devices are not limited to the example shown in FIG. 1 .

[0019] The secure computation system 10 can perform secret sharing and secure computation according to the method described in Non-Patent Document 1 (URL: https: / / www.rd.ntt / sil / project / sc / secure_computation.html).

[0020] First, data provided to the secure computing system 10 is divided into multiple shares (fragmentation). Then, each of the multiple shares is distributed and stored in multiple storage devices included in the data storage unit 11. In the example of Fig. 1, the provided data is divided into three shares. Then, storage device 111, storage device 112, and storage device 113 each store one share.

[0021] The data processing unit 12 performs secure computation on the shares stored in the data storage unit 11. The data processing unit 12 performs secure computation through multi-party computation using multiple computing devices. In the example of FIG. 1 , the data processing unit 12 performs secure computation using computing device 121, computing device 122, and computing device 123.

[0022] The data processing unit 12 can perform various statistical calculations without restoring the shares. For example, the data processing unit 12 can perform table operations such as sorting and joining, tally the number of records, calculate statistical quantities such as sums, averages, maximum values, minimum values, and sample variances, and perform statistical tests such as t-tests. Furthermore, the data processing unit 12 can perform statistical analyses such as regression analysis and principal component analysis.

[0023] The analysis device 13 analyzes the data using the data processing unit 12. The analysis device 13 provides the analysis result to the terminal device 40 on the data user side based on the result of the secure computation executed by the data processing unit 12. The user can obtain the data analysis result via the terminal device 40.

[0024] For example, the secure computing system 10 may be provided with data on the attributes and physical condition of each individual. The data on the attributes and physical condition is personal information that is preferably kept confidential. The data on the attributes and physical condition includes, for example, age, sex, height, weight, etc. The data storage unit 11 stores fragmented shares of the provided data in each storage device.

[0025] Note that each individual share is meaningless data on its own. Therefore, it is not possible to restore the original data from a single share. However, by collecting multiple shares, it is possible to restore the original data.

[0026] Although users of the data cannot view the registered data itself, they can view the analysis results of the data via the analysis device 13 and the terminal device 40. For example, if the data includes the gender and weight of individuals, users cannot view the gender and weight of each individual, but can view the "average weight of men," which is the analysis result of the data.

[0027] As an example, the data storage unit 11 can perform secret sharing using a technique known as Shamir's threshold secret sharing scheme. In this case, the data storage unit 11 stores, as shares, three coordinates passing through a polynomial whose intercept is the original data in each server. Furthermore, since the slope of the polynomial is determined randomly, the shares are not necessarily the same each time even if the original data is the same. Note that the original data may be a numerical value or data that has already been converted into a numerical value.

[0028] The secure computing system 10 can restore the original data from multiple shares. If the polynomial is a linear expression, the secure computing system 10 can find the intercept (corresponding to the original data) from the intersection of the axis and a line connecting two coordinates (corresponding to shares). On the other hand, since a line cannot be determined from a single coordinate, the original data cannot be restored.

[0029] As described above, the data processing unit 12 can perform secure computation on the original data without restoring the shares. For example, the result of adding shares represented by coordinates corresponds to the share obtained by adding the original data of each share.

[0030] In response to a request from the terminal device 40, the analysis device 13 causes the data processing unit 12 to perform processing using secure computation. Note that the data processing unit 12 or the terminal device 40 may realize functions equivalent to those of the analysis device 13. For example, the analysis system 1 may be configured without the analysis device 13. In that case, the terminal device 40 is connected to the data processing unit 12 and performs processing equivalent to that of the analysis device 13. Furthermore, statistical computation based on shares may be performed by the terminal device 40 rather than the data processing unit 12.

[0031] In the first embodiment, an example will be described in which the analysis device 13 performs duplicate deletion on a table using secure computation. Note that the table targeted for duplicate deletion by the analysis device 13 is, for example, a table included in a relational database (RDB) in which multiple tables are associated with each other.

[0032] As already explained using Fig. 6, the conventional technology has a problem in that it may not be possible to specify which records to keep when deleting duplicates. In contrast, the analysis device 13 of the first embodiment can delete duplicates in a table using secure computation while keeping the specified records.

[0033] The configuration of the analysis device 13 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the analysis device according to the embodiment.

[0034] The following describes each unit of the analysis device 13. As shown in FIG. 2, the analysis device 13 includes a communication unit 131, an input unit 132, an output unit 133, a storage unit 134, and a control unit 135.

[0035] The communication unit 131 communicates data with other devices. For example, the communication unit 131 is a network interface card (NIC). The communication unit 131 can send and receive data to and from other devices.

[0036] The input unit 132 is an interface for receiving data input, and is connected to input devices such as a mouse and a keyboard.

[0037] The output unit 133 is an interface for outputting data and is connected to input devices such as a display and a speaker.

[0038] The storage unit 134 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk, etc. Note that the storage unit 134 may also be a data-rewritable semiconductor memory such as a random access memory (RAM), a flash memory, or a non-volatile static random access memory (NVSRAM). The storage unit 134 stores an operating system (OS) and various programs executed by the analysis device 13.

[0039] The control unit 135 controls the entire analyzer 13. The control unit 135 is, for example, an electronic circuit such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or GPU (Graphics Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array). The control unit 135 also has an internal memory for storing programs that define various processing procedures and control data, and executes each process using the internal memory.

[0040] The control unit 135 functions as various processing units by running various programs. For example, the control unit 135 includes a determination unit 1351, a sorting unit 1352, and a deletion unit 1353.

[0041] The procedure for deleting duplicates will be described with reference to Fig. 3, along with the functions of each processing unit of the control unit 135. Fig. 3 is a diagram illustrating the procedure for deleting duplicates according to an embodiment. For the sake of explanation, Fig. 3 shows the contents of each table in a readable natural language format, but in reality, the process shown in Fig. 3 is performed by secure computation on tables stored in an unreadable share format (for example, a list of meaningless numerical values).

[0042] Table 51 in Figure 3 is the table to be deleted for duplicates. In this case, records with duplicates in the "Employee ID" column and the "Department Code" column (hereinafter referred to as the duplicate deletion key) are deleted except for one. Therefore, record group 61 and record group 62 in table 51 in Figure 3 are the target for duplicate deletion.

[0043] The determination unit 1351 determines a duplicate removal key, a sort key, and a sort order. The duplicate removal key and the sort key are a set of one or more columns. The sort key is used in the sorting process, which will be described later.

[0044] The determination unit 1351 can determine a duplicate deletion key and a sort key in response to a request from a user received via the terminal device 40. However, the duplicate deletion key and the sort key are assumed to be different.

[0045] For example, consider a case where the determination unit 1351 receives a request to "delete records in which the 'employee ID' and 'department code' are duplicated, leaving only the record with the oldest 'entry date'." In this case, the determination unit 1351 determines the "employee ID" column and the "department code" column as duplicate deletion keys. The determination unit 1351 also determines the "entry date" column as the sort key. The determination unit 1351 also determines the sort order to be ascending.

[0046] If the record requested to be kept is the record with the smallest value (which is equivalent to the oldest in the case of date and time), the determination unit 1351 determines the sorting order to be ascending. Conversely, if the record requested to be kept is the record with the largest value (which is equivalent to the newest in the case of date and time), the determination unit 1351 determines the sorting order to be descending.

[0047] The sorting unit 1352 sorts the records of table 51, including records with duplicate values ​​for the duplicate deletion key, using a sort key by secure computation. The sorting unit 1352 also sorts the records of the table in a specified order, either ascending order or descending order. Table 52 is the table after the sorting unit 1352 sorts table 51.

[0048] The determining unit 1351 determines the "Entry Date" column as the sort key and the sort order as ascending. Therefore, the sorting unit 1352 sorts the records in table 51 in ascending order of the "Entry Date" column. In this case, as shown in table 52, records with smaller values ​​in the "Entry Date" column (older dates and times) are placed higher.

[0049] The deletion unit 1353 uses secure computation to delete all records except one record located at a predetermined position in each set of records with duplicate deletion keys included in the table 52 sorted by the sort unit 1352. For example, in the example of Fig. 3, the deletion unit 1353 deletes all records except one record located at the top of the set.

[0050] Record group 61 and record group 62 in table 52 are both sets of records with duplicate deletion keys. The deletion unit 1353 deletes the lowest-ranked record (the record whose "Entry Date" column has the value "2022 / 9 / 3") from among the records included in record group 61, and leaves the other records (the records whose "Entry Date" column has the value "2022 / 9 / 2").

[0051] In the example of FIG. 3, the records included in each record group in the sorted table 52 are adjacent to each other, but the records included in each record group do not have to be adjacent to each other.

[0052] Furthermore, the deletion unit 1353 may delete the records so that the lowest-ranked record is retained instead of the highest-ranked record. In this case, the determination unit 1351 determines the reverse order from that described above. That is, if the record requested to be retained is the record with the smallest value (which in the case of date and time is equivalent to the oldest), the determination unit 1351 determines the sort order to be descending. Conversely, if the record requested to be retained is the record with the largest value (which in the case of date and time is equivalent to the newest), the determination unit 1351 determines the sort order to be ascending.

[0053] The output control unit 1354 deletes the records and then outputs the table 52. The output control unit 1354 may also output the results of further statistical analysis performed using the table 52 from which the records have been deleted.

[0054] 4 is a flowchart showing the processing flow of the analysis device according to the embodiment. As shown in FIG. 4, the analysis device 13 first determines a duplicate elimination key, a sort key, and a sort order based on a request from a user (step S101). The analysis device 13 then sorts the records in the table using secure computation based on the determined duplicate elimination key and order (step S102).

[0055] Next, the analysis device 13 acquires a group of records with duplicate deletion keys from the sorted table (step S103), and then selects one of the unprocessed records (step S104).

[0056] The analysis device 13 deletes all records except the topmost record from the selected record group using secure computation (step S105).

[0057] If there are unselected record groups (Yes at Step S106), the analysis device 13 returns to Step S104 and repeats the process. If there are no unselected record groups (No at Step S106), the analysis device 13 outputs the finally obtained table (Step S107).

[0058] [Effects of the Embodiment] As described above, the analysis device 13 includes a sorting unit 1352 and a deleting unit 1353. The sorting unit 1352 sorts, by secure computation, records in a table including records with duplicate values ​​for a first key (duplicate deletion key) using a second key (sort key) that is different from the first key. The deleting unit 1353 uses secure computation to delete all records except for one record located at a predetermined position in each set of records with duplicate first keys included in the table sorted by the sorting unit 1352. This allows the analysis device 13 to specify the records to be kept by sorting the records so that the records to be kept are located at predetermined positions when deleting duplicates.

[0059] The sorting unit 1352 sorts the records in the table in a specified order, either ascending or descending. The deleting unit 1353 deletes all records except for one record at the top or bottom of the set. This allows the analysis device 13 to place the record that will not be deleted at the top or bottom in accordance with the user's request, and delete the other records.

[0060] [System Configuration, etc.] The components of each device shown in the figure are conceptual functional units and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of the devices can be functionally or physically distributed or integrated in any unit depending on various loads, usage conditions, etc. Furthermore, all or any part of the processing functions performed by each device can be realized by a CPU (Central Processing Unit) and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic. The program may be executed not only by the CPU but also by other processors such as a GPU.

[0061] Furthermore, among the processes described in this embodiment, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method.In addition, the information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified.

[0062] [Program] In one embodiment, the analysis device 13 can be implemented by installing an analysis program that executes the above-described analysis process as package software or online software on a desired computer. For example, by having an information processing device execute the above-described analysis program, the information processing device can function as the analysis device 13. The information processing device referred to here includes desktop and notebook personal computers. Other information processing devices also include mobile communication terminals such as smartphones, mobile phones, and PHS (Personal Handyphone Systems), as well as slate terminals such as PDAs (Personal Digital Assistants).

[0063] The analysis device 13 can also be implemented as an analysis server device that provides services related to the above-mentioned analysis processing to a client terminal device used by a user. For example, the analysis server device is implemented as a server device that provides an analysis service that receives a table to be deleted for duplicates as input and outputs a table after duplicates have been deleted.

[0064] 5 is a diagram showing an example of a computer that executes an analysis program. The computer 1000 includes, for example, a memory 1010 and a CPU 1020. The computer 1000 also includes a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.

[0065] The memory 1010 includes a read-only memory (ROM) 1011 and a random access memory (RAM) 1012. The ROM 1011 stores a boot program such as a basic input / output system (BIOS). The hard disk drive interface 1030 is connected to a hard disk drive 1090. The disk drive interface 1040 is connected to a disk drive 1100. A removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to a mouse 1110 and a keyboard 1120, for example. The video adapter 1060 is connected to a display 1130, for example.

[0066] The hard disk drive 1090 stores, for example, an OS 1091, an application program 1092, a program module 1093, and program data 1094. That is, the program that defines each process of the analysis device 13 is implemented as a program module 1093 in which computer-executable code is written. The program module 1093 is stored, for example, in the hard disk drive 1090. For example, the program module 1093 for executing processes similar to those of the functional configuration of the analysis device 13 is stored in the hard disk drive 1090. The hard disk drive 1090 may be replaced by an SSD (Solid State Drive).

[0067] Furthermore, setting data used in the processing of the above-described embodiment is stored as program data 1094, for example, in the memory 1010 or the hard disk drive 1090. Then, the CPU 1020 reads the program module 1093 or the program data 1094 stored in the memory 1010 or the hard disk drive 1090 into the RAM 1012 as necessary, and executes the processing of the above-described embodiment.

[0068] The program module 1093 and program data 1094 may not necessarily be stored in the hard disk drive 1090, but may also be stored in a removable storage medium and read by the CPU 1020 via the disk drive 1100 or the like. Alternatively, the program module 1093 and program data 1094 may be stored in another computer connected via a network (such as a local area network (LAN) or a wide area network (WAN)). The program module 1093 and program data 1094 may then be read by the CPU 1020 from the other computer via the network interface 1070.

[0069] REFERENCE SIGNS LIST 1 Analysis system 10 Secure computation system 11 Data storage unit 12 Data processing unit 13 Analysis device 131 Communication unit 132 Input unit 133 Output unit 134 Storage unit 135 Control unit 1351 Determination unit 1352 Sorting unit 1353 Deletion unit

Claims

1. An analysis device comprising: a sorting unit that sorts, through secure computation, records of a table including records with duplicate values ​​of a first key by a second key different from the first key; and a deletion unit that, through secure computation, deletes, for each set of records with duplicate values ​​of the first key included in the table sorted by the sorting unit, all records other than one record located at a predetermined position in the set.

2. The analysis device according to claim 1, wherein the sorting section sorts the records of the table in a specified order out of ascending order and descending order.

3. The analysis device according to claim 1 or 2, characterized in that the deletion unit deletes all records except for one record at the top or bottom of the set.

4. An analysis method executed by an analysis device, comprising: a sorting step of sorting, by secret computation, records of a table including records with duplicate values ​​of a first key by a second key different from the first key; and a deletion step of deleting, by secret computation, all records except for one record located at a predetermined position in each set of records with duplicate values ​​of the first key included in the table sorted by the sorting step.

5. An analysis program that causes a computer to execute the following steps: a sorting step of sorting, by secret computation, records of a table including records with duplicate values ​​of a first key by a second key different from the first key; and a deletion step of deleting, by secret computation, all records except for one record located at a predetermined position in each set of records with duplicate values ​​of the first key included in the table sorted by the sorting step.

Citation Information

Patent Citations

  • Equal coupling system and method of table by secret calculation

    JP2014139640A

  • Secret statistic processing system, method, statistical processing apparatus, and program

    JP2020042128A

  • Secure computation system and method

    WO2019124260A1

  • Secret aggregate function calculation system, secret calculation device, secret aggregate function calculation method, and program

    WO2019225401A1

  • Encoded data analysis device, encoded data analysis method, and program

    WO2021144840A1