Information processing device, information processing method, and computer program

Abstract

This information processing device (10) comprises an acquisition means (50) that acquires a plurality of elements included in series data, a calculation means (100) that calculates a likelihood ratio indicating the likelihood that the series data is derived from the same subject as prescribed data on the basis of at least two consecutive elements among the plurality of elements, and a determination means (200) that determines whether the series data is derived from the same subject as the prescribed data on the basis of the likelihood ratio. The calculation means takes into account the degree of similarity or degree of difference of the series data and the prescribed data in calculating the likelihood ratio. Such an information processing device makes it possible to accurately determine whether the series data is derived from the same subject as the prescribed data.

Description

[Technical field]

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a computer program for processing information regarding class classification, for example. [Background technology]

[0002] As this type of device, a device that executes biometric matching processing is known. For example, Patent Document 1 discloses a method for determining whether a person is the person himself / herself by calculating a likelihood ratio based on the similarity between acquired biometric information and a plurality of registered biometric information. Patent Document 2 discloses a method for obtaining a log likelihood ratio of the person himself / herself distribution and the other person distribution by using a matching score corresponding to the biometric information. Patent Document 3 discloses a method for obtaining a score distribution by matching an input face image with the face images of all registered persons, and for presuming that the registered person who has obtained the highest score is the person himself / herself.

[0003] As another related technique, for example, Patent Document 4 discloses calculating an integrated likelihood ratio from a first likelihood ratio and a second likelihood ratio, and calculating an integrated likelihood representing the likelihood of face pose candidates constituting a face pose candidate group. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-120580 A [Patent Document 2] JP 2008-299589 A [Patent Document 3] JP 2008-040874 A [Patent Document 4] International Publication No. 2009 / 091029 Summary of the Invention [Problem to be solved by the invention]

[0005] This disclosure aims to improve upon the related art mentioned above. [Means for solving the problem]

[0006] One aspect of the information processing device disclosed herein includes an acquisition means for acquiring a plurality of elements included in sequence data, a calculation means for calculating a likelihood ratio indicating the likelihood that the sequence data and specified data originate from the same subject based on at least two consecutive elements among the plurality of elements, and a determination means for determining whether the sequence data and specified data originate from the same subject based on the likelihood ratio, where the calculation means calculates the likelihood ratio taking into account a similarity or dissimilarity between the sequence data and the specified data.

[0007] One aspect of the information processing method disclosed herein includes obtaining a plurality of elements included in sequence data, calculating a likelihood ratio indicating the likelihood that the sequence data and specified data originate from the same subject based on at least two consecutive elements among the plurality of elements, determining whether the sequence data and specified data originate from the same subject based on the likelihood ratio, and taking into account the similarity or dissimilarity between the sequence data and the specified data when calculating the likelihood ratio.

[0008] One aspect of the computer program of the present disclosure operates a computer to obtain multiple elements included in sequence data, calculate a likelihood ratio indicating the likelihood that the sequence data and specified data originate from the same subject based on at least two consecutive elements among the multiple elements, determine whether the sequence data and specified data originate from the same subject based on the likelihood ratio, and take into account the similarity or dissimilarity between the sequence data and the specified data when calculating the likelihood ratio. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a hardware configuration of an information processing device according to a first embodiment. [Diagram 2]1 is a block diagram showing a functional configuration of an information processing device according to a first embodiment. [Diagram 3] 4 is a flowchart showing a flow of operations of the information processing device according to the first embodiment. [Figure 4] 4 is a graph showing an example of a likelihood ratio calculated by the information processing device according to the first embodiment. [Diagram 5] 13 is a diagram showing an example of image data handled by an information processing device according to a second embodiment. FIG. [Figure 6] 13 is a diagram showing an example of audio data handled in an information processing device according to a second embodiment. FIG. [Figure 7] 10 is a flowchart showing the flow of operations of the information processing device according to the second embodiment. [Figure 8] FIG. 11 is a block diagram showing a functional configuration of an information processing device according to a third embodiment. [Figure 9] 13 is a flowchart showing the flow of operations of the information processing device according to the third embodiment. [Figure 10] FIG. 13 is a conceptual diagram showing a specific operation example of the information processing device according to the third embodiment. [Figure 11] FIG. 13 is a block diagram showing a functional configuration of an information processing device according to a fourth embodiment. [Figure 12] 13 is a flowchart showing the flow of operations of the information processing device according to the fourth embodiment. [Figure 13] FIG. 13 is a conceptual diagram showing a specific operation example of the information processing device according to the fourth embodiment. [Figure 14] FIG. 13 is a block diagram showing a functional configuration of an information processing device according to a fifth embodiment. [Figure 15] 13 is a flowchart showing the flow of operations of the information processing device according to the fifth embodiment. [Figure 16] FIG. 13 is a conceptual diagram showing a specific operation example of the information processing device according to the fifth embodiment. [Figure 17] FIG. 13 is a block diagram showing a functional configuration of an information processing device according to a sixth embodiment. [Figure 18] 13 is a flowchart showing the flow of operations of the information processing device according to the sixth embodiment. [Figure 19] FIG. 23 is a block diagram showing a functional configuration of an information processing device according to a modified example of the sixth embodiment. [Figure 20] 23 is a flowchart showing the flow of operations of an information processing device according to a modified example of the sixth embodiment. [Figure 21] FIG. 23 is a diagram conceptually showing a determination made on a plurality of registered data in an information processing device according to a seventh embodiment. [Figure 22] 13 is a flowchart showing the flow of operations of an information processing device according to a modified example of the seventh embodiment. [Figure 23] FIG. 13 is a block diagram showing a functional configuration of an information processing device according to an eighth embodiment. [Figure 24] 20 is a flowchart showing the flow of operations of the information processing device according to the eighth embodiment. [Diagram 25] FIG. 13 is a block diagram showing a functional configuration of an information processing device according to a ninth embodiment. [Figure 26] 13 is a flowchart showing the flow of operations of an information processing device according to a ninth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of an information processing device, an information processing method, and a computer program will be described with reference to the drawings.

[0011] First Embodiment An information processing device according to a first embodiment will be described with reference to FIGS. 1 to 4. FIG.

[0012] (Hardware configuration) First, the hardware configuration of the information processing device according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing device according to the first embodiment.

[0013] 1, an information processing device 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing device 10 may further include an input device 15 and an output device 16. The processor 11, the RAM 12, the ROM 13, the storage device 14, the input device 15, and the output device 16 are connected via a data bus 17.

[0014] The processor 11 reads a computer program. For example, the processor 11 is configured to read a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may read a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., read) a computer program from a device (not shown) disposed outside the information processing device 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the computer program that the processor 11 reads. In particular, in this embodiment, when the processor 11 executes the computer program that the processor 11 reads, a functional block for executing a judgment process using a likelihood ratio is realized in the processor 11. Examples of the processor 11 include a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a demand-side platform (DSP), and an application specific integrated circuit (ASIC). The processor 11 may be one of the above-mentioned examples, or a plurality of processors may be used in parallel.

[0015] The RAM 12 temporarily stores a computer program executed by the processor 11. The RAM 12 temporarily stores data that is temporarily used by the processor 11 when the processor 11 is executing the computer program. The RAM 12 may be, for example, a D-RAM (Dynamic RAM).

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store other fixed data. The ROM 13 may be, for example, a programmable ROM (P-ROM).

[0017] The storage device 14 stores data that is to be stored long-term by the information processing device 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be a dedicated controller (operation terminal). The input device 15 may also include a terminal owned by a user (for example, a smartphone, a tablet terminal, etc.). The input device 15 may be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the information processing device 10 to the outside. For example, the output device 16 may be a display device (for example, a display) that can display information related to the information processing device 10. The display device here may be a television monitor, a personal computer monitor, a smartphone monitor, a tablet terminal monitor, or a monitor of another mobile terminal. In addition, the display device may be a large monitor or digital signage installed in various facilities such as a store. In addition, the output device 16 may be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing device 10 as sound.

[0020] (Functional configuration) Next, the functional configuration of the information processing device 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing device according to the first embodiment.

[0021] 2, the information processing device 10 according to the first embodiment includes, as processing blocks for realizing its functions, a data acquisition unit 50, a likelihood ratio calculation unit 100, and a determination unit 200. Each of the data acquisition unit 50, the likelihood ratio calculation unit 100, and the determination unit 200 may be realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0022] The data acquisition unit 50 is configured to be able to acquire a plurality of elements included in the sequence data. The data acquisition unit 50 may acquire data directly from any data acquisition device (for example, a camera, a microphone, etc.), or may read data acquired in advance by a data acquisition device and stored in a storage or the like. When acquiring data from a camera, the data acquisition unit 50 may be configured to acquire data from each of a plurality of cameras. The elements of the sequence data acquired by the data acquisition unit 50 are configured to be output to the likelihood ratio calculation unit 100. Note that sequence data is data including a plurality of elements arranged in a predetermined order, and one example is time-series data. More specific examples of sequence data include, but are not limited to, video data and audio data.

[0023] The likelihood ratio calculation unit 100 is configured to be able to calculate a likelihood ratio based on at least two consecutive elements among the multiple elements acquired by the data acquisition unit 50. Note that the "likelihood ratio" here is an index indicating the likelihood that the sequence data and the predetermined registered data originate from the same subject. The likelihood ratio may be calculated as, for example, a log likelihood ratio (LLR: Log Likehood Ratio). The likelihood ratio may also be calculated as an integrated likelihood ratio that integrates individual likelihood ratios calculated from two consecutive elements.

[0024] The likelihood ratio calculation unit 100 can read out information on the registered data from the registered data storage unit 300 that stores the registered data. The likelihood ratio calculation unit 100 according to this embodiment is particularly configured to calculate the likelihood ratio by taking into account the similarity or dissimilarity between the sequence data and the registered data. A specific method for calculating such a likelihood ratio will be described in detail in another embodiment described later.

[0025] The determination unit 200 determines whether the sequence data and the registered data originate from the same subject based on the likelihood ratio calculated by the likelihood ratio calculation unit 100. The determination unit 200 may determine that the sequence data and the registered data originate from the same subject when the calculated likelihood ratio reaches a predetermined threshold. The determination unit 200 may also determine that the sequence data and the registered data do not originate from the same subject when the calculated likelihood ratio reaches another predetermined threshold.

[0026] (Operation flow) Next, the flow of operations of the information processing device 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of operations of the information processing device according to the first embodiment.

[0027] 3, when the operation of the information processing device 10 according to the first embodiment is started, the data acquisition unit 50 first acquires elements included in the sequence data (step S11). The data acquisition unit 50 outputs the acquired elements of the sequence data to the likelihood ratio calculation unit 100.

[0028] Next, the likelihood ratio calculation unit 100 calculates a likelihood ratio based on the two or more acquired elements. At this time, the likelihood ratio calculation unit 100 calculates the likelihood ratio by taking into account the similarity or dissimilarity between the sequence data and the registered data (step S12). That is, the likelihood ratio is calculated as a value that takes into account not only the acquired sequence data but also the registered data.

[0029] Next, the determination unit 200 determines whether the sequence data and the registered data originate from the same subject based on the calculated likelihood ratio (step S13). The determination unit 200 may output the determination result to a display or the like. The determination unit 200 may also output the determination result as sound via a speaker or the like.

[0030] If the determination unit 200 cannot determine whether the sequence data and the registered data originate from the same subject (for example, if the likelihood ratio does not reach a threshold value used for determination), the above-mentioned series of processes may be repeatedly executed. Specifically, a process of acquiring a new element from the sequence data and calculating a likelihood ratio taking the newly acquired element into consideration may be repeated.

[0031] (Specific judgment examples) Next, a specific example of determination by the information processing device 10 according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a graph showing an example of a likelihood ratio calculated by the information processing device according to the first embodiment. In the example of Fig. 4, it is assumed that the likelihood ratio is calculated as a log-likelihood ratio (LLR).

[0032] 4 can be expressed, for example, as the following formula (1): where y=1 is a class in which the sequence data and the registered data originate from the same subject, and y=0 is a class in which the sequence data and the registered data originate from the same subject.

[0033] LLR = p(X|y=1) / p(X|y=0) … (1)

[0034] This likelihood ratio gradually changes from the initial value by repeatedly executing the above-mentioned series of processes (see FIG. 3). The determination unit 200 performs the determination using, for example, a first threshold value corresponding to a state in which the sequence data and the registered data originate from the same object, and a second threshold value corresponding to a state in which the sequence data and the registered data do not originate from the same object. Specifically, when the likelihood ratio reaches the first threshold value, the determination unit 200 determines that the sequence data and the registered data originate from the same object. On the other hand, when the likelihood ratio reaches the second threshold value, the determination unit 200 determines that the sequence data and the registered data do not originate from the same object.

[0035] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the first embodiment will be described.

[0036] 1 to 4, in the information processing device 10 according to the first embodiment, the similarity or dissimilarity between sequence data and registered data is taken into consideration when calculating the likelihood ratio. In this way, it is possible to determine whether the sequence data and registered data originate from the same object using the likelihood ratio calculated from the sequence data. More specifically, it is possible to determine whether the input sequence data belongs to a class in which the sequence data and registered data originate from the same object, or a class in which the sequence data and registered data do not originate from the same object.

[0037] <Second embodiment> An information processing device 10 according to the second embodiment will be described with reference to Fig. 5 to Fig. 7. Note that the second embodiment describes specific examples of sequence data and registered data handled in the above-mentioned first embodiment, and for example, the device configuration (see Fig. 1 and Fig. 2) may be similar to that of the first embodiment. Therefore, hereinafter, the parts that differ from the first embodiment will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0038] (Specific data examples) First, the sequence data and registered data handled by the information processing device 10 according to the second embodiment will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a diagram showing an example of image data handled by the information processing device according to the second embodiment. Fig. 6 is a diagram showing an example of audio data handled by the information processing device according to the second embodiment.

[0039] As shown in FIG. 5, the sequence data (hereinafter, sometimes referred to as "query") and the registration data (hereinafter, sometimes referred to as "target") handled by the information processing device 10 according to the second embodiment may be image data. More specifically, the sequence data and the registration data may be image data including a person (for example, face image data obtained by capturing an image of a person's face). Alternatively, the sequence data and the registration data may be image data including an animal such as a snake or a dog, or an object such as a robot, in addition to or instead of a person. The sequence data may be input as, for example, a plurality of image data (i.e., video data) in a time series. The registration data may be registered as at least one image data. The registration data may be video data or may be a 3D image. By using image data including a person in this way, it is possible to determine whether the sequence data and the registration data are derived from the same person based on the calculated likelihood ratio.

[0040] As shown in FIG. 5, the sequence data and the registered data handled by the information processing device 10 according to the second embodiment may be voice data. More specifically, the sequence data and the registered data may be data including a voice uttered by a person. Alternatively, the sequence data and the registered data may be voice data uttered by an animal such as a snake or a dog, or an object such as a robot. The sequence data may be input as time-series voice data uttered by a person or an animal. The registered data may be registered as fixed-length voiceprint data. By using voice data uttered by a person or the like in this way, it is possible to determine whether the sequence data and the registered data originate from the same person (i.e., from the same object) based on the calculated likelihood ratio.

[0041] (Operation flow) Next, the flow of operations of the information processing device 10 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of operations of the information processing device according to the second embodiment.

[0042] 7, when the operation of the information processing device 10 according to the second embodiment is started, the data acquisition unit 50 first acquires image data or audio data included in the sequence data (step S21). The data acquisition unit 50 outputs the acquired image data or audio data to the likelihood ratio calculation unit 100.

[0043] Next, the likelihood ratio calculation unit 100 extracts features from the acquired image data or voice data (step S22). Note that a specific method for extracting features can be appropriately adopted from existing technologies, so a detailed explanation will be omitted here. Thereafter, the likelihood ratio calculation unit 100 calculates a likelihood ratio based on the extracted features. At this time, the likelihood ratio calculation unit 100 calculates the likelihood ratio by taking into account the similarity or dissimilarity between the sequence data and the registered data (step S23).

[0044] Next, the determination unit 200 determines whether the sequence data and the registered data are from the same person based on the calculated likelihood ratio (step S24). The determination unit 200 may output the determination result to a display, a speaker, or the like. The determination unit 200 may also execute a predetermined process (for example, a process executed on the condition of personal authentication) according to the determination result.

[0045] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the second embodiment will be described.

[0046] As described in FIG. 5 to FIG. 7, in the information processing device 10 according to the second embodiment, the sequence data and the registration data include image data or voice data. When image data is used, it is possible to determine whether or not a person included in the image is the same as a registered person. Therefore, the information processing device 10 according to the second embodiment can be applied to, for example, a device that performs face authentication. When voice data is used, it is possible to determine whether or not a person who has made a sound is the same as a registered person. Therefore, the information processing device 10 according to the second embodiment can be applied to, for example, a device that performs voice authentication.

[0047] <Third embodiment> The information processing device 10 according to the third embodiment will be described with reference to Figures 8 to 10. The third embodiment differs from the first and second embodiments in part of its configuration and operation, and other parts may be similar to the first and second embodiments. Therefore, hereinafter, only the parts that differ from the embodiments already described will be described in detail, and the description of other overlapping parts will be omitted as appropriate.

[0048] (Functional configuration) First, the functional configuration of the information processing device 10 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the functional configuration of the information processing device according to the third embodiment. In Fig. 8, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0049] 8, the information processing device 10 according to the third embodiment includes, as processing blocks for realizing the functions thereof, a data acquisition unit 50, a likelihood ratio calculation unit 100, and a determination unit 200. The likelihood ratio calculation unit 100 according to the third embodiment is particularly configured to include a combination unit 110. The combination unit 110 may be realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0050] The combining unit 110 is configured to be able to combine a feature vector extracted from sequence data (hereinafter, appropriately referred to as a "query vector") and a feature vector extracted from registered data (hereinafter, appropriately referred to as a "target vector"). The combining unit 110 combines the query vector and the target vector to generate a combined vector. The length of the combined vector is the sum of the length of the query vector and the length of the target vector. The combined vector generated by the combining unit 110 is used to calculate a likelihood ratio.

[0051] (Operation flow) Next, the flow of operations of the information processing device 10 according to the third embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the flow of operations of the information processing device according to the third embodiment. Note that in Fig. 9, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0052] 9, when the operation of the information processing device 10 according to the third embodiment is started, the data acquisition unit 50 first acquires elements included in the sequence data (step S11). The data acquisition unit 50 outputs the acquired elements of the sequence data to the likelihood ratio calculation unit 100.

[0053] Next, the likelihood ratio calculation unit 100 extracts a feature vector (i.e., a query vector) from the elements of the acquired sequence data (step S31). When the query vector is extracted, the combining unit 110 combines the query vector and the target vector to generate a combined vector (step S32). The target vector may be extracted in advance when the registered data is registered, etc. In this case, the target vector may be stored in the registered data storage unit 300 together with the registered data, and the combining unit 110 reads the target vector from the registered data storage unit 300 and combines it with the query vector. Alternatively, the target vector may be newly extracted from the registered data when generating the combined vector. In this case, the combining unit 110 executes a process of reading the registered data from the registered data storage unit 300 and extracting the target vector from the registered data. Then, the combining unit 110 combines the extracted target vector with the query vector.

[0054] Next, the likelihood ratio calculation unit 100 performs time series integration using the combined vector and extracts a feature vector (step S33). For example, the likelihood ratio calculation unit 100 inputs the combined vector to a Long Short Term Memory (LSTM) and obtains the feature vector as its output. Note that the LSTM here is just an example, and a similar process may be performed using any recurrent neural network. For example, the feature vector may be extracted using a Recurrent Neural Network (RNN).

[0055] Next, the likelihood ratio calculation unit 100 converts the feature vector into a binary value using a conversion matrix (step S34). Specifically, the likelihood ratio calculation unit 100 converts the feature vector into a binary value that indicates that the sequence data and the registered data are derived from the same subject, and that the sequence data and the registered data are not derived from the same subject. The likelihood ratio calculation unit 100 also converts the range of each binary value into [0,1] (i.e., scales it).

[0056] Next, the likelihood ratio calculation unit 100 calculates the likelihood ratio from the converted value (step S35). The likelihood ratio calculated in this way is a value that takes into account the similarity or dissimilarity between the sequence data and the registered data. Specifically, the query vector extracted from the sequence data and the target vector extracted from the registered data are combined, and the likelihood ratio is calculated based on the combined vector, so the calculated likelihood ratio ultimately takes into account the similarity or dissimilarity between the sequence data and the registered data.

[0057] Finally, the determining unit 200 determines whether or not the sequence data and the registered data originate from the same subject based on the calculated likelihood ratio (step S13).

[0058] (Specific operation example) Next, a specific operation example of the information processing device 10 according to the third embodiment will be described with reference to Fig. 10. Fig. 10 is a conceptual diagram showing a specific operation example of the information processing device according to the third embodiment. In the operation example shown in Fig. 10, as explained in the second embodiment (see Figs. 5 to 7), it is determined whether the sequence data and the registered data are from the same person.

[0059] In Figure 10, the query vector is X 1 ={x 1 1 ,x 1 2 ,…,x 1 M}, the target vector is t 1 In this case, the combining unit 110 sequentially combines the query vector corresponding to each element with the target vector.

[0060] Specifically, the combiner 110 first combines a query vector x 1 1 and the target vector t 1 and combine them to create a combined vector t 1 x 1 1 Then, the combined vector t 1 x 11 The combination unit 110 then inputs the query vector x 1 2 and the target vector t 1 and combine them to create a combined vector t 1 x 1 2 Then, the combined vector t 1 x 1 2 is input to the LSTM to extract a feature vector, and the likelihood ratio is calculated from the value obtained by converting the feature vector. By repeating such processing in the same manner, the combining unit 110 finally obtains the query vector x 1 M and the target vector t 1 and combine them to create a combined vector t 1 x 1 M Then, the combined vector t 1 x 1 M is input into LSTM to extract a feature vector, and the likelihood ratio is calculated from the transformed value of the feature vector.

[0061] In the example shown in Fig. 10, the determination is made by comparing the likelihood ratio calculated by the above-mentioned process with a true threshold (i.e., a threshold corresponding to a state in which the sequence data and the enrolled data are from the same person) and a false threshold (i.e., a threshold corresponding to a state in which the sequence data and the enrolled data are not from the same person). In the example shown in Fig. 10, the likelihood ratio gradually changes toward the true threshold and finally reaches the true threshold. Therefore, the determination unit 200 determines that the sequence data and the enrolled data are from the same person.

[0062] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the third embodiment will be described.

[0063] As described in Fig. 8 to Fig. 10, the information processing device 10 according to the third embodiment performs a process of generating a combined vector by combining a query vector and a target vector, and calculating a likelihood ratio using the combined vector. The likelihood ratio calculated in this manner is a value that takes into account the similarity or dissimilarity between the sequence data and the registered data. Therefore, the information processing device 10 according to the third embodiment makes it possible to determine whether the sequence data and the registered data originate from the same subject, based on the calculated likelihood ratio.

[0064] <Fourth embodiment> An information processing device 10 according to the fourth embodiment will be described with reference to Fig. 11 to Fig. 13. The fourth embodiment differs from the first to third embodiments in some configurations and operations, and other parts may be similar to the first to third embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0065] (Functional configuration) First, the functional configuration of the information processing device 10 according to the fourth embodiment will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the functional configuration of the information processing device according to the fourth embodiment. In Fig. 11, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0066] 11, the information processing device 10 according to the fourth embodiment includes, as processing blocks for realizing the functions thereof, a data acquisition unit 50, a likelihood ratio calculation unit 100, and a determination unit 200. The likelihood ratio calculation unit 100 according to the fourth embodiment is particularly configured to include a comparison unit 120. The comparison unit 120 may be realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0067] The comparison unit 120 is configured to be able to compare a feature vector generated by performing a predetermined process on a query vector extracted from sequence data with a target vector. More specifically, the comparison unit 120 is configured to be able to calculate a similarity between a feature vector generated from the query vector and the target vector. The comparison unit 120 may calculate a cosine similarity between the feature vector generated from the query vector and the target vector. However, the comparison unit 120 may calculate a similarity other than the cosine similarity. The similarity calculated by the comparison unit 120 is used to calculate a likelihood ratio.

[0068] (Operation flow) Next, the flow of operations of the information processing device 10 according to the fourth embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of operations of the information processing device according to the fourth embodiment. In Fig. 12, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0069] 12, when the operation of the information processing device 10 according to the fourth embodiment is started, the data acquiring unit 50 first acquires elements included in the sequence data (step S11). The data acquiring unit 50 outputs the acquired elements of the sequence data to the likelihood ratio calculating unit 100.

[0070] Next, the likelihood ratio calculation unit 100 extracts a feature vector (i.e., a query vector) from the elements of the acquired sequence data (step S41). When the query vector is extracted, the likelihood ratio calculation unit 100 performs time series integration using the query vector and extracts a feature vector (step S42). For example, the likelihood ratio calculation unit 100 inputs the query vector to an LSTM and acquires the feature vector as the output. Note that the LSTM here is an example, and a similar process may be performed using any recursive neural network. For example, the feature vector may be extracted using an RNN.

[0071] Next, the comparison unit 120 compares the feature vector extracted from the query vector with the target vector to calculate the similarity between these vectors (step S43). The target vector may be extracted in advance when the registered data is registered, etc. In this case, the target vector may be stored in the registered data storage unit 300 together with the registered data, and the comparison unit 120 reads out the target vector from the registered data storage unit 300 and calculates the similarity. Alternatively, the target vector may be newly extracted from the registered data when calculating the similarity. In this case, the comparison unit 120 executes a process of reading out the registered data from the registered data storage unit 300 and extracting the target vector from the registered data. Then, the comparison unit 120 compares the extracted target vector with the feature vector extracted from the query vector to calculate the similarity.

[0072] Next, the likelihood ratio calculation unit 100 converts the range of the calculated similarity into a range of probability (step S44). For example, when the cosine similarity is calculated as the similarity, the likelihood ratio calculation unit 100 converts the range of the cosine similarity [-1, 1] into a range of probability [0, 1].

[0073] Next, the likelihood ratio calculation unit 100 calculates the likelihood ratio from the converted value (step S45). The likelihood ratio calculated in this way is a value that takes into account the similarity or dissimilarity between the sequence data and the registered data. Specifically, the similarity between the feature vector extracted from the query vector and the target vector is calculated, and the likelihood ratio is calculated based on the value obtained by converting the similarity. As a result, the calculated likelihood ratio takes into account the similarity or dissimilarity between the sequence data and the registered data.

[0074] Finally, the determining unit 200 determines whether or not the sequence data and the registered data originate from the same subject based on the calculated likelihood ratio (step S13).

[0075] (Specific operation example) Next, a specific operation example of the information processing device 10 according to the fourth embodiment will be described with reference to Fig. 13. Fig. 13 is a conceptual diagram showing a specific operation example of the information processing device according to the fourth embodiment. In the operation example shown in Fig. 13, as described in the second embodiment (see Figs. 5 to 7), it is determined whether the sequence data and the registered data are from the same person.

[0076] In Figure 13, the query vector is X 1 ={x 1 1 ,x 1 2 ,…,x 1 M}, the target vector is t 1 In this case, the comparison unit 120 sequentially calculates the similarity between the feature vector extracted from the query vector corresponding to each element and the target vector.

[0077] Specifically, the likelihood ratio calculation unit 100 first calculates a query vector x 1 1 is input to the LSTM to extract a feature vector. Then, the comparison unit 120 extracts the query vector x 1 1 The feature vector extracted from and the target vector t 1 Then, the likelihood ratio calculation unit 100 converts the calculated similarity to calculate the likelihood ratio. 1 2 is input to the LSTM to extract a feature vector. Then, the comparison unit 120 extracts the query vector x 1 2 The feature vector extracted from and the target vector t 1 Then, the likelihood ratio calculation unit 100 converts the calculated similarity to calculate the likelihood ratio. This process is repeated in the same manner, and finally, the likelihood ratio calculation unit 100 calculates the similarity between the query vector x 1 M is input to the LSTM to extract a feature vector. Then, the comparison unit 120 extracts the query vector x 1M The feature vector extracted from and the target vector t 1 Then, the likelihood ratio calculation unit 100 converts the calculated similarity to calculate a likelihood ratio.

[0078] In the example shown in Fig. 13, the likelihood ratio calculated by the above-mentioned process is compared with the true person threshold and the other person threshold to perform the determination. In the example shown in Fig. 13, the likelihood ratio gradually changes toward the true person threshold and finally reaches the true person threshold. Therefore, the determination unit 200 determines that the sequence data and the registered data are from the same person.

[0079] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the fourth embodiment will be described.

[0080] As described in FIG. 11 to FIG. 13, in the information processing device 10 according to the fourth embodiment, a feature vector is extracted from a query vector, and the extracted feature vector is compared with a target vector to calculate a similarity. Then, a process of calculating a likelihood ratio is performed based on the calculated similarity. The likelihood ratio calculated in this manner is a value that takes into account the similarity or dissimilarity between the sequence data and the registered data. Therefore, according to the information processing device 10 according to the fourth embodiment, it is possible to determine whether the sequence data and the registered data originate from the same subject based on the calculated likelihood ratio.

[0081] <Fifth embodiment> The information processing device 10 according to the fifth embodiment will be described with reference to Fig. 14 to Fig. 16. The fifth embodiment differs from the first to fourth embodiments in some configurations and operations, and other parts may be similar to the first to fourth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0082] (Functional configuration) First, the functional configuration of the information processing device 10 according to the fifth embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the information processing device according to the fifth embodiment. In Fig. 14, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0083] 14, the information processing device 10 according to the fifth embodiment includes, as processing blocks for realizing the functions thereof, a data acquisition unit 50, a likelihood ratio calculation unit 100, and a determination unit 200. The likelihood ratio calculation unit 100 according to the fifth embodiment is particularly configured to include a difference calculation unit 130. The difference calculation unit 130 may be realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0084] The difference calculation unit 130 is configured to be able to calculate the difference between a query vector extracted from sequence data and a target vector extracted from registered data. The difference calculation unit 130 calculates a difference vector as the difference between the query vector and the target vector. The difference vector calculated by the difference calculation unit 130 is used to calculate a likelihood ratio.

[0085] (Operation flow) Next, the flow of operations of the information processing device 10 according to the fifth embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of operations of the information processing device according to the fifth embodiment. In Fig. 15, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0086] 15, when the operation of the information processing device 10 according to the fifth embodiment is started, the data acquiring unit 50 first acquires elements included in the sequence data (step S11). The data acquiring unit 50 outputs the acquired elements of the sequence data to the likelihood ratio calculating unit 100.

[0087] Next, the likelihood ratio calculation unit 100 extracts a feature vector (i.e., a query vector) from the elements of the acquired sequence data (step S51). When the query vector is extracted, the difference calculation unit 130 calculates a difference vector as a difference between the query vector and the target vector (step S52). The target vector may be extracted in advance when the registered data is registered, etc. In this case, the target vector may be stored in the registered data storage unit 300 together with the registered data, and the difference calculation unit 130 reads the target vector from the registered data storage unit 300 and calculates the difference with the query vector. Alternatively, the target vector may be newly extracted from the registered data when calculating the difference vector. In this case, the difference calculation unit 130 executes a process of reading the registered data from the registered data storage unit 300 and extracting the target vector from the registered data. Then, the difference calculation unit 130 calculates the difference between the extracted target vector and the query vector.

[0088] Next, the likelihood ratio calculation unit 100 performs time series integration using the difference vector to extract a feature vector (step S53). The likelihood ratio calculation unit 100 inputs the difference vector to, for example, an LSTM, and obtains a feature vector as the output. Note that the LSTM here is an example, and a similar process may be performed using any recursive neural network. For example, the feature vector may be extracted using an RNN.

[0089] Next, the likelihood ratio calculation unit 100 converts the feature vector into a binary value using a conversion matrix (step S54). Specifically, the likelihood ratio calculation unit 100 converts the feature vector into a binary value that indicates that the sequence data and the registered data are derived from the same subject, and that the sequence data and the registered data are not derived from the same subject. The likelihood ratio calculation unit 100 also converts the range of each binary value into [0,1] (i.e., scales it).

[0090] Next, the likelihood ratio calculation unit 100 calculates the likelihood ratio from the converted value (step S55). The likelihood ratio calculated in this way is a value that takes into account the similarity or dissimilarity between the sequence data and the registered data. Specifically, the difference between the query vector extracted from the sequence data and the target vector extracted from the registered data is calculated, and the likelihood ratio is calculated based on the difference vector, so that the calculated likelihood ratio takes into account the similarity or dissimilarity between the sequence data and the registered data.

[0091] Finally, the determining unit 200 determines whether or not the sequence data and the registered data originate from the same subject based on the calculated likelihood ratio (step S13).

[0092] (Specific operation example) Next, a specific operation example of the information processing device 10 according to the fifth embodiment will be described with reference to Fig. 16. Fig. 16 is a conceptual diagram showing a specific operation example of the information processing device according to the fifth embodiment. In the operation example shown in Fig. 15, as described in the second embodiment (see Figs. 5 to 7), it is determined whether the sequence data and the registered data are from the same person.

[0093] In Figure 16, the query vector is X 1 ={x 1 1 ,x 1 2 ,…,x 1 M}, the target vector is t 1 In this case, the difference calculation unit 130 sequentially calculates the difference between the query vector corresponding to each element and the target vector.

[0094] Specifically, the difference calculation unit 130 first calculates a query vector x 1 1 and the target vector t 1 Calculate the difference between and the difference vector t 1 -x 1 1 Then, the difference vector t 1 -x1 1 is input to the LSTM to extract a feature vector, and the likelihood ratio is calculated from the transformed value of the feature vector. 1 2 and the target vector t 1 Calculate the difference between and the difference vector t 1 -x 1 2 Then, the difference vector t 1 -x 1 2 is input to the LSTM to extract a feature vector, and the likelihood ratio is calculated from the value obtained by converting the feature vector. By repeating such processing in the same manner, the difference calculation unit 130 finally obtains the query vector x 1 M and the target vector t 1 Calculate the difference between and the difference vector t 1 -x 1 M Then, the difference vector t 1 -x 1 M is input into LSTM to extract a feature vector, and the likelihood ratio is calculated from the transformed value of the feature vector.

[0095] In the example shown in Fig. 16, the likelihood ratio calculated by the above-mentioned process is compared with the true person threshold and the other person threshold to perform the determination. In the example shown in Fig. 16, the likelihood ratio gradually changes toward the true person threshold and finally reaches the true person threshold. Therefore, the determination unit 200 determines that the sequence data and the registered data are from the same person.

[0096] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the fifth embodiment will be described.

[0097] As described in Fig. 14 to Fig. 16, the information processing device 10 according to the fifth embodiment calculates a difference vector as the difference between a query vector and a target vector, and performs a process of calculating a likelihood ratio using the difference vector. The likelihood ratio calculated in this manner is a value that takes into account the similarity or dissimilarity between the sequence data and the registered data. Therefore, the information processing device 10 according to the fifth embodiment makes it possible to determine whether the sequence data and the registered data originate from the same subject, based on the calculated likelihood ratio.

[0098] Sixth embodiment An information processing device 10 according to the sixth embodiment will be described with reference to Fig. 17 and Fig. 18. The sixth embodiment selectively uses a combination of the third to fifth embodiments described above, and the configuration and operation of the sixth embodiment may be substantially similar to those of the third to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will appropriately omit a description of other overlapping parts.

[0099] (Functional configuration) First, the functional configuration of the information processing device 10 according to the sixth embodiment will be described with reference to Fig. 17. Fig. 17 is a block diagram showing the functional configuration of the information processing device according to the sixth embodiment. In Fig. 17, the same components as those shown in Figs. 8, 11, and 14 are denoted by the same reference numerals.

[0100] As shown in FIG. 17, the information processing device 10 according to the sixth embodiment includes a data acquisition unit 50, a likelihood ratio calculation unit 100, and a determination unit 200 as processing blocks for realizing the functions. The likelihood ratio calculation unit 100 according to the sixth embodiment is particularly configured to include a combination unit 110, a comparison unit 120, a difference calculation unit 130, and a selection unit 140. That is, the likelihood ratio calculation unit 100 according to the sixth embodiment includes the combination unit 110 described in the third embodiment, the comparison unit 120 described in the fourth embodiment, and the difference calculation unit 130 described in the fifth embodiment, and is further configured to include a selection unit 140 in addition to the combination unit 110 described in the third embodiment, the comparison unit 120 described in the fourth embodiment, and the difference calculation unit 130 described in the fifth embodiment. The selection unit 140 may be realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0101] The selection unit 140 is configured to be able to select which of the combination unit 110, the comparison unit 120, and the difference calculation unit 130 to use when calculating the likelihood ratio. That is, the selection unit 140 is able to select which method to use to calculate the likelihood ratio from among the method of calculating the likelihood ratio using the combination vector described in the third embodiment (see Figs. 8 to 10), the method of calculating the likelihood ratio using the similarity described in the fourth embodiment (see Figs. 11 to 13), and the method of calculating the likelihood ratio using the difference vector described in the fifth embodiment (see Figs. 14 to 16).

[0102] The selection unit 140 selects which of the combining unit 110, the comparing unit 120, and the difference calculation unit 130 to use based on the condition information acquired in advance. The condition information is information for determining which of the combining unit 110, the comparing unit 120, and the difference calculation unit 130 is optimally used to calculate the likelihood ratio. The condition information may be, for example, information on the type of the sequence data or the registered data. For example, information indicating that the sequence data and the registered data are image data or information indicating that the sequence data and the registered data are audio data may be acquired as the condition information. The condition information may be, for example, information on the quality of the sequence data or the registered data. For example, when the sequence data and the registered data are image data or audio data, information indicating the clarity of the data may be acquired as the condition information. The condition information may be information on the environment in which the sequence data or the registered data was acquired. For example, when the sequence data and the registered data are image data or audio data, information on the location and surrounding environment where the data were acquired, information on the camera used to acquire the image data, information on the microphone used to acquire the audio data, etc. may be acquired as the condition information.

[0103] (Operation flow) Next, the flow of operations of the information processing device 10 according to the sixth embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the flow of operations of the information processing device according to the sixth embodiment.

[0104] 18, when the operation of the information processing device 10 according to the sixth embodiment is started, the selection unit 140 first acquires condition information (step S61). Then, the selection unit 140 selects which of the combination unit 110, the comparison unit 120, and the difference calculation unit 130 to use when calculating the likelihood ratio based on the condition information (step S62).

[0105] Thereafter, the information processing device 10 executes a determination process (i.e., a process of calculating a likelihood ratio to determine whether the sequence data and the registered data originate from the same subject) using the method selected by the selection unit 140 (step S63). Specifically, if the selection unit 140 selects the combination unit 110, the determination process (see FIG. 9) described in the third embodiment is executed. If the selection unit 140 selects the comparison unit 120, the determination process (see FIG. 12) described in the fourth embodiment is executed. If the selection unit 140 selects the difference calculation unit 130, the determination process (see FIG. 15) described in the fifth embodiment is executed.

[0106] In the above example, the condition information is acquired and the likelihood ratio calculation method is selected before the determination process is executed. However, the condition information may be acquired and the likelihood ratio calculation method may be selected during the determination process. For example, the condition information may be acquired and the likelihood ratio calculation method may be selected after the data acquisition unit acquires elements from the sequence data (i.e., after step S11). Also, the condition information may be acquired and the likelihood ratio calculation method may be selected immediately before the combination unit 110 generates a combined vector (i.e., immediately before step S32 in FIG. 9). The condition information may be acquired and the likelihood ratio calculation method may be selected immediately before the comparison unit 120 calculates the similarity (i.e., immediately before step S43 in FIG. 12). The condition information may be acquired and the likelihood ratio calculation method may be selected immediately before the difference calculation unit 130 calculates a difference vector (i.e., immediately before step S52 in FIG. 15).

[0107] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the sixth embodiment will be described.

[0108] 17 and 18, in the information processing device 10 according to the sixth embodiment, the selection unit 140 selects which of the combining unit 110, the comparing unit 120, and the difference calculation unit 130 to use when calculating the likelihood ratio. In this way, it is possible to calculate the likelihood ratio by selecting the most suitable method from the three, the combining unit 110, the comparing unit 120, and the difference calculation unit 130. Therefore, it is possible to accurately determine whether the sequence data and the registered data originate from the same subject.

[0109] <Modification of the Sixth Embodiment> An information processing device 10 according to a modification of the sixth embodiment will be described with reference to Fig. 19 and Fig. 20. The modification of the sixth embodiment differs from the sixth embodiment described above only in part of the configuration and operation, and other parts may be the same as the sixth embodiment. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0110] (Functional configuration) First, a functional configuration of an information processing device 10 according to a modification of the sixth embodiment will be described with reference to Fig. 19. Fig. 19 is a block diagram showing the functional configuration of an information processing device according to a modification of the sixth embodiment. In Fig. 19, the same components as those shown in Figs. 8, 11, and 14 are denoted by the same reference numerals.

[0111] As shown in FIG. 19, the information processing device 10 according to the modification of the sixth embodiment includes a data acquisition unit 50, a likelihood ratio calculation unit 100, and a determination unit 200 as processing blocks for realizing the functions. The likelihood ratio calculation unit 100 according to the modification of the sixth embodiment is particularly configured to include a combination unit 110, a comparison unit 120, a difference calculation unit 130, and an operation detection unit 150. That is, the likelihood ratio calculation unit 100 according to the modification of the sixth embodiment includes the combination unit 110 described in the third embodiment, the comparison unit 120 described in the fourth embodiment, and the difference calculation unit 130 described in the fifth embodiment, and is further configured to include an operation detection unit 150 in addition to the combination unit 110 described in the third embodiment, the comparison unit 120 described in the fourth embodiment, and the difference calculation unit 130 described in the fifth embodiment. The operation detection unit 150 may be realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0112] The operation detection unit 150 is configured to be able to detect an operation by a user. Specifically, the operation detection unit 150 is configured to be able to detect an operation of selecting which of the combining unit 110, the comparing unit 120, and the difference calculation unit 130 to use when calculating the likelihood ratio (hereinafter, appropriately referred to as a "selection operation"). In other words, the operation detection unit 150 is capable of detecting an operation of selecting which of the method of calculating the likelihood ratio using the combined vector described in the third embodiment (see Figs. 8 to 10), the method of calculating the likelihood ratio using the similarity described in the fourth embodiment (see Figs. 11 to 13), and the method of calculating the likelihood ratio using the difference vector described in the fifth embodiment (see Figs. 14 to 16). The operation detection unit 150 may detect a selection operation by the user using, for example, the input device 15 (see Fig. 1).

[0113] (Operation flow) Next, the flow of operations of the information processing device 10 according to the modified example of the sixth embodiment will be described with reference to Fig. 20. Fig. 20 is a flowchart showing the flow of operations of the information processing device according to the modified example of the sixth embodiment.

[0114] 20, when the operation of the information processing device 10 according to the modification of the sixth embodiment is started, the operation detection unit 150 first detects a selection operation by the user (step S65). Then, based on the detected selection operation, the operation detection unit 150 selects which of the combination unit 110, the comparison unit 120, and the difference calculation unit 130 to use when calculating the likelihood ratio (step S66).

[0115] When accepting a user's selection operation, a notification or the like may be given to prompt the user to perform the selection operation. For example, the notification to perform the selection operation may be given by voice via a speaker or the like. Also, the notification to perform the selection operation may be given on a screen display using a display or the like. When the screen display is performed, the user may perform the selection operation by touching the screen. For example, three areas corresponding to the combining unit 110, the comparing unit 120, and the difference calculation unit 130 may be displayed on the screen, and an operation of the user touching any of the areas may be detected as the selection operation.

[0116] Thereafter, the information processing device 10 executes a determination process (i.e., a process of calculating a likelihood ratio and determining whether the sequence data and the registered data are derived from the same subject) using a method corresponding to the user's selection operation (step S67). Specifically, when the user performs an operation to select the combining unit 110, the determination process (see FIG. 9) described in the third embodiment is executed. When the user performs an operation to select the comparing unit 120, the determination process (see FIG. 12) described in the fourth embodiment is executed. When the user performs an operation to select the difference calculation unit 130, the determination process (see FIG. 15) described in the fifth embodiment is executed.

[0117] In the above example, the selection operation by the user is detected before the determination process is executed. However, the selection operation may be detected during the determination process. For example, the selection operation may be detected after the data acquisition unit acquires elements from the sequence data (i.e., after step S11). The selection operation may be detected immediately before the combination unit 110 generates a combined vector (i.e., immediately before step S32 in FIG. 9). The selection operation may be detected immediately before the comparison unit 120 calculates the similarity (i.e., immediately before step S43 in FIG. 12). The selection operation may be detected immediately before the difference calculation unit 130 calculates a difference vector (i.e., immediately before step S52 in FIG. 15).

[0118] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the modified example of the sixth embodiment will be described.

[0119] 19 and 20, in the information processing device 10 according to the modification of the sixth embodiment, when calculating the likelihood ratio, the combining unit 110, the comparing unit 120, or the difference calculation unit 130 is selected according to a user operation. In this way, it is possible to calculate the likelihood ratio by selecting the most suitable method from the three, the combining unit 110, the comparing unit 120, and the difference calculation unit 130. Therefore, it is possible to accurately determine whether the sequence data and the registered data originate from the same subject.

[0120] In the sixth embodiment and the modified example of the sixth embodiment described above, examples have been given in which the combining unit 110, the comparing unit 120, and the difference calculation unit 130 are selectively used, but two of the combining unit 110, the comparing unit 120, and the difference calculation unit 130 may be selectively used. For example, the combining unit 110 and the comparing unit 120 may be selectively used. The combining unit 110 and the difference calculation unit 130 may be selectively used. The comparing unit 120 and the difference calculation unit 130 may be selectively used.

[0121] Seventh embodiment The information processing device 10 according to the seventh embodiment will be described with reference to Fig. 21 and Fig. 22. The seventh embodiment differs from the first to sixth embodiments in part of the configuration and operation, and other parts may be similar to the first to sixth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0122] (Decision for multiple registered data) First, a determination for a plurality of registered data items executed by the information processing device 10 according to the seventh embodiment will be described with reference to Fig. 21. Fig. 21 is a diagram conceptually showing a determination for a plurality of registered data items in the information processing device according to the seventh embodiment.

[0123] As shown in FIG. 21, in the information processing device 10 according to the seventh embodiment, a plurality of registered data are judged for input sequence data. That is, it is configured to judge whether one query originates from the same subject as a plurality of targets. For example, as shown in FIG. 21, it is assumed that face images of a plurality of persons are registered as a plurality of registered data. In this case, it is judged whether the person in the image input as sequence data is the same person as the plurality of registered persons. In this way, when a plurality of registered data are judged, it is sufficient to calculate a likelihood ratio taking into account the sequence data and each of the plurality of registered data. Specifically, it is sufficient to calculate a plurality of likelihood ratios taking into account the similarity or difference between the sequence data and each of the plurality of registered data.

[0124] (Operation flow) Next, the flow of operations of the information processing device 10 according to the seventh embodiment will be described with reference to Fig. 22. Fig. 22 is a flowchart showing the flow of operations of the information processing device according to the seventh embodiment. In Fig. 22, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0125] 22, when the operation of the information processing device 10 according to the seventh embodiment is started, the data acquiring unit 50 first acquires elements included in the sequence data (step S11). The data acquiring unit 50 outputs the acquired elements of the sequence data to the likelihood ratio calculating unit 100.

[0126] Next, the likelihood ratio calculation unit 100 calculates a likelihood ratio based on the two or more acquired elements. At this time, the likelihood ratio calculation unit 100 calculates a plurality of likelihood ratios by taking into account the similarity or dissimilarity between the sequence data and a plurality of registered data (step S71). That is, the likelihood ratio is calculated according to the number of judgment targets (i.e., the number of registered data).

[0127] Next, the determination unit 200 determines whether the sequence data and the enrollment data are from the same subject based on the calculated likelihood ratios (step S72). For example, if the first likelihood ratio reaches the identity threshold, the determination unit 200 determines that the sequence data and the enrollment data corresponding to the first likelihood ratio are from the same subject. Similarly, if the second likelihood ratio reaches the identity threshold, the determination unit 200 determines that the sequence data and the enrollment data corresponding to the second likelihood ratio are from the same subject.

[0128] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the seventh embodiment will be described.

[0129] 21 and 22, the information processing device 10 according to the seventh embodiment calculates a plurality of likelihood ratios by taking into account the similarity or dissimilarity between the sequence data and each of a plurality of registered data. In this way, even if a plurality of registered data exists (i.e., if a plurality of determination targets exists), it is possible to determine which registered data and the sequence data originate from the same target.

[0130] Eighth embodiment The information processing device 10 according to the eighth embodiment will be described with reference to Fig. 23 and Fig. 24. The eighth embodiment differs from the seventh embodiment described above only in part of the configuration and operation, and other parts may be similar to the seventh embodiment. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0131] (Functional configuration) First, the functional configuration of the information processing device 10 according to the eighth embodiment will be described with reference to Fig. 23. Fig. 23 is a block diagram showing the functional configuration of the information processing device according to the eighth embodiment. In Fig. 23, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0132] As shown in Fig. 23, the information processing device 10 according to the eighth embodiment includes a data acquisition unit 50, a likelihood ratio calculation unit 100, a determination unit 200, and an output unit 400 as processing blocks for realizing the functions thereof. That is, the information processing device 10 according to the eighth embodiment is configured to further include an output unit 400 in addition to the configuration of the first embodiment (see Fig. 2). The output unit 400 may be realized by, for example, the above-mentioned processor 11 (see Fig. 1). Moreover, the output unit 400 may be configured to include the above-mentioned output device (see Fig. 1).

[0133] The output unit 400 is configured to be capable of outputting the determination result by the determination unit 200. That is, the output unit 400 is configured to be capable of outputting the determination result as to whether or not the sequence data and the registered data are derived from the same object. In particular, the output unit 400 is configured to be capable of outputting, as the determination result, not only one registered data derived from the same object as the sequence data, but also a plurality of registered data that are highly likely to be derived from the same object as the sequence data. The output unit 400 may output the determination result to a display or the like. In addition, the output unit 400 may output the determination result as sound via a speaker or the like.

[0134] (Operation flow) Next, the flow of operations of the information processing device 10 according to the eighth embodiment will be described with reference to Fig. 24. Fig. 24 is a flowchart showing the flow of operations of the information processing device according to the eighth embodiment. In Fig. 24, the same processes as those shown in Fig. 22 are denoted by the same reference numerals.

[0135] 24, when the operation of the information processing device 10 according to the eighth embodiment is started, the data acquiring unit 50 first acquires elements included in the sequence data (step S11). The data acquiring unit 50 outputs the acquired elements of the sequence data to the likelihood ratio calculating unit 100.

[0136] Next, the likelihood ratio calculation unit 100 calculates a likelihood ratio based on the two or more acquired elements. At this time, the likelihood ratio calculation unit 100 calculates a plurality of likelihood ratios by taking into account the similarity or dissimilarity between the sequence data and a plurality of registered data (step S71). That is, the likelihood ratio is calculated according to the number of judgment targets (i.e., the number of registered data).

[0137] Next, the determination unit 200 determines whether the sequence data and the registered data are derived from the same subject based on the calculated likelihood ratios (step S72).Then, the output unit 400 outputs information on one or more registered data as a result of the determination by the determination unit 200 (step S81).

[0138] For example, when only one likelihood ratio reaches the personal threshold among the plurality of likelihood ratios corresponding to each of the plurality of enrollment data (i.e., when only one enrollment data is determined to be derived from the same subject), the output unit 400 may output only information on the one enrollment data corresponding to the likelihood ratio as the determination result. On the other hand, when there are a plurality of likelihood ratios that reach the personal threshold among the plurality of likelihood ratios corresponding to each of the plurality of enrollment data, the output unit 400 may output information on the plurality of enrollment data corresponding to the plurality of likelihood ratios as the determination result. Also, when there is no likelihood ratio that reaches the personal threshold among the plurality of likelihood ratios corresponding to each of the plurality of enrollment data, the output unit 400 may select a predetermined number of likelihood ratios in order of final value close to the personal threshold, and output information on the plurality of enrollment data corresponding to the selected likelihood ratios as the determination result. Alternatively, when there is no likelihood ratio that reaches the personal threshold, the output unit 400 may select a plurality of likelihood ratios whose final value exceeds a selection threshold lower than the personal threshold, and output information on the plurality of enrollment data corresponding to the selected likelihood ratios as the determination result.

[0139] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the eighth embodiment will be described.

[0140] 23 and 24, the information processing device 10 according to the seventh embodiment is configured to be able to output one registered data item originating from the same subject as the sequence data, or multiple registered data items that are highly likely to originate from the same subject as the sequence data. In this way, even if it is not possible to narrow down the registered data items originating from the same subject as the sequence data to exactly one, multiple candidates can be output as the determination result.

[0141] <Ninth embodiment> The information processing device 10 according to the ninth embodiment will be described with reference to Fig. 25 and Fig. 26. The ninth embodiment differs from the seventh embodiment described above only in part of the configuration and operation, and other parts may be similar to the seventh embodiment. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0142] (Functional configuration) First, the functional configuration of the information processing device 10 according to the ninth embodiment will be described with reference to Fig. 25. Fig. 25 is a block diagram showing the functional configuration of the information processing device according to the ninth embodiment. In Fig. 25, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0143] 25, the information processing device 10 according to the ninth embodiment includes, as processing blocks for realizing its functions, a data acquisition unit 50, a likelihood ratio calculation unit 100, a determination unit 200, and a determination object limitation unit 500. That is, the information processing device 10 according to the ninth embodiment is configured to further include a determination object limitation unit 500 in addition to the configuration of the first embodiment (see FIG. 2). The determination object limitation unit 500 may be realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0144] The judgment target limiting unit 500 is configured to be able to limit judgment targets by performing a narrowing process on a plurality of enrollment data stored in the enrollment data storage unit 300. That is, the judgment target limiting unit 500 is configured to be able to execute a process for reducing the number of judgment targets. For example, when face image data is stored as the enrollment image, the narrowing process executed by the judgment target limiting unit 500 may be a face recognition process with a low processing load. In this case, the face recognition process does not need to be so accurate (for example, it may be a process with a somewhat high other person acceptance rate). By executing such face recognition process, even if it is not possible to narrow down the enrollment data derived from the same person as the sequence data to one, it is possible to narrow down the judgment targets to only the enrollment data that may be derived from the same person as the sequence data (that is, a smaller number of enrollment data than all the enrollment data stored).

[0145] (Operation flow) Next, the flow of operations of the information processing device 10 according to the ninth embodiment will be described with reference to Fig. 26. Fig. 26 is a flowchart showing the flow of operations of the information processing device according to the ninth embodiment. In Fig. 26, the same processes as those shown in Fig. 22 are denoted by the same reference numerals.

[0146] 26, when the operation of the information processing device 10 according to the ninth embodiment is started, the data acquiring unit 50 first acquires elements included in the sequence data (step S11). The data acquiring unit 50 outputs the acquired elements of the sequence data to the likelihood ratio calculating unit 100.

[0147] Next, the judgment target limiting unit 500 executes a narrowing process using the acquired sequence data elements to limit the number of judgment targets (step S91). As a result, the subsequent processes are executed only for the limited judgment targets. That is, the processes are executed not for all registered data stored in the registered data storage unit 300, but for the registered data whose number has been reduced by the narrowing process.

[0148] The likelihood ratio calculation unit 100 calculates a likelihood ratio based on the two or more acquired elements. At this time, the likelihood ratio calculation unit 100 calculates a plurality of likelihood ratios by taking into account the similarity or dissimilarity between the sequence data and the limited registered data (step S92). Then, the determination unit 200 determines whether the sequence data and the registered data originate from the same subject based on the calculated plurality of likelihood ratios (step S93).

[0149] (Technical effect) Next, technical effects obtained by the information processing device 10 according to the ninth embodiment will be described.

[0150] As described in Fig. 25 and Fig. 26, in the information processing device 10 according to the ninth embodiment, the registered data to be judged is limited by the narrowing process (i.e., the number of judgment targets is reduced). In this way, even if the original number of judgment targets is huge, it is possible to reduce the number of judgment targets for which the likelihood ratio is actually calculated. Therefore, the processing load of the information processing device 10 and the time required for processing can be effectively suppressed.

[0151] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-mentioned embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. That is, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, not only the recording medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment.

[0152] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. In addition, the scope of each embodiment does not include those that execute processing by themselves recorded on the recording media, but also those that execute processing by operating on an OS in cooperation with other software and functions of an extension board.

[0153] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and computer programs that involve such modifications are also included in the technical idea of ​​this disclosure.

[0154] <Additional Notes> The above-described embodiment may be further described as follows, but is not limited to the following.

[0155] (Appendix 1) The information processing device described in Supplementary Note 1 includes an acquisition means for acquiring a plurality of elements included in sequence data, a calculation means for calculating a likelihood ratio indicating the likelihood that the sequence data and a predetermined data originate from the same subject, based on at least two consecutive elements among the plurality of elements, and a determination means for determining whether the sequence data and the predetermined data originate from the same subject, based on the likelihood ratio, wherein the calculation means calculates the likelihood ratio taking into account a similarity or a difference between the sequence data and the predetermined data.

[0156] (Appendix 2) The information processing device described in Supplementary Note 2 is the information processing device described in Supplementary Note 1, characterized in that the calculation means performs a first processing on a combined feature that combines a first feature extracted from the sequence data and a second feature extracted from the specified data, and calculates the likelihood ratio based on a processing result of the first processing, thereby taking into account the similarity or dissimilarity between the sequence data and the specified data.

[0157] (Appendix 3) The information processing device described in Supplementary Note 3 is the information processing device described in Supplementary Note 1, characterized in that the calculation means performs a second processing on a first feature extracted from the sequence data, and calculates the likelihood ratio based on a comparison result between the first feature after the second processing and a second feature extracted from the specified data, thereby calculating the similarity or dissimilarity between the sequence data and the specified data.

[0158] (Appendix 4) The information processing device described in Supplementary Note 4 is the information processing device described in Supplementary Note 1, characterized in that the calculation means performs a third processing on a difference feature which is a difference between a first feature extracted from the sequence data and a second feature extracted from the specified data, and calculates the likelihood ratio based on a processing result of the third processing, thereby calculating a similarity or a dissimilarity between the sequence data and the specified data.

[0159] (Appendix 5) The information processing device described in Supplementary Note 5 is the information processing device described in any one of Supplements 1 to 4, characterized in that the calculation means calculates a plurality of the likelihood ratios corresponding to each of the plurality of specified data, and the determination means determines whether the series data originates from the same subject as any of the plurality of specified data based on the plurality of the likelihood ratios.

[0160] (Appendix 6) The information processing device described in Supplementary Note 6 is the information processing device described in Supplementary Note 5, characterized in that the determination means outputs as a determination result one of the specified data determined to be derived from the same subject as the sequence data, or two or more of the specified data determined to have a high possibility of being derived from the same subject as the sequence data.

[0161] (Appendix 7) The information processing device described in Appendix 7 is the information processing device described in Appendix 5 or 6, characterized in that it further comprises a limiting means for performing a narrowing-down process on the multiple specified data and limiting the specified data to be judged by the judgment means so as to reduce the number of specified data.

[0162] (Appendix 8) The information processing device described in Appendix 8 is the information processing device described in any one of Appendixes 1 to 7, characterized in that the series data includes at least one of image data and audio data of a target, and the calculation means calculates a likelihood ratio indicating the likelihood that the series data and a specified data originate from the same target.

[0163] (Appendix 9) The information processing method described in Supplementary Note 9 is an information processing method characterized by obtaining a plurality of elements included in sequence data, calculating a likelihood ratio indicating the likelihood that the sequence data and a given data originate from the same subject based on at least two consecutive elements among the plurality of elements, determining whether the sequence data and the given data originate from the same subject based on the likelihood ratio, and taking into account a similarity or a difference between the sequence data and the given data when calculating the likelihood ratio.

[0164] (Appendix 10) The computer program described in Supplementary Note 10 is a computer program that causes a computer to operate to obtain a plurality of elements included in sequence data, calculate a likelihood ratio indicating a likelihood that the sequence data and a given data originate from the same subject based on at least two consecutive elements among the plurality of elements, determine whether the sequence data and the given data originate from the same subject based on the likelihood ratio, and take into account a similarity or a difference between the sequence data and the given data when calculating the likelihood ratio.

[0165] (Appendix 11) The recording medium according to claim 11 is a recording medium having the computer program according to claim 10 recorded thereon. [Explanation of symbols]

[0166] 10. Information processing device 11 Processors 14 Storage device 50 Data Acquisition Section 100 Likelihood ratio calculation section 110 Joint 120 Comparison section 130 Difference calculation section 140 Selection Section 150 Operation detector 200 Judgment section 300 Registration data storage unit 400 Output section 500 Judgment subject limited part

Claims

1. An acquisition means for acquiring a plurality of elements included in the sequence data; a calculation means for calculating a likelihood ratio indicating the likelihood that the sequence data and a predetermined data originate from the same subject, based on at least two consecutive elements among the plurality of elements; a determination means for determining whether or not the sequence data and a predetermined data originate from the same subject based on the likelihood ratio; Equipped with The calculation means performs a third process of calculating a feature vector for a difference feature that is a difference between a first feature extracted from the sequence data and a second feature extracted from the predetermined data, and calculates the likelihood ratio based on a result of the third process.

23. An information processing apparatus comprising:

2. the calculation means calculates a plurality of the likelihood ratios corresponding to each of a plurality of the predetermined data; The determining means determines whether the sequence data originates from the same subject as any one of the plurality of predetermined data based on the plurality of likelihood ratios.

2. The information processing apparatus according to claim 1,

3. 3. The information processing device according to claim 2, wherein the determination means outputs, as a determination result, one of the predetermined data determined to be derived from the same subject as the sequence data, or two or more of the predetermined data determined to be highly likely to be derived from the same subject as the sequence data.

4. 4. The information processing apparatus according to claim 2, further comprising a limiting unit that performs a narrowing process on the plurality of predetermined data, thereby limiting the number of predetermined data that become targets for judgment by the judging unit.

5. the sequence data includes at least one of image data and audio data of a target; The calculation means calculates a likelihood ratio indicating the likelihood that the sequence data and a predetermined data originate from the same subject.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

6. the calculation means converts the feature vector into a binary value representing that the sequence data and the specified data originate from the same subject, and that the sequence data and the specified data do not originate from the same subject.

2. The information processing apparatus according to claim 1,

7. the calculation means calculates the likelihood ratio using the binary converted feature vector; 7. The information processing apparatus according to claim 6,

8. At least one computer Obtain multiple elements contained in the sequence data, calculating a likelihood ratio indicating the likelihood that the sequence data and a predetermined data originate from the same subject based on at least two consecutive elements among the plurality of elements; determining whether the sequence data and a predetermined data are derived from the same subject based on the likelihood ratio; When calculating the likelihood ratio, a third process is performed to calculate a feature vector for a difference feature that is a difference between a first feature extracted from the sequence data and a second feature extracted from the predetermined data, and the likelihood ratio is calculated based on a result of the third process.

23. An information processing method comprising:

9. Obtain multiple elements contained in the sequence data, calculating a likelihood ratio indicating the likelihood that the sequence data and a predetermined data originate from the same subject based on at least two consecutive elements among the plurality of elements; determining whether the sequence data and a predetermined data are derived from the same subject based on the likelihood ratio; When calculating the likelihood ratio, a third process is performed to calculate a feature vector for a difference feature that is a difference between a first feature extracted from the sequence data and a second feature extracted from the predetermined data, and the likelihood ratio is calculated based on a result of the third process. A computer program for causing a computer to operate in such a manner.

10. An acquisition means for acquiring a plurality of elements included in the sequence data; a calculation means for calculating a likelihood ratio indicating the likelihood that the sequence data and a predetermined data originate from the same subject, based on at least two consecutive elements among the plurality of elements; a determination means for determining whether or not the sequence data and a predetermined data originate from the same subject based on the likelihood ratio; Equipped with The calculation means performs a first process of extracting a feature vector from a combined feature obtained by combining a first feature extracted from the sequence data and a second feature extracted from the predetermined data, and calculates the likelihood ratio based on a result of the first process.

23. An information processing apparatus comprising:

11. the calculation means converts the feature vector into a binary value representing that the sequence data and the specified data originate from the same subject, and that the sequence data and the specified data do not originate from the same subject.

11. The information processing apparatus according to claim 10,

Images