Information processing apparatus

Abstract

To provide an information processing apparatus and an information processing method for allowing a person to perform a procedure securely without visiting a place for the procedure.SOLUTION: An information processing apparatus 10 includes: a storage processing unit 12 which stores, in a storage unit 11, first video data including voice data of a first speech related to a declaration of intention or confirmation of intension, the video data being obtained by imaging a speech action of a person who performs the declaration of intention or confirmation of intention, in association with an application for a predetermined procedure that requires a declaration of intention or confirmation of intention of an applicant or a guardian; and a viewing processing unit 13 which allows a determiner who determines whether to validate the predetermined procedure to view the first video data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and an information processing method.

Background Art

[0002] For example, in procedures at financial institutions, when a person or the like cannot perform procedures at a financial institution due to reasons such as advanced age, an agent is appointed.

Summary of the Invention

Problems to be Solved by the Invention

[0003] However, there may be a burden or resistance in the procedure of appointing an agent. Also, even when an agent is appointed, there may remain concerns such as impersonation or fraud.

[0004] Therefore, in one aspect, an object of the present invention is to provide an information processing apparatus and an information processing method that can perform procedures safely even if a person or the like does not go to the procedure site.

Means for Solving the Problems

[0005] (1) In one aspect, in association with an application for a predetermined procedure that requires a declaration or confirmation of intention of a person or a guardian, first video data obtained by imaging the speech operation of the person who makes the declaration or confirmation of intention, the first video data including audio data of a first speech related to the declaration or confirmation of intention is stored in a storage unit by a storage processing unit, and a viewing processing unit that allows a determiner who determines whether to validate the predetermined procedure to view the first video data.

[0006] (2) In the above aspect, preferably, based on the first video data, a speaker included in the video is identified, and based on a collation result between information of the identified speaker and registered information, a determination unit that determines whether the speaker is a legitimate registrant is further included. The memory processing unit further stores, in the memory unit, the determination result by the determination unit in association with the first video data.

[0007] (3) In the above aspect, preferably, the memory processing unit further stores, in the memory unit, the determination result by the determiner in association with the first video data.

[0008] (4) In the above aspect, preferably, the memory processing unit further stores, in the memory unit, second video data obtained by imaging an agent or an assistant for the predetermined procedure based on a first predetermined input from the person who performs the intention display or intention confirmation, in association with the first video data. The viewing processing unit causes the determiner to view the first video data and the second video data.

[0009] (5) In the above aspect, preferably, the second video data includes audio data of a second utterance in which the agent or the assistant mentions the predetermined procedure.

[0010] (6) In the above aspect, preferably, the apparatus further includes an output data generation unit that embeds the first video data in a document data including input information related to an application for the predetermined procedure so that the first video data can be reproduced.

[0011] (7) In the above aspect, preferably, the memory processing unit further associates an expiration date of the predetermined procedure with the first video data based on a second predetermined input from the person who performs the intention display or intention confirmation.

[0012] (8) In the predetermined procedure that requires an intention display or intention confirmation of the person himself / herself or the guardian, a video playback unit that acquires, in real time, first video data of the person who performs the intention display or intention confirmation, the first video data including audio data of a first utterance related to the intention display or intention confirmation, and plays back the acquired first video data in a manner visible to the determiner in real time. A storage processing unit that stores the determination result by a determiner who determines whether to activate the predetermined procedure in association with the first video data, characterized in that it includes the above.

[0013] (9) In another aspect, a document storage step of storing a procedure document associated with an application for a predetermined procedure that requires the consent or confirmation of the person himself or his guardian, A video storage step of storing a video of the speech operation of a person related to the predetermined procedure in association with the procedure document, A selection reception step of receiving the selection of the procedure document, When the selection of the procedure document is received in the selection reception step, a display step of making the video associated with the selected procedure document displayable or displayed, Characterized in that it comprises the above.

Effect of the Invention

[0014] In one aspect, according to the present invention, it is possible to provide an information processing apparatus and an information processing method capable of safely performing procedures without the person himself or the like having to go to the procedure site.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 3A

Figure 3B

Figure 3C

Figure 4

Figure 4A

Figure 4B

Figure 4C

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0016] Hereinafter, each embodiment will be described in detail with reference to the accompanying drawings.

[0017] (First Embodiment) FIG. 1 is a diagram showing the configuration of the information processing apparatus of this embodiment.

[0018] As shown in FIG. 1, the information processing apparatus 10 of this embodiment is associated with an application for a predetermined procedure that requires the intention indication or confirmation of the user or the guardian, and stores in the storage unit 11 the first video data 21 obtained by imaging the speech operation of the person who performs the intention indication or confirmation, where the first video data 21 includes the audio data of the first speech related to the intention indication or confirmation. The information processing apparatus 10 further includes a viewing processing unit 13 that allows a determiner who determines whether to activate the predetermined procedure to view the first video data 21, a determination unit 14 that identifies the speaker included in the video based on the first video data 21 and determines whether the speaker is a legitimate registrant based on the collation result between the information of the identified speaker and the registration information, and an output data generation unit 16 that embeds the first video data 21 in a document data 23 of a procedure document including input information related to the application for the predetermined procedure so that it can be reproduced.

[0019] The memory processing unit 12 stores, in the storage unit 11 in association with the first video data 21, the determination result by the determination unit 14 and the determination result by the above-mentioned determiner together with the first video data 21. Further, the memory processing unit 12 can store, in the storage unit 11 in association with the first video data 21, second video data 22 obtained by imaging an agent or an assistant for the above-mentioned predetermined procedure based on a first predetermined input from the person who performs the above-mentioned intention display or intention confirmation. This second video data 22 includes voice data of a second utterance in which the above-mentioned agent or the above-mentioned assistant refers to the above-mentioned predetermined procedure.

[0020] Further, the memory processing unit 12 can associate the expiration date of the above-mentioned predetermined procedure with the first video data 21 based on a second predetermined input from the person who performs the above-mentioned intention display or intention confirmation.

[0021] Here, the above-mentioned predetermined procedure is optional, and includes, for example, procedures for various contracts, procedures that require consent regarding medical treatment, applications for vaccination, and the like.

[0022] In addition, a camera 31 for shooting the first video data 21 and the second video data 22, a microphone 32 for acquiring voice data of the first utterance and the second utterance, an operation reception unit 33 for receiving the determination result by the determiner, the first predetermined input, the second predetermined input, etc., and a display unit 34 for displaying the first video data 21 and the second video data 22 are connected to the information processing apparatus 10. These camera 31, microphone 32, operation reception unit 33, and display unit 34 are constituted by, for example, devices built in or externally attached to a terminal device used by a person related to the above-mentioned information processing.

[0023] The information processing apparatus 10 of this embodiment can be configured by, for example, a single computer or a plurality of computers capable of communicating with each other. FIG. 2 shows an example in which a plurality of terminal devices (computers) and a server (computer) are configured to be able to communicate with each other. In this case, all the elements constituting the information processing apparatus 10 may be provided in, for example, the server 10D shown in FIG. 2. Further, the elements constituting the information processing apparatus 10 may be dispersedly provided in a plurality of the devices among the terminal devices 10A, 10B, 10C and the server 10D shown in FIG. 2. For example, among the elements constituting the information processing apparatus 10, the viewing processing unit 13 and the output data generation unit 16 may be respectively provided in the terminal devices 10A to 10C, and the other elements may be provided in the server 10D. Application software (program) for executing necessary processing is installed in each of the terminal devices 10A, 10B, 10C.

[0024] Next, the procedure for executing information processing in the information processing apparatus 10 will be described.

[0025] FIGS. 3 to 3C are flowcharts showing an example of the procedure of information processing in the information processing apparatus, and FIGS. 4 to 4C are diagrams exemplifying videos handled in the information processing apparatus.

[0026] As shown in FIG. 3, in step S102, first, the document data 23 or the video 101 shown in FIG. 4 is provided from the side of Company X to the server 10D.

[0027] The document data 23 is created, for example, based on an application made by the applicant or the guardian 301 of a person who undergoes a predetermined procedure to Company X, and is stored in the storage unit 11. The document data 23 may include, for example, information for identifying the applicant or the guardian 301 who undergoes a predetermined procedure to Company X (name, address, age, etc. of the applicant or the guardian 301) and the date of the document data 23 (the date when the document data 23 was created or submitted). Note that the guardian includes the parent, guarantor, minor guardian, etc. of the person.

[0028] As shown in FIG. 4, the video 101 is provided with an area 201 where document data 23 such as an application form selected as the subject of the procedure is displayed. The document data 23 is stored in the storage unit 11, and the video 101 is generated by the output data generation unit 16 based on the document data 23. Instead of the video 101, a still image including the area 201 where the document data 23 is displayed may be stored in the storage unit 11.

[0029] Next, in step S200, a first video data storage process for storing video data related to the application of the applicant or the guardian 301 is executed.

[0030] FIG. 3A is a flowchart showing the first video data storage process (step S200).

[0031] In step S202 of FIG. 3A, the storage processing unit 12 determines whether the first video data 21 related to the application of the applicant or the guardian 301 has been received, and waits for the determination to be affirmative, and then proceeds to step S206. Here, for example, when the first video data 21 is transmitted from the terminal device 10A of the applicant or the guardian 301, the determination in step S202 is affirmative.

[0032] In step S206, the determination unit 14 identifies the speaker included in the video of the received first video data 21 based on the first video data 21, and determines whether the speaker is a legitimate registrant based on the collation result between the information related to the identified speaker and the registration information. If the determination by the determination unit 14 is affirmative, the process proceeds to step S208, and if the determination is negative, the process proceeds to step S210.

[0033] For example, a face photo or voice of the applicant or the guardian 301 registered in advance is used as the registration information. The determination unit 14 can determine whether the speaker is a legitimate registrant by image comparison or voiceprint comparison. The determination result by the determination unit 14 is associated with a predetermined procedure (document data 23) via the storage processing unit 12 and stored in the storage unit 11.

[0034] In step S208, the memory processing unit 12 stores the first video data 21 received in step S202 in the storage unit 11 in association with a predetermined procedure (document data 23), and then returns.

[0035] Note that prior to the processing in step S208, the memory processing unit 12 may receive a second predetermined input from the individual or the guardian 301 via the terminal device 10A. In this case, the memory processing unit 12 associates an expiration date of the predetermined procedure with the first video data 21 based on the received second predetermined input. By setting the expiration date, the security in the procedure can be improved. This expiration date is stored in the storage unit 11 in association with the predetermined procedure (document data 23).

[0036] In step S210, the determination unit 14 notifies the individual or the guardian 301's terminal device 10A that the verification result is inconsistent, and ends the process.

[0037] Prior to the application video data storage process (step S200), the individual or the guardian 301, for example, uses the terminal device 10A to acquire the video 101 (Figure 4) from the information processing device 10. Also, using the application software installed in the terminal device 10A, the individual's own intention expression or intention confirmation, that is, a speech operation indicating the intention to apply for a predetermined procedure or intention confirmation, is captured by a built-in or external camera (corresponding to the camera 31 in Figure 1) in the terminal device 10A, and the individual's own voice (the voice of the first speech) is recorded by a built-in or external microphone (corresponding to the microphone 32 in Figure 1) in the terminal device 10A.

[0038] At this time, the output data generation unit 16 creates the video data of the video 101 using the document data 23 stored in the storage unit 11, and the viewing processing unit 13 transmits the created video data of the video 101 to the terminal device 10A. As a result, the applicant or the guardian 301 can, for example, view the video 101 displayed on the screen of the terminal device 10A (corresponding to the display unit 34 in FIG. 1), confirm the content of the application form, and capture the speaking action and record the voice. Also, in the terminal device 10A, since the video (the video corresponding to the first video data 21) in which the applicant or the guardian 301 captures their own speaking action for intention expression or intention confirmation can be displayed in the area 202 of the video 101, not only the application form but also the speaking action can be captured and the voice can be recorded while confirming that the speaking action is correctly captured. In this way, the applicant or the guardian 301 can create the first video data 21 in the terminal device 10A in such a form as to create the video 102 (FIG. 4A).

[0039] As shown in FIG. 4A, the video 102 includes the video (the video corresponding to the first video data 21) in which the applicant or the guardian 301 captures their own speaking action for intention expression or intention confirmation. As shown in FIG. 4A, in the area 201 of the video 102, the application form is displayed as in the video 101, and in the area 202 of the video 102, the video (the video corresponding to the first video data 21) in which the applicant or the guardian 301 captures their own speaking action for intention expression or intention confirmation is displayed. Also, this video (the video corresponding to the first video data 21) includes the voice (the voice of the first speech) accompanying the speaking action of the applicant or the guardian 301. The video 102 is generated by the output data generation unit 16 based on the document data 23 and the first video data 21 stored in the storage unit 11.

[0040] After the speaking action of the applicant or the guardian 301 is captured, the applicant or the guardian 301 transmits the first video data 21 to the server 10D, whereby the determination in step S202 is affirmed.

[0041] Note that a series of processes of causing the video 101 to be viewed by the person himself or the guardian 301, photographing the speech operation of the person himself or the guardian 301, and then storing the first video data 21 in the storage unit 11 may be continuously executed.

[0042] Next, in step S104, the information processing apparatus 10 (server 10D) notifies, for example, the terminal device 10B of the agent or assistant 302 of the person himself or the guardian 301 that the person himself or the guardian 301 wishes to apply for a predetermined procedure. The agent or assistant 302 is registered in advance. Also, information related to the agent or assistant 302, for example, access information to the terminal device 10B, is stored in the server 10D in advance.

[0043] Next, in step S300 of FIG. 3, the second video data storage process is executed.

[0044] FIG. 3B is a flowchart showing the second video data storage process (step S300).

[0045] In step S302 of FIG. 3B, in response to a request from the terminal device 10B of the agent or assistant 302, the output data generation unit 16 generates the video 102 based on the first video data 21 and the document data 23 stored in the storage unit 11, and the viewing processing unit 13 transmits the video data of the video 102 to the terminal device 10B.

[0046] In step S304 of FIG. 3B, the information processing apparatus 10 (server 10D) determines whether the second video data 22 (FIG. 1) has been received, and waits for the determination to be affirmative, and then proceeds to step S308. Here, for example, when the second video data 22 is transmitted from the terminal device 10B of the agent or assistant 302, the determination in step S304 is affirmative.

[0047] In step S308, the storage processing unit 12 stores the second video data 22 received in step S304 in the storage unit 11 in association with the predetermined procedure (document data 23) and the first video data 21, and returns.

[0048] Prior to the process of step S308, the agent or assistant 302 uses, for example, the application software installed in the terminal device 10B to capture the speech operation of the agent or assistant 302 for his / her own predetermined procedure with a built-in or external camera (corresponding to the camera 31 in FIG. 1) of the terminal device 10B, and records the speech (the speech of the second speech) with a built-in or external microphone (corresponding to the microphone 32 in FIG. 1) of the terminal device 10B.

[0049] At this time, the output data generation unit 16 creates the video data of the video 102 using the first video data 21 and the document data 23 stored in the storage unit 11, and the viewing processing unit 13 transmits the created video data of the video 102 to the terminal device 10A. Thereby, the agent or assistant 302 can, for example, view the video 103 being captured displayed on the screen of the terminal device 10B or the video 102 displayed on the screen of the terminal device 10A, confirm the content of the application form and the speech of the first speech of the principal or the guardian 301, and capture his / her own speech operation and record the speech. Also, in the terminal device 10B, since the video (the video corresponding to the second video data 22) in which the agent or assistant 302 captures his / her own speech operation can be displayed in the area 203 of the video 102, the agent or assistant 302 can capture the speech operation and record the speech while confirming that his / her own speech operation is correctly captured. In this way, the agent or assistant 302 can create the second video data 22 in the terminal device 10B in such a form as to create the video 103 (FIG. 4B).

[0050] The video 103 shown in FIG. 4B includes the video (the video corresponding to the second video data 22) in which the speech operation of the agent or assistant 302 is captured. As shown in FIG. 4B, in the area 201 of the video 103, the application form is displayed as in the video 102, and in the area 202 of the video 103, the video in which the principal or the guardian 301 captures his / her own speech operation for intention expression or intention confirmation is displayed as in the video 102.

[0051] In addition, in the area 203 of the video 103, a video of an agent or assistant 302 for a predetermined procedure is displayed, and this video corresponds to the second video data 22. Further, the second video data 22 includes voice data of a second utterance in which the agent or assistant 302 mentions the predetermined procedure. The video 103 is generated by the output data generation unit 16 based on the document data 23, the first video data 21, and the second video data 22 stored in the storage unit 11.

[0052] After photographing the speech operation of the agent or assistant 302, the agent or assistant 302 transmits the second video data 22 to the server 10D, whereby the determination in step S304 is affirmed.

[0053] Note that a series of processes of storing the second video data 22 in the storage unit 11 after photographing the speech operation of the agent or assistant 302 while allowing the agent or assistant 302 to view the video 102 may be continuously executed.

[0054] In step S308, the storage processing unit 12 may wait for a first predetermined input from the principal or the guardian 301 and store the second video data 22 in the storage unit 11.

[0055] In this case, the video data of the video 103 can be transferred from the server 10D to the terminal device 10A in advance to the principal or the guardian 301, and step S308 can be executed after waiting for the reception of the first predetermined input via the terminal device 10A.

[0056] By such processing, the principal or the guardian 301 can confirm, for example, whether the agent or assistant 302 is a legitimate person by viewing the video 103. In this case, if it is confirmed that the agent or assistant 302 photographed in the video 103 is a legitimate person, the principal or the guardian 301 may make the first predetermined input.

[0057] Next, in step S400 of FIG. 3, a determination process is executed. The determination process (step S400) is a process for determining the validity of a predetermined procedure by the determiner 303. The determiner 303 is, for example, a person in charge on the side of Company X.

[0058] FIG. 3C is a flowchart showing the determination process (step S400).

[0059] In step S402, the information processing apparatus 10 determines whether the predetermined procedure is valid based on the information stored in the storage unit 11. If the determination is affirmative, the process proceeds to step S404. If the determination is negative, the process proceeds to step S408. In step S408, the information processing apparatus 10 notifies the person himself / herself or the guardian 301 that the procedure is not valid, and ends the process.

[0060] In step S402, for example, the information processing apparatus 10 determines the validity of the procedure based on the date of the document data 23 stored in the storage unit 11 (the date when the document data 23 was submitted), the information identifying the person himself / herself or the guardian 301 (for example, age), the expiration date defined by the second predetermined input from the person himself / herself or the guardian 301, and the like.

[0061] In step S404, the viewing processing unit 13 causes the determiner 303 to view the video 103 including the document data 23, the first video data 21, and the second video data 22.

[0062] As shown in FIG. 4B, the video 103 includes a video (the video corresponding to the second video data 22) of the speech operation of the agent or assistant 302.

[0063] As shown in FIG. 4B, in area 201 of video 103, an application form is displayed, similar to video 102. In area 202 of video 103, a video (a video corresponding to the first video data 21) in which the applicant or the guardian 301 has filmed their speech act of intention expression or intention confirmation is displayed. In area 203 of video 103, a video (a video corresponding to the second video data 22) in which the speech act of the agent or the assistant 302 is filmed is displayed. Also, the video corresponding to the first video data 21 includes the voice (the voice of the first speech) accompanying the speech act of the applicant or the guardian 301, and the video corresponding to the second video data 22 includes the voice (the voice of the second speech) accompanying the speech act of the agent or the assistant 302. Video 103 is generated by the output data generation unit 16 based on the document data 23, the first video data 21, and the second video data 22 stored in the storage unit 11.

[0064] Thereby, the adjudicator 303 can, for example, confirm the content of the application form, the speech act of the applicant or the guardian 301, and the speech act of the agent or the assistant 302 by viewing the video 103 displayed on the screen of the terminal device 10C, and make a determination regarding the predetermined procedure.

[0065] Also, in step S404, the adjudicator 303 who views video 103, for example, uses the application software installed in the terminal device 10C of the adjudicator 303 to film their own speech act with a camera (corresponding to the camera 31 in FIG. 1) built in or externally attached to the terminal device 10C, and records the voice with a microphone (corresponding to the microphone 32 in FIG. 1) built in or externally attached to the terminal device 10C. Also, in the terminal device 10C, since the area 204 of the video 103 can display the video in which the adjudicator 303 has filmed their own speech act, the adjudicator 303 can film the speech act and record the voice while confirming that their own speech act has been correctly filmed. In this way, the adjudicator 303 can record and record the speech act in the form of creating video 104. The created video 104 is stored in the server 10D in association with the predetermined procedure.

[0066] The stored video 104 may be stored in a form that can be viewed by the person himself / herself, the guardian 301, the agent or the assistant 302. Thereby, the person himself / herself, the guardian 301, the agent or the assistant 302 can confirm, for example, that a predetermined procedure is being treated as valid.

[0067] Next, in step S406, the information processing apparatus 10 receives the determination result by the determiner 303. Here, by viewing the video 103, the determiner 303 confirms the intention expression or intention confirmation of the person himself / herself or the guardian 301, and the reference of the agent or the assistant 302 to the predetermined procedure, and finally determines whether to treat the predetermined procedure as valid. The determination content of the determiner 303 is arbitrary. For example, it can be determined whether the person himself / herself or the guardian 301 is a legitimate person, or the determination can be made based on the intention of the person himself / herself or the guardian 301. Also, the determiner 303 can make a determination based on the content of the reference of the agent or the assistant 302 to the predetermined procedure, for example, whether the predetermined procedure is allowed to proceed. The determination result of the determiner 303 is associated with the predetermined procedure (document data 23) by the storage processing unit 12 and stored in the storage unit 11.

[0068] In step S410, the information processing apparatus 10 determines whether to treat the procedure as valid based on the determination result received in step S406. If the determination is affirmative, the process proceeds to step S412, and if the determination is negative, the process proceeds to step S408.

[0069] In step S412, the information processing apparatus 10 notifies the person himself / herself or the guardian 301 and the agent or the assistant 302 that the procedure is to be treated as valid, and returns.

[0070] As described above, in this embodiment, the speech operation and voice of the person himself or the guardian 301 are created as one video 103 that includes them, and the judge 303 can view this. Therefore, the judge 303 can easily determine whether a predetermined procedure should be treated as valid. Even if the person himself or others do not go to the location of the procedure, there is no worry about forgery or fraud related to the agent, and the procedure can be carried out safely.

[0071] Also, in this embodiment, a single video 103 that includes the speech operations of multiple persons related to a predetermined procedure and their voices is created, and the judge 303 can view this. Therefore, the judge 303 can easily determine whether a predetermined procedure should be treated as valid just by checking one video 103. Also, the burden on the persons involved in the predetermined procedure can be significantly reduced.

[0072] Also, with videos 102 to 104, the linkage between the movement of the face (mouth) and the voice can be confirmed. Therefore, not only can the intention of the speech be clearly understood, but also the effect of preventing dubbing can be obtained.

[0073] Also, in this embodiment, the speech operations of multiple persons related to a predetermined procedure are saved as videos 102 to 104 and made viewable. Therefore, with videos 102 to 104, the speech of the persons related to the predetermined procedure can be confirmed at any time, and errors and the like can be effectively prevented.

[0074] In the above embodiment, an example where an agent or an assistant 302 is involved in a predetermined procedure is shown, but the present invention is also applicable when an agent or an assistant 302 is not involved. In this case, instead of video 103, by performing a determination process (FIG. 3C) on video 102 (FIG. 4A), the judge 303 can make a determination regarding the predetermined procedure.

[0075] In this embodiment, measures for preventing tampering and copying of the stored videos 101 to 104, for example, signatures using NFTs (non-fungible tokens), may be applied.

[0076] (Second Embodiment) As described above, when no agent or assistant 302 is involved in a predetermined procedure, the determiner 303 makes a determination on the video 102 in which the speech operation of the principal or guardian 301 is captured, so that the predetermined procedure becomes valid. In this case, the determiner 303 does not view the video 102 based on the first video data 21 stored in the storage unit 11, but can make necessary determinations based on the real-time interaction with the principal or guardian 301.

[0077] FIG. 5 is a diagram showing the procedure in the second embodiment, and FIG. 6 is a diagram exemplifying the images handled in the second embodiment.

[0078] In the example of FIG. 5, for example, the principal or guardian 301 and the determiner 303 have a real-time conversation via the video 105 shown in FIG. 6 between the terminal device 10A and the terminal device 10C. In this case, the video 105 is displayed in real time on the screens of the terminal device 10A and the terminal device 10C, respectively. In the area 201 of the video 105, an image of the application form based on the document data 23 is shown. In the area 202 of the video 105, the speech operation of the principal or guardian 301 captured by the camera of the terminal device 10A is shown. In the area 204 of the video 105, the speech operation of the determiner 303 captured by the camera of the terminal device 10C is shown in real time. Further, the video 105 displayed on the screen of the terminal device 10C is stored in the storage unit 11 in association with a predetermined procedure (document data 23) by the storage processing unit 12 together with the voices of the principal or guardian 301 and the determiner 303. The video 105 stored in the storage unit 11 can be made viewable.

[0079] In this embodiment, the determiner 303 can make a determination while confirming the speech operation and voice of the principal or guardian 301. Therefore, the determiner 303 can easily determine whether a predetermined procedure should be treated as valid. Even if the principal or the like does not go to the procedure site, there is no worry about forgery or fraud related to the agent, and the procedure can be carried out safely.

[0080] In this embodiment, since the judge 303 can confirm the linkage between the movement of the face (mouth) and the voice in the conversation with the person himself or the guardian 301 through the video 105, the intention of the speech can be clearly understood, and the judgment on the predetermined procedure can be easily made. The judgment result of the judge 303 is stored in the storage unit 11 in association with the video 105.

[0081] In this embodiment, measures for preventing tampering and copying of the stored video 105, such as signing using NFT (Non-Fungible Token), may be taken.

[0082] As described above, each embodiment has been described in detail, but it is not limited to a specific embodiment, and various modifications and changes are possible within the scope described in the claims. Also, it is possible to combine all or a plurality of the components of the above-described embodiments.

Description of Reference Numerals

[0083] 10 Information processing device 11 Storage unit 12 Storage processing unit 13 Viewing processing unit (video playback unit) 14 Judgment unit 16 Output data generation unit (video playback unit)

Claims

1. A storage processing unit that stores, in a storage unit, first video data obtained by imaging a speech operation of a person who makes the above-mentioned intention expression or intention confirmation in association with an application for a predetermined procedure that requires an intention expression or intention confirmation of the person himself or his guardian, the first video data including audio data of a first speech related to the intention expression or intention confirmation; A viewing processing unit that causes a determiner who determines whether to validate the predetermined procedure to view the first video data, wherein the storage processing unit further stores, in the storage unit in association with the first video data, second video data obtained by imaging an agent or an assistant for the predetermined procedure based on a first predetermined input from the person who makes the intention expression or intention confirmation; An information processing apparatus, wherein the viewing processing unit causes the determiner to view the first video data and the second video data.

2. A storage processing unit that stores, in a storage unit, first video data obtained by imaging a speech operation of a person who makes the above-mentioned intention expression or intention confirmation in association with an application for a predetermined procedure that requires an intention expression or intention confirmation of the person himself or his guardian, the first video data including audio data of a first speech related to the intention expression or intention confirmation; A viewing processing unit that causes a determiner who determines whether to validate the predetermined procedure to view the first video data, further including a determination unit that identifies a speaker included in the video based on the first video data and determines whether the speaker is a legitimate registrant based on a collation result between information of the identified speaker and registration information of the person himself and his guardian registered in advance; An information processing apparatus, wherein the storage processing unit further stores, in the storage unit in association with the first video data, a determination result by the determination unit.

3. The information processing apparatus according to claim 1 or 2, wherein the storage processing unit further stores, in the storage unit in association with the first video data, a determination result by the determiner.

4. The information processing apparatus according to claim 1, wherein the second video data includes audio data of a second speech in which the agent or the assistant mentions the predetermined procedure.

5. The information processing apparatus according to any one of claims 1 to 4, further including an output data generation unit that embeds the first video data in a document data including input information related to an application for the predetermined procedure so as to be reproducible.

6. The memory processing unit further associates an expiration date of the predetermined procedure with the first video data based on a second predetermined input from a person who performs the intention display or intention confirmation. The information processing apparatus according to any one of claims 1 to 5.

Images