Information processing device, information processing method, and information processing program

Abstract

To solve a problem that a three-dimensional avatar in conventional technology only gives a user feeling that an alter ego is actually present but cannot act as a substitute for the user in making payment or receiving service.SOLUTION: An information processing device includes: a user image acquisition unit that acquires a user image obtained by photographing an image of a user; a user verification information generation unit that generates user verification information in which the acquired user image is associated with personal verification information of the user; and a three-dimensional avatar generation unit that generates, on the basis of the generated user verification information, a three-dimensional avatar of the user.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to technology for 3D avatars and identity verification. [Background technology]

[0002] A 3D avatar is a three-dimensional representation of an avatar using 3DCG, and can be used for online activities such as self-expression and communication.

[0003] Furthermore, by making the appearance of the 3D avatar more similar to the user's appearance, the user can feel as if an alter ego is actually present in the user's body (Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2014-522536 Summary of the Invention [Problem to be solved by the invention]

[0005] However, 3D avatars in conventional technology only allow users to feel as if their alter ego is actually present, and cannot act as a substitute for the user in, for example, making payments or receiving services. [Means for solving the problem]

[0006] Therefore, in order to solve the above problems, the present invention provides the following information processing device, etc., that is, an information processing device including a user image acquisition unit that acquires a user image obtained by capturing an image of a user, a user verification information generation unit that generates user verification information that associates the acquired user image with personal verification information of the user, and a 3D avatar generation unit that generates a 3D avatar of the user based on the generated user verification information.

[0007] In addition to the above features, the information processing device also provides a 3D avatar generation unit that generates a 3D avatar that reflects biometric authentication information of the user.

[0008] In addition to the above features, the present invention provides an information processing device further comprising a 3D avatar storage unit that stores the generated 3D avatar and the user verification information in association with each other.

[0009] In addition to the above features, the present invention also provides an information processing device that further has an NFT conversion unit that associates the generated 3D avatar with the user verification information, records it on a blockchain, and converts it into an NFT.

[0010] Also provided is an information processing method executed by a computer in an information processing device, the information processing method including a user image acquisition step of acquiring a user image of a user, a user verification information generation step of generating user verification information that associates the acquired user image with the user's personal verification information, and a 3D avatar generation step of generating a 3D avatar of the user based on the generated user verification information.

[0011] The present invention also provides an information processing program that causes a computer to execute a user image acquisition step of acquiring a user image of a user captured by an information processing device, a user verification information generation step of generating user verification information that associates the acquired user image with the user's personal verification information, and a 3D avatar generation step of generating a 3D avatar of the user based on the generated user verification information. [Effects of the Invention]

[0012] According to the present invention, a 3D avatar that reflects personal identification information can be generated. [Brief explanation of the drawings]

[0013] [Figure 1] Conceptual diagram showing an outline of the embodiment [Figure 2]FIG. 1 is a block diagram illustrating an example of a functional configuration of an information processing apparatus according to an embodiment of the present invention. [Figure 3] FIG. 1 is a conceptual diagram illustrating an example of the configuration of hardware that realizes an information processing apparatus according to an embodiment of the present invention. [Figure 4] FIG. 1 is a flow chart showing an example of a process flow of an information processing apparatus according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. However, the present invention should not be limited to these embodiments and can be embodied in various forms without departing from the spirit and scope of the present invention.

[0015] <Example> <Summary> Fig. 1 is a conceptual diagram showing an overview of this embodiment. As shown in the figure, a 3D avatar 102 is generated based on a user image captured of a user 101. The generated 3D avatar is then provided with the user's identity verification information 103 (such as a My Number card or health insurance card) including biometric authentication information 104 such as face shape, fingerprints, and irises. This makes it possible to generate a 3D avatar that can verify the identity of the user on behalf of the user and to utilize the 3D avatar.

[0016] The following describes the functions and processing flow of the information processing device, as well as the hardware details. The functional blocks of the device described below can be realized as a combination of hardware and software. Specifically, if a computer is used, these include a CPU (central processing unit), main memory, bus, or secondary storage device, input / output devices, external peripheral devices and their interfaces, communication interfaces, and driver programs and other application programs for controlling them. The CPU processes and stores data stored in memory or on a hard disk in accordance with the programs, and generates commands to control the above hardware and software. The functional blocks of the device can also be realized by dedicated hardware.

[0017] Furthermore, this invention can be realized not only as an apparatus but also as a method. Furthermore, a part of such an invention can be configured as software. Furthermore, a program used to cause a computer to execute such software, and a recording medium on which the program is fixed, are naturally included within the technical scope of this invention (the same applies throughout this specification).

[0018] <Functional configuration> 2 is a block diagram showing an example of the functional configuration of the information processing device of this embodiment. As shown in FIG. 2, the information processing device 200 includes a user image acquisition unit 201, a user confirmation information generation unit 202, a 3D avatar generation unit 203, a 3D avatar storage unit 204, and an NFT unit 205.

[0019] The information processing device 200 is a device configured to cooperate with a computer such as a server device, and, if necessary, a user terminal, a 3D scanner, a blockchain, and the like.

[0020] <User image acquisition section> The user image acquisition unit 201 has a function of acquiring a user image obtained by capturing an image of a user. The user image is an image of the user's face, appearance, etc., and may be a still image or a video. The user image may be acquired by a three-dimensional measuring device such as a 3D scanner provided in the information processing device itself or connected via a network, or a two-dimensional user image captured by the user's terminal device may be acquired. When a three-dimensional measuring device is used, the three-dimensional measurement data obtained by measuring the user corresponds to the user image.

[0021] In order to reflect the user's appearance and features in the 3D avatar, it is preferable to acquire a frontal image of the face and images of the head and whole body from various angles. Furthermore, a configuration may be adopted in which additional images are generated based on the acquired user image to serve as the user image.

[0022] <User confirmation information generation unit> The user verification information generation unit 202 has a function of generating user verification information that associates the acquired user image with the user's personal verification information. The user's personal verification information is information for identifying the user, such as a My Number (personal identification number), information listed on a health insurance card or driver's license, etc. The personal verification information may also include various personal information such as qualification certificates, academic certificates, award history, learning history, and birth certificates.

[0023] Furthermore, the personal identification information also includes biometric authentication information (fingerprints, palm prints, voiceprints, veins, irises, face shape, DNA, etc.) that utilizes the user's unique physical characteristics. Biometric authentication information related to the user's appearance may be acquired by the user image acquisition unit described above, or may be acquired using a separate device. Biometric authentication information related to anything other than the user's appearance may be acquired by an appropriate device as appropriate.

[0024] Furthermore, the user's personal identification information may also include user attribute information such as address, telephone number, email address, date of birth, employee ID card, student ID card, credit card or cash card account number, accounts for receiving various services, information on owned tickets or passes, PHR (personal health record), etc. Then, this personal identification information is associated with the user image to generate user identification information.

[0025] It is preferable to store the generated user confirmation information, including any changes to that information. For example, by storing daily body measurements such as weight and blood pressure, and PHR such as medical history, the stored data can be used to predict future health and physical conditions, promote health, and prevent disease.

[0026] <3D avatar generation section> The 3D avatar generation unit 203 has a function of generating a 3D avatar of the user based on the generated user identification information. "Generating based on user identification information" means generating a 3D avatar that includes the user's biometric authentication information, rather than simply generating a 3D avatar that resembles the user's appearance. By generating a 3D avatar in this way, the 3D avatar will have the user's unique physical characteristics necessary for identity verification, and will be able to perform actions and activities requiring identity verification just like the user himself.

[0027] A specific method for generating a 3D avatar can be appropriately performed using known techniques. For example, a 3D scanner is used to acquire three-dimensional coordinate information (horizontal (x-axis), vertical (y-axis), and vertical (z-axis)) indicating the shape, size, position, etc. of the user's face and appearance, and a three-dimensional shape model (3D model) is generated based on the information. Then, information regarding the user's appearance, such as geometry, skin texture, and skin condition and color, is acquired to generate the user's 3D avatar. Note that the 3D avatar may also be generated by generating three-dimensional image information of the user using AI (artificial intelligence) based on a two-dimensional image of the user. The user image includes not only the three-dimensional coordinate information obtained by the 3D scanner described above but also two-dimensional images.

[0028] The generated 3D avatar also reflects the user's biometric authentication information. That is, the 3D avatar is configured to incorporate the user's biometric authentication information described above in its shape, appearance, etc. For example, biometric authentication information that appears in external appearance such as facial shape, fingerprints, and irises is reflected and incorporated into the shape and appearance of the 3D avatar's face, fingers, pupils, etc. Furthermore, when the 3D avatar outputs audio, the voiceprint is reflected in the voice output. Furthermore, biometric authentication information that cannot be reflected in the 3D avatar's external appearance or audio output is incorporated in a manner that meets requests for the presentation and provision of that biometric authentication information.

[0029] <3D avatar storage section> The 3D avatar storage unit 204 has the function of storing the generated 3D avatar in association with the user verification information. When the user verification information and the 3D avatar are changed, each updated one is stored. It is also preferable to sequentially accumulate the update history of the user verification information and the 3D avatar. As described for the user verification information generation unit, for example, by accumulating user verification information related to health and the body, it can contribute to health prediction, health promotion, disease prevention, etc.

[0030] <NFT conversion unit> The NFT conversion unit 205 has the function of recording the generated 3D avatar in association with the user verification information on the blockchain and converting it into an NFT. By converting the 3D avatar associated with the user verification information into an NFT (non-fungible token), a unique 3D avatar that cannot be replicated or forged can be generated. Also, by recording the generation process of the 3D avatar associated with the user verification information on the blockchain, it can be proven that the generated 3D user is the genuine 3D avatar of the user himself / herself.

[0031] Furthermore, by recording the identity verification process of collating and verifying the user himself / herself and the generated 3D avatar in a public institution or the like on the blockchain, this 3D avatar can become the acting subject as the user himself / herself. That is, by using this 3D avatar, for example, when using multiple online applications, the KYC process (online identity verification work) conventionally required for the user himself / herself becomes unnecessary.

[0032] Also, when converting the 3D avatar into an NFT, by including the VC (Verifiable Credentials: verifiable digital certificate) of the user verification information in the metadata of the NFT, the identity verification information and various personal information (qualifications, licenses, etc.) proven by the VC are linked to the 3D avatar converted into an NFT, so that identity verification can be performed using this 3D avatar. That is, possessing (generating) the 3D avatar converted into an NFT becomes an alternative to the KYC process by the user himself / herself.

[0033] In addition, by recording various behavioral histories such as a user's purchase history and viewing history on the blockchain, the user's authentic behavioral history, free from impersonation or forgery, can be reflected in the 3D avatar. By accumulating accurate information about the user, it becomes possible to receive suggestions such as health advice and medical information tailored to the user's true condition, as well as recommendations for meals and products that suit their preferences.

[0034] <Hardware configuration> 3 is a conceptual diagram showing an example of the configuration of hardware that realizes an information processing device according to an embodiment. As shown in the figure, the information processing device 300 includes a CPU 301 that performs various arithmetic processing, a RAM 302 that is a volatile storage medium, a storage 303 that is a non-volatile storage medium such as a flash memory or HDD, a communication interface 304, and an input / output interface 305. The RAM 302 reads programs that perform various arithmetic processing to cause the CPU 301 to execute the programs, and also provides a work area (working area) for the programs. In addition, multiple addresses are assigned to the RAM 302, and the programs executed by the CPU 301 can exchange data and perform processing by identifying and accessing the addresses (the same applies throughout this specification).

[0035] Here, the functions of the user image acquisition unit 201, user confirmation information generation unit 202, and 3D avatar generation unit 203 of the information processing device 200 in Figure 2 are mainly realized by the CPU 301, RAM 302, and communication interface 304 in Figure 3. Also, the function of the 3D avatar storage unit 204 is mainly realized by the storage 303 in Figure 3. Also, the function of the NFT unit 205 is realized by a blockchain connected via the CPU 301, RAM 302, and communication interface 304.

[0036] <Processing flow> 4 is a flow diagram simply illustrating an example of the processing flow of an information processing device. First, a user image of a user is acquired (S401: user image acquisition step). Then, user verification information, which is information that associates the acquired user image with the user's personal verification information, is generated (S402: user verification information generation step). Then, a 3D avatar of the user is generated based on the generated user verification information (S403: 3D avatar generation step). Then, the generated 3D avatar and user-related information are associated and stored (S404: 3D avatar storage step). Then, the generated 3D avatar and user-related information are associated and registered in the blockchain to be converted into an NFT (S405: NFT conversion step). Note that the NFT conversion step may be performed before the 3D avatar storage step.

[0037] <Effects> According to the information processing device of this embodiment, a 3D avatar that reflects personal identification information can be generated. [Explanation of symbols]

[0038] 101: User himself 102: 3D Avatar 103: Personal identification information 104: Biometric information 200: Information processing device 201: User image acquisition unit 202: User confirmation information generation unit 203: 3D avatar generation unit 204: 3D avatar memory unit 205:NFT conversion department 300: Information processing device 301:CPU 302:RAM 303: Storage 304: Communication interface 305: Input / output interface

Claims

1. a user image acquisition unit that acquires a user image obtained by capturing an image of a user; a user confirmation information generating unit that generates user confirmation information that associates the acquired user image with personal confirmation information of the user; a 3D avatar generation unit that generates a 3D avatar of the user based on the generated user confirmation information; An information processing device having the above.

2. The information processing device according to claim 1 , wherein the 3D avatar generation unit generates a 3D avatar that reflects biometric authentication information of the user.

3. The information processing apparatus according to claim 1 , further comprising a 3D avatar storage unit that stores the generated 3D avatar and the user confirmation information in association with each other.

4. The information processing device according to claim 1 or 2, further comprising an NFT conversion unit that associates the generated 3D avatar with the user verification information, records them in a blockchain, and converts them into NFT.

5. An information processing method executed by an information processing device, a user image acquisition step of acquiring a user image obtained by capturing an image of a user; a user verification information generating step of generating user verification information that associates the acquired user image with personal verification information of the user; a 3D avatar generating step of generating a 3D avatar of the user based on the generated user confirmation information; An information processing method comprising:

6. a user image acquisition step of acquiring a user image obtained by capturing an image of a user; a user verification information generating step of generating user verification information that associates the acquired user image with personal verification information of the user; a 3D avatar generating step of generating a 3D avatar of the user based on the generated user confirmation information; An information processing program that causes an information processing device to execute the above.

Images