Avatar generation device, avatar generation method, and program

The avatar generation device authenticates a target person using a first image and subsequent actions to ensure reliability and minimize operational steps, addressing the challenge of reliable yet efficient avatar creation.

JP7704208B2Active Publication Date: 2025-07-08NEC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023554411
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-10-19
Filing Date
2022-10-03
Publication Date
2025-07-08
Estimated Expiration
2042-10-03

AI Technical Summary

Technical Problem

Existing avatar generation systems face challenges in ensuring the reliability of the person represented by the avatar while minimizing the number of operations required for avatar creation.

Method used

An avatar generation device performs a first authentication process using a first image of a target person and master information to generate an authenticated avatar, followed by a second authentication process involving the target person's actions to further verify identity.

Benefits of technology

Ensures the reliability of the avatar representation while reducing the number of operations needed for avatar generation, enhancing user experience and security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007704208000001
    Figure 0007704208000001
  • Figure 0007704208000002
    Figure 0007704208000002
  • Figure 0007704208000003
    Figure 0007704208000003
Patent Text Reader

Abstract

An avatar generating device (10) is provided with an authentication unit (110) and an avatar generating unit (120). The authentication unit (110) performs a first authentication process for a target person included in a first image, by using the first image including the target person, and master information of the target person. If the first authentication process is successful, the avatar generation unit (120) generates an avatar of the target person by using the first image. The avatar is stored, for example, in a storage unit (140).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an avatar generation device, an avatar generation method, and a recording medium.

Background Art

[0002] In a virtual space or the like, an avatar may be used. For example, Patent Document 1 describes generating an avatar of a participant in a video conference. In Patent Document 1, the avatar of the participant is generated based on pre-registered avatar information. This avatar information is pre-associated with face recognition information in a table.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When an avatar is used, in order to ensure the reliability of the person represented by the avatar, it is necessary to authenticate that person before generating the avatar. On the other hand, for a person using the avatar, it is preferable that the number of operations when generating the avatar is small.

[0005] An example of the object of the present invention is to ensure the reliability of the person represented by the avatar and reduce the number of operations required of that person when generating the avatar.

Means for Solving the Problems

[0006] According to one aspect of the present invention, authentication means for performing a first authentication process on a target person included in a first image using the first image including the target person and master information of the target person; When the first authentication process is successful, avatar generation means for generating an avatar of the target person using the first image An avatar generation device comprising the same is provided.

[0007] According to one aspect of the present invention, avatar generation means for generating an avatar using a first image including a target person Authentication means for performing a first authentication process of the target person included in the first image using the first image and master information of the target person, and when the authentication is successful, authenticating the avatar An avatar generation device comprising the same is provided.

[0008] According to one aspect of the present invention, a computer A authentication process for performing a first authentication process of the target person included in the first image using a first image including the target person and master information of the target person An avatar generation process for generating an avatar of the target person using the first image when the first authentication process is successful An avatar generation method for performing the above is provided.

[0009] According to one aspect of the present invention, a computer An avatar generation process for generating an avatar using a first image including a target person A authentication process for performing a first authentication process of the target person included in the first image using the first image and master information of the target person, and when the authentication is successful, authenticating the avatar An avatar generation method for performing the above is provided.

[0010] According to one aspect of the present invention, a computer is provided with A authentication function for performing a first authentication process of the target person included in the first image using a first image including the target person and master information of the target person An avatar generation function for generating an avatar of the target person using the first image when the first authentication process is successful A computer-readable recording medium is provided that records a program for providing.

[0011] According to one aspect of the present invention, a computer is provided with an avatar generation function for generating an avatar using a first image including a target person, a first authentication process of the target person included in the first image is performed using the first image and master information of the target person, and when authentication is successful, an authentication function for making the avatar authenticated, A computer-readable recording medium is provided that records a program for providing.

Advantages of the Invention

[0012] According to one aspect of the present invention, the reliability of the person indicated by the avatar is ensured. Also, the number of operations required of the person when generating the avatar is small.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Embodiments for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

[0015] FIG. 1 is a diagram for explaining the usage environment of an avatar generation device 10 according to an embodiment. The avatar generation device 10 is a device that generates a human avatar and is used, for example, together with a terminal 20. The terminal 20 is a terminal operated by a user of the avatar generation device 10. The terminal 20 may be a portable terminal or a fixed terminal.

[0016] The terminal 20 has an imaging unit and a display. The user of the avatar generation device 10 operates the imaging unit of the terminal 20 to generate an image of a person to be the generation target of the avatar, that is, an image of the target person. The generated image is transmitted to the avatar generation device 10. Hereinafter, this image will be referred to as the first image. The first image may be a still image or a moving image. The avatar generation device 10 performs an authentication process of the target person using the first image. At this time, the avatar generation device 10 uses, for example, master information of the target person and the first image. Hereinafter, this authentication process will be referred to as the first authentication process. When the first authentication process is successful, the avatar generation device 10 generates an avatar of the target person using the first image and stores it in a storage unit. This storage unit may be a part of the avatar generation device 10 or may be located outside the avatar generation device 10. Further, the avatar generation device 10 may display the generated avatar on the display of the terminal 20. In this way, the user of the terminal 20 can immediately confirm the avatar generated by the avatar generation device 10. Note that the user of the terminal 20 and the target person may be the same or different.

[0017] There are various ways to use the generated avatar. For example, the avatar may be used in a virtual space. In this case, the virtual space where the avatar is used may be, for example, a game or a communication tool such as a virtual conference. Also, the avatar may be used in an SNS (Social Networking Service). In this case, since a person who sees the avatar displayed on the SNS recognizes that the avatar is the avatar of the owner of that account, it is easy to feel affection for that avatar. Also, the service in which the avatar is used may be provided by the avatar generation device 10 or may be provided by another server. In the latter case, the other server is connectable to the storage unit that stores the avatar.

[0018] FIG. 2 is a diagram showing an example of the functional configuration of the avatar generation device 10. The avatar generation device 10 includes an authentication unit 110, an avatar generation unit 120, a display unit 130, and a storage unit 140.

[0019] The authentication unit 110 acquires the first image generated by the terminal 20 and performs the first authentication process of the target person using this first image and the master information of the target person. Here, the master information is information that is guaranteed to be, for example, the face information of the target person. As an example, the master information may be registered in advance in a storage means such as the storage unit 140. In this case, the storage means for storing the master information may be located outside the avatar generation device 10.

[0020] As another example, the master information may be generated using an image of the target person, for example, an image obtained by photographing an identification document including the face image of the target person. In this case, the authentication unit 110 acquires an image of the target person via, for example, the terminal 20 and generates master information using this image. Here, an example of the identification document is a driver's license or a passport, but it is not limited to these. Also, when the identification document has a non-volatile memory and the image of the target person is stored in this non-volatile memory, the authentication unit 110 may generate master information using this image.

[0021] When the authentication unit 110 succeeds in the first authentication process, for example, when the degree of coincidence between the person included in the first image and the master information exceeds the standard, the avatar generation unit 120 generates an avatar using the first image. Then, the avatar generation unit 120 stores the generated avatar in the storage unit 140. Here, the avatar generation unit 120 may also store the first image in the storage unit 140 in association with the avatar. In addition, when the authentication unit 110 generates master information using the image of the target person included in the identification document, the avatar generation unit 120 may also store this master information in the storage unit 140 in association with the avatar.

[0022] Instead of the first image, the avatar generation unit 120 may generate an avatar using the image of the target person included in the identification document.

[0023] The display unit 130 displays the avatar on the display. At this time, the display unit 130 may also display information indicating that the first authentication process has succeeded on the display together with the avatar. This display indicates that the displayed avatar is based on the image that has succeeded in the first authentication process, that is, it is an avatar whose identity has been authenticated. The information displayed here includes, for example, a sentence indicating that the first authentication process has succeeded. An example of the display on which the display unit 130 displays the avatar or the like is the display of the terminal 20. In this case, the user of the terminal 20 can recognize that the first authentication process has succeeded.

[0024] In addition, after the avatar generation unit 120 generates an avatar, the authentication unit 110 may perform a second authentication process on the target person. In this second authentication process, the authentication unit 110 may use the avatar generated by the avatar generation unit 120. Specific examples of the second authentication process will be described later with reference to other figures.

[0025] FIG. 3(A) is a diagram showing an example of information that is the source of master information, FIG. 3(B) is a diagram showing an example of a first image, and FIG. 3(C) is a diagram showing an example of an avatar. In the example shown in FIG. 3(A), the authentication unit 110 generates master information using the face image included in the license. In the example shown in FIG. 3(B), the first image is a face image of a target person. And in the example shown in FIG. 3(C), the avatar inherits the features of the face image included in the first image.

[0026] FIG. 4 is a diagram showing an example of the hardware configuration of the avatar generation device 10. The avatar generation device 10 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0027] The bus 1010 is a data transmission path for the processor 1020, the memory 1030, the storage device 1040, the input / output interface 1050, and the network interface 1060 to transmit and receive data to and from each other. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0028] The processor 1020 is a processor implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0029] The memory 1030 is a main memory device implemented by a RAM (Random Access Memory) or the like.

[0030] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a removable medium such as a memory card, or a read only memory (ROM). The storage device 1040 stores program modules that implement the respective functions of the avatar generation device 10 (for example, the authentication unit 110, the avatar generation unit 120, and the display unit 130). When the processor 1020 reads and executes these program modules onto the memory 1030, the respective functions corresponding to the program modules are realized. Further, the storage device 1040 also functions as a storage unit 140.

[0031] The input / output interface 1050 is an interface for connecting the avatar generation device 10 and various input / output devices.

[0032] The network interface 1060 is an interface for connecting the avatar generation device 10 to a network. This network is, for example, a local area network (LAN) or a wide area network (WAN). The method by which the network interface 1060 connects to the network may be a wireless connection or a wired connection. Then, the avatar generation device 10 communicates with the terminal 20 via the network interface 1060.

[0033] FIG. 5 is a diagram showing a first example of the avatar generation process performed by the avatar generation device 10.

[0034] First, the user of the terminal 20 operates the terminal 20 to generate a first image. The terminal 20 transmits the generated first image to the avatar generation device 10. The authentication unit 110 of the avatar generation device 10 acquires the first image from the terminal 20 (step S10).

[0035] Next, the authentication unit 110 acquires master information (step S20). If the master information is stored in the storage unit 140, the authentication unit 110 reads the master information from the storage unit 140. Further, when the master information is generated from the image of the identification document, the user of the terminal 20 operates the terminal 20 to generate an image of the identification document. The terminal 20 transmits the generated image to the avatar generation device 10. In step S20, the authentication unit 110 generates master information by processing this image.

[0036] Note that the order of step S10 and step S20 may be reversed. Also, step S10 and step S20 may be performed simultaneously.

[0037] Next, the authentication unit 110 calculates the degree of match between the first image and the master information, and when this degree of match is equal to or greater than the reference value, determines that the first authentication process has succeeded (step S30: Yes). Then, the avatar generation unit 120 generates an avatar using the first image (step S40).

[0038] Then, the display unit 130 transmits information indicating the authentication result to the terminal 20 and displays it on the display of the terminal 20. For example, when the first authentication process is successful (step S30: Yes), the display unit 130 displays the avatar generated in step S40 on the display of the terminal 20 (step S50). Also, when the first authentication process fails (step S30: No), the display unit 130 displays a screen indicating that the authentication has failed on the display of the terminal 20 (step S50).

[0039] FIG. 6 is a diagram showing an example of a screen displayed on the display of the terminal 20 in step S50 of FIG. 5. This figure shows the screen displayed when the first authentication process is successful in step S30. This screen includes the avatar generated in step S40 and a text indicating that the first authentication process has succeeded.

[0040] FIG. 7 is a diagram showing a second example of the avatar generation process performed by the avatar generation device 10. In the example shown in this figure, the processes from step S10 to step S40 are the same as those in the example shown in FIG. 5.

[0041] After the avatar generation unit 120 generates an avatar, the authentication unit 110 performs a second authentication process using this avatar. A specific example of the second authentication process will be described later with reference to other figures. When the second authentication process is successful (step S42: Yes), the display unit 130 causes a screen indicating successful authentication to be displayed on the display of the terminal 20. Otherwise (step S30: No, or step S42: No), the display unit 130 causes a screen indicating failed authentication to be displayed on the display of the terminal 20.

[0042] FIG. 8 is a diagram for explaining a first example of the second authentication process performed in step S42 of FIG. 7. FIG. 8 shows an example of a screen that the authentication unit 110 causes to be displayed on the display of the terminal 20 in the second authentication process (step S42 of FIG. 7). In the example shown in this figure, as the second authentication process, the authentication unit 110 is checking whether the target person performs a specified action on the spot. Thereby, the authentication unit 110 can check whether the target person is present.

[0043] Specifically, the authentication unit 110 causes an avatar to be displayed on the display of the terminal 20. Then, the authentication unit 110 causes this avatar to perform a first action that the target person should perform. Since this avatar is the avatar of the target person, the target person feels familiar with the avatar. Therefore, the target person is less likely to feel psychological resistance when performing the first action. The target person looking at the display of the terminal 20 performs the first action according to this avatar. The terminal 20 generates a second image by photographing the target person while the target person is performing the first action, and transmits this second image to the avatar generation device 10. The second image is preferably a video. When the second image is a video, the frame rate of the video is arbitrary.

[0044] The authentication unit 110 of the avatar generation device 10 recognizes the actions performed by the target person after the avatar has performed the first action by processing the second image. Then, the authentication unit 110 performs a second authentication process using the recognized action and the first action. As an example, the authentication unit 110 determines that the authentication of the target person has succeeded when the degree of coincidence between the recognized action and the first action is equal to or greater than a reference value.

[0045] FIG. 9 is a diagram for explaining a second example of the second authentication process performed in step S42 of FIG. 7. FIG. 9 shows an example of a screen that the authentication unit 110 causes to be displayed on the display of the terminal 20 in the second authentication process (step S42 of FIG. 7). Also in the example shown in this figure, the authentication unit 110 is confirming whether or not the target person performs the designated action on the spot as the second authentication process. In the example of FIG. 9, as shown in the upper area of FIG. 9, the authentication unit 110 causes the information indicating the first action to be displayed on the display of the terminal 20, and as shown in the lower area of FIG. 9, causes the second image to be displayed on the display of the terminal 20. Further, in the example of FIG. 9, the authentication unit 110 causes the target person shown in the second image to be displayed on the display of the terminal 20 with the target person replaced by the avatar. Even in this way, since the target person is familiar with the avatar, the target person is less likely to feel psychological resistance when performing the first action. At this time, the authentication unit 110 does not necessarily need to display the area other than the target person in the second image on the display. Here, the information indicating the first action may be, for example, an image in which a character different from the avatar performs the first action.

[0046] Note that, as described with reference to FIG. 1, the display unit 130 uses the generated avatar in an SNS or a virtual space.

[0047] In the above description, the avatar generation unit 120 and the display unit 130 are provided in the avatar generation device 10, which is a device different from the terminal 20. However, the avatar generation unit 120 and display unit 130It may be provided in the terminal 20. In this case, the authentication unit 110 transmits information indicating that the first authentication process has been successful to the terminal 20. Then, the avatar generation unit 120 in the terminal 20 generates an avatar using the first image. And the display unit 130 in the terminal 20 performs processing using this avatar.

[0048] Note that in FIGS. 5 and 7, the order of step S30 and step S40 may be reversed. That is, after the avatar generation unit 120 generates an avatar using the first image, the authentication unit 110 may perform the first authentication process. In this case, when the authentication unit 110 succeeds in the first authentication process, the avatar generated by the avatar generation unit 120 is set as the authenticated avatar. Also, when the authentication unit 110 fails in the first authentication process, it does not set it as the authenticated avatar.

[0049] As described above, according to the present embodiment, the avatar generation device 10 performs the first authentication process before generating an avatar. ta For this reason, the reliability of the person indicated by the avatar is ensured. Also, the avatar generation device 10 generates an avatar using the first image used in the first authentication process. For this reason, the user of the avatar generation device 10 does not need to separately prepare the image that is the basis of the avatar. Therefore, the number of operations when generating an avatar is reduced.

[0050] As described above, the embodiments of the present invention have been described with reference to the drawings, but these are examples of the present invention, and various configurations other than the above can also be adopted.

[0051] Also, in the plurality of flowcharts used in the above description, a plurality of steps (processes) are described in order, but the execution order of the steps executed in each embodiment is not limited to the described order. In each embodiment, the order of the illustrated steps can be changed within a range that does not substantially affect the content. Also, the above-described embodiments can be combined within a range where the contents do not conflict.

[0052] Some or all of the above embodiments can also be described as in the following supplementary notes, but are not limited thereto. 1. Authentication means for performing a first authentication process on a target person included in a first image using the first image including the target person and master information of the target person; Avatar generation means for generating an avatar of the target person using the first image when the first authentication process is successful; An avatar generation device comprising the above. 2. Avatar generation means for generating an avatar using a first image including a target person; Authentication means for performing a first authentication process on the target person included in the first image using the first image and master information of the target person, and when the authentication is successful, authenticating the avatar; An avatar generation device comprising the above. 3. In the avatar generation device according to the above 1 or 2, The avatar generation device further comprises display means for displaying, on a display, information indicating that the first authentication process has been successful, together with the avatar. 4. In the avatar generation device according to any one of the above 1 to 3, The authentication means further performs a second authentication process on the target person using the avatar after the avatar generation means generates the avatar. 5. In the avatar generation device according to the above 4, In the second authentication process, the authentication means Causes the avatar to perform a first action that the target person should perform, By processing a second image of the target person, recognizes an action performed by the target person after the avatar performs the first action, and performs the second authentication process using the action and the first action. 6. In the avatar generation device according to the above 4, The authentication means Obtains a second image of the target person taken for the second authentication process, In the second authentication process, an avatar generation device that causes a display to display information indicating a first action to be performed by the target person, and causes the display to display the second image with the target person shown in the second image replaced with the avatar. 7. In the avatar generation device according to any one of 1 to 6 above, The authentication means, in the first authentication process, An avatar generation device that acquires an image of the target person included in the identification document of the target person and generates the master information using the image. 8. A computer Performs an authentication process for performing a first authentication process on the target person included in the first image using the first image including the target person and the master information of the target person, When the first authentication process is successful, an avatar generation process for generating an avatar of the target person using the first image, An avatar generation method for performing. 9. A computer An avatar generation process for generating an avatar using a first image including a target person, Using the first image and the master information of the target person, performing a first authentication process on the target person included in the first image, and when the authentication is successful, an authentication process for making the avatar authenticated, An avatar generation method for performing. 10. In the avatar generation method according to 8 or 9 above, The computer further performs a display process of causing a display to display information indicating that the first authentication process has been successful together with the avatar. 11. In the avatar generation method according to any one of 8 to 10 above, In the authentication process, the computer further performs an avatar generation method of performing a second authentication process on the target person using the avatar after generating the avatar. 12. In the avatar generation method according to 11 above, The computer, in the second authentication process, Cause the avatar to perform a first action that the target person should perform. An avatar generation method that recognizes an action performed by the target person after the avatar has performed the first action by processing a second image of the target person, and performs the second authentication process using the action and the first action. 13. In the avatar generation method according to 11 above, In the authentication process, the computer Obtains a second image of the target person taken for the second authentication process, In the second authentication process, an avatar generation method that causes information indicating a first action that the target person should perform to be displayed on a display, and causes the second image to be displayed on the display with the target person shown in the second image replaced by the avatar. 14. In the avatar generation method according to any one of 8 to 13 above, In the first authentication process, the computer An avatar generation method that obtains an image of the target person included in the identification document of the target person, and generates the master information using the image. 15. On a computer, A authentication function that performs a first authentication process of the target person included in the first image using the first image including the target person and the master information of the target person, An avatar generation function that generates an avatar of the target person using the first image when the first authentication process is successful, A program having the above. 16. On a computer, An avatar generation function that generates an avatar using a first image including a target person, A authentication function that performs a first authentication process of the target person included in the first image using the first image and the master information of the target person, and when the authentication is successful, authenticates the avatar, A program having the above. 17. In the program according to 15 or 16 above, A program that further enables the computer to have a display function for displaying, on a display, information indicating that the first authentication process has been successful, together with the avatar. 18. In the program according to any one of the above items 15 to 17, The authentication function is a program that, after the avatar generation function generates the avatar, further performs a second authentication process on the target person using the avatar. 19. In the program according to item 18 above, In the second authentication process, the authentication function Causes the avatar to perform a first action to be performed by the target person, By processing a second image of the target person taken, recognizes an action performed by the target person after the avatar performs the first action, and performs the second authentication process using the action and the first action. 20. In the program according to item 18 above, The authentication function Obtains a second image of the target person taken for the second authentication process, In the second authentication process, a program that displays, on a display, information indicating a first action to be performed by the target person, and also displays the second image on the display with the target person shown in the second image replaced by the avatar. 21. In the program according to any one of the above items 15 to 20, The authentication function, in the first authentication process, Obtains an image of the target person included in the identification document of the target person, and generates the master information using the image.

[0053] This application claims priority based on Japanese Patent Application No. 2021-170852 filed on October 19, 2021, and incorporates the entire disclosure thereof herein.

Explanation of Reference Numerals

[0054] 10 Avatar generation device 20 terminals 110 authentication unit 120 avatar generation unit 130 display unit

Claims

1. authentication means for performing a first authentication process on the target person included in the first image using the first image including the target person and the master information of the target person; avatar generation means for generating an avatar of the target person using the first image when the first authentication process is successful; comprising; after the avatar generation means generates the avatar, the authentication means further performs a second authentication process on the target person using the avatar; Avatar generation device.

2. In the avatar generation device according to Claim 1, The avatar generation device further comprises display means for causing the display to display information indicating that the first authentication process has been successful together with the avatar.

3. In the avatar generation device according to Claim 1 or 2, In the second authentication process, the authentication means causes the avatar to perform a first action to be performed by the target person, By processing the second image of the target person, the action performed by the target person after the avatar performs the first action is recognized, and the second authentication process is performed using the action and the first action. Avatar generation device.

4. In the avatar generation device according to Claim 1 or 2, The authentication means acquires a second image of the target person taken for the second authentication process, In the second authentication process, information indicating a first action to be performed by the target person is displayed on the display, and the second image is displayed on the display with the target person shown in the second image replaced by the avatar. Avatar generation device.

5. In the avatar generation device according to Claim 1 or 2, In the first authentication process, the authentication means acquires an image of the target person included in the identification document of the target person, and generates the master information using the image. Avatar generation device.

6. A computer, a authentication process for performing a first authentication process on the target person included in the first image using the first image including the target person and the master information of the target person; an avatar generation process for generating an avatar of the target person using the first image when the first authentication process is successful; performing, after the computer generates the avatar, the computer further performs a second authentication process on the target person using the avatar; Avatar generation method.

7. On the computer, An authentication function that performs a first authentication process on the target person included in the first image by using the first image including the target person and the master information of the target person; An avatar generation function that generates an avatar of the target person by using the first image when the first authentication process is successful; be provided with; After the avatar generation function generates the avatar, the authentication function further performs a second authentication process on the target person by using the avatar. Program.

Citation Information

Patent Citations

  • Face image authentication apparatus

    JP2012160001A

  • Program, information processing apparatus, communication system, and communication method

    JP2016018313A

  • Image processing apparatus, computer program, video call system, and image processing method

    JP2019201360A

  • Three-dimensional information generation device, biometric authentication device, and three-dimensional image generation device

    JP2020129175A

  • Communication system, information processing apparatus, communication method, and program

    JP2021016083A