Information processing device, information processing system, information processing method and program

Abstract

An apparatus and method for reliably performing ownership transfer processing of virtual items are provided. The present invention has a data processing unit for performing display control of an AR image in which real objects and virtual content are superimposed and displayed. The data processing unit performs display control of virtual items and a virtual item trading box, ownership is registered for the virtual items, the virtual item trading box is used to transfer the ownership of the virtual items, and the data processing unit transfers the ownership of the virtual items in the case of performing a handover of the virtual items in the virtual item trading box. In the case where a user who is to provide the virtual item opens his hand while the hand is in the virtual item trading box, the virtual item moves toward the hand of the user who is to receive the virtual item, and the ownership transfer registration processing is performed.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a program. More specifically, the present disclosure relates to an information processing device, an information processing system, an information processing method, and a program that perform a process of transferring ownership of virtual content between users using an augmented reality (AR) image displayed by superimposing virtual content on a real object that can be observed in reality. Background Art

[0002] A real object that can be observed in a real space or an image displayed by superimposing a virtual object on a real object image is called an augmented reality (AR) image.

[0003] For example, a process of displaying an image of a person in a real space and displaying virtual content is performed as an example of content display by an AR image.

[0004] Specifically, for example, in the case where battle-type game content in which a plurality of real people form a team to fight each other is displayed as an AR image, there is a case where processing is performed to display various weapons such as swords and pistols as virtual items (virtual content) and to provide the weapons owned by the user (real person) to another user.

[0005] For example, when a virtual item such as a "sword" is provided from user A to user B, the ownership of the virtual item "sword" is transferred from user A to user B.

[0006] However, in the case where user A who owns the virtual item “sword” wants to pass the “sword” to user B who appears on the AR image, user A performs a process of presenting the “sword” to user B. However, there is a problem in that user B who is viewing the AR image cannot determine whether the process of presenting the “sword” by user A indicates that user A wants to provide the “sword” to user B or that user A wants to use the “sword” to fight user B.

[0007] Furthermore, there is a problem that even in the case where user A hands the “sword” to user B, it is unclear whether user A is temporarily lending the “sword” to user B or has completely transferred ownership.

[0008] Furthermore, in a case where not only user B to whom user A wants to deliver the virtual item but also other users C, D, E, etc. are displayed in the real space displayed as an AR image, there is also a problem that it is difficult to reliably deliver the virtual item to user B.

[0009] Note that as a conventional technology that discloses processing related to association between virtual items and users, for example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2018-153354) is available.

[0010] Patent Document 1 discloses a process of registering a currency object, which is a virtual item, in association with an owning user.

[0011] Specifically, it is a process of transferring ownership of a currency object such as by handing over the currency object between two users.

[0012] However, this document has a configuration in which the ownership of a monetary object is acquired by a user through a process in which the user holds the monetary object in his hand, and there is a problem that, for example, when the possessing user of the monetary object discards the monetary object and the monetary object is picked up by another user, the problem of transferring ownership occurs regardless of the intention of the possessing user of the monetary object.

[0013] Furthermore, Patent Document 2 (Japanese Patent Application Laid-Open No. 2003-242527) discloses a process of designating a target user to whom the possessing user of a virtual object wants to deliver the virtual object.

[0014] The document has the following configuration: in this configuration, in the case of performing a process in which the possessing user of a virtual object holds the virtual object in hand and throws the virtual object to pass it to a target user, at the moment when the possessing user of the virtual object performs the throwing operation - specifically, at the moment when the movement speed of the hand becomes a certain level or lower - the user in the line of sight direction is determined as the target user to whom the possessing user passes the virtual object, and the throwing operation performs the operation of throwing the virtual object.

[0015] With this configuration, it is necessary to analyze the manual throwing operation and analyze the line of sight with high accuracy, and there is a problem that the cost is high because a configuration for performing such analysis processing becomes indispensable.

[0016] Furthermore, the disclosed configuration specifically discloses a configuration in which, in the case of playing a catch game, a ball is regarded as a virtual object and a throwing target to which the ball is thrown is specified, but does not disclose a concept of ownership transfer of the virtual object.

[0017] Reference List

[0018] Patent Literature

[0019] Patent Document 1: Japanese Patent Application Publication No. 2018-153354

[0020] Patent Document 2: Japanese Patent Application Laid-Open No. 2003-242527 Summary of the invention

[0021] Problems to be solved by the present invention

[0022] The present disclosure provides an information processing device, an information processing system, an information processing method, and a program that enable execution of a process in which ownership of a virtual item (virtual content) displayed in an AR image is transferred while being reliably identified between users.

[0023] Solution to the problem

[0024] The first aspect of the present disclosure is

[0025] An information processing device, comprising:

[0026] A data processing unit that performs display control of an augmented reality (AR) image, in which real objects and virtual contents are superimposed and displayed in the augmented reality (AR) image, wherein:

[0027] Data processing unit:

[0028] Performing display control of virtual items and a virtual item trading box, where the virtual item is a virtual content whose ownership is registered, and the virtual item trading box is a limited area for performing ownership transfer processing of the virtual item, and

[0029] When the delivery process of the virtual item is executed in the virtual item trading box, the process of transferring the ownership of the virtual item is executed.

[0030] In addition, a second aspect of the present disclosure is

[0031] An information processing system, comprising:

[0032] A user terminal having a display unit for displaying an augmented reality (AR) image in which a real object and virtual content are superimposed and displayed; and

[0033] a server that performs communication with a user terminal and performs display control of an AR image displayed on a display unit of the user terminal, wherein

[0034] As a virtual content display control process for the display unit of the user terminal,

[0035] The server performs display control of virtual items and a virtual item transaction box, wherein the virtual item is a virtual content with registered ownership, and the virtual item transaction box is a limited area for performing ownership transfer processing of the virtual item, and

[0036] When a delivery process of a virtual item is performed in the virtual item trading box, a process of transferring the ownership of the virtual item is performed.

[0037] In addition, a third aspect of the present disclosure is

[0038] An information processing method executed in an information processing device,

[0039] The information processing device includes a data processing unit, which performs display control of an augmented reality (AR) image, and superimposes and displays a real object and virtual content in the augmented reality (AR) image;

[0040] The information processing method comprises:

[0041] By the data processing unit,

[0042] Performing display control of virtual items and a virtual item transaction box, where the virtual item is a virtual content with registered ownership, and the virtual item transaction box is a limited area for performing ownership transfer processing of the virtual item; and

[0043] When a delivery process of a virtual item is performed in the virtual item trading box, a process of transferring the ownership of the virtual item is performed.

[0044] In addition, a fourth aspect of the present disclosure is

[0045] An information processing method executed in an information processing system, the information processing system comprising:

[0046] A user terminal having a display unit for displaying an augmented reality (AR) image in which a real object and virtual content are superimposed and displayed; and

[0047] a server that performs communication with a user terminal and performs display control of an AR image displayed on a display unit of the user terminal;

[0048] The information processing method comprises:

[0049] By the server,

[0050] As a virtual content display control process for the display unit of the user terminal,

[0051] Performing display control of virtual items and a virtual item transaction box, the virtual item being virtual content with registered ownership, and the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual item; and

[0052] When a delivery process of a virtual item is performed in the virtual item trading box, a process of transferring the ownership of the virtual item is performed.

[0053] In addition, a fifth aspect of the present disclosure is

[0054] A program for causing an information processing device to perform information processing, the information processing device comprising:

[0055] a data processing unit that performs display control of an augmented reality (AR) image in which a real object and virtual content are superimposed and displayed;

[0056] The program enables the data processing unit to:

[0057] Performing display control of virtual items and a virtual item transaction box, where the virtual item is a virtual content with registered ownership, and the virtual item transaction box is a limited area for performing ownership transfer processing of the virtual item; and

[0058] When a delivery process of a virtual item is performed in the virtual item trading box, a process of transferring the ownership of the virtual item is performed.

[0059] Note that the program of the present disclosure is, for example, a program that can be provided by a storage medium or a communication medium, which is provided in a computer-readable format to an information processing device or a computer system that can execute various program codes. By providing such a program in a computer-readable format, processing according to the program can be implemented on the information processing device or the computer system.

[0060] Other objects, features and advantages of the present disclosure will be apparent from the following examples of the present disclosure and a more detailed description based on the accompanying drawings. Note that in this specification, a system is a logical set configuration of multiple devices and is not limited to those in which each configured device is in the same housing.

[0061] With the configuration of one example of the present disclosure, an apparatus and method for reliably performing a virtual item ownership transfer process are realized.

[0062] Specifically, for example, a data processing unit that performs display control of an AR image in which a real object and virtual content are superimposed and displayed is provided. The data processing unit performs display control of a virtual item whose ownership is registered and a virtual item transaction box for transferring ownership of the virtual item, and further, in the case where delivery of the virtual item is performed in the virtual item transaction box, the ownership of the virtual item is transferred. When the virtual item providing user opens his hand in a state where the user's hand is in the virtual item transaction box, the virtual item is moved to the hand side of the virtual item receiving user, and ownership transfer registration processing, etc. are performed.

[0063] With this configuration, an apparatus and method for reliably performing virtual item ownership transfer processing are realized.

[0064] Note that the effects described in this specification are merely exemplary and non-limiting, and additional effects may be provided. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 It is a diagram for explaining the processing executed by the information processing device of the present disclosure.

[0066] Figure 2 It is a diagram for explaining the processing executed by the information processing device of the present disclosure.

[0067] Figure 3 It is a diagram for explaining the processing executed by the information processing device of the present disclosure.

[0068] Figure 4 It is a diagram for explaining the processing executed by the information processing device of the present disclosure.

[0069] Figure 5 It is a diagram for explaining the processing executed by the information processing device of the present disclosure.

[0070] Figure 6 is a diagram illustrating an example of a user list stored in a storage unit of the information processing device of the present disclosure.

[0071] Figure 7 2 is a diagram illustrating an example of an inter-user credit information list stored in a storage unit of the information processing device of the present disclosure.

[0072] Figure 8 is a diagram illustrating an example of a virtual item.

[0073] Fig. 9 This is a diagram for explaining an example of transaction processing of virtual items.

[0074] Fig.10 is a diagram illustrating an example of a list of items owned by a user stored in a storage unit of the information processing device of the present disclosure.

[0075] Fig.11 is a diagram illustrating a system configuration example of an information processing device of the present disclosure.

[0076] Fig.12 is a diagram illustrating a system configuration example of an information processing device of the present disclosure.

[0077] Fig.13 is a diagram illustrating a system configuration example of an information processing device of the present disclosure.

[0078] Fig.14 is a diagram illustrating a system configuration example of an information processing device of the present disclosure.

[0079] Fig.15 is a diagram illustrating a system configuration example of an information processing device of the present disclosure.

[0080] Fig.16is a diagram illustrating a system configuration example of an information processing device of the present disclosure.

[0081] Fig.17 is a diagram illustrating a system configuration example of an information processing device of the present disclosure.

[0082] Fig.18 is a diagram illustrating a configuration example of an information processing device of the present disclosure.

[0083] Fig.19 : is a diagram showing a flowchart explaining a processing sequence executed by the information processing apparatus of the present disclosure.

[0084] Fig. 20 : is a diagram showing a flowchart explaining a processing sequence executed by the information processing apparatus of the present disclosure.

[0085] Fig.21 2 is a diagram for explaining an example of display control of a virtual item trading box.

[0086] Fig. 22 : is a diagram showing a flowchart explaining a processing sequence executed by the information processing apparatus of the present disclosure.

[0087] Fig.23 It is a diagram for explaining a specific example of the processing executed by the information processing device of the present disclosure.

[0088] Fig.24 It is a diagram for explaining a specific example of the processing executed by the information processing device of the present disclosure.

[0089] Fig.25 is a diagram illustrating a hardware configuration example of the information processing device of the present disclosure. DETAILED DESCRIPTION

[0090] Hereinafter, details of the information processing device, information processing system, information processing method, and program of the present disclosure will be described with reference to the drawings. Note that the description will be given according to the following items.

[0091] 1. About the Processing Executed by the Information Processing Device of the Present Disclosure

[0092] 2. List of Processing and Storage Executed by the Information Processing Device of the Present Disclosure

[0093] 3. Configuration Example of Information Processing Device for Executing Virtual Content Display Control and Virtual Item Ownership Transfer Control

[0094] 4. Configuration example of information processing device

[0095] 5. Regarding the processing sequence executed by the information processing device of the present disclosure

[0096] 6. Specific examples of transfer of ownership of virtual items

[0097] 7. Hardware configuration examples of information processing devices

[0098] 8. Overview of the Configuration of the Present Disclosure

[0099] [1. Regarding the processing performed by the information processing device of the present disclosure]

[0100] First, refer to Figure 1 and subsequent figures describe processing performed by the information processing apparatus of the present disclosure.

[0101] Figure 1 A user wearing a transmissive head mounted display (HMD) 11 a , which is an example of an information processing device of the present disclosure, is shown.

[0102] The transmissive head mounted display (HMD) 11 a is an AR image display device.

[0103] Note that except Figure 1 The information processing device of the present disclosure may be realized as various devices such as a PC, a smartphone, and a server in addition to the illustrated head mounted display (HMD).

[0104] The information processing device of the present disclosure performs control regarding the transfer of ownership of virtual items (virtual content) displayed in an augmented reality (AR) image. Note that the virtual items described in the following examples are virtual content, and virtual content whose ownership is registered.

[0105] Virtual item transfer control processing can also be done in Figure 1 The process is executed in a data processing unit in the head mounted display (HMD) shown, and may also be executed in various devices such as a PC, a smartphone, and a server.

[0106] Examples using these various means will be described below.

[0107] First, refer to Figure 1 and subsequent figures, will describe the assumption Figure 1 A series of processes performed by the information processing device of the present disclosure in the case where a data processing unit in the head mounted display (HMD) shown executes virtual item transfer control processing.

[0108] Note that the users include a “virtual item providing user 10 ” and a “virtual item receiving user 20 ”.

[0109] The virtual item providing user 10 is a user who possesses a virtual item which is a virtual content displayed on the transmissive HMD 11 a as an AR image display device, and who provides the possessed virtual item to the virtual item receiving user 20 .

[0110] When the virtual item providing process is executed, the ownership of the virtual item is transferred from the virtual item providing user 10 to the virtual item receiving user 20 .

[0111] This process will be described in detail below.

[0112] exist Figure 1 The user shown on the left is a virtual item providing user 10 .

[0113] The virtual item providing user 10 wears the transmissive HMD 11a so as to cover the eyes.

[0114] The transmissive HMD 11a has a transmissive display unit (display). The transmissive display unit (display) is attached so as to be located in front of the user.

[0115] The virtual item providing user 10 can observe an external real object as it is through the transmissive display unit (display) of the transmissive HMD 11 a.

[0116] Furthermore, a virtual content image of a virtual object, such as a character or various item images, is displayed on the transmissive display unit (display).

[0117] The virtual item providing user 10 can observe external real objects and virtual content images together via the transmissive HMD 11 a to experience a feeling that virtual content (eg, a character or an item) exists in the real world.

[0118] exist Figure 1 , an example of an image that can be provided by a virtual item and observed by the user 10 via the transmissive HMD 11 a is shown.

[0119] (1) Display image @ t1 is an example of an image observed by the user 10 in the transmissive HMD 11 a provided by a virtual item at time= t1 . This display image includes only the external real object image 21 .

[0120] The display image includes the virtual item receiving user 20. The virtual item receiving user 20 is a real object and is a user who really exists. The virtual item receiving user 20 also wears a transmissive HMD 11b similar to the transmissive HMD 11a of the virtual item providing user 10.

[0121] (2) Display image @t2 is a display image at the next time = t2. The display image at time t2 is an image in which the virtual content 13 is additionally displayed on the display image at time t1.

[0122] The virtual content 13 includes the “user name (Alice)” of the virtual item receiving user 20 and the “authentication identification mark” indicating that the virtual item receiving user 20 is a reliable authenticated user.

[0123] The ID and position of the virtual item receiving user 20 are identified by the ID and position set in the transmissive HMD 11b worn by the virtual item receiving user 20. Note that in the case where the HMD is not used, a camera may be used. For example, user recognition processing may be performed based on a facial image of a person captured by the camera 12 of the transmissive HMD 11a worn by the virtual item providing user 10 to display the name of the identified user.

[0124] Furthermore, in the case where it is determined that the identified user (Alice in this example) is a reliable “trusted user” of the virtual item providing user 10 , an “authentication identification mark” indicating that the user is a “trusted user” is displayed.

[0125] The data processing unit of the information processing device performs display control of such a user name and authentication identification mark. In this example, the display control is performed by the data processing unit of the transmissive HMD 11a worn by the virtual item providing user 10.

[0126] The details of this processing will be described below.

[0127] Next, we will refer to Figure 2 2 and subsequent drawings describe examples of images displayed on the transmissive HMD 11 a worn by the virtual item providing user 10 at time=t3 and after time=t3.

[0128] (3) Figure 2 The display image @ t3 is an image displayed on the transmissive HMD 11 a worn by the virtual item providing user 10 at time = t3 after time t2.

[0129] In the display image at time t3, a virtual item 31 as virtual content to be traded is displayed.

[0130] The virtual item 31 is a virtual item of which the virtual item providing user 10 has ownership, and display is performed in a state where the virtual item providing user 10 holds the virtual item 31 in hand.

[0131] Note that the hand of the virtual item providing user 10 shown in the display image @t3 is a real object, that is, an actual hand of the virtual item providing user 10. However, an image of the hand of the virtual item providing user 10 may be displayed as virtual content.

[0132] In the display image at time t3, in addition to the virtual item 31, a virtual item trading box 32 is displayed as virtual content.

[0133] The virtual item transaction box 32 is a box displayed as a transaction execution area for executing a transaction process of the virtual item 31 , that is, a transfer process of the ownership of the virtual item.

[0134] Note that in the following description of the example, an example in which the virtual item transaction box 32 is a columnar space area will be described, but the area of ​​the virtual item transaction box 32 can be set in various ways. For example, it can be a three-dimensional space area with a cubic shape or a spherical shape. In addition, a flat circular area or a rectangular area can also be set on the screen.

[0135] In the example described below, the virtual item trading box 32 will be described as a columnar space area.

[0136] The virtual item transaction box 32 is a box that is displayed when a predetermined display condition is satisfied.

[0137] The conditions for displaying the virtual item transaction box 32 are, for example, the conditions described below.

[0138] (a) The distance between the “credit user” for which the “authentication identification mark” is displayed and the virtual item providing user 10 is equal to or smaller than a predetermined threshold distance.

[0139] For example, the virtual item trading box 32 is displayed when the above-mentioned condition (a) is satisfied.

[0140] The condition determination process and the display control process are executed in the data processing unit of the information processing device. In this example, the condition determination process and the display control process are executed by the data processing unit of the transmissive HMD 11a worn by the virtual item providing user 10.

[0141] Note that the condition for displaying the virtual item transaction box 32 is not limited to the above-mentioned condition (a), but may be, for example, the following condition (b).

[0142] (b) The “trusted user” for which the “authentication identification mark” is displayed is displayed in a specified area of ​​the transmissive HMD 11 a worn by the virtual item providing user 10 .

[0143] For example, the virtual item transaction box 32 may also be set to be displayed when the above-mentioned condition (b) is satisfied.

[0144] (4) Figure 2 The display image @t4 is an image displayed on the transmissive HMD 11a worn by the virtual item providing user 10 at time t4 after time t3.

[0145] The display image at this time t4 indicates a state in which the virtual item providing user 10 holding the virtual item 31 as the virtual content to be traded holds out the virtual item 31 and puts it into the virtual item trading box 32 .

[0146] This process is performed by providing the user 10 with the virtual item that is actually extended.

[0147] Note that although the virtual item providing user 10 actually has nothing, a hand in a state of holding the virtual item 31 is displayed as a display image.

[0148] The data processing unit of the information processing device performs display control of changing the display position of the virtual item 31 according to the movement of the hand of the virtual item providing user 10 .

[0149] like Figure 2 As shown in (4) display image @t4, the process of the virtual item providing user 10 extending the virtual item 31 and placing it into the virtual item transaction box 32 becomes an indication of the intention of the virtual item providing user 10 to transfer the virtual item 31 to another user.

[0150] Here, the virtual item providing user 10 indicates an intention to provide the virtual item 31 to the virtual item receiving user 20 , that is, to transfer ownership.

[0151] Next, we will refer to Figure 3 Describe the subsequent processing.

[0152] (5) Figure 3 The display image @t5 is an image displayed on the transmissive HMD 11a worn by the virtual item providing user 10 at time = t5 after time t4.

[0153] The display image at this time t5 is an image showing a state in which the virtual item receiving user 20 places his hand in the virtual item transaction box 32 in a state in which the virtual item providing user 10 places the virtual item 31 and the hand in the virtual item transaction box 32 .

[0154] The process in which the virtual item receiving user 20 places his hand in the virtual item transaction box 32 is a process indicating that the virtual item receiving user 20 has the intention to receive the virtual item 31 .

[0155] (6) Figure 3The display image @6 is an image displayed on the transmissive HMD 11 a worn by the virtual item providing user 10 at time = t6 after time t5.

[0156] The display image at this time t6 is an image showing a state in which the virtual item providing user 10 has released the virtual item 31 and pulled the hand out of the virtual item transaction box 32 while the virtual item receiving user 20 holds the virtual item 31 in the virtual item transaction box 32 .

[0157] Through this process, the ownership of the virtual item 31 is transferred from the virtual item providing user 10 to the virtual item receiving user 20 .

[0158] The information processing device stores a list of ownership in a storage unit in units of each virtual item, and updates registration information of the list when the ownership of the virtual item is transferred.

[0159] In this example, a list update process for changing the ownership of the virtual item 31 from the virtual item providing user 10 to the virtual item receiving user 20 is performed.

[0160] The details of this processing will also be described below.

[0161] In addition, (7) Figure 4 The display image @7 is an image displayed on the transmissive HMD 11 a worn by the virtual item providing user 10 at time = t7 after time t6.

[0162] The display image at this time t7 shows a state in which the virtual item receiving user 20 pulls the hand out of the virtual item transaction box 32 while holding the virtual item 31 .

[0163] In addition, (8) Figure 4 The display image @8 is an image displayed on the transmissive HMD 11 a worn by the virtual item providing user 10 at time = t8 after time t7.

[0164] The display image at this time t8 shows a state in which the virtual item receiving user 20 has moved while holding the virtual item 31 .

[0165] Furthermore, in the display image at this time t8, the display of the virtual item transaction box 32 is turned off and is in a hidden state.

[0166] When a predetermined condition is satisfied, the information processing device turns off the display of the virtual item transaction box 32 and changes it to a hidden state.

[0167] The conditions for closing the display of the virtual item transaction box 32 are, for example, the following conditions.

[0168] (a) The distance between the “credit user” for which the “authentication identification mark” is displayed and the virtual item providing user 10 is equal to or greater than a predetermined threshold distance.

[0169] For example, when the above condition (a) is satisfied, the display of the virtual item transaction box 32 is closed and hidden.

[0170] The condition determination process and the display control process are executed in the data processing unit of the information processing device. In this example, the condition determination process and the display control process are executed by the data processing unit of the transmissive HMD 11a worn by the virtual item providing user 10.

[0171] Note that the condition for hiding the virtual item transaction box 32 is not limited to the above-mentioned condition (a), but may be, for example, the following condition.

[0172] (b) The “credit user” for which the “authentication identification mark” is displayed has moved from inside the designated area of ​​the transmissive HMD 11 a worn by the virtual item providing user 10 to outside the designated area.

[0173] (c) the hand of the “credit user” for which the “authentication identification mark” is displayed has been pulled out of the virtual item transaction box 32, and

[0174] (d) The position of the “credit user” for which the “authentication identification mark” is displayed has moved away from the virtual item transaction box 32 by a specified distance or more.

[0175] For example, in the case where any one of the above conditions (b) to (d) is satisfied, a process may be performed in which the display of the virtual item transaction box 32 is turned off and becomes a hidden state.

[0176] Referenced above Figures 1 to 4 Describes a series of sequences for the virtual item ownership transfer process.

[0177] [2. Regarding the processing performed by the information processing device of the present disclosure and the list stored]

[0178] Next, we will refer to Figure 5 1 and subsequent drawings to describe the processing performed by the information processing device of the present disclosure and the list stored in the storage unit of the information processing device.

[0179] Figure 5 1 is a diagram for explaining the process performed by the information processing apparatus of the present disclosure by roughly dividing the process performed by the information processing apparatus of the present disclosure into three processing steps, ie, the processes of steps S01 to S03 .

[0180] Hereinafter, the processing of each step will be described in sequence.

[0181] (Step S01)

[0182] First, in step S01, the information processing device of the present disclosure performs user identification processing on the transaction target (virtual item receiving user) as processing before performing transaction processing for transferring ownership of virtual items. In addition, thereafter, authentication processing (credit confirmation processing) is performed on the transaction target (virtual item receiving user) for which user identification has been successful.

[0183] An authentication identification mark (badge, etc.) is displayed near the transaction target (virtual item receiving user) only when the authentication process (credit confirmation process) regarding the transaction target (virtual item receiving user) is successful and it is determined that the transaction target (virtual item receiving user) is a trustworthy user.

[0184] The processing of step S01 corresponds to the above reference Figure 1 The process of transitioning from (1) displaying image @t1 to (2) displaying image @t2 is described.

[0185] When performing user identification processing on a transaction target (virtual item receiving user), the information processing device refers to a user list stored in a storage unit of the information processing device.

[0186] Figure 6 A specific example of a user list stored in a storage unit of an information processing device is shown.

[0187] like Figure 6 As shown, data described below are registered in the user list in association with each other.

[0188] (a) User ID

[0189] (b) Username

[0190] (c) User’s facial image

[0191] The user who uses the system of the present disclosure performs user registration in advance. Specifically, a process of registering a user name and a face image is performed.

[0192] In the case where a new user is detected in the display unit controlled by the information processing apparatus, the information processing apparatus first performs a process of identifying the user.

[0193] Note that, as described above, the ID and position of the virtual item receiving user 20 can be identified by the ID and position set in the transmissive HMD 11 b worn by the virtual item receiving user 20 .

[0194] Note that, without using an HMD, a process may be performed in which a camera-captured image captured by a camera of an information processing device is compared with facial images registered in a user list and a registered facial image having a high degree of match with the captured image is extracted. In addition, a process is performed in which a user name recorded in an entry of the extracted registered facial image is displayed as virtual content near the detected user.

[0195] For example, the above reference Figures 1 to 4 Descriptive user name, such as [Alice].

[0196] Furthermore, thereafter, the information processing apparatus performs authentication processing (credibility confirmation processing) regarding the transaction target (virtual item receiving user) for which user identification has succeeded.

[0197] An authentication identification mark (badge, etc.) is displayed near the transaction target (virtual item receiving user) only when the authentication process (credit confirmation process) regarding the transaction target (virtual item receiving user) is successful and it is determined that the transaction target (virtual item receiving user) is a trustworthy user.

[0198] An authentication process (credibility confirmation process) regarding a transaction target (virtual item receiving user) for which user identification has succeeded is performed with reference to the inter-user credit information list stored in the storage unit of the information processing device.

[0199] Figure 7 A specific example of the inter-user credit information list stored in the storage unit of the information processing device is shown.

[0200] like Figure 7 As shown, the inter-user credit information list includes two lists described below.

[0201] (2-1) Credit User List

[0202] (2-2) Rejected User List

[0203] (2-1) The credit user list is a list in which users ((b) credit users) given credit by a user ((a) user ID) are registered.

[0204] As shown in the figure, correspondence data between (a) user ID and (b) credit user ID is registered.

[0205] The user ID of the user to whom credit is given by the user having the user ID recorded in the item “(a) User ID” in the credit user list is registered in the item “(b) Credit user ID”.

[0206] This list is generated and updated by, for example, each user notifying the information processing apparatus of "credited users" to whom the user gave credit.

[0207] The data processing unit of the information processing device records the user ID of the user who made the notification in the item “(a) User ID”, and records the user ID of the “credited user” included in the notification in the item “(b) Credited user”.

[0208] On the other hand, (2-2) the rejected user list is a list in which users ((b) rejected users) to whom the user ((a) user ID) has not given credit are registered.

[0209] As shown in the figure, correspondence data between (a) user ID and (b) rejected user ID is registered.

[0210] The user IDs of users not given credit by the users having user IDs recorded in the item “(a) User ID” in the rejected user list are registered in the item “(b) Rejected User ID”.

[0211] The list is also generated and updated by, for example, each user notifying the information processing apparatus of "rejected users" to whom the user did not give credit.

[0212] The data processing unit of the information processing device records the user ID of the user who made the notification in the item “(a) User ID”, and records the user ID of the “rejected user” included in the notification in the item “(b) Rejected user”.

[0213] Figure 7 Shows

[0214] (2-1) Credit User List

[0215] (2-2) List of rejected users.

[0216] The data recorded in these lists correspond to the data registered according to Figure 7 A list of data on the credit and rejection relationships of users (user ID=001 to 004) is shown in the lower right corner.

[0217] In this way, the storage unit of the information processing device records the inter-user credit information list including the following two lists: a credit user list in which credit users given credit to each user are registered and a rejected user list in which rejected users not given credit to each user are registered.

[0218] exist Figure 5 In step S01 shown, the information processing apparatus executes the following processing.

[0219] The information processing device refers to the inter-user credit information list and performs authentication processing (credit confirmation processing) on ​​the transaction target (virtual item receiving user).

[0220] The user ID of the transaction target (the user receiving the virtual item) is in Figure 7 In the case of a "credit user" registered as a virtual item providing user in the credit user list shown in (2-1), it is determined that the transaction target (virtual item receiving user) is a "credit user". In this case, an authentication identification mark (badge, etc.) is displayed near the transaction target (virtual item receiving user).

[0221] On the other hand, the user ID of the transaction target (the user receiving the virtual item) is Figure 7 If a "credit user" is not registered as a virtual item providing user in the credit user list shown in (2-1), it is determined that the transaction target (virtual item receiving user) is not a "credit user". In this case, the process of displaying the authentication identification mark (badge, etc.) near the transaction target (virtual item receiving user) is not performed.

[0222] In this case, no execution Figure 5 The virtual item transaction processing of step S02 and subsequent steps.

[0223] Only when it is determined that the transaction target (virtual item receiving user) is a "credit user" and the processing of displaying an authentication identification mark (badge, etc.) near the transaction target (virtual item receiving user) is executed, Figure 5 The processing of step S02 and subsequent steps is shown.

[0224] (Step S02)

[0225] The information processing apparatus executes the processing in step S02 described below.

[0226] When the virtual item providing user approaches an authenticated transaction target (virtual item receiving user) holding the virtual item to be traded (or a marker associated with the virtual item) in his hand, a virtual item trading box is displayed near the transaction target (virtual item receiving user).

[0227] The processing of step S02 corresponds to the above reference Figure 1 and Figure 2 The description is about the process of transferring from (2) displaying image @t2 to (3) displaying image @t3.

[0228] The information processing device performs display control of the virtual item trading box.

[0229] As described above, the display conditions of the virtual item trading box are, for example, the following conditions.

[0230] (a) The distance between the “credit user” for which the “authentication identification mark” is displayed and the virtual item providing user is equal to or smaller than a predetermined threshold distance.

[0231] The information processing device performs processing to display the virtual item trading box, for example, when determining that the above-mentioned condition (a) is satisfied.

[0232] Note that, as described above, the display condition of the virtual item trading box is not limited to the above-described condition (a), but may be, for example, the following condition (b).

[0233] (b) The “credited user” for which the “authentication identification mark” is displayed is displayed in a specified area of ​​the transmissive AR image display device worn by the virtual item providing user.

[0234] For example, a virtual item trading box may also be set to be displayed when the above condition (b) is satisfied.

[0235] Note that, in the case where the virtual item to be traded is small enough to be held in the hand, the information processing device displays the virtual item in the state of being held in the hand as it is. However, in the case where the virtual item to be traded is large but not small enough to be held in the hand or in the case where it is an intangible object such as a location, status, license, voucher, etc., the virtual item itself may be configured not to be displayed, but a mark associated with the virtual item may be configured to be displayed.

[0236] Will refer to Figure 8 A specific example is described.

[0237] Figure 8 The example shown is an example in which the virtual item 31 to be traded is a house. The house itself is large and cannot be held in the user's hand. Note that the house is a virtual content.

[0238] In such a case, alternative virtual items 35 associated with the house as a virtual item, ie, alternative virtual items 35 such as coins, cards, icons, or miniatures, are displayed so as to be held in the hand.

[0239] (Step S03)

[0240] Back to Figure 5 , the processing of the final step 03 will be described.

[0241] After executing the display processing of the virtual trading box in step S02, the information processing apparatus executes the following processing in step S03.

[0242] The ownership of the virtual item is transferred according to detecting that the process of handing over the virtual item to the transaction target (virtual item receiving user) is performed in a state where both the virtual item providing user and the virtual item receiving user put their hands in the virtual item transaction box.

[0243] Will refer to Fig. 9 A specific example of a process of handing over a virtual item from a virtual item providing user to a virtual item receiving user in a virtual item trading box will be described.

[0244] Fig. 9 The state shown in (a) indicates an initial state in which both the virtual item providing user 10 and the virtual item receiving user 20 put their hands in the virtual item transaction box.

[0245] The initial state is a state in which the virtual item providing user 10 holds the virtual item 31 to be traded in his hand.

[0246] The virtual item receiving user 20 is in a state where his hand is open and he is not holding anything.

[0247] Next, the virtual item 31 is provided from the virtual item providing user 10 to the virtual item receiving user 20, so that Fig. 9 (b) The state shown.

[0248] Fig. 9 The state shown in (b) is a state in which the virtual item receiving user 20 holds the virtual item 31 to be traded in his hand.

[0249] The virtual item receiving user 10 is in a state where his hand is open and he is not holding anything.

[0250] For example, the information processing apparatus detects that the virtual item providing user 10 has shifted from a clenched hand state to an open hand state, and performs display control to move the display position of the virtual item 31 to the position of the hand of the virtual item receiving user 20 .

[0251] When the virtual item receiving user 20 clenches his hand in this state, the information processing device then follows the position of the hand of the virtual item receiving user 20 to display the virtual item 31 .

[0252] The information processing device performs display control such as this.

[0253] Note that the detection of the user's hand clenching and opening motions is performed, for example, by analyzing images captured by a camera.

[0254] However, the process of moving virtual items between different users' hands in this manner is limited to the case where two users' hands are within the virtual item transaction box 32 .

[0255] In the space outside the virtual item transaction box 32, even when the hands of two users are close to each other, a process of moving virtual items between the hands of different users is not performed.

[0256] That is, the information processing device executes the virtual item ownership transfer process only when the hands of two users are within the virtual item transaction box 32 .

[0257] Furthermore, in a case where the hands of two users are within the virtual item transaction box 32 and the virtual item has been moved between the hands of the two users, the information processing apparatus updates the ownership registration information of the virtual item.

[0258] The information processing device stores a list of items owned by a user in a storage unit, and performs a process of updating the list.

[0259] Will refer to Fig.10 A specific example of the process of updating the list of items owned by a user will be described.

[0260] Fig.10 Shown are lists of items owned by two users before and after an update process as described below.

[0261] (3-1) List of items owned by the user (before update)

[0262] (3-2) List of items owned by the user (after update)

[0263] like Fig.10 As shown, the list of items owned by the user includes corresponding data for each data described below.

[0264] (a) User ID

[0265] (b) Name of the item you own

[0266] (c) Number of items owned

[0267] For example, in the first entry in the list of items owned by the user (before updating) at (3-1),

[0268] (a) User I = 001

[0269] (b) Name of item owned = Star

[0270] (c) Number of items owned = 3

[0271] Record these registration data.

[0272] This is data indicating that the user of user ID=001 owns three virtual items (stars).

[0273] For example, when executing reference Fig. 9When the virtual items (stars) are traded between the users, the information processing device executes an update Fig.10 Processing of a list of items owned by the user shown.

[0274] Assume that a virtual item (star) has been provided from a user with user ID=001 to a user with user ID=002.

[0275] In this case, the information processing apparatus performs processing to change the list registration data of (3-1) the list of items owned by the user (before updating) to the list registration data of (3-2) the list of items owned by the user (after updating).

[0276] In (3-1) the list of items owned by the user (before updating),

[0277] The number of virtual items (stars) owned by user ID = 001 = 3, and

[0278] The number of virtual items (stars) owned by user ID=002=1.

[0279] When a virtual item (star) is provided from the user of user ID=001 to the user of user ID=002, a list update process of changing registration data as described below as indicated in (3-2) User-owned item list (after update) is executed.

[0280] User ID = 001's virtual item (star) quantity = 2

[0281] User ID = 002's virtual item (star) quantity = 2

[0282] In this manner, the information processing apparatus performs processing for updating the list of virtual items owned by the user stored in the storage unit at the time of virtual item transaction processing.

[0283] Through such processing, the process of virtual item transaction between users, that is, the ownership transfer process can be performed safely and reliably.

[0284] In the process of the present disclosure, the virtual item transaction process, that is, the ownership transfer process is performed under the following conditions.

[0285] (Condition 1) The virtual item receiving user is a user authenticated as trustworthy by the virtual item providing user.

[0286] (Condition 2) Both the hand of the virtual item providing user and the hand of the virtual item receiving user who is a user authenticated as reliable by the virtual item providing user are in the virtual item transaction box.

[0287] The virtual item transaction process is possible only when these two conditions (condition 1) and (condition 2) are met.

[0288] By enabling the transfer of ownership of virtual items only under such specific conditions, it is possible to prevent the ownership of virtual items from being erroneously transferred against the intention of the virtual item owner.

[0289] With the configuration of the present disclosure, in order to transfer the ownership of a virtual item, both the user who wants to assign the ownership of the virtual item and the user who wants to acquire the ownership of the virtual item need to put their hands in the virtual item transaction box. Therefore, after confirming that both the user who wants to assign the ownership of the virtual item and the user who wants to acquire the ownership of the virtual item have reached an agreement to transfer the ownership of the virtual item, the ownership of the virtual item can be transferred.

[0290] [3. Regarding a configuration example of an information processing device that performs virtual content display control and virtual item ownership transfer control]

[0291] Next, a configuration example of an information processing device that performs virtual content display control and virtual item ownership transfer control is described.

[0292] In reference Figures 1 to 4 In the described processing example, an example has been described in which a head mounted display (HMD) type transmissive AR image display device worn by a user is used as an information processing apparatus that performs virtual content display control and virtual item ownership transfer control.

[0293] As mentioned above, except Figure 1 The information processing device of the present disclosure may be realized as various devices such as a PC, a smartphone, and a server in addition to the head mounted display (HMD) shown in other drawings.

[0294] Hereinafter, examples of various information processing devices, that is, specific examples of information processing devices that perform virtual content display control and virtual item ownership transfer control will be described.

[0295] Fig.11 is an example in which the PC 13 connected to a head mounted display (HMD) is an information processing device that performs virtual content display control and virtual item ownership transfer control.

[0296] The PC 13 controls display data of the display unit of the head mounted display (HMD). That is, it displays various virtual contents such as virtual items to be traded, virtual item trading boxes, user names of trading targets, authentication identification marks, etc. on the display unit of the head mounted display (HMD), and performs display control of such virtual contents.

[0297] In addition, the storage unit of the PC 13 stores the above-referenced Figure 6 , Figure 7 and Fig.10 The user list, the item list owned by the user, and the inter-user credit information list are described, and the data processing unit of the PC 13 refers to these lists to perform virtual content display control and virtual item ownership transfer control processing.

[0298] Fig.12 The smartphone (smartphone) 14 in which communication with a head mounted display (HMD) is performed is an example of an information processing device that performs virtual content display control and virtual item ownership transfer control.

[0299] The smartphone 14 controls display data of the display unit of the head mounted display (HMD). That is, various virtual contents such as virtual items to be traded, a virtual item trading box, a user name of a trading target, an authentication identification mark, etc. are displayed on the display unit of the head mounted display (HMD), and display control of such virtual contents is performed.

[0300] In addition, the storage unit of the smartphone 14 stores the Figure 6 , Figure 7 and Fig.10 A user list, a user-owned item list, and an inter-user credit information list are described, and the data processing unit of the smartphone 14 refers to these lists to perform virtual content display control and virtual item ownership transfer control processing.

[0301] Fig.13 It is a configuration in which a real image captured by a camera and virtual content are displayed on a display unit of a PC 13 or a smartphone 14 without using a head mounted display (HMD). The virtual content is superimposed and displayed on a real image captured by a camera provided in the PC 13 or the smartphone 14.

[0302] The data processing unit of PC 13 or smart phone 14 displays various virtual contents, such as virtual items to be traded, virtual item trading boxes, user names of trading targets, authentication identification marks, etc., on the display unit of PC 13 or smart phone 14, and performs display control of such virtual contents.

[0303] In addition, the storage unit of the PC 13 or the smartphone 14 stores the above-referenced Figure 6 , Figure 7 and Fig.10 A user list, an item list owned by a user, and an inter-user credit information list are described, and the data processing unit of the PC refers to these lists to perform virtual content display control and virtual item ownership transfer control processing.

[0304] Note that the PC 13 or the smartphone 14 communicates with a PC or smartphone of another remote user via the communication unit.

[0305] The PC 13 or smartphone 14 on the virtual item providing user 10 side performs communication with the device on the virtual item receiving user 20 side at a certain distance from the virtual item providing user 10, and each device performs virtual content display control and virtual item ownership transfer control processing for the display unit of each device.

[0306] Note that Fig.13 In the illustrated example, for example, a real image captured by a camera provided in the PC 13b as an information processing device of the remote virtual item receiving user 20 can be displayed on the PC 13 or the smart phone 14 as an information processing device of the virtual item providing user 10. The PC 13 or the smart phone 14 can display the virtual item or the virtual transaction box on the real image to control the transaction of the virtual item.

[0307] That is, even if there is a virtual item receiving user 20 that is far away from the virtual item providing user 10, it is possible to perform the above-mentioned Figures 1 to 4 The process described is to perform a virtual item ownership transfer process.

[0308] Fig.14 The example shown is an example using a head mounted display (HMD), but it is Fig.14 The head mounted display (HMD) shown uses a non-transmissive HMD 15 instead of the above referenced Figure 1 and other figures describe examples of transmissive HMDs.

[0309] On the display unit of the non-transmissive HMD 15, real objects captured by the camera 12 set in the non-transmissive HMD 15, as well as various virtual contents such as virtual items to be traded, virtual item trading boxes, user names of trading targets, authentication identification marks, etc. are displayed.

[0310] Furthermore, the data processing unit of the non-transmissive HMD 15 performs virtual content display control and virtual item ownership transfer control.

[0311] Even with this configuration, the non-transmissive HMD 15 can communicate with the non-transmissive HMD 15b of another remote user via the communication unit.

[0312] Furthermore, the display unit of the non-transmissive HMD 15 may display a real object captured by the camera 12 provided in the non-transmissive HMD 15 b worn by the virtual item receiving user 20 who is away from the virtual item providing user 10 .

[0313] The non-transmissive HMD 15 on the virtual item providing user 10 side performs communication with the non-transmissive HMD 15b on the virtual item receiving user 20 side at a certain distance from the virtual item providing user 10, and each device performs virtual content display control and virtual item ownership transfer control processing for the display unit of each device.

[0314] Similarly, using Fig.14 The configuration shown is similar to the above Fig.13 The configuration shown in the figure can be used to receive virtual items even if the virtual item receiving user 20 is far away from the virtual item providing user 10 by a method similar to that described above. Figures 1 to 4 The above process is used to perform the virtual item ownership transfer process.

[0315] Fig.15 The example shown is using Fig.14 An example of a non-transmissive HMD 15 similar to the non-transmissive HMD 15 of FIG. Fig.15 The non-transmissive HMD 15 shown is connected to a PC 13 or a smartphone (smartphone) 14 .

[0316] use Fig.15 In the illustrated configuration, the PC 13 or the smartphone 14 connected to the non-transmissive HMD 15 performs virtual content display control and virtual item ownership transfer control.

[0317] The PC 13 or the smartphone 14 controls display data of the display unit of the non-transmissive HMD 15. That is, various virtual contents such as virtual items to be traded, a virtual item trading box, a user name of a trading target, an authentication identification mark, etc. are displayed on the display unit of the non-transmissive HMD 15, and display control of such virtual contents is performed.

[0318] On the display unit of the non-transmissive HMD 15, real objects captured by the camera 12 set in the non-transmissive HMD 15 and various virtual contents such as virtual items to be traded, virtual item trading boxes, user names of trading targets, authentication identification marks, etc. are displayed.

[0319] In addition, the storage unit of the PC 13 or the smartphone 14 stores the above-referenced Figure 6 , Figure 7 and Fig.10 A user list, an item list owned by a user, and an inter-user credit information list are described, and the data processing unit of the PC 13 or the smartphone 14 refers to these lists to perform virtual content display control and virtual item ownership transfer control processing.

[0320] Also, with this configuration, the PC 13 or the smartphone 14 can communicate with an information processing device of another remote user (for example, an information processing device such as an HMD, a PC, or a smartphone) via the communication unit.

[0321] The information processing device (e.g., PC 13 or smart phone 14) of the virtual item providing user 10 communicates with the information processing device of the virtual item receiving user 20 at a certain distance from the virtual item providing user 10, and each user's information processing device performs virtual content display control and virtual item ownership transfer control processing.

[0322] Similarly, using Fig.15 The configuration shown is similar to the above Fig.13 and Fig.14 The configuration shown in the figure can be used to receive virtual items even if the virtual item receiving user 20 is far away from the virtual item providing user 10 by a method similar to the above reference. Figures 1 to 4 The above process is used to perform the virtual item ownership transfer process.

[0323] Fig.16 The illustrated example is a configuration example having the management server 50 connected to a plurality of user terminals (for example, user terminals such as HMDs, PCs, or smartphones).

[0324] With this configuration, the management server 50 controls the display data of the display unit of the user terminal (HMD, PC, smart phone, etc.) connected to the network. That is, various virtual contents such as virtual items to be traded, virtual item trading boxes, user names of trading targets, authentication identification marks, etc. are displayed on the display unit of each user terminal, and display control of such virtual contents is performed.

[0325] With this configuration, the storage unit of the management server 50 stores the Figure 6 , Figure 7 and Fig.10 A user list, a user-owned item list, and an inter-user credit information list are described, and the data processing unit of the management server 50 refers to these lists to perform virtual content display control and virtual item ownership transfer control processing with respect to each user terminal.

[0326] With this configuration, a user terminal (e.g., HMD, PC, or smartphone) can communicate with the management server 50 or a user terminal of another user via the communication unit. Communication with the information processing device on the side of the virtual item receiving user 20 can be performed directly or via the management server 50 at a distance from the virtual item providing user 10.

[0327] With this configuration, the management server 50 performs virtual content display control and virtual item ownership transfer control processing of the user terminal.

[0328] Fig.17 is a diagram showing an example of a network configuration having a configuration in which: Fig.16 The management server 50 shown controls display contents of user terminals connected to the network.

[0329] like Fig.17 As shown, the management server 50 is connected to various user terminals 71 to 75 such as an HMD, a smartphone, or a PC, and performs communication with each user terminal.

[0330] The management server 50 performs virtual content display control and virtual item ownership transfer control processing with respect to the display unit of each of the user terminals 71 to 75 .

[0331] [4. Regarding configuration example of information processing device]

[0332] Next, a configuration example of the information processing device of the present disclosure will be described.

[0333] As mentioned above, except Figure 1 In addition to the transmissive HMD shown, the information processing device of the present disclosure also includes, for example, a PC, a smartphone, a non-transmissive HMD, a server, and the like.

[0334] These information processing apparatuses perform control of display of virtual contents on a display unit observed by a user, control of ownership transfer processing of a virtual item which is one of the virtual contents, and the like.

[0335] Fig.18 One configuration example of the information processing device 100 of the present disclosure is shown.

[0336] Fig.18 The illustrated information processing device 100 is, for example, any of a transmissive HMD, a PC, a smartphone, a non-transmissive HMD, and a server.

[0337] like Fig.18 As shown, the information processing device 100 includes a storage unit 110, a communication unit 115, a user information acquisition unit 121, a user-owned item information acquisition unit 122, a user credit information acquisition unit 123, a user identification & user motion detection unit 124, a virtual content display control unit 131, a virtual item transaction box display control unit 132, a virtual item transaction control unit 133, a user-owned item information update unit 134, a sensor 151 and a display unit 152.

[0338] Note that the storage unit 110 stores a user list 111, a user-owned item list 112, and an inter-user credit information list 113. These lists are Figure 6 , Figure 7 and Fig.10 A list of descriptions.

[0339] Notice, Fig.18 Each constituent unit of the information processing apparatus 100 shown may be configured to be arranged in a plurality of information processing apparatuses in a distributed manner. In this case, communication is performed between the components arranged in a distributed manner to perform processing.

[0340] For example, the sensor 151 or the display unit 152 may be configured on a user terminal such as an HMD, and the other components may be configured to be arranged on a PC, a smart phone, or a management server.

[0341] Will describe Fig.18 Each component of the information processing device 100 is shown.

[0342] The user information acquisition unit 121 acquires the user list 111 of the storage unit 110 , and outputs it to the user recognition & user motion detection unit 124 and the virtual content display control unit 131 .

[0343] The user recognition & user motion detection unit 124 inputs sensor detection information (eg, camera capture information) of the sensor (camera, gyroscope, etc.) 151 , and further, performs user recognition processing through comparison processing with facial images registered in the user list 111 .

[0344] Specifically, a user identification process of a virtual item receiving user who is a transaction target of the virtual item is performed.

[0345] The user identification & user movement detection unit 124 performs a user identification process with reference to the user list 111 stored in the storage unit 110 .

[0346] As above Figure 6 As mentioned above, the data described below are registered in the user list 111 in association with each other.

[0347] (a) User ID

[0348] (b) Username

[0349] (c) User’s facial image

[0350] The user who uses the system of the present disclosure performs user registration in advance. Specifically, a process of registering a user name and a face image is performed.

[0351] In the case where a new user is detected in the display unit, the user identification & user movement detection unit 124 first performs a process of identifying the user.

[0352] As described above, the ID and the position of the virtual item receiving user 20 can be identified by the ID and the position set in the transmissive HMD 11 b worn by the virtual item receiving user 20 .

[0353] Alternatively, for example, a configuration is possible in which a camera-captured image captured by a camera is compared with facial images registered in the user list 111 and a registered facial image having a high degree of matching with the captured image is extracted.

[0354] The virtual content display control unit 131 acquires the user name recorded in the entry of the registered face image extracted by the user recognition & user motion detection unit 124 , and displays the acquired user name as virtual content on the AR image.

[0355] In addition, the user recognition & user motion detection unit 124 detects the user's motion, such as the user's position, the user's hand motion, position, etc., based on input information from the sensor (camera, gyroscope, etc.) 151.

[0356] Note that in a configuration for communicating with an external user terminal or an information processing device, the user identification & user motion detection unit 124 inputs detection information (e.g., camera capture information) of a sensor (camera, gyroscope, etc.) provided in the external user terminal or the information processing device via the communication unit 115, and performs identification processing or position and motion detection of the remote user.

[0357] The user identification information and the user motion information (user position, hand position, motion information, etc.) generated by the processing of the user identification & user motion detection unit 124 are input to the virtual content display control unit 131 .

[0358] The user-owned item information acquisition unit 122 reads the user-owned item list 112 stored in the storage unit 110 , and inputs it to the virtual content display control unit 131 .

[0359] The user credit information acquisition unit 123 reads the inter-user credit information list 113 stored in the storage unit 110 , and inputs it to the virtual content display control unit 131 .

[0360] The virtual content display control unit 131 inputs the following information.

[0361] (1) User identification information and user motion information (user position, hand position, motion information, etc.) from the user identification & user motion detection unit 124

[0362] (2) User-owned item list 112 from user-owned item information acquisition unit 122

[0363] (3) User credit information list 113 from user credit information acquisition unit 123

[0364] The virtual content display control unit 131 performs virtual content display control with respect to the display unit 152 based on each of these multiple pieces of information.

[0365] Specifically, for example, the above reference is performed Figures 1 to 4 Display control of virtual content (such as user names, authentication identification marks, and virtual items) described.

[0366] The virtual content display control unit 131 displays and moves virtual items as virtual content to be traded according to the hand motion of the virtual item providing user input from the user recognition & user motion detection unit 124 .

[0367] Furthermore, the virtual content display control unit 131 performs processing for displaying the user name registered in the user list 111 as virtual content near the detected user based on the user identification information of the virtual item receiving user or another detected user input from the user identification & user motion detection unit 124.

[0368] For example, the above reference Figures 1 to 4 Descriptive user name, such as [Alice].

[0369] Furthermore, the virtual content display control unit 131 performs an authentication process (credibility confirmation process) with respect to a transaction target (virtual item receiving user) for which user identification has succeeded.

[0370] An authentication identification mark (badge, etc.) is displayed near the transaction target (virtual item receiving user) only when the authentication process (credit confirmation process) regarding the transaction target (virtual item receiving user) is successful and it is determined that the transaction target (virtual item receiving user) is a trustworthy user.

[0371] Note that the authentication identification mark display control is performed with reference to the inter-user credit information list 112 stored in the storage unit 110. Figure 7 As described above, the inter-user credit information list 112 includes the following two lists.

[0372] (1) Credit User List

[0373] (2) Rejected User List

[0374] The user ID of the transaction target (the user receiving the virtual item) is in Figure 7In the case of a "credit user" registered as a virtual item providing user in the credit user list shown in (2a), the transaction target (virtual item receiving user) is determined to be a "credit user". In this case, an authentication identification mark (badge, etc.) is displayed near the transaction target (virtual item receiving user).

[0375] In the case where there is a user determined to be a “credited user”, the virtual content display control unit 131 outputs “credited user” detection information to the virtual item transaction box display control unit 132 .

[0376] The virtual item trading box display control unit 132 is related to the above reference Figures 1 to 4 The display unit 152 of the depicted virtual item trading box 32 performs display control.

[0377] When the virtual item providing user approaches the authenticated transaction target (virtual item receiving user) while holding the virtual item to be traded (or a marker associated with the virtual item) in his / her hand, the virtual item transaction box display control unit 132 displays the virtual item transaction box near the transaction target (virtual item receiving user).

[0378] As described above, the display conditions of the virtual item trading box are, for example, the following conditions.

[0379] (a) The distance between the “credit user” for which the “authentication identification mark” is displayed and the virtual item providing user is equal to or smaller than a predetermined threshold distance.

[0380] The virtual item trading box display control unit 132 performs processing to display the virtual item trading box, for example, when determining that the above-described condition (a) is satisfied.

[0381] Note that, as described above, the display condition of the virtual item trading box is not limited to the above-described condition (a), but may be, for example, the following condition (b).

[0382] (b) The “credited user” for which the “authentication identification mark” is displayed is displayed in a specified area of ​​the transmissive AR image display device worn by the virtual item providing user.

[0383] For example, a virtual item trading box may also be set to be displayed when the above condition (b) is satisfied.

[0384] The virtual item transaction control unit 133 controls the transaction of virtual items. Specifically, it controls the process of transferring the ownership of virtual items from the virtual item providing user to the virtual item receiving user.

[0385] Upon detecting the fact that the process of handing over the virtual item to the transaction target (virtual item receiving user) has been performed in a state where both the virtual item providing user and the virtual item receiving user place their hands in the virtual item transaction box, the virtual item transaction control unit 133 determines that the ownership of the virtual item has been transferred.

[0386] Specifically, for example, as mentioned above with reference to Fig. 9 As described, when it is confirmed that both the virtual item providing user and the virtual item receiving user place their hands in the virtual item trading box, the virtual item providing user opens his hand from a state of holding the virtual item, and the virtual item receiving user changes from a state of opening his hand to a state of holding the virtual item, it is determined that the ownership of the virtual item has been transferred.

[0387] In the case where the virtual item transaction control unit 133 determines that the ownership of the virtual item has been transferred, the virtual item transaction control unit 133 outputs the determination information to the user-owned item information updating unit 134 .

[0388] The user-owned item information updating unit 134 performs a process of updating the registration data of the user-owned item list 112 of the storage unit 110 based on the virtual item ownership transfer information input from the virtual item transaction control unit 133 .

[0389] This process is, for example, as described above. Fig.10 Describes the process of updating the list of items owned by a user.

[0390] Through such processing, the process of virtual item transaction between users, that is, the ownership transfer process can be performed safely and reliably.

[0391] [5. Regarding the processing sequence executed by the information processing device of the present disclosure]

[0392] Next, we will refer to Fig.19 The processing sequence executed by the information processing apparatus of the present disclosure is described with reference to the flowcharts shown in the following figures.

[0393] Note that the data processing unit of the information processing device executes the Fig.19 The data processing unit includes a CPU having a program execution function, and can execute the processing according to the flow chart according to the program stored in the storage unit.

[0394] Will describe Fig.19 And the processing of each step of the process shown in the subsequent figures.

[0395] (Step S101)

[0396] First, the data processing unit of the information processing device determines whether the user has a virtual item in step S101.

[0397] Note that the user who intends to provide a virtual item to another user (virtual item providing user) obtains the virtual item owned by the user in advance and performs an operation of holding the virtual item in the hand. Through this operation, the virtual item is displayed in a state held in the hand of the user virtual item providing user.

[0398] (Step S102 to Step S103)

[0399] Next, in steps S102 to S103 , the data processing unit of the information processing device sets the user having the virtual item as a “virtual item providing user” and detects whether a new other user is detected in the observation image of the “virtual item providing user”.

[0400] In a case where a new other user is detected in the observation image of the “virtual item providing user”, the process proceeds to step S104 .

[0401] (Step S104)

[0402] Next, in step S104, the data processing unit of the information processing device determines whether the detected user has been authenticated. Specifically, it determines whether the detected user is a user registered in the credit user list of "virtual item providing user".

[0403] The credit user list is the reference above Figure 7 A list of descriptions of (2-1).

[0404] In a case where the detected user is registered in the credit user list of “virtual item providing user”, it is determined that the detected user has been authenticated, and the process proceeds to step S105 .

[0405] (Step S105)

[0406] Next, in step S105 , the data processing unit of the information processing device determines whether the detected user is a user registered in the rejected user list of “virtual item providing user”.

[0407] The list of rejected users is the one referenced above Figure 7 A list of descriptions of (2-2).

[0408] In a case where the detected user is registered in the rejected user list of “virtual item providing user”, the processing of step S106 and subsequent steps is not performed, and the processing returns to step S102 .

[0409] In this case, the virtual item transaction process with the detected user is not performed.

[0410] In a case where the detected user is not registered in the rejected user list of “virtual item providing user”, the process proceeds to step S106 .

[0411] (Step S106)

[0412] Next, in step S106 , the data processing unit of the information processing device displays the authentication identification mark near the detected user.

[0413] For example, the certification identification mark is Figures 1 to 4 The certification identification mark described in .

[0414] (Step S107 to Step S108)

[0415] Next, the data processing unit of the information processing device determines whether the display condition of the "virtual item trading box" is satisfied in step S107, and displays the virtual item trading box near the detected user in step S108 if it is determined that the display condition is satisfied.

[0416] Note that various conditions can be set as the display conditions of the “virtual item trading box” as described above.

[0417] (a) the distance between the “credit user” for which the “authentication identification mark” is displayed and the virtual item providing user is equal to or less than a predetermined threshold distance, and

[0418] (b) The “credited user” for which the “authentication identification mark” is displayed is displayed in a specified area of ​​the transmissive AR image display device worn by the virtual item providing user.

[0419] For example, in step S108, when any one of the above conditions (a) and (b) is met, a virtual item trading box is displayed near the detected user.

[0420] Will refer to Fig. 20 The flow shown describes the order in which each of the above conditions (a) and (b) is determined.

[0421] Fig. 20 A flow illustrating two processes described below is shown.

[0422] (1) Virtual commodity trading box display control example 1

[0423] (2) Virtual Commodity Trading Box Display Control Example 2

[0424] (1) Virtual Commodity Trading Box Display Control Example 1 corresponds to the determination sequence of the above-mentioned condition (a).

[0425] (2) Virtual Commodity Trading Box Display Control Example 2 corresponds to the determination sequence of the above-mentioned condition (b).

[0426] Both correspond to Fig.19 The process shown is the process of step S106 to step S108.

[0427] First, we will describe Fig. 20 (1) The process of virtual item trading box display control example 1.

[0428] (Step S106)

[0429] In step S106 , the data processing unit of the information processing device displays the authentication identification mark near the detected user.

[0430] For example, the certification identification mark is Figures 1 to 4 The certification identification mark described in .

[0431] (Step S107a1)

[0432] Next, in step S107a1, the data processing unit of the information processing device measures the distance between the “virtual item providing user” and the detected user.

[0433] (Step S107a2)

[0434] Next, in step S107a2, the data processing unit of the information processing device determines whether the distance between the “virtual item providing user” and the detected user is equal to or smaller than a predetermined threshold.

[0435] In the case where it is determined that the distance is equal to or smaller than the specified threshold, the process proceeds to step S108.

[0436] (Step S108)

[0437] When it is determined in step S107a2 that the distance between the "virtual item providing user" and the detected user is equal to or less than a predetermined threshold, in step S108, the data processing unit of the information processing device displays a virtual item trading box near the detected user and at a position between the virtual item providing user and the detected user.

[0438] Next, we will describe Fig. 20 (2) Sequence of virtual item trading box display control example 2.

[0439] (Step S106)

[0440] In step S106 , the data processing unit of the information processing device displays the authentication identification mark near the detected user.

[0441] For example, the certification identification mark is Figures 1 to 4 The certification identification mark described in .

[0442] (Step S107b1 to Step S107b2)

[0443] Next, in step S107b1, the data processing unit of the information processing device detects the display position of the detected user.

[0444] In the event that it is determined in step S107b2 that the detected display position of the user is within the predetermined display area, the process proceeds to step S108.

[0445] The display position is a display position on the display unit observed by the “virtual item providing user”.

[0446] Will refer to Fig.21 A specific example is described.

[0447] Fig.21 Two examples of display images of the non-transmissive HMD 15 worn by the user 10 are shown provided with virtual items.

[0448] In each of the display images, the virtual item receiving user 20 as the detected user is displayed.

[0449] (1) Display Image Example 1 is a state in which the virtual item receiving user 20 as a detected user is displayed in the predetermined designated area 301 .

[0450] In this case, the data processing unit of the information processing device determines in step S107b2 that the detected display position of the user is within the predetermined display area, proceeds to step S108, and displays the virtual item transaction box at a position near the detected user.

[0451] On the other hand, (2) Display Image Example 2 is a state in which the virtual item receiving user 20 as the detected user is displayed outside the predetermined designated area 301 .

[0452] In this case, the data processing unit of the information processing device determines in step S107b2 that the detected display position of the user is not within the predetermined display area, and does not proceed to step S108 but returns to step S107b1. In this case, the virtual item transaction box is not displayed.

[0453] (Step S108)

[0454] In a case where it is confirmed in step S107b2 that the detected user is displayed within the predetermined designated area, in step S108, the data processing unit of the information processing device displays a virtual item transaction box at a position near the detected user.

[0455] Note that various conditions other than the above conditions may be set as display conditions of the virtual item trading box.

[0456] Next, we will refer to Fig. 22 The flowchart shown describes the processing after the virtual item trading box is displayed.

[0457] (Step S121 to Step S122)

[0458] After the virtual item transaction box is displayed in step S108, in step S121, the information processing device detects whether the hand of the "virtual item providing user" and the hand of the detected user (virtual item receiving user) are already in the virtual item transaction box. This is detected based on an image captured by a camera, for example.

[0459] In a case where it is determined in step S122 that the hand of the “virtual item providing user” and the hand of the detected user (virtual item receiving user) are already within the virtual item transaction box, the process proceeds to step S123.

[0460] (Step S123)

[0461] When it is determined in step S122 that the hand of the "virtual item providing user" and the hand of the detected user (virtual item receiving user) are already in the virtual item trading box, the information processing device determines in step S123 whether the hand of the "virtual item providing user" is open.

[0462] This is determined, for example, based on images captured by a camera.

[0463] In the case where it is determined that the hand of the “virtual item providing user” has been opened, the process proceeds to step S124 .

[0464] Note that the waiting time until this determination processing is predetermined, for example, 10 seconds from the time when the hand of the "virtual item providing user" and the hand of the detected user (virtual item receiving user) are determined to be already in the virtual item trading box.

[0465] If it is not determined that the hand of the "virtual item providing user" has been opened within the specified waiting time, the processing is completed. In this case, the virtual item ownership transfer processing is not performed.

[0466] In a case where it is determined that the hand of the “virtual item providing user” has been opened within the specified time, the process proceeds to step S124 .

[0467] (Step S124)

[0468] Next, in step S124, the information processing apparatus moves the display position of the virtual item from the position of the hand of the "virtual item providing user" to the position of the hand of the detected user (virtual item receiving user), and displays the virtual item.

[0469] (Step S125)

[0470] Next, in step S125, the information processing apparatus determines whether the detected user (virtual item receiving user) has held the virtual item in hand and performed a gripping operation. This determination process is performed based on an image captured by a camera, for example.

[0471] In a case where it is determined in step S125 that the detected user (virtual item receiving user) has held the virtual item in hand and performed a gripping operation, the process proceeds to step S126 .

[0472] On the other hand, in a case where it is determined in step S125 that the detected user (virtual item receiving user) does not hold the virtual item in hand or perform a gripping operation, the process ends.

[0473] Note that the waiting time until this determination process is also predetermined. For example, the waiting time is predetermined, such as 10 seconds after the display position of the virtual item moves to the position of the hand of the user (virtual item receiving user) detected.

[0474] If it is not determined that the "virtual item receiving user" has clasped his hands within the specified waiting time, the process ends. In this case, the virtual item ownership transfer process is not performed.

[0475] In the case where it is determined that the “virtual item receiving user” has clenched his hand within the specified time, the process proceeds to step S126.

[0476] (Step S126)

[0477] Next, in step S126, the information processing device transfers the ownership of the virtual item from the "virtual item providing user" to the detected user, and registers it in the list of items owned by the user.

[0478] That is, execute the above reference Fig.10 Describes the process of updating the list of items owned by a user.

[0479] Through such processing, the process of virtual item transaction between users, that is, the ownership transfer process can be performed safely and reliably.

[0480] [6. Specific example of handling the transfer of ownership of virtual items]

[0481] Next, a specific processing example of the virtual item ownership transfer processing performed by the information supplement processing device of the present disclosure will be described.

[0482] Fig.23 1 is a diagram showing an example of a specific process of a virtual item ownership transfer process executed by the information supplement processing device of the present disclosure.

[0483] A display image of the HMD worn by the user U1 is shown.

[0484] Fig.23 The displayed image example shown is an example of an AR image display in a game content. This is a game in which a plurality of users are divided into a friendly team and an enemy team that fight each other. Each user possesses a weapon such as a pistol and a rifle as virtual content, and fights with the opponent team.

[0485] Team members of the user U1 are users a to c, and users d and e are team members of the enemy team.

[0486] Authentication identification marks are displayed for users a to c.

[0487] The virtual item to be traded here is a pistol. The pistol as the virtual item 31 to be traded is displayed in the virtual item trading box 32 in a state of being held in the hand of the user U1.

[0488] In this state, for example, when one of the users a to c for which the authentication identification mark is displayed places a hand in the virtual item transaction box 32, the operation according to the above reference is performed. Figure 19 to Figure 22 The described sequence of processing is performed, and the transaction processing of the virtual item (pistol), that is, the ownership transfer processing, is executed.

[0489] In the case where such processing is performed, each virtual item transaction box corresponding to each of the users a to c may be configured to be displayed, and each transaction process may be performed in each transaction box.

[0490] Note that when any one of users d to e for which the authentication identification mark is not displayed places a hand in the virtual item transaction box 32, the transaction processing of the virtual item (pistol), that is, the ownership transfer processing is not performed.

[0491] In this case, in the above Fig.19In the determination process of step S103 of the flow shown, that is, in the determination process as to whether the detected user has been authenticated, specifically, in the determination process as to whether the detected user is registered in the credit user list of user U1, it is determined to be "No". As a result, the transaction process of the virtual item (pistol), that is, the ownership transfer process, is not performed.

[0492] Fig.24 1 is a diagram showing another example of a specific process of a virtual item ownership transfer process executed by the information supplement processing device of the present disclosure.

[0493] A display image of the HMD worn by the user U1 is shown.

[0494] Fig.24 The displayed image example shown is an example of an AR image display in a product transaction process in a virtual store, for example. This is an example in which the user U1 sells virtual content at the virtual store.

[0495] The user U1 stands in front of a store clerk in a virtual store, holds a virtual item "Star" in his hand, and places his hand in a virtual item transaction box 32 displayed in front of the store clerk.

[0496] The virtual item to be traded here is a “star.” The star, which is the virtual item 31 to be traded, is displayed in the virtual item trading box 32 in a state of being held in the hand of the user U1.

[0497] In this state, for example, when the clerk for whom the authentication identification mark is displayed places his hand in the virtual item transaction box 32, the operation according to the above reference is performed. Figures 19 to 22 The described sequence of processing is performed, and the transaction processing of the virtual item (star), that is, the ownership transfer processing, is executed.

[0498] For example, when a price of $80 per star is set in advance, a process is possible in which, through the transaction process, the ownership of the virtual item (star) is transferred to the store side and the user U1 obtains the ownership of $80 instead.

[0499] Note that in the case of an entity such as a clerk of a virtual store, the system management party can set it as an officially certified entity in advance. The official entity certified by the management party in this way can be set to be automatically given credit.

[0500] Normally, transactions cannot be conducted with a person who is not on the credit list, but the clerk appearing here is a character officially certified by the management, so that the certification identification mark is displayed even when it is not pre-listed on the credit list.

[0501] Note that in the above example, an example is described in which the virtual item providing user and the virtual item receiving user are both real people, but the virtual item providing user and the virtual item receiving user may be, for example, animals or robots other than people or virtual contents.

[0502] Specifically, a configuration is possible in which virtual contents such as meals or toys given to a real dog and a dog as virtual contents and weapons given to a robot are provided.

[0503] For example, when a horse as virtual content is set as a virtual item receiving user and the user holds a carrot as a virtual item in his hand and brings it close to the horse's mouth, a virtual item trading box is displayed at the horse's mouth.

[0504] Here, image display control in which a carrot is taken into a horse's body and disappears when the user puts his hand in the virtual item trading box and opens his hand is also possible.

[0505] Furthermore, a real vending machine is provided to receive virtual items from a user, and when a user holds coins as virtual items and approaches the vending machine, a virtual item transaction box is displayed.

[0506] Here, image display control is also possible in which, when the user puts his hand in the virtual item transaction box and opens his hand, coins are brought into the vending machine and disappear, and products come out.

[0507] Note that the above-mentioned horses and vending machines can also be pre-set as officially certified entities by the system management party. When the management party sets the horse or vending machine to be fed with an ID (and name), the name is displayed and the certification identification mark is displayed even when it is not on the credit list.

[0508] Furthermore, the above example is described as an example of a one-to-one transaction process in which both the virtual item providing user and the virtual item receiving user are one user, but the virtual item receiving user may be a plurality of users, for example.

[0509] For example, it is a configuration in which user A owns two virtual items (specifically, for example, two “stars”) respectively provided to two users B and C.

[0510] However, in the case of performing such processing, preferably, each virtual item transaction box corresponding to each user is configured to be displayed, and each transaction process is performed in each transaction box.

[0511] In addition, as a configuration in which a virtual transaction box is displayed in a recycling bin, a configuration in which an ownership relinquishment process is performed as follows: in the ownership relinquishment process, the virtual item provides that the user holds the virtual item, places his hand in the virtual transaction box in the recycling bin and opens his hand so that the virtual item is thrown into the recycling bin.

[0512] [7. Regarding hardware configuration example of information processing device]

[0513] Next, we will refer to Fig.25 A hardware configuration example of an information processing apparatus that performs processing according to the above-described example will be described.

[0514] Fig.25 The illustrated hardware is an example of the hardware configuration of the information processing device of the present disclosure (for example, an information processing device such as an HMD, a PC, a smartphone, or a server).

[0515] Will describe Fig.25 The hardware configuration shown.

[0516] A central processing unit (CPU) 501 functions as a data processing unit that performs various processes according to a program stored in a read-only memory (ROM) 502 or a storage unit 508. For example, a process according to the sequence described in the above example is performed. A random access memory (RAM) 503 stores programs and data executed by the CPU 501. The CPU 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504.

[0517] The CPU 501 is connected to an input / output interface 505 via a bus 504, and the input / output interface 505 is connected to an input unit 506 including various sensors, cameras, switches, keyboards, mice, microphones, etc., and to an output unit 507 including a display, speakers, etc.

[0518] The storage unit 508 connected to the input / output interface 505 includes, for example, a hard disk, etc., and stores programs and various data executed by the CPU 501. The communication unit 509 functions as a transmission / reception unit for data communication via a network such as the Internet or a local area network, and communicates with external devices.

[0519] The drive 510 connected to the input / output interface 505 drives a removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card, and performs recording or reading of data.

[0520] [8. Summary of Configuration of the Present Disclosure]

[0521] As described above, examples of the present disclosure have been described in detail with reference to specific examples. However, it is apparent that those skilled in the art may modify or replace the examples without departing from the gist of the present disclosure. That is, the present invention has been disclosed in the form of examples, and the present invention should not be interpreted in a limiting manner. In order to determine the gist of the present disclosure, the columns of the claims should be considered.

[0522] Note that the technology disclosed in this specification can have the following configurations.

[0523] (1) An information processing device comprising:

[0524] A data processing unit that performs display control of an AR (augmented reality) image in which a real object and virtual content are superimposed and displayed, wherein:

[0525] The data processing unit:

[0526] performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents for which ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and

[0527] When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

[0528] (2) The information processing device according to (1), wherein:

[0529] When the delivery process of the virtual item is performed with both the virtual item providing user who owns the ownership of the virtual item and the virtual item receiving user who wants to obtain the ownership of the virtual item in the hands of the virtual item trading box, the data processing unit performs the process of transferring the ownership of the virtual item.

[0530] (3) The information processing device according to (1) or (2), wherein:

[0531] The data processing unit performs a process of transferring the ownership of the virtual item in a case where the virtual item receiving user who is to acquire the ownership of the virtual item is the user for whom the authentication identification mark indicating that the virtual item receiving user is the user given credit by the virtual item providing user is displayed.

[0532] (4) The information processing device according to any one of (1) to (3), wherein:

[0533] The data processing unit performs the following virtual item display position control: in the virtual item display position control, when both the hands of a virtual item providing user who holds the virtual item in his hands and the virtual item receiving user who wants to obtain the ownership of the virtual item are in the virtual item transaction box, if the virtual item providing user opens his hand, the display position of the virtual item is moved to the hand side of the virtual item receiving user.

[0534] (5) The information processing device according to (4), wherein:

[0535] The data processing unit performs the following virtual item display position control: in the virtual item display position control, when the hand of the virtual item receiving user is closed while holding the virtual item after the display position of the virtual item is moved to the hand side of the virtual item receiving user, the virtual item display position is displayed following the hand of the virtual item receiving user.

[0536] (6) The information processing device according to any one of (1) to (5), wherein:

[0537] When a predetermined condition is met, the data processing unit displays the virtual item trading box.

[0538] (7) The information processing device according to any one of (1) to (6), wherein:

[0539] The data processing unit displays the virtual item transaction box when the distance between the virtual item providing user who owns the ownership of the virtual item and the virtual item receiving user who wants to acquire the ownership of the virtual item is equal to or less than a specified distance.

[0540] (8) The information processing device according to any one of (1) to (7), wherein:

[0541] When a virtual item receiving user who wants to acquire ownership of the virtual item is displayed in a designated area of ​​the display screen of the AR image, the data processing unit displays the virtual item transaction box.

[0542] (9) The information processing device according to any one of (1) to (8), wherein:

[0543] When a predetermined condition is met, the data processing unit hides the virtual item trading box.

[0544] (10) The information processing device according to any one of (1) to (9), wherein:

[0545] The data processing unit hides the virtual item transaction box when the distance between the virtual item providing user who owns the virtual item and the virtual item receiving user who wants to acquire the ownership of the virtual item is equal to or greater than a specified distance.

[0546] (11) The information processing device according to any one of (1) to (10), wherein:

[0547] The data processing unit performs user identification processing of a virtual item receiving user who is to acquire ownership of the virtual item, and displays a user name acquired based on the identification result near the virtual item receiving user.

[0548] (12) The information processing device according to any one of (1) to (11), wherein:

[0549] The data processing unit performs credit determination processing as to whether the virtual item receiving user who is to obtain ownership of the virtual item is a user given credit by the virtual item providing user, and if it is determined that the virtual item receiving user is a credit user, an authentication identification mark is displayed near the virtual item receiving user.

[0550] (13) The information processing device according to (12), wherein:

[0551] The data processing unit performs the credit determination process with reference to the inter-user credit information list stored in the storage unit.

[0552] (14) The information processing device according to any one of (1) to (13), wherein:

[0553] When the delivery processing of the virtual item is performed in the virtual item trading box, the data processing unit performs processing to update the registration data of the user-owned item list, the user-owned item list is a list stored in the storage unit, and the virtual items owned by each user are registered in the user-owned item list.

[0554] (15) An information processing system comprising:

[0555] A user terminal having a display unit that displays an AR (Augmented Reality) image in which a real object and virtual content are superimposed and displayed; and

[0556] a server that performs communication with the user terminal and performs display control of the AR image displayed on the display unit of the user terminal, wherein

[0557] As a display control process for the virtual content of the display unit of the user terminal, the server:

[0558] performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents whose ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and

[0559] When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

[0560] (16) The information processing system according to (15), wherein:

[0561] In the AR image displayed on the display unit of the user terminal, when the delivery process of the virtual item is performed in a state where both the hands of the virtual item providing user who owns the ownership of the virtual item and the virtual item receiving user who wants to obtain the ownership of the virtual item are in the virtual item trading box, the server performs the process of transferring the ownership of the virtual item.

[0562] (17) The information processing system according to (15) or (16), wherein:

[0563] The server performs the following virtual item display position control: in the virtual item display position control, in the AR image displayed on the display unit of the user terminal, when both the hands of the virtual item providing user who holds the virtual item in his hands and the virtual item receiving user who wants to obtain the ownership of the virtual item are in the virtual item trading box, if the virtual item providing user opens his hand, the display position of the virtual item is moved to the side of the hand of the virtual item receiving user, and if the hand of the virtual item receiving user closes while holding the virtual item, the virtual item display position is displayed following the hand of the virtual item receiving user.

[0564] (18) An information processing method executed in an information processing device,

[0565] The information processing device includes a data processing unit that performs display control of an AR (Augmented Reality) image in which a real object and virtual content are superimposed and displayed,

[0566] The information processing method comprises:

[0567] performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents for which ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and

[0568] When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

[0569] (19) An information processing method executed in an information processing system, the information processing system comprising:

[0570] A user terminal having a display unit that displays an AR (Augmented Reality) image in which a real object and virtual content are superimposed and displayed; and

[0571] a server that performs communication with the user terminal and performs display control of the AR image displayed on the display unit of the user terminal;

[0572] The information processing method comprises:

[0573] As a display control process for the virtual content on the display unit of the user terminal, the server:

[0574] performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents whose ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and

[0575] When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

[0576] (20) A program for causing an information processing device to execute information processing, the information processing device comprising:

[0577] a data processing unit that performs display control of an AR (Augmented Reality) image in which a real object and virtual content are superimposed and displayed,

[0578] The program enables the data processing unit to:

[0579] performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents for which ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and

[0580] When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

[0581] The series of processes described in the specification can be performed by hardware, software or a combination of the two. In the case of performing the process by software, a program recording the process sequence can be installed and executed in a memory in a computer with built-in dedicated hardware, or a program can be installed and executed on a general-purpose computer that can perform various processes. For example, the program can be recorded in advance on a recording medium. In addition to being installed on a computer from a recording medium, the program can also be received via a network such as a local area network (LAN) and the Internet, and the program can be installed on a recording medium such as a built-in hard disk.

[0582] Note that the various processes described in the specification are not only performed in chronological order according to the description, but can also be performed in parallel or individually according to the processing capabilities of the device performing the process or when necessary. In addition, in this specification, a system is a logical set configuration of multiple devices, and is not limited to those configurations in which the devices of each configuration are in the same housing.

[0583] Industrial Applicability

[0584] As described above, with the configuration of one example of the present disclosure, an apparatus and method for reliably performing a virtual item ownership transfer process are realized.

[0585] Specifically, for example, a data processing unit that performs display control of an AR image in which a real object and virtual content are superimposed and displayed is provided. The data processing unit performs display control of a virtual item whose ownership is registered and a virtual item trading box for transferring the ownership of the virtual item, and further, in the case where a delivery of the virtual item is performed in the virtual item trading box, the ownership of the virtual item is transferred. When the virtual item providing user opens his hand in a state where the user's hand is in the virtual item trading box, the virtual item is moved to the hand side of the virtual item receiving user, and ownership transfer registration processing, etc. are performed.

[0586] With this configuration, an apparatus and method for reliably performing virtual item ownership transfer processing are realized.

[0587] Reference numerals list

[0588] 10. Virtual Items Provided to Users

[0589] 11 Transmissive HMD

[0590] 12 Camera

[0591] 13 PC

[0592] 14 Smartphone

[0593] 15. Non-transmissive HMD

[0594] 20 Virtual Item Receiving User

[0595] 21 Real object images

[0596] 31 Virtual Items

[0597] 32 Virtual Item Trading Box

[0598] 35 Alternative Virtual Items

[0599] 100 Information processing device

[0600] 110 Storage Units

[0601] 111 User List

[0602] 112 List of items owned by the user

[0603] 113 User credit information list

[0604] 115 Communication Unit

[0605] 121 User information acquisition unit

[0606] 122 User-owned item information acquisition unit

[0607] 123 User credit information acquisition unit

[0608] 124 User identification & user motion detection unit

[0609] 131 Virtual content display control unit

[0610] 132 Virtual item trading box display control unit

[0611] 133 Virtual Item Transaction Control Unit

[0612] 134 User-owned item information update unit

[0613] 151 Sensor

[0614] 152 Display Unit

[0615] 301 Specified Area

[0616] 501 CPU

[0617] 502 ROM

[0618] 503 RAM504 Bus

[0619] 505 Input / Output Interface

[0620] 506 Input Unit

[0621] 507 Output Unit

[0622] 508 storage unit

[0623] 509 Communication Unit

[0624] 510 Driver

[0625] 511 Removable Media

Claims

1. An information processing device, comprising: A data processing unit that performs display control of an AR (augmented reality) image in which a real object and virtual content are superimposed and displayed, wherein: The data processing unit: performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents whose ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

2. The information processing device according to claim 1, wherein: When the delivery process of the virtual item is performed with both the virtual item providing user who owns the ownership of the virtual item and the virtual item receiving user who wants to obtain the ownership of the virtual item in the hands of the virtual item trading box, the data processing unit performs the process of transferring the ownership of the virtual item.

3. The information processing device according to claim 1, wherein: The data processing unit performs a process of transferring the ownership of the virtual item in a case where the virtual item receiving user who is to acquire the ownership of the virtual item is a user for whom an authentication identification mark indicating that the virtual item receiving user is a user given credit by the virtual item providing user is displayed.

4. The information processing device according to claim 1, wherein: The data processing unit performs the following virtual item display position control: in the virtual item display position control, when both hands of a virtual item providing user who holds the virtual item in his hands and a virtual item receiving user who wants to obtain ownership of the virtual item are in the virtual item trading box, if the virtual item providing user opens his hand, the display position of the virtual item is moved to the hand side of the virtual item receiving user.

5. The information processing device according to claim 4, wherein: The data processing unit performs the following virtual item display position control: in the virtual item display position control, when the hand of the virtual item receiving user is closed while holding the virtual item after the display position of the virtual item is moved to the hand side of the virtual item receiving user, the virtual item display position is displayed following the hand of the virtual item receiving user.

6. The information processing device according to claim 1, wherein: When a predetermined condition is met, the data processing unit displays the virtual item trading box.

7. The information processing device according to claim 1, wherein: The data processing unit displays the virtual item transaction box when the distance between the virtual item providing user who owns the virtual item and the virtual item receiving user who wants to acquire the ownership of the virtual item is equal to or less than a specified distance.

8. The information processing device according to claim 1, wherein: The data processing unit displays the virtual item transaction box when a virtual item receiving user who wants to acquire ownership of the virtual item is displayed in a designated area of ​​the display screen of the AR image.

9. The information processing device according to claim 1, wherein: When a predetermined condition is met, the data processing unit hides the virtual item trading box.

10. The information processing device according to claim 1, wherein: The data processing unit hides the virtual item transaction box when the distance between the virtual item providing user who owns the virtual item and the virtual item receiving user who wants to acquire the ownership of the virtual item is equal to or greater than a specified distance.

11. The information processing device according to claim 1, wherein: The data processing unit performs user identification processing of a virtual item receiving user who is to acquire ownership of the virtual item, and displays a user name acquired based on the identification result near the virtual item receiving user.

12. The information processing device according to claim 1, wherein: The data processing unit performs credit determination processing as to whether the virtual item receiving user who is to obtain ownership of the virtual item is a user given credit by the virtual item providing user, and if it is determined that the virtual item receiving user is a credit user, an authentication identification mark is displayed near the virtual item receiving user.

13. The information processing device according to claim 12, wherein: The data processing unit performs the credit determination process with reference to the inter-user credit information list stored in the storage unit.

14. The information processing device according to claim 1, wherein: When the delivery processing of the virtual item is performed in the virtual item trading box, the data processing unit performs processing to update the registration data of the user-owned item list, the user-owned item list is a list stored in the storage unit, and the virtual items owned by each user are registered in the user-owned item list.

15. An information processing system comprising: A user terminal having a display unit for displaying an AR (augmented reality) image in which real objects and virtual contents are superimposed and displayed; as well as a server that performs communication with the user terminal and performs display control of the AR image displayed on the display unit of the user terminal, wherein As a display control process for the virtual content of the display unit of the user terminal, the server: performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents whose ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

16. The information processing system according to claim 15, wherein: In the AR image displayed on the display unit of the user terminal, when the delivery process of the virtual item is performed in a state where both the hands of the virtual item providing user who owns the ownership of the virtual item and the virtual item receiving user who wants to obtain the ownership of the virtual item are in the virtual item trading box, the server performs the process of transferring the ownership of the virtual item.

17. The information processing system according to claim 15, wherein: The server performs the following virtual item display position control: in the virtual item display position control, in the AR image displayed on the display unit of the user terminal, when both the hands of the virtual item providing user who holds the virtual item in his hands and the virtual item receiving user who wants to obtain the ownership of the virtual item are in the virtual item trading box, if the virtual item providing user opens his hand, the display position of the virtual item is moved to the side of the hand of the virtual item receiving user, and if the hand of the virtual item receiving user closes while holding the virtual item, the virtual item display position is displayed following the hand of the virtual item receiving user.

18. An information processing method executed in an information processing device, The information processing device includes a data processing unit that performs display control of an AR (Augmented Reality) image in which a real object and virtual content are superimposed and displayed, The information processing method comprises: performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents whose ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

19. An information processing method executed in an information processing system, the information processing system comprising: A user terminal having a display unit for displaying an AR (augmented reality) image in which real objects and virtual contents are superimposed and displayed; as well as a server that performs communication with the user terminal and performs display control of the AR image displayed on the display unit of the user terminal; The information processing method comprises: As a display control process for the virtual content on the display unit of the user terminal, the server: performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents whose ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

20. A computer program product, comprising a computer program, wherein when the computer program is executed by an information processing device, the information processing device implements an information processing method, the information processing device comprising: a data processing unit that performs display control of an AR (Augmented Reality) image in which a real object and virtual content are superimposed and displayed, The information processing method comprises causing the data processing unit to: performing display control of virtual items and a virtual item transaction box, the virtual items being virtual contents whose ownership is registered, the virtual item transaction box being a limited area for performing ownership transfer processing of the virtual items, and When the delivery process of the virtual item is executed in the virtual item trading box, the ownership of the virtual item is transferred.

Images