Information processing system, information processing method, and program

Abstract

The present invention aims to provide a system for completing operations to execute a payment method in an augmented reality space or a virtual reality space. [Solution] A virtual space payment system (10) for making payments for selected goods, which are goods selected by a selection operation by a user wearing a display device for a three-dimensionally displayed product object placed in an augmented reality space or a virtual reality space, wherein the wallet providing server (100) comprises a display processing unit that performs processing to display a wallet UI, which is a user interface that executes a three-dimensionally displayed payment method available to the user, on the display unit of the user terminal (the display device), and a payment unit that completes the operation of making payment for the selected goods in the augmented reality space or the virtual reality space in accordance with the user's selection operation on the user interface that executes the payment method.

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] A system that allows you to purchase products in a virtual space has been disclosed (Patent Document 1 ). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-79439 Summary of the Invention [Problem to be solved by the invention]

[0004] The system described in Patent Document 1 allows users to place objects in a virtual space into a virtual cart ( Users can take actions such as adding something to their cart or expressing their positive impression of a product (like). The system is also configured to allow users to run virtual cursors. By adding products to the shopping cart, you can connect to an EC (Electronic Commerce) site and purchase the products. However, when making a purchase in a virtual space, The system allows the e-commerce site to process the purchase in a browser tab. In this system, the purchase operation cannot be completed in the virtual space, so the user This requires the user to put on and take off the goggles or other terminal devices. Every time a purchase is made during this time, the user loses their sense of immersion in the virtual space. A problem arises.

[0005] Therefore, in order to solve the above problems, the present invention provides a method for creating a virtual reality image in an augmented reality space or a virtual reality space. The present invention aims to provide a system for completing payment operations in the [Means for solving the problem]

[0006] An information processing system according to one aspect of the present invention is an augmented reality space or a virtual three-dimensional space. In a virtual reality space, a three-dimensional object is placed in the augmented reality space or the virtual reality space. Displaying the augmented reality space or the virtual reality space for the displayed product object. A display device for displaying a selected product is a product selected by a selection operation by a user wearing the display device. A user interface showing three-dimensionally displayed payment methods available to the user for making a payment. a display processing unit that executes processing for displaying the interface on the display unit of the display device. and a selection operation by the user on a user interface relating to the payment means. In response, a payment for the selected product is made in the augmented reality space or the virtual reality space. and a settlement unit that completes the operation.

[0007] An information processing method according to one aspect of the present invention includes: In a virtual reality space, which is a three-dimensional space, the augmented reality space or the virtual reality space is placed The augmented reality space or the virtual reality space is used to visualize the three-dimensionally displayed product object. The product is selected by a user wearing a display device that displays the real space. Regarding the three-dimensionally displayed payment means available to the user for paying for the selected products and executing a process for displaying a user interface on a display unit of the display device. and a selection by the user on a user interface relating to the payment method. In response to the operation, payment for the selected product is made in the augmented reality space or the virtual reality space. and to complete and execute the operations related to the

[0008] A program according to one aspect of the present invention is a program for causing a computer to create an augmented reality space or a virtual three-dimensional space. In the virtual reality space, which is the original space, the The augmented reality space or the virtual reality This is a product selected by a user wearing a display device that displays the space. Regarding the three-dimensionally displayed payment means available to the user for paying for the selected products. and executing a process for displaying a user interface on the display unit of the display device. and a selection operation by the user on a user interface relating to the payment means. In accordance with the operation, payment for the selected product is made in the augmented reality space or the virtual reality space. To complete the operation and to execute the operation. [Effects of the Invention]

[0009] According to the present invention, it is possible to complete a payment in an augmented reality space or a virtual reality space. This prevents the user from losing their sense of immersion in the virtual space. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram showing an example of the configuration of a virtual space payment system 10. FIG. [Figure 2] FIG. 1 is a diagram showing an example of an overview of the processing of the virtual space payment system 10. [Figure 3] FIG. 2 is a diagram showing an example of the configuration of a wallet providing server 100. [Figure 4] FIG. 10 is a diagram showing the configuration of user information D111. [Figure 5] FIG. 10 is a diagram showing the configuration of retail store information D112. [Figure 6] FIG. 11 is a diagram showing the configuration of UI information D113. [Figure 7] FIG. 10 is a diagram illustrating an example of a store identification UI in a virtual space. [Figure 8] FIG. 10 is a diagram illustrating an example of a product confirmation UI in a virtual space. [Figure 9] FIG. 10 is a diagram illustrating an example of a product selection UI in a virtual space. [Figure 10] FIG. 10 is a diagram showing another example of a product selection UI in a virtual space. [Figure 11] FIG. 10 is a diagram illustrating an example of a menu UI in a virtual space. [Figure 12] A figure showing an example of a first wallet UI in a virtual space. [Figure 13] A figure showing an example of a second wallet UI in a virtual space. [Figure 14] A figure showing an example of a third wallet UI in a virtual space. [Figure 15] A figure showing an example of a fourth wallet UI in a virtual space. [Figure 16] A figure showing another example of the fifth wallet UI in the virtual space. [Figure 17] FIG. 10 is a diagram illustrating an example of a purchase confirmation UI in a virtual space. [Figure 18] FIG. 2 is a diagram illustrating an example of the configuration of a virtual space management server 200. [Figure 19] FIG. 10 is a diagram showing an example of store space information D211. [Figure 20] FIG. 10 is a diagram showing an example of product placement information D212. [Figure 21] FIG. 10 is a diagram showing an example of product information D213. [Figure 22] FIG. 10 is a diagram showing an example of action information D214. [Figure 23]FIG. 2 illustrates an example of the configuration of a user terminal 300. [Figure 24] 1 is a flow chart showing an example of processing of the virtual space payment system 10. FIG. [Figure 25] FIG. 2 illustrates an example of a hardware configuration of a computer. DETAILED DESCRIPTION OF THE INVENTION

[0011] The following describes a virtual space payment system 10 according to one embodiment of the present invention with reference to the drawings. However, the embodiments described below are merely examples. It is not intended to exclude various modifications and applications of techniques not explicitly stated below. Various modifications may be made within the scope of the spirit of the present invention, or the embodiments may be combined. In the following description of the drawings, the same or similar parts are indicated by the same or similar parts. Similar symbols are used.

[0012] ===Outline of Virtual Space Payment System 10=== The virtual space payment system 10 is, for example, a terminal device such as goggles worn by a user. Projected augmented reality space (hereinafter referred to as "augmented reality space") or virtual three-dimensional Losing the sense of immersion in the original space (hereinafter referred to as "virtual reality space") This system allows users to complete the purchasing process without touching the screen. The term "virtual space" is used to refer to both real-world and virtual reality spaces. The local payment system 10 allows the user to make payments without leaving the virtual space (for example, without using goggles, etc.). The user can complete the purchase of a 3D avatar without removing the device. This allows the virtual space payment system to prevent users from losing their sense of immersion in the virtual space. This can prevent this.

[0013] The augmented reality space is created by, for example, a user using a terminal device such as a see-through head-mounted display. By wearing the device, an image is projected onto the real world. The virtual reality space can be realized, for example, by a non-transparent head-mounted display worn by the user. It is a virtual space that is made up of images displayed on a terminal device. , so-called mixed reality space (information from the real world reflected in the digital space) The image displayed on the terminal device may be perceived by the user as a three-dimensional image, for example. Below, we will explain the images displayed on the terminal device that are actual objects in the virtual space. Objects that can be seen by the user, such as a virtual object, can be called "virtual objects." be.

[0014] First, with reference to FIG. 1, an outline of the configuration of the virtual space payment system 10 will be described. FIG. 1 is a diagram showing an example of the configuration of a virtual space payment system 10. As shown in FIG. 1, The virtual space payment system 10 includes, for example, a wallet providing server 100, a virtual space management server, The system may include a server 200, a user terminal 300, and a retail store terminal 400.

[0015] The wallet providing server 100 provides information for realizing the user's purchase procedure in the virtual space. The wallet providing server 100 is a server that processes information about a retail store that operates in a virtual space. Information for opening (e.g., information about the virtual object of the store, the virtual object of the product, In order to process the information about the user's purchase in the virtual space, Information about the user interface for the payment virtual object The wallet providing server 100 processes information for opening a store and and user interface information are provided in the Software Development Kit (hereinafter referred to as "SDK" ") to the virtual space management server 200, which will be described later.

[0016] This allows the virtual space payment system 10 to easily open a store in a retail store. This allows users to make purchases in the virtual world. The SDK allows businesses to easily set up retail stores and facilitate purchase procedures for users. This allows for continuation, which can attract retailers and encourage consumer participation. This allows the virtual space payment system 10 to expand the business area for the business. This can have an economic effect.

[0017] The virtual space management server 200 is, for example, a server for providing a virtual space to a user. The user terminal 300 creates a virtual space based on the information provided by the virtual space management server 200. The virtual space management server 200 provides a virtual space to the user. Based on the information about the user interface provided by the user terminal 300 to display a predetermined user interface.

[0018] The user terminal 300 may be, for example, a non-transmissive head-mounted display or a transmissive head-mounted display. A virtual object can be visualized in a virtual space by a user using a head-mounted display. The user terminal 300 is a device that can display the user's actions. do.

[0019] The retail store terminal 400 stores, for example, information about the store to be opened in the virtual space and the products to be displayed. The retail store terminal 400 is a device that receives operation inputs from, for example, a retail store manager. By receiving the data, various information is generated.

[0020] In the above, the wallet providing server 100 and the virtual space management server 200 Although the wallet providing server 100 is described as being provided separately, it is not limited to this. The virtual space management server 200 may be configured as a single server or as a cloud server. The wallet providing server 100 may be divided into various functions. It may be composed of multiple servers.

[0021] Next, an overview of the processing of the virtual space payment system 10 will be described with reference to FIG. FIG. 2 is a diagram showing an example of an outline of the processing of the virtual space payment system 10. First, step In step S1, the retailer terminal 400 receives, for example, the wallet provided by the wallet providing server 100. The web page accepts user input and stores information (hereinafter referred to as "store") Information") and product information (hereinafter referred to as "Product Information") provided by the Wallet Provider. Although not shown here, the wallet providing server 100 For example, by providing store information and product information to businesses that create 3D data, You may also obtain 3D data of the store and products from the business. The server 100 receives store information and product information from the business operator. The three-dimensional data of the store and the products may or may not be acquired dynamically.

[0022] Next, in step S2, the wallet providing server 100 receives, for example, store information and The wallet providing server 1 then transmits the product information to the electronic commerce server 500. 00 is a small token that is used when a user purchases a product offered by a retail store in a virtual space. It will be possible to transfer funds to the store.

[0023] Next, in step S3, the wallet providing server 100 receives, for example, store information, The product information and three-dimensional data of the store and the product are sent to the virtual space management server 200. This allows retailers to open stores in virtual space and display products with simple operational inputs. When retailers open stores in virtual space, preparing 3D data of the store and products is a hurdle. This can solve the problem that has been occurring.

[0024] Next, in step S4, the user terminal 300 displays the virtual space on the user terminal 300. Application software (hereinafter referred to as "virtual The user terminal 300 installs the virtual space APP Regardless of the above, the virtual space may be displayed on the display unit 1007 via a web browser.

[0025] Next, in step S5, the user terminal 300, for example, Application software that allows users to use payment methods for Install the "wallet app".

[0026] Next, in step S6, the user terminal 300, for example, through the wallet APP Information about the user acquired based on the user's operational input (hereinafter referred to as "user information") ) to the wallet providing server 100. The user information may be, for example, The payment method may include information about the payment method (hereinafter referred to as "payment method information").

[0027] Next, in step S7, the wallet providing server 100 adds, for example, the following to the user information: Based on this, a user interface corresponding to the payment method used by the user (hereinafter referred to as "wallet") The wallet providing server 100 identifies the user information and the wallet The information about the virtual UI is transmitted to the virtual space management server 200. You can purchase products in the virtual space using your desired payment method.

[0028] Next, in step S8, the user terminal 300, for example, The user terminal 300 receives an operation input from the user to add the item to the cart. The user selects a product from the list and the purchase procedure is carried out. For convenience, the operations from when a user selects a product to when the purchase procedure is carried out are referred to as "purchase operations." The information for executing a payment by a purchase operation is called "payment execution information." Regarding the user interface provided to the user through the user terminal 300 in the operation More details will be provided later.

[0029] Next, in step S9, the virtual space management server 200 collects information about the purchased product. The purchase information is transmitted to the wallet providing server 100. For example, the information includes information about the product that is the target of the user's purchase operation. In S10, the wallet providing server 100 transmits the purchase information to the electronic commerce server 500. This allows the user to complete the purchase procedure without removing the user terminal 300. can.

[0030] Next, in step S11, the electronic commerce server 500 notifies the retailer of the user's purchase procedure. The proceeds of the sale of the product are then transferred to the bank. This allows the retailer to You can obtain sales proceeds from

[0031] In this way, in the virtual space payment system 10, for example, the virtual space management server 200 Even if there are multiple virtual space management servers 200, each virtual space management server 200 is a wallet providing server 10. 0 to send the purchase information to the appropriate e-commerce server 500. The user can use the VR (Virtual Reality) SNS (Social Networking Service) without having to attach or detach the user terminal 300. Transactions can be completed within the Virtual Networking Service, allowing users to This solves the problem of losing the sense of immersion in the space.

[0032] ===Configuration of wallet provider server 100=== Next, the configuration of the wallet providing server 100 will be described with reference to Fig. 3. 3 is a diagram showing an example of the configuration of the wallet providing server 100. As shown in FIG. The internet providing server 100 includes, for example, a storage unit 110, an acquisition unit 120, and a UI information providing unit 130. 30, a display processing unit 140, a settlement unit 150, and a product classification unit 160. The functional unit may be, for example, a processor 1001 that executes a program stored in a memory 1002. This is a function that is realized by reading it.

[0033] The storage unit 110 stores user information D111, retail store information D112, and UI information D113. Remember.

[0034] First, the user information D111 will be described with reference to Fig. 4. Fig. 4 shows the user information D 4 is a diagram showing the configuration of user information D111. As shown in FIG. 4, the user information D111 includes, for example, User ID], [Name], [Email address], [Address], [Telephone number], [Payment method], It may contain the items [Purchased Product] and [UIID]. [User ID] is a unique identifier for the user. [Name] stores the user's name. [Email address] stores the user's name. [Address] stores the email address used by the user. [Address] stores the user's current address. [Phone number] stores the user's phone number. [Payment method] stores the user's virtual phone number. In this example, the user with user ID "U0001" uses the payment method As payment methods, register credit card A, bank account B, virtual currency C, and electronic money D. The wallet providing server 100 receives the wallet associated with the user with the user ID "U0001". Generates information about the Red UI. [Purchased Items] is the items that the user has previously purchased in the virtual space. Stores data related to the product. [UIID] is a UIID that can uniquely identify each UI. Remember.

[0035] Next, the retail store information D112 will be described with reference to Fig. 5. Fig. 5 shows the retail store information D112. 5 is a diagram showing the configuration of retail store information D112. As shown in FIG. 5, the retail store information D112 includes, for example, Store ID], [Retailer Name], [Email Address], [Address], [Phone Number], [Store 3D It may also include the following items: [Retailer ID], [Product 3D Data], and [Sales History]. ] stores the retail store ID that can uniquely identify the retail store. [Retail store name] stores the name of the retail store. [Email address] will remember the email address used by the retailer. [Address] ] stores the current location of the retail store. [Phone Number] stores the telephone number of the retail store. [3D data] stores 3D data about retail stores. [Product 3D data] stores 3D data about small Stores 3D data related to products in the store. [Sales History] is a small data in the virtual space. Store the sales history of products in the store.

[0036] Next, the UI information D113 will be described with reference to Fig. 6. Fig. 6 shows the UI information D113. 6 is a diagram showing the configuration of UI information D113. As shown in FIG. ], [UI Name], [UI Type], [UI Data], and [Virtual Space ID]. [UIID] stores a UIID that can uniquely identify each UI. [UI Name] The name of each UI is stored. [UI type] is a UI for identifying a store, a UI for checking the items, UI for executing payment methods, UI for checking purchased items It stores the type of UI, such as UI for the UI, menu-related UI, etc. [UI data] is virtual It stores data for displaying the UI in the space. [Virtual Space ID] is the virtual space ID that the UI corresponds to. A virtual space ID that can uniquely identify the space is stored.

[0037] The acquisition unit 120 is, for example, a virtual space management server 200, a user terminal 300, a retail store terminal 400 and other devices such as an e-commerce server 500 .

[0038] The UI information providing unit 130 provides information about the UI related to the purchase operation by the user (hereinafter, “ The UI for the purchase operation is generated by, for example, UI for identifying the store (hereinafter referred to as "Store Identification UI"), UI for checking products I (hereinafter referred to as "Product Confirmation UI"), UI for selecting products in the cart (hereinafter referred to as " a wallet UI for executing payment methods, a product selection UI for confirming purchased products, UI for confirming purchases (hereinafter referred to as "Purchase Product Confirmation UI"), and UI for menus (hereinafter referred to as "Purchase Product Confirmation UI"). The UI information providing unit 130 generates a menu UI. The information is transmitted to the virtual space management server 200. 00 can provide a UI tailored to the user in the virtual space to the user terminal 300. For convenience, when we say "user's hand," we mean the hand of the avatar corresponding to the user in the virtual reality space. In the augmented reality space, it is assumed to be the user's real hand.

[0039] First, an example of a store identification UI will be described with reference to Fig. 7. Fig. 7 shows a store identification UI in a virtual space. 7 is a diagram showing an example of a store identification UI in a virtual space. In the above, an identification object U1 is displayed for a store where payment by the payment means is accepted. The identification object U1 is, for example, a predetermined distance (here, The identification object U1 is displayed when the user approaches the device within the specified distance ("L"). The identification object U1 can be, for example, a logo, a payment This is an object that indicates the type of payment method. Users can easily find stores that accept their payment methods, This can improve user convenience.

[0040] Next, an example of a product confirmation UI will be described with reference to Fig. 8. Fig. 8 shows a product confirmation UI in a virtual space. 8 is a diagram showing an example of a product confirmation UI in a virtual space. In this example, a linear object is displayed in response to the user's hand gestures recognized by the user terminal 300. The product confirmation UI also includes a line object (hereinafter referred to as "line object U2"). When the object U2 overlaps or intersects with the product, the user places their index finger and thumb together. When a user makes a pinching motion (hereinafter referred to as a "pinch motion"), the product is By bringing the product closer, it can be rotated and transformed. This allows for a virtual space payment system. 0 allows users to check products from various angles at hand without having to get close to the products. In addition, the product confirmation UI can be used to check products by specifying them with the line object U2. It includes a price display object U3 that displays the price and specifications of the product. This allows the virtual space payment system 10 to allow users to input the price and specifications of the product. This allows users to easily check the above, thereby improving user convenience.

[0041] As shown in FIG. 8, the product confirmation UI may be configured to display, for example, a product designated by the user. A display object U4 is included which displays each of a plurality of related products in a predetermined area. For example, the product specified by the user may be "Bag A." In this case, in relation to bag A, bags of the same brand and bags of similar shape , bags with similar colors, bags with similar uses, etc. Display object U4 The object has a spherical shape and displays 3D image data of the product in the inner area of ​​the spherical shape. The multiple display objects U4 are arranged so that they overlap at least partially. In this way, the user in the virtual space can In addition, the visibility of the product to the user can be improved. The product confirmation UI may be displayed so as to move in accordance with the user's hand movements. This allows users to view products through intuitive operations.

[0042] Next, an example of a product selection UI will be described with reference to Fig. 9. Fig. 9 shows a product selection UI in a virtual space. 9 is a diagram showing an example of a product selection UI in the product selection menu. It includes a cart object U5 and a product display object U6 that displays the selected product. The cart object U5 is a 3D object for storing selected products. The cart object U5 is displayed so as to cover one of the user's palms. The product display object U6 moves according to the movement of the palm. This object reduces the size of the product and displays it within a specified area when the product is moved. The product display object U6 changes into a spherical shape in response to the user's action of pinching the product with the other hand. It is an object that displays 3D image data of the product in the area inside the shape. The display object U6 is moved by the user while accepting the user's pinch action. This allows the user to select products intuitively. .

[0043] Another example of the product selection UI will be described with reference to Fig. 10. Fig. 10 shows a virtual space 10 is a diagram showing another example of a product selection UI between. As shown in FIG. For example, a product display object that displays multiple products added to a cart by a user. The product display object U7 includes, for example, a cart object U shown in FIG. This is an area where each product moved to 5 is displayed in a reduced size within a specified area. The UI may, for example, display multiple product display objects U7 on the upper body (torso) of a user's avatar. In this way, the user can easily select the product. This improves user convenience by making it easier to view the products. In response to the user's hand movement to remove the connected product display object U7 from the row, This allows the user to intuitively select products. The product selection UI also allows you to select a product from a series of product display objects. Move the product along the line in response to hand movements that move the product U7 along the line. This allows the user to view the selected product through intuitive operations. To make it Noh.

[0044] Next, an example of the menu UI will be described with reference to Fig. 11. Fig. 11 shows a virtual space 11 is a diagram showing an example of a menu UI in the For example, an accessory placed around the user's hand with the thumb pointed forward. Includes Ikon U8. To encircle the hand, for example, wrap it around the wrist in a circle or arc. The icon U8 is used to represent an item in the menu (e.g., (items that transition to checkout, cart, inventory). This makes it easy for users to understand the items included in the menu, improving user convenience. In addition, the menu UI can select any one of the multiple icons U8. The instruction object U9 may include an instruction object U9 for pointing to a user. The menu UI is displayed in the direction indicated by the tip of the user's thumb. The object U9 points to an object in response to the user's wrist twisting motion in one direction. This allows the user to intuitively change the menu items. This allows for the selection of:

[0045] Next, an example of the first wallet UI will be described with reference to FIG. 12. 12 is a diagram showing an example of a first wallet UI in the virtual space. The wallet UI is a virtual space where a card-shaped payment method that corresponds to the payment method in the real world is displayed. The first wallet UI includes a plurality of card-shaped objects U The numbers are displayed in a row in one direction so that some of the numbers overlap. This allows users to select payment methods through intuitive operations. The first wallet UI also The display position may be changed depending on the frequency of use by the user. The UI is sorted in order of frequency of use (for example, in Figure 12, "Credit Card A" is the most frequently used). The card-shaped object U10 may be displayed on top of the other objects U10. This allows the user to easily select a payment method that they use frequently. The first wallet UI is a limit display object U that shows the usage limit for each payment method. 11 may be displayed. This allows the user to easily understand the available balance for each payment method. This improves user convenience.

[0046] Next, an example of the second wallet UI will be described with reference to Fig. 13. Fig. 13 shows the virtual wallet UI. 13 is a diagram showing an example of a second wallet UI in the virtual space. The wallet UI is a virtual space where objects of different shapes are displayed according to the type of asset related to the payment method. The second wallet UI includes, for example, a wallet-shaped UI corresponding to a regular account. object, an object shaped like a piggy bank corresponding to a savings account, cryptocurrency The object may include a three-dimensional polygonal object corresponding to the object. On the other hand, it allows users to select payment methods through intuitive operations.

[0047] Next, an example of the third wallet UI will be described with reference to Fig. 14. Fig. 14 shows the virtual wallet UI. 14 is a diagram showing an example of a third wallet UI in the virtual space. The Wallet UI is an input object that allows users to input confidential information in a virtual space. The input object U13 is, for example, a combination lock. The U13 locks secret information in response to the user's hand rotating the combination lock. The third wallet UI is an object that accepts input of confidential information. Upon confirmation, a payment execution process is performed to have the wallet providing server 100 execute the payment. This allows users to make payments through intuitive operations. The third wallet UI can be implemented using a pin pad, signature pad, or keyboard. It may also be an input object that indicates a code.

[0048] Next, an example of the fourth wallet UI will be described with reference to Fig. 15. Fig. 15 shows a virtual wallet UI. 15 is a diagram showing an example of a fourth wallet UI in the virtual space. The web UI uses a slide object U14 that slides according to the user's hand movements. The slide object U14 may be provided on a plate-shaped object U15. The fourth wallet UI displays a slide object U14 on one palm of the user's hand. The fourth wallet UI may be displayed by a user's hand. The payment execution information is transmitted in response to the sliding action of the 4. This allows users to make payments through intuitive operations.

[0049] Another example of the fifth wallet UI will be described with reference to Fig. 16. 16 is a diagram showing another example of the fifth wallet UI in the virtual space. 5 The wallet UI consists of a card-shaped slide object U16 and a slide object In this case, the fifth gate object U16 may include a gate object U17 that allows the fifth gate object U16 to pass through. The wallet UI responds to the user's hand movements as they slide the slide object U16. This allows the user to make payments through intuitive operations. can be executed.

[0050] Next, an example of a purchase confirmation UI will be described with reference to FIG. 17. FIG. 17 shows a virtual 17 is a diagram showing an example of a purchase confirmation UI in the space. As shown in FIG. The recognition UI is based on the product category (e.g., clothing, games, etc.) classified by the product classification section (described later). ) icon U18 (e.g., folder format, etc.) corresponding to the purchased product confirmation UI. For example, the product associated with the icon U18 selected by the user is displayed in a predetermined format. This can improve the user's operability. The 3D image data of the purchased product can be easily found. For example, if the icon U18 corresponds to the clothing category, the wardrobe U19 will contain the purchased items. The display may include a format in which the 3D image data of the clothing is hung. Users can view purchased items as if they were in real space, improving convenience. In addition, the purchase confirmation UI can display multiple purchase items in combination. Specifically, as shown in Figure 17, the purchase confirmation UI is hung in the wardrobe U19. The clothing that is selected by the user is displayed on a human-shaped object. This allows the user to display the current This improves user convenience by allowing users to shop while checking how the item coordinates with their current clothes. It is also suitable for large, highly customizable products with complex mechanisms, such as cars, motorcycles, and bicycles. You can also preview the features of the products and consider combinations when purchasing. This can improve user convenience.

[0051] The display processing unit 140, for example, In order to display various UIs generated by the UI information providing unit 130 on the display unit 1007, various UIs are The process of transmitting information about I to the virtual space management server 200 is executed. The display processing unit 140 of the server providing server 100 displays various UIs on the display unit 100 of the user terminal 300. 7, information about various UIs may be sent directly to the user terminal 300. The information about the various UIs is displayed on the display unit 1007 of the user terminal 300. The program may include a program for:

[0052] The settlement unit 150 may be, for example, a user interface (e.g., first to In response to the user's selection operation on the fourth wallet UI, Specifically, the user terminal 30 completes the operation related to the payment for the selected product. 0 is a selection operation by the user regarding the payment method, for example, the first and second wallet UIs. For example, payment is executed based on the user's operation on the third, fourth, and fifth wallet UIs. The settlement unit 150 transmits the transaction information to the virtual space management server 200. 00, the payment process is carried out based on the purchase information sent based on the payment execution information. The transaction process may involve, for example, sending purchase information, including information about products purchased by a user, to an e-commerce server. The settlement unit 150 executes the settlement process, and the virtual The user's payment in the space is completed.

[0053] The product classification unit 160 may, for example, classify the purchased products that have been paid for by the payment settlement unit 150. The product classification unit 160 classifies the purchased information into one of a plurality of categories. Information about the product is stored in the user information D111.

[0054] ===Configuration of virtual space management server 200=== Next, the configuration of the virtual space management server 200 will be described with reference to FIG. 18 is a diagram showing an example of the configuration of the virtual space management server 200. As shown in FIG. The space management server 200 includes, for example, a storage unit 210, an acquisition unit 220, and a display processing unit 230. and a purchase information transmission unit 240. Each of the functional units includes, for example, a processor 1001 This is a function that is realized by reading out a program stored in memory 1002.

[0055] The storage unit 110 stores, for example, store space information D211, product placement information D212, product information D 213, action information D214, UI information D215, and user information D216. The UI information D215 and the user information D216 are the same as the UI information D113 and the user information D116. Since this is the same as the information D111, the explanation thereof will be omitted.

[0056] First, the store space information D211 will be described with reference to Fig. 19. Fig. 19 shows the store space information D211. 10 is a diagram showing an example of the store space information D211. The store space information D211 is a diagram showing three types of store space information in a virtual space. The 3D data of the store is a database that stores 3D data of the walls, floors, ceilings, products, etc. It includes data on the 3D shape of a room, including display shelves, etc. The space information D211 includes, for example, the items [Store space ID], [Store space name], and [Update history]. [Store space ID] is a store space ID that can uniquely identify a store in the virtual space. The space ID is stored. [Store space name] stores the name of the store space. The name of the point p space is, for example, For example, it may be the store name. [Update History] stores the update history of the store space.

[0057] Next, the product placement information D212 will be described with reference to Fig. 20. 10 is a diagram showing an example of product placement information D212. The product placement information D212 stores the placement of objects. The target object is an object in the virtual space that the user pays attention to. The information D212 includes, for example, [Store Space ID], [Object ID], [3D Coordinates], [Scale], [Store space ID] records the store space ID. [Object ID] stores the object ID of the object placed in the virtual space. [3 The [dimensional coordinates] record the coordinates (x, y, z) that indicate the position of the object placed in the store in the virtual space. [Scale] remembers the scale at which the object is displayed in the virtual space. [Update Date and time] stores the update date and time of each record.

[0058] Next, the product information D213 will be described with reference to Fig. 21. Fig. 21 shows the product information D 2 is a diagram showing an example of the product information D213. The product information D213 stores attributes of the target object. As shown in 1, the product information D213 includes, for example, [object ID], [product name], and [price]. The [Object ID] is the object ID of the corresponding object. D. [Product name] stores the product name. [Price] stores the product price. [Update New Date and Time stores the update date and time of each record.

[0059] Next, the action information D214 will be described with reference to Fig. 22. 10 is a diagram showing an example of action information D214. The action information D214 is As shown in FIG. 22, the action information D214 includes, for example, For example, [Action ID], [Action Name], [Recognition Action], [UIID], [Execution Date and Time] [Action ID] is a unique identifier for the action type. [Action name] stores the name of the action. [Recognition] stores the action ID. The [recognition action] stores information corresponding to the user's action recognized by the user terminal 300. Specifically, the recognized user actions are, for example, those shown in Figs. 8, 9, 10, 14, 15, and 16, including the user's hand movements shown in Figure 11. [UIID] can uniquely identify various UIs. The [Execution Date] records the date and time when the action was performed by the user. To remember.

[0060] The acquisition unit 220 is, for example, a wallet providing server 100 and a user terminal 300. The information acquired by the acquisition unit 220 is stored in the storage unit 210. It is remembered.

[0061] The display processing unit 230 may, for example, display three-dimensional image data relating to the virtual space stored in the storage unit 210. The display unit 1007 of the user terminal 300 displays the data. The display processing unit 230 displays a U-shaped image as shown in FIGS. 7 to 17 on the display unit 1007 of the user terminal 300. Display a virtual space containing I.

[0062] For example, when the purchase information transmission unit 240 receives payment execution information from the user terminal 300, The purchase information transmission unit 240 identifies the product that is the target of the purchase operation. Purchase information regarding the product is transmitted to the wallet providing server 100.

[0063] ===User terminal 300=== Next, the configuration of the user terminal 300 will be described with reference to Fig. 23. 23 is a diagram illustrating an example of the configuration of the user terminal 300. As shown in FIG. For example, the storage unit 310, the acquisition unit 320, the action recognition unit 330, and the display processing unit 340 Each functional unit includes, for example, a processor 1001 stored in a memory 1002. This function is realized by reading the program.

[0064] The storage unit 310 stores, for example, user information D311 and action information D312. The user information D311 is similar to the user information D111, and therefore a description thereof will be omitted. The action information D312 is the same as the action information D214, so its explanation will be omitted. Storage unit 310 may store information similar to UI information D215. The acquisition unit 320 is, for example, a wallet providing server 100 and a virtual space management server 200. The various information acquired by the acquisition unit 320 is stored in the storage unit 31 The action recognition unit 330 stores the action information of the sensor group 10 included in the user terminal 300. Based on the information acquired in step 08, the user's actions are recognized. Specifically, The unit 330 refers to the action information D312 and obtains information about the action (hereinafter, "action information"). The user terminal 300 sends the action information to the virtual space management server 200. This allows the display unit 1007 to display a UI according to the user's actions. The display processing unit 340 can, for example, display the virtual space acquired from the virtual space management server 200. and 3D image data relating to various UIs are displayed on the display unit 1007. Display it.

[0065] ===Processing of the virtual space payment system 10=== An example of the processing of the virtual space payment system 10 will be described with reference to FIG. 4 is a flow diagram showing an example of the processing of the virtual space payment system 10. Since retailers open stores in virtual space, users can find the retailers in virtual space. An example of the process flow from purchasing clothes at a retail store to completing the payment process will be explained. In the following description, reference will be made to FIGS. 7 to 17 as appropriate.

[0066] In step S100, the retail store terminal 400 of the retail store receives the wallet providing server 10 The wallet providing server 100 transmits the store information and product information to the Based on the information and product information, 3D image data of the store and the product may be created. The server 100 stores store information, product information, and 3D image data of the store and the product. The store ID is stored in the storage unit 110 in association with the store ID.

[0067] Next, in step S101, the wallet providing server 100 executes the virtual space management server The virtual space management server 200 manages store information, product information, and three-dimensional image data of the store and products. At this time, the wallet providing server 100 transmits the store information, product information, and the like to the management server 200. The virtual space management server 200 provides the virtual information and the three-dimensional image data of the store and the products. It may be sent together with a program for applying it to the virtual space. The server 100 stores store information, product information, and store and product information in the virtual space management server 200. The 3D image data of the virtual shop may be transmitted via SDK. This allows retailers to easily You can open a store in the space.

[0068] Next, in step S102, the virtual space management server 200 collects store information, product information, and The virtual space management server stores the three-dimensional image data of the store and the products in the storage unit 210. The virtual store 200 reflects the store and its products in the virtual space.

[0069] Next, in step S200, the wallet providing server 100 Upon request, we will send a wallet app that will enable various UIs to be used in the virtual space. In addition, the virtual space management server 200 manages the virtual space in response to a request from the user terminal 300. Send the virtual space APP for display.

[0070] Next, in step S201, the user terminal 300 receives an operation input from the user. Then, the user information and payment method information are transmitted to the wallet providing server 100. The ticket providing server 100 stores the user information and the payment method information in the storage unit 110 .

[0071] Next, in step S202, the wallet providing server 100 The corresponding UI information is associated with the user information and transmitted to the virtual space management server 200. This allows the virtual space management server 200 to provide the user with a wallet UI. In step S203, the virtual space management server 200 adds the user information to the wallet UI. are stored in the storage unit 210 in association with each other.

[0072] Next, in step S300, the user terminal 300 transmits to the virtual space management server 200 In step S301, the virtual space management server 200 transmits the authentication information. In step S302, the user terminal 300 transmits information about the time interval. The user terminal 300 displays the virtual space on the display unit 1007. The virtual space management server 20 recognizes the user's actions by referring to the information D312. In step S303, the virtual space management server 200 sends the The UI information relating to various UIs corresponding to the user's actions is transmitted to the user terminal 300 based on the UI information. Next, in step S304, the user terminal 300 displays various UIs on the display unit 1007. Show it.

[0073] The following describes the process by which the user terminal 300 displays various UIs. The virtual space management server 200 refers to the UI information 215 and displays the UI information on the display unit 10 of the user terminal 300. 07 to display various UIs. For example, the UI information is recorded on the user terminal 300. When the UI information is stored, the user terminal 300 refers to the UI information and displays various UIs on the display unit 1007. I may be displayed.

[0074] As shown in FIG. 7, the virtual space management server 200 manages the relationship between the avatar and the store in the virtual space. When it is determined that the distance has reached a predetermined distance, the store identification UI is displayed by referring to the UI information D215. The payment method is displayed on the display unit 1007. This allows the user to access stores where the registered payment method can be used. This allows the user to easily recognize the information, thereby improving user convenience.

[0075] As shown in FIG. 8, when a user checks products in a store, the virtual space management server 200 Then, a product confirmation UI (here, , line object U2) is displayed on the display unit 1007 of the user terminal 300. The management server 200 refers to the action information D312 in the user terminal 300 and By acquiring motion information about the user's hand movements, the product is drawn to the user's hand and rotated. The virtual space management server 200 can also Identify products related to the product specified by the line object U2 by referring to the product information D213. The virtual space management server 200 stores the three-dimensional image data of each of the identified products. The virtual space management server 200 displays the user's Based on the motion information about the user's hand movements recognized by the user terminal 300, The user moves the spherical display object U4 along the arrow. The virtual space payment system 10 allows users to check the payment details in a list, and provides an intuitive It allows you to view products by operating the device.

[0076] As shown in FIG. 9, the virtual space management server 200 allows a user to add products in a store to a cart. Product selection UI for adding products (here, cart object U5 and product display object U6) The virtual space management server 20 displays the object U6 on the display unit 1007 of the user terminal 300. 0 is the left hand of the user recognized by referring to the action information D312 in the user terminal 300. The virtual space management server 200 acquires the motion information related to the palm-out motion. D215, the cart object U5 is displayed on the display unit 1007 of the user terminal 300. This allows the virtual space payment system 10 to display the cart with intuitive operations. This improves user convenience. 00, referring to the action information D312, regarding the user's action of picking up the product. The virtual space management server 200 acquires the operation information by referring to the UI information D215. The product display object U6 including the three-dimensional image data is displayed on the display unit 1007 of the user terminal 300. The virtual space management server 200 displays the product display object U6 on the cart object. When the operation information about the operation of moving the product to the Project U5 is acquired, the list of products to purchase is (hereinafter referred to as "purchase list"). The purchase list is, for example, This is a list stored in the storage unit 210 of the server 200. The 10-inch display allows users to add items to their cart intuitively, improving user convenience. can.

[0077] As shown in FIG. 10, the virtual space management server 200 also stores the products stored in the purchase list. A product selection UI (here, a product display object U7) for browsing products is displayed on the user terminal. The virtual space management server 200 displays the information on the display unit 1007 of the user terminal 300. For example, the operation information about the operation of selecting icon U8, which indicates the cart in the menu UI, is displayed. Once acquired, the product display object U7 is displayed on the display unit 1007. When the server 200 acquires information about the operation of removing the product display object U7 from the column, The product displayed in the product display object U7 is excluded from the purchase list. The virtual space payment system 10 allows you to easily view the items in your cart. In addition, users can remove items from the cart with intuitive actions, improving user convenience. Cut.

[0078] As shown in FIG. 11, the virtual space management server 200 displays a menu for selecting an item. The UI is displayed on the display unit 1007 of the user terminal 300. The virtual space management server 200 The user terminal 300 refers to the action information D312 and recognizes the thumb pointing forward. The virtual space management server 20 acquires motion information relating to the motion of thrusting out one of the clenched hands. 0 is the icon included in the menu UI that surrounds the user's outstretched hand. U8 is displayed on the display unit 1007 of the user terminal 300. The items can be easily checked, improving user convenience. The operation is performed by selecting a predetermined icon U8 on the menu UI from the user terminal 300. When the creation information is acquired, the object corresponding to the icon U8 is displayed on the user terminal 300. The display unit 1007 displays the result.

[0079] As shown in FIGS. 12 and 13, the virtual space management server 200 Wallet UI for selecting the payment method at the time of purchase (in this case, the first wallet UI or the second wallet UI) 2 Wallet UI) is displayed on the display unit 1007 of the user terminal 300. For example, the server 200 refers to the action information D312 in the user terminal 300 and recognizes the action. When the operation information regarding the operation for paying for the items in the shopping list is acquired, the display The first wallet UI or the second wallet UI is displayed on 1007. The server 200 allows the user to select either the first wallet UI or the second wallet UI. The payment method (e.g., credit card U10 or wallet object U12) Purchase information is generated based on the purchase operation.

[0080] As shown in FIGS. 14, 15, and 16, the virtual space management server 200 Wallet UI (this) accepts actions to confirm purchases when making payments by financial means. Here, you can choose to use the 3rd Wallet UI, 4th Wallet UI, or 5th Wallet UI. The virtual space management server 200 displays the image on the display unit 1007 of the user terminal 300. 12. When the operation information regarding the operation of selecting the payment method shown in FIG. 13 is acquired, the user terminal The display unit 1007 of the 300 displays the third wallet UI, the fourth wallet UI, or the fifth wallet UI. The user terminal 300 refers to the action information D312 and displays the first UI. User decision for 3rd Wallet UI, 4th Wallet UI, or 5th Wallet UI When the action of executing the payment is recognized, the payment execution information for executing the payment is The information is transmitted to the space management server 200.

[0081] Next, in step S305, purchase information is generated based on the payment execution information. Next, in step S306, the purchase information is transmitted to the wallet providing server 100. The internet providing server 100 is an electronic commerce service provider that provides payment for the product that is the subject of payment. The purchase information is transmitted to the server 500. As a result, the user can operate the user terminal 300. Therefore, payment operations can be completed in the virtual space without removing the user terminal 300. do.

[0082] Next, in step S306, the wallet providing server 100 performs the following based on the purchase information: The electronic commerce server 500 corresponding to the purchased item is identified and the purchase information is transmitted. The electronic commerce server 500 executes payment processing to the retail store associated with the purchase information. This allows users to enjoy, for example, VR (Virtual Reality) SNS (Social Networking Service). Transactions can be completed within the Searching Service.

[0083] Next, in step S307, the user terminal 300 The electronic commerce server 500 receives a payment availability notification regarding whether or not payment is possible. This allows users to know whether or not payment in virtual space is possible, This improves user convenience.

[0084] Next, in step S308, the virtual space management server 200 checks the user information D216 As shown in FIG. 17, the virtual space management server 200 stores the purchased product information. By referring to the user information D216, 3D image data of the product for which the purchase procedure has been completed is A purchase confirmation UI displayed as a three-dimensional image is displayed on the display unit 1007 of the user terminal 300. It may be possible.

[0085] === Variations === The virtual space payment system 10 is a payment method for, for example, credit card confidential information. A structure that issues encrypted (anonymized) token numbers based on the user's ID (e.g., card number) Specifically, for example, after step S6 in FIG. The user terminal 300 receives information about the card number and token number through user input. The user terminal 300 transmits the transaction number corresponding to the card number to the service provider that issues the transaction number. The user terminal 300 acquires the token number in cooperation with the virtual space APP. The user terminal 300 receives an action to purchase a product from the user in the virtual space. If so, the payment execution information is sent to the virtual space management server 200. 200 transmits the purchase information including the token number to the wallet providing server 100 (see FIG. 2 Step S9) This allows the user to have a secure purchasing process.

[0086] The virtual space payment system 10 also blocks three-dimensional data relating to purchased goods. Specifically, the purchase certificate for the purchased product can be sent to the user. The 3D data of the product will be distributed to the user. The transaction history of the product is stored on the blockchain platform. This allows users to This allows you to prove that you are a legitimate purchaser of the content, and prevents service interruptions from content distribution providers. Even if the service is stopped, the data can still be used.

[0087] ===Hardware Configuration=== A wallet providing server 100 and a virtual space that realize the functions related to the above-described embodiment The management server 200 may be, for example, a server computer or a personal computer (e.g., Desktop, laptop, tablet, etc.), media computer platform (e.g., cable, satellite set-top boxes, digital video recorders), handheld a hard computing device (e.g., PDA, email client, etc.), or It may also be any other type of computer or communications platform.

[0088] The user terminal 300 and the retail store terminal 400 that realize the functions related to the above-described embodiment are For example, smartphones, mobile phones (feature phones), personal computers (e.g., desktop, laptop, tablet, etc.), media computer platform Networks (e.g., cable, satellite set-top boxes, digital video recorders) , handheld computing devices (e.g., PDAs (Personal Digital Assistants) , email clients, etc.), wearable devices (glasses-type devices, watch-type devices may be other types of computers or communication platforms. The user terminal 300 may be a transparent head-mounted display or a non-transparent head-mounted display. It is preferable that the display be a hard-mounted display.

[0089] Referring to FIG. 25, the wallet providing server 100, the virtual space management server 200, the user Hardware when the terminal 300 and the retail store terminal 400 are implemented by the computer 1000 The following describes an example of the hardware configuration. The various functions of the server 200, the user terminal 300, and the retail store terminal 400 are implemented by multiple devices. It can be realized separately.

[0090] FIG. 25 is a diagram showing an example of a hardware configuration of a computer. The computer 1000 includes, for example, a processor 101, a memory 1002, and a storage device. 1003, an input I / F unit 1004, a data I / F unit 1005, and a communication I / F unit 10 1006, a display unit 1007, and a group of sensors 1008. The group of sensors 1008 The wallet providing server 100 is a hardware provided in the terminal 300. The space management server 200, the user terminal 300, and the retail store terminal 400 are not provided with That's fine.

[0091] The processor 1001 executes a program stored in the memory 1002. It is a control unit that controls various processes in the computer 1000.

[0092] The memory 1002 is a storage medium such as a RAM (Random Access Memory). The program code of the program executed by the processor 1001 and the , temporarily stores data required when a program is executed.

[0093] The storage device 1003 is, for example, a hard disk drive (HDD) or a flash memory. The storage device 1003 is a non-volatile storage medium. It stores various programs for realizing each configuration.

[0094] The input I / F unit 1004 is a device for receiving input from the user. Specific examples of the I / F unit 1004 include a keyboard, a mouse, a touch panel, various sensors, The input I / F unit 1004 is, for example, a USB (Universal The computer 1000 may be connected via an interface such as a serial bus.

[0095] The data I / F unit 1005 is used to input data from outside the computer 1000. A specific example of the data I / F unit 1005 is a device that stores data stored in various storage media. The data I / F unit 1005 includes a drive device for reading data stored in the computer. It is also conceivable that the data I / F unit 1000 may be provided outside the computer 1000. In this case, 5 is connected to the computer 1000 via an interface such as a USB.

[0096] The communication I / F unit 1006 is configured to communicate with external devices of the computer 1000 via wired or wireless connections. A device for performing data communication via the Internet N. Communication I / F unit 100 6 may be provided outside the computer 1000. In that case, the communication I / F The F unit 1006 is connected to the computer 1000 via an interface such as a USB. will be done.

[0097] The display unit 1007 is a device for displaying various types of information. Examples include liquid crystal displays and organic EL (Electro-Luminescence) displays. The display unit 1007 may be a display of a computer, a wearable device, or the like. The display unit 1007 may be provided outside the computer 1000. In this case, the display unit 1007 may be, for example, a display. The input I / F unit 10 is connected to the computer 1000 via a play cable or the like. When a touch panel is used as the input I / F unit 1004, the display unit 1007 It is possible to configure it as an integrated unit with 4.

[0098] In the above, when referring to the display unit 1007 of the user terminal 300, it refers to the display unit 10 07 includes a liquid crystal display panel. The user terminal 300 is a transparent head-mounted display. In the case of play, the real space is not displayed on the display unit 1007. In the case of a head-mounted display or smartphone, the captured image of the real world and the virtual world are An image superimposed on the image in real space may be generated and displayed on the display unit 1007. The terminal 300 is a transmissive head mounted display or a non-transmissive head mounted display. In the case of a ray, the display unit 1007 may include two display panels to display a stereo image. .

[0099] The sensor group 1008 includes various sensors. The sensor group 1008 grasps the surrounding space of the user. A sensor for grasping, a sensor for grasping the user's position, posture, and hand movement, and a sensor for grasping the user's hand movement. It includes sensors to detect the user's viewpoint and line of sight. The sensors are RGB image sensors, depth sensors, etc. Sensors for detecting movement and the user's line of sight include a gyro sensor, a digital compass, These include acceleration sensors, proximity sensors, and motion tracking sensors.

[0100] ===Summary=== The virtual space payment system 10 in this embodiment is an augmented reality space or a virtual three-dimensional In a virtual reality space, which is a space, a three-dimensional object placed in an augmented reality space or virtual reality space A user can view an augmented or virtual reality space for the displayed product object. The product is selected by a selection operation by a user wearing the terminal 300 (display device). Regarding the three-dimensionally displayed payment methods available to users for paying for selected products The user interface is displayed on the display unit 1007 of the user terminal 300 (display device). a display processing unit 140 that executes processing for displaying the payment method, and a user interface for the payment method. In response to a user's selection operation, a selection is made in an augmented reality space or a virtual reality space. and a payment unit 150 that completes operations related to payment for products. Users can complete payment operations in the virtual or physical space. This can prevent the user from losing their sense of immersion in the virtual space.

[0101] In addition, in the virtual space payment system 10 of this embodiment, the settlement unit 150 Augmented reality is based on a token number (identification information) that conceals the identification code that identifies the payment method. to complete an operation related to payment for a selected product by a user in a real-world or virtual reality space. This allows users to have a secure purchasing process.

[0102] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 , for stores that allow payment by payment method in augmented reality space or virtual reality space Then, a process is executed to display the identification object U1 (predetermined identification mark). This allows users to easily find stores that accept their payment methods. This can improve user convenience.

[0103] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the image is recognized by the user terminal 300 (display device). The linear object U2 (linear object) moves according to the user's hand movement. The product overlaps or intersects with the linear object U2 (linear object). If there is a specified product object, the specified product object can be displayed by the user's pinch operation. This allows the user to get closer to the product. This improves user convenience by allowing users to view products from various angles at their fingertips without having to worry about their surroundings. .

[0104] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or virtual reality space, A display object that displays a number of related products in a predetermined display area. The plurality of display objects U4 are The plurality of display objects U4 are arranged in a direction away from the user so that they overlap at least partially. The display objects U4 are displayed in a series, and multiple display objects U5 are displayed in accordance with the user's hand movements. This executes a process to move the number of display objects U4 in the virtual space. This improves the visibility of products for users in the market. This allows for browsing of the product.

[0105] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the image is recognized by the user terminal 300 (display device). When the user pinches the selected item object, The processing for reducing and displaying the product display object U6 in a predetermined area This allows the user to select products through intuitive operations.

[0106] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the user selects the product object. The selected products that have been set as candidates for purchase by the selection operation are displayed in the product display object U 6, and each of the plurality of product display objects U7 is displayed by the user or The objects are displayed in a series around the user's avatar's body, and multiple product display objects are displayed. The product display objects U7 are moved according to the user's hand movements. This will make it easier for users to view the selected products. This can improve user convenience.

[0107] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the image is recognized by the user terminal 300 (display device). When the user moves the selected product displayed in the product display object U7 out of the specified range, In response to such an action, the selected item is removed from the list of possible purchases. This executes a process to hide the product display object U7. This allows the user to deselect the product through an intuitive operation.

[0108] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the image is recognized by the user terminal 300 (display device). A menu UI (menu) is displayed around at least one hand of the user. This executes a process to display multiple icons U8 that make up the icon object. This allows the user to easily understand the items included in the menu, This can improve convenience.

[0109] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality or virtual reality space, the menu UI (menu object) Display an indicator object U9 that indicates one of the included icons U8 The user terminal 300 (display device) recognizes the user's wrist twisting in one direction. The icon U8 indicated by the instruction object U9 is changed according to the operation. This allows the user to select menu items intuitively. do.

[0110] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 , a user interface for payment methods in an augmented reality space or a virtual reality space is displayed in the form of a card corresponding to the payment method in the real space, and In one direction, so that part of object U10 (user interface) overlaps This allows the user to perform intuitive operations. This allows users to choose their payment method.

[0111] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 , a user interface for payment methods in an augmented reality space or a virtual reality space The process to display the asset in a shape according to the asset type (in this case, object U12) This allows users to select a payment method through intuitive operations. To make.

[0112] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In an augmented reality space or a virtual reality space, a prompt is provided to prompt a user to input secret information. The settlement unit 150 executes a process to display an input object U13 indicating a lock. The information input to the input object is displayed in response to the user's hand movements, which are recognized by the display device. This allows users to make payments with intuitive operations. The payment can be executed.

[0113] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the image is recognized by the user terminal 300 (display device). A slide object U16 that slides in response to the user's hand movement is displayed. The settlement unit 150 executes the process, and the settlement unit 150 receives the user's hand data recognized by the user terminal 300 (display device). The user makes a payment based on the information entered in the slide object U16 in response to the operation of This allows users to make payments through intuitive operations. can.

[0114] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the image is recognized by the user terminal 300 (display device). Then, a process is executed to display the slide object U14 on one of the palms of the user. This allows the user to make payments through intuitive operations.

[0115] In addition, in the virtual space payment system 10 of this embodiment, the payment unit 150 Product classification, which classifies information about purchased products into one of several categories. The display processing unit 140 further includes a display unit 160, and the display processing unit 140 displays the image in the augmented reality space or the virtual reality space. , a plurality of folders corresponding to a plurality of categories are displayed, and one of the folders is displayed. In response to the user's selection operation on a folder, the cursor corresponding to the folder that accepted the selection operation is displayed. Purchased item objects (here, 3D images of clothing) are purchased items that fall into a category. This improves user operability. It is possible.

[0116] In addition, in the virtual space payment system 10 of this embodiment, the display processing unit 140 In the augmented reality space or the virtual reality space, the purchased products stored in the product classification unit 160 are Based on the information about the product object (here, 3D image data of clothing), Multiple purchase item objects (in this case, 3D image data of clothing) are stored according to the category. This allows you to check the products you are purchasing in real space. This allows the user to view the information in the same way as if they were viewing it in real time, thereby improving user convenience.

[0117] In addition, in the virtual space payment system 10 of this embodiment, the product classification unit 160 The display processing unit 140 stores information about the user's clothes, which are purchased items, and the display processing unit 140 displays the augmented reality image. In a virtual reality space or a virtual reality environment, a clothing object is visually recognized by the user. The process for displaying the image by hanging it from the drobe U19 is executed. When shopping, you can check how the clothes will coordinate with the clothes you already own. This improves user convenience. [Explanation of symbols]

[0118] 10... Virtual space payment system, 100... Wallet providing server, 200... Virtual space management management server, 300...user terminal, 400...retailer terminal.

Claims

1. a display processing unit that executes processing to display, in a three-dimensional display space that is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for a selected commodity, which is a commodity selected by a selection operation by the user, for a three-dimensionally displayed commodity object arranged in the three-dimensional display space that is the augmented reality space or the virtual reality space; a payment unit that, when receiving payment execution information for executing payment for the selected product transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected product in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected product to an e-commerce server corresponding to the selected product; the display processing unit executes a process for displaying, in the three-dimensional display space, a predetermined identification sign for a store where payment can be made by the payment means. Information processing system.

2. the payment unit completes an operation related to payment for the selected product by the user in the three-dimensional display space based on identification information obtained by concealing an identification code that identifies the payment means. The information processing system according to claim 1 .

3. A display processing unit that executes processing to display in a three-dimensional display space, which is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for selected products, which are products selected by a selection operation by the user, for three-dimensionally displayed product objects placed in the three-dimensional display space, which is an augmented reality space or a virtual reality space; and a payment unit that, when receiving payment execution information for executing payment for the selected product transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected product in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected product to an e-commerce server corresponding to the selected product; the display processing unit displays, in the three-dimensional display space, a user interface relating to the payment means in the shape of a card corresponding to the payment means in the real space, so that a plurality of the card-shaped user interfaces partially overlap each other; Execute the process to display them in a row in one direction. Information processing system.

4. A display processing unit that executes processing to display in a three-dimensional display space, which is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for selected products, which are products selected by a selection operation by the user, for three-dimensionally displayed product objects placed in the three-dimensional display space, which is an augmented reality space or a virtual reality space; a payment unit that, when receiving payment execution information for executing payment for the selected product transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected product in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected product to an e-commerce server corresponding to the selected product; the display processing unit executes processing for displaying a user interface relating to the payment means in a shape corresponding to the type of asset in the three-dimensional display space. Information processing system.

5. A display processing unit that executes processing to display in a three-dimensional display space, which is an augmented reality space or a virtual reality space, a user interface relating to payment methods available to the user for making payment for selected products, which are products selected by a selection operation by the user, for three-dimensionally displayed product objects placed in the three-dimensional display space, which is an augmented reality space or a virtual reality space; and a payment unit that, when receiving payment execution information for executing payment for the selected products transmitted from the user in response to an operation by the user on a user interface related to the payment means, completes an operation related to payment for the selected products in the three-dimensional display space by transmitting purchase information indicating that the user will purchase the selected products to an e-commerce server corresponding to the selected products; a product classification unit that classifies information about purchased products that have been paid for by the payment unit into one of a plurality of categories, the display processing unit displays a plurality of folders corresponding to the plurality of categories in the three-dimensional display space; executes a process for displaying, in response to a selection operation by the user on one of the plurality of folders, a purchase item object that is the purchase item classified into a category corresponding to the folder for which the selection operation has been accepted; Information processing system.

6. the display processing unit executes a process for combining and displaying the plurality of purchase item objects in the three-dimensional display space according to the product categories based on the information about the purchase item objects stored in the product classification unit. The information processing system according to claim 5 .

7. The product classification unit stores information about the user's clothes, which are the purchased products; and the display processing unit executes processing to display clothing objects, which are the clothes, in the three-dimensional display space by hanging them in a wardrobe so that they are visible to the user. The information processing system according to claim 6.

8. The computer Executing a process for displaying in the three-dimensional display space a user interface relating to payment methods available to the user for making payment for a selected product, which is a product selected by a selection operation by the user, for a three-dimensionally displayed product object arranged in the three-dimensional display space, which is an augmented reality space or a virtual reality space; Executing a process for displaying a predetermined identification sign for a store where payment can be made using the payment means in the three-dimensional display space; when payment execution information for executing payment for the selected products transmitted from the user in response to an operation by the user on a user interface related to the payment means is acquired, purchase information indicating that the user will purchase the selected products is transmitted to an electronic commerce server corresponding to the selected products, thereby completing an operation related to payment for the selected products in the three-dimensional display space; An information processing method that performs the above.

9. On the computer, Executing a process for displaying in the three-dimensional display space a user interface relating to payment methods available to the user for making payment for a selected product, which is a product selected by a selection operation by the user, for a three-dimensionally displayed product object arranged in the three-dimensional display space, which is an augmented reality space or a virtual reality space; Executing a process for displaying a predetermined identification sign for a store where payment can be made using the payment means in the three-dimensional display space; when payment execution information for executing payment for the selected products transmitted from the user in response to an operation by the user on a user interface related to the payment means is acquired, purchase information indicating that the user will purchase the selected products is transmitted to an electronic commerce server corresponding to the selected products, thereby completing an operation related to payment for the selected products in the three-dimensional display space; A program that executes the following.

Images