Information processing method, information processing system, information processing apparatus, and storage medium

Abstract

To provide sample objects of various designs.SOLUTION: An information processing method executed by a computer determines a design of a sample object representing an initial state in customization of a target object on the basis of an image of a reference object acquired by a predetermined method. In the terminal method, a sample object representing an initial state in customization of a target object is displayed on a display unit, and a design of the sample object is determined based on an image of a reference object acquired by a predetermined method.SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] The present invention relates to an information processing method, an information processing system, an information processing device, and a program. [Background technology]

[0002] Conventionally, there is known a technology for customizing the configuration of product parts and the like on a computer to achieve a design desired by a user (for example, Patent Document 1). In this technology, a sample object that serves as a base for customization is prepared in advance, and the user customizes the product design by making design changes to the sample object. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-85415 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the above-mentioned conventional technology, the types of sample object designs that can be provided are limited, making it difficult for users to come up with diverse customization ideas, and it takes a lot of effort to customize to the desired design.

[0005] The present invention aims to provide sample objects with a variety of designs. [Means for solving the problem]

[0006] In order to solve the above problems, an information processing method according to the present invention includes: 1. A computer-implemented information processing method, comprising: Based on an image of a reference object acquired by a predetermined method, a design of a sample object representing an initial state in customization of a target object is determined. [Effects of the Invention]

[0007] According to the present invention, sample objects with a variety of designs can be provided. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an information processing system. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of a VR server. [Figure 3] FIG. 2 is a block diagram showing a functional configuration of an EC server. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of a control device. [Figure 5] FIG. 2 is a block diagram showing the functional configuration of the VR device. [Figure 6] FIG. 1 is a diagram showing a VR screen. [Figure 7] FIG. 10 is a diagram illustrating an IF object. [Figure 8] FIG. 10 is a diagram showing a state in which a short band icon is selected. [Figure 9] FIG. 10 is a diagram showing a state in which a product object is generated in response to selection of an export button. [Figure 10] FIG. 10 is a diagram showing an image of a reference object and a sample object whose design is determined based on the image. [Figure 11] FIG. 10 is a diagram showing an image of a reference object and a sample object whose design is determined based on the image. [Figure 12] FIG. 10 is a diagram showing the proportions of colors used in a first reference object. [Figure 13] FIG. 10 is a diagram showing the color of a sample object determined based on a first reference object. [Figure 14]FIG. 10 is a diagram showing an example of generating a plurality of sample objects corresponding to a plurality of reference objects. [Figure 15] FIG. 10 is a diagram showing the proportions of colors used in a second reference object. [Figure 16] FIG. 10 is a diagram showing the colors of a first sample object and a second sample object determined based on a first reference object and a second reference object. [Figure 17] FIG. 10 is a diagram showing the total color ratio of a first reference object and a second reference object. [Figure 18] FIG. 18 is a diagram showing the color of the sample object determined based on the total value of the ratios shown in FIG. 17. [Figure 19] 10 is a flowchart showing a control procedure for customization processing. [Figure 20] FIG. 10 illustrates an example object with an indicator. [Figure 21] FIG. 1 shows a sample object displayed on a website. [Figure 22] FIG. 10 shows a sample object after an image of a reference object has been input into the website. DETAILED DESCRIPTION OF THE INVENTION

[0009] A first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing the configuration of an information processing system 1. The information processing system 1 includes a VR server 10, a plurality of control devices 20 (information processing devices), a plurality of VR devices 30 (terminal devices), and an EC server 40. The VR server 10, the control devices 20, and the EC server 40 are connected to each other via a network N, and are capable of transmitting and receiving data to and from each other. The network N may be, for example, the Internet, but is not limited to this. The information processing system 1 provides various services in a three-dimensional virtual space 2 (metaverse) (see FIG. 6) constructed by a computer to a plurality of users who use the information processing system 1. The information processing system 1 can also provide users with services that apply VR (virtual reality) in the metaverse (hereinafter referred to as "VR services"). VR is a technology that allows users to experience a virtual world constructed in the virtual space 2 as if it were reality. In addition, a user of the information processing system 1 can purchase (acquire) a product object 70 (target object) (see Figure 9) in the virtual space 2 customized by the user, or a product in the real world with the same design as the product object 70, on the website of the EC (electronic commerce) service provided by the EC server 40.

[0010] Each user of the information processing system 1 uses one control device 20 and one VR device 30. The control device 20 and the VR device 30 are connected to each other so that data can be transmitted and received wirelessly. The VR device 30 includes a VR headset 31 (head-mounted device) worn by the user and a controller 32. The VR device 30 detects the user's movements and input operations using the VR headset 31 and the controller 32 and transmits the detection results to the control device 20. The control device 20 transmits data such as a VR screen 3151 (see FIG. 6) of the virtual space 2 and audio in response to the user's movements and input operations detected by the VR device 30, causing the VR headset 31 to display the VR screen 3151 and output audio. In this way, VR is realized by displaying the VR screen 3151 of the virtual space 2 on the VR headset 31 in real time and outputting audio in response to the user's movements and input operations. In the virtual space 2, a character called an avatar 3 (see FIGS. 8 and 9) acts on behalf of the user. In other words, the VR screen 3151 of the virtual space 2 as seen from the viewpoint of the avatar 3 is displayed on the VR headset 31 in real time.

[0011] As shown in Fig. 2, the VR server 10 includes a CPU 11 (Central Processing Unit), a RAM 12 (Random Access Memory), a storage unit 13, and a communication unit 14. Each unit of the VR server 10 is connected via a data transmission path such as a bus. The VR server 10 acquires and manages various data required to provide VR services, and transmits the data to multiple control devices 20 as needed.

[0012] The CPU 11 is a processor that controls the operation of each part of the VR server 10 by reading and executing a program 131 stored in the storage unit 13 and performing various arithmetic processing. The VR server 10 may have multiple processors (for example, multiple CPUs), and the multiple processes executed by the CPU 11 of this embodiment may be executed by these multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel. The RAM 12 provides a working memory space for the CPU 11 and stores temporary data.

[0013] The storage unit 13 is a non-transitory recording medium readable by the CPU 11 as a computer, and stores a program 131 and various data. The storage unit 13 includes a non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). The program 131 is stored in the storage unit 13 in the form of computer-readable program code. Data stored in the storage unit 13 includes object data 132 and user management data 133. The object data 132 includes information such as the position and appearance of each object in the virtual space 2. Here, an object is any physical object placed in the virtual space 2, including an avatar 3. The user management data 133 includes attributes of each user, information related to the avatar 3 used by each user, and information related to product objects 70 purchased by each user.

[0014] The communication unit 14 performs a communication operation in accordance with a predetermined communication standard. The communication unit 14 transmits and receives data to and from the control device 20 via the network N through this communication operation.

[0015] As shown in FIG. 3 , the EC server 40 includes a CPU 41, a RAM 42, a storage unit 43, and a communication unit 44. The EC server 40 acquires and manages various data necessary for providing EC services and transmits it to the control device 20 as needed. The CPU 41 is a processor that reads and executes a program 431 stored in the storage unit 43 and controls the operation of each unit of the EC server 40 by performing various arithmetic processing. The RAM 42 provides a working memory space for the CPU 41 and stores temporary data. The storage unit 43 is a non-transitory recording medium readable by the CPU 41 as a computer and stores the program 431 and various data. The storage unit 43 includes a non-volatile memory such as an HDD or SSD. The communication unit 44 performs communication operations in accordance with a predetermined communication standard. Through this communication operation, the communication unit 44 transmits and receives data between the VR server 10 and the control device 20 via the network N.

[0016] 4, the control device 20 includes a CPU 21 (processing unit), a RAM 22, a storage unit 23, an operation input unit 24, a display unit 25, and a communication unit 26. The components of the control device 20 are connected via a data transmission path such as a bus. The control device 20 is, for example, a notebook PC or a desktop PC, but is not limited to these and may also be a tablet terminal, a smartphone, or the like.

[0017] The CPU 21 is a processor that reads and executes a program 231 stored in the storage unit 23 and performs various arithmetic processing to control the operation of each unit of the control device 20. The control device 20 may have multiple processors (e.g., multiple CPUs), and the multiple processes performed by the CPU 21 of this embodiment may be executed by these multiple processors. In this case, the multiple processors constitute a "processing unit." In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel. The RAM 22 provides a working memory space for the CPU 21 and stores temporary data.

[0018] The storage unit 23 is a non-transitory recording medium readable by the CPU 21 as a computer, and stores a program 231 and various data. The storage unit 23 includes a non-volatile memory such as an HDD or SSD. The program 231 is stored in the storage unit 23 in the form of computer-readable program code. The program 231 includes a web browser 2311. The web browser 2311 is a program for displaying a website such as an EC site provided by the EC server 40 on the display unit 25. Data stored in the storage unit 23 includes object data 232, etc. The object data 232 is data received from the VR server 10 and stored in the storage unit 23, and includes data that is identical to at least a portion of the object data 132 of the VR server 10.

[0019] The operation input unit 24 accepts input operations from the user and outputs an input signal corresponding to the input operation to the CPU 21. The operation input unit 24 includes input devices such as a keyboard, a mouse, and a touch panel. The display unit 25 displays to the user information related to the processing contents and various statuses of the control device 20, as well as various websites including EC sites. The display unit 25 includes a display device such as a liquid crystal display. The communication unit 26 performs communication operations in accordance with a predetermined communication standard. Through this communication operation, the communication unit 26 transmits and receives data to and from the VR server 10 and the EC server 40 via the network N. The communication unit 26 also transmits and receives data to and from the VR device 30 via wireless communication.

[0020] As shown in Fig. 5, the VR device 30 includes a VR headset 31, a controller 32 for the right hand, and a controller 32 for the left hand. The two controllers 32 are connected to the VR headset 31 wirelessly or via a wire so as to be able to communicate data. The VR headset 31 is used by being worn on the user's head. The controller 32 is used by being worn or held by the user's hand. The controller 32 corresponds to the "input unit."

[0021] The VR headset 31 includes a CPU 311, a RAM 312, a storage unit 313, an operation input unit 314, a display unit 315, a sound output unit 316, a sensor unit 317, and a communication unit 318. The various units of the VR headset 31 are connected via a data transmission path such as a bus. The CPU 311 is a processor that controls the operation of the various units of the VR headset 31 by reading and executing a program 3131 stored in the storage unit 313 and performing various arithmetic processing. The RAM 312 provides a working memory space for the CPU 311 and stores temporary data. The storage unit 313 is a non-transitory recording medium readable by the CPU 311 as a computer, and stores the program 3131 and various data. The operation input unit 314 includes various switches, buttons, etc., accepts input operations from the user, and outputs input signals corresponding to the input operations to the CPU 311. The operation input unit 314 corresponds to the "input unit." The display unit 315 displays images visible to the user wearing the VR headset 31. The display unit 315 includes a liquid crystal display, an organic EL display, or the like, located in a position visible to the user wearing the VR headset 31. Image data of images displayed by the display unit 315 is transmitted from the control device 20 to the VR headset 31. The display unit 315 displays images based on the received image data under the control of the CPU 311. The sound output unit 316 outputs various sounds that are perceived by the ears of the user wearing the VR headset 31 under the control of the CPU 311. The sensor unit 317 detects the movement and orientation of the head of the user wearing the VR headset 31. The sensor unit 317 includes, for example, a triaxial acceleration sensor that detects acceleration in three orthogonal axial directions, a triaxial gyro sensor that detects angular velocity around three orthogonal axes, and a triaxial geomagnetic sensor that detects geomagnetism in three orthogonal axial directions. The CPU 311 derives the movement and orientation of the user's head based on the acceleration data, angular velocity data, and geomagnetic data received from the sensor unit 317. The sensor unit 317 is capable of receiving the user's movement and direction as user operation, and corresponds to an “input unit.” The communication unit 318 performs communication operations in accordance with a predetermined communication standard.Through this communication operation, the communication unit 318 transmits and receives data between the controller 32 and the control device 20 via wireless communication.

[0022] The controller 32 includes a CPU 321 that controls the overall operation of the controller 32, a RAM 322 that provides working memory space for the CPU 321, a storage unit 323 that stores programs and data necessary for executing the programs, an operation input unit 324, a sensor unit 325, and a communication unit 326 that communicates data with the VR headset 31. The operation input unit 324 (input unit) includes various switches, buttons, operation keys, etc., and receives input operations from the user and outputs input signals corresponding to the input operations to the CPU 321. The operation input unit 324 may also be capable of separately detecting the movements of each of the user's fingers. The sensor unit 325 includes a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor, and detects the movement and orientation of the user's hand holding or wearing the controller 32. The configuration and operation of the sensor unit 325 may be similar to, for example, the sensor unit 317 of the VR headset 31.

[0023] The configuration of the VR device 30 is not limited to the above. For example, the VR device 30 may further include an auxiliary sensor device that is not held or worn by the user. This sensor device may be, for example, a device that is installed on the floor or the like and optically detects the user's movements or the movements of the VR headset 31 and the controller 32 by laser scanning or the like. Furthermore, in cases where there is no need to detect the movements of both hands separately, one of the controllers 32 may be omitted. Furthermore, in cases where the VR headset 31 is capable of detecting the necessary user movements and input operations, the controller 32 may be omitted.

[0024] Next, the operation of the information processing system 1 will be described. In the following description, the subject of operation is the CPU 11 of the VR server 10, the CPU 21 of the control device 20, the CPU 311 of the VR headset 31, the CPU 321 of the controller 32, or the CPU 41 of the EC server 40. However, for convenience of explanation, the VR server 10, the control device 20, the VR headset 31, the controller 32, or the EC server 40 may be referred to as the subject of operation. Furthermore, the user's movements and input operations detected by the VR device 30 will be collectively referred to as "user operations" below. That is, in this embodiment, "user operations" includes input operations detected by the operation input unit 314 of the VR headset 31 and the operation input unit 324 of the controller 32, and operations detected by the sensor unit 317 of the VR headset 31 and the sensor unit 325 of the controller 32. Furthermore, the following description will mainly focus on the image display operation of the VR headset 31, and will omit descriptions of other operations such as sound output.

[0025] When a user starts using the VR service provided by the information processing system 1, the user puts on the VR headset 31 and controller 32 of the VR device 30 and performs a predetermined operation to start the VR service. In response to this operation, user authentication information is sent from the control device 20 to the VR server 10, and when the user is authenticated by the VR server 10, the authentication result is returned from the VR server 10 to the control device 20, and the provision of the VR service to the authenticated user begins.

[0026] When the VR service starts, the control device 20 downloads object data 232 required for displaying the virtual space 2 from the VR server 10 and stores it in the storage unit 23. Based on the object data 232, the control device 20 generates image data of the virtual space 2 seen from the viewpoint of the avatar 3 and starts transmitting it to the VR headset 31 of the VR device 30. Based on the received image data, the VR headset 31 starts displaying a VR screen 3151 of the virtual space 2 shown in FIG. 6 on the display unit 315.

[0027] In this embodiment, an example will be described in which a user and his / her avatar 3 receive services in a virtual shop 200 for watches provided in the virtual space 2 shown in FIG. 6 . The virtual shop 200 customizes and sells a product object 70 (target object) of a watch. The VR screen 3151 includes an image that represents the interior of the virtual shop 200 in three dimensions. An IF object 50 (interface object) and pedestals 201 and 202 are provided inside the virtual shop 200. A sample object 60 is placed in the space above the pedestal 201. As will be described later, a user can place a reference object 80 in the space above the pedestal 202. The position, orientation, color, shape, etc. of each object in the virtual shop 200 are determined based on information in the object data 232. The IF object 50 and the sample object 60 are one aspect of customization objects used to customize a target object in the virtual space 2.

[0028] The IF object 50 is an interface operated by the avatar 3 to customize the design of the watch product object 70. The sample object 60 is an object that is an enlarged model of the watch product object 70. The sample object 60 represents the customization details of the product object 70 performed by the IF object 50. The sample object 60 is designed to reflect the customization details performed by the avatar 3 in real time. The sample object 60 and the product object 70 have multiple parts (components) in common. The multiple parts include a bezel 61, a face 62, a short band 63, a long band 64, a keeper ring 65, and a buckle 66 (see Figures 8 and 9 for all of these).

[0029] When the virtual store service starts, the VR device 30 starts detecting user operations and continuously transmits the detection results to the control device 20. The control device 20 controls the movement of the avatar 3 in the virtual store 200 (virtual space 2) in response to the received user operations. That is, the control device 20 converts the received user operations into movements of the avatar 3 in the virtual store 200 and determines and updates the position, orientation, posture, etc. of the avatar 3 in the virtual store 200 in real time. The control device 20 then generates image data of the virtual store 200 viewed from the viewpoint of the avatar 3 in the updated position and orientation, and transmits the image data to the VR headset 31. This image data generation and transmission are repeated at a predetermined frame rate. The display unit 315 of the VR headset 31 displays a VR screen 3151 at the above frame rate based on the received image data of the virtual store 200. This allows the user wearing the VR headset 31 to view the virtual store 200 in real time from the viewpoint of the avatar 3 moving and moving within the virtual store 200 in response to the user's operations. In addition, the control device 20 transmits information such as the position, orientation, and posture of the avatar 3 to the VR server 10.

[0030] The following describes operations related to customizing a product object. As shown in FIG. 6, in the virtual store 200, a virtual line L extends from the fingertip of the right hand 3R of the avatar 3, and a pointer P is generated at the intersection of the virtual line L and the object. By performing a predetermined operation with the pointer P aligned with the position of a desired target, the user can select an object in the virtual store 200. When the user wants to customize the design of a product object, the user uses the pointer P to operate the IF object 50 by moving the avatar 3. As shown in FIG. 7, the IF object 50 is a board-shaped object resembling a signboard. The IF object 50 is provided with an object selection IF 51, a color selection IF 52, and an export button 53.

[0031] The target selection IF 51 is an interface for selecting a part to be customized from among a plurality of parts constituting the product object 70. The target selection IF 51 of this embodiment includes a bezel icon 511, a face icon 512, a short band icon 513, a long band icon 514, a keeper ring icon 515, and a buckle icon 516 for selecting the bezel 61, the face 62, the short band 63, the long band 64, the keeper ring 65, and the buckle 66, respectively, as targets for customization. Each of the icons 511 to 516 can be selected using the pointer P described above. In the example shown in FIG. 7, the selected icon (here, the bezel icon 511) is surrounded by a frame.

[0032] The color selection IF52 is an interface for specifying the color of the part selected by the target selection IF51. The color selection IF52 includes a plurality of color palettes 521 corresponding to one of a plurality of different colors. Each color palette 521 can be selected using the pointer P described above. The type of color palette 521 included in the color selection IF52 may be switched according to the icon selected from the icons 511 to 516 of the target selection IF51. With one of the icons 511 to 516 selected in the target selection IF51, the color of the part corresponding to the icon 511 to 516 can be changed by selecting one of the color palettes 521 of the color selection IF52. The change in the color of the part is reflected in real time in the sample object 60.

[0033] In a default state, the sample object 60 is positioned so that the face 62 displaying the time faces a predetermined front direction of the virtual store 200. For example, when the avatar 3 selects the short band icon 513 from this state, the sample object 60 rotates so that the short band 63 faces forward, as shown in FIG. 8. The same applies when another icon is selected. Also, in FIG. 8, when the short band icon 513 is selected, the color palette 521 is selected, and the color of the short band 63 is specified as yellow. Accordingly, the color of the short band 63 of the sample object 60 is colored yellow. For ease of explanation, FIG. 8 (and FIG. 9 as well) shows a third-person perspective screen 3152 that displays the inside of the virtual store 200 from a third-person perspective different from the perspective of the avatar 3.

[0034] By repeating the operations of the object selection IF51 and the color selection IF52, the color of each part of the sample object 60 can be changed to customize the design. While FIGS. 7 to 9 illustrate a method for customizing the color of a part, other design elements of each part, such as the shape, may also be customized using a similar method. For shape customization, a shape selection IF (not shown) for selecting a shape may be displayed in addition to the color selection IF52. After customizing the design as described above, the avatar 3 selects the export button 53, whereby a product object 70 with a design reflecting the customization content is generated in the virtual space 2. Specifically, when the export button 53 is selected, a product object 70 with the same design as the sample object 60 at that time is generated near the export button 53 and displayed (output), as shown in FIG. 9.

[0035] The object data 232 received from the VR server 10 includes image data of customization details that can be selected for each part of the product object 70 in advance. Each part of the product object 70 may be a reduced version of each part of the sample object 60, and the image data of each part of the product object 70 and the sample object 60 may be shared. The control device 20 generates image data of the entire product object 70 by combining image data of the "shape" and "color" of each part specified by customization using the IF object 50, and transmits the image data to the VR device 30 for display. Alternatively, the VR server 10 that receives data representing the customization details may generate image data of the product object 70 with the customization details specified by the data, and transmit the image data to the control device 20.

[0036] The generated product object 70 is held or attached to a predetermined part of the avatar 3 when the avatar 3 performs a predetermined movement. When the avatar 3 holding or wearing the product object 70 moves in the virtual space 2, the position and orientation of the product object 70 in the virtual space 2 follow the position and orientation of the part of the avatar 3 where the product object 70 is attached.

[0037] The generated product object 70 can be held or worn by the avatar 3, and the avatar 3 can be made to perform a predetermined action (for example, pressing a purchase button at a purchase counter (not shown) in the virtual store 200) to start a purchase procedure for purchasing (obtaining) the product object 70 or a real-world watch that has been customized in the same way as the product object 70. When the product object 70 is purchased, the product object 70 is assigned to the user's avatar 3. That is, the purchased product object 70 is associated with the user and registered in the user management data 133. When the real-world watch is purchased, the product is delivered to the user's address in the real world. The purchase procedure is performed by the control device 20 as a client terminal and the EC server 40. For example, when the purchase procedure is started, the web browser 2311 of the control device 20 is launched, and a website for purchasing the product is displayed on the display unit 25. In response to the purchase procedure (input operation) performed by the user on the website, the EC server 40 executes a process for purchasing the product object 70 or the real product.

[0038] Next, an operation relating to adjusting the design of the sample object 60 in its initial state will be described. Typically, in the initial state of the sample object 60 (in other words, the design of the sample object 60 representing the initial state in customization), each part is white, and each part is changed to a desired color in accordance with the customization operation performed by the avatar 3. However, customizing the color of all parts from white is time-consuming for the user. In response to this, it is also conceivable to set the sample object 60 in its initial state to a predetermined sample color scheme. However, the sample color scheme is not necessarily close to the user's preference, and if it is far from the user's preference, it may actually be more difficult to customize than if it were white.

[0039] Therefore, in the information processing system 1 of this embodiment, an image of the reference object 80 designated by the user is acquired by a predetermined method, and the design of the sample object 60 representing the initial state of customization (the design of the sample object 60 in the initial state) is determined based on this image. In this embodiment, the reference object 80 is a different type of article (item type) from the sample object 60 and the product object 70. In the examples shown in FIGS. 6 and 10, the article of the reference object 80 is a T-shirt, which is different from the article (watch) of the sample object 60 and the product object 70.

[0040] The user can place the reference object 80 on the pedestal 202 (a predetermined position in the virtual space 2) by performing a predetermined user operation while the avatar 3 is positioned near the pedestal 202. Data of the reference object 80 is registered in advance in the object data 132, 232 using a predetermined method, and is also registered in the user management data 133 in association with the user. The reference object 80 is, for example, a three-dimensional object in the virtual space 2, but may also be a two-dimensional object. The reference object 80 placed on the pedestal 202 is virtually photographed by a virtual camera (not shown) provided in the virtual space 2, and photographed image data is generated. The photographed image data may be two-dimensional image data obtained by photographing the reference object 80 from the position of the virtual camera, or may be three-dimensional image data from which the three-dimensional structure of the reference object 80 can be identified. The control device 20 acquires this photographed image data and also acquires an image of the reference object 80 included in the photographed image data. For example, in the case of two-dimensional photographed image data, the control device 20 identifies the outline of the reference object 80 in the photographed image data by a predetermined image recognition process, and acquires an image of the reference object 80 by trimming a portion of the reference object 80. Furthermore, the control device 20 identifies a plurality of components that make up the reference object 80 by this image recognition process. The plurality of components may include a plurality of parts (components) of the reference object 80, or may include a portion or pattern of the reference object 80.

[0041] The control device 20 identifies the color scheme of the reference object 80 by subjecting the acquired image to predetermined image processing. The control device 20 determines the color of each of the multiple parts constituting the sample object 60 based on the color scheme of the reference object 80. Specifically, the control device 20 identifies the color of each component of the reference object 80. Then, when the reference object 80 has multiple components corresponding to the multiple parts of the sample object 60, the control device 20 may determine the color of each component so that the color of each part of the sample object 60 matches the color of one of the components of the reference object 80. The correspondence between the parts of the sample object 60 and the components of the reference object 80 may be determined based on at least one of the shape, size, and arrangement of the multiple components of the reference object 80. In the example shown in FIG. 10 , a collar component 81 having a ring shape is associated with a bezel 61 that also has a ring shape. Furthermore, a torso component 82 that is located in the most eye-catching position and has a large area is associated with a face 62 that is also located in the most eye-catching position and has a large area. Furthermore, sleeve elements 83 and 84, each having a shape that protrudes from the main portion, correspond to short band 63 and long band 64, respectively, which also have shapes that protrude from the main portion. Furthermore, pattern elements 85 and 86, each occupying a relatively small area in the reference object 80, correspond to keeper ring 65 and buckle 66, each occupying a relatively small area in the sample object 60. According to these correspondences, the color scheme of the sample object 60 is determined so that the colors of the bezel 61, face 62, short band 63, long band 64, keeper ring 65, and buckle 66 of the sample object 60 are the colors of the corresponding elements 81 to 86 in the reference object 80, respectively. The determined color information is reflected in the design information of the sample object 60 in the object data 232. Therefore, by placing the reference object 80 on the pedestal 202, the color scheme of the sample object 60 in the virtual store 200 is changed to the color scheme corresponding to the reference object 80.

[0042] Furthermore, when a lion reference object 80 shown in FIG. 11 is placed on the pedestal 202, the correspondence between the multiple components of the reference object 80 and the multiple parts of the sample object 60 can be determined, for example, as follows. That is, the mane component 81, which has a ring shape, is associated with the bezel 61, and the facial component 82, which is located in the most eye-catching position and has the largest area, is associated with the face 62. Furthermore, the components 83 to 86 of the front legs, hind legs, ears, and tail are associated with the short band 63, long band 64, sling 65, and buckle 66, respectively. In accordance with these correspondences, the color scheme of the sample object 60 is determined so that the colors of the bezel 61, face 62, short band 63, long band 64, sling 65, and buckle 66 of the sample object 60 match the colors of the corresponding components 81 to 86 in the reference object 80, respectively. Note that the object correspondences shown in FIGS. 10 and 11 are merely examples, and correspondences may be established according to other rules. Furthermore, the correspondence between the parts of the sample object 60 and the components of the reference object 80 may be determined in advance for each type of item of the reference object 80 and registered in the storage unit 23 as table data.

[0043] The reference object 80 may be the avatar 3. When the avatar 3 is used as the reference object 80, the avatar 3 may be moved onto the pedestal 202. By moving the avatar 3 onto the pedestal 202, the avatar 3 is photographed by the virtual camera, and an image of the avatar 3 is acquired as an image of the reference object.

[0044] In cases where it is not possible to associate the constituent elements of the reference object 80 with parts of the sample object 60, the color of each part of the sample object 60 may be determined based on the proportion of multiple colors used in the reference object 80. For example, a case will be described in which the colors and their proportions (area ratios) used in a certain first reference object are as shown in FIG. 12 . The colors used in this first reference object are blue most frequently, followed by white, light blue, yellow, black, gray, and navy blue. The proportions of each color are as shown in FIG. 12 . In this case, as shown in FIG. 13 , the color of each part may be determined so that the higher the priority of a part in the sample object 60, the greater the proportion of that color in the first reference object. Here, the priority of each part is, from highest to lowest, the bezel 61, face 62, short band 63, long band 64, keeper ring 65, and buckle 66. The colors assigned to the parts arranged in this order are blue, white, light blue, yellow, black, and gray, respectively, in descending order of their proportions. The priority of parts is higher for parts located closer to the front (visible side) of the product object 70 corresponding to the sample object 60 in normal use (i.e., parts that are more likely to catch the user's eye through the avatar 3). However, the method of determining the priority is not limited to this. For example, the priority of each part may be set differently depending on the type of appearance (human, non-human, animal, etc.) of the avatar 3 when the sample object 60 is customized or when the reference object 80 is placed on the pedestal 202. Specifically, if the type of avatar 3 is human, the bezel 61 may be given the highest priority, but if the type of avatar 3 is a robot, which is a type of non-human, the face 62 may be given the highest priority. The type of avatar 3 is identified based on images captured by a virtual camera installed in the virtual space 2, similar to the acquisition of image data including the reference object 80.

[0045] A user may input a plurality of different reference objects 80 (i.e., placeable on the pedestal 202). A plurality of pedestals 202 for placing a plurality of reference objects 80 may be provided in the virtual store 200. The plurality of reference objects 80 may be different types of articles (items). When a plurality of reference objects 80 are placed, the control device 20 may determine designs of a plurality of different sample objects 60 corresponding to the plurality of reference objects 80 based on a plurality of images of the plurality of reference objects 80, and display these plurality of sample objects 60 in the virtual space 2 (i.e., on the display unit 315 of the VR headset 31). For example, as shown in FIG. 14, when the two reference objects 80 shown in FIGS. 10 and 11 are placed on the pedestal 202, the two sample objects 60 shown in FIGS. 10 and 11 are generated on the pedestal 201 accordingly. Furthermore, when a second reference object having a color scheme with the proportions shown in FIG. 15 is installed on the base 202 in addition to the first reference object having the color scheme with the proportions shown in FIG. 12, a first sample object whose color scheme is determined based on the first reference object and a second sample object whose color scheme is determined based on the second reference object may be generated and displayed as shown in FIG. 16. For the first sample object, the color of each component is determined so that the higher the priority of the component, the greater the proportion of that component in the first reference object. For the second sample object, the color of each component is determined so that the higher the priority of the component, the greater the proportion of that component in the second reference object. Note that, as shown in FIG. 15, if the number of colors used in the second reference object (five colors) is less than the number of components in the sample object 60 (six), the colors of components with priorities lower than the number of colors may be set to a predetermined default color (e.g., white). In the example shown in FIG. 16, the color of the buckle 66, which has the sixth priority in the second sample object, is white.Furthermore, if the number of colors used in the second reference object (five colors) is less than the number of parts (six) of the sample object 60, a color obtained by changing the lightness (brightness of the color) and / or saturation (vividness of the color) of one of the colors used in the second reference object (e.g., the color with the highest proportion) without changing the hue (color tone) may be set for the part (buckle in FIG. 16). This can also be applied when a single reference object 80 is placed on the base 202.

[0046] Alternatively, the design of a single sample object 60 may be determined based on multiple images of multiple reference objects 80. In this case, the first and second methods for determining the color of each component are described below. The first method determines the color of each component based on the overall color ratio of the multiple reference objects 80. Specifically, the values ​​of the ratios of multiple colors used in each of the multiple reference objects 80 are summed for each color across the multiple reference objects. For example, as shown in FIG. 17 , when the first and second reference objects are installed, the ratio of blue in the first reference object (0.35) and the ratio of blue in the second reference object (0.19) are summed to calculate a total value of 0.54. This process is performed for each color, and the colors are sorted in descending order of their total value. Then, as shown in FIG. 18 , the color of each component may be determined by assigning colors to components in the sample object 60 in descending order of priority, starting with the component with the highest total value.

[0047] The second method is a method of determining the priority of multiple reference objects 80 using a predetermined determination method, and determining the color of each part of the sample object 60 so that the color of the reference object 80 with a higher priority is used preferentially. For example, the size (maximum length) of each reference object 80 may be identified, and the priority of each reference object 80 may be determined based on the size. In this case, the larger the size, the higher the priority of the reference object 80. Also, the object types of the multiple reference objects 80 may be identified, and the priority of each reference object 80 may be determined based on the object type. For example, the priority of a reference object 80 whose object type is a person (including the avatar 3) may be lower than the priority of a reference object 80 whose object type is an item other than a person (e.g., accessories such as clothing). Also, when there are multiple reference objects 80 related to multiple different types of items, the priority of the reference objects 80 may be determined according to the priority of the items. For example, when multiple different types of items are all clothing, an item worn closer to the wearing site (i.e., the wrist) of the watch, which is the item to be customized, may be given a higher priority. Therefore, if the different types of items are a top and a bottom of clothing, the top may be given a higher priority. Also, if the object types of two or more reference objects 80 are all avatars 3, the priority may be determined according to the characteristics of the avatars 3. The characteristics of the avatars 3 may be, for example, the type of appearance (human, non-human, animal), size (height, body length), gender, age, etc.

[0048] In the second method, the color of the highest priority part (bezel 61) may be determined from the colors of the highest priority reference objects 80, and the color of the lowest priority part (buckle 66) may be determined from the colors of the lowest priority reference objects 80. As for the colors of parts with intermediate priorities, the colors of parts with relatively high priorities may also be determined from the colors of reference objects 80 with relatively high priorities.

[0049] Next, a description will be given of the customization process executed by the CPU 21 of the control device 20 to realize the above-mentioned operations. Fig. 19 is a flowchart showing the control procedure of the customization process. The customization process is started when an avatar 3 that will perform an action related to customization is identified (for example, when the user's avatar 3 enters the virtual store 200).

[0050] When the customization process starts, the CPU 21 of the control device 20 determines whether or not a user operation to input the reference object 80 has been performed (step S101). In this embodiment, the CPU 21 determines whether or not a user operation to move the avatar 3 near the pedestal 202 and place the reference object 80 on the pedestal 202 has been performed. If it is determined that a user operation to input the reference object 80 has been performed ("YES" in step S101), the CPU 21 acquires an image of the reference object 80 from the virtual camera and performs image processing on the image to identify the color scheme of the reference object 80 and the components of the reference object 80 (step S102).

[0051] The CPU 21 determines whether multiple components of the reference object 80 correspond to multiple parts of the sample object 60 (step S103). If it is determined that multiple components correspond to multiple parts ("YES" in step S103), the CPU 21 determines the color scheme of the sample object 60 so that the color of each part of the sample object 60 matches the color of one of the components of the reference object 80, using the method described above with reference to FIGS. 10 and 11 (step S104). On the other hand, if it is determined that multiple components do not correspond to multiple parts ("NO" in step S103), the CPU 21 determines the color of each part of the sample object 60 based on the proportion of colors used in the sample object 60, using the method described above with reference to FIGS. 12 to 18 (step S105). When step S104 or S105 is completed, the CPU 21 reflects the determined color of the part in the sample object 60 (step S106). That is, the CPU 21 reflects the determined color information of the part in the design information of the sample object 60 in the object data 232, and changes the color scheme of the sample object 60 to the determined color scheme. That is, the sample object 60 with the changed color scheme is displayed on the display unit 315 of the VR headset 31.

[0052] When step S106 is completed, or when it is determined in step S101 that a user operation to input the sample object 60 has not been performed ("NO" in step S101), the CPU 21 determines whether or not an operation on the IF object 50 by the avatar 3 has been started (step S107). For example, the CPU 21 determines that an operation on the IF object 50 has been started when the avatar 3 selects any icon of the target selection IF 51 of the IF object 50. When it is determined that the operation has not been started ("NO" in step S107), the CPU 21 returns the process to step S101. When it is determined that the operation has been started ("YES" in step S107), the CPU 21 causes the sample object 60 to reflect customization (color change) corresponding to the operation each time the avatar 3 performs an operation on the IF object 50 (step S108). The CPU 21 determines whether the export button 53 has been selected (step S109), and if it determines that the export button 53 has been selected ("YES" in step S109), it generates and displays a product object 70 that reflects the customization content of the sample object 60 at that time (step S110). When step S110 is completed or if it determines that the export button 53 has not been selected ("NO" in step S109), the CPU 21 determines whether the customization by the avatar 3 has been completed (step S111). For example, the CPU 21 determines that the customization has been completed when the avatar 3 has left the virtual store 200. When it determines that the customization has not been completed ("NO" in step S111), the CPU 21 returns the process to step S108, and when it determines that the customization has been completed ("YES" in step S111), it terminates the customization process.

[0053] Next, a first modification of the first embodiment will be described. Differences from the above embodiment will be described below, and a description of configurations common to the above embodiment will be omitted (the same applies to the second and third modifications described below). In the above embodiment, the colors of the parts of the sample object 60 are changed based on the image of the reference object 80. In addition, the arrangement of the multiple color palettes 521 in the color selection IF 52 of the IF object 50, i.e., the types of colors and their arrangement order, may be changed based on the image of the reference object 80. For example, the types of colors in the color palette 521 may be the types of colors used in the reference object 80. Furthermore, the order of the colors in the color palette 521 may be in descending order of the proportion of the colors in the reference object 80.

[0054] Next, Modification 2 of the first embodiment will be described. Modification 2 may be combined with Modification 1. In the above embodiment, the color of the parts of the sample object 60 is changed based on the image of the reference object 80. However, in addition to or instead of this, the shape of the parts of the sample object 60 may be changed based on the image of the reference object 80. Specifically, the shape of at least one of the multiple parts constituting the sample object 60 may be determined based on at least one of the shape, size, and arrangement of each of the multiple components constituting the reference object 80. For example, if the reference object 80 has a rod-shaped component, the sample object 60 may be changed from a digital clock to an analog clock, and the shape of the hands may be changed to the shape of the rod-shaped component. Furthermore, in the first embodiment, the sample object 60 of a digital clock is exemplified as having an octagonal face 62 and a bezel 61 surrounding the face 62, but this is not limited thereto. For example, the face 62 of a digital clock or the bezel 61 surrounding the face 62 may be deformed into a substantially circular shape (a circular shape with a portion of the arc being a straight line is also considered to be a substantially circular shape here) based on the image of the reference object 80. Furthermore, when the face 62 is changed into a substantially circular shape, an indicator 621 (e.g., a substantially circular shape) indicating the time or the passage of time in a stopwatch function may be provided in a portion of the inner area of ​​the face 62 (the area displaying the date, time, etc.) as shown in FIG. 20 . The indicator 621 may be one or more. The reference object 80 for changing into a substantially circular face 62 may have characteristics such as including a predetermined number or more substantially circular parts, including deformed characters or objects (clothing, accessories, etc.) used in illustrations, animation, etc.

[0055] Next, a third modification of the first embodiment will be described. The third modification may be combined with the first modification and / or the second modification. In the above embodiment, the CPU 21 of the control device 20 executes the process of determining the design of the sample object 60, but instead, the CPU 11 of the VR server 10 may execute the process. In this modification, the VR server 10 corresponds to the information processing device, and the CPU 11 of the VR server 10 corresponds to the processing unit.

[0056] As described above, in the information processing method according to the first embodiment, the CPU 21 determines the design of the sample object 60 representing the initial state in customization of the product object 70, based on the image of the reference object 80 acquired by a predetermined method. This allows a variety of reference object 80 designs to be reflected in the design of the sample object 60. Therefore, it is possible to provide sample objects 60 with a variety of designs. Furthermore, by using the image of the reference object 80 specified by the user, it is possible to generate a sample object 60 with a color scheme that suits the user's preferences. Therefore, customization can be started from a color scheme that suits the user's preferences, making it easier to perform intended customization and reducing the effort required for customization.

[0057] Furthermore, the type of object of the reference object 80 is different from the type of object of the product object 70. This allows a wider variety of designs of the reference object 80 to be reflected in the design of the sample object 60, making it possible to provide sample objects 60 with a wider variety of designs.

[0058] Furthermore, the CPU 21 determines the color of each of the multiple parts that make up the sample object 60 based on the color scheme of the reference object 80 in the image. This makes it possible to generate a sample object 60 that has a color scheme that corresponds to the color scheme of the reference object 80.

[0059] Furthermore, the CPU 21 determines the color of each of the multiple parts that make up the sample object 60 based on at least one of the shape, size, and arrangement of each of the multiple components that make up the reference object 80, and the color of each of the multiple components. This allows the color of each part of the sample object 60 to be the color of the corresponding component in the reference object 80. Therefore, it is possible to generate a sample object 60 that has an appearance similar to that of the reference object 80 due to its color scheme.

[0060] Furthermore, in Modification 2, CPU 21 determines the shape of at least one of the multiple parts that make up sample object 60, based on at least one of the shape, size, and arrangement of each of the multiple components that make up reference object 80. This makes it possible to generate sample object 60 whose appearance, based on the shape of the parts, is similar to that of reference object 80.

[0061] Furthermore, the CPU 21 may determine designs of a plurality of different sample objects 60 corresponding to a plurality of different reference objects 80 based on a plurality of images relating to the plurality of different reference objects 80, and display the plurality of sample objects 60 on the display unit 315. This makes it possible to present to the user a plurality of sample objects 60 that can serve as candidates for the base of customization.

[0062] Furthermore, the CPU 21 may determine the design of one sample object 60 based on a plurality of images relating to a plurality of different reference objects 80. This makes it possible to generate sample objects 60 with a wider variety of designs.

[0063] Furthermore, the CPU 21 may add up the values ​​of the proportions of the multiple colors used in each of the multiple reference objects 80 for each color, and determine the color of each of the multiple parts that make up the sample object 60 based on the total value for each color. This makes it possible to generate a sample object 60 with a design that reflects the impression given by the multiple reference objects 80 as a whole.

[0064] Furthermore, the CPU 21 may determine the priorities of the multiple reference objects 80 using a predetermined determination method, and determine the colors of the multiple parts that make up the sample object 60 so that the colors of the reference objects 80 with higher priorities are used preferentially. This makes it possible to generate a sample object 60 with a design that more strongly reflects the characteristics of the reference objects 80 with higher priorities.

[0065] Furthermore, the reference object 80 is an avatar 3 that operates in the virtual space 2, or an object that is located in the virtual space 2, and the image is acquired by virtually photographing the reference object 80 at a predetermined position in the virtual space 2, and the sample object 60 is placed in the virtual space 2 and used for customizing the product object 70 with the avatar 3. This makes it possible to provide sample objects 60 with a variety of designs that can serve as a base for customization in the virtual space 2.

[0066] The information processing system 1 according to this embodiment and the control device 20 as an information processing device include a CPU 21, which determines the design of a sample object 60 representing an initial state in customizing the product object 70 based on an image of the reference object 80 acquired by a predetermined method. This makes it possible to provide sample objects 60 with a variety of designs and also reduces the effort required for customization by the user.

[0067] Furthermore, the program 231 according to this embodiment causes the CPU 21 to execute a process of determining the design of a sample object 60 representing an initial state in customizing the product object 70, based on an image of the reference object 80 acquired by a predetermined method. This makes it possible to provide sample objects 60 with a variety of designs and also to reduce the effort required for customization by the user.

[0068] In addition, in an information processing method executed by the CPU 311 of the VR device 30 including the display unit 315, and the operation input unit 314 as an input unit, the sensor unit 317, the controller 32, and the operation input unit 324, a sample object 60 representing an initial state in customizing a product object 70 is displayed on the display unit 315, and the design of the sample object 60 is determined based on an image of a reference object 80 acquired by a predetermined method. This makes it possible to provide sample objects 60 with a variety of designs and also reduces the effort required for customization by the user.

[0069] Next, a second embodiment will be described. Differences from the first embodiment will be described below, and configurations common to the first embodiment will not be described. In the second embodiment, the design of a product object 70 or a real product can be customized on a website 251 (FIG. 21) provided by the EC server 40 and displayed on the display unit 25 of the control device 20 using a web browser 2311. The website 251 may be a website for purchasing a real watch product without using the VR service in the virtual space 2, or may be a website for customizing the purchased watch online. In this case, the client terminal operated by the user may be an information terminal such as a PC separate from the control device 20 connected to the VR device 30.

[0070] The website 251 displays a sample object 60, a target selection icon 252, a color selection icon 253, an image input button 254, and a product purchase button 255. The sample object 60 in this embodiment is a two-dimensional image of a watch. The target selection icon 252 is a group of icons for selecting components to be customized when customizing the design of the product object 70 or a real product on the website 251. The six icons of the target selection icon 252 include, for example, the same icons as the six icons included in the target selection IF 51 of the IF object 50. The color selection icon 253 is a group of icons for specifying the color of the component when customizing on the website 251. The color selection icon 253 includes, for example, the same color palette as the color palette 521 included in the color selection IF 52 of the IF object 50.

[0071] The image input button 254 is used to upload an image of the reference object 80 for determining the initial design of the sample object 60. When the user selects the image input button 254, a predetermined window for selecting an image to upload is displayed. When the user selects an image including the desired reference object 80 in this window and operates a confirm button (not shown), the image of the reference object 80 is uploaded from the control device 20 (or an equivalent information terminal) to the EC server 40. The CPU 41 of the EC server 40 determines the design of the sample object 60, particularly the colors of its components, based on the image of the reference object 80 in a manner similar to that of the first embodiment, and reflects the design in the sample object 60 on the website 251. For example, when the image of the reference object 80 shown in FIG. 10 is uploaded using the image input button 254 from the state shown in FIG. 21, the design of the sample object 60 is changed to the colors shown in FIG. 22. The color scheme of the sample object 60 in FIG. 22 is the same as the color scheme of the sample object 60 in FIG. 10. As described above, in this embodiment, the CPU 41 of the EC server 40 executes the process of determining the design of the sample object 60 .

[0072] In the second embodiment, multiple images relating to multiple reference objects 80 may also be input. In this case, the design of one sample object 60 may be determined based on the multiple reference objects 80, or the designs of multiple sample objects 60 may be determined based on the multiple reference objects 80. In the latter case, each time an image of a reference object 80 is input, a sample object 60 with a new design may be added to the website 251. In this case, the latest sample object 60 may be displayed in a predetermined position (e.g., the upper left corner, which is most likely to attract the user's attention), and the positions of the existing sample objects 60 may be slid. Furthermore, when a certain number or more of sample objects 60 have been generated, sample objects 60 with similar designs may be grouped and displayed. The grouping rule is not particularly limited. For example, a rule may be set such that sample objects 60 that share the same color of a specific component (e.g., the bezel 61) are grouped together.

[0073] When the product purchase button 255 is selected, a process is performed to purchase a product having the same design as the current sample object 60. Note that the first and second modifications of the first embodiment may be applied to the second embodiment.

[0074] As described above, in the information processing method according to the second embodiment, an image of the reference object 80 is acquired by uploading data relating to the image to the EC server 40 in response to a user operation, and the sample object 60 is displayed on the website 251 for providing customization services to the user. This makes it possible to provide sample objects 60 with a variety of designs that can serve as the basis for customization on the website.

[0075] Note that the present invention is not limited to the above-described embodiment, and various modifications are possible. For example, the functions of the control device 20 may be integrated into the VR server 10, omitting the control device 20, and the VR service may be executed by the VR server 10 and the VR device 30. In this case, signals output from the operation input unit 324 and the sensor unit 325 of the VR device 30 are transmitted to the communication unit 14 of the VR server 10 via the communication unit 326. The VR server 10 controls the movement of the avatar 3 in the virtual space 2 in accordance with the received user operation. That is, the VR server 10 performs the same processing as the control device 20 described above, generates image data of the virtual space 2, and transmits it to the VR device 30. Furthermore, the functions of the control device 20 may be integrated into the VR device 30 (for example, the VR headset 31), omitting the control device 20.

[0076] Furthermore, the design of the sample object 60 determined based on the reference object 80 is not limited to the color and shape of the parts. For example, the pattern of the parts of the sample object 60 may be determined based on the pattern of the reference object 80. In this case, customization may be possible by using the sample object 60 to change the pattern of the parts of the product object 70.

[0077] In addition, in the above embodiment, an example was given of determining the design for each part of the sample object 60 based on the reference object 80, but this is not limited to this, and the overall design of the reference object 80 may also be determined based on the reference object 80.

[0078] Furthermore, as the reference object 80, an object whose object type is different from the product object 70 and the sample object 60 has been exemplified, but the present invention is not limited to this, and the reference object 80, the product object 70, and the sample object 60 may all be the same object type. That is, if the product object 70 is a clock, a reference object 80 for a clock may be used. For example, if a reference object 80 whose model (model, type number) is different from the product object 70 and the sample object 60 is placed, the color of the sample object 60 may be changed based on the image of the reference object 80.

[0079] Furthermore, the design of the reference object 80 may be determined using a machine learning model that has been trained to input a reference object 80 and output a sample object 60 with a design based on the reference object 80.

[0080] Alternatively, the user may operate the avatar 3 without wearing the VR headset 31. In this case, instead of the VR headset 31, an image of the virtual space 2 is displayed on a normal display (for example, a liquid crystal display included in the display unit 25 of the control device 20) provided in a position visible to the user. The screen displayed in this case may be a VR screen 3151 if the VR device 30 can detect the user's movements. Alternatively, a third-person perspective screen may be displayed instead of the VR screen 3151. For example, the user may operate the controller 32 to move the avatar 3 in the virtual space 2 from a third-person perspective.

[0081] Furthermore, although a watch product object 70 has been exemplified as a target object, the present invention is not limited to this and can be applied to any object of any kind.

[0082] In the above description, an example has been disclosed in which an HDD or SSD such as the storage units 13 and 23 is used as a computer-readable medium for the program according to the present invention, but this is not limiting. Other computer-readable media may also be used, such as flash memory or CD-ROM. Furthermore, a carrier wave may also be used as a medium for providing data for the program according to the present invention via a communication line.

[0083] Furthermore, it goes without saying that the detailed configuration and detailed operation of each component of the information processing system 1 in the above embodiment can be modified as appropriate without departing from the spirit of the present invention.

[0084] Although the embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and its equivalents. [Explanation of symbols]

[0085] 1...information processing system, 2...virtual space, 3...avatar, 20...control device (information processing device), 21...CPU (processing unit), 30...VR device (terminal device), 315...display unit, 40...EC server (server), 60...sample object, 61...bezel (component), 62...face (component), 63...short band (component), 64...long band (component), 65...loose ring (component), 66...buckle (component), 70...product object (target object), 80...reference object, 81-86...component, 251...website

Claims

1. 1. A computer-implemented information processing method, comprising: determining a design of a sample object representing an initial state in customization of the target object based on an image of the reference object obtained by a predetermined method; Information processing methods.

2. the object type of the reference object is different from the object type of the target object; The information processing method according to claim 1 .

3. determining the color of each of a plurality of parts constituting the sample object based on the color scheme of the reference object in the image; The information processing method according to claim 1 .

4. determining the color of each of the plurality of components constituting the sample object based on at least one of the shape, size, and arrangement of each of the plurality of components constituting the reference object and the color of each of the plurality of components; The information processing method according to claim 3 .

5. determining a shape of at least one of a plurality of parts constituting the sample object based on at least one of the shape, size, and arrangement of each of a plurality of components constituting the reference object; The information processing method according to claim 1 .

6. determining designs of the sample objects that are different from each other and correspond to the reference objects based on the images of the reference objects that are different from each other; displaying the plurality of sample objects on a display unit; The information processing method according to claim 1 .

7. determining a design of one of the sample objects based on a plurality of the images of the plurality of reference objects that are different from each other; The information processing method according to claim 1 .

8. summing the values ​​of the proportions of the multiple colors used in each of the multiple reference objects for each color, and determining the color of each of the multiple parts constituting the sample object based on the sum of the values ​​of each color; The information processing method according to claim 7.

9. determining priorities of the plurality of reference objects using a predetermined determination method, and determining the colors of each of the plurality of parts constituting the sample object so that the color of a reference object having a higher priority is used preferentially; The information processing method according to claim 7.

10. the reference object is an avatar that operates in a virtual space or an object that is located in the virtual space; the image is acquired by virtually photographing the reference object at a predetermined position in the virtual space; the sample object is placed in the virtual space and used for customizing the target object by the avatar; The information processing method according to any one of claims 1 to 9.

11. the image is acquired by uploading data relating to the image to a predetermined server in response to a user operation; the sample object is displayed on a website for providing the user with a service related to the customization. The information processing method according to any one of claims 1 to 9.

12. An information processing system including a processing unit that determines a design of a sample object that represents an initial state in customization of a target object based on an image of a reference object acquired by a predetermined method.

13. An information processing device comprising: a processing unit that determines a design of a sample object representing an initial state in customization of a target object based on an image of a reference object acquired by a predetermined method.

14. A program that causes a computer to execute a process of determining the design of a sample object that represents an initial state in customization of a target object, based on an image of a reference object obtained by a predetermined method.

15. An information processing method executed by a computer of a terminal device having a display unit and an input unit, displaying a sample object representing an initial state in customization of the target object on the display unit; the design of the sample object is determined based on an image of a reference object acquired by a predetermined method; Information processing methods.

Images