Information processing method, information processing system, and program

The method generates second design information to create diverse objects and convert them based on first design information, addressing the limitation of conventional systems by allowing for more varied and customizable designs in virtual spaces.

JP2024164374APending Publication Date: 2024-11-27CASIO COMPUTER CO LTD

Patent Information

Application Number
JP2023079802
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-15
Publication Date
2024-11-27

AI Technical Summary

Technical Problem

Conventional systems limit the variations in design for objects in virtual spaces, restricting the diversity of article designs that can be applied to avatars.

Method used

An information processing method that generates second design information for a second object based on first design information, allowing for the creation of objects with diverse designs by adjusting size and shape to fit the avatar's characteristics and enabling conversion between different types of objects.

Benefits of technology

Enables the creation of objects with more diverse designs and allows for the conversion of existing objects into different types, enhancing user interaction and customization in virtual environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164374000001_ABST
    Figure 2024164374000001_ABST
Patent Text Reader

Abstract

To create objects of more various designs.SOLUTION: An information processing method to be executed by a computer includes: generating, on the basis of first design information for determining a design of a first object related to a first article, second design information for determining a design of a second object related to a second article, which is different from the first article, the second article having a corresponding portion of a shape corresponding to a certain portion of the first article; and causing a display unit to display the second object in a virtual space, on the basis of the second design information.SELECTED DRAWING: Figure 13
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing method, an information processing system, and a program. [Background technology]

[0002] Conventionally, services have been realized that allow users to communicate with other users who are operating other avatars and participate in events and games held in a virtual space constructed by a computer by operating an avatar according to a user's operation. Some of these services allow users to equip their avatars with objects such as clothing. For example, Patent Document 1 discloses a system that supports the coordination of clothing for an avatar by providing a plurality of interchangeable objects of different designs. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-071271 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-mentioned conventional technology, the design variations of the article object are provided in a state where the design variations are limited to the type of article to which the product is applied (e.g., shirts, etc.), which poses a problem that the design of the article object is limited to the variations provided for each article.

[0005] An object of the present invention is to enable the creation of objects with a greater variety of designs. [Means for solving the problem]

[0006] In order to solve the above problems, an information processing method according to the present invention comprises: 1. A computer-implemented information processing method, comprising: generating, based on first design information defining a design of a first object related to a first article, second design information defining a design of a second object related to a second article, the second article being different from the first article and having a corresponding portion having a shape corresponding to a certain portion of the first article; The second object in a virtual space is displayed on a display unit based on the second design information. Effect of the Invention

[0007] According to the present invention, objects with a greater variety of designs can be created. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an information processing system. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of a server. [Diagram 3] FIG. 4 is a diagram showing an example of user management data. [Figure 4] FIG. 2 is a block diagram showing a functional configuration of the information processing device. [Diagram 5] FIG. 4 is a diagram showing an example of the contents of object data. [Figure 6] FIG. 2 is a block diagram showing the functional configuration of the VR device. [Figure 7] FIG. 1 is a diagram showing a VR screen. [Figure 8] FIG. 13 is a diagram showing a customized IF. [Figure 9] FIG. 13 is a diagram showing a state in which a bezel icon is selected. [Figure 10] FIG. 13 is a diagram showing a state in which a short band icon is selected. [Figure 11] FIG. 13 shows the state in which the buckle icon is selected. [Figure 12]FIG. 13 is a diagram showing a state in which a clock object is generated in response to selection of the export button. [Figure 13] 13A and 13B are diagrams showing a clock object and a ring object in comparison. [Figure 14] FIG. 13 is a diagram showing a comparison between a clock object and a necklace object. [Figure 15] FIG. 13 is a diagram showing an example of the contents of an item table. [Figure 16] 13 is a diagram showing an example of the contents of object data including second design information for a ring object. FIG. [Figure 17] 13 is a flowchart showing a control procedure of a virtual store operation process. [Figure 18] 13 is a flowchart showing a control procedure of a customization process. [Figure 19] 13 is a flowchart showing a control procedure for design information generation processing. [Figure 20] 13 is a flowchart showing a control procedure for the object adjustment processing. [Figure 21] 13 is a flowchart showing a control procedure for object conversion processing. [Figure 22] FIG. 13 is a diagram illustrating a configuration of an information processing system according to a modified example. [Figure 23] FIG. 1 is a diagram showing a portion of information registered in a blockchain. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] (Outline of Information Processing System) FIG. 1 is a diagram showing a configuration of an information processing system 1. As shown in FIG. The information processing system 1 includes a server 10, a plurality of information processing devices 20, and a plurality of VR devices 30 (terminal devices). The information processing system 1 provides various services in a three-dimensional virtual space (metaverse) constructed by a computer to a plurality of users who use the information processing system 1. The information processing system 1 can also provide users with services to which VR (virtual reality) is applied in the metaverse. VR is a technology that allows users to experience a virtual world constructed in a virtual space as if it were reality.

[0011] Each user of the information processing system 1 uses one information processing device 20 and one VR device 30. The information processing device 20 and the VR device 30 are connected to each other so that data can be transmitted and received by wireless communication. The VR device 30 includes a VR headset 31 (head-mounted device) and a controller 32 that are worn by the user. The VR device 30 detects the user's movements and input operations using the VR headset 31 and the controller 32, and transmits the detection results to the information processing device 20. The information processing device 20 transmits data such as images and sounds of the virtual space to the VR headset 31 in response to the user's movements and input operations detected by the VR device 30, and causes the VR headset 31 to display images and output sounds. In this way, VR is realized by displaying images of the virtual space on the VR headset 31 in real time and outputting sounds in response to the user's movements and input operations. In the virtual space, a character called an avatar 40 (see FIG. 9) acts on behalf of the user. In other words, an image of the virtual space seen from the viewpoint of the avatar 40 is displayed in real time on the VR headset 31.

[0012] The information processing system 1 of this embodiment provides various services (hereinafter, referred to as "virtual store services") related to watches (wristwatches) as merchandise in a virtual store 200 (see FIG. 7) constructed in a virtual space 2. The virtual store services provided in the virtual store 200 include a service that allows a user to freely customize the design of a watch object (product object, object) that can be worn by an avatar 40, a service that generates a customized watch object and allows the avatar 40 to wear it (try it on), and the like. These will be described in detail later.

[0013] The multiple information processing devices 20 are connected to the server 10 via a network N, and are capable of transmitting and receiving data to and from the server 10. The network N is, for example, the Internet, but is not limited to this. The server 10 is, for example, managed by a provider of services in the virtual store 200. The server 10 transmits various data required for providing services in the virtual store 200 to the multiple information processing devices 20. The server 10 also receives and manages data related to users and data related to customization and sales of watches from the multiple information processing devices 20. Each component of the information processing system 1 will be described in detail below.

[0014] (Server configuration) FIG. 2 is a block diagram showing the functional configuration of the server 10. As shown in FIG. The server 10 includes a CPU 11 (Central Processing Unit), a RAM 12 (Random Access Memory), a storage unit 13, a communication unit 14, and a bus 15. The components of the server 10 are connected to each other via the bus 15. The server 10 may further include an operation unit, a display unit, and the like that are used by an administrator of the server 10.

[0015] The CPU 11 is a processor that reads and executes the program 131 stored in the storage unit 13 and performs various arithmetic processing to control the operation of each unit of the server 10. The server 10 may have multiple processors (e.g., multiple CPUs), and the multiple processes executed by the CPU 11 of the present embodiment may be executed by the multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.

[0016] The RAM 12 provides a working memory space for the CPU 11 and stores temporary data.

[0017] The storage unit 13 is a non-transitory recording medium readable by the CPU 11 as a computer, and stores a program 131 and various data. The storage unit 13 includes a non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). The program 131 is stored in the storage unit 13 in the form of a computer-readable program code. The data stored in the storage unit 13 includes user management data 132 in which information related to multiple users of the information processing system 1 is recorded.

[0018] FIG. 3 is a diagram showing an example of the contents of the user management data 132. As shown in FIG. One row of data in the user management data 132 corresponds to one user. Each row of data includes data items such as "user ID", "avatar ID", and "avatar information".

[0019] A "user ID" is a unique code assigned to each user. The "avatar ID" is a unique code assigned to the avatar 40 corresponding to the user. The "avatar information" includes a number of sub-items related to the characteristics of the avatar 40. Here, the sub-items shown are, for example, "total length," "maximum wrist diameter," and "wrist shape." "Total length" is the total length of the avatar 40 in the virtual space 2 (height, in the case of a humanoid avatar 40). “Maximum wrist diameter” is the maximum diameter of avatar 40's wrist. "Wrist shape" is the shape of the wrist of avatar 40. "Wrist shape" may be expressed by a numerical value such as the ratio between the maximum diameter and the minimum diameter. The units of "total length" and "maximum wrist diameter" can be any unit length related to length in the virtual space 2. "Total length", "maximum wrist diameter" and "wrist shape" are referenced when automatically adjusting the size and / or shape of the watch object, which will be described later. The user management data 132 may further include data items not shown in Fig. 3. For example, data items such as user attributes, characteristics, login history, and product purchase history may further be included.

[0020] 2, the communication unit 14 performs a communication operation in accordance with a predetermined communication standard. The communication unit 14 transmits and receives data to and from the information processing device 20 via the network N through this communication operation.

[0021] (Configuration of information processing device) FIG. 4 is a block diagram showing the functional configuration of the information processing device 20. As shown in FIG. The information processing device 20 includes a CPU 21 (processing unit, computer), a RAM 22, a storage unit 23, an operation input unit 24, an output unit 25, a communication unit 26, and a bus 27. The units of the information processing device 20 are connected via the bus 27. The information processing device 20 is, for example, a notebook PC or a desktop PC, but is not limited to these and may be a tablet terminal, a smartphone, or the like.

[0022] The CPU 21 is a processor that reads and executes the program 231 stored in the storage unit 23 and performs various arithmetic processing, thereby controlling the operation of each unit of the information processing device 20. The information processing device 20 may have multiple processors (e.g., multiple CPUs), and the multiple processes performed by the CPU 21 of this embodiment may be executed by the multiple processors. In this case, a "processing unit" is configured by the multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.

[0023] The RAM 22 provides a working memory space for the CPU 21 and stores temporary data.

[0024] The storage unit 23 is a non-transitory recording medium readable by the CPU 21 as a computer, and stores programs such as the program 231 and various data. The storage unit 23 includes a non-volatile memory such as an HDD or SSD. The program is stored in the storage unit 23 in the form of a computer-readable program code. The data stored in the storage unit 23 includes object data 232 in which information related to objects in the virtual space 2 is recorded, and an item table 233 in which the correspondence between components in objects of different items is recorded. The object data 232 and the item table 233 may be stored in the storage unit 13 of the server 10, or the CPU 21 of the information processing device 20 may acquire information on the object data 232 and the item table 233 from the server 10 via the communication unit 26 as necessary.

[0025] FIG. 5 is a diagram showing an example of the contents of the object data 232. As shown in FIG. One row of data in the object data 232 corresponds to one object. In Fig. 5, data relating to a clock object handled in the virtual store 200, among the objects in the virtual space 2, is illustrated. Each row of data includes data on items such as "object ID", "name", "display magnification correction", "shape correction", "avatar to be worn", and "customization information". One data row relating to a clock object constitutes the first design information 2321.

[0026] An "object ID" is a unique code assigned to each object. "Name" is the name of each object, which is "Clock" in this example.

[0027] "Display magnification correction" is a setting related to the size at which an object is displayed. Here, the size of the object is expressed as a magnification with the default size being 1. A value greater than 1 indicates that the object is displayed larger than the default size, and a value less than 1 indicates that the object is displayed smaller than the default size. The "display magnification correction" setting is adjusted according to the overall length and maximum wrist diameter of the avatar 40 to which the object is to be worn, so that the clock object is displayed at a size that suits the avatar 40. The "display magnification correction" setting is one aspect of the "setting related to the size of the object". The setting related to the size of the object does not necessarily have to be expressed by the display magnification, and may be, for example, a setting that directly specifies the size of the object (such as the width or length of the entire object or a predetermined part of the object).

[0028] "Shape correction" is a setting related to the correction of the shape when an object is displayed. Here, the shape of the watch band when worn by the avatar 40 is specified. For example, if the setting is "cylinder", the shape of the watch object is corrected so that the band is cylindrical, and if the setting is "elliptical cylinder", the shape of the watch object is corrected so that the band is elliptical cylinder. In the case of "elliptical cylinder", the flattening rate of the ellipse may be further specified. The setting of "shape correction" is adjusted according to the wrist shape of the avatar 40 to be worn, so that the watch object is displayed in a shape that suits the avatar 40. The setting of "shape correction" is one aspect of the "setting related to the shape of the object".

[0029] The "target avatar" is information on the avatar 40 when an object (here, a clock object) is worn by the avatar 40. Here, the "target avatar" includes sub-items of "avatar ID" and "body part". The "avatar ID" is the avatar ID corresponding to the avatar 40 wearing the object. The "body part" indicates the body part of the avatar 40 to which the object is worn. If the object is not worn by any avatar 40, the "target avatar" is blank data (empty characters). If a setting value is input to the "target avatar", the position and orientation of the object are updated as needed to follow the movement of the set body part of the set avatar 40. This provides a display effect as if the object is worn on the body part of the avatar 40.

[0030] The "customization information" indicates the content of customization when the design of a clock object, which will be described later, is customized. Specifically, the "customization information" includes sub-items such as a "customization design ID," a "base design," and "bezel color" and "face color" that indicate the colors of each component (part) of the clock. The "customized design ID" is a unique code that represents the customized design set for the clock object. "Base design" is a unique code that represents the design used as the base for customization. If a customized design is used as the base, the "base design" will be the above-mentioned customized design ID. The clock object of this embodiment has a bezel 61 (component C1), a face 62 (watch face; component C2), a short band 63 (component C3), a long band 64 (component C4), a ring 65 (component C5), and a buckle 66 (component C6) as components (parts) (see Figs. 9 and 15). The components C1 to C6 are composed of one or more parts. For example, the component C1 of the face 62 is composed of a printed glass, a liquid crystal display, a control circuit, a case, etc. The "customization information" has sub-items of "color", "size", and "shape" for each of the components C1 to C6. "Color" represents the color setting of the component. "Size" represents the size setting of the component, and is expressed by a magnification with the default size set to 1, for example, as with "display magnification correction". "Shape" represents the shape setting of the component. In Fig. 5, the sub-items of each component other than the components C1 and C2 are omitted. If the design of the clock object is not customized, the "color" item of each component is blank data (null characters). In this case, the color of each component will be the same as the color of the component in the "base design."

[0031] Fig. 5 shows an example of a data configuration for identifying the size, shape, attachment target avatar, and customized design of an object in the object data 232, but is not limited thereto. The object data 232 may further include data items not shown in Fig. 5. For example, the object data 232 may include information that can identify the position and orientation of the object in the virtual space 2, and the external shape of the object (such as the file path of the 3D model data of each component of the object). 5 illustrates an example of line data related to a clock object, but the object data 232 also includes line data related to various objects that may be components of the virtual space 2. For example, the object data 232 includes data related to objects such as the interior and fixtures of the virtual store 200, and the avatars 40 of each user. At least a portion of the data related to the avatars 40 may be extracted from the user management data 132 of the server 10. Furthermore, while color information of each component is stored in the sub-items of the customization information in FIG. 5, the design pattern (for example, design or pattern) of each component may also be added.

[0032] 4, the operation input unit 24 accepts an input operation by the user and outputs an input signal according to the input operation to the CPU 21. The operation input unit 24 includes input devices such as a keyboard, a mouse, and a touch panel.

[0033] The output unit 25 outputs to the user information related to the processing contents and various statuses in the information processing device 20. The output unit 25 includes, for example, a display device such as a liquid crystal display, a sound output device such as a speaker, and a light emitting device such as an LED.

[0034] The communication unit 26 performs a communication operation according to a predetermined communication standard. Through this communication operation, the communication unit 26 transmits and receives data to and from the server 10 via the network N. The communication unit 26 also transmits and receives data to and from the VR device 30 via wireless communication.

[0035] (VR device configuration) FIG. 6 is a block diagram showing the functional configuration of the VR device 30. The VR device 30 includes a VR headset 31, a controller 32 for a right hand, and a controller 32 for a left hand. The two controllers 32 are connected to the VR headset 31 wirelessly or via a wire to enable data communication. The VR headset 31 is used by being worn on the user's head. The controller 32 is used by being worn or held on the user's hand. The controller 32 corresponds to an "input unit."

[0036] The VR headset 31 includes a CPU 311, a RAM 312, a storage unit 313, an operation input unit 314, a display unit 315, a sound output unit 316, a sensor unit 317, a communication unit 318, and a bus 319. The various units of the VR headset 31 are connected to each other via the bus 319.

[0037] The CPU 311 is a processor that reads and executes a program 3131 stored in the storage unit 313 and performs various arithmetic processing to control the operation of each unit of the VR headset 31. Note that the VR headset 31 may have multiple processors (e.g., multiple CPUs), and the multiple processes executed by the CPU 311 of this embodiment may be executed by the multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.

[0038] The RAM 312 provides a working memory space for the CPU 311 and stores temporary data.

[0039] The storage unit 313 is a non-transitory recording medium readable by the CPU 311 as a computer, and stores the program 3131 and various data. The storage unit 313 includes a non-volatile memory such as a flash memory. The program 3131 is stored in the storage unit 313 in the form of a computer-readable program code.

[0040] The operation input unit 314 includes various switches, buttons, etc., accepts an input operation by a user, and outputs an input signal corresponding to the input operation to the CPU 311. The operation input unit 314 may also include a microphone, and may be capable of accepting an input operation by the user's voice via the microphone. The operation input unit 314 corresponds to the "input unit."

[0041] The display unit 315 displays an image to be viewed by a user wearing the VR headset 31. The display unit 315 includes a liquid crystal display, an organic EL display, or the like, provided in a position viewable by a user wearing the VR headset 31. Image data of an image displayed by the display unit 315 is transmitted from the information processing device 20 to the VR headset 31. The display unit 315 displays an image based on the received image data under the control of the CPU 311.

[0042] The sound output unit 316 outputs various sounds that are recognized by the hearing of a user wearing the VR headset 31. The sound output unit 316 includes a speaker that outputs sounds. Sound data of the sounds output by the sound output unit 316 is transmitted from the information processing device 20 to the VR headset 31. The sound output unit 316 outputs sounds based on the received sound data under the control of the CPU 311.

[0043] The sensor unit 317 detects the movement and orientation of the head of the user wearing the VR headset 31. The sensor unit 317 includes, for example, a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor. The three-axis acceleration sensor detects the acceleration in each axis direction applied to the VR headset 31 according to the user's movement at a predetermined sampling frequency, and outputs the acceleration data as the detection result to the CPU 311. The three-axis gyro sensor detects the angular velocity around each axis applied to the VR headset 31 according to the user's movement at a predetermined sampling frequency, and outputs the angular velocity data as the detection result to the CPU 311. The three-axis geomagnetic sensor detects the magnitude of the geomagnetism passing through the VR headset 31 at a predetermined sampling frequency, and outputs the geomagnetic data as the detection result to the CPU 311. The data output from the three-axis acceleration sensor, the three-axis gyro sensor, and the three-axis geomagnetic sensor include signal components for three axes that are orthogonal to each other. The CPU 311 derives the movement and orientation of the user's head based on the acceleration data, angular velocity data, and geomagnetic data received from the sensor unit 317. The sensor unit 317 is capable of receiving the user's movement and direction as user operation, and corresponds to an "input unit."

[0044] The communication unit 318 performs a communication operation in accordance with a predetermined communication standard. Through this communication operation, the communication unit 318 transmits and receives data between the controller 32 and the information processing device 20 via wireless communication.

[0045] The controller 32 includes a CPU 321 which controls the overall operation of the controller 32, a RAM 322 which provides working memory space for the CPU 321, a memory unit 323 in which programs and data necessary for executing the programs are stored, an operation input unit 324, a sensor unit 325, and a communication unit 326 which performs data communication with the VR headset 31.

[0046] The operation input unit 324 (input unit) includes various switches, buttons, operation keys, etc., accepts an input operation by a user, and outputs an input signal according to the input operation to the CPU 321. In addition, the operation input unit 324 may be capable of separately detecting the movement of each finger of the user.

[0047] The sensor unit 325 includes a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor, and detects the movement and orientation of the hand of the user holding or wearing the controller 32. The configuration and operation of the sensor unit 325 may be similar to those of the sensor unit 317 of the VR headset 31, for example.

[0048] The configuration of the VR device 30 is not limited to the above. For example, the VR equipment 30 may further include an auxiliary sensor device that is not held or worn by the user. This sensor device may be, for example, a device that is installed on the floor or the like and optically detects the movement of the user or the movement of the VR headset 31 and the controller 32 by laser scanning or the like. In addition, in cases where it is not necessary to detect the movements of both hands separately, one of the controllers 32 may be omitted. In addition, in cases where the VR headset 31 is capable of detecting the necessary user movements and input operations, the controller 32 may be omitted.

[0049] (Operation of information processing system) Next, the operation of the information processing system 1 will be described. In the following description of the operation, the subject of operation is the CPU 11 of the server 10, the CPU 21 of the information processing device 20, the CPU 311 of the VR headset 31, or the CPU 321 of the controller 32, but for ease of explanation, the server 10, the information processing device 20, the VR headset 31, or the controller 32 may be described as the subject of operation. In addition, the user's movements and input operations detected by the VR device 30 are hereinafter collectively referred to as "user operations." That is, the "user operations" in this embodiment include input operations detected by the operation input unit 314 of the VR headset 31 and the operation input unit 324 of the controller 32, and actions detected by the sensor unit 317 of the VR headset 31 and the sensor unit 325 of the controller 32. In the following description, the image display operation in the VR headset 31 will be mainly described, and a description of other operations such as sound output will be omitted.

[0050] <Start of virtual store service and VR-related operations> When a user starts using the above-mentioned virtual store service provided by the information processing system 1, the user puts on the VR headset 31 and the controller 32 of the VR device 30 and performs a predetermined operation to start the service. In response to the operation, user authentication information is transmitted from the information processing device 20 to the server 10, and when the user is authenticated by the server 10, the authentication result is returned from the server 10 to the information processing device 20, and the virtual store service for the authenticated user is started.

[0051] When the virtual store service is started, the information processing device 20 starts transmitting image data of the virtual store 200 to the VR headset 31 of the VR device 30. Here, the position of the user's avatar 40 in the virtual store 200 is set to a predetermined initial position, and image data of the virtual store 200 as seen from the viewpoint of the avatar 40 at the initial position is transmitted to the VR headset 31. In response to this, the display unit 315 of the VR headset 31 starts displaying a VR screen 3151 of the virtual store 200 based on the received image data.

[0052] FIG. 7 is a diagram showing the VR screen 3151. The VR screen 3151 includes an image that three-dimensionally expresses the interior of the virtual store 200. Inside the virtual store 200, a customized IF (interface) 50 and a sample object 60 are installed.

[0053] The customization IF 50 is an interface operated by the avatar 40 to customize the design of the clock object.

[0054] The sample object 60 is a model object that is an enlarged version of a clock object. The sample object 60 reflects the content of the customization performed by the customization IF 50. The sample object 60 is placed in the space above the base 201. The time displayed on the sample object 60 reflects the time in the real world. For example, the time set on any one of the server 10, the information processing device 20, and the VR device 30 is reflected in the time displayed on the sample object 60. The time displayed on the sample object 60 may be displayed in a 12-hour format, with a "PM" mark lit if it is afternoon. It may also be displayed in a 24-hour format.

[0055] The position, orientation, shape, etc. of each object in the virtual store 200 (such as the interior of the virtual store 200, the customization IF 50, and the sample object 60) are generated based on information in the object data 232 of the information processing device 20. Information on each object in the object data 232 may be stored in advance in the storage unit 23 of the information processing device 20, or may be transmitted from the server 10 to the information processing device 20 when the virtual store service is started.

[0056] Also, when the virtual store service is started, the VR device 30 starts to detect user operations, and the detection results are continuously transmitted to the information processing device 20. The information processing device 20 controls the movement of the avatar 40 in the virtual store 200 (virtual space 2) according to the received user operations. That is, the information processing device 20 converts the received user operations into the movements of the avatar 40 in the virtual store 200, and specifies and updates the position, orientation, posture, etc. of the avatar 40 in the virtual store 200 in real time. Then, the information processing device 20 generates image data of the virtual store 200 seen from the viewpoint of the avatar 40 in the updated position and orientation, and transmits it to the VR headset 31. This image data generation and transmission are repeatedly performed at a predetermined frame rate. The display unit 315 of the VR headset 31 displays the VR screen 3151 at the above frame rate based on the received image data of the virtual store 200. As a result, the user wearing the VR headset 31 can view the inside of the virtual store 200 in real time from the viewpoint of the avatar 40 moving and moving in the virtual store 200 according to the user's operation.

[0057] Since the VR screen 3151 is a first-person viewpoint of the avatar 40, the avatar 40 is not generally displayed on the VR screen 3151. However, when the arm is moved to a position within the field of view of the avatar 40 or when the line of sight of the avatar 40 is directed toward the user's own body, a part of the avatar 40 is displayed on the VR screen 3151 according to the positional relationship between the field of view of the avatar 40 and the arm or body. In FIG. 7, the user is performing an action of stretching the right arm forward, and in response to this, the right hand 40R of the avatar 40 is displayed within the VR screen 3151.

[0058] <Actions related to customizing the clock object> As shown in FIG. 7, in the virtual store 200, a virtual line L extends from the fingertip of the avatar 40, and a pointer P is generated at the intersection between the virtual line L and the object. By performing a predetermined operation with the pointer P aligned with the position of a desired object, the object in the virtual store 200 can be selected. The position and direction of the virtual line L are derived according to the position and direction of the fingers of the avatar 40, which are specified according to the user's operation. The position of the pointer P is derived as the intersection between the derived virtual line L and the surface of each object in the virtual space 2, which is specified from the object data 232. The virtual line L and the pointer P may be displayed only when the distance between the fingertip and the object is equal to or less than a predetermined distance. When the user wants to customize the design of the clock object, the user operates the customization IF 50 by the movement of the avatar 40 using the pointer P.

[0059] FIG. 8 is a diagram showing the customized IF 50. As shown in FIG. The customization IF 50 is a board-shaped object like a signboard. The customization IF 50 includes an object selection IF 51, a color selection IF 52, and export buttons 531-533.

[0060] The object selection IF51 is an interface for selecting a component to be customized among a plurality of components (a plurality of parts) constituting a clock object. The object selection IF51 of this embodiment includes a bezel icon 511 for selecting the bezel 61 of the clock as a customization target, a face icon 512 for selecting the face 62, a short band icon 513 for selecting the short band 63, a long band icon 514 for selecting the long band 64, a loose ring icon 515 for selecting the loose ring 65, and a buckle icon 516 for selecting the buckle 66. Each icon 511 to 516 can be selected using the above-mentioned pointer P. In the example shown in FIG. 8, one selected icon (here, the bezel icon 511) is surrounded by a frame. However, this is not limited to this, and for example, only the selected icon may be displayed with the remaining icons turned off.

[0061] Note that the components to be customized are merely examples, and components other than those described above may be customized. For example, in addition to the free ring icon 515 corresponding to a single free ring, a free ring icon corresponding to a triple free ring may be displayed, and the shape of the free fit may be selected from single or triple by selecting one of the free ring icons.

[0062] The color selection IF52 is an interface for designating the color of the component selected in the target selection IF51. The color selection IF52 includes a plurality of color palettes 521 corresponding to any one of a plurality of different colors. Each color palette 521 can be selected using the above-mentioned pointer P. The type of color palette 521 included in the color selection IF52 is switched in accordance with the icon selected among the icons 511 to 516 of the target selection IF51. That is, the color palette 521 of the color preset for the component corresponding to the selected icon is displayed in the color selection IF52.

[0063] With one of the icons 511-516 selected in the object selection IF 51, the color of the component corresponding to the icon 511-516 can be changed by selecting one of the color palettes 521 in the color selection IF 52. The change in color of the component is reflected in the sample object 60. That is, when the customization IF 50 is operated by the action of the avatar 40, the information processing device 20 changes the content of the sample object 60 so that the customization content of the clock object corresponding to the content of the operation is reflected, and transmits the changed image data to the VR headset 31.

[0064] In the sample object 60, in a default state at the start of customization, the color of each component is white, and the color of each component is changed as needed in response to the operation of the customization IF 50. The design of the sample object 60 in the default state corresponds to, for example, the base design of "TYPE01" in the object data 232 shown in FIG. 5. In addition, in the default state, the sample object 60 is arranged so that the face 62 displaying the time faces the front direction of the virtual store 200. In this embodiment, the front direction of the virtual store 200 is the direction in which the face on which the target selection IF 51 and the like of the customization IF 50 are provided faces. FIG. 7 shows the sample object 60 in the default state.

[0065] FIG. 9 is a diagram showing a state in which the bezel icon 511 is selected. For convenience of explanation, FIG. 9 shows a third-person viewpoint screen 3152 that displays the inside of the virtual store 200 from a third-person viewpoint. The third-person viewpoint screen 3152 is an image of the virtual store 200 viewed from a predetermined point in the virtual space 2, which is different from the viewpoint of the avatar 40. In other words, the third-person viewpoint screen 3152 is an image in which the avatar 40 located in the virtual store 200 is displayed together with the virtual store 200. The user can switch between the VR screen 3151 and the third-person viewpoint screen 3152 by performing a predetermined operation. It is of course possible to perform customization while keeping the VR screen 3151. When performing customization using the VR screen 3151, the user can observe the sample object 60 from any direction by moving the avatar 40 in the virtual store 200.

[0066] 9, the bezel icon 511 is selected and the color of the bezel 61 is designated as red. In response to this, the color of the bezel 61 of the sample object 60 is colored red.

[0067] FIG. 10 is a diagram showing a state in which the short band icon 513 is selected. When any one of the icons 511 to 516 of the target selection IF 51 is selected, the orientation of the sample object 60 is changed so that the component corresponding to the selected icon is easily visible to the user. In detail, when a certain component of the clock object is selected by the target selection IF 51, the information processing device 20 changes the orientation of the sample object 60 so that the component in the sample object 60 faces a reference direction in the virtual store 200 (virtual space 2), and transmits the changed image data to the VR headset 31. Here, the reference direction is, for example, the front direction in the virtual store 200. In the example shown in FIG. 10, in response to the selection of the short band icon 513, the sample object 60 is rotated so that the short band 63 of the sample object 60 faces the front direction. The reference direction may be a direction from the position of the sample object 60 in the virtual store 200 (for example, the position of the representative point of the sample object 60) to the position of the avatar 40 (for example, the position of the representative point of the avatar 40). For example, the reference direction is set to a direction toward a surface toward which the face of the avatar 40 (one of the eyes of the face) is facing. As a result, when an arbitrary component is selected by the avatar 40 in the target selection IF 51, the selected component in the sample object 60 is displayed toward the face of the avatar 40, so that the avatar 40 (user) can customize the clock object in a state in which the selected component is easily visible. The reference direction can be switched by operating the operation input unit 314.

[0068] 10, the color of the short band 63 is specified as yellow with the short band icon 513 selected, and accordingly, the color of the short band 63 of the sample object 60 is colored yellow.

[0069] FIG. 11 shows the state when the buckle icon 516 is selected. 11, in response to the selection of the buckle icon 516, the sample object 60 rotates so that the buckle 66 of the sample object 60 faces forward. In this state, the color of the buckle 66 can be changed by selecting a color palette 521 from the color selection IF 52.

[0070] In this way, by selecting an icon 511 to 516 of the object selection IF 51, the sample object 60 rotates so that the corresponding component faces forward, and further by selecting a color palette 521 of the color selection IF 52, the color of the component of the sample object 60 can be changed. By repeating this operation, the color of each component of the sample object 60 can be changed to customize the design. In other words, when the customization IF 50 is operated by the avatar 40, the settings related to the clock object are changed so that the clock object is customized according to the contents of the operation. For example, at the start of customization, new line data (first design information 2321 shown in FIG. 5) related to the clock object to be customized may be generated in the object data 232, and the color settings of each component may be changed in the first design information 2321. It is also possible to change the design of an existing clock object by the above operation, and in this case, the settings of the first design information 2321 related to the design of the existing clock object in the object data 232 may be changed. Alternatively, at this stage, the setting values ​​of the sample object 60 in the object data 232 may be changed according to the contents of the customization, and when a new clock object is generated, the setting values ​​of the sample object 60 may be reflected in the first design information 2321 of the new clock object.

[0071] By selecting export button 531 after customizing the design as described above, a clock object 70a with the customized design is generated in virtual space 2. Clock object 70a corresponds to a "first object" related to a clock as a "first item." Note that by selecting export buttons 532 and 533, a ring object 70b (see FIG. 13) and a necklace object 70c (see FIG. 14) can be generated, respectively. These operations will be described later.

[0072] FIG. 12 is a diagram showing a state in which a clock object 70a is generated in response to selection of the export button 531. When the export button 531 is selected, a clock object 70a having the same design as the sample object 60 at that time is generated and displayed (output) near the export button 531. In addition, in response to the generation of the clock object 70a, the sample object 60 returns to the default color scheme shown in FIG.

[0073] The generated clock object 70a is held or worn on any one of a plurality of parts of the avatar 40 when the avatar 40 performs a predetermined motion. When the avatar 40 holding or wearing the clock object 70a moves in the virtual space 2, the position and orientation of the clock object 70a in the virtual space 2 follows the position and orientation of the part of the avatar 40 where it is worn. For example, when the avatar 40 wears the clock object 70a on his or her wrist and performs a motion of twisting his or her wrist, the clock object 70a also rotates in response to the motion.

[0074] <Actions related to adjusting objects> In this embodiment, when the avatar 40 performs an action of holding or wearing the clock object 70a (i.e., when the user performs an operation to make the avatar 40 perform an action of holding or wearing the clock object 70a), a setting related to at least one of the size and shape of the clock object 70a in the virtual space 2 is automatically adjusted according to the characteristics of the avatar 40. Note that it is also possible that when the avatar 40 holds the clock object 70a, the setting related to the size and shape of the clock object 70a is not changed, and when the avatar 40 wears the clock object 70a, the setting related to at least one of the size and shape of the clock object 70a is changed. The user operation for making the avatar 40 perform the action of holding the clock object 70a is not particularly limited, and may be, for example, a predetermined grab operation for grabbing an object with the controller 32 when the hand of the avatar 40 is within a predetermined distance from the clock object 70a. The user operation for making the avatar 40 perform the action of wearing the clock object 70a is not particularly limited, and may be, for example, a predetermined wearing operation for wearing an object with the controller 32 when the avatar 40 is holding the clock object 70a.

[0075] For example, the setting related to the size of the clock object 70a in the virtual space 2 is adjusted according to the size of the avatar 40 in the virtual space 2. Specifically, the setting value of "display magnification correction" in the object data 232 shown in FIG. 5 is adjusted according to the setting value of "total length" or "maximum wrist diameter" in the "avatar information" in the user management data 132 shown in FIG. 3. As an example, the clock object 70a is enlarged or reduced (the setting value of "display magnification correction" is adjusted) so that the maximum width of the clock object 70a in the virtual space 2 corresponds to the "total length" of the avatar 40 in the virtual space 2. Alternatively, a setting related to the size of the clock object 70a in the virtual space 2 ("display magnification correction") is adjusted according to the size of the part of the avatar 40 where the clock object 70a is held or worn ("maximum wrist diameter" in this embodiment). For example, if the band of the clock object 70a is cylindrical, the "display magnification correction" is adjusted so that the inner diameter of the band matches the "maximum wrist diameter" of the avatar 40.

[0076] Furthermore, the settings relating to the shape of the clock object 70a may be adjusted so as to match the shape of the part of the avatar 40 on which the clock object 70a is to be worn. Specifically, the setting value of "shape correction" in the object data 232 is changed according to the setting value of "wrist shape" in the "avatar information" in the user management data 132. For example, if the "wrist shape" of the avatar 40 is "cylinder," the "shape correction" of the clock object 70a is set to "cylinder" accordingly, and if the "wrist shape" of the avatar 40 is "elliptical cylinder," the "shape correction" of the clock object 70a is set to "elliptical cylinder" accordingly.

[0077] The above object adjustment is not limited to the clock object 70a, but can also be performed on objects other than clocks, including a ring object 70b and a necklace object 70c, which will be described later.

[0078] <Operations related to the creation of objects of different items> After customizing the design of the clock, by selecting the export button 532 instead of the export button 531 in FIG. 8, a ring object 70b having a design corresponding to the customized clock object 70a can be generated. Also, by selecting the export button 533 instead of the export button 531, a necklace object 70c having a design corresponding to the customized clock object 70a can be generated. The ring object 70b and the necklace object 70c correspond to the ring and the necklace as the "second object", respectively. In this way, one object is determined from a plurality of objects (second objects) according to the operation of the customization IF 50 by the avatar 40, and the ring object 70b or the necklace object 70c of the object is generated. In the following description, any one of a plurality of objects including the watch object 70a, the ring object 70b, and the necklace object 70c will be referred to as "object 70".

[0079] FIG. 13 is a diagram showing a clock object 70a and a ring object 70b in comparison. FIG. 14 is a diagram showing a comparison between a clock object 70a and a necklace object 70c. FIG. 15 is a diagram showing an example of the contents of the item table 233. As shown in FIG. Correspondence between components of different article objects 70 is determined and recorded in advance in the article table 233. Furthermore, the article table 233 also determines and records in advance the parts of the avatar 40 on which each article object 70 can be worn.

[0080] 13 and 15, the ring object 70b has a stone setting component C1 (corresponding part) corresponding to the bezel component C1 (certain part) of the clock object 70a, a gemstone component C2 (corresponding part) corresponding to the face component C2 (certain part) of the clock object 70a, an arm A component C3 (corresponding part) corresponding to the short band component C3 (certain part) of the clock object 70a, and an arm B component C4 (corresponding part) corresponding to the long band component C4 (certain part) of the clock object 70a. Each of the arms A and B constitutes half of the entire arm of the ring. 14 and 15, the necklace object 70c has a frame component C1 (corresponding part) corresponding to the bezel component C1 (certain part) of the clock object 70a, a jewel component C2 (corresponding part) corresponding to the face component C2 (certain part) of the clock object 70a, a chain A component C3 (corresponding part) corresponding to the short band component C3 (certain part) of the clock object 70a, and a chain B component C4 (corresponding part) corresponding to the long band component C4 (certain part) of the clock object 70a. The chain A and the chain B each constitute half of the entire chain of the necklace.

[0081] Corresponding components in the clock object 70a and the ring object 70b have common design elements according to the customization content of the design of the clock object 70a. Similarly, corresponding components in the clock object 70a and the necklace object 70c also have common design elements. In this embodiment, the design elements are colors. For example, the bezel component C1 of the clock object 70a and the stone setting component C1 of the corresponding ring object 70b have the same color specified in the customization. The same applies to the other components C2 to C4. In addition, common design elements are not limited to color, but may also include external shape (number of sides, number of corners, curvature of curves, vertical and horizontal aspect ratios, etc.), pattern, accessories (clasps, decorations, etc.), texture, etc.

[0082] When a ring object 70b or a necklace object 70c is generated, second design information 2322 that defines the design of the ring object 70b or the necklace object 70c is generated based on the first design information 2321 of the clock object 70a.

[0083] FIG. 16 is a diagram showing an example of the content of the object data 232 including the second design information 2322 for the ring object 70b. Among the "customization information" in the second design information 2322, the setting related to the design of at least one component is generated by changing the setting related to at least one of the size and shape of the corresponding component in the first design information 2321 shown in FIG. 5. In the example shown in FIG. 16, the "size" of the stone setting component C1 is changed from "1.0" in FIG. 5 to "0.2", and the "shape" is changed from "bezel" in FIG. 5 to "stone setting". In addition, the "size" of the gemstone component C2 is changed from "1.0" in FIG. 5 to "0.4", and the "shape" is changed from "face" in FIG. 5 to "gemstone". The same is true for other corresponding components. Meanwhile, in the second design information 2322, the "color" setting of the corresponding component is not changed from the first design information 2321 in FIG. 5. When the necklace object 70c is generated, the second design information 2322 is generated in a similar manner. In this way, by using second design information 2322 in which the settings of at least one of the "size" and "shape" have been changed while maintaining the "color" setting of the corresponding component, a ring object 70b or a necklace object 70c having a common color as a design element is generated.

[0084] Instead of the operation of selecting the export buttons 532 and 533, the ring object 70b or the necklace object 70c may be generated by having the avatar 40 perform a predetermined gesture. The gesture may specify a body part of the avatar 40, and an object 70 of an article that can be worn on the body part specified by the gesture may be generated in response to the gesture. For example, the ring object 70b may be generated by performing a gesture around a finger.

[0085] In the above, an operation of newly generating a ring object 70b or a necklace object 70c as a second object (hereinafter, a reference symbol 70B is added and the object is referred to as a "second object 70B") without generating a clock object 70a as a first object (hereinafter, a reference symbol 70A is added and the object is referred to as a "first object 70A") has been described. However, a first object 70A such as a clock object 70a that has already been generated can also be converted into a second object 70B such as a ring object 70b or a necklace object 70c. The object 70 is converted by deleting the first object 70A in the virtual space 2 and displaying the second object 70B at the position where the first object 70A has been deleted. The first object 70A is not limited to the clock object 70a, and the second object 70B is not limited to the ring object 70b or the necklace object 70c. For example, the ring object 70b can also be converted into the necklace object 70c.

[0086] The conversion of the object 70 is executed, for example, when the user performs a specific operation to instruct the conversion of the object 70 while the first object 70A is specified by a predetermined method. The method of specifying the first object 70A is not particularly limited. For example, one object 70 held or worn by the avatar 40 (for example, the last object 70 held or worn) may be set as the first object 70A. Also, an object 70 specified by a user operation may be set as the first object 70A. The specific operation for instructing the conversion of the object 70 is not particularly limited, and may be, for example, an operation of making the avatar 40 perform a predetermined gesture. The specific operation may be an operation for putting the first object 70A on a body part where it cannot be worn originally, and in response to this operation, the object 70A may be converted into a second object 70B that is an article that can be worn on that body part. For example, an operation for putting the clock object 70a around the neck may be detected as the specific operation, and the clock object 70a may be converted into a necklace object 70c. The second object 70B may be determined by other methods. For example, when the first object 70A is held or worn at a certain part of the avatar 40, an object 70 of an article that can be worn at the certain part or a part in the vicinity of the certain part, or a part within a predetermined vicinity range from the first object 70A held by the avatar 40 may be determined as the second object 70B. Alternatively, a notification may be given to indicate that there is the second object 70B of the wearable article. The notification may be a blinking display of the generated first object 70A. Alternatively, the notification may be a display of a list of the second objects 70B of the wearable articles (such as a window in the virtual space 2 including the list). The specific operation may be an operation of selecting any one of the object 70 of the article from the list, and the object 70 of the selected article may be determined as the second object 70B. In this manner, one article may be determined from a plurality of articles (second articles) in accordance with an action that the user causes avatar 40 to perform, and the determined article may be converted into second object 70B.

[0087] <Virtual store operation processing> Next, a description will be given of a virtual store operation process executed in the information processing system 1 to realize operations related to the above virtual store service. The following description will focus on the process executed by the CPU 21 of the information processing device 20 out of the virtual store operation process.

[0088] FIG. 17 is a flowchart showing a control procedure of the virtual store operation process. When the virtual store operation process is started, the CPU 21 of the information processing device 20 determines whether or not a user has logged in and the virtual store service has started (step S101). If it is determined that the virtual store service has not started ("NO" in step S101), the CPU 21 executes step S101 again.

[0089] When it is determined that the virtual store service has started ("YES" in step S101), the CPU 21 starts receiving operation information related to user operation from the VR device 30 and controlling the avatar 40 in the virtual space 2 based on the received operation information (step S102). The CPU 21 also starts generating image data of the VR screen 3151 or the third-person viewpoint screen 3152 according to the position and orientation of the avatar 40 and transmitting the image data to the VR headset 31 (step S103). In each of the subsequent steps, the control of the avatar 40 based on the operation information, and the generation and transmission of image data of the VR screen 3151 or the third-person viewpoint screen 3152 to the VR headset 31 continue, but for convenience, the description of these processes will be omitted.

[0090] The CPU 21 determines whether or not the operation of the customization IF 50 by the avatar 40 has been started (step S104). If it is determined that the operation of the customization IF 50 has been started ("YES" in step S104), the CPU 21 starts the customization process (step S105).

[0091] FIG. 18 is a flowchart showing a control procedure of the customization process. When the customization process is called, the CPU 21 changes the color and orientation of the sample object 60 to the color and orientation of the default state described above (step S201). The CPU 21 also generates first design information 2321 (line data) related to the clock object 70a to be customized in the object data 232 (step S202). The first design information 2321 corresponds to the line data related to the clock object 70a to be generated in step S210 described later.

[0092] The CPU 21 determines whether or not a component to be customized has been selected by the action of the avatar 40 selecting one of the icons 511-516 of the object selection IF 51 (step S203). If it is determined that a component has been selected ("YES" in step S203), the CPU 21 rotates the sample object 60 so that the selected component faces the reference direction (step S204).

[0093] CPU 21 determines whether or not a component color has been designated by the action of avatar 40 selecting one of color palettes 521 of color selection IF 52 (step S205). If it is determined that a component color has been designated ("YES" in step S205), CPU 21 colors the selected component in sample object 60 in the designated color (step S206). CPU 21 also changes the color setting of the corresponding component in first design information 2321 generated in step S202 (step S207). This step S207 corresponds to "processing for changing settings related to an object so that the design of the object is customized."

[0094] When step S207 is completed, or when branching to "NO" in step S203 or S205, CPU 21 determines whether or not any of export buttons 531 to 533 has been operated by avatar 40. When it is determined that such operation has not been performed ("NO" in step S208), CPU 21 returns the process to step S203.

[0095] If it is determined that any one of the export buttons 531 to 533 has been operated ("YES" in step S208), the CPU 21 determines whether the designated item is a clock, i.e., whether the export button 531 for instructing the generation of the clock object 70a has been operated (step S209). If it is determined that the designated item is a clock ("YES" in step S209), the CPU 21 generates a clock object 70a having the same design as the sample object 60 at that time based on the first design information 2321 at that time, and displays (outputs) it at a predetermined position (step S210).

[0096] On the other hand, if it is determined that the specified item is not a watch, i.e., that the export button 532 or 533 has been operated to instruct the generation of a ring object 70b or a necklace object 70c ("NO" in step S209), the CPU 21 executes a design information generation process to generate the second design information 2322 of the object 70 that was instructed to be generated (step S211).

[0097] FIG. 19 is a flowchart showing a control procedure for the design information generating process. When the design information generation process is called, CPU 21 refers to the item table 233 and identifies components C1 to C4 that correspond to the components of the first item (here, a watch) among the components of the second item (here, a ring or a necklace) (step S301). CPU 21 selects one of these corresponding components (step S302), and generates design settings of the component in second design information 2322 by changing the settings of the size and / or shape of the component in the first design information 2321 (step S303).

[0098] The CPU 21 determines whether or not the design settings of all the corresponding components C1 to C4 have been generated (step S304), and if it is determined that there is a component for which the design settings have not been generated ("NO" in step S304), the process returns to step S302. If it is determined that the design settings of all the corresponding components C1 to C4 have been generated ("YES" in step S304), the CPU 21 determines whether or not there is a component in the second item that does not correspond to any component in the first item (step S305). If it is determined that there is such a component ("YES" in step S305), the CPU 21 generates the design settings of the component (step S306). Note that in the example shown in FIG. 15, all the components C1 to C4 of the ring and necklace correspond to any component of the watch, so the process branches to "NO" in step S305 and step S306 is not executed. When step S306 is completed, or when the process branches to "NO" in step S305, the CPU 21 ends the design information generating process, and returns the process to the customization process of FIG.

[0099] When the design information generating process (step S211) in FIG. 18 ends, the CPU 21 generates the ring object 70b or the necklace object 70c based on the generated second design information 2322, and displays (outputs) it (step S212). When step S210 or S212 ends, the CPU 21 ends the customization process, and returns the process to the virtual store operation process of FIG.

[0100] 17, when the customization process (step S105) is completed, the CPU 21 determines whether or not the user has performed an operation for holding or attaching the generated object 70 to the avatar 40 (step S106). If it is determined that the operation has been performed ("YES" in step S106), the CPU 21 executes an object adjustment process (step S107).

[0101] FIG. 20 is a flowchart showing a control procedure for the object adjustment processing. When the object adjustment process is called, the CPU 21 specifies the overall length of the avatar 40 and the size and shape of the body part that holds or wears the object 70 (step S401). Here, the CPU 21 acquires from the server 10 the "avatar information" ("overall length", "maximum wrist diameter", and "wrist shape") of the user management data 132 shown in FIG. 3, and specifies the size and shape of the body part based on the acquired information. Alternatively, if the "avatar information" of the user management data 132 has been acquired in advance and recorded in the object data 232, the CPU 21 identifies the size and shape of the body part by referring to the object data 232. Note that one of the "overall length" and the "maximum wrist diameter" may be acquired and used in the next step S402.

[0102] CPU 21 adjusts the setting related to the size of object 70 ("display magnification correction" in object data 232 of FIG. 5) according to the overall length or the size of the part of avatar 40 acquired in step S401 (step S402). CPU 21 also adjusts the setting related to the shape of object 70 ("shape correction" in object data 232) according to the shape of the part of avatar 40 acquired in step S401 (step S403).

[0103] The CPU 21 causes the avatar 40 to hold or wear the object 70 whose size and / or shape settings have been adjusted (step S404). Here, the CPU 21 records the avatar ID of the avatar 40 to be worn (held) and the wearing (holding) body part in the "wearing target avatar" in the object data 232 in Fig. 5. When step S305 ends, the CPU 21 ends the object adjustment process and returns the process to the virtual store operation process in Fig. 17. When the object adjustment process (step S107) in FIG. 17 ends, the CPU 21 executes an object conversion process (step S108).

[0104] FIG. 21 is a flowchart showing a control procedure for the object conversion process. When the object conversion process is called, the CPU 21 determines whether the avatar 40 is wearing a first object 70A (object 70 generated in the customization process) (step S501), and if it is determined that the avatar 40 is wearing the first object 70A (object 70 generated in the customization process) (step S501), it determines whether there is a candidate for a second object 70B that can be worn on the wearing area (or a area near that area) (step S502). Furthermore, if it is determined that the first object 70A is not being worn (i.e., is being held) ("NO" in step S501), the CPU 21 determines whether there is a candidate for the second object 70B that can be worn on a part within a vicinity range of the first object 70A (step S503). When it is determined that there is a candidate for the wearable second object 70B ("YES" in step S502 or S503), the CPU 21 executes a notification indicating that the object 70 can be converted or a notification indicating the candidate for the second object 70B (step S504). For example, the CPU 21 causes the first object 70A to blink or displays a window including a list of the second objects 70B in the virtual space 2, as described above.

[0105] The CPU 21 determines whether or not a specific operation has been performed to instruct the transformation of the object 70 (step S505), and if it is determined that a specific operation has been performed ("YES" in step S505), identifies an item for the second object 70B (step S506). For example, the CPU 21 determines one item that can be worn on an attachment site of the first object 70A or on a site within a vicinity range of the first object 70A as the item for the second object 70B. Alternatively, if a specific operation has been performed to select one second object 70B from the above list, the CPU 21 identifies the item for the second object 70B.

[0106] 19 to generate second design information 2322 for the second object 70B of the identified item (step S507). In the design information generation process in this case, the item of the generated first object 70A is set as the "first item", and the item identified in step S506 is set as the "second item". Other process contents are the same as those in the design information generation process performed during the customization process.

[0107] The CPU 21 converts the object based on the generated second design information 2322 (step S508). That is, the CPU 21 deletes the first object 70A, and generates a second object 70B based on the second design information 2322. After conversion to the second object 70B, the size and / or shape of the second object 70B may be adjusted by executing the object adjustment process of Fig. 20 on the second object 70B. When step S508 is completed, or when it is determined in step S502 or S503 that there is no candidate for the wearable second object 70B ("NO" in step S502 or S503), the CPU 21 ends the object conversion process and returns the process to the virtual store operation process of Fig. 17. Note that when branching to "NO" in step S502 or S503, the process may be shifted to step S505 to execute conversion of the object 70.

[0108] 17, when the object adjustment process (step S108) is completed, or when the process branches to "NO" in step S104 or S106, the CPU 21 determines whether or not the avatar 40 has left the virtual store 200 (step S109). When it is determined that the avatar 40 has not left the virtual store 200 ("NO" in step S109), the CPU 21 returns the process to step S104. When it is determined that the avatar 40 has left the virtual store 200 ("YES" in step S109), the CPU 21 ends the virtual store operation process.

[0109] (Modification) Next, a modified example of the above embodiment will be described. Below, differences from the above embodiment will be described, and configurations common to the above embodiment will be denoted by the same reference numerals and description thereof will be omitted.

[0110] In this modification, a non-fungible token (hereinafter referred to as "NFT") associated with an object 70 can be registered in association with a user who generated the object 70 (a user corresponding to the avatar 40 who operated the customization IF 50). An NFT is non-fungible digital data that uses blockchain technology to prove the uniqueness and owner of digital content such as an image, video, or audio. NFTs can also be purchased and sold on the NFT marketplace. Hereinafter, an object 70 associated with an NFT is also referred to as an "NFT object."

[0111] FIG. 22 is a diagram showing a configuration of an information processing system 1 according to a modified example. The information processing system 1 according to this modified example includes an NFT management system 90 connected to the server 10 and the information processing device 20 via a network N. The NFT management system 90 includes a blockchain 91. The NFT management system 90 registers and manages NFTs by, for example, recording information related to the NFT in the blockchain 91. The information related to the NFT includes, for example, information on the holder of the NFT, the date and time of generation of the NFT, and the object associated with the NFT (the object for which the NFT proves the holder, which is the object 70 in this embodiment). The NFT management system 90 registers and manages the NFT object by associating the NFT with the object 70 and recording them in the blockchain 91.

[0112] After the object 70 is generated, when a user performs an operation to instruct the registration (purchase) of an NFT object related to the object 70, the information processing device 20 transmits a registration request (purchase request) of the NFT object to the server 10. The process related to the transmission corresponds to a "process for registering an NFT associated with an object in association with a user." The server 10 executes a payment process related to the purchase of the NFT object in response to the registration request, and when the payment process is completed, requests the NFT management system 90 to process the registration of the NFT object in the blockchain 91.

[0113] FIG. 23 is a diagram showing a portion of the information registered in the blockchain 91. In the blockchain 91, a unique "token ID" assigned to an NFT, a "user ID" representing the owner of the NFT, an "object ID" representing the object 70 associated with the NFT, and an "object conversion history" representing the conversion history of the object 70 are recorded in association with each other. The "current" item in the "object conversion history" represents the item of the object 70 at that time, and the items "history 1", "history 2", ... represent the transition of the item from the present to the past. The object 70 with the object ID "OJ001" shown in FIG. 23 is converted in the order of a watch, a necklace, and a ring. By imposing certain constraints on the user to convert the object 70 in the virtual space 2, a value according to the conversion history of the object 70 is assigned to the NFT object. For example, if only a user who wins a lottery with a low probability can convert a certain item into the object 70, the value of an NFT object including the specific item in the object conversion history increases. Furthermore, if conversion of the object 70 is permitted only when certain conditions are met, the frequency with which conversion can be performed will be limited, increasing the value of an NFT object that converts the object 70 many times.

[0114] (effect) As described above, in the information processing method according to the present embodiment, the CPU 21 as a computer generates second design information 2322 that defines the design of a second object 70B (such as a ring object 70b) related to a second object having a component corresponding to the component of the first object based on first design information 2321 that defines the design of a first object 70A (such as a clock object 70a) related to a first object, and displays the second object 70B in the virtual space 2 on the display unit 315 based on the second design information 2322. This makes it possible to generate the second object 70B of the second object by repurposing the design of the first object 70A of the first object. Therefore, it is possible to create objects 70 with more diverse designs compared to the conventional technology in which the scope of application of the design of an object was limited to the same object.

[0115] Moreover, the CPU 21 changes settings related to at least one of the size and shape of a component in the first design information 2321, thereby generating settings related to the design of the corresponding component in the second design information 2322. This makes it possible to divert design elements other than the size and shape to the second object 70B while correcting the size and / or shape of the component depending on the product.

[0116] Furthermore, the CPU 21 deletes the first object 70A generated in the virtual space 2 based on the first design information 2321, and displays the second object 70B at the position where the first object 70A was deleted, thereby converting the first object 70A into the second object 70B. This makes it possible to realize an event in the virtual space 2 in which the existing first object 70A is converted into the second object 70B of a different item.

[0117] Furthermore, when a first object 70A is held or worn in a certain part of the avatar 40 corresponding to the user and the user performs a specific operation to instruct conversion, the CPU 21 converts the first object 70A into a second object 70B relating to a second item that can be worn in the certain part or a part in the vicinity of the certain part, or a part within a predetermined vicinity range of the first object 70A held by the avatar 40. This makes it possible to convert into the second object 70B of an item that can be worn by the avatar 40. Thus, the converted second object 70B can be worn by the avatar 40.

[0118] Furthermore, when a first object 70A is held or attached to a certain part of the avatar 40 corresponding to the user, and the first object 70A can be converted into a second object 70B relating to a second article that can be attached to the certain part or a part in the vicinity of the certain part, or a part within a predetermined vicinity range of the first object 70A held by the avatar 40, the CPU 21 issues a notification indicating that conversion to the second object 70B is possible, and when a specific operation instructing the conversion is performed by the user, the CPU 21 converts the first object 70A into the second object 70B. This allows the user to recognize that conversion of the object 70 is possible.

[0119] Furthermore, CPU 21 determines one second object from among a plurality of second objects different from each other, according to an action that the user causes avatar 40 corresponding to the user to perform, and displays second object 70B related to the determined second object on display unit 315. This makes it possible to generate second object 70B of a desired object, or to convert into second object 70B of a desired object.

[0120] Furthermore, CPU 21 displays on display unit 315 the customization IF 50 in virtual space 2 operated by avatar 40, and determines one second article in response to an action of operating the customization IF 50 by avatar 40. In this way, by operating the customization IF 50 by avatar 40 in virtual space 2, an article for second object 70B to be generated (or converted) can be selected.

[0121] Furthermore, CPU 21 causes display unit 315 to display second object 70B, at least one of the size and shape of which has been adjusted in accordance with the characteristics of avatar 40. This allows avatar 40 to wear generated or converted second object 70B in a natural-looking state.

[0122] Furthermore, the CPU 21 displays on the display unit 315 the customization IF 50 in the virtual space 2 operated by the avatar 40 corresponding to the user, the customization IF 50 for customizing the design of the first object 70A, and generates first design information 2321 so that the design of the first object 70A is customized in accordance with an operation on the customization IF 50 by the avatar 40. This allows the design of the first object 70A to be customized, and the customized design can be diverted to the second object 70B.

[0123] In a modified example, the CPU 21 executes a process of displaying the second object 70B on the display unit 315 in response to a user's operation and registering the NFT associated with the generated second object 70B in association with the user. This makes it possible to realize a service that provides the user with an NFT object. This also makes it possible to increase the added value of the virtual store service.

[0124] Moreover, the information processing system 1 according to this embodiment includes a CPU 21, which generates second design information 2322 based on the first design information 2321 by the above-mentioned method, and displays the second object 70B on the display unit 315 based on the second design information 2322. This makes it possible to create objects 70 with more diverse designs.

[0125] Moreover, the program 231 according to this embodiment causes the CPU 21 as a computer to execute a process of generating second design information 2322 based on the first design information 2321 by the above-mentioned method, and a process of displaying the second object 70B on the display unit 315 based on the second design information 2322. This makes it possible to create objects 70 with more diverse designs.

[0126] In the information processing method of this embodiment, the CPU 311 of the VR device 30, which includes the display unit 315, and the operation input unit 314, the sensor unit 317, the controller 32, and the operation input unit 324 as input units, displays a second object 70B in the virtual space 2 relating to the second object, which is a second object different from the first object and has components having a shape corresponding to the components of the first object, on the display unit 315, and the design of the second object 70B is determined by second design information 2322 generated based on first design information 2321 that determines the design of the first object 70A relating to the first object. This makes it possible to create objects 70 with more diverse designs.

[0127] (others) The above description of the embodiment is merely an example of the information processing method, the information processing system, and the program according to the present invention, and the present invention is not limited to this. For example, the functions of the information processing device 20 may be integrated into the VR device 30 (for example, the VR headset 31), and the information processing device 20 may be omitted. In this case, the VR device 30 (VR headset 31) corresponds to the "information processing device" according to the present invention.

[0128] Also, a mode may be adopted in which the user operates the avatar 40 without wearing the VR headset 31. In this case, instead of the VR headset 31, an image of the virtual space 2 is displayed on a normal display (for example, a liquid crystal display included in the output unit 25 of the information processing device 20) provided at a position visible to the user. The screen displayed in this case may be a VR screen 3151 if the VR device 30 can detect the user's movements. Also, a third-person perspective screen 3152 may be displayed instead of the VR screen 3151. For example, a mode may be adopted in which the user operates the controller 32 to move the avatar 40 in the virtual space 2 from a third-person perspective.

[0129] In the above embodiment, after the virtual store service is started, various services and operations are executed by cooperation between the VR device 30 and the information processing device 20, but the present invention is not limited to this. For example, the virtual store service may be executed by the server 10, which integrates the functions of the information processing device 20, and the VR device 30. In this case, signals output from the operation input unit 324 and the sensor unit 325 of the VR device 30 are transmitted to the communication unit 14 of the server 10 via the communication unit 326. The server 10 controls the operation of the avatar 40 in the virtual store 200 (virtual space 2) in response to the received user operation. That is, the server 10 performs the same process as the information processing device 20 described above, generates image data of the virtual store 200, and transmits it to the VR device 30.

[0130] It may also be possible to order an item in the real world that has contents corresponding to (for example, the same design as) the first object 70A or the second object 70B generated in the virtual store 200. For example, the above order may be placed by the avatar 40 performing a predetermined action (for example, pressing an order button) at an order counter (not shown) provided in the virtual store 200. When an order is placed, the information processing device 20 transmits an order request to the server 10. The order request includes, for example, the model of the ordered watch, the customization contents, and information on the user corresponding to the avatar 40 who placed the order.

[0131] Furthermore, in the above embodiment, the customization step may be omitted, and the second design information 2322 of the second object 70B may be generated based on the default first design information 2321 of the first object 70A.

[0132] Also, it may be possible to allow conversion of the object 70 to be executed only within a predetermined area in the virtual space 2 (for example, inside the virtual store 200), and not to execute conversion of the object 70 outside this area. Also, it may be possible to allow conversion of the object 70 to be executed only when the user or avatar 40 has a predetermined attribute (for example, a store clerk attribute of the virtual store 200).

[0133] In the above embodiment, it has been described that the ring object 70b and the necklace object 70c can be generated as designs corresponding to the customized clock object 70a, but the objects that can be generated are not limited to these. Specifically, the clock object 70a is configured to form a ring shape by the short band component C3, the long band component C4, the ring component C5, and the buckle component C6, and as a corresponding design, the ring shape is formed by the arm A component C3 and the arm B component C4 of the ring object 70b, and the chain A component C3 and the chain B component C4 of the necklace object 70c. However, the object that can be generated as a design corresponding to the clock object 70a may also be an object that does not include a ring shape. For example, an object that does not form a ring shape by one or more components, such as a glasses object, may be generated. For example, in this case, the two temples of the glasses correspond to the components C3 and C4 of the clock object 70a, and the rim of the glasses corresponds to the component C1 of the clock object 70a, and the design of the components corresponding to the objects may be set in advance in the item table 233 in the same manner as in the above embodiment.

[0134] In the above embodiment, the customization is exemplified by changing the color combination of each component of the clock object 70a, but the content of the customization is not limited to this. For example, it may be possible to add a handwritten (or prepared) pattern by the user to the appearance of the component. Also, it may be possible to customize the shape of the component.

[0135] Furthermore, the interface for customizing the object 70 is not limited to the customization IF 50 illustrated in the above embodiment, but may be any interface that can be operated by the avatar 40.

[0136] Furthermore, the clock object 70 a, the ring object 70 b, and the necklace object 70 c have been exemplified as the object 70, but the present invention is not limited to these and can be applied to any object 70 handled in the virtual space 2.

[0137] In the above description, an example has been disclosed in which the HDD or SSD of the storage unit 23 is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, information recording media such as flash memory and CD-ROM can be applied. In addition, a carrier wave is also applied to the present invention as a medium for providing data of the program according to the present invention via a communication line.

[0138] Furthermore, it goes without saying that the detailed configurations and detailed operations of each component of the server 10, the information processing device 20, and the VR device 30 in the above embodiment can be modified as appropriate without departing from the spirit of the present invention.

[0139] Although the embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and its equivalents. [Explanation of symbols]

[0140] 1. Information Processing Systems 2. Virtual Space 10 Server 20 Information processing device 21 CPU (processing unit) 23 Memory section 231 Programs 232 Object Data 233 Item Table 30 VR equipment 40 Avatar 50 Customized IF (Interface) 60 Sample Objects 70 Objects 70A First Object 70B Second Object 70a Clock object 70b Ring object 70c Necklace Object 90 NFT Management Systems 200 Virtual Stores 2321 First Design Information 2322 Second Design Information C1~C6 Components (parts of an item)

Claims

1. 1. A computer-implemented information processing method, comprising: generating, based on first design information defining a design of a first object related to a first article, second design information defining a design of a second object related to a second article, the second article being different from the first article and having a corresponding portion having a shape corresponding to a certain portion of the first article; displaying the second object in a virtual space on a display unit based on the second design information; Information processing methods.

2. generating a setting related to a design of the corresponding part in the second design information by changing a setting related to at least one of a size and a shape of the certain part in the first design information; The information processing method according to claim 1 .

3. deleting the first object generated in the virtual space based on the first design information, and displaying the second object at a position where the first object has been deleted, thereby converting the first object into the second object; The information processing method according to claim 1 .

4. When the first object is held or worn at a certain part of an avatar corresponding to a user and a specific operation for instructing the conversion is performed by the user, the first object is converted into the second object related to the second item that can be worn at the certain part or a part in the vicinity of the certain part, or a part within a predetermined vicinity range of the first object held by the avatar. The information processing method according to claim 3.

5. when the first object is held or worn on a certain part of an avatar corresponding to a user, and the first object can be converted into the second object related to the second item that can be worn on the certain part or a part in the vicinity of the certain part, or a part within a predetermined vicinity range of the first object held by the avatar, a notification is made indicating that the conversion into the second object is possible; converting the first object into the second object when a specific operation for instructing the conversion is performed by the user; The information processing method according to claim 3.

6. determining, in response to an action performed by an avatar corresponding to the user, one second object from among a plurality of second objects different from each other, and displaying, on the display unit, the second object related to the determined second object; The information processing method according to claim 1 .

7. displaying an interface in the virtual space operated by the avatar on the display unit; determining the one second item in response to the action of the avatar manipulating the interface; The information processing method according to claim 6.

8. displaying, on the display unit, the second object, at least one of a size and a shape of which has been adjusted in accordance with the characteristics of the avatar; The information processing method according to any one of claims 4 to 7.

9. displaying, on the display unit, an interface in the virtual space operated by an avatar corresponding to a user, the interface being for customizing a design of the first object; generating the first design information so that a design of the first object is customized in response to an operation performed by the avatar on the interface; The information processing method according to claim 1 .

10. displaying the second object on the display unit in response to a user operation; execute a process for registering the generated non-fungible token associated with the second object in association with the user; The information processing method according to claim 1 .

11. generating, based on first design information defining a design of a first object related to a first article, second design information defining a design of a second object related to a second article, the second article being different from the first article and having a corresponding portion having a shape corresponding to a certain portion of the first article; displaying the second object in a virtual space on a display unit based on the second design information; An information processing system including a processing unit.

12. On the computer, a process of generating, based on first design information defining a design of a first object related to a first article, second design information defining a design of a second object related to a second article, the second article being different from the first article and having a corresponding portion having a shape corresponding to a certain portion of the first article; displaying the second object in a virtual space on a display unit based on the second design information; A program that executes the following.

13. An information processing method executed by a computer of a terminal device having a display unit and an input unit, displaying, on a display unit, a second object in a virtual space relating to a second object that is different from the first object and has a corresponding portion having a shape that corresponds to a certain portion of the first object; a design of the second object is determined by second design information generated based on first design information that determines a design of the first object related to the first article; Information processing methods.

Citation Information

Patent Citations

  • Video processing method, server device, and computer program

    JP2021048564A

  • Method and system for processing the attachment and detachment of items on an NFT-ed wearable model

    JP7180933B1

  • Dress and ornament coordination support processing server, dress and ornament coordination support processing method, dress and ornament coordination support processing program and dress and ornament coordination support processing system

    JP2008071271A

Cited By

  • User interface system

    WO2026211056A1