Information processing method, information processing system, information processing device, and program
Patent Information
- Application Number
- JP2023132208
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-08-15
- Publication Date
- 2025-02-28
AI Technical Summary
【0007】 本発明によれば、オブジェクトを用いたより多様な表現を可能とすることができる。
Smart Images

Figure 2025027481000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing method, an information processing system, an information processing device, and a program. [Background technology]
[0002] Conventionally, a service has been realized in which a user can operate an avatar in response to a user's operation in a virtual space constructed by a computer, thereby communicating with other users who are operating other avatars, and participating in events and games held in the virtual space (for example, Patent Document 1). In addition to avatars, various objects with predefined display modes are placed in the virtual space. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2016-152521 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, if the display mode of an object is fixed, there is a problem that the expression using the object in the virtual space becomes monotonous.
[0005] An object of the present invention is to enable more diverse expressions using objects. [Means for solving the problem]
[0006] In order to solve the above problems, an information processing method according to the present invention comprises: 1. A computer-implemented information processing method, comprising: In a virtual space in which an object is placed, when an avatar that satisfies predetermined conditions is located within a reference range including the placement position of the object, settings related to the display mode of the object in the virtual space are adjusted based on avatar information related to the avatar. Effect of the Invention
[0007] According to the present invention, it is possible to realize a wider variety of expressions using objects. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an information processing system. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of a server. [Diagram 3] FIG. 11 is a diagram showing an example of the contents of avatar data. [Figure 4] FIG. 11 is a diagram showing an example of the contents of object data. [Diagram 5] FIG. 11 is a diagram showing an example of the contents of variation data. [Figure 6] FIG. 2 is a block diagram showing a functional configuration of a control device. [Figure 7] FIG. 2 is a block diagram showing the functional configuration of the VR device. [Figure 8] FIG. 1 is a diagram showing a VR screen. [Figure 9] FIG. 13 shows a VR screen on which another avatar is displayed. [Figure 10] 13A and 13B are diagrams illustrating an operation for adjusting the orientation of a clock object. [Figure 11] 13A and 13B are diagrams illustrating an operation of adjusting the orientation of a clock object when there are multiple avatars. [Figure 12] FIG. 13 is a diagram showing a VR screen when an avatar being operated is within a reference range. [Figure 13] FIG. 13 is a diagram showing a VR screen when an avatar starts a virtual camera application in the state shown in FIG. 12. [Figure 14]11A and 11B are diagrams illustrating a method of switching between a global display mode and a local display mode. [Figure 15] 13A and 13B are diagrams illustrating an example of adjustment of a display mode in a global display mode. [Figure 16] 11A and 11B are diagrams illustrating an example of adjustment of a display mode in a local display mode. [Figure 17] 13 is a flowchart showing a control procedure for object display processing. [Figure 18] 13 is a flowchart showing a control procedure for a target avatar condition determination process. [Figure 19] 13 is a flowchart showing a control procedure of a display setting adjustment process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0010] (Outline of Information Processing System) FIG. 1 is a diagram showing a configuration of an information processing system 1. As shown in FIG. The information processing system 1 includes a server 10 (information processing device), a plurality of control devices 20, and a plurality of VR devices 30 (terminal devices). The information processing system 1 provides various services in a three-dimensional virtual space (metaverse) constructed by a computer to a plurality of users who use the information processing system 1. The information processing system 1 can also provide users with services (hereinafter, referred to as "VR services") that apply VR (virtual reality) in the metaverse. VR is a technology that allows users to experience a virtual world constructed in a virtual space as if it were reality.
[0011] Each user of the information processing system 1 uses one control device 20 and one VR device 30. The control device 20 and the VR device 30 are connected so that data can be transmitted and received by wireless communication. The VR device 30 includes a VR headset 31 (head-mounted device) and a controller 32 that are worn by the user. The VR device 30 detects the user's movements and input operations using the VR headset 31 and the controller 32, and transmits the detection results to the control device 20. The control device 20 transmits data such as a VR image 70 (see FIG. 8 and FIG. 9, etc.) of the virtual space 2 and audio to the VR headset 31 in response to the user's movements and input operations detected by the VR device 30, and causes the VR image 70 to be displayed and the audio to be output. In this way, VR is realized by displaying the VR image 70 of the virtual space 2 on the VR headset 31 in real time and outputting audio in response to the user's movements and input operations. In the virtual space 2, a character called an avatar 40 (for example, avatars 40a, 40b in FIG. 9; hereinafter, any one avatar will be referred to as "avatar 40") acts on behalf of the user. In other words, a VR image 70 of the virtual space 2 as seen from the viewpoint of the avatar 40 is displayed in real time on the VR headset 31. The positions of the avatar 40 and various objects in the virtual space 2 are represented by an XYZ Cartesian coordinate system.
[0012] The multiple control devices 20 are connected to the server 10 via a network N, and can transmit and receive data to and from the server 10. The network N is, for example, the Internet, but is not limited to this. The server 10 acquires and manages various data required for providing VR services, and transmits the data to the multiple control devices 20 as necessary. For example, the server 10 receives and consolidates position and motion information Ib (see FIG. 3; information related to the real-time position and motion of the avatar 40 in response to user operations) of the avatar 40 of each user from the multiple control devices 20, and transmits the data to each control device 20. Each component of the information processing system 1 will be described in detail below.
[0013] (Server configuration) FIG. 2 is a block diagram showing the functional configuration of the server 10. As shown in FIG. The server 10 includes a CPU 11 (Central Processing Unit) (processing unit, computer), a RAM 12 (Random Access Memory), a storage unit 13, a communication unit 14, and a bus 15. The various units of the server 10 are connected to each other via the bus 15. The server 10 may further include an operation unit, a display unit, and the like that are used by an administrator of the server 10.
[0014] The CPU 11 is a processor that reads and executes the program 131 stored in the storage unit 13 and performs various arithmetic processing to control the operation of each unit of the server 10. The server 10 may have multiple processors (e.g., multiple CPUs), and the multiple processes executed by the CPU 11 of this embodiment may be executed by the multiple processors. In this case, a "processing unit" is configured by the multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.
[0015] The RAM 12 provides a working memory space for the CPU 11 and stores temporary data.
[0016] The storage unit 13 is a non-transitory recording medium readable by the CPU 11 as a computer, and stores the program 131 and various data. The storage unit 13 includes a non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). The program 131 is stored in the storage unit 13 in the form of a computer-readable program code. Data stored in the storage unit 13 includes avatar data 132 and object data 133. Of these, the object data 133 includes variation data 1331.
[0017] FIG. 3 is a diagram showing an example of the contents of the avatar data 132. As shown in FIG. Avatar data 132 includes information (avatar information Ia) related to multiple avatars 40 corresponding to multiple users of information processing system 1. One row of data in avatar data 132 corresponds to avatar information Ia of one avatar 40. Avatar information Ia includes data items such as "avatar ID," "user ID," "position and action information," "attributes," "appearance," and "possessed objects."
[0018] The “avatar ID” is a unique code assigned to the avatar 40 . The “user ID” is a unique code assigned to the user corresponding to the avatar 40 . The "position and action information" includes the sub-items of "position" and "action." Hereinafter, the part of the avatar data 132 that corresponds to the "position and action information" will also be referred to as "position and action information Ib." “Position” represents the position coordinates of the avatar 40 in the virtual space 2. "Action" represents an action being performed by the avatar 40. This action includes, for example, "moving" to move in the virtual space 2, "standing still" to stand still in the virtual space 2, and "taking a picture" to take a picture of the virtual space 2 with a virtual camera application. However, these are merely examples, and the "actions" are not limited to those shown in FIG. 3. "Attributes" represent attributes of the avatar 40. In FIG. 3, "people" and "animals" are exemplified as "attributes". However, "attributes" are not limited to these, and may be any element for classifying the avatar 40, such as a group to which the avatar 40 belongs. "Attributes" may also include attributes of the user corresponding to the avatar 40 (e.g., age, sex, place of residence, etc.). "Appearance" represents the characteristics of the appearance of the avatar 40. For example, "appearance" represents the characteristics of the clothes worn by the avatar 40. In FIG. 3, "appearance" is exemplified by "casual" representing casual clothes and "formal" representing formal clothes. However, "appearance" is not limited to these and may be any element that represents the characteristics of the appearance of the avatar 40. "Possessed object" indicates the object ID of an object possessed by avatar 40. In this embodiment, a wristwatch object 60 (see FIG. 9) is exemplified as an object possessed by avatar 40. The wristwatch object 60 can be worn on the wrist of avatar 40. When avatar 40 wearing the wristwatch object 60 moves in virtual space 2, the position and orientation of the wristwatch object 60 in virtual space 2 follows the position and orientation of the wrist of avatar 40. Note that the state in which avatar 40 possesses an object is not limited to the state in which the object is worn, but also includes the state in which the object is held without being worn. Avatar data 132 may include information other than the information exemplified in FIG.
[0019] FIG. 4 is a diagram showing an example of the contents of the object data 133. As shown in FIG. The object data 133 includes information related to various objects arranged and displayed in the virtual space 2. One row of data in the object data 133 corresponds to one object. Each row of data includes data on items such as "object ID", "name", "position", "avatar owned", "display settings", and "corresponding object".
[0020] An "object ID" is a unique code assigned to an object. In Fig. 4, data of two objects with object IDs "OJ001" and "OJ901" is illustrated. Of these, the object with object ID "OJ001" is a clock object 50 (see Fig. 8) of an exhibition clock, and the object with object ID "OJ901" is a wristwatch object 60 to be worn by the avatar 40. "Name" is the name of the object. "Position" represents the position coordinates of an object in the virtual space 2. "Position" is set for an object that is directly placed (installed) in the virtual space 2. In FIG. 4, the position (X4, Y4, Z4) of a clock object 50 with an object ID of "OJ001" is set. "Owner avatar" indicates the avatar ID of the avatar 40 who owns the object. In Fig. 4, a wristwatch object 60 with an object ID of "OJ901" is owned by an avatar 40 with an avatar ID of "A001".
[0021] The "display setting" is a setting related to the display mode of an object in the virtual space 2, and includes data on the sub-items of "orientation" and "appearance variation." Hereinafter, the "display setting" of the clock object 50 will be referred to as "display setting S." "Orientation" represents the orientation of an object in the virtual space 2. "Orientation" may represent an azimuth angle on the XY plane, or an azimuth angle and an elevation angle in the XYZ space. "Orientation" is set for objects that are directly placed (installed) in the virtual space 2. In FIG. 4, the orientation of the clock object 50 with the object ID "OJ001" is set to "D1." "D1" represents a predetermined azimuth angle. An "appearance variation" is a code representing one of multiple different appearance variations (appearances) preregistered for the object. The object is displayed in virtual space 2 with an appearance indicated by the code set in the "appearance variation." Specific appearance settings corresponding to each code of the "appearance variation" are registered in variation data 1331 included in object data 133.
[0022] A "corresponding object" is the object ID of another object that is registered in advance in association with the object in that data row. In the example shown in FIG. 4, a wristwatch object 60 with an object ID of "OJ901" is registered as a corresponding object of a clock object 50 with an object ID of "OJ001". Multiple corresponding objects may be registered for one object. The corresponding object is used to determine whether or not the target avatar condition described below is satisfied.
[0023] 4 illustrates row data relating to a clock object 50 and a wristwatch object 60, but the object data 133 also includes row data relating to various other objects that may be components of the virtual space 2. For example, the object data 133 includes data on objects that are components of facilities (parks, event venues, etc.) in the virtual space 2.
[0024] FIG. 5 is a diagram showing an example of the content of the variation data 1331. As shown in FIG. One row of data in the variation data 1331 corresponds to one appearance variation of a certain object. Each row of data includes data on items such as "object ID", "appearance variation", "applicable conditions", "base design", "time display method", "face color", and "bezel color".
[0025] "Object ID" represents the object ID of the object for which the appearance variation of the data row is registered. "Appearance variation" is a code assigned to the appearance variation of the data row. In Fig. 5, ten appearance variations, "Default 1", "Default 2", and "V1" to "V8", are registered for a clock object 50 with an object ID of "OJ001". "Application conditions" indicate the conditions under which the appearance variation of that data row is applied. "Application conditions" include data on the sub-items "avatar" and "placement position." "Avatar" indicates the conditions related to the avatar 40 that is within the reference range R (see Figures 8 and 9, etc.) described below. "Placement position" indicates the conditions related to the placement position of an object. Below, the part of the variation data 1331 that corresponds to the "application conditions" is also referred to as "application conditions C." Details of application conditions C will be described later. The "base design" refers to the type of design that is the base of the appearance variation. The specific content of the base design is not particularly limited, but may be, for example, a design that defines the shape of each part that constitutes the object. "Time display format" indicates whether the format in which the clock object 50 displays time is "digital" or "analog." "Face color" represents the color setting of the watch face 51 (see FIG. 8) of the clock object 50 in that appearance variation. "Bezel color" represents the color setting of the bezel 52 (see FIG. 8) of the clock object 50 in that appearance variation. 5. For example, it may include settings related to the colors of parts other than the watch face 51 and the bezel 52. It may also include settings for the shape, pattern, etc. of each part. The variation data 1331 may also include a file path of 3D model data of the object (or each part of the object), etc.
[0026] 2, the communication unit 14 performs a communication operation in accordance with a predetermined communication standard. The communication unit 14 transmits and receives data to and from the control device 20 via the network N through this communication operation.
[0027] (Control device configuration) FIG. 6 is a block diagram showing the functional configuration of the control device 20. As shown in FIG. The control device 20 includes a CPU 21, a RAM 22, a storage unit 23, an operation input unit 24, an output unit 25, a communication unit 26, and a bus 27. The components of the control device 20 are connected via the bus 27. The control device 20 is, for example, a notebook PC or a desktop PC, but is not limited to these and may be a tablet terminal, a smartphone, or the like.
[0028] The CPU 21 is a processor that reads and executes the program 231 stored in the storage unit 23 and performs various arithmetic processing to control the operation of each unit of the control device 20. The control device 20 may have multiple processors (e.g., multiple CPUs), and the multiple processes executed by the CPU 21 of this embodiment may be executed by the multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.
[0029] The RAM 22 provides a working memory space for the CPU 21 and stores temporary data.
[0030] The storage unit 23 is a non-transitory recording medium readable by the CPU 21 as a computer, and stores programs such as the program 231 and various data. The storage unit 23 includes a non-volatile memory such as an HDD or SSD. The program is stored in the storage unit 23 in the form of a computer-readable program code. The data stored in the storage unit 23 includes avatar data 232 and object data 233. The object data 233 includes variation data 2331. The avatar data 232 and the object data 233 are data received from the server 10 and stored in the storage unit 23. The avatar data 232 includes at least a part of the same data as the avatar data 132 of the server 10. The object data 233 and the variation data 2331 include at least a part of the same data as the object data 133 and the variation data 1331 of the server 10, respectively. In this embodiment, as shown in FIGS. 3 to 5, it is assumed that avatar data 232, object data 233, and variation data 2331 are the same as avatar data 132, object data 133, and variation data 1331, respectively.
[0031] The operation input unit 24 receives an input operation by a user, and outputs an input signal according to the input operation to the CPU 21. The operation input unit 24 includes input devices such as a keyboard, a mouse, and a touch panel.
[0032] The output unit 25 outputs to the user information related to the processing contents and various statuses in the control device 20. The output unit 25 includes, for example, a display device such as a liquid crystal display, a sound output device such as a speaker, and a light emitting device such as an LED.
[0033] The communication unit 26 performs a communication operation according to a predetermined communication standard. Through this communication operation, the communication unit 26 transmits and receives data to and from the server 10 via the network N. The communication unit 26 also transmits and receives data to and from the VR device 30 via wireless communication.
[0034] (VR device configuration) FIG. 7 is a block diagram showing the functional configuration of the VR device 30. The VR device 30 includes a VR headset 31, a controller 32 for a right hand, and a controller 32 for a left hand. The two controllers 32 are connected to the VR headset 31 wirelessly or via a wire to enable data communication. The VR headset 31 is used by being worn on the user's head. The controller 32 is used by being worn or held on the user's hand. The controller 32 corresponds to an "input unit."
[0035] The VR headset 31 includes a CPU 311, a RAM 312, a storage unit 313, an operation input unit 314, a display unit 315, a sound output unit 316, a sensor unit 317, a communication unit 318, and a bus 319. The various units of the VR headset 31 are connected to each other via the bus 319.
[0036] The CPU 311 is a processor that reads and executes a program 3131 stored in the storage unit 313 and performs various arithmetic processing to control the operation of each unit of the VR headset 31. Note that the VR headset 31 may have multiple processors (e.g., multiple CPUs), and the multiple processes executed by the CPU 311 of this embodiment may be executed by the multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.
[0037] The RAM 312 provides a working memory space for the CPU 311 and stores temporary data.
[0038] The storage unit 313 is a non-transitory recording medium readable by the CPU 311 as a computer, and stores the program 3131 and various data. The storage unit 313 includes a non-volatile memory such as a flash memory. The program 3131 is stored in the storage unit 313 in the form of a computer-readable program code.
[0039] The operation input unit 314 includes various switches, buttons, etc., accepts an input operation by a user, and outputs an input signal corresponding to the input operation to the CPU 311. The operation input unit 314 may also include a microphone, and may be capable of accepting an input operation by the user's voice via the microphone. The operation input unit 314 corresponds to the "input unit."
[0040] The display unit 315 displays an image to be viewed by a user wearing the VR headset 31. The display unit 315 includes a liquid crystal display, an organic EL display, or the like, provided in a position viewable by a user wearing the VR headset 31. Image data of an image displayed by the display unit 315 is transmitted from the control device 20 to the VR headset 31. The display unit 315 displays an image based on the received image data under the control of the CPU 311.
[0041] The sound output unit 316 outputs various sounds that are recognized by the hearing of a user wearing the VR headset 31. The sound output unit 316 includes a speaker that outputs sounds. Sound data of the sounds output by the sound output unit 316 is transmitted from the control device 20 to the VR headset 31. The sound output unit 316 outputs sounds based on the received sound data under the control of the CPU 311.
[0042] The sensor unit 317 detects the movement and orientation of the head of the user wearing the VR headset 31. The sensor unit 317 includes, for example, a three-axis acceleration sensor that detects acceleration in three orthogonal axial directions, a three-axis gyro sensor that detects angular velocity around three orthogonal axes, and a three-axis geomagnetic sensor that detects geomagnetism in three orthogonal axial directions. The CPU 311 derives the movement and orientation of the user's head based on the acceleration data, angular velocity data, and geomagnetic data received from the sensor unit 317. The sensor unit 317 is capable of receiving the movement and orientation of the user as a user operation, and corresponds to an "input unit."
[0043] The communication unit 318 performs a communication operation in accordance with a predetermined communication standard. Through this communication operation, the communication unit 318 transmits and receives data between the controller 32 and the control device 20 via wireless communication.
[0044] The controller 32 includes a CPU 321 which controls the overall operation of the controller 32, a RAM 322 which provides working memory space for the CPU 321, a memory unit 323 in which programs and data necessary for executing the programs are stored, an operation input unit 324, a sensor unit 325, and a communication unit 326 which performs data communication with the VR headset 31.
[0045] The operation input unit 324 (input unit) includes various switches, buttons, operation keys, etc., accepts an input operation by a user, and outputs an input signal according to the input operation to the CPU 321. In addition, the operation input unit 324 may be capable of separately detecting the movement of each finger of the user.
[0046] The sensor unit 325 includes a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor, and detects the movement and orientation of the hand of the user holding or wearing the controller 32. The configuration and operation of the sensor unit 325 may be similar to those of the sensor unit 317 of the VR headset 31, for example.
[0047] The configuration of the VR device 30 is not limited to the above. For example, the VR equipment 30 may further include an auxiliary sensor device that is not held or worn by the user. This sensor device may be, for example, a device that is installed on the floor or the like and optically detects the movement of the user or the movement of the VR headset 31 and the controller 32 by laser scanning or the like. In addition, in cases where it is not necessary to detect the movements of both hands separately, one of the controllers 32 may be omitted. In addition, in cases where the VR headset 31 is capable of detecting the necessary user movements and input operations, the controller 32 may be omitted.
[0048] (Basic operation of information processing system) Next, the basic operation of the information processing system 1 will be described. In the following description, the subject of operation is the CPU 11 of the server 10, the CPU 21 of the control device 20, the CPU 311 of the VR headset 31, or the CPU 321 of the controller 32, but for ease of explanation, the server 10, the control device 20, the VR headset 31, or the controller 32 may be described as the subject of operation. In addition, the user's movements and input operations detected by the VR device 30 are hereinafter collectively referred to as "user operations." That is, the "user operations" in this embodiment include input operations detected by the operation input unit 314 of the VR headset 31 and the operation input unit 324 of the controller 32, and actions detected by the sensor unit 317 of the VR headset 31 and the sensor unit 325 of the controller 32. In the following description, the image display operation in the VR headset 31 will be mainly described, and a description of other operations such as sound output will be omitted.
[0049] When a user starts using a VR service provided by the information processing system 1, the user puts on the VR headset 31 and the controller 32 of the VR device 30 and performs a predetermined operation to start the VR service. In response to the operation, user authentication information is transmitted from the control device 20 to the server 10, and when the user is authenticated by the server 10, the authentication result is returned from the server 10 to the control device 20, and the provision of the VR service to the authenticated user is started.
[0050] When the VR service is started, the control device 20 downloads the necessary avatar data 232 and object data 233 from the server 10 and stores them in the storage unit 23. In addition, the control device 20 starts transmitting image data of the virtual space 2 to the VR headset 31 of the VR device 30. Here, the position of the user's avatar 40 in the virtual space 2 is set to a predetermined initial position, and image data of the virtual space 2 seen from the viewpoint of the avatar 40 at the initial position is transmitted to the VR headset 31. The image data is generated based on the avatar data 232, the object data 233, and the like. In response to the transmission of the image data, the display unit 315 of the VR headset 31 starts displaying the VR screen 70 of the virtual space 2 based on the received image data.
[0051] FIG. 8 is a diagram showing a VR screen 70. 8 is a three-dimensional image of a park provided in the virtual space 2, and is an image of the park seen from the viewpoint of the avatar 40 corresponding to the user currently operating (hereinafter, referred to as the "avatar 40 currently operating"). As such, since the VR screen 70 is a first-person viewpoint of the avatar 40, the avatar 40 currently operating is not generally displayed on the VR screen 70. Instead of the VR screen 70, a third-person viewpoint screen (not shown) seen from a third-person viewpoint different from the viewpoint of the avatar 40 may be displayed. The third-person viewpoint screen displays the appearance of the avatar 40 being operated. The user may be able to switch between the VR screen 70 and the third-person viewpoint screen by performing a predetermined operation.
[0052] In the park in the virtual space 2 shown in Fig. 8, a clock object 50 with an avatar ID of "OJ001" is placed on a pedestal. The clock object 50 is a wristwatch-type object for display or advertising purposes, with approximately the same height as the avatar 40. The position at which the clock object 50 is placed in the virtual space 2 is referred to as object position P. The object position P is a point on the XY plane, and may be, for example, the center position (center of gravity position) of the clock object 50 when viewed from the +Z direction.
[0053] In the object data 233 at the start of the VR service, the "orientation" and "appearance variation" of the display setting S of the clock object 50 are set to predetermined initial settings. The clock object 50 with an appearance reflecting this initial setting is displayed on the VR screen 70. The initial setting of the "appearance variation" is set to "default 1" or "default 2" in the variation data 2331 shown in FIG. 5. In FIG. 8, the clock object 50 is placed outdoors, so the setting of "default 1" in which the "placement position" of the application condition C in the variation data 2331 is "outdoors" is applied. In accordance with the setting of "default 1", the appearance of the clock object 50 in FIG. 8 has the watch face 51 and bezel 52 in white.
[0054] In addition, when the VR service is started and the VR screen 70 is displayed, the VR device 30 starts to detect user operations, and the detection results are continuously transmitted to the control device 20. The control device 20 controls the operation of the avatar 40 in the virtual space 2 in response to the received user operations. That is, the control device 20 specifies and updates the position and operation of the avatar 40 in the virtual space 2 in real time from the received user operations. Here, the information on the position of the avatar 40 includes information on the orientation and posture of the avatar 40. The specified latest position and operation are reflected in the position operation information Ib in the avatar data 232 (the position operation information Ib is updated to contents reflecting the latest position and operation). Then, the control device 20 generates image data of the virtual space 2 seen from the viewpoint of the avatar 40 in the updated position and transmits it to the VR headset 31. This generation and transmission of image data is repeatedly performed at a predetermined frame rate. The display unit 315 of the VR headset 31 displays the VR screen 70 at the above frame rate based on the received image data of the virtual space 2. This allows a user wearing the VR headset 31 to view the inside of the virtual space 2 in real time from the viewpoint of an avatar 40 that moves and acts within the virtual space 2 in response to the user's operations.
[0055] The above operation is executed in each of the multiple control devices 20 receiving the VR service. The real-time position and motion information Ib relating to each avatar 40 is transmitted from each of the multiple control devices 20 to the server 10. The position and motion information Ib in the avatar data 132 of the server 10 is updated to include the latest position and motion information Ib transmitted from each control device 20. Then, the position and motion information Ib relating to the multiple avatars 40 in the avatar data 132 is transmitted to each control device 20 in real time and reflected in the avatar data 232. By referring to this avatar data 232, each control device 20 can specify the position and motion of the other avatar 40. If the position of the other avatar 40 is within the display range of the VR screen 70 being displayed, the other avatar 40 is displayed on the VR screen 70.
[0056] FIG. 9 is a diagram showing a VR screen 70 on which other avatars 40a and 40b are displayed. 9, avatars 40a and 40b other than the avatar 40 being operated are displayed. The avatar ID of the avatar 40a is "A001" in the avatar data 232 of FIG. 3, and the avatar 40a is wearing a wristwatch object 60 with an object ID of "OJ901". The positions of the avatars 40a and 40b are denoted as avatar positions Pa and Pb, respectively. The avatar positions Pa and Pb are points on the XY plane, and may be the center positions (centers of gravity) of the avatars 40a and 40b when viewed from the +Z direction, for example.
[0057] (Adjustment of the display mode of the object) In this embodiment, when an avatar 40 that satisfies a predetermined target avatar condition (predetermined condition) is located within a reference range R including an object position P in a virtual space 2 in which a clock object 50 is placed, a display setting S (setting related to a display mode) of the clock object 50 in the virtual space 2 is adjusted based on the avatar information Ia related to the avatar 40. For example, when an avatar 40a located within the reference range R in Fig. 9 satisfies the target avatar condition, the display setting S "orientation" and "appearance variation" of the clock object 50 are adjusted.
[0058] 8 and 9, in this embodiment, the reference range R is a circle centered on the object position P and having a radius of a predetermined distance D. When the avatar position Pa of the avatar 40a is within the reference range R, the avatar 40a is determined to be within the reference range R.
[0059] In this embodiment, the target avatar condition is: (i) the avatar 40 has the corresponding object, or (ii) When the avatar 40 is performing a photographing action to photograph the virtual space 2 is filled with. Hereinafter, the adjustment operation of the display mode of the clock object 50 will be specifically described for each of the target avatar conditions (i) and (ii).
[0060] <(i) Adjustment operation according to the target avatar's condition regarding possession of the corresponding object> In the situation shown in FIG. 9, the corresponding object corresponding to the clock object 50 is the wristwatch object 60 with an object ID of "OJ901" as shown in the object data 233 in FIG. 4. The corresponding object may be, for example, the wristwatch object 60 manufactured by the same manufacturer as the clock object 50. The corresponding object may be, instead of the corresponding object itself, an object that can be regarded as substantially the same as the corresponding object, an object that provides substantially the same effect in the virtual space 2, or the like. For example, when the avatar 40 possesses specific data (such as ticket data) provided by the manufacturer of the clock object 50 and that provides substantially the same effect as the corresponding object, the avatar 40 may be regarded as possessing the corresponding object.
[0061] 9 is wearing the wristwatch object 60, which is a corresponding object, and therefore satisfies the target avatar condition. Since the avatar 40a that satisfies the target avatar condition is within the reference range R, the display setting S of the watch object 50 is adjusted based on the avatar information Ia of the avatar 40a.
[0062] The adjustment operation of the display setting S includes adjustment of the “orientation” of the display setting S. FIG. 10 is a diagram illustrating the operation of adjusting the orientation of the clock object 50. In FIG. In this embodiment, as shown in Figs. 9 and 10, the "orientation" of the display setting S is adjusted so that the watch face 51 (predetermined portion) of the clock object 50 faces the avatar 40a. For example, the "orientation" setting is changed so that the normal direction of the watch face 51 is the direction from the object position P to the avatar position Pa. Since the "orientation" in this embodiment represents an azimuth angle, the clock object 50 rotates around the Z axis by changing the "orientation". As a result, the orientation of the clock object 50 shown in Fig. 8 is changed to the orientation of the clock object 50 shown in Fig. 9. Note that the azimuth angle and the elevation angle may be changed by changing the "orientation". For example, the azimuth angle and the elevation angle of the clock object 50 may be changed so that the watch face 51 faces the face of the avatar 40a.
[0063] The adjustment operation of the display setting S includes adjustment (change) of the "appearance variation" of the display setting S. The "appearance variation" is adjusted based on the application condition C of the variation data 2331 shown in FIG. 5. That is, for a certain appearance variation among the multiple types of registered appearance variations, when the condition of "avatar" of the application condition C corresponds to the avatar 40a and the condition of "location" of the application condition C corresponds to the location of the clock object 50, the certain appearance variation is selected and reflected in the display setting S. In the example shown in FIG. 9, the avatar 40a has a corresponding object and the clock object 50 is placed outdoors, so that the application condition C of the appearance variation "V1" in FIG. 5 is satisfied. Therefore, the "appearance variation" of the display setting S is changed to "V1" and reflected in the appearance of the clock object 50. By reflecting the appearance variation of "V1", the bezel 52 of the clock object 50 shown in FIG. 9 is changed to red. In addition, the band and the like are also changed to red according to the setting omitted in FIG. 5. The appearance variation "V1" may be the same model (design) as the corresponding object, the wristwatch object 60. Selecting the appearance variation "V1" corresponds to adjusting the display setting S so that the display mode corresponds to the object possessed by the avatar 40.
[0064] Priorities may be determined in advance for a plurality of appearance variations, and when application conditions C for two or more appearance variations are satisfied, the appearance variation with the highest priority may be selected. For example, if the appearance variation "V3" has a higher priority than "V1" and the "appearance" of the avatar 40 possessing the corresponding object is "formal", the appearance variation "V3" is selected instead of "V1" and reflected in the display setting S. Selecting the appearance variation "V3" corresponds to adjusting the display setting S so that the display mode corresponds to the appearance of the avatar 40. For example, if the appearance of the avatar 40 is "formal", an appearance variation corresponding to a model with a formal design (e.g., metal-based) may be selected. Also, if the appearance of the avatar 40 is "casual", an appearance variation corresponding to a model with a casual design (e.g., resin-based) may be selected. Also, the appearance of the avatar 40 may be the main color of the clothes or exterior. For example, if the avatar 40 is wearing clothes or exterior of a red color, an appearance variation corresponding to a model whose main color is a red color may be selected. Each of the above models may be an actual model. Furthermore, if the appearance variation "V4" has a higher priority than "V1" and the "attribute" of the avatar 40 possessing the corresponding object is "animal", then the appearance variation "V4" is selected instead of "V1" and reflected in the display setting S. Selecting the appearance variation "V4" corresponds to adjusting the display setting S so that the display mode corresponds to the attribute of the avatar 40.
[0065] Next, the operation when multiple avatars 40 that satisfy the target avatar conditions are located within reference range R will be described. FIG. 11 is a diagram illustrating the operation of adjusting the orientation of the clock object 50 when there are multiple avatars 40. In FIG. In FIG. 11, three avatars 40a to 40c that satisfy the target avatar condition are located within the reference range R. The positions of the avatars 40a to 40c are defined as avatar positions Pa to Pc, respectively. In this case, the "orientation" of the display setting S of the clock object 50 is adjusted so that the watch face 51 of the clock object 50 faces the representative point Q of the multiple avatars 40a to 40c. The representative point Q may be the average position of the avatar positions Pa to Pc, or may be the midpoint between the avatar positions of the two outermost avatars 40. In this case, the "orientation" setting is changed so that the normal direction of the watch face 51 is the direction from the object position P to the representative point Q. Alternatively, the representative point Q may be a point having a predetermined height in the Z direction. In this case, the "orientation" setting may be changed so that the normal direction of the watch face 51 is the direction toward the representative point Q.
[0066] Furthermore, the adjustment of the "appearance variation" of the display setting S is performed, for example, based on the avatar information Ia of a representative avatar determined from the avatars 40a to 40c that satisfy the target avatar conditions. The representative avatar may be, for example, the avatar 40 located closest to the object position P, or the avatar 40 located closest to the representative point Q. Alternatively, when the majority or all of the avatars 40 among the avatars 40a to 40c that satisfy the target avatar conditions have a common attribute or appearance, an appearance variation may be selected based on the attribute or appearance. For example, when the number of male avatars 40 is greater than the number of female avatars 40, an appearance variation corresponding to a model for men may be selected. When the number of female avatars 40 is greater than the number of male avatars 40, an appearance variation corresponding to a model for women may be selected. When the majority of the avatars 40 are wearing clothes or exteriors in a reddish color, an appearance variation corresponding to a model whose main color is a reddish color may be selected.
[0067] After the display setting S is adjusted as described above, if a predetermined restoration condition is satisfied, the display setting S may be returned to the state before the adjustment. The restoration condition may be, for example, that an avatar 40 satisfying the target avatar condition is no longer present within the reference range R. In addition, the restoration condition may be that a predetermined waiting time has elapsed after the display setting S is adjusted. The length of the waiting time is not particularly limited, but may be, for example, about 5 seconds.
[0068] <(ii) Adjustment Operation According to Target Avatar Conditions Related to Shooting Operation> Next, the target avatar conditions related to the above shooting operation (ii) will be described. The user can start a virtual camera application for causing the avatar 40 to capture an image of the virtual space 2 by performing a predetermined shooting start operation on the VR device 30.
[0069] FIG. 12 is a diagram showing the VR screen 70 when the avatar 40 being operated is within the reference range R. FIG. 13 is a diagram showing a VR screen 70 when the avatar 40 starts a virtual camera application in the state shown in FIG. As shown in FIG. 13, when the virtual camera application is started, a virtual shooting window 80 is displayed on the VR screen 70. The shooting window 80 shows the range to be shot in real time. The function of the shooting window 80 corresponds to the function of a liquid crystal monitor for live view shooting in a real camera. The user can adjust the shooting range in the shooting window 80 by adjusting the orientation of the VR headset 31 or the controller 32 or by performing a predetermined operation. In addition, the user can cause the avatar 40 to shoot by performing a predetermined shooting operation. Data of the shot image is stored in the storage unit 23 of the control device 20.
[0070] Displayed near the shooting window 80 are an end button 81, a frame fixing button 82, a video button 83, a timer button 84, a zoom-in button 85, and a zoom-out button 86. When the end button 81 is selected, the photographing window 80 is cleared and the photographing operation is terminated. When the frame fixing button 82 is selected, the shooting range of the shooting window 80 is fixed. By moving the avatar 40 being operated within the shooting range while keeping the shooting range fixed, it is possible to take a commemorative photo or the like including the avatar 40 being operated. When the video button 83 is selected, a transition to a mode in which videos are captured instead of still images is made. When a shooting operation is performed with the timer button 84 selected, shooting is performed when a predetermined timer time has elapsed since the shooting operation. When the zoom-in button 85 or the zoom-out button 86 is selected, the shooting range can be zoomed in or out by an adjustment amount according to the number of times the button is selected. Instead of the zoom-in button 85 or the zoom-out button 86, a slider bar for zoom adjustment may be used.
[0071] When the virtual camera application is started, it is determined that the avatar 40 is in the shooting operation, and the target avatar condition is satisfied. Therefore, in the state shown in FIG. 13, the avatar 40 being operated, which satisfies the target avatar condition, is within the reference range R, so that the display setting S of the clock object 50 is adjusted based on the avatar information Ia of the avatar 40 being operated. The method of adjusting the display setting S is the same as that of (i) above. For example, by starting the shooting operation from the state shown in FIG. 12, the "orientation" of the display setting S is adjusted so that the watch face 51 of the clock object 50 faces the avatar 40 being operated, as shown in FIG. 13. In addition, since the avatar 40 being operated is in the shooting operation and the clock object 50 is placed outdoors, the application condition C of the appearance variation of "V2" in the variation data 2331 of FIG. 5 is satisfied. Therefore, the "appearance variation" of the display setting S is changed to "V2", and is reflected in the appearance of the clock object 50. By reflecting the appearance variation of "V2", the bezel 52 of the clock object 50 shown in Fig. 13 has been changed to blue. Also, the band and the like have been changed to blue according to the settings omitted in Fig. 5.
[0072] (Global display mode and local display mode) In this embodiment, the clock object 50 on the VR screen 70 is displayed in either the global display mode or the local display mode. The global display mode is a display mode in which the clock object 50 is viewed in a common display manner by multiple (all) avatars 40. When the display setting S of the clock object 50 is adjusted in the global display mode, the adjustment is performed so that the display manner of the clock object 50 as viewed by the multiple avatars 40 becomes common. On the other hand, the local display mode is a display mode in which the display mode of the clock object 50 may differ for each avatar 40. When the display setting S of the clock object 50 is adjusted in the local display mode, the display setting S is adjusted separately and independently for each avatar 40 based on the relationship between each of the multiple avatars 40 and the clock object 50.
[0073] The global display mode and the local display mode may be switched in response to the movement of any avatar 40 (user). FIG. 14 is a diagram for explaining a method of switching between the global display mode and the local display mode. 14, it is assumed that three avatars 40a to 40c that satisfy the target avatar conditions are within a reference range R. In addition, a switching object 90 for switching the display mode is placed near the clock object 50. Every time an avatar 40 performs a predetermined operation (e.g., a touching action) on the switching object 90, the display mode is switched between the global display mode and the local display mode.
[0074] FIG. 15 is a diagram showing an example of adjustment of the display mode in the global display mode. 15 is a VR screen 70a corresponding to the avatar 40a in FIG. 14, the center is a VR screen 70b corresponding to the avatar 40b, and the right is a VR screen 70c corresponding to the avatar 40c. In this way, in the global display mode, an image of the clock object 50 with the common adjusted display setting S ("orientation" and "appearance object") viewed from the position of each avatar 40 is displayed on the VR screen 70 corresponding to each avatar 40.
[0075] FIG. 16 is a diagram showing an example of adjustment of the display mode in the local display mode. The left, center, and right diagrams in FIG. 16 are also VR screens 70a to 70c corresponding to the avatars 40a to 40c in FIG. 14, respectively. In this way, in the local display mode, an image of the clock object 50 of the display setting S ("orientation" and "appearance object") adjusted separately and independently according to the avatar information Ia of each avatar 40 is displayed on the VR screen 70 corresponding to each avatar 40, viewed from the position of each avatar 40. In detail, the "orientation" of the display setting S is adjusted so that the watch face 51 faces each avatar 40 as viewed from each avatar 40. In addition, the application condition C satisfied for each avatar 40 is specified, and the "appearance variation" corresponding to the application condition C is selected and reflected in the display setting S. For example, the appearance variation "V2" is selected on the VR screen 70a corresponding to the avatar 40a, the appearance variation "V4" is selected on the VR screen 70b corresponding to the avatar 40b, and the appearance variation "V3" is selected on the VR screen 70c corresponding to the avatar 40c.
[0076] Switching between the global display mode and the local display mode is not limited to a predetermined operation on the switching object 90. For example, when the distance between the position of the avatar 40a in FIG. 14 and the position of the avatar 40b closest to the avatar 40a is within a predetermined distance, the avatar 40a and the avatar 40b are determined to be in the same group, and the VR screens 70a to 70b corresponding to the avatars 40a to 40b are automatically displayed in the global display mode. Similarly, when the distance between the position of the avatar 40b and the position of the avatar 40c closest to the avatar 40b is within a predetermined distance, the avatars 40a to 40c are determined to be in the same group, and the VR screens 70a to 70c corresponding to the avatars 40a to 40c are automatically displayed in the global display mode. As a result, when a plurality of avatars 40 are gathered in relatively close positions in the VR space 2, the avatars 40 present nearby are regarded as one (same) group, and each group is displayed in the global display mode, so that commemorative photos can be taken efficiently.
[0077] (Object display processing) Next, a description will be given of an object display process executed in the information processing system 1 to realize the above operation. The following description will focus on the process executed by the CPU 11 of the server 10 out of the object display process.
[0078] FIG. 17 is a flowchart showing a control procedure for the object display process. The object display process is executed when a VR service is started for at least one user. When the object display process is started, the CPU 11 of the server 10 sets the display setting S of the clock object 50 in the object data 133 to the default setting (for example, the default "orientation" and the "appearance variation" of "default 1") and transmits this display setting S to each control device 20. As a result, the CPU 11 starts displaying the clock object 50 in the VR headset 31 with the default display setting S (step S101). The CPU 11 also starts receiving and aggregating position and motion information Ib of the avatar 40 from each control device 20 and transmitting it to each control device 20 (step S102).
[0079] The CPU 11 repeatedly determines whether the avatar 40 is within a reference range R centered on the object position P of the clock object 50 (step S103), and if it is determined that the avatar 40 is within the reference range R ("YES" in step S103), it executes a target avatar condition determination process (step S104).
[0080] FIG. 18 is a flowchart showing a control procedure for the target avatar condition determination process. When the target avatar condition determination process is called, the CPU 11 selects one avatar 40 within the reference range R (step S201). The CPU 11 refers to the avatar data 132 and determines whether the selected avatar 40 possesses the corresponding object (step S202). If it is determined that the selected avatar 40 possesses the corresponding object ("YES" in step S202), the CPU 11 determines that the selected avatar 40 satisfies the target avatar condition (step S204).
[0081] If it is determined that the selected avatar 40 does not possess the corresponding object ("NO" in step S202), the CPU 11 refers to the latest position and movement information Ib of the avatar data 132 and determines whether the selected avatar 40 is performing a photographing action (step S203). If it is determined that the selected avatar 40 is performing a photographing action ("YES" in step S203), the CPU 11 determines that the selected avatar 40 satisfies the target avatar condition (step S204).
[0082] If it is determined that the selected avatar 40 is not performing a photographing action ("NO" in step S203), or if step S204 is completed, the CPU 11 determines whether or not there is an unselected avatar 40 (step S205). If it is determined that there is an unselected avatar 40 ("YES" in step S205), the CPU 11 returns the process to step S201, and if it is determined that there is no unselected avatar 40, the CPU 11 ends the target avatar condition determination process and returns the process to the object display process of FIG. 17.
[0083] 17, the CPU 11 determines whether or not there is an avatar determined to satisfy the target avatar condition in the target avatar condition determination process (step S105). If there is no avatar determined to satisfy the target avatar condition ("NO" in step S105), the CPU 11 returns the process to step S103, and if there is an avatar determined to satisfy the target avatar condition ("YES" in step S105), the CPU 11 executes a display setting adjustment process (step S106).
[0084] FIG. 19 is a flowchart showing a control procedure of the display setting adjustment process. When the display setting adjustment process is called, the CPU 11 determines whether or not the current display mode is the global display mode (step S301).
[0085] If it is determined that the mode is the global display mode ("YES" in step S301), CPU 11 derives representative point Q of avatar 40 that satisfies the target avatar condition (step S302). If there is only one avatar 40 that satisfies the target avatar condition, the avatar position of that avatar 40 is set as representative point Q. CPU 11 adjusts the "orientation" of display setting S of object data 133 so that watch face 51 of clock object 50 faces representative point Q (step S303).
[0086] The CPU 11 determines a representative avatar from among the avatars 40 that satisfy the target avatar conditions (step S304). If there is only one avatar 40 that satisfies the target avatar conditions, the avatar 40 is designated as the representative avatar. The CPU 11 identifies an application condition C that is satisfied for the representative avatar based on the avatar information Ia of the representative avatar, selects an "appearance variation" that corresponds to the application condition C, and reflects it in the display setting S of the object data 133 (step S305).
[0087] If it is determined in step S301 that the mode is not the global display mode (the mode is the local display mode) ("NO" in step S301), the CPU 11 adjusts the "orientation" of the display setting S of the object data 133 for each avatar 40 so that the watch face 51 of the clock object 50 faces each avatar 40 (step S306). Here, the CPU 11 holds the adjusted display setting S in the object data 133 for each avatar 40. Alternatively, a plurality of object data 133 corresponding to a plurality of avatars 40 may be generated, and the content of the display setting S in each object data 133 may be changed for each avatar 40.
[0088] Based on the avatar information Ia of each avatar 40, the CPU 11 identifies the application condition C that is satisfied for each avatar 40, selects an "appearance variation" that corresponds to the application condition C, and reflects it in the display setting S for each avatar 40 (the display setting S that is held or the display setting S in the multiple object data 133, as described above) (step S307). When step S305 or S307 ends, the CPU 11 ends the display setting adjustment process, and returns the process to the object display process of FIG.
[0089] 17, the CPU 11 transmits the adjusted display setting S to each control device 20, thereby causing the VR headset 31 to display the clock object 50 in accordance with the adjusted display setting S (step S107). In particular, in the global display mode, the CPU 11 transmits a common display setting S to each control device 20, causing the clock object 50 to be displayed in a common display mode in accordance with the display setting S. In addition, in the local display mode, the CPU 11 transmits the display setting S adjusted for each avatar 40 to each control device 20, causing the clock object 50 to be displayed in a display mode distinct from one another.
[0090] The CPU 11 determines whether the above-mentioned restoration condition is satisfied (step S108), and if it is determined that the restoration condition is not satisfied ("NO" in step S108), the process returns to step S103. If it is determined that the restoration condition is satisfied ("YES" in step S108), the CPU 11 returns the display setting S to the default, and transmits the display setting S to each control device 20 (step S109). This causes each VR headset 31 to display the clock object 50 in the default display mode.
[0091] The CPU 11 determines whether the display of the clock object 50 is to end (for example, the VR service is to end) (step S110), and if it is determined that the display of the clock object 50 is to continue ("NO" in step S110), the process returns to step S103. If it is determined that the display of the clock object 50 is to end ("YES" in step S110), the CPU 11 ends the object display process.
[0092] (Variation 1) Next, a first modified example of the above embodiment will be described. Below, differences from the above embodiment will be described, and a description of features common to the above embodiment will be omitted. The clock object 50 may be capable of changing its position in the virtual space 2, for example, by being carried by the avatar 40. When the position of the clock object 50 in the virtual space 2 is changed, the display setting S is adjusted so that the display mode of the clock object 50 becomes a display mode corresponding to the changed position. For example, when the clock object 50 is moved indoors by the avatar 40a from the situation in FIG. 9, the avatar 40a possesses the corresponding object and the clock object 50 is placed indoors, so that the application condition C of the appearance variation of the variation data 2331 "V5" in FIG. 5 is satisfied. Therefore, the appearance variation is changed from "V1" to "V5", and is reflected in the display of the clock object 50. Note that the "position" of the application condition C is not limited to "outdoors" and "indoors", and may be a specific area or a specific facility in the virtual space 2.
[0093] (Variation 2) Next, a second modification of the above embodiment will be described. Below, differences from the above embodiment will be described, and a description of features common to the above embodiment will be omitted. The second modification may be combined with the first modification. The display setting S may be adjusted so that the clock object 50 displays the analog time when the distance between the clock object 50 and the avatar 40 that satisfies the target avatar conditions is equal to or greater than a reference distance. The reference distance may be distance D, which is the radius of reference range R, or may be different from distance D. This allows the clock object 50 to display the analog time, making it easy to see the time even from a distance, when the avatar 40 is equal to or greater than the reference distance from the clock object 50. When the reference distance is distance D, the operation of this modified example can be realized by setting the "time display method" of "default 1" and "default 2" in the variation data 2331 in FIG. 5 to "analog." If the distance between the clock object 50 and the avatar 40 is less than the reference distance, the display setting S is adjusted based on the avatar information Ia as described in the above embodiment. Therefore, if the "time display method" of the selected appearance variation is "digital," the time display is changed to digital.
[0094] (effect) As described above, in the information processing method of this embodiment, when an avatar 40 that satisfies the target avatar conditions is located within a reference range R including an object position P in the virtual space 2 in which the clock object 50 is placed, the CPU 11 adjusts the display setting S related to the display mode of the clock object 50 in the virtual space 2 based on the avatar information Ia related to the avatar 40. This allows the display mode of the clock object 50 to be automatically changed when an avatar 40 that satisfies the target avatar conditions is in the vicinity of the clock object 50, making it possible to create a wider variety of expressions using the clock object 50. Furthermore, by setting the condition that the avatar 40 is within the reference range R and that the target avatar conditions are satisfied, it is possible to prevent the problem of the display mode of the clock object 50 changing more frequently than necessary, which would cause a sense of discomfort to the user. In addition, even when data capacity is limited, the clock object 50 can be recognized by the user as an exhibit more effectively and efficiently. For example, it becomes possible to exhibit a plurality of clock objects 50 in a limited space. Moreover, compared to the case where a plurality of clock objects 50 with different display modes are exhibited side by side, the rendering process can be reduced, and the load of each device of the information processing system 1 can be reduced.
[0095] The target avatar condition is satisfied when the avatar 40 possesses a predetermined corresponding object that corresponds to the clock object 50. This provides a user experience in which the possession of the corresponding object is used as a trigger to change the display mode of the clock object 50. Furthermore, the value of the corresponding object in the virtual space 2 can be increased, which can promote sales of the corresponding object, for example.
[0096] The target avatar condition is satisfied when the avatar 40 is performing a photographing action to photograph the virtual space 2. This allows the clock object 50 to automatically face the photographer. As a result, commemorative photographs, etc., can be easily taken in the virtual space 2, and the clock object 50 can be easily photographed at an ideal angle.
[0097] Furthermore, based on the position of the avatar 40 identified from the avatar information Ia, the CPU 11 adjusts the "orientation" of the display setting S of the clock object 50 so that the watch face 51 of the clock object 50 faces the avatar 40. This makes it possible for the avatar 40 that satisfies the target avatar condition to easily view the watch face 51.
[0098] Furthermore, when multiple avatars 40 that satisfy the target avatar conditions are located within the reference range R, the CPU 11 adjusts the "orientation" of the display setting S of the clock object 50 so that the watch face 51 of the clock object 50 faces the representative point Q of the multiple avatars 40. This makes it possible to make the watch face 51 easily visible to the multiple avatars 40 that satisfy the target avatar conditions.
[0099] Furthermore, the avatar information Ia includes information related to at least one of the appearance, attributes, and possessed objects of the avatar 40, and the CPU 11 adjusts the "appearance variation" of the display setting S so that the clock object 50 has a display mode corresponding to at least one of the appearance, attributes, and possessed objects of the avatar 40. This makes it possible to flexibly and appropriately change the appearance of the clock object 50 according to the characteristics of the avatar 40.
[0100] Adjustment of the display settings S also includes selecting and determining an appearance variation of the clock object 50 to be displayed from a plurality of different types of appearance variations registered in advance. This allows the appearance of the clock object 50 to be appropriately adjusted by a simple process of selecting an appearance variation.
[0101] Furthermore, by making the clock object 50 a target for adjusting the display mode, for example, it is possible to allow the user to effectively recognize the clock that is the model for the clock object 50.
[0102] Furthermore, when a predetermined restoration condition is satisfied after adjusting the display settings S, the CPU 11 returns the display settings S to the state before the adjustment (default state). This makes it possible to automatically return to the default state after necessary adjustments of the display mode are made.
[0103] Furthermore, the CPU 11 displays the clock object 50 in a global display mode in which the display setting S is adjusted so that the display mode of the clock object 50 as viewed from a plurality of avatars 40 is common, or in a local display mode in which the display setting S of the clock object 50 is adjusted separately and independently for each avatar 40 based on the relationship between each of the plurality of avatars 40 and the clock object 50, and switches between the global display mode and the local display mode in response to an operation of the avatar 40 on a switching object 90 provided in the virtual space 2. This allows the clock object 50 to be easily displayed in a display mode desired by the user.
[0104] Furthermore, the information processing system 1 according to the present embodiment and the server 10 as an information processing device include the above-mentioned CPU 11, so that more diverse expressions using the clock object 50 can be made possible.
[0105] Furthermore, the program 131 according to this embodiment causes the CPU 11 to execute a process of adjusting the display setting S related to the display mode of the clock object 50 in the virtual space 2 based on the avatar information Ia related to the avatar 40, when an avatar 40 that satisfies a target avatar condition is located within a reference range R including the object position P in the virtual space 2 in which the clock object 50 is placed. This makes it possible to provide a wider variety of expressions using the clock object 50.
[0106] Furthermore, in the information processing method according to the present embodiment, the CPU 311 of the VR device 30, which includes the display unit 315, and the operation input unit 314, the sensor unit 317, the controller 32, and the operation input unit 324 as input units, displays the clock object 50 in the virtual space 2 on the display unit 315 based on a display setting S related to the display mode of the clock object 50 in the virtual space 2, and the display setting S is adjusted based on the avatar information Ia related to the avatar 40 when an avatar 40 that satisfies the target avatar condition is located within a reference range R including the object position P in the virtual space 2. This enables a wider variety of expressions using the clock object 50.
[0107] (others) The above description of the embodiment is merely an example of the information processing method, the information processing system, and the program according to the present invention, and the present invention is not limited to this. For example, in the above embodiment, the server 10 adjusts the display setting S of the clock object 50, but instead, the control device 20 may adjust the display setting S. In this case, the control device 20 corresponds to the "information processing device", and the CPU 21 corresponds to the "processing device". That is, in the global display mode, each control device 20 receives from the server 10 the same data representing the situation of the avatar 40 around the clock object 50. Then, each control device 20 adjusts the common display setting S in the same manner as the server 10 does in the above embodiment, and reflects it in the display of the clock object 50. In addition, in the local display mode, each control device 20 independently changes the display setting S based on the relationship between the avatar 40 corresponding to the user of that control device 20 and the clock object 50, and reflects this in the display of the clock object 50. Also, the VR device 30 may adjust the display setting S. In this case, the VR device 30 corresponds to the "information processing device", and the CPU 311 corresponds to the "processing unit".
[0108] Furthermore, the adjustment of the display mode is not limited to the adjustment of the "orientation" and the "appearance object." For example, when an avatar 40 that satisfies the target avatar condition is within the reference range R, and the virtual space 2 satisfies a predetermined darkness condition (such as in the evening or at night), the display mode may be adjusted so that the watch face 51 of the clock object 50 is illuminated by an LED or a backlight.
[0109] Furthermore, the object whose display aspect is to be adjusted is not limited to the clock object 50, and the display aspect of any object (e.g., a piano, a calculator, etc.) placed in the virtual space 2 may be adjusted in the same manner as in the above embodiment.
[0110] Furthermore, the application conditions C in the object data 233 are not limited to those exemplified in Fig. 5. For example, the condition of "avatar" among the application conditions C may be the distance from the clock object 50 to the avatar 40. By associating different appearance variations with different distance ranges, it becomes possible to produce an effect in which the appearance of the clock object 50 changes according to the movement of the avatar 40 moving toward or away from the clock object 50. Furthermore, the adjustment of "orientation" in the display setting S may be omitted, and the condition of "avatar" in the application condition C may be the angle of the position of the avatar 40 from the front direction of the clock object 50 (the direction in which the watch face 51 faces). By associating different appearance variations with different angle ranges, it is possible to produce an effect in which the appearance of the clock object 50 changes according to the movement of the avatar 40 around the clock object 50. In addition, in FIG. 5, application condition C is a combination of a condition regarding the "avatar" and a condition regarding the "placement position", but this is not limited to this. For example, the condition regarding the "placement position" may be omitted, and only the condition regarding the "avatar" may be included.
[0111] The target avatar condition is not limited to being satisfied when (i) the corresponding object is held or (ii) a shooting action is being performed. For example, the target avatar condition may be satisfied when the avatar 40 has a predetermined attribute or when the clock object 50 has a predetermined appearance. The target avatar condition may be satisfied when the avatar 40 is shooting a video or is streaming the shot video in real time, that is, when an online streaming event is being held.
[0112] Also, the user may operate the avatar 40 without wearing the VR headset 31. In this case, instead of the VR headset 31, an image of the virtual space 2 is displayed on a normal display (for example, a liquid crystal display included in the output unit 25 of the control device 20) provided at a position visible to the user. The screen displayed in this case may be a VR screen 70 if the VR device 30 can detect the user's movements. Also, a third-person perspective screen may be displayed instead of the VR screen 70. For example, the user may operate the controller 32 to move the avatar 40 in the virtual space 2 from a third-person perspective.
[0113] Furthermore, the functions of the control device 20 may be integrated into the VR device 30 (for example, the VR headset 31), and the control device 20 may be omitted.
[0114] Also, the functions of the control device 20 may be integrated into the server 10, omitting the control device 20, and the VR service may be executed by the server 10 and the VR device 30. In this case, signals output from the operation input unit 324 and the sensor unit 325 of the VR device 30 are transmitted to the communication unit 14 of the server 10 via the communication unit 326. The server 10 controls the movement of the avatar 40 in the virtual space 2 in response to the received user operation. That is, the server 10 performs the same process as the control device 20 described above, generates image data of the virtual space 2, and transmits it to the VR device 30.
[0115] In the above description, an example has been disclosed in which the HDD and SSD of the storage unit 13 and storage unit 23 are used as computer-readable media for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, information recording media such as flash memory and CD-ROM can be applied. In addition, a carrier wave is also applied to the present invention as a medium for providing data of the program according to the present invention via a communication line.
[0116] Furthermore, it goes without saying that the detailed configuration and detailed operation of each component of the information processing system 1 in the above embodiment can be modified as appropriate without departing from the spirit of the present invention.
[0117] Although the embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and its equivalents. [Explanation of symbols]
[0118] 1. Information Processing Systems 2. Virtual Space 10 Server (information processing device) 11 CPU (processing unit) 13 Storage section 131 Programs 20 Control device 23 Memory section 30 VR equipment (terminal device) 31 VR Headset 314 Operation input section (input section) 315 Display section 317 Sensor section (input section) 32 Controller (input section) 324 Operation input section (input section) 40, 40a~40c Avatar 50 Clock Object (Object) 51 Watch Face (specified area) 60 Watch object (corresponding object, possession object) 70, 70a~70c VR screen 90 Switching Objects C Applicable conditions Ia Avatar Information Ib position movement information P Object position (object placement position) Pa~Pc avatar position Q representative point R Reference Range S Display settings (settings related to display mode)
Claims
1. 1. A computer-implemented information processing method, comprising: When an avatar that satisfies a predetermined condition is located within a reference range including a placement position of an object in a virtual space in which the object is placed, a setting related to a display mode of the object in the virtual space is adjusted based on avatar information related to the avatar. Information processing methods.
2. The predetermined condition is satisfied when the avatar has a predetermined corresponding object corresponding to the object. The information processing method according to claim 1 .
3. The predetermined condition is satisfied when the avatar is performing a photographing action for photographing the virtual space. The information processing method according to claim 1 .
4. adjusting the setting related to the orientation as the display mode of the object based on a position of the avatar identified from the avatar information so that a predetermined portion of the object faces the avatar; The information processing method according to claim 1 .
5. adjusting the setting related to the orientation as the display mode of the object such that a predetermined portion of the object faces a representative point of the plurality of avatars when the plurality of avatars satisfying the predetermined condition are located within the reference range; The information processing method according to claim 1 .
6. The avatar information includes information related to at least one of the appearance, attributes, and possessed objects of the avatar; adjusting the settings so that the object has a display mode corresponding to at least one of the appearance, the attributes, and the possessed object of the avatar; The information processing method according to claim 1 .
7. adjusting the settings includes selecting and determining an appearance of the object to be displayed from a plurality of different types of appearances registered in advance; The information processing method according to claim 1 .
8. adjusting the setting so that, when a placement position of the object in the virtual space is changed, a display mode of the object is changed to a display mode corresponding to the changed placement position; The information processing method according to claim 1 .
9. the object is a clock object, The information processing method according to claim 1 .
10. adjusting the setting so that the clock object displays analog time when the distance between the object and the avatar is equal to or greater than a reference distance; The information processing method according to claim 9.
11. after adjusting the settings, restoring the settings to their state prior to the adjustment if a predetermined restoration condition is met; The information processing method according to claim 1 .
12. displaying the object in a global display mode in which the settings are adjusted so that a display aspect of the object as viewed from a plurality of the avatars is common, or in a local display mode in which the settings related to the display aspect of the object are adjusted separately and independently for each of the plurality of avatars based on a relationship between each of the plurality of avatars and the object; switching between the global display mode and the local display mode in response to an operation of the avatar on a switching object provided in the virtual space; The information processing method according to claim 1 .
13. When an avatar that satisfies a predetermined condition is located within a reference range including a placement position of an object in a virtual space in which the object is placed, a setting related to a display mode of the object in the virtual space is adjusted based on avatar information related to the avatar. An information processing system including a processing unit.
14. When an avatar that satisfies a predetermined condition is located within a reference range including a placement position of an object in a virtual space in which the object is placed, a setting related to a display mode of the object in the virtual space is adjusted based on avatar information related to the avatar. An information processing device comprising a processing unit.
15. On the computer, A program that executes a process of adjusting settings related to the display mode of an object in a virtual space based on avatar information related to the avatar when an avatar that satisfies specified conditions is located within a reference range including the placement position of the object in a virtual space in which the object is placed.
16. An information processing method executed by a computer of a terminal device having a display unit and an input unit, displaying the object in the virtual space on the display unit based on a setting related to a display mode of the object in the virtual space; the setting is adjusted based on avatar information related to an avatar when an avatar that satisfies a predetermined condition is located within a reference range including a placement position of the object in the virtual space; Information processing methods.
Citation Information
Patent Citations
Server, program and method for providing video chat
JP2016152521A