Information processing system, information processing method, and information processing program

Abstract

To draw fine movement of a user object in a virtual space without excessively increasing a processing load.SOLUTION: A drawing processing unit configured to draw various objects in a virtual space to generate a display image; an input acquisition unit configured to acquire a user input; and a display control unit configured to control display of the display image, there is disclosed an information processing system including an information generation unit configured to generate positional relationship information indicating a positional relationship in a virtual space, and a drawing information storage unit configured to store first drawing information for drawing a first animation related to a combination of a predetermined object and a user object, in which the drawing processing unit draws the first animation on the basis of the first drawing information when a distance between the predetermined object and the user object becomes equal to or less than a predetermined distance on the basis of the positional relationship information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system, an information processing method, and an information processing program. [Background technology]

[0002] Using the tracking module, various states of the user's hand (pointing at something) , open hand, closed hand, pinching hand, twisted hand There are known technologies that can recognize situations such as a person standing next to another person, shaking hands, etc. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-128966 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, information related to a relatively large number of joints of the fingers is stored in a tracking module. Since the data must be acquired based on the rules, it is difficult to capture the precise movements of the user's hand as intended. While it is easy to reflect the hand movements of the user avatar in the virtual space, the number of joints increases. This poses a problem in that the processing load is likely to increase.

[0005] Therefore, in one aspect, the present disclosure provides a method for controlling a virtual space without increasing the processing load. The purpose of this is to make it possible to draw the detailed movements of the user object. [Means for solving the problem]

[0006] On the one hand, it records object information about various objects located in a virtual space. an object storage unit for storing the object; Based on the object information, various objects in the virtual space are drawn. a drawing processing unit that generates a display image; User input related to a user object associated with a user among various objects an input acquisition unit that acquires a force; Determine the movement of the user object in the virtual space based on the user input. an operation processing unit for determining One or more predetermined objects among various objects and the user object A positional relationship is an information generation method for generating positional relationship information that represents a positional relationship in the virtual space. With Naribe, a first animation relating to a combination of the predetermined object and the user object; a drawing information storage unit that stores first drawing information for drawing the object, The drawing processing unit determines whether the predetermined object and the user are in a predetermined position based on the positional relationship information. When the distance between the object and the image is equal to or shorter than a predetermined distance, the An information processing system is provided that renders a first animation. [Effects of the Invention]

[0007] In one aspect, the present disclosure provides a method for controlling a virtual space without excessively increasing a processing load. It becomes possible to draw the detailed movements of the user object. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram of a virtual reality generation system according to an embodiment of the present invention. [Figure 2] FIG. 10 is an explanatory diagram of an example of a display image on a head-mounted display. [Figure 3]FIG. 10 is an explanatory diagram of a first predetermined distance and a second predetermined distance related to a pencil object. [Figure 4] FIG. 10 is an explanatory diagram (part 1) of an animation relating to a combination of a pencil object and a user avatar. [Figure 5] FIG. 10 is an explanatory diagram (part 2) of an animation relating to a combination of a pencil object and a user avatar. [Figure 6] FIG. 10 is an explanatory diagram of an example of a state machine that can be suitably used in this embodiment. [Figure 7] FIG. 2 is a schematic block diagram showing a configuration related to the animation drawing function described above, among various functions of the terminal device. [Figure 8] FIG. 2 is an explanatory diagram of an example of data in an avatar storage unit. [Figure 9] FIG. 2 is an explanatory diagram of an example of data in a predetermined object storage unit. [Figure 10] FIG. 2 is an explanatory diagram of an example of data in an animation data storage unit. [Figure 11] FIG. 10 is an explanatory diagram of joint position information. [Figure 12] FIG. 2 is an explanatory diagram of an example of a field of view of a virtual camera. [Figure 13] FIG. 10 is an explanatory diagram (part 1) of an example of an animation related to a gift object. [Figure 14] FIG. 10 is a diagram (part 2) illustrating an example of an animation related to a gift object. [Figure 15] FIG. 10 is an explanatory diagram (part 3) of an example of an animation related to a gift object. [Figure 16] FIG. 2 is a schematic block diagram showing a configuration related to the animation drawing function described above, among the various functions of the server device. [Figure 17] FIG. 2 is an explanatory diagram of an example of data in an avatar storage unit. [Figure 18] FIG. 2 is an explanatory diagram of an example of data in a predetermined object storage unit. [Figure 19] FIG. 4 is an explanatory diagram of an example of data in a distance state storage unit. [Figure 20]FIG. 2 is an explanatory diagram of an example of data in an animation information storage unit. [Figure 21] 4A and 4B are diagrams illustrating an interference state detected by an interference detection unit; [Figure 22] FIG. 10 is an explanatory diagram of another example of a state machine that can be suitably used in the animation control unit. [Figure 23] 10 is a flowchart illustrating an example of processing executed by the server device in relation to an adjustment method by an object management unit. [Figure 24] 23 is a schematic flowchart showing an example of an adjustment process (step S2310 in FIG. 23) for a simultaneous interference state related to a predetermined object in a free state. [Figure 25] 23 is a schematic flowchart showing an example of an adjustment process (step S2326 in FIG. 23) for a predetermined object that is in an exclusive state with one user avatar. [Figure 26] 23 is a schematic flowchart showing an example of an adjustment process (step S2328 of FIG. 23) for a predetermined object in a shared state by two or more user avatars. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments will be described with reference to the drawings.

[0010] (Overview of Virtual Reality Generation System) An overview of a virtual reality generation system 1 according to one embodiment of the present invention will be described with reference to FIG. Fig. 1 is a block diagram of a virtual reality generation system 1 according to this embodiment.

[0011] The virtual reality generation system 1 includes a server device 10 and one or more terminal devices 20. For simplicity, three terminal devices 20 are shown in FIG. 1, but the number of terminal devices 20 is one. Anything above that is fine.

[0012] The server device 10 may be, for example, a server managed by an operator that provides one or more virtual realities. The terminal device 20 is an information processing system. terminal, PC (Personal Computer), head-mounted display, The terminal device 20 is typically a device used by a user, such as a game device. A plurality of users are connected to the server device 10 via the network 3 in different modes for each user. Ugh.

[0013] The terminal device 20 is capable of executing a virtual reality application according to this embodiment. The real application is transmitted to the server device 10 and a predetermined application via the network 3. The terminal device 20 may receive the information from the application distribution server, or may receive the information from a device provided in the terminal device 20. The information is stored in advance in a storage device or a storage medium such as a memory card that can be read by the terminal device 20. The server device 10 and the terminal device 20 can communicate with each other via the network 3. For example, the server device 10 and the terminal device 20 cooperate to Performs a variety of processes.

[0014] The terminal devices 20 are connected to each other via the server device 10 so that they can communicate with each other. In the following description, "one terminal device 20 transmits information to another terminal device 20" means "one terminal device 20 transmits information to another terminal device 20 via the server device 10. Similarly, "one terminal device 20 receives information from another terminal device 20" means "one terminal The terminal device 20 receives information from another terminal device 20 via the server device 10. However, in the modified example, each terminal device 20 is connected so as to be able to communicate without going through the server device 10. It may be continued.

[0015] Network 3 includes wireless communication networks, the Internet, and VPNs (Virtual Private Networks). Private Network), WAN (Wide Area Network), It may include a wired network, or any combination thereof.

[0016] In the following, the virtual reality generation system 1 is an example of an information processing system. Each element of one terminal device 20 (see the terminal communication unit 21 to the terminal control unit 25 in FIG. 1) processes information. Alternatively, a plurality of terminal devices 20 may cooperate to realize an information processing system. Alternatively, the server device 10 may independently implement an example of an information processing system. Alternatively, the server device 10 and one or more terminal devices 20 may cooperate to implement an information processing system. An example of such a system may be implemented.

[0017] Here, an overview of the virtual reality according to this embodiment will be described. In fact, for example, education, travel, role-playing, simulation, games and concerts Entertainment such as virtual reality for any reality, etc., and the execution of virtual reality In accordance with this, a virtual reality medium such as an avatar is used. In fact, it is a 3D virtual space, various virtual reality media that appear in that virtual space, and This is realized through various contents provided within the space.

[0018] Virtual reality media is electronic data used in virtual reality, such as cards, items, etc. , points, in-service currency (or virtual reality currency), tokens (e.g., Non-Fun NFTs, tickets, characters, avatars, parameters, etc. , any media. The virtual reality media may also include level information, status information, parameters, Information (such as physical strength and attack power) or ability information (skills, abilities, spells, jobs, etc.) The virtual reality medium may be information related to virtual reality such as the above. Electricity that can be acquired, owned, used, managed, exchanged, synthesized, strengthened, sold, disposed of, or donated within the Although it is child data, the manner in which the virtual reality medium is used is not limited to that explicitly stated in this specification.

[0019] In this embodiment, the user is a viewer who views various contents in a virtual space, and a subsequent viewer who views various contents in a virtual space. A distribution user who distributes specific content (described later) in a virtual space through a distributor avatar (described later). Including the.

[0020] In addition, a broadcasting user may, as a viewing user, view specific content by other broadcasting users. Conversely, viewing users can also distribute specific content as distribution users. However, in the following, in order to avoid complicating the explanation, The user is the viewing user at that time, and the distribution user is the distribution user at that time. In the following, when there is no particular distinction between distribution users and viewing users, we will simply refer to them as "users." In addition, there is no particular distinction between broadcaster avatars and other user avatars. In other cases, it may simply be called a "user avatar."

[0021] The user avatar is typically a character facing forward. The user avatar may have a shape that resembles a cat, animal, or the like. By associating them with each other, it is possible for them to have a variety of appearances (appearances when drawn).

[0022] In this embodiment, one user is associated with one user avatar. A user and a user avatar associated with that user have a one-to-one correspondence. Therefore, in the following description, the user avatar may be synonymous with the user. In some cases, a user may be synonymous with a user avatar. A user may be associated with multiple user avatars. If there is only one user avatar in the virtual space at that time, The user avatar associated with the user has a one-to-one correspondence.

[0023] Basically, the viewer user and the distributor user wear a wearable device on their head or part of their face, The wearable device is a head-mounted device that allows users to view the virtual space. The device may be a spray or a glasses-type device. The glasses-type device may be a so-called AR (Augmented Reality) device. Realized Reality (MR) glasses and Mixed Reality (MR) glasses. In either case, the wearable device may be separate from the terminal device 20 or may be integrated into the terminal device. In this embodiment, as an example, the terminal device 20 may be 20 is realized by a head-mounted display.

[0024] In the following, among various contents distributed by the server device 10, a specific content by a distribution user is The following explanation will mainly focus on the content. This section describes content that is suitable for viewing online.

[0025] The specific content by the broadcast user is a broadcaster avatar related to the broadcast user, A broadcaster avatar that changes its orientation, position, and movement according to the user's orientation, position, and movement. This refers to content that appears in the virtual space. Movement refers to not only the orientation, position, and movement of the broadcaster's face, hands, or other parts of their body, but also the This concept includes the direction, position, movement, or the like of the user's gaze. The content is typically video content.

[0026] Specific content by broadcast users is typically distributed in any manner via a broadcaster avatar. For example, specific content provided by distribution users There are various performances such as dance, music, magic, etc., chats, meetings, gatherings, and parties. It may also be related to discussions, or the like.

[0027] In addition, the specific content by the distribution user may be educational. Specific content by the user can be used to receive guidance and advice from the user via the user's avatar. For example, the content provided in virtual reality related to dance lessons may include This may include guidance and advice from a dance teacher. The teacher will be the user who receives the instruction, and the students will be the viewer. You can receive guidance.

[0028] In addition, specific content by a broadcasting user may be created as a collaboration between two or more broadcasting users. This allows for a variety of different ways of distributing content (hereafter referred to as "collaborative distribution"). This will enable distribution in various ways, promoting interaction between distribution users.

[0029] The server device 10 may distribute content other than the specific content by the distribution user. It is also possible to provide the content provided by the server device 10 (content provided in virtual reality). The types and number of contents are arbitrary. In this embodiment, as an example, the server device 10 The content provided may include digital content such as various videos. It may be real-time video or non-real-time video. The image may be based on a real image or may be a computer graphic (CG) image. The video may be informational video. In this case, The video is for information services in specific genres (travel, housing, food, fashion, health, etc.) , beauty information provision services), broadcasting services by specific users (e.g., You The invention may be related to a tube (registered trademark) or the like.

[0030] There are various ways to provide content in virtual reality, including head-mounted displays. For example, the content may be provided in a form other than that using the display function of the In some cases, images are rendered on the display of a display device (virtual reality medium) in the virtual space. The display device in the virtual space may be any device. It can be any form, such as a screen installed in a virtual space or a large screen installed in a virtual space. The display may be a display of a mobile terminal in a virtual space, or the like.

[0031] In addition, virtual reality content can be viewed in ways other than through a head-mounted display. For example, virtual reality content may be available on smartphones. Directly via a smartphone or tablet (without a head-mounted display) (K) May be viewed.

[0032] (Server device configuration) The configuration of the server device 10 will be specifically described. The server device 10 is configured by a plurality of server computers working together. For example, the server device 10 may be a server computer that provides various contents. This is realized in cooperation with a computer that implements various authentication servers, etc. The server device 10 may also include a Web server. Part of the function of the terminal device 20 is to receive HTML documents from a web server and each associated Even if it is realized by the browser processing the seed program (Javascript), good.

[0033] As shown in FIG. 1, the server device 10 includes a server communication unit 11, a server storage unit 12, and a server and a server control unit 13.

[0034] The server communication unit 11 is an interface that communicates with an external device wirelessly or via a wired connection to transmit and receive information. The server communication unit 11 includes, for example, a wireless LAN (Local Area Network). It may also include a wired LAN communication module or a wired LAN communication module. The server communication unit 11 is capable of transmitting and receiving information to and from the terminal device 20 via the network 3. be.

[0035] The server storage unit 12 is, for example, a storage device, and stores various data necessary for various processes related to virtual reality. Stores information and programs.

[0036] The server control unit 13 is configured to read a dedicated microprocessor or a specific program. CPU (Central Processing Unit) that realizes specific functions ), a GPU (Graphics Processing Unit), etc. For example, the server control unit 13 cooperates with the terminal device 20 to display the display unit 23 of the terminal device 20. The virtual reality application is executed in response to user operations.

[0037] (Terminal Device Configuration) The configuration of the terminal device 20 will be described. As shown in FIG. 1, the terminal device 20 is a terminal communication The terminal device includes a terminal storage unit 22, a display unit 23, an input unit 24, and a terminal control unit 25. .

[0038] The terminal communication unit 21 is an interface that communicates with an external device wirelessly or via a wired connection to transmit and receive information. The terminal communication unit 21 includes, for example, an LTE (Long Term Evolution) interface. ution) (registered trademark), LTE-A (LTE-Advanced), 5th generation mobile Mobile communication systems, such as UMB (Ultra Mobile Broadband) Wireless communication module, wireless LAN communication module, or wired LAN communication module that supports the communication standard The terminal communication unit 21 may include a communication module, etc. It is possible to send and receive information to and from the device 10.

[0039] The terminal storage unit 22 includes, for example, a primary storage unit and a secondary storage unit. The terminal storage unit 22 may include a semiconductor memory, a magnetic memory, an optical memory, or the like. Various information and programs used in virtual reality processing received from the server device 10 The information and programs used for processing the virtual reality are stored via the terminal communication unit 21. For example, a virtual reality application program may be acquired from an external device. The application program may be acquired from the application distribution server. The system is also simply called an application.

[0040] The terminal storage unit 22 also stores data for rendering a virtual space, such as data for indoor spaces like buildings. The data for rendering the virtual space is stored in the following format: A plurality of types may be prepared for each virtual space and used appropriately.

[0041] The terminal storage unit 22 also stores the image data projected onto various objects arranged in the three-dimensional virtual space. It stores various images (texture images) for texture mapping.

[0042] For example, the device storage unit 22 stores drawing information of a user avatar associated with each user. Each user avatar is rendered in the virtual space based on the rendering information of the user avatar. can be.

[0043] In addition, the terminal storage unit 22 stores, for example, various gift objects, buildings, walls, or NPCs ( Non-Player Characters) and other characters that are different from the user avatar. The drawing information relating to various objects is stored. Various objects are displayed in the virtual space as follows: The gift object is a gift from one user to another. An object that corresponds to a gift to the user and is part of an item. Soft objects are things worn by the user avatar (clothes and accessories) and images to be distributed. Decorations (fireworks, flowers, etc.), backgrounds (wallpapers) or similar, and gacha (lottery) The term "gift" as used in this application may be a gift ticket or the like. The term "token" has a similar concept to that of "token." The term "gift" may be replaced with the term "token" as used herein. It is also possible to understand the techniques described.

[0044] The display unit 23 is, for example, a liquid crystal display or an organic EL (Electro-Luminescent) The display unit 23 includes a display device such as a display. The display unit 23 is configured, for example, with a touch panel, and is capable of detecting various user operations. As described above, the display unit 23 functions as an interface for The display may be built into the front display.

[0045] The input unit 24 may include physical keys or a pointing device such as a mouse. The input unit 24 may further include any input interface such as: It is possible to accept contactless user input such as voice input, gesture input, and gaze input. The gesture input may be performed using a sensor (image sensor) for detecting various states of the user. sensors, acceleration sensors, distance sensors, etc.), sensor technology (e.g., depth sensors, cameras, motion capture, joypad-like controllers, etc.) are used. In the case of motion capture, position information of various joints of the user (joint position information) The angle information (joint angle information) may be acquired. Information that refers to both or either of these is sometimes called "joint information." In the case of sensors, even if movement information of movable parts other than the user's joints (for example, eyes or mouth) is acquired, The camera for detecting the line of sight may be disposed in the head-mounted display. As described above, various states of the user include, for example, the orientation, position, and movement of the user. In this case, the user's orientation, position, and movement refer to the orientation and position of the user's hands and body. This concept includes not only the movement of the broadcast user, but also the direction, position, movement, or the like of the broadcast user's gaze.

[0046] The terminal control unit 25 includes one or more processors. Controls body movements.

[0047] The terminal control unit 25 transmits and receives information via the terminal communication unit 21. For example, the terminal control unit 25 is a server device that stores various information and programs used in various processes related to virtual reality. The terminal control unit 25 receives the received information from at least one of the external server 10 and another external server. The terminal storage unit 22 stores information and programs. For example, the terminal storage unit 22 stores A browser (Internet browser) for connecting to the server may be stored.

[0048] The terminal control unit 25 starts the virtual reality application in response to a user operation. The control unit 25 cooperates with the server device 10 to execute various processes related to virtual reality. For example, The terminal control unit 25 displays an image of the virtual space on the display unit 23. For example, A GUI (Graphical User Interface) that detects user operations is displayed. The terminal control unit 25 can detect a user operation via the input unit 24. For example, For example, the terminal control unit 25 may perform various operations (tap operation, long tap, etc.) based on the user's gestures. It is possible to detect operations such as touch, flick, and swipe. The unit 25 transmits the operation information to the server device 10.

[0049] The terminal control unit 25 draws the user avatar together with the virtual space (image) and displays it on the display unit 23. In this case, for example, as shown in FIG. 2, images that are visually recognized by the left and right eyes are displayed. A stereoscopic image can be generated by generating G200 and G201. The images G200 and G201 that are visually recognized are shown in the following. Unless otherwise specified, the image in the virtual space is the image represented by images G200 and G201. In addition, the terminal control unit 25 may, for example, change the virtual Various movements of the user avatar are realized in the space. The process is detailed below.

[0050] (Animation drawing function) In this embodiment, the drawing process is performed when the distance between the predetermined object and the user object is When the distance is equal to or less than the first predetermined distance d1, the combination of the predetermined object and the user object In this case, the animation drawing function is implemented. Animations are animations prepared in advance and are assigned to specific objects and users. A separate file may be prepared for each user object.

[0051] The predetermined object is any object among various objects that can be placed in the virtual space. Typically, it is part of various objects that can be placed in virtual space. It may be all of the various objects that can be placed in the virtual space.

[0052] In this embodiment, the predetermined object is, for example, any of various objects that can be placed in a virtual space. Among the objects, the object that the user avatar can handle (for example, the object that can be held in the hand) For example, the predetermined object is a user avatar. The object may include an object related to a physical object such as a pen that can be picked up by a user. The object corresponding to the object does not need to exist in reality, but can be created in the virtual space. It may also be an object that exists only between the user and the object. When the project includes a gift object, the predetermined object is preferably a gift object. Contains all or part of the object.

[0053] The distance between a given object and a user object is the distance in the virtual space (e.g. For example, spatial distance), and the position information of a given object and the position information of a user object In this case, the position information of the predetermined object may be calculated based on the It may be position information used when placing a predetermined object in the virtual space. The position information may be the representative point (for example, the center of gravity or the centroid) of the user object. The position information may be the position information of the hand of the user object. The position information of the object's hand is the position information of the tip of the user object's hand. For example, in the case of a configuration that can acquire finger joint position information, the position of the user object's hand can be acquired. The position information may be finger joint position information. Alternatively, the position information may be wrist position information without finger joint position information. In the case of a configuration that can acquire joint position information, the hand position information of the user object is the wrist joint. It may be node position information.

[0054] In the following, unless otherwise specified, the user's hand or the user object's hand refers to the user's hand. Or it refers to the part of the user object corresponding to the palm and fingers beyond the wrist.

[0055] The first predetermined distance d1 is an arbitrary value, but is a relatively small value. The first predetermined distance d1 may be the same as the distance at which contact between the object and the sensor is detected. The size of a given object (its actual size in the virtual space or its image in the virtual space) For example, the first predetermined distance d1 may be set according to the size of the predetermined object. The smaller the size of the image in the virtual space, the smaller the size of the image. If the first predetermined distance d1 is set according to the size of the predetermined object in the same predetermined It can also be a different value for objects.

[0056] FIG. 3 shows the first predetermined distance d1 of a pencil object M3, which is an example of a predetermined object. 10 is an explanatory diagram of the second predetermined distance d1 and the second predetermined distance d2.

[0057] In the example shown in FIG. 3, a sphere 301 ( In FIG. 3, a sphere 301 is shown as a two-dimensional circle. The sphere 301 is a half circle of a first predetermined distance d1. The center of the circle is set to the centroid (representative point) of the pencil object M3. 3, the radius d2 (hereinafter referred to as the "second predetermined distance d2") is larger than that of the sphere 301. A sphere 302 (shown as a two-dimensional circle in FIG. 3) is also shown. The center of the sphere 302 is also a lead. The center of gravity (representative point) of the brush object M3 is set. The sphere 302 will be described later.

[0058] The animation related to the combination of a predetermined object and a user object can be arbitrarily For example, touching a predetermined object, holding a predetermined object, or Grasp a given object, pick up a given object, lift a given object, It is an animation that shows various hand movements, such as pinching. The animation for the combination of the object and the user object is the animation for one hand. It may be an animation of the character or an animation of both hands.

[0059] The animation preferably only concerns the hand portion of the entire user object. This is because the hands have many joints due to the fingers, and it is difficult to move them by motion capture, etc. Therefore, obtaining and using the position information of each joint tends to significantly increase the processing load. be.

[0060] Since animations are prepared for each predetermined object, The type of animation prepared for an object depends on the attribute of the given object of that type. For example, if a given object is relatively heavy in reality, For objects that correspond to large objects (e.g., barbells), one hand is used to hold the “predetermined object.” There is no need to provide animations such as "lifting the ball."

[0061] The animation may also represent changes such as the movement and deformation of a given object. Depending on the type of object, the movement of the object can be controlled by the hand. This is because giving a certain object may result in a higher consistency with reality. If the object corresponds to a bottle, glass, mug, etc. containing a drink, the animation The movement of the drink (when pouring from a bottle into a glass or mug) and the movement of the glass It is also possible to express the movement of the liquid surface in the cup in response to the temperature, the generation of bubbles, etc.

[0062] 4 and 5 show a pencil object M3, which is an example of a predetermined object, and a user avatar. 10 is an explanatory diagram of an animation relating to a combination with hand part M2.

[0063] Figure 4 shows the pencil object M3 and the hand of the user avatar ( 10 is a diagram showing a pencil object M3 and a user FIG. 10 is a diagram showing a state immediately before the distance to the avatar's hand part M2 becomes equal to or shorter than the first predetermined distance d1. Figure 5 shows the pencil object M3 and the hand movements of the user avatar in the virtual space. 10 is a diagram showing a pencil object M3 and a hand part M2 of a user avatar. 10 is a diagram showing a state immediately after the distance between the first and second electrodes becomes equal to or shorter than the first predetermined distance d1.

[0064] In the example shown in FIGS. 4 and 5, a pencil object M3 and a hand part M2 of a user avatar are When the distance d3 between the user avatar and the user avatar becomes equal to or smaller than the first predetermined distance d1 (see FIG. 3), the user avatar's hand moves An animation of the user grasping the brush object M3 is drawn. The animation shows the hand of the person holding the pencil object M3. may include an animation portion from the state shown in FIG. 4 to the state shown in FIG. 5. .

[0065] Here, the animations shown in Figs. 4 and 5 are generated by the movements of each joint of the user avatar's hand. It expresses detailed movements, but the movements of each joint of the user are captured by motion capture, etc. It can be drawn without acquiring position information. In other words, it is possible to draw animations such as those shown in Figures 4 and 5. The motion is generated based on the data (drawing data) prepared in advance, so the motion There is no need to obtain position information of each of the user's joints by means of position capture or the like.

[0066] In this way, according to this embodiment, the processing load is not excessively large and the This makes it possible to draw the detailed movements of the user object.

[0067] FIG. 6 is an explanatory diagram of an example of a state machine that can be suitably used in this embodiment. In the illustrated example, states ST600 to ST625 are shown as an example. 0 is the default value formed after the user avatar enters the virtual space (after entry). The state ST610 corresponds to the state (“Default”), and the state ST620 to ST622 5. Each state S T620 to ST625 are states that accompany animation drawing during transition. For example, “P "pencilHand" shows a user avatar holding a pencil object (see Figure 5). This corresponds to a state in which the pencil object and the user avatar are in a parent-child relationship. In this state "PencilHand", the bottle, which is a predetermined object, The distance between the object (not shown) and the hand part M2 of the user avatar is a first predetermined distance When it becomes d1 or less, the state “BottleHand” can transition from “Any State” Since this is possible, a direct transition occurs from the "PencilHand" state. The animation leading to the state where the user avatar is holding a bottle object (not shown) is It may be drawn.

[0068] By using such a state machine to realize various animation changes, It is easy to increase the variety of animations. When adding animation related to a specific object, for example, By describing it based on the transition from the "State", it can affect existing animations. This effectively reduces the number of design steps and simplifies the logic. This can reduce the processing load associated with the fragmentation.

[0069] Next, with reference to FIG. 7 and subsequent figures, an example of the configuration of the virtual reality generation system 1 will be described in order. go.

[0070] FIG. 7 shows the animation drawing function described above among the various functions of the terminal device 20. 8 is a schematic block diagram showing the configuration of the avatar storage unit 241. 9 is an explanatory diagram of an example of data in the predetermined object storage unit 242. FIG. 10 is an explanatory diagram of an example of data in the animation data storage unit 244. 11 is an explanatory diagram of joint position information.

[0071] In the following, one terminal device 20 will be described, but the other terminal devices 20 will also be described. In the following, unless otherwise specified, the term "user" refers to the terminal Unless otherwise specified, the user avatar M1 refers to the user who uses the device 20. A user avatar M1 associated with the user, or a distributor avatar in the distribution image H2, Point to the target.

[0072] As shown in FIG. 7, the terminal device 20 includes an object information storage unit 240 and an animation a server data storage unit 244, a server data acquisition unit 250, a user input acquisition unit 252, and It includes a butter action processing unit 254 and a drawing processing unit 258.

[0073] In addition, each function of the object information storage unit 240 to the animation data storage unit 244 This can be realized by the terminal storage unit 22 of the terminal device 20 shown in FIG. The functions from the acquisition unit 250 to the drawing processing unit 258 are implemented by the terminal control unit of the terminal device 20 shown in FIG. 25 cooperates with the terminal communication unit 21, the terminal storage unit 22, the display unit 23, and the input unit 24 to This can be achieved by running a real application.

[0074] The object information storage unit 240 stores object information related to various objects in the virtual space. The object information storage unit 240 stores the object information in the avatar storage unit 241 and the predetermined and an object storage unit 242.

[0075] The avatar storage unit 241 stores various information (hereinafter, " In the example shown in FIG. 8, the user avatar M1 is stored in the The drawing information 800 of the avatar M1 includes, for each avatar ID, a face part ID, a hairstyle part ID, Clothing part IDs, etc. are associated. Facial part ID, hairstyle part ID, clothing part ID, etc. The part information relating to the appearance of the user avatar M1 is a parameter that characterizes the user avatar M1. The facial part ID and hairstyle part ID of the user avatar M1 may be selected by the user. D. Information related to appearance, such as clothing part ID, is stored in multiple types so that each user can choose from a variety of options. In addition, the facial part IDs are prepared for each type of face, such as face shape, eyes, mouth, nose, etc. The facial part ID is prepared, and the information related to the facial part ID is the ID of each part that makes up the face. In this case, the appearance associated with each avatar ID may be managed as a combination of the above. Each user avatar M1 can be drawn on the terminal device 20 side based on each ID. is.

[0076] The predetermined object storage unit 242 stores various information related to the predetermined object (hereinafter, “object”). In the example shown in FIG. 9, object information 90 0, each predetermined object ID is assigned with position information, a first predetermined distance d1 (see FIG. 3), a second predetermined distance d2 (see FIG. 3), and The distance d2 (see FIG. 3) is associated with the position information. (position in virtual space), and as described above, the position information of the representative point of the predetermined object In addition, if the predetermined object is a movable object, the position information may be The first predetermined distance d1 and the second predetermined distance d2 may be updated according to the movement of the corresponding predetermined object. The predetermined distance d2 is as described above with reference to Fig. 3. Note that the first predetermined distance d1 and / or The second predetermined distance d2 may be the same for all predetermined objects. In this case, the object information 900 may be simplified.

[0077] The animation data storage unit 244 stores the various animations described above. The animation data shown in FIG. The animation information 1000 includes animations associated with a specific user avatar M1. Animation information such as animation information 1000 shown in FIG. may be prepared for each user avatar M1.

[0078] The animation information 1000 shown in FIG. 10 is composed of data I D is associated with the data. The data ID is an ID given to each animation data. Each data ID uniquely corresponds to a specific piece of animation data. In the animation information 1000 shown in FIG. 1, the predetermined object ID "B01" has two data. The two data IDs correspond to the first animation data. animation data (an example of first drawing information) and second animation data (an example of second drawing information) In addition, the first animation data is associated with the predetermined object ID "B02". Two data IDs relating to the data are associated with each other.

[0079] The first animation data is a data in which the distance between the predetermined object and the user avatar M1 is An animation (an example of the first animation) is drawn when the distance becomes equal to or less than the first predetermined distance d1. The second animation data is data for plotting the predetermined object and the user action. The distance between the butter M1 is greater than the first predetermined distance d1 but is equal to or less than the second predetermined distance d2. This is data for drawing an animation (an example of the second animation) when The second animation data may be omitted. Instead of the data, a predetermined posture of the hand of the user avatar M1 (for example, pointing at a predetermined object) is used. Still image data representing the posture may be used.

[0080] In this embodiment, the animation data stored in the animation data storage unit 244 of one terminal device 20 The various animation data are stored in a user address associated with the user of the terminal device 20. Various animation data related to Butter M1 and various animations related to the streamer avatar In other words, animations may be prepared for each user avatar M1. In addition, various animations stored in the animation data storage unit 244 of one terminal device 20 The application data is the application data prepared for the corresponding user avatar M1 and various broadcaster avatars. However, in a variant, the animation is It may be common to one or more types of user avatars M1.

[0081] The server data acquisition unit 250 acquires the animation data from the server device 10 on the terminal device 20 side. For example, server data acquisition The acquisition unit 250 acquires the object information stored in the object information storage unit 240 and the animation data storage unit 244. The various data to be stored (and updated) and the update data are acquired.

[0082] The user input acquisition unit 252 acquires various inputs by the user via the input unit 24. When drawing the distribution image H2, the user input acquisition unit 252 receives various information related to the distribution user. The various inputs via the input unit 24 may be as described above. In the embodiment, for example, the user input acquisition unit 252 may perform the following based on motion capture: Joint information related to various joints of the user is acquired. In this case, the joint information is Specifically, in this embodiment, the joint information is For example, the joint information may be a user's The information may be about the joints of the neck, shoulders, elbows, wrists, hips, knees, ankles, etc. The information is the transformation matrix (position and angle) that represents the posture and skeleton, and the mesh that depends on that matrix. The data may be in the form of a transformation data.

[0083] Alternatively, in another embodiment, the joint information acquired by the user input acquisition unit 252 is However, in this case, the joint information relating to the joints of the user's fingers may be included. Joint information does not need to be used to draw animations, or the joints of the user's fingers may be Only a portion of the joint information relating to the joints may be used in drawing the animation.

[0084] For the sake of explanation, the user avatar M1 will be referred to as a user avatar with various joints corresponding to the user's various joints. However, the position and movement (range of motion) of the various joints of the user avatar M1 The position and movement of the person do not need to be completely consistent with each other, and may be different as appropriate. In this example, the user avatar M1 is connected via joints (shown by black circle marks in FIG. 11). The plurality of parts includes a hand part M2 (an example of a first part) corresponding to a hand. ) and each part M5 (an example of a second part) on the body side including arm parts. M2 is connected to each part M5 on the body side via the wrist joint. User avatar The number and locations of the joints of M1 may be set as appropriate.

[0085] The avatar movement processing unit 254 performs the following operations based on the various inputs acquired by the user input acquisition unit 252. The movement of the user avatar M1 is determined based on the overall It may include not only movement but also movement of some parts.

[0086] If the input acquired by the user input acquisition unit 252 includes joint information, the avatar movement processing The control unit 254 determines the posture and movement of the user avatar M1 based on the joint information. In this case, the position and / or angle of each joint of the user in the real coordinate system represented by the joint information is The coordinate system of the virtual space is set to match the position and / or angle of each joint of the user avatar M1. The posture and movement of the user avatar M1 may be determined in this manner.

[0087] In addition, the input acquired by the user input acquisition unit 252 is used to acquire various functions of the user avatar M1. If the movement information includes information about movable parts other than the joints (for example, the mouth or eyes), the avatar movement processing unit 2 54 determines the state (movement) of the movable parts of the user avatar M1 based on the movement information. In this case, the avatar movement processing unit 254 may add the user avatar M1 to the movement information. The state (movement) of the movable parts of the user avatar M1 is adjusted so that the state (movement) of the movable parts of the user avatar M2 is matched. (ki) may be determined.

[0088] In this embodiment, the avatar movement processing unit 254 receives the user input from the user input receiving unit 252. Based on the various inputs received, the position / orientation information of the user avatar M1 is Information representing the overall position and orientation of M1 and the relationships between the various joints of the user avatar M1 The position of the user avatar M1 as a whole is updated by, for example, the user avatar It may be the position of a representative point of M1 (for example, the center of the body or any one of the joints), The overall orientation of the user avatar M1 is, for example, the forward direction of the torso of the user avatar M1. The avatar movement processing unit 254 may also correspond to the position / direction of the user avatar M1. The information may include information indicating the state (movement) of the movable parts of the determined user avatar M1. In another embodiment, the avatar operation processing unit 254 may change the position of the user avatar M1. As information to be included in the orientation information, the movement information acquired by the user input acquisition unit 252 is It may be used as is.

[0089] The rendering processing unit 258 generates an image (hereinafter referred to as a virtual image) within the field of view of a virtual camera that is virtually placed in a virtual space. Hereinafter, the virtual camera generates an image for the terminal device 20. It may be set.

[0090] FIG. 12 is an explanatory diagram of an example of the field of view of the virtual camera 60. In FIG. 12, The field of view of the virtual camera 60 is shown within the hatched area, along with the user avatar M1 and the virtual camera 60. The virtual camera 60 is shown in a top view as a schematic diagram in the area R1100. It does not necessarily have to be horizontal (parallel to the field in the virtual space), but can be varied with various degrees of freedom. The position of the virtual camera 60 may also be changed with various degrees of freedom. Now, the field of view of the virtual camera 60 is determined according to the values ​​of various camera parameters. .

[0091] The drawing processing unit 258 can switch between a plurality of modes including a normal mode and an animation mode. The drawing processing unit 258 may operate in a transitional manner. a project drawing unit 2582, a base image drawing unit 2583, and an animation drawing unit 2584 Includes:

[0092] The avatar drawing unit 2581 draws the user avatar M1 from among the terminal images described above. Specifically, the avatar drawing unit 2581 draws the parts related to each camera of the virtual camera 60. The values ​​of the camera parameters, the position / orientation information of each user avatar M1, and the user avatar M1 Based on the drawing information 800 (see FIG. 8) etc., one or more The avatar drawing unit 2581 draws the user avatar M1. The drawing of M1 may be superimposed on a base image, which will be described later.

[0093] As described above, the position / orientation information of one user avatar M1 is When the information includes information indicating the positions and orientations of the multiple parts of M1, the avatar drawing unit 25 Based on this information, the position and the like of each of the multiple parts of the user avatar M1 are calculated. This allows the movement of the user avatar M1 to be expressed more naturally. For example, if a specific part is the upper body, it can also express movements such as twisting the upper body relative to the lower body. It may be possible.

[0094] As described above, the position / orientation information of one user avatar M1 is If the joint information includes information about the various joints of the avatar M1, the avatar drawing unit 2581 The joint information of the user avatar M1 is adjusted so that the states of the various joints of the user avatar M1 are consistent with the joint information. You may draw 1.

[0095] As described above, the position / orientation information of one user avatar M1 is Includes information representing the movements of the avatar M1's movable parts other than the joints (e.g., mouth, eyes, etc.) In this case, the avatar rendering unit 2581 renders the moving parts of the user avatar M1 based on this information. The movable parts of the user avatar M1 may be drawn in a manner that expresses the corresponding movements of the parts. .

[0096] In the normal mode, the avatar drawing unit 2581 draws a user avatar M1 including hand parts M2. On the other hand, the avatar drawing unit 2581 draws the entire image. In the animation mode in which the animation drawing unit 2584 operates, For parts that are not drawn (for example, hand part M2), the animation drawing section Parts not drawn by 2584 (for example, each part M5 on the body side other than the hand part M2) ) only.

[0097] As described above, in the configuration in which joint information relating to the joints of the user's fingers is acquired, In the normal mode, the finger drawing unit 2581 draws a finger based on the joint information related to the joints of the user's fingers. In this case, the hand part M2 of the user avatar M1 may be drawn. In the animation mode, the finger drawing unit 2581 draws the joints of the user's fingers. Without using the information (or only using a part of it), animation drawing part 2584 Only the parts that are not drawn by (for example, each part M5 on the body side other than the hand part M2) Draw.

[0098] Similarly, as described above, in a configuration in which movement information of a movable part is acquired, the avatar drawing unit 2581 may be configured to use the movement information of the movable part only in normal mode. That is, in animation mode, the avatar drawing unit 2581 Without using (or only using part of) the information, the animation drawing unit 258 Only parts not drawn by 4 (for example, each body part M5 other than the hand part M2) However, if the moving part is not drawn by the animation drawing unit 2584, If the character is not included in the animation mode, the avatar drawing unit 2581 The moving parts of the user avatar M1 may be drawn based on the information representing the movement of the moving parts. stomach.

[0099] The user avatar M1 drawn by the avatar drawing unit 2581 is displayed to other users. The image may include other user avatars M1 associated with the virtual camera 60. If another user avatar M1 is located within the field of view, the avatar drawing unit 2581 User avatar M1 may be similarly rendered.

[0100] The object drawing unit 2582 draws a predetermined object from the terminal image as described above. The drawing information of each object is the drawing information 80 of the user avatar M1. 0 (see FIG. 8), the information may be stored in a storage unit (not shown).

[0101] In the normal mode, the object drawing unit 2582 On the other hand, the object drawing unit 2582 draws a predetermined object based on the In the animation mode in which the animation drawing unit 2584 operates, the viewfinder of the virtual camera Of the predetermined objects in the field, the predetermined objects are drawn by the animation drawing unit 2584. The object is not drawn, but is drawn by the animation drawing unit 2584. Only certain objects that are not included in the drawing are drawn.

[0102] The base image drawing unit 2583 draws the basic part of the image for the terminal as described above. That is, the base image drawing unit 2583 is a unit that draws an avatar and an object. 82, which draws the basic part before the drawing by the animation drawing unit 2584 described later is superimposed. For example, the base image drawing unit 2583 may generate drawing information for the virtual space and the virtual camera 60. Based on the values ​​of the camera parameters, the field and background of the field of view from the virtual camera 60 are displayed. The rendering information for the virtual space may be prepared in advance, but it may also be prepared after the fact or The virtual space may be drawn in any way. By mapping field objects and background objects onto appropriate planes, curved surfaces, etc. This may be realized by:

[0103] The animation drawing unit 2584 is an animation control unit 1 of the server device 10, which will be described later. Based on the instruction from 57, the animation data in the animation data storage unit 244 is From the data (see Figure 10), the animation data corresponding to the data ID included in the command is The animation drawing unit 2584 then extracts the extracted animation data. Based on this, various animations such as those described above with reference to FIGS. 4 and 5 are rendered.

[0104] In this embodiment, the animation is performed by combining a predetermined object with the hand of the user avatar M1. In this case, the animation drawing unit 2584 Based on the position and orientation of the wrist of the user avatar M1, hand parts are attached to the wrist joint of the user avatar M1. The animation of M2 may be drawn so that it is connected in a natural way.

[0105] In this embodiment, the predetermined object may include a gift object. In this case, the image H2 (image related to specific content) distributed by the distribution user is animated. You may also draw the

[0106] For example, FIGS. 13 to 15 illustrate an example of an animation related to a gift object. 13 to 15 are diagrams showing an example of a delivery image H2. The object is H2, and the gift object G13 (predetermined object) of a stuffed toy falls from above. As shown in Fig. 13, the animation for the stuffed toy When the soft object G13 falls, the broadcaster avatar G13 appears as shown in FIG. User avatar M1 moves hand part M2 close to stuffed toy gift object G13. Then, the stuffed toy gift object G13 and the hand part M of the user avatar M1 are When the distance between the two objects becomes equal to or less than the first predetermined distance d1, the stuffed toy gift object G13 The animation of grabbing and embracing the user avatar M1 and the stuffed toy gift. The animation in combination with the object G13 is drawn as shown in FIG. As the last frame of the animation, the child holds the stuffed toy gift object G13. The user avatar M1 is depicted holding a

[0107] In the examples shown in FIGS. 13 to 15, the heart-shaped gift object G12 is also In this case, the heart-shaped gift object G12 and the user object G13 are The distance between the butter M1 and the hand part M2 is not less than the first predetermined distance d1, and therefore, Animation related to the combination of the avatar M1 and the heart-shaped gift object G12 (In this case, the heart-shaped gift object G12 is not drawn in the normal mode.) (The object is depicted falling under the influence of virtual gravity in the image.)

[0108] In the examples shown in FIGS. 13 to 15, the stuffed toy gift object G13 is For example, a food object such as ramen is a predetermined object. If the object is a food-related object and an animation related to the user avatar M1, As an example, the user avatar M1 is depicted eating food using chopsticks, a fork, etc. In this case, chopsticks, forks, etc. may also be used as gift objects by the user avatar M1 It may also be an item gifted to

[0109] FIG. 16 shows the functions of the server device 10, including the animation drawing function. 17 is a schematic block diagram showing the configuration of the avatar storage unit 141. 18 is an explanatory diagram of an example of data in the predetermined object storage unit 142. FIG. 19 is an explanatory diagram of an example of data stored in the distance state storage unit 144. 10 is an explanatory diagram of an example of data in the animation information storage unit 146.

[0110] As shown in FIG. 16, the server device 10 includes an object information storage unit 140 and a distance state A storage unit 144, an animation information storage unit 146, and a positional relationship calculation unit 150 (information generation an example of a collision detection unit 154, an object management unit 156, and an animation control unit The control unit 150 includes a prohibition processing unit 157 and a prohibition processing unit 158.

[0111] The object information storage unit 140 to the animation information storage unit 146 are shown in FIG. The server storage unit 12 shown in FIG. This can be realized by the server control unit 13 shown in FIG. A part of the stop processing unit 158 ​​(a functional unit that communicates with the terminal device 20) is the same as that shown in FIG. This can be realized by the server communication unit 11 together with the server control unit 13 .

[0112] The object information storage unit 140 stores object information related to various objects in the virtual space. The object information storage unit 140 stores the object information in the avatar storage unit 141 and the predetermined and an object storage unit 142.

[0113] The avatar storage unit 141 stores the avatars stored in the avatar storage unit 241 of the terminal device 20. In addition to the original data of the data, the values ​​of predetermined parameters of the user avatar M1 are stored. In the avatar information 1700 shown in FIG. 17, the value of a predetermined parameter is In FIG. 17, the force relationship between the user avatars M1 and M2 is used as a predetermined parameter. For example, a force parameter representing the relationship between the user avatars M1 and M2 and a priority parameter representing the priority relationship between the user avatars M1 and M2 are used. Each user avatar M1 has a force parameter value and a priority parameter value. The values ​​of the force parameters and the like associated with each user avatar M1 are The value of the priority parameter may be variable. For example, The values ​​of the force parameters and the priority parameters to be assigned are determined by the user avatar M1 Activities (e.g., activities in virtual space that contribute to other users) ) or may be increased according to the power parameter associated with one user avatar M1. The value of the parameter and the value of the priority parameter are associated with the user avatar M1. It may be changed depending on the avatar item.

[0114] The avatar storage unit 141 may also store information about friend avatars ( (See avatar information 1700 in FIG. 17.) Information about a friend avatar is This information indicates that the intimacy between the user and the avatar M1 is greater than or equal to a threshold value. The friend information associated with the user avatar M1 is This information represents one or more user avatars M1 whose intimacy level is equal to or greater than a threshold value. Door avatars may be added by user registration. In this case, one user avatar User avatar M1, who is registered as a friend avatar for M1, has a level of intimacy equal to or greater than the threshold. The user avatar M1 may be treated as the user avatar M1.

[0115] Here, the intimacy level may be increased, for example, in the following manner. In other words, the intimacy between mutual followers increases, and collaborative broadcasts are performed multiple times. If you do this, your intimacy level will increase, and you can send a lot of gifts, comments, likes, etc. to the broadcaster during their broadcast. It increases when you watch a broadcast user's broadcast for a long time, and it increases when you watch a broadcast user's broadcast outside of the broadcast. This number increases when a large number of messages are exchanged between users and the In other embodiments, the number of users increases when a large number of systems are sent to the distribution users. The threshold for determining whether the intimacy is equal to or greater than the threshold is not a value, but a value as described above. When the conditions for increasing intimacy are met, it is determined that the intimacy is above the threshold. Good too.

[0116] The predetermined object storage unit 142 includes the predetermined object storage unit of the terminal device 20 described above. In addition to the original data of the data stored in 242, for each predetermined object ID, whether interference is possible or not information, information on whether sharing is possible, information on sharing conditions, information on release conditions, and information on parent-child relationship settings The information is stored.

[0117] The information on whether or not the corresponding predetermined object is a specific predetermined object A specific predetermined object is information on the object between two or more user avatars M1. The distance between the objects is not within the first predetermined distance d1 at the same time. For example, a specific object can be handled only by a specific user avatar. In a modified example, the specific predetermined object may be omitted.

[0118] The information on whether or not the object can be shared is based on whether or not there are two or more corresponding objects, i.e., user avatar M1 and parent / child avatar M2. This is information that indicates whether a relationship can be set. If a parent-child relationship with The Avatar M1 can be established (i.e., sharing is possible), sharing is possible. For example, the number of user avatars M1 that can be used may be stored in the table. In the object information 1800, the predetermined object with the predetermined object ID “B01” is The number of user avatars M1 that can be shared is up to two. The above-mentioned specific objects cannot be shared. may be set appropriately depending on the attribute of a predetermined object. For example, Relatively small objects like item 3, or items that are generally used by one person, such as smartphones A predetermined object corresponding to a body or the like may be set as "unshareable." , cake cutting knife at ceremony, tape at ribbon cutting ceremony, etc. A predetermined object corresponding to an object that can be picked up by multiple people may be set as "shareable." .

[0119] The information on the sharing conditions may be stored in association with a predetermined object that can be shared. The conditional information is information that corresponds to a predetermined object shared by two or more user avatars M1. The shared condition is an arbitrary condition that must be satisfied when the If they are lend avatars or streamer avatars in a collaborative stream (i.e., if their intimacy level is Alternatively, the sharing condition may be satisfied when the force parameter If the user avatars M1 have similar values ​​of the parameter and / or the priority parameter, the condition is satisfied. This may be possible.

[0120] The release condition information indicates the basic conditions that must be met when releasing a parent-child relationship. The release condition is arbitrary, but for example, it can be when a predetermined time has elapsed or when the distance between the objects has become When the inter-object distance is changed from a state where the inter-object distance is equal to or less than the first predetermined distance d1 (a first state to be described later) to a state where the inter-object distance is equal to or less than the first predetermined distance d1, the A transition to a state greater than the fixed distance d1 (the second state described later), and The condition may be satisfied based on at least one of the following: The time may be set for each predetermined object according to the attribute of the predetermined object. The release conditions are related to the parent-child relationship described below, and are divided into exclusive and shared states. The object ID may be set differently depending on the time (see the predetermined object ID "B01" in FIG. 18). .

[0121] The parent-child relationship setting information is the status of the parent-child relationship (current status) for the corresponding specified object. The parent-child relationship setting information is information indicating whether a parent-child relationship is set or not. and, if a parent-child relationship is set, identifying one or more user avatars M1 that are parents. It may include information (for example, avatar ID) that can be shared. In the case of an object, if a parent-child relationship is set, there are two or more parent user avatars M1. This may occur.

[0122] In this embodiment, as an example, the setting information of the parent-child relationship related to one predetermined object is A state in which a parent-child relationship is not set for the user avatar M1 (hereinafter referred to as the "free state") "), and a state in which the object is a subordinate object of one user avatar M1 (hereinafter referred to as "exclusive"). A state in which the user is a subordinate object of two or more user avatars M1. (hereinafter also referred to as "shared state"), in which case: When the setting information of the parent-child relationship related to one predetermined object indicates an exclusive state or a shared state, Furthermore, information (e.g., avatar ID) for identifying one or more parent user avatars M1 is stored. include.

[0123] The distance state storage unit 144 stores the user's distance state for each predetermined object and for each user avatar M1. The distance between the user avatar and a predetermined object (hereinafter also referred to as the "object distance") Information relating to the location of the virtual object (hereinafter also referred to as "location relationship information") is stored. When a space is set, the positional relationship information may be managed for each virtual space. The predetermined object and the user avatar M1 included in the positional relationship information in the section 144 are The positional relationship calculation unit 150 calculates the inter-object distance and It may be only the user avatar M1.

[0124] The positional relationship information may be the distance between the objects themselves, and / or the distance between the objects. The information may be information representing the relationship between the distance between the first and second predetermined distances d1 and d2. good.

[0125] The positional relationship information 1900 shown in FIG. 19 is stored for each predetermined object ID and user avatar. Each of the positions M1 has a first state and a second state. In 00, the second state includes a non-proximity state and a proximity state. The first state is between objects. The second state corresponds to a state where the distance between the objects is equal to or less than the first predetermined distance d1. The close state corresponds to a state where the distance between the objects is greater than the first predetermined distance d1. The non-proximity state corresponds to a state in which the distance is greater than the predetermined distance d1 and less than or equal to the second predetermined distance d2. This corresponds to a state in which the inter-object distance is greater than the second predetermined distance d2. It may be divided into more detailed states, or it may be divided into only two states, the first and second states. may be classified as follows.

[0126] The animation information storage unit 146 stores the various animations described above. Control information (hereinafter also referred to as "animation control information") is stored. The animation control information 2000 includes one or more drawing conditions for each predetermined object ID. The drawing conditions are associated with the data ID. When multiple types of animation data are available, which animation data For example, in the example shown in Figure 20, For a given object with the object ID "B01", multiple types of animation data are (Data ID) is prepared, and each drawing condition is specified. Data ID is As mentioned above, this is an ID assigned to each animation data. , uniquely corresponds to one specific animation data. In FIG. 20, data I D "D01(A01)" is the animation related to the user avatar M1 with avatar ID "A01". This indicates that the ID is associated with the application data.

[0127] For example, in the case of a specific object ID "B01", the transition from the non-proximity state to the proximity state ( The animation data with data ID "D01" is associated with the drawing conditions. In this case, for example, a user avatar M1 with an avatar ID "A01" and a predetermined object I When the positional relationship information relating to D “B01” transitions from a non-proximity state to a proximity state, The animation data of ID "D01(A01)" is drawn. For example, if the data ID is "B01", the parent-child relationship (drawing condition) is In this case, for example, a predetermined object ID " A predetermined object related to "B01" is subordinate to the user avatar M1 with the avatar ID "A01". When a parent-child relationship is formed, the animation of data ID "D02(A01)" The orientation data is drawn.

[0128] In addition, in the case of a predetermined object ID "B01", when forming a parent-child relationship, a predetermined condition is further Depending on whether the condition is met, different animation data is prepared. The conditions may be set in various ways depending on the type of animation data to be handled. For example, If the specified object is a "sword"-like object, the animation of drawing the sword and slashing will be displayed. In this case, animation data for swinging the sword and preparing it may be prepared. In this case, the predetermined condition related to the animation data of drawing the sword and slashing is This condition may be satisfied when the user input is an input instructing "slash." The predetermined condition related to the animation data of the raised stance is the user's This condition may be satisfied when the input is an input instructing "take a stance." The matching is performed by matching a predetermined object (an object resembling a "sword") with a user avatar M1. The timing may be just before the distance between the first and second electrodes reaches the first predetermined distance d1 (see FIG. 3). For example, The distance between the predetermined object and the user avatar M1 is a second predetermined distance d2 (see FIG. 3). The timing may be as follows:

[0129] The positional relationship calculation unit 150 calculates the distance between the user avatar M1 and a predetermined object (i.e., In this case, the distance between the objects is calculated. The objects do not have to be all predetermined objects, but may be objects in the vicinity of the user avatar M1. For example, the object related to one user avatar M1 may be a predetermined object. The object distance is calculated based on the movable range of the hand part M2 of the user avatar M1. The distance between the objects may be limited to a predetermined object located within the The calculation load can be reduced efficiently.

[0130] Furthermore, when the predetermined object includes a gift object, the positional relationship calculation unit 150 When the gift object falls from the top to the bottom in the virtual space, The distance between the objects may be calculated. This allows other users (e.g., viewing users) to User avatar M1 (streamer avatar) received a gift object from By bringing your hand close to the gift object that is coming, you can receive the gift object with your hand. It is possible to create animations that represent actions such as:

[0131] In this embodiment, the positional relationship calculation unit 150 calculates the position of the wrist joint of the user avatar M1 and the The distance between the object and the target object is calculated as the inter-object distance. The inter-object distance for the fixed object is calculated by the joint positions of the two wrists of the user avatar M1. Two calculations may be made based on the position.

[0132] As described above, the positional relationship calculation unit 150 calculates the inter-object distances for each predetermined object. When the distance is calculated, the data in the distance state storage unit 144 (see positional relationship information 1900 in FIG. 19) Specifically, the positional relationship calculation unit 150 generates and updates a positional relationship (or a coordinate system) for one predetermined object. When the distance between the objects is calculated, the first distance corresponding to the one predetermined object is calculated. Based on the predetermined distance d1 and the second predetermined distance d2, the object distance and the first predetermined distance d1 and / or generates and updates information representing the relationship with the second predetermined distance d2. The timing may be synchronized with the calculation timing by the positional relationship calculation section 150.

[0133] In this embodiment, as described above, the first predetermined distance d1 and the second predetermined distance d2 are set at corresponding positions. Since it is defined by a sphere (see Figure 3) centered on the position of the fixed object, The positional relationship information 1 is smaller than when the first predetermined distance d1 and / or the second predetermined distance d2 are different. However, in a modified example, a certain predetermined object With respect to the object, the first predetermined distance d1 and / or the second predetermined distance d2 may be determined depending on the direction (e.g., The direction of the hand part M2 relative to a predetermined object may differ.

[0134] The interference detection unit 154 uses the data in the distance state storage unit 144 (positional relationship information 190 in FIG. 19) 0), for each given object, interactions between two or more user avatars M1 are calculated. Specifically, the interference detection unit 154 detects an interference state between one or more user objects. For a given object that is a subordinate object, one or more other user objects When the distance between the objects becomes equal to or less than the first predetermined distance d1, an interference state (hereinafter , also referred to as "later interference state" for distinction).

[0135] In addition, the collision detection unit 154 detects two or more users interacting with one predetermined object in a free state. The object distance between the user and the object is simultaneously equal to or less than the first predetermined distance d1. Even if an interference state (hereinafter also referred to as a "simultaneous interference state" for the sake of distinction) is detected, good.

[0136] 21 is a schematic diagram illustrating the interference state detected by the interference detection unit 154. In this case, the hand parts M2 of the two user avatars M1 are the predetermined objects. The pencil object M3 is closer to the pencil object M3 by a first predetermined distance d1 or less (i.e., the distance d 3≦first predetermined distance d1), and a concurrent interference condition may be detected.

[0137] In the following, two or more users who form an interference state with respect to one predetermined object are referred to as In the case of a subsequent interference state, the avatar M1 treats the one predetermined object as a subordinate object. One or more user avatars M1 that have been used as the target and an object for one predetermined object and one or more other user avatars M1 whose inter-object distance has newly become equal to or less than the first predetermined distance d1. Two or more user avatars M that form an interference state with respect to one predetermined object 1 means that in the case of simultaneous interference, the object distance for one given object is These are the user avatars M1 whose distance is equal to or less than the first predetermined distance d1.

[0138] The object management unit 156 manages the parent-child relationships (an example of master-slave relationships) of various objects. In this embodiment, the object management unit 156 manages a predetermined object. The object management unit 156 manages the parent-child relationship for each object. 44 and the interference state detection result by the interference detection unit 154. The parent-child relationship setting information in the fixed object storage unit 142 is updated.

[0139] For example, the object management unit 156 may perform the following with respect to a specific object in a free state: When the positional relationship information for one user avatar M1 transitions from the second state to the first state ( That is, when the inter-object distance becomes equal to or less than the first predetermined distance d1, the predetermined object A parent-child relationship is established between the object and the user avatar M1. The object management unit 156 stores the setting information of the parent-child relationship related to the one predetermined object in a free state. information representing an exclusive state (an example of a first relationship) by the one predetermined object from the information representing the Update the information.

[0140] The object management unit 156 stores the setting information of the parent-child relationship related to one predetermined object in the form The information representing the exclusive state of the user avatar M1 is updated to the information representing the exclusive state of the user avatar M1. When the user changes the parent-child relationship, the updated parent-child relationship setting information (the user avatar) is updated until the specified cancellation condition is met. In this case, the object manager 156 maintains the information indicating the exclusive status of the object. monitors whether a predetermined release condition for the one predetermined object is met.

[0141] The predetermined release condition is satisfied when the release condition described above with reference to FIG. 18 is satisfied. The release conditions are as described above and are defined in the predetermined object storage unit 142. In this embodiment, the predetermined cancellation condition is, as will be described later, when another user avatar It can also be fulfilled by sharing with M1, handing over to another user avatar M1, etc.

[0142] Then, the object management unit 156 determines whether the predetermined cancellation condition for the one predetermined object has been met. If the above is true, the setting information of the parent-child relationship related to the one predetermined object is (Setting information of parent-child relationship in the predetermined object storage unit 142) is updated.

[0143] In this embodiment, the object manager 156 manages, for example, the collision detection unit 154. Based on the result, the parent-child relationship for one predetermined object is adjusted.

[0144] Specifically, the object management unit 156 determines whether the interference state of a specific object is interfering with the object. If the interference detection unit 154 detects it, the information on whether the one predetermined object can be shared (see FIG. 18 object information 1800), the parent related to the one predetermined object For example, the child relationship may be adjusted in one location where an interference state is detected by the interference detection unit 154. If a specified object cannot be shared, two or more user objects that form the interference state The relationship between two or more user objects is determined based on the value of a predetermined parameter that describes the relationship between the objects. The parent-child relationship of the one specified object is adjusted so that one of them becomes the parent. The predetermined parameters are as described above with reference to FIG. A predetermined object is moved based on the value of a force parameter that represents the force relationship between the user objects on the In this case, the parent-child relationships of two or more user objects may be adjusted. That is, the user object with the largest value of the force parameter is the one of the predetermined objects. The parent-child relationship of the one predetermined object may be adjusted so that the other object becomes the parent. Among these user objects, the user object with the highest priority parameter value is The parent of the one predetermined object is set so that the object becomes the parent of the one predetermined object. Child relationships may be adjusted.

[0145] On the other hand, if a predetermined object for which an interference state is detected by the interference detection unit 154 is sharable, If there is, the object management unit 156 sets the sharing conditions (object information 1800 in FIG. 18) In this case, if the sharing condition is satisfied, the specified object The parent-child relationship setting information for the object is converted into information representing the shared state (an example of a second relationship), At this time, the parent-child relationship setting for the one predetermined object before the update is The information is in a state of exclusive use by one of two or more user objects that form the interference state. If the state is true, the predetermined cancellation condition is met.

[0146] If the sharing condition is not met, the object manager 156 creates the interference state. Based on the value of a predetermined parameter that represents a relationship between two or more user objects, In this case, it is determined whether or not the predetermined release condition for the specified object is satisfied. The value of the force parameter of the user avatar M1, which was the parent immediately before the interference state was detected, is If the force parameter value of the user avatar M1 is larger than that of the other user avatar M1 that formed the interference state, the interference state is In this case, the predetermined cancellation condition due to the interference state is not satisfied. The exclusive state of the user avatar M1, who was the parent immediately before the transfer, is maintained. The value of the force parameter of the user avatar M1, which was the parent just before the interference state was detected, is If the value of the force parameter of the other user avatar M1 that formed the interference state is smaller than that of the other user avatar M2, the interaction state is In this case, the object manager may The unit 156 stores setting information of the parent-child relationship related to the one predetermined object (predetermined object record The parent-child relationship setting information in the memory 142 is set to the user object with the larger value of the force parameter. The information is updated to represent the state of occupation by the object. Although adjustment has been described, the same may be true for adjustment based on priority parameters.

[0147] The object management unit 156 manages the object in a shared state by two or more user avatars M1. When the interference detection unit 154 detects an interference state relating to a certain predetermined object, Similarly, a predetermined parameter representing the relationship between two or more user objects forming the interference state is used. Based on the value of the parameter, it is determined whether or not a predetermined release condition related to the one predetermined object is satisfied. In this case, two or more users who were parents immediately before the interference condition was detected may be The values ​​of the force parameters of the avatar M1 are compared with the values ​​of the other user avatar M1 If the force parameter value is greater than the value of the force parameter, the predetermined release condition due to the interference state is not met. In this case, two or more users who were parents just before the interference state was detected may The shared state by user avatar M1 is maintained. On the other hand, just before the interference state is detected, At least one of the values ​​of the force parameters of two or more parent user avatars M1 is If the value of the force parameter of the user avatar M1 that created the interference state is smaller than the value of the force parameter of the user avatar M1, A predetermined release condition caused by the interference state may be satisfied. The management unit 156 stores the setting information of the parent-child relationship related to the one predetermined object (predetermined object The parent-child relationship setting information in the parent storage unit 142 is sorted by a predetermined number of units in descending order of the value of the force parameter. The information is updated to represent the shared state of the user object. The adjustment based on the data has been described, but the same can be said for the adjustment based on the priority parameter. stomach.

[0148] For further details of the adjustment method by the object manager 156, please refer to FIGS. 23 to 26. This will be discussed later.

[0149] The animation control unit 157 cooperates with the object management unit 156 to It controls the operation of the animation drawing unit 2584 of the drawing processing unit 258 in the device 20. When the animation control unit 157 causes the drawing processing unit 258 to draw animation, Animate drawing command including data ID related to animation data to be drawn The animation control unit 157 also stops the drawing of the animation. When stopping the animation, a stop command is given to the animation drawing unit 2584.

[0150] The animation control unit 157 controls the animation based on the data in the animation information storage unit 146. For each predetermined object, drawing conditions (see animation control information 2000 in FIG. 20) are set. ) is monitored for success or failure. Then, the animation control unit 157 When the drawing condition is met, a drawing command including the corresponding data ID is sent to the one predetermined object. The terminal device 20 (for example, For example, the animation of the terminal device 20 that is drawing the terminal image including the user avatar M1 The image is provided to the motion drawing unit 2584.

[0151] When an animation starts, the animation control unit 157 Changes in parent-child relationships of specified objects drawn by the application (when specified cancellation conditions are met) When a change in the parent-child relationship occurs, the animation is For example, if the parent-child relationship changes from an exclusive state to a free state, The animation control unit 157 sends a stop command to the animation In this case, instead of a stop command, a stop command is sent to the animation drawing unit 2584. Animation data (for example, in the case of pencil object M3, the action of releasing pencil object M3 A drawing command including a data ID relating to the animation data is sent to the animation drawing unit 2584. may be given to.

[0152] FIG. 22 shows a state machine that can be suitably used in the animation control unit 157. The example shown in FIG. 22 is an explanatory diagram of an example of the state machine described above with reference to FIG. The difference is that states ST220 to ST222 have been added. 220 represents the exclusive state for a given object "Pocky (registered trademark)." In this case, for example, an animation of opening a bag containing Pocky may be drawn. If an interference state is detected in the exclusive state, the two users who form the interference state are Depending on the intimacy level of the user avatar M1, the state transitions to either state ST221 or state ST222. Specifically, if the intimacy level is less than the threshold, the state transitions to ST221, and the exclusive state As an animation of the state, one person (user avatar M1 in the exclusive state) eats Pocky. If the intimacy level is equal to or greater than the threshold, the state transitions to state ST222, As an animation of the shared state, the action of two people eating Pocky may be depicted.

[0153] If the subordinate object is a specific predetermined object, the prohibition processing unit 158 In other words, a specific object is not allowed to be When a parent-child relationship is formed in which the avatar M1 is a subordinate object, the prohibition processing unit 158 The parent-child relationship is maintained (for example, until the release condition is met), and the interference state is maintained. The predetermined process is performed to prevent the occurrence of the interference state (later interference state). The terminal device 20 of the user who operates the user avatar that may cause the In response to such feedback, the terminal device 20 may For example, a haptic device may be used as one element of the input unit 24. When the user holds the chair, the hand part M2 of the corresponding user avatar M1 is The user is instructed via a haptic device to avoid approaching certain predetermined objects. Vibration, reaction force, etc. may be applied to the

[0154] In the examples shown in FIGS. 7 to 22, the server device 10 and the terminal device 20 cooperate with each other. Although various functions are realized by these, the allocation of such functions can be changed as appropriate. That is, some or all of the various functions of the server device 10 shown in FIG. 16 are implemented by the terminal device 20. Conversely, some of the various functions of the terminal device 20 shown in FIG. For example, the positional relationship calculation unit of the server device 10 may 150 and the interference detection unit 154 may be partly or entirely realized by the terminal device 20. In addition, the avatar action processing unit 254 and the drawing processing unit 258 of the terminal device 20 may be partially or entirely This may be realized by the server device 10.

[0155] Next, referring to FIGS. 23 to 26, the adjustment method by the object management unit 156 described above will be explained. An example of the operation of the server device 10 related to the law will be described.

[0156] FIG. 23 shows the adjustment method by the object management unit 156 and the server device 10. 23 is a flowchart showing an example of processing to be executed repeatedly at predetermined intervals. may be executed.

[0157] In step S2300, the server device 10 extracts a predetermined object to be monitored. The predetermined object to be monitored is drawn on a terminal image displayed on any terminal device 20. In other embodiments, the predetermined object to be monitored may be The object may be any predetermined object. In a situation where M1 is placed, the same predetermined object is displayed simultaneously on two or more terminal devices 20. Sometimes it may be drawn.

[0158] In step S2302, the server device 10 extracts one or more The predetermined objects are sorted in a predetermined order, and the variable k is set to "1."

[0159] In step S2304, the server device 10 selects the k-th predetermined object as the processing target. Set it as an object.

[0160] In step S2306, the server device 10 Based on the object information 1800 (see FIG. 18), the parent-child relationship related to the kth predetermined object is calculated. If the result of the determination is "YES", Proceed to step S2308, otherwise (parent-child relationship setting information is in exclusive or shared state) If the value of the .DELTA..times ...

[0161] In step S2308, the server device 10 simultaneously The interference detection unit 15 determines whether or not a simultaneous interference state has been detected. As described above in relation to 4. If the determination result is "YES", step S2310 otherwise, proceed to step S2312.

[0162] In step S2310, the server device 10 executes the same process for the predetermined object in the free state. When the interference state occurs, an adjustment process (hereinafter also referred to as "first adjustment process") is executed. This first adjustment process will be described later with reference to FIG.

[0163] In step S2312, the server device 10 calculates the positional relationship information 1900 (see FIG. 19) Based on this, the distance (of the object) between any one user avatar M1 and the k-th predetermined object is calculated. It is determined whether the distance between the objects has become equal to or less than the first predetermined distance d1. The user device 10 acquires the kth predetermined object for any one user avatar M1. The positional relationship information is used to determine whether or not there is a transition from the second state to the first state. If "YES", proceed to step S2314, otherwise proceed to step S2318. move on.

[0164] In step S2314, the server device 10 checks whether the parent-child relationship related to the kth predetermined object is correct. The setting information of the relationship is calculated from the information representing the free state of the subordinate object of one user avatar M1. In this case, the user avatar M1 is updated to the information representing the exclusive state. , positional relationship information relating to the kth predetermined object (positional relationship with respect to each user avatar M1) The user avatar related to the positional relationship information that transitioned from the second state to the first state, among the positional relationship information M1, and hereinafter, simply referred to as "the user avatar that has formed the exclusive state of the kth predetermined object." It is also called "-M1".

[0165] In step S2316, the server device 10 connects the k-th predetermined object and the k-th predetermined object. The combination of the user avatar M1 and the user avatar M2 that has created an exclusive state of the predetermined object of the eye In order to draw the animation (in Figure 23, it is written as "Exclusive state animation") A drawing command including a data ID relating to the corresponding first animation data is sent to the corresponding terminal. In this case, the corresponding terminal device 20 transmits the k-th predetermined object to the In this case, the corresponding terminal device 20 is Based on the first animation data corresponding to the data ID included in the drawing command, Draw animation.

[0166] In step S2316, a parent-child relationship is formed with respect to the k-th predetermined object. The predetermined conditions for the drawing conditions when the animation is created (see animation control information 2000 in FIG. 20) are set. If the data ID is specified, a data ID according to the predetermined condition may be selected.

[0167] In step S2318, the server device 10 calculates the positional relationship information 1900 (see FIG. 19) Based on this, the distance (of the object) between any one user avatar M1 and the k-th predetermined object is calculated. It is determined whether the distance between the objects has become equal to or less than the second predetermined distance d2. The user device 10 calculates the position of the kth predetermined object for an arbitrary user avatar M1. Regarding the related information, it is judged whether there is a transition from non-proximity state to proximity state. If the judgment result is "Y If "ES", proceed to step S2320, otherwise proceed to step S2322. nothing.

[0168] In step S2320, the server device 10 determines whether the kth predetermined object is in proximity with the kth predetermined object. The animation (see FIG. 23) shows the combination of the user avatar M1 and the user avatar M2. In order to draw the corresponding second animation (described as "proximity animation"), The terminal device 20 then transmits a drawing command including a data ID related to the drawing data to the corresponding terminal device 20. In this case, the corresponding terminal device 20 generates the second animation corresponding to the data ID included in the drawing command. Draws animation based on the motion data.

[0169] In step S2322, the server device 10 executes the animation related to the k-th predetermined object. A command to stop the animation is sent to the terminal device 20 that is drawing the animation. In this case, the corresponding terminal device 20 stops the animation mode and switches to the normal mode. Various objects (including the user avatar M1) are drawn by the kth position. If there is no terminal device 20 that is drawing animation related to a specified object, If so, step S2322 is skipped.

[0170] In step S2323, the server device 10 reads the object in the predetermined object storage unit 142. Based on the object information 1800 (see FIG. 18), the kth predetermined object is associated with the kth predetermined object. If the result of the determination is "YES", If so, proceed to step S2324; otherwise, the parent-child relationship setting information indicates the exclusive state. The process proceeds to step S2326.

[0171] In step S2324, the server device 10 Based on the object information 1800 (see FIG. 18), the parent-child relationship related to the kth predetermined object is calculated. If the result of the determination is "YES", the step otherwise (if the parent-child relationship setting information indicates a shared state), Proceed to step S2328.

[0172] In step S2326, the server device 10 performs the exclusive state of one user avatar M1. and executes an adjustment process (hereinafter also referred to as "second adjustment process") for the predetermined object. This second adjustment process will be described later with reference to FIG.

[0173] In step S2328, the server device 10 executes the shared image processing by two or more user avatars M1. The adjustment process (hereinafter also referred to as "third adjustment process") is performed on a predetermined object in a valid state. This third adjustment process will be described later with reference to FIG.

[0174] In step S2330, the server device 10 extracts one or more If the result of the determination is "YES", it is determined whether all of the predetermined objects have been processed. If ", the processing of this cycle is terminated; otherwise, the process returns to step S2332. The process from step S2304 is repeated.

[0175] In step S2332, the server device 10 increments the variable k by "1". .

[0176] FIG. 24 shows the adjustment process for the simultaneous occurrence of interference states related to a predetermined object in the free state. 23 is a schematic flowchart showing an example of the first adjustment process (step S2310 in FIG. 23). be.

[0177] In step S2400, the server device 10 reads the object in the predetermined object storage unit 142. Based on the object information 1800 (see FIG. 18), the kth predetermined object is associated with the kth predetermined object. If the result of the determination is "YES", If so, proceed to step S2402; otherwise, proceed to step S2408.

[0178] In step S2402, the server device 10 executes the kth predetermined object. Based on the information of the shared condition (see object information 1800 in FIG. 18), the shared condition is The sharing conditions may be as described above with reference to FIG. If the determination result is "YES", the process proceeds to step S2404; otherwise, The processing of the cycle ends. That is, if the sharing condition is not met, the kth predetermined object However, if the sharing conditions are not met, the project remains free. You may proceed to 2408.

[0179] In step S2404, the server device 10 checks whether the parent-child relationship related to the kth predetermined object is correct. The setting information of the relationship is calculated from the information representing the free state to the information representing two or more simultaneous interference states. The information is updated to indicate a shared state in which the object is a subordinate object of user avatar M1.

[0180] Also, in the object information 1800 (see FIG. 18) relating to the k-th predetermined object, The sharing information specifies the maximum number of user avatars M1 that can be shared, and If the number of two or more user avatars M1 that form simultaneous interference states exceeds the maximum number, In this case, the server device 10 determines whether or not the user avatar M1 is a user based on the values ​​of the predetermined parameters of the two or more user avatars M1. Based on this, the maximum number of user avatars M that have the kth predetermined object as a subordinate object is In this case, for example, when a force parameter is used, the force parameter may be determined as described above. The maximum number of user avatars M1 in descending order of the parameter value are assigned to the k-th predetermined object. In this case, the server device 10 may select the kth predetermined object as the “parent” of the kth predetermined object. The parent-child relationship setting information for the object is calculated from the information representing the free state, and the simultaneous interference state is calculated. The maximum number of users among the two or more user avatars M1 that are created as described above is determined. The information is updated to represent a shared state that makes the object a subordinate object of avatar M1.

[0181] In step S2406, the server device 10 connects the k-th predetermined object and the k-th predetermined object. A combination of two or more user avatars M1 that form a shared state of a predetermined object of interest animation related to the shared state (shown as "shared state animation" in Figure 24) In order to do so, a drawing command including a data ID relating to the corresponding first animation data is sent to the corresponding In this case, the corresponding terminal device 20 transmits the image data included in the drawing command. The animation is drawn based on the first animation data corresponding to the data ID. do.

[0182] In step S2408, the server device 10 detects two or more simultaneous interference states. Based on the values ​​of the predetermined parameters of the user avatar M1, a simultaneous interference state is formed. Among the two or more user avatars M1, the k-th predetermined object is set as a subordinate object. In this case, for example, a force parameter is used. In this case, as described above, the user avatar M1 with the largest value of the force parameter is the kth A user avatar M1 may be selected as a user avatar M1 having a predetermined object as a subordinate object. stomach.

[0183] In step S2410, the server device 10 checks the parent-child relationship related to the kth predetermined object. The setting information of the user determined in step S2408 is used to determine whether the user is free. The information is updated to indicate the exclusive state of the object as a subordinate of avatar M1.

[0184] In step S2412, the server device 10 connects the k-th predetermined object and the step The animation associated with the combination with the user avatar M1 determined in S2408 (see Figure 1) In 24, in order to draw the "exclusive state animation", A drawing command including a data ID relating to the animation data is transmitted to the corresponding terminal device 20. In this case, the corresponding terminal device 20 receives the first image corresponding to the data ID included in the drawing command. Draws animation based on animation data.

[0185] FIG. 25 shows an adjustment process for a predetermined object in an exclusive state by one user avatar M1. 23 is a schematic flowchart showing an example of the second adjustment process (step S2326 in FIG. 23) In the following, before starting this adjustment process, the kth predetermined object is treated as a subordinate object. The user avatar M1 that was the current exclusive user avatar M1 is also referred to as the "currently exclusive user avatar M1." do.

[0186] In step S2500, the server device 10 executes the following process for the k-th predetermined object. The interference detection unit 154 determines whether or not a subsequent interference state has been detected. If the determination result is "YES", the process proceeds to step S2502. Otherwise, proceed to step S2518.

[0187] In step S2502, the server device 10 reads the object in the predetermined object storage unit 142. Based on the object information 1800 (see FIG. 18), the kth predetermined object is associated with the kth predetermined object. If the result of the determination is "YES", If so, proceed to step S2504; otherwise, proceed to step S2510.

[0188] In step S2504, the server device 10 executes the kth predetermined object. Based on the information of the shared condition (see object information 1800 in FIG. 18), the shared condition is The sharing conditions may be as described above with reference to FIG. If the determination result is "YES", the process proceeds to step S2506; otherwise, If the result of the determination is "YES", the predetermined cancellation condition is satisfied. In other words, in this case, the predetermined cancellation condition is that an interference state is detected and the sharing condition is satisfied. The condition is met based on the factor (an example of the first factor) that the condition is met. As described above, the sharing condition is, for example, when two or more user accounts form a subsequent interference state. This may be satisfied if the intimacy between Butter M1 is equal to or greater than a threshold.

[0189] In step S2506, the server device 10 checks whether the parent-child relationship related to the kth predetermined object is correct. The information representing the exclusive state is used to determine the relationship between two or more users who have formed a subsequent interference state. The information is updated to represent a shared state that makes the object a subordinate object of avatar M1.

[0190] Also, in the object information 1800 (see FIG. 18) relating to the k-th predetermined object, The sharing information specifies the maximum number of user avatars M1 that can be shared, and ,If the number of two or more user avatars M1 that form a subsequent interference state exceeds the maximum number, The server device 10 determines whether or not the user avatars M1 are the same as the user avatars M1 based on the values ​​of the predetermined parameters of the two or more user avatars M1. Then, the maximum number of user avatars M1 that have the k-th predetermined object as a subordinate object is calculated. In this case, for example, when a force parameter is used, the force parameter may be determined as described above. The maximum number of user avatars M1 in the order of the largest data value are assigned to the k-th predetermined object. In this case, the server device 10 may select the kth predetermined object as the “parent.” The parent-child relationship setting information related to the exclusive state is divided into two parts, which form the subsequent interference state. Among the above user avatars M1, the maximum number of user avatars M determined as described above It is updated to represent the shared state of the object that is a subordinate of object 1.

[0191] In step S2508, the server device 10 connects the k-th predetermined object and the k-th predetermined object. A combination of two or more user avatars M1 that form a shared state of a predetermined object of interest animation related to the shared state (in Figure 25, it is written as "animation in shared state") In order to do so, a drawing command including a data ID relating to the corresponding first animation data is sent to the corresponding In this case, the corresponding terminal device 20 transmits the image data included in the drawing command. The animation is drawn based on the first animation data corresponding to the data ID. do.

[0192] In step S2510, the server device 10 detects two or more users who have formed a subsequent interference state. Based on the values ​​of the predetermined parameters of the user avatar M1, two or more subsequent interference states are generated. Among the above user avatars M1, the kth predetermined object is set as a subordinate object. In this case, for example, when a priority parameter is used, In this case, as described above, the user avatar M1 with the largest priority parameter value is the kth A user avatar M1 may be selected as a user avatar M1 having a predetermined object as a subordinate object. This also applies when using force parameters.

[0193] In step S2512, the server device 10 executes the user account determined in step S2508. It is determined whether the avatar M1 is the currently exclusive user avatar M1. If the determination result is " If "YES", change the parent-child relationship setting information for the kth specified object. (In this case, the animation in the corresponding terminal device 20 is On the other hand, if the result of the determination is "NO", the predetermined cancellation condition is met. This means that the condition is met, and the process proceeds to step S2514. In other words, the determination result is "NO." In this case, the predetermined release condition is that an interference state is detected and the currently occupied user avatar M1 The first state is formed later for the kth given object. The user avatar M1 (the one created) is stronger or has a higher priority (the second factor). The condition will be met based on the following factors:

[0194] In step S2514, the server device 10 checks whether the parent-child relationship related to the kth predetermined object is correct. The setting information of the user is calculated from the information indicating the exclusive status of the currently exclusive user avatar M1. The exclusive state of the object that is the subordinate object of one user avatar M1 determined in step S2510 is Update the information to represent the

[0195] In step S2516, the server device 10 connects the k-th predetermined object and the step The animation associated with the combination with one user avatar M1 determined in S2510 (Fig. In 25, in order to draw the "exclusive state animation", A drawing command including a data ID relating to the animation data is transmitted to the corresponding terminal device 20. In this case, the corresponding terminal device 20 receives the first image corresponding to the data ID included in the drawing command. Draws animation based on animation data.

[0196] In step S2518, the server device 10 executes the release related to the k-th predetermined object. It is determined whether the condition (see object information 1800 in FIG. 18) is met. For the kth given object, the release condition for the exclusive state and the release condition for the shared state are When the lease conditions are associated with each other (for example, when the predetermined object ID “B01” in FIG. 18 is If the result is "YES," the release conditions for the exclusive state are used. If the condition for canceling the setting is met, the process proceeds to step S2520. End the periodic processing (in this case, animation drawing in the corresponding terminal device 20) Processing continues).

[0197] In step S2520, the server device 10 checks whether the parent-child relationship related to the kth predetermined object is correct. The setting information of the association is updated from information representing an exclusive state to information representing a free state.

[0198] In step S2522, the server device 10 executes the animation related to the k-th predetermined object. A command to stop the animation is sent to the terminal device 20 that is drawing the animation. In this case, the corresponding terminal device 20 stops the animation mode and switches to the normal mode. Various objects (including the user avatar M1) are drawn by this.

[0199] FIG. 26 shows the status of a given object shared by two or more user avatars M1. 23 is a schematic flow chart showing an example of the third adjustment process (step S2328 in FIG. 23) which is an adjustment process. Before starting this adjustment process, the kth predetermined object is treated as a subordinate object. Two or more user avatars M1 that were the object of the It is also called "Avatar M1".

[0200] In step S2600, the server device 10 executes the following process for the k-th predetermined object. The interference detection unit 154 determines whether or not a subsequent interference state has been detected. If the determination result is "YES", the process proceeds to step S2602. Otherwise, proceed to step S2610.

[0201] In step S2602, the server device 10 detects two or more users who have formed a subsequent interference state. k in such a manner that the sharing condition is satisfied based on the values ​​of the predetermined parameters of the user avatar M1. Determine two or more user avatars M1 that have the th predetermined object as a subordinate object. Also, object information 1800 (see FIG. 18) relating to the kth predetermined object In the above, the sharing information specifies the maximum number of user avatars M1 that can be shared. Furthermore, if the number of two or more user avatars M1 that form the subsequent interference state exceeds the maximum number, In this case, the server device 10 determines whether or not the user avatar M1 is a user based on the values ​​of the predetermined parameters of the two or more user avatars M1. Based on this, the maximum number of user avatars M that have the kth predetermined object as a subordinate object is In this case, for example, when a force parameter is used, the force parameter may be determined as described above. The maximum number of user avatars M1 in descending order of the parameter value are assigned to the k-th predetermined object. may be selected as the "parent" of the

[0202] In step S2604, the server device 10 selects two or more servers determined in step S2602. It is determined whether the user avatar M1 is one of two or more currently occupied user avatars M1. If the result of the determination is "YES", the parent-child relationship setting for the kth predetermined object is performed. The processing for this cycle ends without changing the information (in this case, the corresponding terminal device 20 (The animation drawing process continues in the current state.) On the other hand, if the result is "NO", If so, it means that the predetermined cancellation condition is satisfied and the process proceeds to step S2606.

[0203] In step S2606, the server device 10 checks whether the parent-child relationship related to the kth predetermined object is correct. Information indicating the sharing status of the setting information of the user relationship by two or more currently exclusive user avatars M1 , which are subordinate objects of two or more user avatars M1 determined as described above. Update the information to represent the shared state.

[0204] In step S2608, the server device 10 connects the k-th predetermined object and the k-th predetermined object. A combination of two or more user avatars M1 that form a shared state of a predetermined object of interest animation related to the shared state (in Figure 26, this is called "animation in shared state") In order to do so, a drawing command including a data ID relating to the corresponding first animation data is sent to the corresponding In this case, the corresponding terminal device 20 transmits the image data included in the drawing command. The animation is drawn based on the first animation data corresponding to the data ID. do.

[0205] In step S2610, the server device 10 executes the release related to the k-th predetermined object. It is determined whether the condition (see object information 1800 in FIG. 18) is met. For the kth given object, the release condition for the exclusive state and the release condition for the shared state are If there is a lease agreement, the release agreement for the shared state is used (e.g. For example, see the specific object ID "B01" in Figure 18. The conditions for sharing include the release conditions for each user avatar M1 that forms the shared state, and the overall If the result of the determination is "YES", the predetermined release conditions are met. If this is the case, the process proceeds to step S2612. Otherwise, the process for this cycle ends. (In this case, the animation drawing process in the corresponding terminal device 20 continues.) ).

[0206] In step S2612, the server device 10 checks the parent-child relationship related to the kth predetermined object. The setting information of the association is updated from information indicating a shared state to information indicating a free state.

[0207] In step S2614, the server device 10 executes the animation related to the k-th predetermined object. A command to stop the animation is sent to the terminal device 20 that is drawing the animation. In this case, the corresponding terminal device 20 stops the animation mode and switches to the normal mode. Various objects (including the user avatar M1) are drawn by this.

[0208] In the example shown in FIG. 26, in step S2612, two or more nodes forming a shared state are When the above release conditions for a part of the user avatar M1 are satisfied, the server device 10: The parent-child relationship setting information for the kth specified object is stored in the From the information representing the shared state by the avatar M1, the exclusive state or the shared state by two or more other M1s can be In this case, in the next step S2614, the server The server device 10 sends a drawing command including a data ID related to the corresponding first animation data. It may be sent to the corresponding terminal device 20.

[0209] In addition, in order to prevent the explanation from becoming complicated, the examples shown in FIGS. 23 to 26 are explained with reference to FIG. 16. Although the operation of the prohibition processing unit 158 ​​and the like is omitted, it is possible to incorporate them as appropriate. be.

[0210] This embodiment has been described in detail above with reference to the drawings, and the specific configuration has been explained above. The present invention is not limited to the various embodiments, and includes designs within the scope of the present invention. can be.

[0211] For example, in the above-described embodiment, the animation is This applies only to the hand part M2, but is not limited to this. The animation is for the hand part Combinations of M2 and arm parts (elbow and shoulder parts) are available. Alternatively, if the animation relates to the eating action of the user avatar M1, , may include animation of some facial features (for example, the mouth).

[0212] Regarding the above disclosure, the following additional remarks (corresponding to the scope of the claims as originally filed in the original application) are provided: Disclose.

[0213] [Appendix 1] An object that stores object information about various objects located in a virtual space. a storage unit; Based on the object information, various objects in the virtual space are drawn. a drawing processing unit that generates a display image; User input related to a user object associated with a user among various objects an input acquisition unit that acquires a force; Determine the movement of the user object in the virtual space based on the user input. an operation processing unit for determining One or more predetermined objects among various objects and the user object A positional relationship is an information generation method for generating positional relationship information that represents a positional relationship in the virtual space. With Naribe, a first animation relating to a combination of the predetermined object and the user object; a drawing information storage unit that stores first drawing information for drawing the object, The drawing processing unit determines whether the predetermined object and the user are in a predetermined position based on the positional relationship information. When the distance between the object and the image is equal to or shorter than a predetermined distance, the An information processing system that draws the first animation.

[0214] [Appendix 2] the information generation unit generates the positional relationship information for each of the predetermined objects; the drawing information storage unit stores the first drawing information for each of the predetermined objects; The drawing processing unit determines a positional relationship between the predetermined object and the predetermined object based on the positional relationship information. When the distance between the predetermined object and the user object becomes equal to or less than the predetermined distance, Then, the first animation is generated based on the first drawing information related to the one predetermined object. 2. The information processing system of claim 1, wherein the information processing system renders a motion.

[0215] [Appendix 3] the user object includes a plurality of connected parts; the plurality of parts includes a first part and a second part; the positional relationship information includes positional relationship information regarding the first part, The first animation is an information processing method according to claim 1 or 2, which is related to the first part. system.

[0216] [Appendix 4] When drawing the first animation, the drawing processing unit and drawing the second part of the user object. Hmm.

[0217] [Appendix 5] the user object has a shape resembling a human; the first parts include parts corresponding to the palm and fingers of a person beyond the wrist, The user input is a combination of various joints of a part of the corresponding user that corresponds to the second part. 5. The information processing system according to claim 4, including information on the movement of the area.

[0218] [Appendix 6] The information generation unit, based on position information of various joints of the part corresponding to the second part, 6. The information processing system according to claim 5, wherein the positional relationship information is generated.

[0219] [Appendix 7] The user input is a combination of various joints of a part of the corresponding user that corresponds to the first part. or movement information of the region, The drawing processing unit determines whether the distance between the predetermined object and the user object is a predetermined value. If the distance is greater than the predetermined distance, the information on the various joints of the part corresponding to the first part or the Based on the motion information, the first part is drawn while the first animation is drawn. When doing so, the first part is selected based on information on various joints of the part corresponding to the first part or information on the movement of the part. The information processing system according to claim 4 or 5, wherein the first part is drawn without any modification.

[0220] [Appendix 8] The positional relationship information includes a first state in which the distance is equal to or less than the predetermined distance, and a second state in which the distance is equal to or less than the predetermined distance. and a second state in which the distance is greater than a predetermined distance. represents The rendering processing unit determines whether the first animation is in a transition from the second state to the first state. 8. An information processing system according to any one of claims 1 to 7, which draws animation.

[0221] [Appendix 9] An object management unit that manages the master-slave relationships of various objects is further provided, The object management unit manages one of the user objects and one of the predetermined objects. Based on the transition from the second state to the first state in the positional relationship, The first relationship is that the specified object becomes a dependent object of the one user object. 9. The information processing system according to claim 8, wherein the master-slave relationship relating to the one predetermined object is updated. Stem.

[0222] [Appendix 10] The object management unit manages the master-slave relationship related to the one predetermined object in the first When the relationship is updated to a master-slave relationship, the updated master-slave relationship is maintained until a predetermined cancellation condition is met. 10. The information processing system of claim 9.

[0223] [Appendix 11] The drawing processing unit continues to perform the above-described processing based on the master-slave relationship until the predetermined cancellation condition is met. One user object and the one predetermined object that is the subordinate object of the user object. The information processing system according to claim 10, Tem.

[0224] [Appendix 12] The predetermined cancellation condition is the passage of a predetermined time, a transition from the first state to the second state, and , a release input included in the user input, 12. The information processing system according to claim 10 or 11,

[0225] [Appendix 13] The one predetermined object that is the subordinate object of the one user object The positional relationship of another user object with respect to the second state is changed from the second state to the first state. When a transition occurs, or when the user object for the predetermined object and the positional relationship of another user object relative to the one predetermined object. When the positional relationship and the positional relationship simultaneously transition from the second state to the first state, an interference state is detected. an interference detection unit for detecting the interference; The object management unit determines the one predetermined object based on the detection result by the collision detection unit. 13. The information processing system according to claim 11, wherein the master-slave relationship relating to the object is adjusted. Hmm.

[0226] [Appendix 14] The object management unit manages the one user object and the other one user object. and a predetermined parameter representing a relationship between the object and the predetermined object. The information processing system described in Appendix 13 adjusts the master-slave relationship.

[0227] [Appendix 15] the predetermined parameters include a parameter representing a degree of intimacy; The predetermined cancellation condition is that the interference state is detected and the one user object and Based on a first factor including that the intimacy between the other user object is equal to or greater than a threshold value. and is fulfilled according to When the predetermined cancellation condition is satisfied based on the first cause, the object management unit In this case, the one predetermined object is a user object and the other user object. a second relationship in which the first object is a dependent object of the second object, The information processing system according to claim 14, wherein the master-slave relationship is updated.

[0228] [Appendix 16] The drawing processing unit converts the master-slave relationship related to the one predetermined object into the second relationship. When updated, the one user object and the other one user object and their The first object related to the combination with the one predetermined object that is the subordinate object 16. The information processing system of claim 15, wherein the information processing system renders an animation.

[0229] [Appendix 17] the predetermined parameters include parameters representing power relationships or priority relationships; The predetermined cancellation condition is that the interference state is detected and the one user object a second user object having a stronger power or a higher priority than the other user object; Based on the factors, When the predetermined cancellation condition is satisfied based on the second factor, the object management unit In this case, the one predetermined object is a subordinate object of the other one user object. and updating the master-slave relationship related to the one predetermined object to another first relationship. , the information processing system described in Appendix 14.

[0230] [Appendix 18] If the subordinate object is a specific predetermined object, the interference condition does not occur. Any one of appendices 13 to 17, further comprising a prohibition processing unit that performs a predetermined process to prevent Item 1. An information processing system according to item 1.

[0231] [Appendix 19] The drawing information storage unit stores a second animation related to the one user object alone. storing second drawing information for drawing; The second state is a close state in which the distance is greater than the predetermined distance and equal to or less than a second predetermined distance. a close state in which the distance is greater than the second predetermined distance, The drawing processing unit determines whether the second access point is in the proximity state or not based on the transition from the non-proximity state to the proximity state. An information processing system according to any one of appendices 8 to 18, which renders an animation. Hmm.

[0232] [Appendix 20] 19. The predetermined distance is set for each of the predetermined objects. 10. The information processing system according to claim 1,

[0233] [Appendix 21] The predetermined object may be a gift object related to a gift given by another user. Including, The information generating unit generates a signal indicating that the gift object falls from above to below in the virtual space. 21. The method of claim 1, wherein the positional relationship information relating to the gift object is generated when the gift object is generated. 10. An information processing system according to any one of the preceding claims.

[0234] [Appendix 22] An object that stores object information about various objects located in a virtual space. a step of storing information; Based on the object information, various objects in the virtual space are drawn. a rendering processing step for generating a display image; User input related to a user object associated with a user among various objects an input acquisition step for acquiring a force; Determine the movement of the user object in the virtual space based on the user input. an operation processing step of determining One or more predetermined objects among various objects and the user object A positional relationship is an information generation method for generating positional relationship information that represents a positional relationship in the virtual space. and a first animation relating to a combination of the predetermined object and the user object; a drawing information storage step of storing first drawing information for drawing the motion; The drawing processing step is a step of drawing the predetermined object and the predetermined object based on the positional relationship information. When the distance between the user object and the first drawing information becomes equal to or less than a predetermined distance, and drawing the first animation. method.

[0235] [Appendix 23] An object that stores object information about various objects located in a virtual space. information storage processing; Based on the object information, various objects in the virtual space are drawn. a rendering process for generating a display image; User input related to a user object associated with a user among various objects an input acquisition process for acquiring a force; Determine the movement of the user object in the virtual space based on the user input. an operation process for determining the One or more predetermined objects among various objects and the user object A positional relationship is an information generation method for generating positional relationship information that represents a positional relationship in the virtual space. Chemical treatment and a first animation relating to a combination of the predetermined object and the user object; a drawing information storage process for storing first drawing information for drawing the image; Let them go, The drawing process is a process of drawing the predetermined object and the user object based on the positional relationship information. When the distance between the object and the first drawing information becomes equal to or less than a predetermined distance, 1. An information processing program that includes drawing animation. [Explanation of symbols]

[0236] 1 Virtual reality generation system 3 Network 10 Server device 11 Server Communication Unit 12 Server storage unit 13 Server control unit 20 Terminal equipment 21 Terminal communication unit 22 Terminal memory section 23 Display section 24 Input section 25 Terminal control unit 60 Virtual Camera 140 Object information storage unit 141 Avatar Memory Unit 142 Predetermined object storage unit 144 Distance state memory unit 146 Animation information storage unit 150 Positional relationship calculation unit 154 Interference detection unit 156 Object Management Unit 157 Animation Control Unit 158 Prohibition Processing Unit 240 Object information storage unit 241 Avatar Memory Unit 242 Predetermined object storage unit 244 Animation Data Storage Unit 250 Server Data Acquisition Unit 252 User Input Acquisition Unit 254 Avatar movement processing unit 258 Drawing processing unit 2581 Avatar Drawing Department 2582 Object Drawing Section 2583 Base Image Drawing Unit 2584 Animation Drawing Department 900 Object Information 1000 Animation Information 1700 Avatar Information 1800 Object Information 1900 Location Information 2000 Animation Control Information

Claims

[Claim 1] An object that stores object information about various objects located in a virtual space. a storage unit; Based on the object information, various objects in the virtual space are drawn. a drawing processing unit that generates a display image; User input related to a user object associated with a user among various objects an input acquisition unit that acquires a force; Determine the movement of the user object in the virtual space based on the user input. an operation processing unit for determining One or more predetermined objects among various objects and the user object A positional relationship is an information generation method for generating positional relationship information that represents a positional relationship in the virtual space. With Naribe, a first animation relating to a combination of the predetermined object and the user object; a drawing information storage unit that stores first drawing information for drawing the object; The drawing processing unit determines whether the predetermined object and the user are in a predetermined position based on the positional relationship information. When the distance between the object and the target object becomes equal to or shorter than a predetermined distance, the An information processing system that renders a first animation.

Images