Information processing device, information processing method, and program

Abstract

This invention provides an information processing device that can represent a virtual space image based on a two-dimensional image. [Solution] The system comprises a representation processing unit that represents an avatar in a three-dimensional virtual space, controlled according to user operations, along with the virtual space; a parameter setting unit that sets parameters related to the user or avatar; and an environment selection unit that selects an environment in the virtual space based on the parameters set by the parameter setting unit. The representation processing unit represents the virtual space in a manner in which the environment selected by the environment selection unit is presented, and the presentation of the environment includes presentation using images obtained by processing images of captured objects.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Patent Document 1 discloses an image generation system that can cause a display object corresponding to an object to appear in a virtual space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, Patent Document 1 does not specifically disclose a method for generating a virtual space, and in particular, does not disclose a technique for creating the environment of a virtual space.

[0005] Therefore, in one aspect, an object of the present invention is to provide an information processing apparatus capable of creating the environment of a virtual space.

Means for Solving the Problems

[0006] In one aspect, there is provided an information processing apparatus including: a rendering processing unit that renders an avatar in a three-dimensional virtual space, along with the virtual space, under control according to a user's operation; a parameter setting unit that sets parameters related to the user or the avatar; and an environment selection unit that selects an environment in the virtual space based on the parameters set by the parameter setting unit. The rendering processing unit renders the virtual space in a manner in which the environment selected by the environment selection unit is created, and the creation of the environment includes creation using an image obtained by processing an image of a photographed object.

Effects of the Invention

[0007] In one respect, the present invention makes it possible to create a virtual environment. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows the configuration of an information processing system including the information processing device of this embodiment. [Figure 2] This is a diagram illustrating the elements of the presentation. [Figure 2A] This diagram illustrates the layers of production elements. [Figure 3] This diagram illustrates the correspondence between keywords related to lighting effects and main colors. [Figure 4] This diagram illustrates the correspondence between keywords and parameters. [Figure 5] This is an example of the color sky blue. [Figure 6] This diagram illustrates an effect where a video avatar is drawn on a layer between the sky blue background. [Figure 7] This diagram illustrates an effect where a video jingle is drawn on a layer in front of the avatar. [Figure 8] This diagram illustrates the correspondence between keywords and shapes. [Figure 9] This flowchart shows the operation of the expression processing unit that creates the environment selected in the environment selection unit. [Figure 10] This diagram illustrates the timetable for the effects to be performed in step S108. [Modes for carrying out the invention]

[0009] Figure 1 shows the configuration of an information processing system including the information processing device of this embodiment.

[0010] As shown in Figure 1, the information processing device 10 includes a representation processing unit 11 that represents an avatar in a three-dimensional virtual space, controlled according to user operations, along with the virtual space; a parameter setting unit 12 that sets parameters related to the user or avatar; and an environment selection unit 13 that selects an environment in the virtual space based on the parameters set by the parameter setting unit 12. The representation processing unit 11 also represents the virtual space in a manner that displays the environment selected by the environment selection unit 13.

[0011] Furthermore, the information processing device 10 includes an image data storage unit 14 for storing various image data used in the expression processing unit 11, a history data storage unit 15 for storing history data used for setting parameters in the parameter setting unit 12, and a performance information storage unit 16 for storing parameters and other information necessary for performance.

[0012] As shown in Figure 1, the information processing device 10 is connected to an operation unit 20 that accepts user input. The user can operate an avatar in the virtual space via the operation unit 20. The avatar is controlled by operations similar to those used for characters in a game. The expression processing unit 11 is connected to a display unit 30 and an audio output unit 31. The display unit 30 displays the avatar in the three-dimensional virtual space along with the virtual space itself, and the audio output unit 31 outputs sound in synchronization with the display on the display unit 30. The user can operate the avatar while viewing the display on the display unit 30.

[0013] The hardware configuration of the information processing apparatus 10 is arbitrary. For example, the information processing apparatus 10 can be constituted by one or more mobile terminals, one or more computers, or can be constituted by combining one or more mobile terminals and one or more computers. A part of the information processing apparatus 10 may be constituted by a user terminal 50 or one or more servers (computers) connectable to other computers. The image data storage unit 14, the history data storage unit 15, and the production information storage unit 16 can be configured using a storage medium provided in the user terminal 50, a storage medium provided in a computer including a server, a memory card, or other external storage devices.

[0014] The functions of the expression processing unit 11, the parameter setting unit 12, and the environment selection unit 13 can be realized, for example, by application software (program) installed in the user terminal 50 or a computer.

[0015] As an example of the hardware configuration, FIG. 1 shows an example in which an operation unit 20 and a display unit 30 are provided in the user terminal 50. In this case, for example, the information processing apparatus 10 can be constituted by a server connected to the user terminal 50 via the Internet or other communication paths. The administrator of the server can also provide the functions of the information processing apparatus 10 to the user via the server as a service provided to the user. When the information processing apparatus 10 is constituted by a server, after the user connects (logs in) to the server via the user terminal 50, the user can access the virtual space via a predetermined user interface screen. Further, the user can perform various operations on the virtual space via the operation unit 20.

[0016] The method of creating a three-dimensional virtual space represented by the expression processing unit 11 is arbitrary. One method of creating a virtual space is, for example, to construct a three-dimensional model by photogrammetry or other methods based on two-dimensional image data obtained by photographing an imaging object or a landscape with a camera. In this case, the virtual space is represented as a landscape seen from a virtual camera placed at an arbitrary position within the virtual space. By photographing an imaging object or a landscape within the three-dimensional virtual space from various angles, the accuracy of the three-dimensional model can be improved and the reality of the virtual space can be enhanced. The imaging object or landscape photographed by the camera is arbitrary, and includes, for example, actual places such as parks, stores, tourist attractions, and theme parks. For example, by constructing a town or facility at a travel destination as a virtual space, it is also possible to give the user a pseudo-experience of traveling. By making the position and direction of the virtual camera operable by the user, the user can pseudo-experience the scenery of an actual town or facility at a travel destination. Alternatively, a user dressed as an avatar can have a pseudo-experience of freely walking around an actual town or facility at a travel destination. Such a pseudo-experience can, for example, increase the user's interest in traveling, and thus can also function effectively as an advertisement for a travel agency or the like.

[0017] The avatar is managed by the user, and for example, the user can freely set the appearance of the avatar, the clothes the avatar wears, the items the avatar holds, and so on. The avatar can not only move freely within the virtual space according to the user's operation, but may also be able to purchase items within the virtual space.

[0018] Parameters related to the user and parameters related to the avatar are set by the parameter setting unit 12 based on the history data stored in the history data storage unit 15.

[0019] In this embodiment, user-related parameters are parameters based on user operations or user activities. User operations or activities are those of the user themselves, unrelated to avatars or their actions in the virtual space, and are stored as history data in the history data storage unit 15.

[0020] User actions or activities may include information about the user's screen operations, such as identifying user interface screens that the user frequently views when accessing the server, or the user interface screen viewed immediately before logging out. User actions or activities may also include frequently used functions and commands, the number and frequency of ratings (e.g., "likes") the user gives within the virtual space, and the amount and frequency of charges the user makes within the virtual space. Furthermore, user actions or activities may include the user's time spent on the server (e.g., time from login to logout) and the time of day the user is on the server (e.g., login and logout times).

[0021] In this embodiment, the parameters related to the avatar are parameters based on the avatar's actions or state. The avatar's actions or state are information indicating what the avatar did or what state the avatar was in within the virtual space, and are stored as history data in the history data storage unit 15.

[0022] An avatar's behavior or state may include its current appearance, places it has visited, items it possesses, and the clothes it is currently wearing. It may also include items it has recently purchased and the state of its item collection. Furthermore, it may include areas where it spends a long time, the distance it travels within those areas, facilities and equipment it frequently uses, and the number and frequency of times it has given positive feedback (e.g., "likes") in the virtual space. An avatar's behavior or state can be interpreted as indicating the user's interests and preferences.

[0023] The parameter setting unit 12 sets the user or avatar a parameter selected from the parameters stored in the performance information storage unit 16, based on the history data stored in the history data storage unit 15.

[0024] For example, the parameter setting unit 12 can set parameters related to NPCs (non-player characters) that appear in the virtual space, for example, to the avatar. If, for instance, a history researcher, a cooking researcher, a nature researcher, and a scenic photographer are set as NPCs, parameters such as "history," "cooking," "nature," and "scenic views" may be set to the avatar depending on the degree of interaction between the avatar and the NPCs as shown in the history data.

[0025] Furthermore, NPCs that act alongside the user may understand the user's status and guide them to activities (adventures, puzzle-solving, etc.) that match that status, thereby enriching the user experience. For example, in this case, the NPC may subtly invite the user to the target activity with conversations such as, "Let's go over there for a bit," or "I'm curious about what's going to the west," thereby enriching the user experience.

[0026] Furthermore, properties that are opposite to each other may be used as parameters. For example, "famous" and "hidden gem (unknown)" are concepts that are widely used for people, tourist destinations, and food, so they can be used as parameters. For example, the parameter setting unit 12 can associate such properties with the user or avatar in relation to the user's preferences regarding people, tourist destinations, and food, and the behavior of the avatar associated with those people, tourist destinations, and food. In addition, "active" and "cool," which are used for people, places, and attractions, can be used as parameters. Other paired properties such as "historical (traditional)" and "modern (advanced)," "nature" and "urban," and "lively" and "quiet" can be used as parameters.

[0027] Furthermore, virtual space areas can be used as parameters. For example, areas such as "North America," "South America," "Euro," and "Asia" can be used as parameters, and the parameter setting unit 12 can set them for the user or avatar.

[0028] In this way, by setting parameters from diverse perspectives, it becomes possible to set multiple parameters for a single experience, action, state, etc.

[0029] For example, when experiencing "Kyoto" in a virtual space, the parameter setting unit 12 may count three parameters: "famous," "Asian," and "historical." In this case, it is sufficient that the performance information storage unit 16 has already associated the concept of "famous," "Asian," and "historical" with "Kyoto." Similarly, for example, when experiencing "Paris" in a virtual space, the parameter setting unit 12 may count three parameters: "famous," "Euro," and "art." In this case, it is sufficient that the performance information storage unit 16 has already associated the concept of "famous," "Euro," and "art" with "Paris."

[0030] The method of setting parameters by the parameter setting unit 12 is arbitrary, but for example, the parameter setting unit 12 can manage the number of parameters counted (set) for each user or avatar as one of the pieces of information stored in the performance information storage unit 16. The parameter count increases as the experience (play) in the virtual space progresses, and the parameter setting unit 12 updates the parameter count. In addition, the parameter counts that have been set in the past may be cleared at a predetermined timing.

[0031] In this case, the environment selection unit 13 can select an environment within the virtual space to be set for the user or avatar based on the count of the parameters set for the user or avatar. Specifically, when parameters with a large count or extremely small count appear, the environment selection unit 13 treats the appearance of the parameters as events that indicate the user's characteristics, and selects an environment that matches the user's characteristics and tendencies.

[0032] The environment within the virtual space is selected, for example, in the following way:

[0033] (Method 1) If a parameter has a significantly higher cumulative count over a long period compared to other parameters, the environment selection unit 13 can determine that this parameter indicates an item of interest to the user, an item the user likes, or an item the user is engrossed in. In this case, the environment corresponding to the item (parameter) determined to be of interest to the user, an item the user likes, or an item the user is engrossed in is selected.

[0034] (Method 2) Furthermore, if there is a parameter whose recent count is significantly higher than that of other parameters, the environment selection unit 13 can determine that the parameter indicates an item of the user's recent interest. In this case, the environment corresponding to the item (parameter) determined to be of the user's recent interest is selected.

[0035] (Method 3) Furthermore, if there is a parameter with a significantly lower count compared to other parameters, the environment selection unit 13 can determine that the user is prejudiced against the item indicated by that parameter. In this case, the environment corresponding to the item (parameter) that the user is prejudiced against is selected.

[0036] Of the methods described above, "Method 1" and "Method 2" illustrate examples where an environment is selected that matches the user's characteristics or tendencies. On the other hand, "Method 3" illustrates an example where an environment contrary to the user's characteristics or tendencies is selected. When an environment that matches the user's characteristics or tendencies is selected, it can boost the user's mood and further stimulate activities that align with the user's characteristics and tendencies. Conversely, when an environment contrary to the user's characteristics or tendencies is selected, a different environment is provided for the user, which can break the monotony and give the user a reason to take new actions. Therefore, it can enhance the mood of users enjoying activities in the virtual space. In addition, by preparing multiple presentations that aim in opposite directions, it is possible to avoid simplification of the presentation.

[0037] Users can perceive such environmental design as a kind of reward for their activities in the virtual space. Therefore, users can further enjoy their activities in the virtual space with the aim of experiencing the environmental design.

[0038] The expression processing unit 11 represents the virtual space in a manner in which the environment selected by the environment selection unit 13 is displayed. Specific examples of the display performed by the expression processing unit 11 are described below.

[0039] Figure 2 is an example of a visual effect element, and Figure 2A is an example of a visual effect element layer.

[0040] As shown in Figure 2, for example, the performance elements of the performance processing unit 11 include light (color) effects, video avatars, video jingles, shape effects, and sound effects.

[0041] Furthermore, as shown in Figure 2A, the following layers can be used on the screen to which visual effects can be applied: layers behind the background of the virtual space, layers between the avatar and the background of the virtual space, and layers in front of the avatar in the virtual space.

[0042] Next, we will explain each of the performance elements of the performance by the performance processing unit 11. The information necessary for the performance by the performance processing unit 11 is stored in the performance information storage unit 16. In addition, the environment selected by the environment selection unit 13 is also stored in the performance information storage unit 16.

[0043] Figure 3 illustrates the correspondence between keywords related to lighting effects and main colors.

[0044] In the example shown in Figure 3, keywords such as "passion," "active," and "courage" are associated with the main color "red." Different keywords are also associated with other main colors such as "orange," "yellow," "green," "blue," and "purple."

[0045] Furthermore, the keywords are mapped to the parameters mentioned above.

[0046] Figure 4 illustrates the correspondence between keywords and parameters.

[0047] In the example shown in Figure 4, the parameter "history" is associated with the keyword "tradition." Similarly, the parameter "fortune-telling" is associated with the keyword "mystery." As shown in Figure 3, both the keyword "tradition" and the keyword "mystery" are associated with the main color "purple." Therefore, even though the two parameters ("history" and "fortune-telling") are different, the same main color ("purple") is applied as a visual element.

[0048] As shown in Figure 2, one lighting effect is the effect of making the sky appear blue. In this case, the expression processing unit 11 switches the sky color from the default color, for example, the original color (normal color) corresponding to when the camera is taking the picture, to the main color. As shown in Figure 2A, the effect of making the sky appear blue is applied to the layer furthest in the background on the screen.

[0049] Figure 5 illustrates the color of the sky. In Figure 5, "red sky," etc., represent the sky color corresponding to the main color, but "yellow sky," "green sky," and "purple sky" are clearly different from the actual color of the sky, thus creating a significant visual effect.

[0050] Furthermore, "Red Sky," "Orange Sky," and "Blue Sky" are colored differently from the actual sky. Therefore, users can understand that these colors are different from the real sky, thus creating a visual effect. However, considering that sky blue alone may not provide sufficient visual effect, it may be advisable to add other visual elements on other layers.

[0051] As shown in Figure 2, other fantastical lighting effects besides sky blue can also be applied. For example, as shown in Figure 2A, by applying a fantasy filter of a specific color (main color) to the layer between the background and the avatar, the overall color tone of the avatar's background can be altered, creating a fantastical atmosphere. In this case, since the fantasy filter layer is behind the avatar, the fantasy filter does not affect the avatar's colors. Alternatively, instead of a fantasy filter, an image simulating circular or hexagonal ghosts caused by lens flare can be overlaid on the layer between the background and the avatar. This allows for effects that emphasize bright light sources such as the sun.

[0052] Furthermore, as shown in Figures 2 and 2A, it is also possible to apply an effect that draws a video avatar on a layer between the layer to which the sky color is applied and the background. The video avatar is based on things that exist in the sky and is treated as a visual representation. For example, fireworks, rainbows, auroras, and hot air balloons are examples of such objects. By setting the color of these objects as a specific color (main color), an effect similar to switching the sky color can be obtained. In addition, a sense of specialness can be created by changing the color and quantity of pre-prepared objects. Since the origin position (coordinates in the virtual space) of the video avatar is fixed, the appearance of the object changes depending on the standing position (position of the virtual camera). It may also be hidden by the background.

[0053] Figure 6 illustrates an example of an effect where a video avatar is drawn on a layer between the sky blue background and the background.

[0054] In screen 101 shown in Figure 6, fireworks are drawn above the avatar. Because a layer of the fireworks video avatar is inserted between the night sky and the avatar, if there is a background in part of the fireworks, that part will be hidden by the background. Also, in screen 102, a rainbow 102a is drawn between the sky and the background, but part of the rainbow 102a is hidden behind the building 102b which is the background. Furthermore, screen 103 shows an example in which countless balloons are drawn between the sky and the background.

[0055] As shown in Figures 2 and 2A, it is also possible to apply an effect that draws a video jingle on a layer in front of the avatar. For example, by targeting things that exist in the air, such as "a flock of doves flying in the sky," "countless balloons," or "falling cherry blossoms," and filling the screen with these objects for a moment, it is possible to create a celebratory atmosphere.

[0056] Figure 7 illustrates an example of an effect where a video jingle is drawn on a layer in front of the avatar.

[0057] In screen 111 shown in Figure 7, countless balloons are drawn on a layer in front of the avatar, and in screen 112, a flock of pigeons is drawn on a layer in front of the avatar. Screen 113 also shows an example of animated balloons drawn on a layer in front of the avatar. These video jingles are drawn so as to be projected onto the screen independently of collision with the avatar background. Furthermore, these video jingles are drawn as if they are stuck to the screen, so they remain visible regardless of the avatar's position even when the avatar moves.

[0058] As shown in Figure 2, shape can be used as a visual element. In this embodiment, similar to color, keywords linked to parameters are associated with the shape.

[0059] Figure 8 illustrates the correspondence between keywords and shapes. In the example shown in Figure 8, keywords such as "gentle," "harmonious," and "perfect" are associated with circles, while keywords such as "advanced," "exciting," and "dangerous" are associated with triangles. Different keywords are also associated with squares, pentagons, hexagons, stars, and hearts.

[0060] Similar to the selection of colors, the selection of shapes may include both modes in which an environment (shape) is chosen that matches the user's nature or tendencies, and modes in which an environment (shape) is chosen that goes against the user's nature or tendencies. Similar to the selection of colors, when an environment is chosen that matches the user's nature or tendencies, it can boost the user's mood and further stimulate activities that are in line with the user's nature and tendencies. On the other hand, when an environment that goes against the user's nature or tendencies is chosen, an unfamiliar environment is provided to the user, which can break the routine (monotony) and give the user a trigger for new behavior.

[0061] Furthermore, if no clear parameters indicating the user's nature or tendencies appear, it is possible to attempt to guide the user's feelings by deliberately selecting an appropriate form (environment).

[0062] Users can perceive such immersive environments as rewards for their activities in the virtual space, which can further enhance their desire to enjoy those activities.

[0063] The selected shape can be applied to clouds and fireworks in the background. For example, the shape of the fireworks (heart shape) shown in screen 101 of Figure 6 is an example of this. The selected shape can also be applied to patterns and lens flares (circular or hexagonal ghosts) added to filters in the mid-range (for example, the fantasy filter mentioned above). Furthermore, the selected shape can be applied to balloons and confetti in video jingles in the foreground. For example, the shape of the balloons (heart shape) shown in screen 111 of Figure 7 is an example of this.

[0064] Furthermore, as shown in Figure 2, sound effects such as ambient sounds can be applied to enhance the sound design. Various types of music, such as jingles and fanfares, can also be applied.

[0065] Next, we will explain the timing at which the environment selected by the environment selection unit 13 is implemented.

[0066] Figure 9 is a flowchart showing the operation of the expression processing unit that creates the environment selected in the environment selection unit.

[0067] In step S102 of Figure 9, the expression processing unit 11 accesses the performance information storage unit 16 to determine whether or not there is an environment selected by the environment selection unit 13. If the determination is affirmative, the process proceeds to step S104.

[0068] In step S104, the expression processing unit 11 sets the environment selected by the environment selection unit 13 as the environment to be next performed.

[0069] In step S106, the expression processing unit 11 determines whether or not the timing to start the performance has arrived. If the determination is affirmative, the process proceeds to step S108; if the determination is negative, the process proceeds to step S102.

[0070] Here, the timing for initiating the performance corresponds to predetermined screen transitions. For example, the timing for initiating the performance is when an avatar moves from one area to the next in the virtual space, accompanied by a screen transition. Specifically, suitable timings for initiating the performance include when the avatar leaves a particular facility and moves to the next location, such as a park, when it disembarks from a vehicle to the next location, or when it crosses the boundary between areas.

[0071] In step S108, the expression processing unit 11 executes the effects for the environment set in step S104. In step S110, the expression processing unit 11 clears the environment in which the effects were executed in step S108 (the environment selected by the environment selection unit 13) and proceeds to step S102.

[0072] Figure 10 is a diagram illustrating the timetable of the effects to be performed in step S108.

[0073] In the example in Figure 10, four types of effects are combined as part of the video presentation. These effects include a 4-second video jingle that appears on a layer in front of the avatar, an 11-second sky-blue effect using the main color, an 11-second fantasy filter effect that appears on a layer between the avatar and the background, and a 6-second video avatar effect that appears on a layer between the background and the sky-blue effect. Sound effects can also be added to these video effects.

[0074] In the example in Figure 10, the point in time when the judgment in step S106 is affirmed is shown as 0 seconds. For 1 second, the normal environment without any effects continues, and 1 second after the judgment in step S106 is affirmed, the effect with a video jingle begins. The effect with the sky blue and fantasy filter starts with the video jingle obscuring almost the entire screen. After the video jingle ends, there is a brief pause, and then an effect such as fireworks being launched by a video avatar begins. The effect by the video avatar ends before the effect with the sky blue and fantasy filter ends. The effect with the sky blue and fantasy filter continues until 14 seconds after the judgment in step S106 is affirmed, but then there is a 1-second gap until 15 seconds later when the environment seamlessly returns to normal.

[0075] When the expression processing unit 11 performs an environmental effect, the fact of that effect may be recorded along with the title of the effect. In this case, for example, if the setting is such that a user disguised as an avatar travels through a virtual space, the fact of the effect may be recorded in a "travel notebook" that can be viewed by the user and others. When a new effect is performed, the record of the most recent effect may be overwritten, or multiple effects may be recorded as an effect history. The title of the effect can also be automatically generated in the environment selection unit 13 based on the parameters that served as the basis for selecting the effect.

[0076] If the performance is recorded, the recorded performance may be made playable in response to user input. In this case, the performance may also be shown to users other than the user in question. For example, if a user is the leader of a group of people traveling together, the leader can allow the other members to experience the recorded performance. In this case, only members in the leader's vicinity (for example, within a 10m radius) may be allowed to experience the performance. Basically, only the user for whom the parameters have been set may be able to experience the performance, but by creating a mechanism that allows other members to experience the performance as well, it becomes possible to provide "hospitality" and surprises to the other members.

[0077] As explained above, according to this embodiment, by creating an environment that matches the user's nature or tendencies, or by deliberately creating an environment that goes against the user's nature or tendencies, it is possible to make the user feel exhilarated or happy.

[0078] Furthermore, according to this embodiment, the experience a user has is based on the user's own characteristics or tendencies. Therefore, even if users visit the same place, the experience they have will differ. As a result, users can experience different experiences than others and gain a sense of being treated specially. Also, by creating an environment that goes against the user's own characteristics or tendencies, they can experience an experience that is different from what they have had before, and in this case too, they can gain a sense of being treated specially.

[0079] In this way, users can experience feelings of exhilaration and good mood, or gain a sense of being treated specially. This can increase users' motivation to visit the virtual space.

[0080] Furthermore, the experiences that users encounter also function as a kind of reward. In this embodiment, the user's experiences and actions in the virtual space are parameterized, and the content of the experiences that users encounter is selected based on the parameters set for the user. As a result, users become aware of the relationship between the content of the experiences and their own activities. Therefore, if a user recognizes the experiences as a reward, they can make experiencing the experiences one of their activity goals, adding a new level of enjoyment to their activities in the virtual space.

[0081] Although each embodiment has been described in detail above, the invention is not limited to any particular embodiment, and various modifications and changes are possible within the scope described in the claims. Furthermore, it is possible to combine all or more of the components of the embodiments described above. Furthermore, the following additional information is disclosed in relation to each of the above embodiments. [Note 1] A representation processing unit that represents an avatar in a three-dimensional virtual space, controlled according to user operations, along with the virtual space; A parameter setting unit for setting parameters relating to the user or the avatar, An environment selection unit selects an environment within the virtual space based on the parameters set by the parameter setting unit, Equipped with, The representation processing unit is an information processing device that represents the virtual space in a manner in which the presentation of the environment selected by the environment selection unit is executed. [Note 2] The parameters are based on the user's operation or the user's activities, as described in Appendix 1 of the information processing device. [Note 3] The parameters are based on the actions or states of the avatar, as described in Appendix 1 of the information processing device. [Note 4] The information processing apparatus described in Appendix 1, wherein the environment selection unit selects an environment that matches the user's characteristics or tendencies as indicated by the parameters set by the parameter setting unit. [Note 5] The information processing apparatus according to Appendix 1, wherein the environment selection unit selects an environment that contradicts the user's characteristics or tendencies indicated by the parameters set by the parameter setting unit. [Note 6] The representation processing unit represents the virtual space in a manner in which the effect is executed at a timing corresponding to the screen transition, as described in Appendix 1. [Note 7] The information processing apparatus described in Appendix 1, wherein the expression processing unit performs the performance using a color or shape associated with the environment selected by the environment selection unit as a performance element. [Note 8] A representation processing step that represents an avatar in a three-dimensional virtual space, controlled according to user operations, together with the virtual space; A parameter setting step of setting parameters relating to the user or the avatar, An environment selection step in which an environment in the virtual space is selected based on the parameters set in the parameter setting step, Equipped with, An information processing method comprising the representation processing step, which represents the virtual space in a manner in which the effects of the environment selected in the environment selection step are performed. [Note 9] A representation processing step that represents an avatar in a three-dimensional virtual space, controlled according to user operations, together with the virtual space; A parameter setting step of setting parameters relating to the user or the avatar, An environment selection step in which an environment in the virtual space is selected based on the parameters set in the parameter setting step, A program that causes a computer to execute, The representation processing step includes a program that represents the virtual space in a manner in which the effects of the environment selected in the environment selection step are performed. [Explanation of Symbols]

[0082] 10 Information Processing Devices 11. Expression Processing Unit 12 Parameter setting section 13. Environment Selection Section 14 Image data storage unit 15. History data storage unit 16. Production Information Storage Unit 50 User Terminals

Claims

1. A representation processing unit that represents an avatar in a three-dimensional virtual space, controlled according to user operations, along with the virtual space itself, An environment selection unit that selects an environment within the virtual space based on the parameters relating to the user or the avatar, The system includes an information storage unit that stores information necessary for the presentation of the environment by the expression processing unit, and an environment selection unit that stores the environment selected by the environment selection unit. The expression processing unit determines whether the environment selected by the environment selection unit is stored in the performance information storage unit, and if the determination is affirmative, sets the environment selected by the environment selection unit as the next environment to be performed, as an information processing device.

2. The information processing apparatus according to claim 1, wherein the expression processing unit determines whether or not the timing for starting the performance has arrived, and if the determination is affirmative, it executes the performance.

3. The information processing apparatus according to claim 2, wherein the aforementioned timing includes the time of screen transition.

4. The information processing apparatus according to claim 2, wherein the expression processing unit clears the environment in which the performance was performed from the performance information storage unit.

5. The information processing device according to claim 1, wherein the expression processing device can use the following as screen layers to which the elements of the performance can be applied: a first layer which is behind the background of the virtual space and is at the furthest back, a second layer which is in front of the first layer, a third layer which is between the background and the avatar which is in front of the background, and a fourth layer which is in front of the avatar.

6. The information processing apparatus according to claim 5, wherein the aforementioned effect is initiated by the effect of a video jingle in the fourth layer, and while the video jingle obscures almost the entire screen, the sky-blue effect in the first layer and the illusion filter or lens flare effect in the third layer are performed, and after the end of the video jingle and while the sky-blue effect and the illusion filter or lens flare effect are being performed, the effect of a video avatar in the second layer is initiated and terminated.

7. A representation processing step that represents an avatar in a three-dimensional virtual space, controlled according to user operations, together with the virtual space; An environment selection step in which an environment in the virtual space is selected based on the parameters relating to the user or the avatar, The system includes a performance information storage step that stores information necessary for performance by the aforementioned expression processing step and the environment selected by the aforementioned environment selection step, The information processing method comprising the expression processing step, which determines whether the environment selected in the environment selection step is stored in the performance information storage step, and if the determination is affirmative, sets the environment selected in the environment selection step as the environment to be performed next.

8. A representation processing step that represents an avatar in a three-dimensional virtual space, controlled according to user operations, together with the virtual space; An environment selection step in which an environment in the virtual space is selected based on the parameters relating to the user or the avatar, A program that causes a computer to execute a performance information storage step which stores information necessary for performance by the aforementioned expression processing step and the environment selected by the aforementioned environment selection step, The program, in the expression processing step, determines whether the environment selected in the environment selection step is stored in the performance information storage step, and if the determination is affirmative, sets the environment selected in the environment selection step as the environment to be performed next.

Images