Computer program, method, and server device
The computer program and server device enhance user interaction in virtual spaces by displaying avatars and adjusting displays based on their positions, addressing the lack of avatar representation in existing technologies.
Patent Information
- Application Number
- JP2025079816
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-05-12
- Publication Date
- 2025-08-13
- Estimated Expiration
- 2040-12-21
AI Technical Summary
Existing technologies fail to display the user's avatar in a virtual space, making user operations cumbersome and uncomfortable.
A computer program and server device that acquires data on an avatar in a virtual space, determines conditions for display changes, and controls the display to switch based on the avatar's position, enhancing user interaction.
Improves user comfort by allowing seamless avatar display and interaction within virtual spaces without additional complexity.
Smart Images

Figure 2025118828000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a computer program, a method, and a server device. [Background technology]
[0002] Conventionally, when a user uses a terminal to view content executed in a virtual space displayed on the terminal, it is known to display icons corresponding to other users viewing the content in the virtual space (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-34087 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the technology described in Patent Document 1, when a terminal used by a user displays a virtual space, the icon of the user is not displayed in the virtual space. The above-mentioned Patent Document 1 is incorporated herein by reference in its entirety.
[0005] The present disclosure provides a computer program, a method, and a server device that appropriately displays a terminal and makes user operations more comfortable without requiring more complicated operations than conventional methods. [Means for solving the problem]
[0006] A computer program according to one embodiment is a computer program executed by at least one processor, which causes the at least one processor to function as follows: acquire first data regarding an avatar in a virtual space operated using a first terminal of a first user; display a first display including the avatar on a display unit of the first terminal based on the first data; determine whether a first condition is met based on the first data; and, if it is determined that the first condition is met, control the display unit to switch from the first display to a second display based on a first position in the virtual space where the avatar is located.
[0007] A computer program according to one embodiment is a computer program executed by at least one processor, which causes the at least one processor to function as follows: receive first data regarding an avatar in a virtual space operated using a first terminal of a first user via a communication line; determine, based on the first data, first control data for controlling the display unit of the first terminal to display a first display including the avatar on the display unit of the first terminal; transmit the first control data to the first terminal via the communication line; after transmitting the first control data to the first terminal, determine, based on the first data, whether a first condition is met; if it is determined that the first condition is met, determine second control data for controlling the display unit to switch from the first display to a second display based on a first position in the virtual space where the avatar is located; and transmit the second control data to the first terminal via the communication line.
[0008] A method according to one embodiment includes the steps of acquiring first data regarding an avatar in a virtual space operated using a first terminal of a first user, displaying a first display including the avatar on a display unit of the first terminal based on the first data, determining whether a first condition is met based on the first data, and, if it is determined that the first condition is met, determining first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located, and controlling the display unit based on the first control data.
[0009] A method according to one embodiment includes the steps of receiving, via a communication line, first data relating to an avatar in a virtual space operated using a first terminal of a first user; determining, based on the first data, first control data for controlling a display unit of the first terminal to display a first display including the avatar on the display unit; transmitting the first control data to the first terminal via the communication line; after transmitting the first control data to the first terminal, determining, based on the first data, whether a first condition is satisfied; if it is determined that the first condition is satisfied, determining first control data for controlling the display unit to switch from the first display to a second display based on a first position in the virtual space where the avatar is located; and transmitting the second control data to the first terminal via the communication line.
[0010] A server device in one embodiment acquires first data regarding an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on a display unit of the first terminal based on the first data, determines whether a first condition is met based on the first data, and if it determines that the first condition is met, determines first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located, and controls the display unit based on the first control data.
[0011] This Summary section is provided to introduce selected concepts in a simplified form that are described below in the Detailed Description section. All trademarks used herein are the property of their respective owners. The statements in this Summary section are not intended to identify key features or essential features of the claimed inventions, nor are they intended to limit the scope of the claimed inventions. The above and other objects, features, and advantages of the claimed inventions will become more apparent from the following Detailed Description section, taken in conjunction with the accompanying drawings. [Brief explanation of the drawings]
[0012] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a system 1000 according to an embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of the terminal 10 and the server device 20 shown in FIG. [Figure 3] FIG. 3 is a block diagram showing an example of the functions of the terminal 10 shown in FIG. [Figure 4] FIG. 4 is a block diagram showing an example of the functions of the server device 20 shown in FIG. [Figure 5] FIG. 5 is a diagram showing an example of a display displayed on the display unit 140 of the terminal 10. As shown in FIG. [Figure 6] FIG. 6 is a diagram showing an example of a display displayed on the display unit 140 of the terminal 10. As shown in FIG. [Figure 7] FIG. 7 is a diagram showing an example of a display displayed on the display unit 140 of the terminal 10. As shown in FIG. [Figure 8] FIG. 8 is a diagram showing an example of a display displayed on the display unit 140 of the terminal 10. As shown in FIG. [Figure 9] FIG. 9 is a diagram showing an example of a display displayed on the display unit 140 of the terminal 10. As shown in FIG. [Figure 10] FIG. 10 is an example of a flowchart showing the processing carried out in this embodiment. [Figure 11] FIG. 11 is an example of a flowchart showing the processing carried out in this embodiment. [Figure 12] FIG. 12 shows an example of data transmitted from the terminal 10. [Figure 13] FIG. 13 is a block diagram showing an example of the functions of the terminal 10 and the components connected to the terminal 10 shown in FIG. [Figure 14] FIG. 14 is a block diagram illustrating a computing environment 1400 . DETAILED DESCRIPTION OF THE INVENTION
[0013] This specification is described in terms of various representative embodiments, which are not intended to be limiting in any way. As used in this application, singular forms such as "a," "the," "said," "the," "the," "this," and "the" can include the plural unless clearly indicated as not being plural. Also, the term "comprises" can mean "comprises" or "has." Furthermore, the terms "coupled," "coupled," "coupled," "connected," or "connected" encompass mechanical, electrical, magnetic, and optical ways of coupling, connecting, or joining objects together, among other ways, and do not exclude the presence of intermediate elements between objects so coupled, coupled, coupled, coupled, connected, or connected.
[0014] The various systems, methods, and devices described herein should not be construed as limiting in any way. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described herein are not limited to specific aspects, features, or combinations of such aspects with specific features, nor do the products and methods described herein require that one or more particular advantages be present or problems be solved. Furthermore, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.
[0015] Although the operations of some of the various methods disclosed herein may be described in a particular order for convenience, it should be understood that description in this manner encompasses rearranging the order of the operations unless a particular order is required by specific text below. For example, operations described in a sequence may, in some cases, be rearranged or performed simultaneously. Furthermore, for purposes of simplicity, the accompanying drawings may not show the various ways in which the various items and methods described herein may be used in conjunction with other items and methods. In addition, the specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "deliver." These terms are high-level descriptions of the various actual operations that may be performed. The actual operations corresponding to these terms may vary depending on the particular implementation and will be readily discernible by one of ordinary skill in the art having the benefit of the disclosure herein.
[0016] Any theories of operation, scientific principles, or other theoretical descriptions presented herein in connection with the devices or methods of the present disclosure are provided for the purpose of better understanding and are not intended to limit the scope of the technology, and the devices and methods in the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.
[0017] Any of the various methods disclosed herein may be implemented using computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media, such as one or more optical media discs, volatile memory components, or non-volatile memory components), and executed on a computer. Here, the volatile memory components may include, for example, DRAM or SRAM. Also, the non-volatile memory components may include, for example, hard drives and solid-state drives (SSDs). Furthermore, the computer may include any computer available on the market, including, for example, smartphones and other mobile devices with computing hardware. Any such computer-executable instructions for implementing the techniques disclosed herein, along with any data generated or used during the implementation of various embodiments disclosed herein, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may, for example, be part of a separate software application, or may be part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may, for example, be executed on a single local computer (e.g., as an agent executing on any suitable commercially available computer) or in a networked environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.
[0018] For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed herein are not limited to a particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to a particular computer or type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.
[0019] Moreover, any of the various software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or remotely accessed by suitable communications means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF, microwave, and infrared communication), electronic communication, or other such communications means.
[0020] Various embodiments of the present invention will be described below with reference to the accompanying drawings. Note that common components in the drawings are designated by the same reference numerals. It should also be noted that components depicted in one drawing may be omitted in another drawing for the sake of clarity. It should also be noted that the accompanying drawings are not necessarily drawn to scale.
[0021] 1. System 1000 Configuration Fig. 1 is a block diagram showing an example of the configuration of a system 1000 according to an embodiment. As shown in Fig. 1, the system 1000 includes, for example, a plurality of terminals 10 connected to a communication line (communication network) not shown, and one or more server devices 20 connected to the communication line. The terminals 10 include a first terminal 11. The terminals 10 may further include a second terminal 12. The server devices 20 include, for example, a first server system 21 and a second server system 22.
[0022] The communication links may include, but are not limited to, a cellular network, a wireless network (e.g., RF connection via Bluetooth, WiFi (such as IEEE 802.11a / b / n), WiMax, cellular, satellite, laser, infrared), a landline network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and / or an Ethernet network.
[0023] 1-1. Terminal 10 The terminal 10 is connected to one or more server devices 20 via, for example, a communication line. The terminal 10 is, for example, a smartphone, a tablet device, and / or a personal computer. The terminal 10 is configured to be able to install a predetermined application and execute the predetermined application. The terminal 10 can also receive a web page (for example, an HTML document, and in some examples, an HTML document encoding executable code such as JavaScript or PHP code) from the server device 20 (second server system 22).
[0024] Hereinafter, a user who operates terminal 10 may be simply referred to as a user, and a user who operates first terminal 11 may be referred to as a first user. Also, while FIG. 1 shows an example in which, for example, first terminal 11 is provided as a plurality of terminals 10, this is not limiting. The plurality of terminals 10 may include, for example, two or more terminals. Also, in the following description, first terminal 11 may be referred to as terminal 10.
[0025] 1-2. Server device 20 The first server system 21 includes a distribution server device 21A1 and a server storage device 21A2. The distribution server device 21A1 receives, for example, data requested for an application executed on the terminal 10 from the terminal 10. The distribution server device 21A1 also transmits, for example, data used in the application executed on the terminal 10 to the terminal 10 in response to the request. The server storage device 21A2 stores, for example, data to be transmitted from the distribution server device 21A1 to the terminal 10. The server storage device 21A2 also stores, for example, data received by the distribution server device 21A1 from the terminal 10. The first server system 21 also transmits, for example, data used in the application executed by the terminal 10 to the terminal 10. The first server system 21 also transmits, for example, data received from the terminal 10 to the device 70.
[0026] Although the example in which the terminal 10 executes an application has been described, the present invention is not limited to this. For example, a web browser installed on the terminal 10 may be used to perform processing equivalent to executing the application. In this way, when a web browser installed on the terminal 10 is used, the server device 20 may include, for example, a web server (not shown). In the case where the server device 20 includes a web server (not shown), the web server transmits data related to an HTML document such as HTML5, the terminal 10 displays the data related to the HTML document using the web browser, user instruction data is transmitted to the terminal 10 (the web browser), and the server device 20 performs display control. By performing the display control, the server device 20 generates display data and transmits the display data to the terminal 10 (the web browser). In addition, the display control may be performed using a script such as JavaScript (registered trademark) in the web browser.
[0027] 1 illustrates an example in which first server system 21 includes distribution server device 21A1 and server storage device 21A2, but is not limited to this. For example, first server system 21 may include other components in addition to distribution server device 21A1 and server storage device 21A2. In this case, the other components may have the functions of at least one of distribution server device 21A1 and server storage device 21A2. Furthermore, for example, first server system 21 may be configured as a single component having the functions of distribution server device 21A1 and server storage device 21A2.
[0028] The second server system 22 is a server that transmits data related to content to the terminal 10. Here, for example, assume that the user operates the terminal 10 to execute an application. In this case, when the second server system 22 receives a request for data related to content from the terminal 10 while the application is being executed, the second server system 22 transmits the data related to the content to the terminal 10. The data related to content transmitted from the second server system 22 to the terminal 10 is, for example, data related to a video.
[0029] 1-3.Equipment 70 The device 70 (third terminal) is, for example, a terminal operated by the operator or operating organization that operates the virtual venue. The device 70 transmits predetermined data to the first server system 21 and receives predetermined data transmitted from the first server system 21. The specific configuration of the device 70 will be described later.
[0030] 2. Hardware configuration of each device Next, an example of the hardware configuration of each of the terminal 10 and the server device 20 will be described.
[0031] 2-1. Hardware configuration of terminal 10 An example of the hardware configuration of each terminal 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the hardware configuration of the terminal 10 (server device 20) shown in Fig. 1. Note that in Fig. 2, reference numerals in parentheses are those described in relation to the server device 20, as will be described later.
[0032] 2, each terminal 10 includes, for example, a central processing unit 14, a main memory device 15, an input / output interface device 16, an input device 17, an auxiliary memory device 18, and an output device 19. The components shown in Fig. 2 are connected to each other by a data bus and / or a control bus.
[0033] The central processing unit 14 is referred to as a "CPU" and performs operations on instructions and data stored in the main memory 15 and stores the results of the operations in the main memory 15. Furthermore, the central processing unit 14 can control an input device 17, an auxiliary memory device 18, an output device 19, etc. via an input / output interface device 16. The terminal 10 can include one or more such central processing units 14.
[0034] The main memory device 15 is referred to as "memory" and stores instructions and data received from the input device 17, the auxiliary memory device 18, and the communication line 30 (such as the server device 20) via the input / output interface device 16, as well as the results of calculations by the central processing unit 14. The main memory device 15 may include, but is not limited to, computer-readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid-state drive (SSD), magnetic tape, optical media). As will be readily understood, the term "computer-readable recording medium" may include media for data storage such as memory and storage, as well as transmission media such as modulated data signals or transitory signals.
[0035] The input device 17 is a device that inputs data from the outside, and includes, but is not limited to, a touch panel, a button, a keyboard, a mouse, and / or a sensor. As will be described later, the sensor may include, but is not limited to, one or more cameras and / or one or more microphones.
[0036] The auxiliary storage device 18 is a storage device having a larger capacity than the main storage device 15. It can store instructions and data (computer programs) that constitute the above-mentioned specific applications (video distribution applications, video viewing applications, etc.), web browser applications, etc. Furthermore, the auxiliary storage device 18 is controlled by the central processing unit 14 to transmit these instructions and data (computer programs) to the main storage device 15 via the input / output interface device 16. The auxiliary storage device 18 can include, but is not limited to, a magnetic disk device and / or an optical disk device, etc.
[0037] The output device 19 may include, but is not limited to, a display device, a touch panel, and / or a printer device.
[0038] In such a hardware configuration, the central processing unit 14 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 18 into the main storage device 15, and by operating on the loaded instructions and data, controls the output device 19 via the input / output interface device 16, or can send and receive various data to and from other devices (e.g., a server device 20, another terminal 10) via the input / output interface device 16 and the communication line 2.
[0039] 2-2. Hardware configuration of server device 20 An example of the hardware configuration of each server device 20 will be described with reference to Fig. 2. The hardware configuration of each server device 20 (each of the distribution server device 21A1 and the server storage device 21A2) may be the same as the hardware configuration of each of the above-mentioned terminals 10. Therefore, reference numerals for the components of each server device 20 are shown in parentheses in Fig. 2.
[0040] 2, each server device 20 mainly includes a central processing unit 24, a main memory device 25, an input / output interface device 26, an input device 27, an auxiliary memory device 28, and an output device 29. These devices are connected to each other by a data bus and / or a control bus.
[0041] The central processing unit 24, main memory 25, input / output interface unit 26, input unit 27, auxiliary memory unit 28, and output unit 29 can be approximately the same as the central processing unit 14, main memory unit 15, input / output interface unit 16, input unit 17, auxiliary memory unit 18, and output unit 19 included in each terminal 10 described above, respectively.
[0042] In such a hardware configuration, the central processing unit 24 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 28 into the main storage device 25, and by operating on the loaded instructions and data, controls the output device 29 via the input / output interface device 26, or can send and receive various data to and from other devices (e.g., each terminal 10) via the input / output interface device 26 and the communication line 2.
[0043] Note that the server device 20 may include one or more microprocessors and / or a graphics processing unit (GPU) instead of or in addition to the central processing unit 24.
[0044] 3. Functions of each device Next, an example of the functions of the terminal 10 and the server device 20 will be described with reference to FIGS. 3 and 4, respectively.
[0045] 3-1. Functions of Terminal 10 Fig. 3 is a block diagram showing an example of the functions of the terminal 10 shown in Fig. 1. As shown in Fig. 3, the terminal 10 includes, for example, a communication unit 110, an acquisition unit 120, a control unit 130, a display unit 140, a user interface unit 150, and a storage unit 160.
[0046] (1) Communications Unit 110 The communication unit 110 is used, for example, to transmit various data to the server device 20. The communication unit 210 is used, for example, to receive various data from the server device 20. The data received by the communication unit 210 is sent to the control unit 130, for example.
[0047] (2) Acquisition part 120 The acquisition unit 120 acquires, for example, operation data related to an operation from a user. The acquisition unit 120 also acquires, for example, data detected by various sensors. The data acquired by the acquisition unit 120 is sent to, for example, the control unit 130. The acquisition unit 120 performs, for example, the processing of S121 in FIG. 10 and S121 in FIG. 11, which will be described later. For example, the operation data may include one or more of the following data: Data showing how the streamer swiped the touchpad display Data showing where the streamer touched the touchpad display Data indicating which object the streamer tapped or clicked on Data showing how the streamer dragged the touchpad display Other such operational data
[0048] In addition, the data acquired by the acquisition unit 120 may be data regarding non-operation (data indicating that no operation was performed), for example, data indicating that the terminal 10 was not operated for a specific time (specific period), and / or data indicating that a specific location within the virtual space 300 was not entered.
[0049] (3) Control unit 130 The control unit 130 performs various controls based on, for example, data received by the communication unit 110. The control unit 130 also performs various controls based on data acquired by the acquisition unit 120. The control unit 130 performs, for example, processes S125 and S141 in Fig. 10 and S125 and S141 in Fig. 11, which will be described later.
[0050] (4) Display section 140 The display unit 140 displays, for example, display content based on control data output from the control unit 130. The display unit 140 displays, for example, a screen for selecting a predetermined application. Furthermore, the display unit 140 displays, for example, a screen related to the inside of a virtual space when a predetermined application is selected and executed.
[0051] (5) User interface unit 150 The user interface unit 150 is used to input various data used for executing applications through user operations.
[0052] (6) Storage section 160 The storage unit 160 can store various data used to execute applications. The storage unit 160 stores data used to control the display unit 140. The storage unit 160 stores, for example, module data used to generate an avatar of the first user. Note that the storage unit 160 is not limited to storing module data used to generate an avatar of the first user, and may store module data used to generate other avatars.
[0053] The module data is, for example, data related to body parts used to generate an avatar. The body parts used to generate an avatar include, for example, data on each body part of the avatar (eyes, nose, mouth, eyebrows, skin color, hairstyle, hair color, clothes, body, etc.). The module data also includes data related to IDs assigned to each body part used to generate the avatar. If the body part of the avatar is the body, the data related to the body part used to generate the avatar may include data categorized by body type, such as skinny, slightly skinny, normal, slightly obese, and obese.
[0054] Furthermore, when the display unit 140 displays an avatar 80 other than the avatar 80A (an avatar of another person), the server device 20 may transmit ID data used to generate the avatar 80 other than the avatar 80A to the first terminal 11, and the first terminal 11 may construct the avatar 80 other than the avatar 80A based on the ID data.
[0055] Furthermore, when display unit 140 displays an avatar 80 other than avatar 80A (an avatar of another person), display unit 140 may display the avatar 80 other than avatar 80A colored black, or may display the avatar 80 other than avatar 80A with two options for male or female using parts and / or colors determined based on the gender (e.g., male or female) of the user corresponding to the avatar 80 other than avatar 80A.
[0056] 3-2. Functions of the server device 20 Fig. 4 is a block diagram showing an example of the functions of server device 20 shown in Fig. 1. As shown in Fig. 4, server device 20 includes, for example, a communication unit 210, a storage unit 220, and a control unit 230.
[0057] (1) Communications Unit 210 The communication unit 210 is used, for example, to transmit various data to the terminal 10. The communication unit 210 is also used, for example, to receive various data from the terminal 10. The data received by the communication unit 210 is sent to the control unit 230.
[0058] (2) Storage section 220 The storage unit 220 stores various data used for executing applications. The storage unit 220 stores, for example, first data transmitted from the first terminal 11. The first data transmitted from the first terminal 11 includes, for example, data related to the avatar 80A. The first data may also include data related to "behavior history." Details of the first data transmitted from the first terminal 11 and the data related to "behavior history" will be described later.
[0059] (3) Control unit 230 The control unit 230 performs various controls based on, for example, data received by the communication unit 210. The control unit 230 performs, for example, processes of S183 in Fig. 10, S193 in Fig. 10, S131 in Fig. 11, S183 in Fig. 11, and S193 in Fig. 11, which will be described later.
[0060] 5 is a diagram showing an example of a display that is displayed on the display unit 140 of the first terminal 11 by operating the first terminal 11 and starting an application. As shown in FIG. 5, a virtual space 300 is displayed on the display unit 140. The virtual space 300 is, for example, a three-dimensional space. An avatar 80 and a virtual venue 310 are shown within the virtual space 300.
[0061] The avatar 80 is configured to be able to perform at least one of walking, running, and jumping, for example, in response to a user operation. The avatar 80 is also configured to be able to, for example, examine a virtual object, push a virtual object, pull a virtual object, lift a virtual object, sit on a virtual object, purchase a virtual object, and give an item to a virtual object in response to a user operation. Here, examples of virtual objects include an avatar, a door, groceries, an admission ticket, a chair, and an exhibit. When a user operates the avatar 80 using the terminal 10, data related to the operation is transmitted to the server device 20.
[0062] By performing the above-described operation of "examine virtual object," a description of the virtual object is displayed on the display unit 140. The description of the virtual object is, for example, at least one of the name of the virtual object, the purpose of the virtual object, and the price of the virtual object. The description of the virtual object is, for example, at least one of text, an image, and a video.
[0063] The position of the virtual object in the virtual space 300 can be changed by the above-mentioned operations of "pushing the virtual object," "pulling the virtual object," and "lifting the virtual object."
[0064] By performing the above-described operation of "taking a seat on a virtual object," the avatar 80 takes a seat on the virtual object. The avatar 80 may be configured to be able to take a seat at a specific location other than the virtual object. When the avatar 80 takes a seat on the virtual object or when the avatar 80 takes a seat at a specific location other than the virtual object, the display unit 140 may display a display screen different from the display screen before the avatar 80 took a seat (for example, a display screen without a UI operation unit or a chat screen), or may hide the user interface that existed before the avatar 80 took a seat. When the display unit 140 displays a display screen different from the display screen before the avatar 80 took a seat, the display unit 140 may display the screen to be displayed in full screen.
[0065] The above-described operation of "purchase a virtual object" allows, for example, the user to purchase the virtual object. If the virtual object is wearable, the appearance of the avatar 80 can be changed by having the avatar 80 wear the purchased virtual object.
[0066] Among the avatars displayed on display unit 140, avatars 80 other than the avatar 80 to be operated may be avatars operated by the user, or may be avatars whose movements within virtual space 300 have been determined in advance. Here, when the movements of avatar 80 within virtual space 300 have been determined in advance, this means that avatar 80 operates as an NPC (Non Player Character).
[0067] 5 all have the same appearance, but this is not a limitation. The appearance of the avatar 80 may be determined based on data about the user operating the avatar 80 or data about the ID associated with parts of the avatar 80 selected by the user. For example, if the user operating the avatar 80 is male, the appearance of the avatar 80 may be male. Also, for example, if the user operating the avatar 80 is female, the appearance of the avatar 80 may be female.
[0068] The movement of an avatar in the virtual space may also change in response to the user's movement. For example, if the user nods, the avatar in the virtual space may also nod. Here, the movement data may be acquired, for example, using a motion capture system. As will be readily understood by those skilled in the art with the benefit of this disclosure, some examples of suitable motion capture systems that may be used with the apparatus and method disclosed herein include optical motion capture systems that use passive or active markers or no markers, and inertial and magnetic non-optical systems. The motion data may be acquired using an image capture device (such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide semiconductor) image sensor) coupled to a computer that converts the motion data into video or other image data.
[0069] When operating avatar 80A shown in FIG. 5, for example, display unit 140 displays a screen such as that shown in FIG.
[0070] FIG. 6 is a diagram illustrating an example of a display displayed on the display unit 140 of the terminal 10. Specifically, FIG. 6 is a diagram illustrating an example of a display displayed on the display unit 140 of the first terminal 11 when the first user operates the avatar 80A using the first terminal 11. As illustrated in FIG. 6, for example, the display unit 140 displays the avatar 80, the avatar 80A, and the virtual venue 310. Here, the display unit 140 displays the rear view of the avatar 80A, and the line of sight of the first user operating the first terminal 11 and the line of sight of the avatar 80A corresponding to the first user are in the same direction. The display unit 140 displays an area in the virtual space including the avatar 80A, for example, based on a virtual viewpoint located closer to the page of FIG. 6 than the avatar 80A. The display unit 140 displays an area in the virtual space including the traveling direction of the avatar 80A. Note that the area in the virtual space displayed by the display unit 140 can be changed by operating the avatar 80A using the terminal 10. For example, by changing the direction of travel of avatar 80A by 180 degrees using terminal 10, it is possible to display the area behind avatar 80A in Fig. 6. In this way, by operating avatar 80A using terminal 10, display unit 140 can display an area not shown in Fig. 6. When a user operating first terminal 11 operates avatar 80A and avatar 80A shown in Fig. 6 is positioned inside virtual venue 310, a display screen such as that shown in Fig. 7 is displayed.
[0071] 6, when the first user operates avatar 80A, first terminal 11, for example, acquires data relating to the position of avatar 80A within virtual space 300. Furthermore, for example, the data relating to the position of avatar 80A within virtual space 300 acquired by first terminal 11 is transmitted to server device 20. Note that the timing at which first terminal 11 acquires the data relating to the position of avatar 80A within virtual space 300 may be any timing. Furthermore, for example, the timing at which the data relating to the position of avatar 80A within virtual space 300 acquired by first terminal 11 is transmitted to server device 20 may also be any timing.
[0072] Furthermore, it may be possible to perform a touch operation on any area of display unit 140 of first terminal 11. Furthermore, first terminal 11 may be provided with an acceleration sensor (not shown), and when first terminal 11 is operated, the display area and / or direction displayed by display unit 140 may be changed based on the acceleration sensor.
[0073] Here, the above-mentioned "any area" includes, for example, icon 301 (area 301) and / or display area 314 in FIG. 6. Icon 301 and / or display area 314 are an operation user interface for performing predetermined display control by performing a touch operation. Furthermore, "touch operation" refers to, for example, at least one of tapping, double tapping, swiping, flicking, pinching in, and pinching out. Furthermore, icon 301 and / or display area 314 may be displayed in the same position or in a different position not only when displaying FIG. 6 but also when displaying other drawings (for example, at least one of FIGS. 7 to 9) described later.
[0074] 6, two icons 301 may be provided, or one or three or more icons 301 may be provided. When two or more icons 301 are provided, one icon 301 corresponds to, for example, an area used to make avatar 80A walk, and another icon 301 corresponds to, for example, an area used to make avatar 80A jump. In this way, touching an icon 301 makes it possible to make avatar 80A walk or jump.
[0075] Here, the touch operation for making avatar 80A walk or jump is, for example, an operation of tapping or double-tapping icon 301 of avatar 80A. Furthermore, the area where the touch operation for making avatar 80A walk or jump is performed may be an area other than icon 301.
[0076] The display area 314 is an area that displays a message entered by a user corresponding to the avatar 80. When the display unit 140 displays the display area 314, at least one of a message sent from the first terminal 11 and a message sent from a terminal other than the first terminal is displayed in the display area 314. Here, the message displayed in the display area 314 may display a message addressed to the first terminal, or may display a message exchanged between terminals other than the first terminal. Therefore, the display area 314 functions as an area that can be viewed and / or chatted by a user corresponding to at least one avatar 80 existing in the virtual space 300, or an area that can be viewed and / or chatted by a user corresponding to at least one avatar 80 existing in a specific location in the virtual space 300.
[0077] In this way, the first terminal 11 allows the first user to chat with a user corresponding to at least one of all avatars 80 via the display area 314 of the display unit 140. For example, the first terminal 11 allows the first user to chat with users corresponding to all avatars 80 present in a predetermined area (within the same area) via the display area 314 of the display unit 140. Here, the users chatting with the first user are individual users or exhibiting companies. Furthermore, when multiple messages are displayed in the display area 314, if it is not possible to display all the messages within the display area 314, a touch operation can be performed to display messages that are not displayed within the display area 314. Here, the touch operation when it is not possible to display all the messages within the display area 314 is, for example, a swipe.
[0078] Note that the condition for displaying the display area 314 on the display unit 140 is not limited to when the avatar 80 is located within the virtual venue 310. For example, when the avatar 80 is located within a predetermined area within the virtual space 300, a display area corresponding to the predetermined area may be displayed on the display unit 140. That is, the display area to be displayed on the display unit 140 may be determined depending on the location of the avatar 80. This allows a user to exchange messages with users corresponding to other avatars 80 who are present in the same area as the user's avatar 80. Furthermore, a user can chat with users who share specific attributes. Therefore, a user can easily communicate with other users who share common interests, concerns, and / or attributes.
[0079] Furthermore, the terminal from which the message displayed in display area 314 is sent is, for example, a terminal used by a user who operates an avatar present in virtual venue 310. However, the avatar corresponding to the terminal from which the message is sent and displayed in display area 314 may or may not be displayed in virtual venue 310.
[0080] Furthermore, the display area 314 may display products that can be purchased. The products may be, for example, products related to the operator or operating organization that operates the virtual venue 310. The display area 314 may display information about the products and information encouraging the purchase of the products, along with the products. Here, the information encouraging the purchase of the products is configured to be selectable, such as "Add to cart."
[0081] Furthermore, when a user uses terminal 10 to perform an operation to proceed with the purchase procedure for at least one product displayed in display area 314, for example, a browser installed on terminal 10 is launched, and a page requesting input of details to be used to purchase the product is displayed on display unit 140.
[0082] 6, for example, when an operation of tapping or double-tapping point 321 is performed, display unit 140 displays line segment 322 connecting avatar 80A and point 321, and avatar 80A walks to point 321 along line segment 322. Note that point 321 and line segment 322 may be any color. Furthermore, a touch operation for causing avatar 80A to walk is an operation of flicking any area of avatar 80A to change the direction of travel, and then tapping or double-tapping any point on the imaginary line of the changed direction of travel.
[0083] 6, for example, display unit 140 may display icon 323. Icon 323 is operated to switch between displaying and hiding display area 314. When display area 314 is displayed by operating icon 323, display unit 140 may not display icon 323, or may continue to display icon 323.
[0084] FIG. 7 is a diagram showing an example of a display screen in the virtual venue 310 displayed on the display unit 140 of the terminal 10. In FIG. 7, the user operating the first terminal 11 operates the avatar 80A, and the avatar 80A shown in FIG. 6 is positioned inside the virtual venue 310, causing the scene to change, and thus the display screen to change. Note that the URL used when the display screen is displayed using the web browser of the first terminal 11 when the avatar 80A is located outside the virtual venue 310 (e.g., FIG. 6) is different from the URL used when the display screen is displayed using the web browser of the first terminal 11 when the avatar 80A is located inside the virtual venue 310 (e.g., FIG. 7). Therefore, when the web browser of the first terminal 11 is used, if the avatar 80A shown in FIG. 6 is positioned inside the virtual venue 310, the URL will change. As shown in FIG. 7, the avatar 80, avatar 80A, chair 81, display area 311, display area 312, avatar 313, and slider 330 are shown. It should be noted that the slider 330 is not an essential component. Here, the virtual venue 310 is, for example, a booth at an exhibition or event venue. At least one chair 81 is provided. The avatars 80 and 80A are assumed to be located in a first area within the virtual venue 310.
[0085] The chair 81 is, for example, a virtual object on which the avatar 80 can sit. For example, the user operates the avatar 80A to approach a specific chair among the multiple chairs 81 and perform a predetermined operation, causing the avatar 80 to sit in the chair 81. Also, for example, the user operates the avatar 80A to approach a specific chair among the multiple chairs 81 and perform a predetermined operation, causing a message asking whether or not to sit in the specific chair to be displayed on the display screen of the first terminal 11. When the message asking whether or not to sit in the specific chair is displayed on the display screen of the first terminal 11, if the user operates the terminal 10 to perform a predetermined operation indicating an intention to sit in the specific chair in response to the message, the avatar 80 will sit in the chair 81. Note that, together with or instead of a virtual object that can be sat on, a configuration may be adopted in which the avatar 80 is seated when a specific location within the virtual space 300 is specified. In this case, the user may approach a specific location within the virtual space 300 and perform a predetermined operation, causing a message asking whether or not to sit in the specific location to be displayed on the display screen of the first terminal 11. When a message asking whether to sit in a specific location is displayed on the display screen of the first terminal 11, if the user operates the terminal 10 to perform a predetermined operation indicating an intention to sit in the specific location in response to the message, the avatar 80 may be configured to sit in the specific location.
[0086] In the display area 311, for example, various explanatory materials and / or videos are displayed. In the display area 312, the name of the organization operating the virtual venue 310, the theme of the briefing, etc. are displayed. The avatar 313 is, for example, an avatar that resembles a staff member who will be running the virtual venue 310. The avatar 313 may be an avatar operated by a user, or an avatar whose movements within the virtual space 300 are predetermined. Here, when the avatar 80 moves in the virtual space 300 in a manner that is predetermined, this means that the avatar acts as the NPC described above.
[0087] At a predetermined time in the virtual venue 310, for example, a predetermined explanation is started. Here, the time used in the virtual space may be a time synchronized with the real time, or may be a time used in the virtual space 300 separately from the real time. Note that the condition for starting the predetermined explanation in the virtual venue 310 does not have to be related to time. For example, the condition for starting the predetermined explanation in the virtual venue 310 may be when the number of avatars present in the virtual venue 310 reaches a predetermined number or more, or when a specific avatar is located in the virtual venue 310, or the like.
[0088] Note that the system may be configured so that multiple avatars can overlap and occupy the same seat at the same time. For example, when avatar 80 is seated in chair 81 on the left side of Fig. 7, a user may use terminal 10 to operate avatar 80A to seat avatar 80A in chair 81 on the left side of Fig. 7. In this way, even if the total number of avatars located in virtual venue 310 exceeds the total number of chairs 81, all avatars viewing content displayed in display area 311 can be seated in virtual venue 310.
[0089] A predetermined explanation that starts at a predetermined time is provided by displaying predetermined content in the display area 311 and / or outputting audio. The explanation is, for example, a video. The video is, for example, any of a predetermined explanatory video, an event video such as a concert, a video such as a movie, and a video reflecting the real-time movements and / or performances of a Vtuber. If the explanation is a video, the terminal 10 requests data related to the video from the second server system 22. Then, in response to the request, the second server system 22 transmits data related to the video to the terminal 10. As a result, the terminal 10 can receive data related to the video from the second server system 22 and watch the video.
[0090] In Fig. 7, when avatar 80A satisfies a predetermined condition (first condition), display unit 140 displays Fig. 8 or 9 instead of Fig. 7. As a result, display unit 140 displays a first-person perspective (FPS: First-Person Shooter) instead of a third-person perspective (TPS: Third-Person Shooter) perspective. That is, display unit 140 displays a display that does not include avatar 80A instead of a display that includes avatar 80A.
[0091] Here, the above-mentioned "first condition" means, for example, that the first data includes operation data for selecting a part of an area including the first position, that the first data includes operation data for selecting an object to be displayed on display unit 140, or that the first data includes data indicating that avatar 80A is present within the first area. For example, if the first area is a predetermined area within virtual venue 310, the above-mentioned "data indicating that avatar 80A is present within the first area" is data indicating that the position of avatar 80A within virtual venue 310 is present within the predetermined area.
[0092] Specifically, the "first condition" may be, for example, being located at a predetermined position within the virtual venue 310 or a predetermined area within the virtual venue 310. Here, the "predetermined area" may be, for example, an area within the virtual venue 310 within a predetermined distance from the display area 311. The "first condition" may also be, for example, designating the display area 311. The "first condition" may also be, for example, a user operating the terminal 10 to cause the avatar 80A to sit in the chair 81. The "first condition" may also be, for example, being located at a predetermined position within the virtual venue 310 or a predetermined area within the virtual venue 310 and designating the display area 311. The "first condition" may also be, for example, a user operating the terminal 10 to cause the avatar 80A to sit in the chair 81 and designating the display area 311.
[0093] As shown in FIG. 8, display unit 140 displays an enlarged view of a portion of virtual venue 310 shown in FIG. 7. Display unit 140 may enlarge and display display area 311 shown in FIG. 7, or may enlarge and display an object other than display area 311 shown in FIG. 7. In FIG. 8, display unit 140 does not display, for example, avatar 80A. In FIG. 8, icon 301 may be displayed, or icon 301 may not be displayed. In FIG. 8, display area 314 may be displayed, or display area 314 may not be displayed. In FIG. 8, icon 323 may be displayed, or icon 323 may not be displayed. In FIG. 8, slider 330 may be displayed, or slider 330 may not be displayed.
[0094] As shown in Fig. 9, the display unit 140 displays an enlarged partial area of the virtual venue 310 shown in Fig. 7. Specifically, the display unit 140 displays a display area 311 that covers, for example, substantially the entire area of the display screen.
[0095] Further, the display unit 140 displays, for example, an icon 301 (area 301). The icon 301 is an icon for switching from the screen of FIG. 9 to another screen. Here, the "another screen" is, for example, any of the screens of FIGS. 6 to 8. The icon 301 is, for example, the same as the icon 301 shown in FIG. 6. The functions assigned to the icon 301 of FIG. 6 and the icon 301 of FIG. 9 are configured to differ depending on the screen displayed by the display unit 140, for example.
[0096] For example, when the display unit 140 displays the icon 301 on a third-person perspective (TPS) screen shown in FIG. 6 or FIG. 7, operating the icon 301 causes the avatar 80A to walk or jump, for example, as described above. Also, when the display unit 140 displays the icon 301 on a first-person perspective (FPS) screen shown in FIG. 9, operating the icon 324 causes the avatar 80A to leave the screen, for example. Here, causing the avatar 80A to leave the screen means that the display unit 140 displays the third-person perspective (TPS) shown in FIG. 6 or FIG. 7 instead of the first-person perspective (FPS) shown in FIG. 9. Note that when the display unit 140 displays the icon 301 on a screen such as that shown in FIG. 9, operating the icon 324 may switch to a display screen such as that shown in FIG. 8, for example.
[0097] Note that display unit 140 may enlarge and display display area 311 shown in FIG. 7, or may enlarge and display an object other than display area 311 shown in FIG. 7. Therefore, the enlargement ratio of display area 311 in FIG. 9 is greater than the enlargement ratio of display area 311 in FIG. 8. Also, in FIG. 9, display unit 140 does not display, for example, avatar 80A. Also, in FIG. 9, area 301 may be displayed, or area 301 may not be displayed. Also, in FIG. 9, display area 314 may be displayed, or display area 314 may not be displayed. Also, in FIG. 9, icon 323 may be displayed, or icon 323 may not be displayed. Also, in FIG. 9, slider 330 may be displayed, or slider 330 may not be displayed.
[0098] 8 and / or 9, it is possible to communicate with other users through display area 314 while viewing the content displayed in display area 311. If the content of the message from the other user displayed in display area 314 is related to the content displayed in display area 311, the first user can exchange messages with the other user, thereby providing the first user with the feeling that they are viewing the content displayed in display area 314 together with the other user, even if the first user is physically distant from the other user.
[0099] 8 and / or 9, the first user can further concentrate on viewing the content displayed in display area 311. Furthermore, by hiding display area 314 in Fig. 8, in a case where a message displayed in display area 314 may include content related to the content of display area 311, the first user can reduce the possibility of unintentionally learning about the content through display area 314 before viewing the content.
[0100] 8 and / or 9, it is possible to switch between displaying and hiding display area 314 without requiring complicated operations while the first user is viewing content displayed in display area 311. Furthermore, by displaying icon 323 in FIG. 8 and / or 9, before starting to view content displayed in display area 311 or after finishing viewing, the first user can communicate with other users by operating icon 323 to display display area 314, and while viewing content displayed in display area 311, the first user can view the content displayed in display area 311 by operating icon 323 to hide display area 314. Here, when the first user views content displayed in display area 311 with display area 314 hidden by operating icon 323, the first user can further concentrate on viewing the content displayed in display area 311, as described above. Furthermore, when the first user operates icon 323 to hide display area 314 and watches the content displayed in display area 311, in cases where, as described above, the message displayed in display area 314 may include content related to the content of display area 311, the first user can reduce the possibility of unintentionally understanding the content related to the content through display area 314 before watching the content.
[0101] On the other hand, by hiding icon 323 in FIG. 8 , when, after displaying FIG. 8 , a user performs an operation such as pinching in on display unit 140 to enlarge display area 311, the possibility that a part of display area 311 will overlap icon 323 can be reduced. Therefore, for example, in a case where a first user enlarges display area 311 while viewing content displayed in display area 311 and text is displayed in a part of display area 311, the possibility that the text will become indiscernible due to the text overlapping the display position of icon 323 can be reduced. Furthermore, by hiding icon 323 in FIG. 9 , the possibility that a part of display area 311 will overlap icon 323 can be reduced. Therefore, for example, in a case where a first user displays text in a part of display area 311 while viewing content displayed in display area 311, the possibility that the text will become indiscernible due to the text overlapping the display position of icon 323 can be reduced.
[0102] 8 and / or 9, the first user can intuitively make fine adjustments to the magnification ratio of display area 311. Therefore, for example, if the magnification ratio of display area 311 when transitioning to FIG. 8 or 9 instead of FIG. 7 is determined in advance, the first user can intuitively make fine adjustments to the desired magnification ratio.
[0103] On the other hand, by hiding the slider 330 in FIG. 8 , it is possible to reduce the possibility that a part of the display area 311 will overlap with the slider 330 when, after displaying FIG. 8 , the first user performs an operation such as pinching in on the display unit 140 to enlarge the display area 311. Therefore, for example, in a case where the first user enlarges the display area 311 while viewing content displayed in the display area 311 and text is displayed in a part of the display area 311, it is possible to reduce the possibility that the text will become invisible due to the text overlapping the display position of the slider 330. Furthermore, by hiding the slider 330 in FIG. 9 , it is possible to reduce the possibility that a part of the display area 311 will overlap with the slider 330. Therefore, for example, in a case where the first user displays text in a part of the display area 311 while viewing content displayed in the display area 311, it is possible to reduce the possibility that the text will become invisible due to the text overlapping the display position of the slider 330.
[0104] In this way, when the first condition described above is satisfied, display unit 140 can display Fig. 8 or 9 instead of Fig. 7. Therefore, the user can optimize the display (content) in display area 311 and hide avatar 80 operated by the user, without having to perform complex operations such as repeatedly pinching in on display area 311 of display unit 140 to fine-tune the magnification, or pinching out to fine-tune the magnification when repeated pinching in has resulted in excessive magnification, thereby allowing the user to immerse themselves in viewing the content displayed in display area 311. Furthermore, display switching can be easily and appropriately performed even when the application of the present disclosure is executed using terminal 10 with a relatively small display screen, such as a smartphone.
[0105] When changing from the display in Fig. 7 to the display in Fig. 8, the display in Fig. 7 may correspond to the "first display" in the present disclosure, and the display in Fig. 8 may correspond to the "second display" in the present disclosure. When changing from the display in Fig. 7 to the display in Fig. 9, the display in Fig. 7 may correspond to the "first display" in the present disclosure, and the display in Fig. 9 may correspond to the "second display" in the present disclosure.
[0106] 8 or 9, a configuration may be adopted in which an action to move avatar 80A is accepted, or a configuration may be adopted in which an action to move avatar 80A is not accepted. If a configuration is adopted in which an action to move avatar 80A is not accepted in the state shown in FIG. 8 or 9, for example, when a video is displayed in display area 311 and the user is watching the video, it is possible to prevent avatar 80A from moving even if the user accidentally performs an operation to move avatar 80A. In this way, it is possible to prevent avatar 80A from moving and prevent display unit 140 from losing part of display area 311 even when the user accidentally performs an operation to move avatar 80A.
[0107] Furthermore, at least one of the operation for changing from the display of FIG. 9 to the display of FIG. 7, the operation for changing from the display of FIG. 9 to the display of FIG. 8, and the operation for changing from the display of FIG. 8 to the display of FIG. 7 may be, for example, an operation for causing seated avatar 80A to leave chair 81.
[0108] 9 to the display in FIG. 7, the operation to change from the display in FIG. 9 to the display in FIG. 8, and the operation to change from the display in FIG. 8 to the display in FIG. 7 may be, for example, an operation in which the user taps, double-tap, swipes, flicks, pinches in, or pinches out on area 301, or may be an operation in which the user designates (touches) a specific icon such as icon 323.
[0109] 9 to the display in FIG. 7, the operation to change from the display in FIG. 9 to the display in FIG. 8, and the operation to change from the display in FIG. 8 to the display in FIG. 7 may be, for example, an operation in which the user taps, double-tap, swipes, flicks, pinches in, or pinches out on display area 311, or may be an operation in which the user designates (touches) a specific icon such as icon 323.
[0110] Furthermore, at least one of the operations for changing from the display of FIG. 9 to the display of FIG. 7, the operation for changing from the display of FIG. 9 to the display of FIG. 8, and the operation for changing from the display of FIG. 8 to the display of FIG. 7 may be performed, for example, by the user operating slider 330.
[0111] In addition, when at least one of an operation to change from the display of FIG. 9 to the display of FIG. 7, an operation to change from the display of FIG. 9 to the display of FIG. 8, and an operation to change from the display of FIG. 8 to the display of FIG. 7 is performed, display unit 140 may not display icon 323 instead of displaying display area 314.
[0112] The following describes a case where the display unit 140 displays a slider 330 superimposed on the virtual venue 310. The slider 330 is, for example, an operation user interface including a first element 331 and a second element 332. The first element 331 is configured to be slidable on the second element 332. The display unit 140 displays the slider 330 in at least one of FIGS. 7 to 9, for example.
[0113] As first element 331 moves from left to right on second element 332, display unit 140 enlarges and displays a partial area of virtual venue 310. Furthermore, as first element 331 moves from right to left on second element 332, display unit 140 reduces and displays a partial area of virtual venue 310. In this way, when display unit 140 displays the display screens shown in Figures 7 to 9, the user can adjust the magnification rate of a partial area of virtual venue 310.
[0114] When the above-mentioned "first condition" is satisfied and display unit 140 displays FIG. 8 instead of FIG. 7, display unit 140 may, for example, display FIG. 8 in which first element 331 is positioned approximately in the center of second element 332. Furthermore, when the above-mentioned "first condition" is satisfied and display unit 140 displays FIG. 9 instead of FIG. 7, display unit 140 may, for example, display FIG. 9 in which first element 331 is positioned at the right end of second element 332.
[0115] 4. Operation of System 1000 The operation of the system 1000 will be described with reference to Figures 10 and 11. Figures 10 and 11 are flowcharts showing an example of the operation performed using the system 1000 shown in Figure 1.
[0116] First, steps S111 to S193 will be described in order with reference to FIG.
[0117] In S111, the first user starts an application by operating the first terminal 11. After that, in S121, the first terminal 11 acquires the first data.
[0118] Here, the first data may include, for example, data related to an avatar in a virtual space operated using the first user's terminal. The first data may also be user operation data or operation history data, such as data related to the position of the first user's avatar. The first data may also include, for example, data related to the behavior history of the avatar in a virtual space operated using the first user's terminal.
[0119] In S125, first terminal 11 performs a first display control process. Here, the first display control process refers to, for example, a process of displaying a display screen such as that shown in FIG. 7 when a user operating first terminal 11 operates avatar 80A and avatar 80A shown in FIG. 6 is located inside virtual venue 310.
[0120] In S131, the first terminal 11 performs a first determination process. Here, the first determination process is to determine whether or not the first data satisfies a predetermined condition (first condition). If the first terminal 11 determines in S131 that the first condition is satisfied, control data for controlling the display unit 140 of the first terminal 11 is determined, and the process of S141 is executed. On the other hand, if the first terminal 11 determines in S131 that the first condition is not satisfied, the process of S131 is repeated.
[0121] The first condition in S131 is, for example, being located at a predetermined position within the virtual venue 310 or a predetermined area within the virtual venue 310. Here, the "predetermined area" refers, for example, to within a predetermined distance from the display area 311. The "first condition" may also refer, for example, to designating the display area 311. The "first condition" may also refer, for example, to the user operating the terminal 10 to cause the avatar 80A to sit in the chair 81. The "first condition" may also refer, for example, to being located at a predetermined position within the virtual venue 310 or a predetermined area within the virtual venue 310, and designating the display area 311. The "first condition" may also refer, for example, to the user operating the terminal 10 to cause the avatar 80A to sit in the chair 81, and designating the display area 311.
[0122] In S141, first terminal 11 performs a process (second display control process) to control display unit 140 of first terminal 11 based on the control data. As a result, display unit 140 of first terminal 11 displays FIG. 8 or 9 instead of FIG. 7. After S141, first terminal 11 transmits the first data to server device 20. Note that first terminal 11 may transmit the first data to server device 20 before S141.
[0123] In S183, server device 20 determines analytical data based on the first data. Then, server device 20 transmits the determined analytical data to device 70. For example, server device 20 determines analytical data and transmits the determined analytical data to device 70 every time it receives first data.
[0124] In S193, the server device 20 determines advertisement data based on the first data. The advertisement data is determined based on the first data and includes data intended for the first user who operates the first terminal 11. In S193, the server device 20 transmits the determined advertisement data intended for the first user to the first terminal 11.
[0125] Next, steps S111 to S193 will be described in order with reference to FIG.
[0126] In S111, the first user starts an application by operating the first terminal 11. After that, in S121, the first terminal 11 acquires the first data.
[0127] Here, the first data may include, for example, data related to an avatar in a virtual space operated using the first user's terminal. The first data may also be user operation data or operation history data, such as data related to the position of the first user's avatar. The first data may also include, for example, data related to the behavior history of the avatar in a virtual space operated using the first user's terminal.
[0128] After S121, first terminal 11 transmits the first data to server device 20. In S122, server device 20 receives the first data and generates first control data based on the first data. Server device 20 also transmits the first control data to first terminal 11.
[0129] In S125, first terminal 11 performs a first display control process. Here, the first display control process refers to, for example, a process of displaying a display screen such as that shown in FIG. 7 when a user operating first terminal 11 operates avatar 80A and avatar 80A shown in FIG. 6 is located inside virtual venue 310.
[0130] In S131, server device 20 performs a first determination process. Here, the first determination process is to determine whether or not the first data satisfies a predetermined condition (first condition). If server device 20 determines in S131 that the first condition is satisfied, it determines second control data for controlling display unit 140 of first terminal 11 and transmits the second control data to first terminal 11, and the process of S141 is executed. On the other hand, if first terminal 11 determines in S131 that the first condition is not satisfied, the process of S131 is repeated.
[0131] The first condition in S131 is, for example, being located at a predetermined position within the virtual venue 310 or a predetermined area within the virtual venue 310. Here, the "predetermined area" refers, for example, to within a predetermined distance from the display area 311. The "first condition" may also refer, for example, to designating the display area 311. The "first condition" may also refer, for example, to the user operating the terminal 10 to cause the avatar 80A to sit in the chair 81. The "first condition" may also refer, for example, to being located at a predetermined position within the virtual venue 310 or a predetermined area within the virtual venue 310, and designating the display area 311. The "first condition" may also refer, for example, to the user operating the terminal 10 to cause the avatar 80A to sit in the chair 81, and designating the display area 311.
[0132] In S141, first terminal 11 performs a process (second display control process) to control display unit 140 of first terminal 11 based on the second control data. As a result, display unit 140 of first terminal 11 displays Fig. 8 or 9 instead of Fig. 7.
[0133] In S183, server device 20 determines analytical data based on the first data. Then, server device 20 transmits the determined analytical data to device 70. For example, server device 20 determines analytical data and transmits the determined analytical data to device 70 every time it receives first data.
[0134] In S193, the server device 20 determines advertisement data based on the first data. The advertisement data is determined based on the first data and includes data intended for the first user who operates the first terminal 11. In S193, the server device 20 transmits the determined advertisement data intended for the first user to the first terminal 11.
[0135] 10 and S193 in Fig. 11, if avatar 80 has entered virtual venue 310 where an event held by a predetermined operating organization is being held and has a history of watching videos played in virtual venue 310, the advertising data transmitted to first terminal 11 may include, for example, data regarding information about an event that the predetermined operating organization will hold in the future. The data includes at least one of text data, image data, and video data.
[0136] 10 and S193 in FIG. 11, the above-mentioned advertisement data may be, for example, data including a URL for accessing a database that stores second data related to the advertisement determined based on the first data. The above-mentioned advertisement data may also be, for example, already downloaded into an app (application) by batch processing or the like. In this case, server device 20 may transmit data related to an ID corresponding to the data to be transmitted to first terminal 11, and first terminal 11 may display the advertisement data based on the ID.
[0137] FIG. 12 shows an example of data transmitted from the terminal 10. In FIG. 12, various data that the server device 20 receives from each terminal 10 when a first user, a second user, and a third user each operate an avatar using their own terminal 10 is described. Here, the various data are, for example, data related to "age," "gender," "current location," "virtual object," "chat history," "content viewing history," "parts ID," and "simple avatar." Here, the "parts ID" is, for example, data for identifying an avatar. The "simple avatar" is, for example, data related to an ID pattern according to gender, including male and female.
[0138] The above-mentioned first data may include, for example, at least any of the contents relating to the first user in FIG.
[0139] Here, with regard to the above-mentioned "age", FIG. 12 shows an example in which the first user is 21 years old, the second user is 31 years old, and the third user is 41 years old.
[0140] Furthermore, with regard to the above-mentioned "gender," FIG. 12 shows an example in which the gender of the avatar of the first user is male, the gender of the avatar of the second user is female, and the gender of the avatar of the third user is male.
[0141] Furthermore, with regard to the above-mentioned "current location," Figure 12 shows an example in which an avatar operated by a first user is located at location A01, an avatar operated by a second user is located at location B01, and an avatar operated by a third user is located at location C01.
[0142] 12 shows an example in which an avatar operated by a first user purchases virtual object A12 at price A13 at time A11, an avatar operated by a second user opens virtual object B12 at time B11, and an avatar operated by a third user acquires virtual object C12 at time C11. Virtual object B22 is, for example, a door.
[0143] Furthermore, with regard to the above-mentioned "chat history," Figure 12 shows an example in which a first user's terminal sends a message "Hello" to a third user's terminal at location A22 at time A21, the second user has no chat history with any other users, and the third user's terminal receives the message "Hello" from the first user's terminal at location C22 at time C21.
[0144] Furthermore, with regard to the above-mentioned "content viewing history," Figure 12 shows an example in which a first user's avatar stands up at position A32 at time A31 and starts viewing content, a second user's avatar watches content for two hours in seat B33 at position B32 at time B31, and a third user's avatar finishes viewing content at position C32 at time C31 and leaves seat C33.
[0145] Although the above-mentioned "age" has been described as an example of indicating the user's age, the present invention is not limited to this. For example, the above-mentioned "age" may indicate the age group to which the user belongs. For example, if 21 to 30 years old are defined as Category 1, the age of a first user may be indicated as belonging to Category 1. Furthermore, if 31 to 40 years old are defined as Category 2, the age of a second user may be indicated as belonging to Category 2. Furthermore, if 41 to 50 years old are defined as Category 3, the age of a third user may be indicated as belonging to Category 3. In this way, for example, when analysis data is determined in S183 of FIG. 9 or S183 of FIG. 10 and the analysis data is transmitted to the device 70, data related to age can be used for marketing, etc., without transmitting specific personal information about the user to the device 70.
[0146] Furthermore, although the above-mentioned "current location" indicates the location of the avatar at a specific time, it is not limited to this. For example, it may include data indicating the path of the avatar's movement within virtual space 300 within a predetermined period of time.
[0147] Furthermore, with regard to the "chat history" described above, an example has been described in which a first user sends the message "Hello" to a third user's terminal at a location A22 at a time A21, but the content of the message is not limited to this. Furthermore, data sent from one user's terminal to another user's terminal may include at least one of text, emoticons, voice messages, images, and videos.
[0148] 12 is not limited to the above-mentioned example, and may include data related to "behavior history." Data related to "behavior history" may include, for example, the time when the avatar 80 entered the virtual venue 310, the time when the avatar 80 left the virtual venue 310, the time the avatar 80 stayed in the virtual venue 310, the time when the avatar 80 started viewing the object displayed in the display area 311 in the virtual venue 310, the time (duration) when the avatar 80 viewed the object displayed in the display area 311 in the virtual venue 310, the time when the avatar 80 finished viewing the object displayed in the display area 311 in the virtual venue 310, the time when the avatar 80 sat down in the chair 81, the time when the avatar 80 The history may include at least one of the following: the time when avatar 80 leaves chair 81, the time from when avatar 80 sits on chair 81 until when avatar 80 leaves, and position data of chair 81 when avatar 80 sits on chair 81; a history of received data including a message received by a user operating one terminal 10 from a terminal 10 operated by a user operating another terminal 10; and a history of sent data including a message sent by a user operating one terminal 10 to a terminal 10 operated by a user operating another terminal 10.
[0149] 12 to transmit to the device 70. For example, in a case where the data to be transmitted to the device 70 includes the content related to the chat history described in FIG. 12, the server device 20 may transmit to the device 70 the data described in FIG. 12 excluding the content related to the chat history.
[0150] 12 to the device 70. For example, instead of transmitting data indicating that the avatar of the first user is located at position A01 to the device 70, the server device 20 may transmit data indicating that the avatar of the first user is located near position A01 to the device 70.
[0151] Furthermore, when data including a message for the other of the device 70 and the second terminal 12 is received from one of the device 70 and the second terminal 12, the data including the message does not have to be transmitted to the other terminal 10. In this way, data exchanged between the second terminal 12 and the device 70 is not transmitted to any terminal 10 other than the second terminal 12. Therefore, when data transmitted and received between the second terminal 12 and the device 70 includes data related to personal information of a user operating the second terminal 12, it is possible to reduce the possibility that the personal information will be known to a user operating a terminal 10 other than the second terminal 12.
[0152] When the display unit 140 displays the display area 314 and users chat with each other, the user ID and the avatar 80 in the chat may or may not be linked to each other.
[0153] As described above, according to the present disclosure, first data regarding an avatar in a virtual space operated by a first user using a first terminal is acquired, a first display including the avatar is displayed on a display unit of the first terminal based on the first data, whether a first condition is met based on the first data is determined, and if it is determined that the first condition is met, the display unit is controlled to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located. In this way, when moving avatar 80A within virtual space 300, display unit 140 displays avatar 80A, allowing the first user to easily grasp the movement and / or position of avatar 80A being operated. On the other hand, when viewing content within virtual space 300, the user can optimize the display (content) in display area 311 and hide the avatar 80 operated by the user without performing complex operations, allowing the user to immerse themselves in viewing the content displayed in display area 311. Furthermore, display switching can be easily and appropriately performed even when an application of the present disclosure is executed using a terminal 10 with a relatively small display screen, such as a smartphone.
[0154] 5. Variations
[0155] 10 has been described as an example in which server device 20 performs the processes of S183 and S193 after S141, but the present invention is not limited thereto. For example, server device 20 may receive the first data from first terminal 11 before S131. As a result, server device 20 may perform the process of S183 before S131 and transmit the analysis data to device 70. Alternatively, for example, server device 20 may perform the process of S193 before S131 and transmit the advertising data to first terminal 11. In this manner, server device 20 can shorten the time between receiving the first data and transmitting the analysis data determined based on the received first data to device 70. Furthermore, the processes of first terminal 11, server device 20, and device 70 are not limited to being performed as a single series of steps on the same flowchart as in FIGS. 9 and 10 . The processes of first terminal 11, server device 20, and device 70 may be performed simultaneously as separate steps in parallel. The processes at S183 and S193 in Fig. 10 may be performed simultaneously in parallel with processes other than S183 and S193 described in Fig. 10. The processes at S183 and S193 in Fig. 11 may be performed simultaneously in parallel with processes other than S183 and S193 described in Fig. 11. For example, every time the first user performs an operation to move avatar 80A to display an object, the processes at S183 and S193 in Fig. 10 or 11 do not have to be performed as a series of operations, and every time the first user performs an operation to move avatar 80A, the processes at S183 and S193 in Fig. 10 or 11 do not have to be performed as a series of operations.
[0156] Furthermore, as shown in Fig. 13, a first sensor 102a, a second sensor 102b, a camera 102c, and a microphone 102d may be provided in addition to the terminal 10 shown in Fig. 3. Fig. 13 is a block diagram showing an example of the configuration of the terminal 10 and a connection to the terminal 10 shown in Fig. 3. Here, the terminal 10 is connected to each of the first sensor 102a, the second sensor 102b, the camera 102c, and the microphone 102d, for example, by wire or wirelessly.
[0157] The first sensor 102a is connected to the camera 102c, for example, by wire or wirelessly. The camera 102c may include, for example, an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The camera 102c may be, for example, a camera included in the True Depth camera of the iPhone X (registered trademark). The second sensor 102b is connected to the microphone 102d, for example, by wire or wirelessly. The first sensor 102a and the camera 102c may be provided as a single component. The second sensor 102b and the microphone 102d may be provided as a single component.
[0158] In this way, the terminal 10 may transmit an image captured by the camera 102c to the server device 20. The first terminal 11 may also transmit audio data input to the microphone 102d to the server device 20. The first terminal 11 may also transmit video data captured using the camera 102c and the microphone 102d to the server device 20.
[0159] 14 illustrates a generalized example of a suitable computing environment 1400 in which the embodiments, techniques, and technologies described herein, including transmitting and using tokens to render video in a computing environment, may be implemented. For example, the computing environment 1400 may implement any of a terminal device (or broadcaster, or viewer), a broadcast server system, etc., as described herein.
[0160] The computing environment 1400 is not intended to suggest any limitation as to the scope of use or functionality of the technology, as the technology may be implemented in a variety of general-purpose or special-purpose computing environments. For example, the technology disclosed herein may be implemented with a variety of other computer system configurations, including various handheld devices, various multiprocessor systems, various microprocessor-based or programmable consumer electronics, various network PCs, various minicomputers, various mainframe computers, etc. The technology disclosed herein may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
[0161] Referring to FIG. 14 , the computing environment 1400 includes at least one central processing unit 1410 and memory 1420. In FIG. 14 , this most basic configuration 1430 is included within the dashed line. The central processing unit 1410 executes computer-executable instructions and may be a real or virtual processor. In a multiprocessing system, multiple processors may operate simultaneously, with multiple processing units executing computer-executable instructions to increase processing power. The memory 1420 may be volatile memory (e.g., registers, cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory, etc.), or some combination of the two. The memory 1420 stores, for example, software 1480, various images, and videos that can implement the techniques described herein. The computing environment may also have a variety of additional functionality. For example, computing environment 1400 includes storage 1440, one or more input devices 1450, one or more output devices 1460, and one or more communication connections 1470. An interconnection mechanism (not shown), such as a bus, controller, or network, interconnects the various components of computing environment 1400. Typically, operating system software (not shown) provides an operating environment for other software executing in computing environment 1400 and coordinates various activities of the various components of computing environment 1400.
[0162] Storage 1440 may be removable or non-removable and may include magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or any other medium used to store information and that can be accessed within computing environment 1400. Storage 1440 stores instructions for software 1480, plug-in data, and messages that can be used to implement the techniques described herein.
[0163] The one or more input devices 1450 may be a keyboard, keypad, mouse, touchscreen display, touch input device such as a pen or trackball, voice input device, scanning device, or another device that provides input to the computing environment 1400. In the case of audio, the one or more input devices 1450 may be a sound card or similar device that accepts audio input in analog or digital form, or a CD-ROM reader that provides various audio samples to the computing environment 1400. The one or more output devices 1460 may be a display, printer, speakers, CD writer, or another device that provides output from the computing environment 1400.
[0164] The one or more communications connections 1470 enable communication to another computing entity over a communications medium (e.g., a connecting network). The communications medium conveys information such as computer-executable instructions, compressed graphics information, video, or other data embodied in a modulated data signal. The one or more communications connections 1470 include, but are not limited to, wired connections (e.g., megabit or gigabit Ethernet, InfiniBand, or Fibre Channel over electrical or optical fiber connections), wireless technologies (e.g., Bluetooth, WiFi (IEEE 802.11a / b / n), WiMax, cellular, satellite, laser, infrared, RF connections), and various other suitable communications connections for providing network connectivity to the various agents, bridges, and data consumers of the destination agent disclosed herein. In a virtual host environment, the one or more communications connections may be virtualized network connections provided by the virtual host.
[0165] Various embodiments of the various methods disclosed herein may be performed using computer-executable instructions that implement all or a portion of the techniques disclosed herein in the compute cloud 1490. For example, various agents may perform various vulnerability scanning functions in the computing environment, while agent platforms (e.g., bridges) and destination agent data consumer services may execute on various servers located within the compute cloud 1490.
[0166] Computer-readable media are any available media that can be accessed within computing environment 1400. By way of example, and not limitation, with respect to computing environment 1400, computer-readable media include memory 1420 and / or storage 1440. As will be readily understood, the term computer-readable media includes data storage media such as memory 1420 and storage 1440, and does not include transmission media such as various modulated data signals.
[0167] The various embodiments described above can be used in combination with each other unless a contradiction or inconvenience arises. Considering the many possible embodiments to which the principles of the invention disclosed herein can be applied, it should be understood that the illustrated embodiments are merely preferred examples and should not be considered to limit the scope of the claimed invention to these preferred examples. Indeed, the scope of the claimed invention is defined by the appended claims. Accordingly, we claim the grant of a patent as our invention for all inventions falling within the scope of the claimed inventions.
[0168] The computer program according to the first aspect is "a computer program executed by at least one processor, which causes the at least one processor to function as follows: acquire first data regarding an avatar in a virtual space operated by a first user using a first terminal; display a first display including the avatar on a display unit of the first terminal based on the first data; determine whether a first condition is met based on the first data; and, if it is determined that the first condition is met, control the display unit to switch from the first display to a second display based on a first position in the virtual space where the avatar is located."
[0169] A computer program according to a second aspect is "a computer program executed by at least one processor, causing the at least one processor to function as follows: receive, via a communication line, first data regarding an avatar in a virtual space operated using a first terminal of a first user; determine, based on the first data, first control data for controlling the display unit of the first terminal to display a first display including the avatar on the display unit of the first terminal; transmit the first control data to the first terminal via the communication line; after transmitting the first control data to the first terminal, determine, based on the first data, whether a first condition is met; if it is determined that the first condition is met, determine second control data for controlling the display unit to switch from the first display to a second display based on a first position in the virtual space where the avatar is located; and transmit the second control data to the first terminal via the communication line."
[0170] A computer program according to a third aspect is one in which, in the first or second aspect described above, "the first condition is that the first data includes operation data for selecting a portion of an area including the first position, the first data includes operation data for selecting an object to be displayed on the display unit, or the first data includes data indicating that the avatar is present within the first area."
[0171] The computer program according to a fourth aspect is the computer program according to any one of the first to third aspects described above, wherein "the second display does not include the avatar."
[0172] The computer program according to the fifth aspect is the same as in the third or fourth aspect described above, in which "the first condition is that the first data includes operation data for selecting an object to be displayed on the display unit, and the object is a virtual object on which the avatar can sit."
[0173] A computer program according to the sixth aspect is the same as in the third or fourth aspect described above, in which "the first condition is that the first data includes operation data for selecting an object to be displayed on the display unit, and the object is a display to be displayed on the display unit separately from the first display."
[0174] The computer program according to the seventh aspect is the computer program according to any one of the first to sixth aspects, wherein "at least one virtual venue, which is a space where videos are distributed, is provided within the virtual space."
[0175] The computer program according to the eighth aspect is either the seventh aspect dependent on the third aspect described above, or the seventh aspect dependent on the fourth aspect, in which "the first condition is that the first data includes operation data for selecting an object to be displayed on the display unit, and the object is the video."
[0176] The computer program according to the ninth aspect is either the seventh aspect dependent on the third aspect or the seventh aspect dependent on the fourth aspect, in which "the first condition is that the first data includes data indicating that the avatar is present within the first area, and the first area is an area within one of the at least one virtual venue."
[0177] A computer program according to a tenth aspect is one in any of the first to ninth aspects described above, wherein "the second display is an enlarged portion of the first display so that the proportion of the first display that portion occupies on the display unit is increased."
[0178] The computer program according to the eleventh aspect is the one according to the first to ninth aspects described above, which "displays, in the entire area of the display unit, a display corresponding to a virtual object existing in the virtual space when the first condition is satisfied."
[0179] A computer program according to a twelfth aspect is, in any of the first to eleventh aspects described above, such that "when the first display displays an operable virtual object used to instruct the movement of the avatar, if it is determined that the first condition is satisfied, the second display does not display the operable virtual object."
[0180] A computer program according to a thirteenth aspect is one in which, in any of the first to eleventh aspects described above, "when the first display displays a display area for displaying a message sent from at least one terminal including the first terminal, if it is determined that the first condition is satisfied, the second display does not display the display area."
[0181] A computer program according to a 14th aspect is, in any of the above-mentioned aspects 1 to 11, wherein "when the first display displays a display area for displaying a message sent from at least one terminal including the first terminal, if it is determined that the first condition is satisfied, the second display does not display the display area but displays an icon used to display the display area, and the icon is operated to display the display area."
[0182] A computer program according to a 15th aspect is one in any of the above-mentioned 1st to 14th aspects, in which "when the second display is displayed on the display unit, operation input related to the movement of the avatar is not accepted."
[0183] The computer program according to the 16th aspect is in the above-mentioned 1st aspect or any of the 3rd to 14th aspects subordinate to the 1st aspect, and "when the second display is displayed on the display unit and an input related to the movement of the avatar is obtained, controls the display unit to switch the display from the second display to the first display."
[0184] The computer program according to the 17th aspect is, in the above-mentioned 2nd aspect or any of the 3rd to 14th aspects dependent on the 2nd aspect, "causes the at least one processor to function so that, after transmitting the second control data to the first terminal via the communication line, when input related to the movement of the avatar is received from the first terminal, third control data for controlling the display unit to switch the display from the second display to the first display, and transmits the third control data to the first terminal via the communication line."
[0185] The computer program according to the 18th aspect is the 16th aspect dependent on the 12th aspect described above, or the 17th aspect dependent on the 12th aspect described above, in which "when the second display is displayed on the display unit and an input related to the movement of the avatar is obtained, the first display that is switched from the second display and displayed on the display unit displays the operable virtual object."
[0186] A computer program according to a 19th aspect is either the 16th aspect dependent on the 13th aspect described above, or the 17th aspect dependent on the 13th aspect described above, in which "when the second display is displayed on the display unit and an input related to the movement of the avatar is obtained, the first display that is switched from the second display and displayed on the display unit displays the display area."
[0187] The computer program according to the 20th aspect is the 16th aspect dependent on the 14th aspect described above, or the 17th aspect dependent on the 14th aspect described above, in which "when the second display is displayed on the display unit and an input related to the movement of the avatar is obtained, the first display switched from the second display and displayed on the display unit displays the display area but does not display the icon."
[0188] The computer program according to the 21st aspect is one in any of the above-mentioned aspects 1 to 20, wherein "the first data includes at least one of data regarding the avatar's behavioral history within the virtual space and data on the user operating the avatar."
[0189] The computer program according to the 22nd aspect is a 21st aspect dependent on the above-mentioned 7th aspect, in which "the data relating to the behavioral history includes at least any of data relating to the avatar's viewing history of watching the video, data relating to the avatar's viewing time of the video, data relating to the avatar's entry history into the virtual venue, data relating to the avatar's stay time in the virtual venue, data relating to the avatar's exit history from the virtual venue, data relating to the avatar's action history on virtual objects existing in the virtual space, data relating to the position of a first terminal to which a message is sent when the message is sent from one of the first terminal and a second terminal different from the first terminal to the other of the first terminal and the second terminal, data relating to the purchase history of the virtual object, and data relating to the position of the virtual object when the virtual object is available for sitting and the avatar sits on the virtual object."
[0190] A computer program according to a 23rd aspect is one in which, in any of the above-mentioned 1st to 22nd aspects, "the first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal."
[0191] The computer program according to the 24th aspect is the same as the 23rd aspect described above, in that it "determines whether or not the first data has been received, and if the first data has been received, transmits the first data to the third terminal."
[0192] A computer program according to a 25th aspect is the same as in either the 23rd or 24th aspect above, wherein "the period for receiving the first data is shorter than the period for determining the control data."
[0193] The computer program according to the 26th aspect is the one according to either the 23rd or 24th aspect above, in which "the third terminal is a first terminal operated by the operator or operating organization that operates the virtual venue."
[0194] The computer program according to a 27th aspect is the computer program according to any one of the first to 26th aspects described above, wherein "second data relating to an advertisement determined based on the first data is transmitted to the first terminal."
[0195] The computer program according to the 28th aspect is one in which, in any one of the first to 26th aspects, "data including a URL for accessing a database storing second data related to an advertisement determined based on the first data is sent to the first terminal."
[0196] A computer program according to a 29th aspect is the computer program according to any one of the first to 28th aspects, wherein "the virtual space is a three-dimensional space."
[0197] A computer program according to a thirtieth aspect is the computer program according to any one of the first to twenty-ninth aspects, wherein "the communication line includes the Internet."
[0198] The computer program according to the 31st aspect is any one of the above-mentioned aspects 1 to 30, wherein "the at least one processor includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)."
[0199] The computer program according to the 32nd aspect is the computer program according to any one of the first to 31st aspects, wherein "the at least one processor is installed in a server device, a smartphone, a tablet, a mobile phone, or a personal computer."
[0200] The method according to the 33rd aspect includes "a step of acquiring first data relating to an avatar in a virtual space operated using a first terminal of a first user; a step of displaying a first display including the avatar on a display unit of the first terminal based on the first data; a step of determining whether a first condition is met based on the first data; if it is determined that the first condition is met, a step of determining first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located; and a step of controlling the display unit based on the first control data."
[0201] The method according to the 34th aspect includes "a step of receiving, via a communication line, first data relating to an avatar in a virtual space operated using a first terminal of a first user; a step of determining, based on the first data, first control data for controlling the display unit of the first terminal to display a first display including the avatar on the display unit of the first terminal; a step of transmitting the first control data to the first terminal via the communication line; a step of determining, after transmitting the first control data to the first terminal, whether a first condition is satisfied based on the first data; a step of determining, if it is determined that the first condition is satisfied, first control data for controlling the display unit to switch from the first display to a second display based on a first position in the virtual space where the avatar is located; and a step of transmitting the second control data to the first terminal via the communication line."
[0202] The method according to the 35th aspect is the method according to the 33rd or 34th aspect, wherein "the communication line includes the Internet."
[0203] The method according to the 36th aspect is any one of the 33rd to 35th aspects, wherein "the at least one processor includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)."
[0204] A server device according to the 37th aspect "obtains first data regarding an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on a display unit of the first terminal based on the first data, determines whether a first condition is met based on the first data, and if it is determined that the first condition is met, determines first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located, and controls the display unit based on the first control data."
[0205] A server device according to a thirty-eighth aspect is the thirty-seventh aspect, wherein "the communication line includes the Internet."
[0206] The server device according to the 39th aspect is the same as the server device according to the 37th or 38th aspect, in which "the at least one processor includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)."
[0207] In this way, the technology disclosed herein can provide a computer program, a method, and a server device that prevent comfort from being compromised more than before. [Additional Notes] The claims of the parent application as originally filed are set forth below. [Claim 1] A computer program executed by at least one processor, comprising: acquiring first data relating to an avatar in a virtual space operated by a first user using a first terminal; displaying a first display including the avatar on a display unit of the first terminal based on the first data; determining whether a first condition is satisfied based on the first data; causing the at least one processor to function so as to control the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located when it is determined that the first condition is satisfied; The first condition is the first data includes operation data for operating another object different from the one object displayed on the display unit, The second representation is a part of the first display enlarged so that the proportion of the one object occupying the display unit is increased; Computer program. [Claim 2] A computer program executed by at least one processor, the computer program comprising: receiving, via a communication line, first data relating to an avatar in a virtual space operated by a first user using a first terminal; determining, based on the first data, first control data for controlling a display unit of the first terminal to display a first display including the avatar on the display unit; transmitting the first control data to the first terminal via the communication line; After transmitting the first control data to the first terminal, determine whether a first condition is satisfied based on the first data; when it is determined that the first condition is satisfied, determining second control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located; causing the at least one processor to transmit the second control data to the first terminal via the communication line; The first condition is the first data includes operation data for operating another object different from the one object displayed on the display unit, The second representation is a part of the first display enlarged so that the proportion of the one object occupying the display unit is increased; Computer program. [Claim 3] the second representation does not include the avatar; 3. A computer program according to claim 1 or claim 2. [Claim 4] At least one virtual venue is provided in the virtual space, where videos are distributed. The computer program according to any one of claims 1 to 3. [Claim 5] The one object is the video. 5. A computer program according to claim 4. [Claim 6] The first condition is Furthermore, the first data includes data indicating that the avatar is present within a first region; The first area is an area within one of the at least one virtual venues. 6. A computer program according to any one of claims 1 to 5. [Claim 7] When the first display displays an operable virtual object used to instruct movement of the avatar, if it is determined that the first condition is satisfied, the second display does not display the operable virtual object. 7. A computer program according to any one of claims 1 to 6. [Claim 8] When the first display displays a display area for displaying a message transmitted from at least one terminal including the first terminal, if it is determined that the first condition is satisfied, the second display does not display the display area. 8. A computer program according to claim 1. [Claim 9] When the first display displays a display area for displaying a message transmitted from at least one terminal including the first terminal, if it is determined that the first condition is satisfied, the second display does not display the display area but displays an icon used to display the display area, and the icon is operated to display the display area. 9. A computer program according to any one of claims 1 to 8. [Claim 10] When the second display is displayed on the display unit, no operation input related to movement of the avatar is accepted. 10. A computer program according to any one of claims 1 to 9. [Claim 11] When the second representation is displayed on the display unit and an input related to movement of the avatar is acquired, the display unit is controlled to switch the display from the second representation to the first representation. A computer program according to claim 1 or any one of claims 3 to 9 dependent on claim 1. [Claim 12] determining third control data for controlling the display unit to switch the display from the second display to the first display when an input related to movement of the avatar is received from the first terminal after transmitting the second control data to the first terminal via the communication line; causing the at least one processor to transmit the third control data to the first terminal via the communication line. A computer program according to claim 2 or any one of claims 3 to 9 dependent on claim 2. [Claim 13] When an input related to movement of the avatar is acquired while the second display is being displayed on the display unit, the first display that is switched from the second display and displayed on the display unit displays the operable virtual object. A computer program according to claim 11 dependent on claim 7 or claim 12 dependent on claim 7. [Claim 14] When an input related to movement of the avatar is acquired while the second display is being displayed on the display unit, the first display switched from the second display and displayed on the display unit displays the display area. A computer program according to claim 11 depending on claim 8 or claim 12 depending on claim 8. [Claim 15] When an input related to movement of the avatar is acquired while the second display is being displayed on the display unit, the first display switched from the second display and displayed on the display unit displays the display area but does not display the icon. A computer program according to claim 11 dependent on claim 9 or claim 12 dependent on claim 9. [Claim 16] The first data is The data includes at least one of data regarding the behavior history of the avatar in the virtual space and data of a user operating the avatar. 16. A computer program according to any one of claims 1 to 15. [Claim 17] The data on the behavioral history includes: The data includes at least one of data related to the avatar's viewing history of watching the video, data related to the avatar's viewing time for the video, data related to the avatar's entry history into the virtual venue, data related to the avatar's stay time in the virtual venue, data related to the avatar's exit history from the virtual venue, data related to the avatar's action history on virtual objects existing in the virtual space, data related to the position of a first terminal to which a message is sent when the message is sent from one of the first terminal and a second terminal different from the first terminal to the other of the first terminal and the second terminal, data related to the purchase history of the virtual object, and data related to the position of the virtual object when the virtual object is available for sitting and the avatar sits on the virtual object. A computer program according to claim 16 when dependent on claim 4. [Claim 18] the first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal; 18. A computer program according to any one of claims 1 to 17. [Claim 19] determining whether the first data has been received, and if the first data has been received, transmitting the first data to the third terminal; 19. A computer program according to claim 18. [Claim 20] The third terminal is a first terminal operated by an operator or operating organization that operates the virtual venue. A computer program according to claim 18 when dependent on claim 4 or claim 18 when dependent on claim 6. [Claim 21] second data relating to the advertisement determined based on the first data is transmitted to the first terminal; 21. A computer program according to any one of claims 1 to 20. [Claim 22] data including a URL for accessing a database storing second data relating to the advertisement determined based on the first data is transmitted to the first terminal; 21. A computer program according to any one of claims 1 to 20. [Claim 23] The virtual space is a three-dimensional space. 23. A computer program according to any one of claims 1 to 22. [Claim 24] The communication line includes the Internet. A computer program according to claim 2 or any one of claims 3 to 23 dependent on claim 2. [Claim 25] the at least one processor: including a central processing unit (CPU), microprocessor, and / or graphics processing unit (GPU); 25. A computer program according to any one of claims 1 to 24. [Claim 26] The at least one processor is installed in a server device, a smartphone, a tablet, a mobile phone, or a personal computer. 26. A computer program according to any one of claims 1 to 25. [Claim 27] 1. A method performed by at least one processor executing computer readable instructions, comprising: acquiring first data relating to an avatar in a virtual space operated by a first user using a first terminal; displaying a first display including the avatar on a display unit of the first terminal based on the first data; determining whether a first condition is satisfied based on the first data; determining, when it is determined that the first condition is satisfied, first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located; controlling the display unit based on the first control data; The first condition is the first data includes operation data for operating another object different from the one object displayed on the display unit, The second representation is a part of the first display enlarged so that the proportion of the one object occupying the display unit is increased; method. [Claim 28] 1. A method performed by at least one processor executing computer readable instructions, comprising: receiving, via a communication line, first data relating to an avatar in a virtual space operated by a first user using a first terminal; determining, based on the first data, first control data for controlling a display unit of the first terminal to display a first display including the avatar on the display unit; transmitting the first control data to the first terminal via the communication line; After transmitting the first control data to the first terminal, determining whether a first condition is satisfied based on the first data; determining, when it is determined that the first condition is satisfied, second control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located; transmitting the second control data to the first terminal via the communication line; The first condition is the first data includes operation data for operating another object different from the one object displayed on the display unit, The second representation is a part of the first display enlarged so that the proportion of the one object occupying the display unit is increased; method. [Claim 29] The communication line includes the Internet. 29. The method of claim 28. [Claim 30] the at least one processor: including a central processing unit (CPU), microprocessor, and / or graphics processing unit (GPU); The method according to any one of claims 27 to 29. [Claim 31] at least one processor; acquire, via a communication line, first data relating to an avatar in a virtual space operated by a first user using a first terminal; displaying a first display including the avatar on a display unit of the first terminal based on the first data, and determining whether a first condition is satisfied based on the first data; when it is determined that the first condition is satisfied, determining first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar is located; controlling the display unit based on the first control data; The first condition is the first data includes operation data for operating another object different from the one object displayed on the display unit, The second representation is a part of the first display enlarged so that the proportion of the one object occupying the display unit is increased; Server device. [Claim 32] The communication line includes the Internet. 32. The server device according to claim 31. [Claim 33] the at least one processor: including a central processing unit (CPU), microprocessor, and / or graphics processing unit (GPU); 33. The server device according to claim 31 or claim 32. [Explanation of symbols]
[0208] 2. Communication Network 10 devices 11 Terminal 1 12 Terminal 2 14, 24 central processing units 15, 25 Main memory 16, 26 input / output interface 17, 27 Input devices 18, 28 Auxiliary storage device 19, 29 Output device 20 Server device 21 First Server System 21A1 Distribution server device 21A2 Server storage device 22 Second Server System 70 equipment 80, 80A, 313 Avatar 81 Chair 102a First sensor 102b Second sensor 102c Camera 102d Microphone 104 Processing section 110 Communications Department 120 Acquisition Department 130 control section 140 Display section 150 User Interface Section 160 Storage section 210 Communications Department 220 Storage section 230 Control Unit 300 Virtual Space 301 Icon (area) 310 Virtual Venue 311, 312 display area 314 Display area 321 points 322 line segments 323 Icon 330 Slider 331 First Element 332 Second Element 1000 systems 1400 computing environment 1410 Processing Unit 1420 memory 1430 Configuration 1440 Storage 1450 Input Device 1460 Output Device 1470 communication connections 1480 Software Instructions 1490 Computational Cloud
Claims
1. A computer program executed by at least one processor, comprising: acquiring first data relating to an avatar in a virtual space operated by a first user using a first terminal; displaying a first display including an object that is a display area for displaying the avatar and predetermined content on a display unit of the first terminal based on the first data; When the number of avatars in the virtual space is equal to or greater than a predetermined number, or when a specific avatar is present in the virtual space, causing the target to start playing the predetermined content. Computer program.
2. A computer program executed by at least one processor, comprising: receiving, via a communication line, first data relating to an avatar in a virtual space operated by a first user using a first terminal from the first terminal; determining, based on the first data, first control data for controlling the display unit of the first terminal to display a first display including an object that is a display area for displaying the avatar and predetermined content on the display unit; transmitting the first control data to the first terminal via the communication line; When the number of avatars in the virtual space is equal to or greater than a predetermined number, or when a specific avatar is present in the virtual space, causing the target to start playing the predetermined content. Computer program.
3. determining whether a first condition is satisfied based on the first data; causing the at least one processor to function so as to control the display unit to switch the display from the first display to the second display when it is determined that the first condition is satisfied; 3. A computer program according to claim 1 or 2.
4. The first condition is the first data includes data indicating that a first position where the avatar is present is located in a first area within the virtual space; 4. A computer program according to claim 3.
5. The second representation is a part of the first display is enlarged so that the proportion of the object occupying the display portion is increased; 4. A computer program according to claim 3.
6. The computer program according to claim 3 , wherein the object enlarged at a predetermined magnification ratio in the second display is controlled so as to be adjustable to a magnification ratio adjusted by an operation of the first user.
7. When the first display displays an operable virtual object used to instruct movement of the avatar, if it is determined that the first condition is satisfied, the second display does not display the operable virtual object.
4. A computer program according to claim 3.
8. When the first display displays a display area for displaying a message transmitted from at least one terminal including the first terminal, if it is determined that the first condition is satisfied, the second display does not display the display area.
4. A computer program according to claim 3.
9. When the first display displays a display area for displaying a message transmitted from at least one terminal including the first terminal, if it is determined that the first condition is satisfied, the second display does not display the display area but displays an icon used to display the display area, and the icon is operated to display the display area.
4. A computer program according to claim 3.
10. When the second display is displayed on the display unit, no operation input related to movement of the avatar is accepted.
4. A computer program according to claim 3.
11. When the second display is displayed on the display unit and an input related to movement of the avatar is acquired, the display unit is controlled to switch the display from the second display to the first display.
4. A computer program according to claim 3.
12. when an input related to movement of the avatar is acquired while the second display is being displayed on the display unit, the first display that is switched from the second display and displayed on the display unit displays the operable virtual object.
8. A computer program according to claim 7.
13. When an input related to movement of the avatar is acquired while the second display is being displayed on the display unit, the first display switched from the second display and displayed on the display unit displays the display area.
9. A computer program according to claim 8.
14. when an input related to movement of the avatar is acquired while the second display is being displayed on the display unit, the first display switched from the second display and displayed on the display unit displays the display area but does not display the icon; 10. A computer program according to claim 9.
15. The first data is The data includes at least one of data regarding the behavior history of the avatar in the virtual space and data of a user operating the avatar.
3. A computer program according to claim 1 or 2.
16. the first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal; 3. A computer program according to claim 1 or 2.
17. At least one virtual venue is provided in the virtual space, which is a space where the predetermined content is distributed; The third terminal is a first terminal operated by an operator or operating organization that operates the virtual venue.
17. A computer program according to claim 16.
18. second data relating to the advertisement determined based on the first data is transmitted to the first terminal; 3. A computer program according to claim 1 or 2.
19. data including a URL for accessing a database storing second data relating to the advertisement determined based on the first data is transmitted to the first terminal; 3. A computer program according to claim 1 or 2.
20. The first condition is Furthermore, the first data includes data indicating that the avatar will sit in a predetermined chair; The chair is configured so that multiple avatars can sit on it at the same time.
5. A computer program according to claim 4.
21. 1. A method performed by at least one processor executing computer readable instructions, comprising: acquiring first data relating to an avatar in a virtual space operated by a first user using a first terminal; displaying a first display including an object that is a display area displaying the avatar and predetermined content on a display unit of the first terminal based on the first data; When the number of avatars in the virtual space is equal to or greater than a predetermined number, or when a specific avatar is present in the virtual space, causing the target to start playing the predetermined content. method.
22. 1. A method performed by at least one processor executing computer readable instructions, comprising: receiving, via a communication line, first data relating to an avatar in a virtual space operated by a first user using a first terminal from the first terminal; determining, based on the first data, first control data for controlling the display unit of the first terminal to display a first display including an object that is a display area for displaying the avatar and predetermined content; transmitting the first control data to the first terminal via the communication line; When the number of avatars in the virtual space is equal to or greater than a predetermined number, or when a specific avatar is present in the virtual space, causing the target to start playing the predetermined content. method.
23. at least one processor; acquire, via a communication line, first data relating to an avatar in a virtual space operated by a first user using a first terminal from the first terminal; displaying a first display including an object that is a display area for displaying the avatar and predetermined content on a display unit of the first terminal based on the first data; When the number of avatars in the virtual space is equal to or greater than a predetermined number, or when a specific avatar is present in the virtual space, causing the target to start playing the predetermined content. Server device.
Citation Information
Patent Citations
Advertisement distribution server and method for displaying advertisement viewed by user inside metaverse in web page
JP2010015333A
Data transfer device and method
JP2010529547A
User interface processor, user interface processing method, and user interface processing program
JP2011229716A
Program
JP2016140519A
Information processing unit, information processing method, and program
JP2018113616A