Computer programs, methods, and server devices
The described system addresses the lack of avatar display in virtual spaces by dynamically controlling the display based on user interaction and location, enhancing user experience in virtual environments.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- GLEE HOLDINGS CO LTD
- Filing Date
- 2026-03-10
- Publication Date
- 2026-06-30
Smart Images

Figure 2026108688000001_ABST
Abstract
Description
Technical Field
[0006] , , , , ,
[0001] The present disclosure relates to a computer program, a method, and a server device.
Background Art
[0002] Conventionally, when a user views content executed in a virtual space displayed on a terminal using the terminal, it is known to display an icon corresponding to another user who views the content in the virtual space (see Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, in the technique described in Patent Document 1, when the terminal used by the user displays a virtual space, the icon of the user is not displayed in the virtual space. Note that the above-mentioned Patent Document 1 is incorporated herein by reference in its entirety.
[0005] The present disclosure provides a computer program, a method, and a server device that appropriately display the terminal screen and enhance the user experience without performing more complex operations than in the prior art.
Means for Solving the Problems
[0006] The invention described in this specification may be collectively referred to as "the present invention". (1) One aspect of the present invention is a computer program executed by at least one processor, acquiring first data regarding an avatar in a virtual space operated using a first terminal of a first user, Based on the first data, the first display including the avatar is displayed on the display unit of the first terminal. Based on the aforementioned first data, it is determined whether or not the first condition is met. If it is determined that the first condition is met, the display unit is made to function so as to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located. (2) One aspect of the present invention is a computer program executed by at least one processor, The system receives first data regarding an avatar in a virtual space operated using the first terminal of the first user via a communication line. Based on the first data, first control data is determined to control the display unit so that the first display, including the avatar, is displayed on the display unit of the first terminal. The first control data is transmitted to the first terminal via the aforementioned communication line. After transmitting the first control data to the first terminal, it is determined whether or not the first condition is met based on the first data. If it is determined that the first condition is met, second control data is determined to control the display unit to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located. The at least one processor is configured to transmit the second control data to the first terminal via the communication line. (3) In one embodiment of the present invention, the first condition is: The first data includes operation data for selecting a part of the region including the first position, the first data includes operation data for selecting an object to be displayed on the display unit, or the first data includes data indicating that the avatar is located within the first region. (4) In one embodiment of the present invention, the second representation does not include the avatar. (5) In one embodiment of the present invention, the first condition is: The first data includes operation data for selecting an object to be displayed on the display unit, The aforementioned subject is, The aforementioned avatar is a virtual object that can be seated. (6) In one embodiment of the present invention, the first condition is: The first data includes operation data for selecting an object to be displayed on the display unit, The aforementioned subject is, This is a display that is shown on the display unit separately from the first display. (7) In one aspect of the present invention, at least one virtual venue is provided within the virtual space, which is a space where video is streamed. (8) In one embodiment of the present invention, the first condition is: The first data includes operation data for selecting an object to be displayed on the display unit, The subject in question is the aforementioned video. (9) In one embodiment of the present invention, the first condition is: The first data includes data indicating that the avatar is located within the first region. The first region is a region within one of the virtual venues, which is at least one of the virtual venues. (10) In one embodiment of the present invention, the second indication is The first display is enlarged so that the proportion of the first display that occupies the display area is increased. (11) In one aspect of the present invention, when the first condition is met, a display corresponding to a virtual object existing in the virtual space is displayed in the entire area of the display unit. (12) In one embodiment of the present invention, when the first display displays an operable virtual object used to instruct the movement of the avatar, the second display does not display the operable virtual object if it is determined that the first condition is met. (13) In one embodiment of the present invention, when the first display displays a display area for displaying a message transmitted from at least one terminal, including the first terminal, the second display does not display the display area if it is determined that the first condition is met. (14) In one embodiment of the present invention, when the first display displays a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area and displays an icon used for displaying the display area, and the icon is operated to display the display area. (15) In one aspect of the present invention, when the second display is displayed on the display unit, operation inputs relating to the movement of the avatar are not accepted. (16) In one aspect of the present invention, when the second display is displayed on the display unit, if input relating to the movement of the avatar is obtained, the display unit is controlled to switch the display from the second display to the first display. (17) In one aspect of the present invention, after transmitting the second control data to the first terminal via the communication line, if input regarding the movement of the avatar is obtained from the first terminal, the processor determines third control data to control the display unit to switch the display from the second display to the first display, and transmits the third control data to the first terminal via the communication line. (18) In one aspect of the present invention, when the second display is displayed on the display unit and input relating to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the operable virtual object. (19) In one embodiment of the present invention, when the second display is displayed on the display unit and input relating to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area. (20) In one embodiment of the present invention, when the second display is displayed on the display unit and input relating to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area but does not display the icon. (21) In one embodiment of the present invention, the first data is This includes at least one of the following: data relating to the avatar's activity history within the virtual space, and data relating to the user operating the avatar. (22) In one embodiment of the present invention, the data relating to the behavioral history is The data includes at least one of the following: data relating to the avatar's viewing history of watching the video; data relating to the avatar's viewing time of the video; data relating to the avatar's entry history into the virtual venue; data relating to the avatar's stay time in the virtual venue; data relating to the avatar's exit history from the virtual venue; data relating to the avatar's interaction history with virtual objects existing in the virtual space; data relating to the location of the first terminal to which a message is sent when one of the first terminal and a second terminal different from the first terminal sends the message to the other of the first terminal and the second terminal; data relating to the purchase history of the virtual object; and data relating to the location of the virtual object when the virtual object is seatable and the avatar is seated on the virtual object. (23) In one embodiment of the present invention, the first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal. (24) One aspect of the present invention determines whether or not the first data has been received, and if the first data has been received, transmits the first data to the third terminal. (25) In one embodiment of the present invention, the period for receiving the first data is shorter than the period for determining the control data. (26) In one embodiment of the present invention, the third terminal is a first terminal operated by the operator or operating organization that operates the virtual venue. (27) In one aspect of the present invention, second data regarding an advertisement determined based on the first data is transmitted to the first terminal. (28) In one aspect of the present invention, data including a URL for accessing a database that stores second data regarding an advertisement determined based on the first data is transmitted to the first terminal. (29) In one aspect of the present invention, the virtual space is a three-dimensional space. (30) One aspect of the present invention includes the communication line being the Internet. (31) In one aspect of the present invention, the at least one processor includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU). (32) In one aspect of the present invention, the at least one processor is mounted on a server device, a smartphone, a tablet, a mobile phone, or a personal computer. (33) One aspect of the present invention includes a step of obtaining first data regarding an avatar in a virtual space operated using a first terminal of a first user, a step of displaying a first display including the avatar on a display unit of the first terminal based on the first data, a step of determining whether a first condition is satisfied based on the first data, when it is determined that the first condition is satisfied, a step of determining first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, and a step of controlling the display unit based on the first control data. method. (34) One aspect of the present invention includes a step of receiving, via a communication line, first data regarding an avatar in a virtual space operated using a first terminal of a first user, a step of determining first control data for controlling the display unit to display a first display including the avatar on the display unit of the first terminal based on the first data, The steps include transmitting the first control data to the first terminal via the communication line, After transmitting the first control data to the first terminal, the process includes determining whether or not the first condition is met based on the first data, If it is determined that the first condition is met, the process involves determining first control data to control the display unit to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located, A method comprising the step of transmitting the second control data to the first terminal via the communication line. (35) In one aspect of the present invention, the communication line includes the Internet. (36) One aspect of the present invention is that the at least one processor is Central processing unit (CPU), microprocessor, and / or graphics processor Includes a single unit (GPU). (37) One aspect of the present invention involves acquiring first data relating to an avatar in a virtual space operated using a first terminal of a first user, Based on the first data, the first display including the avatar is displayed on the display unit of the first terminal, and it is determined whether or not the first condition is met based on the first data. If it is determined that the first condition is met, first control data is determined to control the display unit to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located. The display unit is controlled based on the first control data. Server device. (38) In one aspect of the present invention, the communication line includes the Internet. (39) One aspect of the present invention is that the at least one processor is Includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU).
[0007] A computer program according to one embodiment is a computer program executed by at least one processor, which causes the at least one processor to function such that it receives first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line, determines first control data to control a display unit to display a first display including the avatar on the display unit of the first terminal based on the first data, transmits the first control data to the first terminal via the communication line, determines whether a first condition is met based on the first data after transmitting the first control data to the first terminal, determines second control data to control the display unit to switch the display from the first display to the second display based on a first position in the virtual space where the avatar exists if the first condition is met, and transmits the second control data to the first terminal via the communication line.
[0008] A method according to one embodiment includes the steps of: acquiring first data relating to an avatar in a virtual space operated using a first terminal of a first user; displaying a first display including the avatar on the display unit of the first terminal based on the first data; determining whether or not a first condition is met based on the first data; determining first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is determined to be met; and controlling the display unit based on the first control data.
[0009] A method according to one embodiment includes the steps of: receiving first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line; determining first control data for controlling a display unit to display a first display including the avatar on the display unit of the first terminal based on the first data; transmitting the first control data to the first terminal via the communication line; determining whether a first condition is met based on the first data after transmitting the first control data to the first terminal; determining first control data for controlling the display unit to switch the display from a first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is met; and transmitting the second control data to the first terminal via the communication line.
[0010] A server device according to one embodiment acquires first data relating to an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on the display unit of the first terminal based on the first data, determines whether or not a first condition is met based on the first data, and if it is determined that the first condition is met, determines first control data that controls the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, and controls the display unit based on the first control data.
[0011] This [Summary of Invention] section is written to introduce various selected concepts in a simplified form, which will be described later in the [Modes for Carrying Out the Invention] section. All trademarks used herein are the property of their respective owners. The description in this [Summary of Invention] section is not intended to identify any important or essential features of the invention described in the claims, nor is it intended to limit the technical scope of the invention described in the claims. The above-mentioned or other purposes, features, and effects of the invention described in the claims will become clearer from the description in the [Modes for Carrying Out the Invention] section shown below with reference to the accompanying drawings. [Brief explanation of the drawing]
[0012] [Figure 1] Figure 1 is a block diagram showing an example of the configuration of system 1000 according to one embodiment. [Figure 2] Figure 2 is a block diagram showing an example of the configuration of the terminal 10 and server device 20 shown in Figure 1. [Figure 3] Figure 3 is a block diagram showing an example of the functions of terminal 10 shown in Figure 1. [Figure 4] Figure 4 is a block diagram showing an example of the functions of the server device 20 shown in Figure 1. [Figure 5] Figure 5 shows an example of a display shown on the display unit 140 of the terminal 10. [Figure 6] Figure 6 shows an example of a display shown on the display unit 140 of the terminal 10. [Figure 7] Figure 7 shows an example of a display shown on the display unit 140 of the terminal 10. [Figure 8] Figure 8 shows an example of a display shown on the display unit 140 of the terminal 10. [Figure 9] Figure 9 shows an example of a display shown on the display unit 140 of the terminal 10. [Figure 10] Figure 10 is an example of a flowchart showing the process performed in this embodiment. [Figure 11] Figure 11 is an example of a flowchart showing the process performed in this embodiment. [Figure 12] Figure 12 shows an example of data transmitted from terminal 10. [Figure 13] Figure 13 is a block diagram showing an example of the functions of the terminal 10 and the configuration connected to terminal 10 as shown in Figure 1. [Figure 14] Figure 14 is a block diagram of the computing environment 1400. [Modes for carrying out the invention]
[0013] This specification is written in the sense of a variety of representative embodiments, and is not intended to be limited in any way. As used in this application, singular nouns such as “one,” “the said,” “above,” “the said,” “this,” and “it” may include plural nouns unless explicitly indicated otherwise. The term “includes” may mean “equipped with” or “possessed.” Furthermore, the terms “combined,” “joined,” “linked,” “connected,” or “connected” encompass, along with other methods, of combining, connecting, or linking objects to one another, and do not exclude the existence of intermediate elements between such combined, combined, linked, connected, or connected objects.
[0014] The various systems, methods, and apparatus described herein should not be construed as limiting in any way. In practice, this disclosure is directed toward any novel features and aspects of each of the various embodiments disclosed, combinations of these various embodiments, and combinations of some of these various embodiments. The various systems, methods, and apparatus described herein are not limited to any particular aspects, particular features, or combinations of such particular aspects and particular features, and the things and methods described herein do not require that one or more particular effects exist or problems are solved. Furthermore, various features or aspects of the various embodiments described herein, or some of such features or aspects, may be used in combination with each other.
[0015] While the operation of some of the various methods disclosed herein is described in a particular order for convenience, this method of description should be understood to include the possibility of rearranging the order of the operations unless a particular order is required by the following specific sentences. For example, multiple operations described in order may, in some cases, be rearranged or performed simultaneously. Furthermore, for the sake of simplification, the accompanying drawings do not show various ways in which the various matters and methods described herein may be used in conjunction with other matters and methods. In addition, this specification may use terms such as “generate,” “generate,” “display,” “receive,” “evaluate,” and “deliver.” These terms are high-level descriptions of the various actual operations performed. The various actual operations corresponding to these terms may vary depending on the particular implementation and may be readily recognizable to a person skilled in the art who has an interest in the disclosure herein.
[0016] Any operating theories, scientific principles, or other theoretical descriptions presented herein in connection with the apparatus or method of this disclosure are provided for the purpose of better understanding and are not intended to limit the technical scope. The apparatus and method in the appended claims are not limited to apparatus and method that operate in the manner described by such operating theories.
[0017] Any of the various methods disclosed herein can be implemented using a plurality of computer-executable instructions stored on one or more computer-readable media (e.g., one or more optical media disks, a plurality of volatile memory components, or a plurality of non-volatile memory components, which are non-temporary computer-readable storage media), and can be executed on a computer. Here, the plurality of volatile memory components include, for example, DRAM or SRAM. The plurality of non-volatile memory components include, for example, hard drives and solid-state drives (SSDs). Furthermore, the computer includes any computer available on the market, including, for example, smartphones and other mobile devices having computing hardware. Any of the multiple computer-executable instructions for implementing the technologies disclosed herein, along with any data generated and used during implementations of the various embodiments disclosed herein, may be stored in one or more computer-readable media (e.g., non-temporary computer-readable storage media). Such multiple computer-executable instructions may, for example, be part of a separate software application, or part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may be executed, for example, on a single local computer (as an agent running on any suitable computer available on the market), or in a network environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more network computers.
[0018] For clarity, only specific selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the technologies disclosed herein are not limited to any particular computer language or program. For example, the technologies disclosed herein may be executed by software written in C, C++, Java, or any other preferred programming language. Similarly, the technologies disclosed herein are not limited to any particular computer or type of hardware. Specific details of preferred computers and hardware are well known and do not need to be described in detail herein.
[0019] Furthermore, any of the various embodiments of such software (including, for example, a plurality of computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or accessed remotely by preferred means of communication. Such preferred means of communication include, for example, the Internet, the World Wide Web, intranets, software applications, cables (including fiber optic cables), magnetic communications, electromagnetic communications (including RF communications, microwave communications, and infrared communications), electronic communications, or other such means of communication.
[0020] Various embodiments of the present invention will be described below with reference to the attached drawings. Note that common components in the drawings are denoted by the same reference numerals. Also, please note that components shown in one drawing may be omitted in another drawing for the sake of clarity. Furthermore, please note that the attached drawings are not necessarily drawn to an exact scale.
[0021] 1. Configuration of System 1000 Figure 1 is a block diagram showing an example of the configuration of a system 1000 according to one embodiment. As shown in Figure 1, the system 1000 includes, for example, a plurality of terminals 10 connected to a communication line (communication network) (not shown), and one or more server devices 20 connected to the communication line. The terminals 10 include a first terminal 11. The terminals 10 may further include a second terminal 12. The server devices 20 include, for example, a first server system 21 and a second server system 22.
[0022] Communication lines may include, but are not limited to, mobile phone networks, wireless networks (e.g., Bluetooth, WiFi (such as IEEE 802.11a / b / n), WiMAX, cellular, satellite, laser, infrared, RF connections), fixed telephone networks, the Internet, intranets, local area networks (LANs), wide area networks (WANs), and / or Ethernet networks.
[0023] 1-1. Terminal 10 Terminal 10 is connected to one or more server devices 20, for example, via a communication line. Terminal 10 is, for example, a smartphone, a tablet device, and / or a personal computer. Terminal 10 is configured to run a predetermined application, for example, by installing a predetermined application on it. Terminal 10 can also receive web pages (for example, HTML documents, or in some examples, HTML documents that encode executable code such as JavaScript or PHP code) from the server device 20 (second server system 22).
[0024] Hereafter, the user operating terminal 10 will be simply referred to as "user," and the user operating the first terminal 11 will be referred to as "first user." Also, Figure 1 shows an example in which the first terminal 11 is provided as part of multiple terminals 10, but is not limited to this. Multiple terminals 10 may include, for example, two or more terminals. Furthermore, in the following explanation, the first terminal 11 may be referred to as terminal 10.
[0025] 1-2. Server device 20 The first server system 21 includes a distribution server device 21A1 and a server storage device 21A2. The distribution server device 21A1 receives data from terminal 10 that is requested for an application to be executed on terminal 10. The distribution server device 21A1 also transmits data to terminal 10 that is used in the application to be executed on terminal 10, in response to the request. The server storage device 21A2 stores data that is transmitted from the distribution server device 21A1 to terminal 10. The server storage device 21A2 also stores data that the distribution server device 21A1 has received from terminal 10. The first server system 21 also transmits data to terminal 10 that is used in an application executed by terminal 10. The first server system 21 also transmits data received from terminal 10 to device 70.
[0026] While an example of terminal 10 executing an application has been described, the system is not limited to this. For example, a web browser installed on terminal 10 may be used to perform processing equivalent to executing the application. In this case, where a web browser installed on terminal 10 is used, the server device 20 may include a web server (not shown). If the server device 20 includes a web server (not shown), the web server transmits data related to an HTML document such as HTML5, terminal 10 displays the data related to the HTML document using the web browser, user instruction data is transmitted to terminal 10 (the web browser), and the server device 20 performs display control. By performing this display control, the server device 20 generates display data and transmits the display data to terminal 10 (the web browser). Display control may also be performed using a script such as JavaScript (registered trademark) in the web browser.
[0027] Furthermore, while Figure 1 illustrates an example in which the first server system 21 includes a distribution server device 21A1 and a server storage device 21A2, the system is not limited to this. For example, the first server system 21 may include other components in addition to the distribution server device 21A1 and the server storage device 21A2. In this case, the other components may have at least one of the functions of the distribution server device 21A1 and the server storage device 21A2. Alternatively, for example, the first server system 21 may be configured as a single component that includes the functions of both the distribution server device 21A1 and the server storage device 21A2.
[0028] The second server system 22 is a server that transmits content-related data to the terminal 10. Here, for example, we assume that a user operates the terminal 10 to run an application. In this case, if the second server system 22 receives a request for content-related data from the terminal 10 while the application is running, the second server system 22 transmits the content-related data to the terminal 10. The content-related data transmitted from the second server system 22 to the terminal 10 is, for example, video-related data.
[0029] 1-3.Equipment 70 Device 70 (third terminal) is, for example, a terminal operated by the operator or organization managing the virtual venue. Device 70 transmits predetermined data to the first server system 21 and receives predetermined data transmitted from the first server system 21. The specific configuration of device 70 will be described later.
[0030] 2. Hardware configuration of each device Next, we will describe an example of the hardware configuration of terminal 10 and server device 20.
[0031] 2-1. Hardware configuration of terminal 10 The hardware configuration examples for each terminal 10 will be explained with reference to Figure 2. Figure 2 is a block diagram showing an example of the hardware configuration of terminal 10 (server device 20) shown in Figure 1. In Figure 2, the reference numerals in parentheses are related to the server device 20, as will be explained later.
[0032] As shown in Figure 2, each terminal 10 includes, for example, a central processing unit 14, a main memory 15, an input / output interface device 16, an input device 17, an auxiliary storage device 18, and an output device 19. The components shown in Figure 2 are connected by a data bus and / or a control bus.
[0033] The central processing unit 14, referred to as the "CPU," performs calculations on the instructions and data stored in the main memory 15 and stores the results of those calculations in the main memory 15. Furthermore, the central processing unit 14 can control the input device 17, auxiliary storage device 18, output device 19, etc., via the input / output interface device 16. The terminal 10 may include one or more such central processing units 14.
[0034] The main memory 15, referred to as "memory," stores instructions and data received via the input / output interface device 16 from the input device 17, auxiliary storage device 18, and communication line 30 (server device 20, etc.), as well as the calculation results of the central processing unit 14. The main memory 15 may include, but is not limited to, computer-readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid state drive (SSD), magnetic tape, optical media). To make it easily understandable, the term "computer-readable recording medium" may include data storage media such as memory and storage, rather than transmission media such as modulated data signals, i.e., transient signals.
[0035] The input device 17 is a device that takes in data from an external source and includes, but is not limited to, a touch panel, buttons, a keyboard, a mouse, and / or sensors. The sensors may include, but are not limited to, one or more cameras and / or one or more microphones, as described later.
[0036] The auxiliary storage device 18 is a storage device with a larger capacity than the main memory device 15. It can store instructions and data (computer programs) that constitute the specific applications mentioned above (video distribution applications, video viewing applications, etc.) and web browser applications. Furthermore, the auxiliary storage device 18 can transmit these instructions and data (computer programs) to the main memory device 15 via the input / output interface device 16, under the control of the central processing unit 14. The auxiliary storage device 18 may include magnetic disk drives and / or optical disk drives, etc., without being limited to these.
[0037] The output device 19 may include, but is not limited to, a display device, a touch panel, and / or a printer device.
[0038] In this hardware configuration, the central processing unit 14 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 18 into the main memory device 15, and by performing calculations on the loaded instructions and data, it can control the output device 19 via the input / output interface device 16, or it can send and receive various data with other devices (e.g., a server device 20, other terminals 10) via the input / output interface device 16 and the communication line 2.
[0039] 2-2. Hardware configuration of server device 20 The hardware configuration examples for each server device 20 will also be explained with reference to Figure 2. For each server device 20 (the distribution server device 21A1 and the server storage device 21A2), it is possible to use the same hardware configuration as that of each terminal 10 described above. Therefore, the reference numerals for the components of each server device 20 are shown in parentheses in Figure 2.
[0040] As shown in Figure 2, each server device 20 mainly includes a central processing unit 24, main memory 25, input / output interface device 26, input device 27, auxiliary storage device 28, and output device 29. These devices are connected to each other by a data bus and / or control bus.
[0041] The central processing unit 24, main memory 25, input / output interface device 26, input device 27, auxiliary storage device 28, and output device 29 can be substantially identical to the central processing unit 14, main memory 15, input / output interface device 16, input device 17, auxiliary storage device 18, and output device 19 included in each of the terminals 10 described above.
[0042] In this hardware configuration, the central processing unit 24 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 28 into the main memory device 25, and by performing calculations on the loaded instructions and data, it can control the output device 29 via the input / output interface device 26, or it can send and receive various data with other devices (for example, each terminal 10) via the input / output interface device 26 and the communication line 2.
[0043] The server device 20 may include one or more microprocessors and / or graphics processing units (GPUs) in place of or together with the central processing unit 24.
[0044] 3. Functions of each device Next, examples of the functions of terminal 10 and server device 20 will be explained using Figures 3 and 4, respectively.
[0045] 3-1. Functions of Terminal 10 Figure 3 is a block diagram showing an example of the functions of the terminal 10 shown in Figure 1. As shown in Figure 3, the terminal 10 includes, for example, a communication unit 110, an acquisition unit 120, a control unit 130, a display unit 140, a user interface unit 150, and a storage unit 160.
[0046] (1) Communications Department 110 The communication unit 110 is used, for example, to transmit various data to the server device 20. The communication unit 210 is used, for example, to receive various data from the server device 20. The data received by the communication unit 210 is sent, for example, to the control unit 130.
[0047] (2) Acquisition section 120 The acquisition unit 120 acquires, for example, operation data related to operations from the user. The acquisition unit 120 also acquires, for example, data detected by various sensors. The data acquired by the acquisition unit 120 is sent, for example, to the control unit 130. The acquisition unit 120 performs, for example, the processing shown in S121 of Figure 10 and S121 of Figure 11, which will be described later. For example, the operation data may include one or more of the following data: • Data showing how the streamer swiped on the touchpad display. • Data showing which part of the touchpad display the streamer touched. • Data showing which objects the streamer tapped or clicked. • Data showing how the streamer dragged the touchpad display. • Other such operational data
[0048] The data acquired by the acquisition unit 120 may also be data related to non-operation (data indicating that no operation was performed), for example, data indicating that the terminal 10 was not operated during a specific time (specific period), and / or data indicating that a specific location within the virtual space 300 was not entered.
[0049] (3) Control unit 130 The control unit 130 performs various controls based on data received by the communication unit 110, for example. The control unit 130 also performs various controls based on data acquired by the acquisition unit 120. The control unit 130 performs, for example, the processes shown in S125 and S141 of Figure 10 and S125 and S141 of Figure 11, which will be described later.
[0050] (4) Display section 140 The display unit 140 displays content based on control data output from the control unit 130, for example. The display unit 140 displays, for example, a screen for selecting a predetermined application. The display unit 140 also displays, for example, a screen related to the virtual space when a predetermined application is selected and executed.
[0051] (5) User interface unit 150 The user interface unit 150 is for inputting various data used to run the application through user operations.
[0052] (6) Storage section 160 The memory unit 160 can store various data used to execute the application. The memory unit 160 stores data used to control the display unit 140. For example, the memory unit 160 stores module data used to generate the first user's avatar. However, the memory unit 160 is not limited to storing module data used to generate the first user's avatar, but may also store module data used to generate other avatars.
[0053] Module data, for example, is data related to the parts used to generate an avatar. Here, the parts used to generate an avatar include data for each part of the avatar (eyes, nose, mouth, eyebrows, skin color, hairstyle, hair color, clothing, body, etc.). The module data also includes data related to the ID assigned to each part used to generate the avatar. If the part of the avatar is the body, the data related to the part used to generate the avatar may include data subdivided according to body type, such as thin, slightly thin, normal, slightly overweight, overweight, etc.
[0054] Furthermore, when the display unit 140 displays an avatar 80 other than avatar 80A (another person's avatar), the server device 20 may transmit ID data used to generate the avatar 80 other than avatar 80A to the first terminal 11, and the first terminal 11 may construct the avatar 80 other than avatar 80A based on said ID data.
[0055] Furthermore, when the display unit 140 displays an avatar 80 other than avatar 80A (another person's avatar), the display unit 140 may display the avatar 80 other than avatar 80A by coloring it black, or it may display a choice of two avatars other than avatar 80A, one for men and one for women, using parts and / or colors determined based on the gender of the user corresponding to the avatar 80 other than avatar 80A (for example, male or female).
[0056] 3-2. Functions of Server Device 20 Figure 4 is a block diagram showing an example of the functions of the server device 20 shown in Figure 1. As shown in Figure 4, the server device 20 includes, for example, a communication unit 210, a storage unit 220, and a control unit 230.
[0057] (1) Communications Section 210 The communication unit 210 is used, for example, to transmit various data to the terminal 10. The communication unit 210 is also used, for example, to receive various data from the terminal 10. The data received by the communication unit 210 is sent to the control unit 230.
[0058] (2) Storage section 220 The memory unit 220 stores various data used for the execution of the application. For example, the memory unit 220 stores the first data transmitted from the first terminal 11. The first data transmitted from the first terminal 11 includes, for example, data related to the avatar 80A. The first data may also include data related to "behavior history". Details of the first data transmitted from the first terminal 11 and the data related to "behavior history" will be described later.
[0059] (3) Control unit 230 The control unit 230 performs various controls based on the data received by the communication unit 210, for example. The control unit 230 performs the processes shown in S183, S193 in Figure 10, S131 in Figure 11, S183 in Figure 11, and S193 in Figure 11, which will be described later.
[0060] Figure 5 shows an example of a display shown on the display unit 140 of the first terminal 11 when an application is launched by operating the first terminal 11. As shown in Figure 5, a virtual space 300 is displayed on the display unit 140. The virtual space 300 is, for example, a three-dimensional space. Within the virtual space 300, an avatar 80 and a virtual venue 310 are shown.
[0061] The avatar 80 is configured to be able to perform at least one of the following actions through user input: walking, running, and jumping. Furthermore, the avatar 80 is configured to be able to, for example, examine virtual objects, push virtual objects, pull virtual objects, lift virtual objects, sit on virtual objects, purchase virtual objects, and give items to virtual objects through user input. Here, virtual objects include, for example, avatars, doors, food items, admission tickets, chairs, and exhibits. When a user operates the avatar 80 using the terminal 10, data related to that operation is transmitted to the server device 20.
[0062] The operation described above, "examine the virtual object," displays a description of the virtual object on the display unit 140. The description of the virtual object includes, for example, at least one of the following: the name of the virtual object, the purpose of the virtual object, and the price of the virtual object. The description of the virtual object includes, for example, at least one of the following: text, images, and videos.
[0063] The operations described above—"pushing the virtual object," "pulling the virtual object," and "lifting the virtual object"—can be used to change the position of the virtual object within the virtual space 300.
[0064] The operation described above, "taking a seat on a virtual object," causes avatar 80 to take a seat on the virtual object. Note that avatar 80 may be configured to take a seat in a specific location other than the virtual object. Furthermore, when avatar 80 takes a seat on the virtual object, or when avatar 80 takes a seat in a specific location other than the virtual object, the display unit 140 may display a different display screen than the one displayed before avatar 80 took a seat (for example, a display screen without the UI operation unit or chat screen), or it may hide the user interface that existed before avatar 80 took a seat. When the display unit 140 displays a different display screen than the one displayed before avatar 80 took a seat, the display unit 140 may display the target screen in full screen.
[0065] The aforementioned "Purchase a virtual object" operation allows you to purchase a virtual object, for example. If the virtual object is wearable, Avatar 80 can change its appearance by wearing the purchased virtual object.
[0066] Of the avatars displayed on the display unit 140, avatars 80 other than the avatar 80 being operated may be avatars operated by the user, or they may be avatars whose actions within the virtual space 300 have been predetermined. Here, if an avatar 80's actions within the virtual space 300 have been predetermined, it means that the avatar 80 will operate as an NPC (Non-Player Character).
[0067] Furthermore, while the appearance of all avatars 80 shown in Figure 5 is identical, it is not limited to this. The appearance of avatar 80 may be determined based on data about the user operating avatar 80 or data about the ID associated with the parts of avatar 80 selected by the user. For example, if the user operating avatar 80 is male, the appearance of avatar 80 may be male. Also, for example, if the user operating avatar 80 is female, the appearance of avatar 80 may be female.
[0068] Furthermore, the actions of the avatar in the virtual space may change in conjunction with the user's actions. For example, if the user nods, the avatar in the virtual space may also nod. Here, the motion data may be acquired, for example, using a motion capture system. As will be readily understood by those skilled in the art who benefit from this disclosure, some examples of suitable motion capture systems that may be used with the apparatus and methods disclosed in this application include optical motion capture systems with or without passive or active markers, and inertial and magnetic non-optical systems. The motion data may be acquired using an image capture device (such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor) image sensor) coupled to a computer that converts the motion data into video or other image data.
[0069] When operating the avatar 80A shown in Figure 5, for example, the display unit 140 displays a screen like the one shown in Figure 6.
[0070] Figure 6 shows an example of what is displayed on the display unit 140 of terminal 10. Specifically, Figure 6 shows an example of what is displayed on the display unit 140 of the first terminal 11 when the first user operates avatar 80A using the first terminal 11. As shown in Figure 6, for example, the display unit 140 displays avatar 80, avatar 80A, and the virtual venue 310. Here, the display unit 140 displays the back of avatar 80A, and the line of sight of the first user operating the first terminal 11 and the line of sight of avatar 80A corresponding to the first user are in the same direction. The display unit 140 displays the area in the virtual space including avatar 80A, based on a virtual viewpoint located in front of the page of Figure 6 relative to avatar 80A. The display unit 140 displays the area in the virtual space that includes the direction of movement of avatar 80A. Note that the area in the virtual space displayed by the display unit 140 can be changed by operating avatar 80A using terminal 10. For example, by changing the direction of movement of the avatar 80A by 180 degrees using terminal 10, the area behind the avatar 80A in Figure 6 can be displayed. In this way, by operating the avatar 80A using terminal 10, the display unit 140 can display areas not shown in Figure 6. When a user operating the first terminal 11 operates the avatar 80A and the avatar 80A shown in Figure 6 is positioned inside the virtual venue 310, a display screen like that shown in Figure 7 will be displayed.
[0071] In Figure 6, when the first user operates the avatar 80A, the first terminal 11 acquires data, for example, regarding the position of the avatar 80A within the virtual space 300. Furthermore, the data acquired by the first terminal 11 regarding the position of the avatar 80A within the virtual space 300 is transmitted to the server device 20. The timing at which the first terminal 11 acquires the data regarding the position of the avatar 80A within the virtual space 300 can be arbitrary. Similarly, the timing at which the data acquired by the first terminal 11 is transmitted to the server device 20 can also be arbitrary.
[0072] Furthermore, any area of the display unit 140 of the first terminal 11 may be touch-operable. Also, the first terminal 11 may be equipped with an acceleration sensor (not shown), and when the first terminal 11 is operated, the display area and / or direction displayed by the display unit 140 may be changed based on the acceleration sensor.
[0073] Here, the "arbitrary area" mentioned above includes, for example, the icon 301 (area 301) and / or display area 314 in Figure 6. The icon 301 and / or display area 314 are user interfaces for performing predetermined display controls by touch operations. "Touch operation" refers to at least one of the following operations: tap, double tap, swipe, flick, pinch in, and pinch out. The icon 301 and / or display area 314 may be displayed in the same or different positions not only when displaying Figure 6, but also when displaying other drawings described later (for example, at least one of Figures 7 to 9).
[0074] Furthermore, as shown in Figure 6, there may be two icons 301, or there may be one or more icons 301. In the case where there are two or more icons 301, one icon 301 corresponds to an area used to make the avatar 80A walk, for example, and the other icons 301 correspond to an area used to make the avatar 80A jump. In this way, the avatar 80A can be made to walk or jump by touching the icons 301.
[0075] Here, the touch operation to make avatar 80A walk or jump is, for example, tapping or double-tapping icon 301 of avatar 80A. Furthermore, the area where the touch operation to make avatar 80A walk or jump is performed may be an area other than icon 301.
[0076] The display area 314 is an area that displays messages entered by a user corresponding to an avatar 80. When the display unit 140 displays the display area 314, at least one of the following messages is displayed: a message sent from the first terminal 11, and a message sent from a terminal other than the first terminal. Here, the message displayed in the display area 314 may be a message addressed to the first terminal, or the message displayed in the display area 314 may be a message exchanged between terminals other than the first terminal. Therefore, the display area 314 functions as an area that can be viewed and / or chatted with by a user corresponding to at least one avatar 80 existing in the virtual space 300, or an area that can be viewed and / or chatted with by a user corresponding to at least one avatar 80 existing in a specific location within the virtual space 300.
[0077] In this way, the first terminal 11 allows the first user to chat with a user corresponding to at least one of the avatars 80 from among all the avatars 80 via the display area 314 of the display unit 140. For example, the first terminal 11 allows the first user to chat with users corresponding to all avatars 80 present within a predetermined area (the same area) via the display area 314 of the display unit 140. Here, the user chatting with the first user is either an individual user or an exhibiting company. Furthermore, when displaying multiple messages in the display area 314, if it is not possible to display all messages within the display area 314, the user can perform a touch operation to display the messages not currently displayed in the display area 314. Here, the touch operation when it is not possible to display all messages within the display area 314 is, for example, a swipe.
[0078] Furthermore, the conditions under which the display area 314 is displayed on the display unit 140 are not limited to when the avatar 80 is located within the virtual venue 310. For example, if the avatar 80 is located within a predetermined area in the virtual space 300, the display area corresponding to that predetermined area may be displayed on the display unit 140. In other words, the display area to be displayed on the display unit 140 may be determined according to the location where the avatar 80 is located. This allows the user to exchange messages with users corresponding to other avatars 80 located in the same area as their own avatar 80. In addition, the user can chat with users who share specific attributes. Therefore, the user can easily communicate with other users who share common interests, concerns, and / or attributes.
[0079] Furthermore, the terminal from which the message displayed in the display area 314 originates is, for example, a terminal used by a user operating an avatar located within the virtual venue 310. However, the avatar corresponding to the terminal from which the message displayed in the display area 314 originates may or may not be displayed in the virtual venue 310.
[0080] Furthermore, the display area 314 may display purchasable products. These products may, for example, be related to the operator or organization that operates the virtual venue 310. The display area 314 may also display information about the products and information encouraging the purchase of the products. Here, the information encouraging the purchase of the products may be a display such as "Add to cart" and may be selectable.
[0081] Furthermore, when a user uses terminal 10 to proceed with the purchase procedure for at least one product displayed in display area 314, for example, a browser installed on terminal 10 is launched, and a page requesting input of information used to purchase the product is displayed on display unit 140.
[0082] Furthermore, as shown in Figure 6, for example, when the user taps or double-tap point 321, the display unit 140 displays a line segment 322 connecting the avatar 80A and point 321, and the avatar 80A walks along the line segment 322 to point 321. Note that point 321 and line segment 322 may be any color. The touch operation to make the avatar 80A walk involves changing the direction of movement by flicking any area of the avatar 80A, and then tapping or double-tapping any point on the virtual straight line of the changed direction of movement.
[0083] Furthermore, as shown in Figure 6, for example, the display unit 140 may display an icon 323. The icon 323 is used to switch the display of the display area 314 on and off when operated. When the display area 314 is displayed by operating the icon 323, the display unit 140 does not have to display the icon 323, or it may continue to display the icon 323.
[0084] Figure 7 shows an example of a display screen in the virtual venue 310 displayed on the display unit 140 of terminal 10. In Figure 7, a user operating terminal 11 operates avatar 80A, and when avatar 80A, shown in Figure 6, is positioned inside the virtual venue 310, the scene changes, and the display screen changes as a result. Note that the URL when displaying the screen when avatar 80A is outside the virtual venue 310 (for example, Figure 6) using the web browser of terminal 11 is different from the URL when displaying the screen when avatar 80A is inside the virtual venue 310 (for example, Figure 7) using the web browser of terminal 11. Therefore, when using the web browser of terminal 11, the URL will change when avatar 80A, shown in Figure 6, is positioned inside the virtual venue 310. As shown in Figure 7, avatar 80, avatar 80A, chair 81, display area 311, display area 312, avatar 313, and slider 330 are shown. Note that the slider 330 is not a required component. Here, the virtual venue 310 is, for example, a booth at an exhibition or event venue. At least one chair 81 is provided. Avatars 80 and avatar 80A are assumed to be located in the first area within the virtual venue 310.
[0085] Chair 81 is, for example, a virtual object on which avatar 80 can sit. For example, if a user operates avatar 80A to approach a specific chair among several chairs 81 and performs a predetermined operation, avatar 80 will sit on chair 81. Alternatively, if a user operates avatar 80A to approach a specific chair among several chairs 81 and performs a predetermined operation, a message asking whether to sit on the specific chair will be displayed on the display screen of the first terminal 11. When a message asking whether to sit on the specific chair is displayed on the display screen of the first terminal 11, if the user operates terminal 10 to perform a predetermined operation indicating their intention to sit on the specific chair in response to the message, avatar 80 will sit on chair 81. In addition, a configuration may be adopted in which avatar 80 is seated when a specific location in the virtual space 300 is specified, either together with a seatable virtual object or in place of a seatable virtual object. In this case, if a user approaches a specific location in the virtual space 300 and performs a predetermined operation, a message asking whether to sit on the specific location may be displayed on the display screen of the first terminal 11. When a message asking whether the user wants to sit in a specific location is displayed on the display screen of the first terminal 11, the avatar 80 may be configured to sit in the specific location if the user operates terminal 10 to perform a predetermined operation indicating their intention to sit in the specific location in response to the message.
[0086] Display area 311 displays, for example, explanatory materials and / or videos. Display area 312 displays the name of the organization operating the virtual venue 310, the theme of the briefing session, etc. Avatar 313 is, for example, an avatar modeled after the staff running the virtual venue 310. Avatar 313 may be an avatar operated by the user, or it may be an avatar whose actions within the virtual space 300 are predetermined. Here, if avatar 80 operates according to predetermined actions within the virtual space 300, it means that the avatar operates as an NPC as described above.
[0087] In the virtual venue 310, at a predetermined time, for example, a predetermined explanation begins. Here, the time used in the virtual space may be a time synchronized to be the same as the real time, or it may be a time used in the virtual space 300 separately from the real time. Note that the conditions for the predetermined explanation to begin in the virtual venue 310 do not have to be related to time. For example, the conditions for the predetermined explanation to begin in the virtual venue 310 may be, for example, when the number of avatars present in the virtual venue 310 exceeds a predetermined number, or when a specific avatar is located within the virtual venue 310.
[0088] Furthermore, the system may be configured so that multiple avatars can occupy the same seat at the same time. For example, if avatar 80 is seated in the chair 81 on the left side of Figure 7, the user may use terminal 10 to operate avatar 80A and have avatar 80A sit in the chair 81 on the left side of Figure 7. In this way, even if the total number of avatars located in the virtual venue 310 exceeds the total number of chairs 81, all avatars viewing the content displayed in the display area 311 can be seated in the virtual venue 310.
[0089] A predetermined explanation, which begins at a predetermined time, is provided by displaying predetermined content in the display area 311 and / or outputting sound. The explanation is, for example, a video. The video is, for example, one of the following: a predetermined explanatory video, an event video such as a concert, a video such as a movie, or a video that reflects the movements and / or performance of a Vtuber in real time. If the explanation is a video, terminal 10 requests video data from the second server system 22. The second server system 22 then sends video data to terminal 10 in response to the request. As a result, terminal 10 can receive video data from the second server system 22 and watch the video.
[0090] In Figure 7, when avatar 80A satisfies a predetermined condition (first condition), the display unit 140 displays Figure 8 or Figure 9 instead of Figure 7. As a result, the display unit 140 displays information related to a first-person shooter (FPS) perspective instead of a third-person shooter (TPS) perspective. In other words, the display unit 140 displays information that does not include avatar 80A instead of information that includes avatar 80A.
[0091] Here, the "first condition" mentioned above means, for example, that the first data includes operation data for selecting a part of a region including the first position, that the first data includes operation data for selecting an object to be displayed on the display unit 140, or that the first data includes data indicating that the avatar 80A is located within the first region. For example, if the first region is a predetermined region within the virtual venue 310, then the "data indicating that the avatar 80A is located within the first region" mentioned above is data indicating that the position of the avatar 80A within the virtual venue 310 is located within that predetermined region.
[0092] Specifically, the "first condition" means, for example, being located in a predetermined position or a predetermined area within the virtual venue 310. Here, the "predetermined area" refers to, for example, an area within a predetermined distance within the virtual venue 310 based on the display area 311. The "first condition" may also mean, for example, specifying the display area 311. The "first condition" may also mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81. The "first condition" may also mean, for example, being located in a predetermined position or a predetermined area within the virtual venue 310 AND specifying the display area 311. The "first condition" may also mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81 AND specifying the display area 311.
[0093] As shown in Figure 8, the display unit 140 displays an enlarged portion of the virtual venue 310 shown in Figure 7. The display unit 140 may enlarge and display the display area 311 shown in Figure 7, or it may enlarge and display objects other than the display area 311 shown in Figure 7. Also, in Figure 8, the display unit 140 does not display, for example, the avatar 80A. Also, in Figure 8, the icon 301 may or may not be displayed. Also, in Figure 8, the display area 314 may or may not be displayed. Also, in Figure 8, the icon 323 may or may not be displayed. Also, in Figure 8, the slider 330 may or may not be displayed.
[0094] As shown in Figure 9, the display unit 140 displays an enlarged portion of the virtual venue 310 shown in Figure 7. Specifically, the display unit 140 displays the display area 311 over approximately the entire display screen.
[0095] Furthermore, the display unit 140 displays, for example, an icon 301 (area 301). Icon 301 is an icon for switching from the screen in Figure 9 to another screen. Here, "another screen" refers to, for example, any of the screens in Figures 6 to 8. Icon 301 is, for example, the same as the icon 301 shown in Figure 6. The functions assigned to icon 301 in Figure 6 and icon 301 in Figure 9 are configured to differ, for example, depending on the screen displayed by the display unit 140.
[0096] For example, when the display unit 140 displays icon 301 on a third-person view (TPS) screen as shown in Figure 6 or Figure 7, operating icon 301 will cause the avatar 80A to walk or jump, as described above. Also, for example, when the display unit 140 displays icon 301 on a first-person view (FPS) screen as shown in Figure 9, operating icon 324 will cause the avatar 80A to leave its seat. Here, causing the avatar 80A to leave its seat means that the display unit 140 will display information related to the third-person view (TPS) shown in Figure 6 or Figure 7 instead of the first-person view (FPS) shown in Figure 9. Note that when the display unit 140 displays icon 301 on a screen like the one shown in Figure 9, operating icon 324 may switch to a display screen like the one shown in Figure 8.
[0097] The display unit 140 may enlarge and display the display area 311 shown in Figure 7, or it may enlarge and display objects other than the display area 311 shown in Figure 7. Therefore, the magnification ratio of the display area 311 in Figure 9 is greater than the magnification ratio of the display area 311 in Figure 8. Also, in Figure 9, the display unit 140 does not display, for example, the avatar 80A. Also, in Figure 9, area 301 may or may not be displayed. Also, in Figure 9, display area 314 may or may not be displayed. Also, in Figure 9, icon 323 may or may not be displayed. Also, in Figure 9, slider 330 may or may not be displayed.
[0098] Here, by displaying the display area 314 in Figure 8 and / or Figure 9, users can communicate with other users through the display area 314 while viewing the content displayed in the display area 311. If the content of the message from the other user displayed in the display area 314 relates to the content displayed in the display area 311, the first user can exchange messages with the other user, giving the first user the feeling that they are viewing the content displayed in the display area 314 together with the other user, even if the first user is physically separated from the other user.
[0099] On the other hand, by hiding the display area 314 in Figure 8 and / or Figure 9, the first user can concentrate more on viewing the content displayed in the display area 311. Also, by hiding the display area 314 in Figure 8, in cases where a message displayed in the display area 314 may contain information related to the content in the display area 311, the first user can reduce the possibility of unintentionally grasping information related to the content through the display area 314 before viewing the content.
[0100] Furthermore, by displaying icon 323 in Figure 8 and / or Figure 9, the display and hiding of display area 314 can be switched on and off without requiring complex operations while viewing content displayed in display area 311. Also, by displaying icon 323 in Figure 8 and / or Figure 9, before starting to view content displayed in display area 311 or after finishing viewing, the first user can operate icon 323 to display display area 314 and communicate with other users, and while viewing content displayed in display area 311, the first user can operate icon 323 to hide display area 314 and view the content displayed in display area 311. Here, when the first user hides display area 314 by operating icon 323 and views content displayed in display area 311, as described above, the first user can concentrate more on viewing the content displayed in display area 311. Furthermore, when the display area 314 is hidden by operating icon 323 and the first user views the content displayed in display area 311, as described above, if the message displayed in display area 314 may contain information related to the content in display area 311, the possibility that the first user may unintentionally grasp the content through display area 314 before viewing the content can be reduced.
[0101] On the other hand, by hiding the icon 323 in Figure 8, when the display area 311 is enlarged by performing an operation such as pinching on the display unit 140 after displaying Figure 8, the possibility of the icon 323 overlapping with a part of the display area 311 can be reduced. Therefore, for example, when the first user is viewing content displayed in the display area 311 and enlarges the display area 311, and text appears in a part of the display area 311, the possibility of the text becoming illegible due to overlapping with the display position of the icon 323 can be reduced. Also, by hiding the icon 323 in Figure 9, the possibility of the icon 323 overlapping with a part of the display area 311 can be reduced. Therefore, for example, when the first user is viewing content displayed in the display area 311 and text appears in a part of the display area 311, the possibility of the text becoming illegible due to overlapping with the display position of the icon 323 can be reduced.
[0102] Furthermore, by displaying the slider 330 in Figure 8 and / or Figure 9, the magnification of the display area 311 can be intuitively fine-tuned. Therefore, for example, if the magnification of the display area 311 when transitioning from Figure 7 to Figure 8 or Figure 9 is predetermined, the first user can intuitively fine-tune it to the desired magnification.
[0103] On the other hand, by hiding the slider 330 in Figure 8, when the display area 311 is enlarged by performing an operation such as pinching in on the display unit 140 after displaying Figure 8, the possibility of a part of the display area 311 overlapping with the slider 330 can be reduced. Therefore, for example, when a first user is viewing content displayed in the display area 311 and enlarges the display area 311, and text appears in a part of the display area 311, the possibility of the text becoming invisible due to overlapping with the display position of the slider 330 can be reduced. Also, by hiding the slider 330 in Figure 9, the possibility of a part of the display area 311 overlapping with the slider 330 can be reduced. Therefore, for example, when a first user is viewing content displayed in the display area 311 and text appears in a part of the display area 311, the possibility of the text becoming invisible due to overlapping with the display position of the slider 330 can be reduced.
[0104] Thus, when the first condition described above is met, the display unit 140 can display Figure 8 or Figure 9 instead of Figure 7. Therefore, the user can optimize the display (content) of the display area 311 and hide the avatar 80 operated by the user, without having to perform complex operations such as repeatedly pinching in on the display area 311 of the display unit 140 to fine-tune the zoom level, or repeatedly pinching in and then pinching out to fine-tune the zoom level if it has been excessively zoomed in. This allows the user to immerse themselves in viewing the content displayed in the display area 311, and also allows for easy and appropriate switching of displays even when running the application of this disclosure on a terminal 10 with a relatively small display screen, such as a smartphone.
[0105] When changing from the representation in Figure 7 to the representation in Figure 8, the representation in Figure 7 may correspond to the "first representation" in this disclosure, and the representation in Figure 8 may correspond to the "second representation" in this disclosure. When changing from the representation in Figure 7 to the representation in Figure 9, the representation in Figure 7 may correspond to the "first representation" in this disclosure, and the representation in Figure 9 may correspond to the "second representation" in this disclosure.
[0106] In addition, in the state shown in Figure 8 or Figure 9, the system may be configured to accept the operation to move the avatar 80A, or it may be configured not to accept the operation to move the avatar 80A. If the system is configured not to accept the operation to move the avatar 80A in the state shown in Figure 8 or Figure 9, for example, if a video is displayed in the display area 311 and the user is watching the video, it is possible to prevent the avatar 80A from moving if the user accidentally performs an operation to move the avatar 80A. In this way, even if the user accidentally performs an operation to move the avatar 80A, it is possible to prevent the avatar 80A from moving and the display unit 140 from ceasing to display a part of the display area 311.
[0107] Furthermore, at least one of the operations to change from the display in Figure 9 to the display in Figure 7, the operation to change from the display in Figure 9 to the display in Figure 8, and the operation to change from the display in Figure 8 to the display in Figure 7 may, for example, be an operation to make the seated avatar 80A leave the chair 81.
[0108] Furthermore, at least one of the operations to change from the display in Figure 9 to the display in Figure 7, the operation to change from the display in Figure 9 to the display in Figure 8, and the operation to change from the display in Figure 8 to the display in Figure 7 may be, for example, an operation in which the user taps, double-tap, swipe, flicks, pinches in, or pinches out of area 301, or an operation in which a specific icon such as icon 323 is specified (touched).
[0109] Furthermore, at least one of the operations to change from the display in Figure 9 to the display in Figure 7, the operation to change from the display in Figure 9 to the display in Figure 8, and the operation to change from the display in Figure 8 to the display in Figure 7 may be, for example, an operation in which the user taps, double-tap, swipe, flicks, pinches in, or pinches out of the display area 311, or an operation in which a specific icon such as icon 323 is specified (touched).
[0110] Furthermore, at least one of the operations to change from the display in Figure 9 to the display in Figure 7, the operation to change from the display in Figure 9 to the display in Figure 8, and the operation to change from the display in Figure 8 to the display in Figure 7 may be performed, for example, by the user operating the slider 330.
[0111] Furthermore, if at least one of the following operations is performed—changing from the display in Figure 9 to the display in Figure 7, changing from the display in Figure 9 to the display in Figure 8, or changing from the display in Figure 8 to the display in Figure 7—the display unit 140 may choose not to display the icon 323 instead of displaying the display area 314.
[0112] The following describes the case in which the display unit 140 displays the slider 330 superimposed on the virtual venue 310. The slider 330 is, for example, an operating user interface including a first element 331 and a second element 332. The first element 331 is configured to slide on the second element 332. The display unit 140 displays the slider 330 in, for example, at least one of Figures 7 to 9.
[0113] As the first element 331 is displaced from left to right on the second element 332, the display unit 140 enlarges and displays a portion of the virtual venue 310. Conversely, as the first element 331 is displaced from right to left on the second element 332, the display unit 140 shrinks and displays a portion of the virtual venue 310. In this way, when the display unit 140 displays the display screens shown in Figures 7 to 9, the user can adjust the magnification of a portion of the virtual venue 310.
[0114] When the display unit 140 displays Figure 8 instead of Figure 7 due to the fulfillment of the "first condition" described above, the display unit 140 may display Figure 8 such that, for example, the first element 331 is located approximately in the center of the second element 332. Also, when the display unit 140 displays Figure 9 instead of Figure 7 due to the fulfillment of the "first condition" described above, the display unit 140 may display Figure 9 such that, for example, the first element 331 is located at the rightmost end of the second element 332.
[0115] 4. Operation of System 1000 The operation of system 1000 will be described with reference to Figures 10 and 11. Figures 10 and 11 are flowcharts showing an example of an operation performed using system 1000 as shown in Figure 1.
[0116] First, referring to Figure 10, we will explain S111 to S193 in order.
[0117] In S111, the first user operates the first terminal 11 to launch the application. Subsequently, in S121, the first terminal 11 acquires the first data.
[0118] Here, the first data includes, for example, data relating to an avatar in a virtual space operated using the first user's terminal. The first data may also include user operation data and operation history data, for example, data relating to the position of the first user's avatar. Furthermore, the first data may also include, for example, data relating to the activity history of the avatar in the virtual space operated using the first user's terminal.
[0119] In S125, the first terminal 11 performs a first display control process. Here, the first display control process refers to the process of displaying a screen like the one in Figure 7 when, for example, a user operating the first terminal 11 operates an avatar 80A and the avatar 80A shown in Figure 6 is located inside the virtual venue 310.
[0120] In S131, the first terminal 11 performs a first determination process. Here, the first determination process determines whether the first data satisfies a predetermined condition (first condition). If the first terminal 11 determines in S131 that the first condition is satisfied, it determines the control data to control the display unit 140 of the first terminal 11, and the process in S141 is executed. On the other hand, if the first terminal 11 determines in S131 that the first condition is not satisfied, the process in S131 is repeated.
[0121] The first condition in S131 is, for example, being located in a predetermined position or a predetermined area within the virtual venue 310. Here, "predetermined area" refers to, for example, within a predetermined distance from the display area 311. Also, "first condition" here may mean, for example, specifying the display area 311. Also, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81. Also, "first condition" may mean, for example, being located in a predetermined position or a predetermined area within the virtual venue 310, and specifying the display area 311. Also, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81, and specifying the display area 311.
[0122] In S141, the first terminal 11 performs a process (second display control process) to control its display unit 140 based on the control data. As a result, the display unit 140 of the first terminal 11 displays Figure 8 or Figure 9 instead of Figure 7. After S141, the first terminal 11 transmits the first data to the server device 20. Alternatively, the first terminal 11 may transmit the first data to the server device 20 before S141.
[0123] In S183, the server device 20 determines the analysis data based on the first data. The server device 20 then transmits the determined analysis data to the instrument 70. For example, each time the server device 20 receives the first data, it determines the analysis data and transmits the determined analysis data to the instrument 70.
[0124] In S193, the server device 20 determines advertising data based on the first data. This advertising data is data determined based on the first data and includes data for the first user operating the first terminal 11. In S193, the server device 20 transmits the determined advertising data for the first user to the first terminal 11.
[0125] Next, referring to Figure 11, we will explain S111 to S193 in order.
[0126] In S111, the first user launches the application by operating the first terminal 11. Subsequently, in S121, the first terminal 11 acquires the first data.
[0127] Here, the first data includes, for example, data relating to an avatar in a virtual space operated using the first user's terminal. The first data may also include user operation data and operation history data, for example, data relating to the position of the first user's avatar. Furthermore, the first data may also include, for example, data relating to the activity history of the avatar in the virtual space operated using the first user's terminal.
[0128] After S121, the first terminal 11 transmits the first data to the server device 20. In S122, the server device 20 receives the first data and generates first control data based on the first data. The server device 20 also transmits the first control data to the first terminal 11.
[0129] In S125, the first terminal 11 performs a first display control process. Here, the first display control process refers to the process of displaying a screen like the one in Figure 7 when, for example, a user operating the first terminal 11 operates an avatar 80A and the avatar 80A shown in Figure 6 is located inside the virtual venue 310.
[0130] In S131, the server device 20 performs a first determination process. Here, the first determination process determines whether the first data satisfies a predetermined condition (first condition). In S131, if the server device 20 determines that the first condition is satisfied, it determines second control data to control the display unit 140 of the first terminal 11 and transmits the second control data to the first terminal 11, and the process in S141 is executed. On the other hand, in S131, if the first terminal 11 determines that the first condition is not satisfied, the process in S131 is repeated.
[0131] The first condition in S131 is, for example, being located in a predetermined position or a predetermined area within the virtual venue 310. Here, "predetermined area" refers to, for example, within a predetermined distance from the display area 311. Also, "first condition" here may mean, for example, specifying the display area 311. Also, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81. Also, "first condition" may mean, for example, being located in a predetermined position or a predetermined area within the virtual venue 310, and specifying the display area 311. Also, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81, and specifying the display area 311.
[0132] In S141, the first terminal 11 performs a process (second display control process) to control its display unit 140 based on the second control data. As a result, the display unit 140 of the first terminal 11 displays Figure 8 or Figure 9 instead of Figure 7.
[0133] In S183, the server device 20 determines the analysis data based on the first data. The server device 20 then transmits the determined analysis data to the instrument 70. For example, each time the server device 20 receives the first data, it determines the analysis data and transmits the determined analysis data to the instrument 70.
[0134] In S193, the server device 20 determines advertising data based on the first data. This advertising data is data determined based on the first data and includes data for the first user operating the first terminal 11. In S193, the server device 20 transmits the determined advertising data for the first user to the first terminal 11.
[0135] Furthermore, with respect to S193 in Figure 10 and S193 in Figure 11, if the avatar 80 has a history of entering a virtual venue 310 where an event is held by a predetermined operating organization and watching a video played in the virtual venue 310, the advertising data transmitted to the first terminal 11 may include, for example, data regarding announcements about future events to be held by the predetermined operating organization. This data includes at least one of text data, image data, and video data.
[0136] Furthermore, with respect to S193 in Figure 10 and S193 in Figure 11, the advertising data described above may include, for example, data that includes a URL to access a database that stores second data relating to advertisements determined based on the first data. Also, the advertising data described above may have already been downloaded into the app (application) by batch processing or the like. In this case, the server device 20 may send data relating to an ID corresponding to the data to be transmitted to the first terminal 11, and the first terminal 11 may display the advertising data based on that ID.
[0137] Figure 12 shows an example of data transmitted from terminal 10. In Figure 12, the server device 20 receives various types of data from each terminal 10 when the first user, second user, and third user each operate their avatar using their own terminal 10. Here, the various types of data include, for example, data related to "age," "gender," "current location," "virtual object," "chat history," and "content viewing history," "part ID," and "simplified avatar." Here, "part ID" is, for example, data used to identify an avatar. "Simplified avatar" is, for example, data related to ID patterns corresponding to gender, including male and female.
[0138] The first data mentioned above may include, for example, at least one of the contents relating to the first user in Figure 12.
[0139] Here, regarding the "age" mentioned above, Figure 12 shows an example where the first user is 21 years old, the second user is 31 years old, and the third user is 41 years old.
[0140] Furthermore, regarding the "gender" mentioned above, Figure 12 shows an example where the first user's avatar is male, the second user's avatar is female, and the third user's avatar is male.
[0141] Furthermore, regarding the "current location" mentioned above, Figure 12 shows an example where the avatar operated by the first user is located at location A01, the avatar operated by the second user is located at location B01, and the avatar operated by the third user is located at location C01.
[0142] Furthermore, regarding the "virtual object" mentioned above, Figure 12 shows an example in which the avatar operated by the first user purchases virtual object A12 at price A13 at time A11, the avatar operated by the second user opens virtual object B12 at time B11, and the avatar operated by the third user acquires virtual object C12 at time C11. Virtual object B22 is, for example, a door.
[0143] Furthermore, regarding the "chat history" mentioned above, Figure 12 shows an example where the first user's terminal sends the message "Hello" to the third user's terminal at time A21 and location A22, the second user has no chat history with any other users, and the third user's terminal receives the message "Hello" from the first user's terminal at time C21 and location C22.
[0144] Furthermore, regarding the "content viewing history" mentioned above, Figure 12 shows an example where the first user's avatar stands up at location A32 at time A31 and begins viewing content, the second user's avatar watches content for two hours at seat B33 at location B32 at time B31, and the third user's avatar finishes viewing content at location C32 at time C31 and leaves seat C33.
[0145] Regarding the "age" mentioned above, examples of how to indicate a user's age have been described, but the system is not limited to these examples. For example, the "age" mentioned above may indicate the age group to which the user belongs. For example, if Category 1 is defined as being between 21 and 30 years old, the system may indicate that the first user's age belongs to Category 1. Also, for example, if Category 2 is defined as being between 31 and 40 years old, the system may indicate that the second user's age belongs to Category 2. Also, for example, if Category 3 is defined as being between 41 and 50 years old, the system may indicate that the third user's age belongs to Category 3. In this way, for example, when analysis data is determined in S183 of Figure 9 or S183 of Figure 10 and transmitted to the device 70, the age-related data can be used for marketing purposes without transmitting the user's specific personal information to the device 70.
[0146] Furthermore, regarding the "current location" mentioned above, an example showing the avatar's position at a specific time has been described, but it is not limited to this. For example, it may include data showing the trajectory the avatar moved within the virtual space 300 within a predetermined period.
[0147] Furthermore, regarding the "chat history" described above, an example was explained in which the first user sends the message "Hello" to the third user's terminal at time A21 and location A22, but the content of the message is not limited to this. Also, data sent from one user's terminal to another user's terminal may include at least one of the following: text, emojis, voice messages, images, and videos.
[0148] Furthermore, the first data shown in Figure 12 is not limited to the example described above and may also include data related to "behavioral history". Data related to "behavioral history" may include, for example, the time when avatar 80 entered the virtual venue 310, the time when avatar 80 left the virtual venue 310, the time when avatar 80 stayed in the virtual venue 310, the time when avatar 80 started viewing the object displayed in the display area 311 in the virtual venue 310, the time (period) when avatar 80 viewed the object displayed in the display area 311 in the virtual venue 310, the time when avatar 80 finished viewing the object displayed in the display area 311 in the virtual venue 310, the time when avatar 80 sat down in the chair 81, and avatar The data may include at least one of the following: the time when tar 80 left chair 81, the time from when avatar 80 sat down on chair 81 until it left, the location data of chair 81 when avatar 80 sat down on chair 81, a history of received data including messages received by a user operating one terminal 10 from a terminal 10 operated by a user operating another terminal 10, and a history of sent data including messages sent by a user operating one terminal 10 to a terminal 10 operated by a user operating another terminal 10.
[0149] Furthermore, the server device 20 may select which of the contents described in Figure 12 to send to the device 70. For example, if the data to be sent to the device 70 includes the contents related to the chat history described in Figure 12, the server device 20 may send to the device 70 the data excluding the contents related to the chat history from the contents described in Figure 12.
[0150] Furthermore, the server device 20 may transmit data to the device 70 that has been modified to include at least a portion of the information shown in Figure 12. For example, instead of transmitting data to the device 70 indicating that the first user's avatar is located at location A01, the server device 20 may transmit data to the device 70 indicating that the first user's avatar is located near location A01.
[0151] Furthermore, when receiving data containing a message from either device 70 or the second terminal 12, it is not necessary to transmit the data containing the message to the other terminal 10. In this way, the data exchanged between the second terminal 12 and device 70 is not transmitted to any terminal 10 other than the second terminal 12. Therefore, if the data transmitted and received between the second terminal 12 and device 70 includes data relating to the personal information of the user operating the second terminal 12, the possibility of such personal information being known to a user operating a terminal 10 other than the second terminal 12 can be reduced.
[0152] Furthermore, when the display unit 140 displays the display area 314 and users chat with each other, the user ID and avatar 80 in the chat may be linked to each other, or they may not be linked to each other.
[0153] As described above, according to this disclosure, first data relating to an avatar in a virtual space operated using a first terminal of a first user is acquired, a first display including the avatar is displayed on the display unit of the first terminal based on the first data, a determination is made based on the first data as to whether or not a first condition is met, and if it is determined that the first condition is met, the display unit is controlled to switch the display from the first display to the second display based on the first position in the virtual space where the avatar exists. In this way, when the avatar 80A is moved in the virtual space 300, the display unit 140 displays the avatar 80A, so the first user can easily grasp the movement and / or position of the avatar 80A being operated. On the other hand, when viewing content in the virtual space 300, the user can optimize the display (content) in the display area 311 and hide the avatar 80 being operated by the user without performing complex operations, allowing the user to immerse themselves in viewing the content displayed in the display area 311, and even when running the application of this disclosure using a terminal 10 with a relatively small display screen such as a smartphone, display switching can be easily and appropriately performed.
[0154] 5. Variations
[0155] In Figure 10, an example is shown in which the server device 20 performs the processes of S183 and S193 after S141, but the process is not limited to this. For example, the server device 20 may receive the first data from the first terminal 11 before S131. This allows the server device 20 to perform the process of S183 before S131 and transmit the analysis data to the device 70. Alternatively, for example, the server device 20 may perform the process of S193 before S131 and transmit the advertising data to the first terminal 11. In this way, the server device 20 can reduce the time between receiving the first data and transmitting the analysis data determined based on the received first data to the device 70. Furthermore, the processes of the first terminal 11, the server device 20, and the device 70 are not limited to being performed as a single flow on the same flowchart as shown in Figures 9 and 10, but the processes of the first terminal 11, the server device 20, and the device 70 may be performed simultaneously as separate steps. The processes in S183 and S193 in Figure 10 may be performed concurrently with other processes shown in Figure 10. Similarly, the processes in S183 and S193 in Figure 11 may be performed concurrently with other processes shown in Figure 11. For example, each time the first user moves the avatar 80A to display a target, the processes in S183 and S193 in Figure 10 or Figure 11 do not necessarily have to be performed as a series of operations. Furthermore, the processes S183 and S193 in Figure 10 or Figure 11 do not necessarily have to be performed as a series of operations each time the first user moves the avatar 80A.
[0156] Furthermore, as shown in Figure 13, in addition to the terminal 10 shown in Figure 3, a first sensor 102a, a second sensor 102b, a camera 102c, and a microphone 102d may also be provided. Figure 13 is a block diagram showing an example of the terminal 10 and the configuration connected to the terminal 10 shown in Figure 3. Here, the terminal 10 and each of the first sensor 102a, second sensor 102b, camera 102c, and microphone 102d are connected, for example, by wire or wireless.
[0157] The first sensor 102a is connected to the camera 102c, for example, by wire or wireless. The camera 102c may include, for example, an RGB camera that images visible light and a near-infrared camera that images near-infrared light. The camera 102c can be, for example, one included in the True Depth camera of the iPhone X (registered trademark). The second sensor 102b is connected to the microphone 102d, for example, by wire or wireless. The first sensor 102a and the camera 102c may also be provided in a single configuration. The second sensor 102b and the microphone 102d may also be provided in a single configuration.
[0158] In this way, terminal 10 may transmit images captured by camera 102c to server device 20. Also, first terminal 11 may transmit audio data input to microphone 102d to server device 20. Also, first terminal 11 may transmit video data using camera 102c and microphone 102d to server device 20.
[0159] Figure 14 shows a generalized example of a suitable computing environment 1400 in which embodiments, techniques, and technologies described herein may be implemented, including transmitting and using tokens to render video in the computing environment. For example, the computing environment 1400 may implement a terminal device (or broadcaster, or viewer), or a broadcast server system, as described herein.
[0160] Because the technology can be implemented in a variety of general-purpose or dedicated computing environments, computing environment 1400 is not intended to imply any limitations on the use or scope of the technology. For example, the technology disclosed herein may be implemented in a variety of other computer system configurations, including a variety of portable devices, a variety of multiprocessor systems, a variety of microprocessor-based or programmable home appliances, a variety of network PCs, a variety of minicomputers, a variety of mainframe computers, and so on. The technology disclosed herein may also be implemented in a distributed computing environment in which tasks are performed by remote processing units linked over a communication network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
[0161] Referring to Figure 14, the computing environment 1400 includes at least one central processing unit 1410 and memory 1420. In Figure 14, this most basic configuration 1430 is enclosed within the dashed line. The central processing unit 1410 executes instructions that can be executed by the computer, and the central processing unit 1410 may be a real processor or a virtual processor. In a multiprocessing system, multiple processors can operate simultaneously so that multiple processing units execute instructions that can be executed by the computer to improve processing power. The memory 1420 may be volatile memory (e.g., registers, cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory, etc.), or several combinations of these two. The memory 1420 stores, for example, software 1480, various images, and videos, which can implement the technologies described herein. The computing environment may have various additional functions. For example, the computing environment 1400 includes storage 1440, one or more input devices 1450, one or more output devices 1460, and one or more communication connections 1470. Interconnection mechanisms such as buses, controllers, or networks (not shown) interconnect the various components of the computing environment 1400. Typically, operating system software (not shown) provides an operating environment for other software running on the computing environment 1400 and coordinates the various activities of the various components of the computing environment 1400.
[0162] The storage 1440 may or may not be removable and includes magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or any other media used to store information and accessible within the computing environment 1400. The storage 1440 stores instructions for software 1480, plug-in data, and messages, which may be used to implement the technology described herein.
[0163] One or more input devices 1450 may be a keyboard, keypad, mouse, touchscreen display, pen, or trackball, a touch input device, an audio input device, a scanning device, or another device that provides input to the computing environment 1400. In the case of audio, one or more input devices 1450 may be a sound card or similar device that accepts analog or digital audio input, or various audio systems. It may be a CD-ROM reader that provides a sample to the computing environment 1400. One or more output devices 1460 may be a display, printer, speaker, CD writer, or another device that provides output from the computing environment 1400.
[0164] One or more communication connections 1470 enable communication to another computing entity via a communication medium (e.g., a connected network). The communication medium transmits information such as instructions executable by a computer, compressed graphics information, video, or other data contained in modulated data signals. One or more communication connections 1470 are not limited to wired connections (e.g., megabit or gigabit Ethernet, InfiniBand, or Fibre Channel via electrical or optical fiber connections), but include wireless technologies (e.g., Bluetooth, WiFi (IEEE 802.11a / b / n), WiMAX, cellular, satellite, laser, infrared, RF connections), and various other suitable communication connections for providing network connectivity to various agents, various bridges, and various data consumers of destination agents disclosed herein. In a virtual host environment, one or more communication connections may be virtualized network connections provided by a virtual host.
[0165] Various embodiments of the various methods disclosed herein may be executed in the compute cloud 1490 using a number of instructions executable by computers implementing all or part of the technologies disclosed herein. For example, various agents can perform various vulnerability scanning functions in the compute environment, while the agent platform (e.g., a bridge) and consumer services for destination agent data can be executed on various servers located within the compute cloud 1490.
[0166] Computer-readable media are any available media that can be accessed within the computing environment 1400. For example, with respect to the computing environment 1400, computer-readable media include memory 1420 and / or storage 1440. For ease of understanding, the term computer-readable media includes data storage media such as memory 1420 and storage 1440, but does not include transmission media such as modulated data signals.
[0167] The various embodiments described above can be used in combination with each other, as long as no contradictions or inconveniences arise. Considering the many possible embodiments to which the principles of the invention disclosed herein can be applied, it should be understood that the various embodiments described are merely preferred examples and should not be considered to limit the technical scope of the claimed invention to these preferred examples. In practice, the technical scope of the claimed invention is defined by the attached claims. Therefore, we request a patent for all things that fall within the technical scope of the invention described in the claims, as our invention.
[0168] The computer program according to the first embodiment is a computer program executed by at least one processor, which acquires first data relating to an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on the display unit of the first terminal based on the first data, determines whether or not a first condition is met based on the first data, and, if it is determined that the first condition is met, controls the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, thereby causing the at least one processor to function in this manner.
[0169] The computer program according to the second embodiment is a computer program executed by at least one processor, which causes the at least one processor to function such that it receives first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line, determines first control data for controlling a display unit to display a first display including the avatar on the display unit of the first terminal based on the first data, transmits the first control data to the first terminal via the communication line, determines whether a first condition is met based on the first data after transmitting the first control data to the first terminal, determines second control data for controlling the display unit to switch the display from a first display to a second display based on a first position in the virtual space where the avatar exists if the first condition is met, and transmits the second control data to the first terminal via the communication line.
[0170] A computer program according to a third embodiment is, in the first or second embodiment described above, "the first condition is that the first data includes operation data for selecting a part of a region including the first position, the first data includes operation data for selecting an object to be displayed on the display unit, or the first data includes data indicating that the avatar is located within the first region."
[0171] The computer program according to the fourth embodiment is such that, in any of the first to third embodiments described above, "the second representation does not include the avatar."
[0172] A computer program according to a fifth embodiment is, in the third or fourth embodiment described above, wherein "the first condition includes operation data for selecting an object to be displayed on the display unit, and the object is a virtual object on which the avatar can sit."
[0173] A computer program according to the sixth embodiment is, in the third or fourth embodiment described above, "the first condition includes operation data for selecting an object to be displayed on the display unit, wherein the object is a display that is displayed on the display unit separately from the first display."
[0174] The computer program according to the seventh embodiment is such that, in any of the first to sixth embodiments, "at least one virtual venue is provided within the virtual space, which is a space where video is distributed."
[0175] The computer program according to the eighth aspect is, in either the seventh aspect dependent on the third aspect or the seventh aspect dependent on the fourth aspect described above, "the first condition is that the first data includes operation data for selecting an object to be displayed on the display unit, and the object is the video."
[0176] A computer program according to the ninth aspect is, in either the seventh aspect dependent on the third or the seventh aspect dependent on the fourth described above, "the first condition is that the first data includes data indicating that the avatar is in the first area, and the first area is an area in one of the at least one virtual venues."
[0177] A computer program according to the tenth embodiment is, in any of the first to ninth embodiments described above, "the second display is an enlargement of a part of the first display such that the proportion of the part of the first display occupies the display unit is increased."
[0178] The computer program according to the 11th embodiment is such that, in the first to 9 embodiments described above, "when the first condition is met, it displays a representation corresponding to a virtual object existing in the virtual space in the entire area of the display unit."
[0179] A computer program according to the twelfth embodiment is such that, in any of the first to eleventh embodiments described above, "when the first display displays an operable virtual object used to instruct the movement of the avatar, and it is determined that the first condition is met, the second display does not display the operable virtual object."
[0180] The computer program according to the 13th embodiment is such that, in any of the first to 11 embodiments described above, "when the first display displays a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area."
[0181] A computer program according to the 14th embodiment is such that, in any of the first to 11 embodiments described above, "when the first display displays a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area and displays an icon used for displaying the display area, and the icon is operated to cause the display area to be displayed."
[0182] The computer program according to the 15th embodiment is, in any of the first to 14 embodiments described above, "does not accept operation inputs relating to the movement of the avatar when the second display is displayed on the display unit."
[0183] The computer program according to the 16th embodiment, in any of the first or third to 14th embodiments subordinate to the first described above, "controls the display unit to switch the display from the second display to the first display when input relating to the movement of the avatar is obtained while the second display is displayed on the display unit."
[0184] The computer program according to the 17th embodiment, in any of the second or third to 14th embodiments subordinate to the second described above, "determines a third control data to control the display unit to switch the display from the second display to the first display when, after transmitting the second control data via the communication line to the first terminal, input regarding the movement of the avatar is obtained from the first terminal, and transmits the third control data via the communication line to the first terminal, thereby causing the at least one processor to function in this manner."
[0185] The computer program according to the 18th embodiment, in the 16th or 17th embodiment dependent on the 12th embodiment described above, "when the second display is displayed on the display unit and input relating to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the operable virtual object."
[0186] A computer program according to the 19th embodiment, in either the 16th embodiment subordinate to the 13th embodiment described above, or the 17th embodiment subordinate to the 13th embodiment described above, "when the second display is displayed on the display unit and input relating to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area."
[0187] A computer program according to the 20th embodiment, in the 16th or 17th embodiment dependent on the 14th embodiment described above, "when the second display is displayed on the display unit and input relating to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area but does not display the icon."
[0188] The computer program according to the 21st embodiment is, in any of the first to 20 embodiments described above, wherein "the first data includes at least one of the following: data relating to the avatar's activity history within the virtual space, and data relating to the user operating the avatar."
[0189] A computer program according to the 22nd aspect, in the 21st aspect subordinate to the 7th aspect described above, "the data relating to the behavioral history includes at least one of the following: data relating to the viewing history of the avatar viewing the video; data relating to the viewing time of the avatar viewing the video; data relating to the avatar's entry history into the virtual venue; data relating to the avatar's stay time in the virtual venue; data relating to the avatar's exit history from the virtual venue; data relating to the history of actions taken by the avatar on virtual objects existing in the virtual space; data relating to the location of the first terminal to which a message is sent when one of the first terminal and a second terminal different from the first terminal sends the message to the other of the first terminal and the second terminal; data relating to the purchase history of the virtual object; and data relating to the location of the virtual object when the virtual object is available for seating and the avatar is seated on the virtual object."
[0190] The computer program according to the 23rd embodiment is such that, in any of the first to 22 embodiments described above, "the first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal."
[0191] The computer program according to the 24th aspect is, in the 23rd aspect described above, "determines whether or not the first data has been received, and if the first data has been received, transmits the first data to the third terminal."
[0192] The computer program according to the 25th embodiment is such that, in either the 23rd or 24th embodiment described above, "the period for receiving the first data is shorter than the period for determining the control data."
[0193] The computer program according to the 26th aspect is such that, in either the 23rd or 24th aspect described above, "the third terminal is a first terminal operated by the operator or operating organization that operates the virtual venue."
[0194] A computer program according to the 27th embodiment is one in which, in any of the first to 26 embodiments described above, "second data relating to an advertisement determined based on the first data is transmitted to the first terminal."
[0195] A computer program according to the 28th aspect is one in which, in any of the first to 26 aspects, "data including a URL for accessing a database storing second data relating to an advertisement determined based on the first data is transmitted to the first terminal."
[0196] A computer program according to the 29th aspect is one in which, according to any of the 1st to 28th aspects, "the virtual space is a three-dimensional space."
[0197] The computer program according to the 30th aspect is one in which "the communication line includes the Internet" in any of the 1st to 29th aspects.
[0198] A computer program according to the 31st aspect is one in which, in any of the first to 30 aspects described above, "the at least one processor includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)."
[0199] The computer program according to the 32nd embodiment is one in which, in any of the 1st to 31st embodiments, "at least one processor is installed in a server device, smartphone, tablet, mobile phone, or personal computer."
[0200] The method according to the 33rd aspect includes "the steps of: acquiring first data relating to an avatar in a virtual space operated using a first terminal of a first user; displaying a first display including the avatar on the display unit of the first terminal based on the first data; determining whether or not a first condition is met based on the first data; determining first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is determined to be met; and controlling the display unit based on the first control data."
[0201] The method according to the 34th aspect includes: "receiving first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line; determining first control data for controlling a display unit to display a first display including the avatar on the display unit of the first terminal based on the first data; transmitting the first control data to the first terminal via the communication line; determining whether a first condition is met based on the first data after transmitting the first control data to the first terminal; determining first control data for controlling the display unit to switch the display from a first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is met; and transmitting the second control data to the first terminal via the communication line."
[0202] The method according to the 35th aspect is one in which, in the 33rd or 34th aspect, "the communication line includes the Internet."
[0203] The method according to the 36th aspect is, in any of the 33rd to 35th aspects, "the at least one processor includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)."
[0204] The server device according to the 37th embodiment "acquires first data relating to an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on the display unit of the first terminal based on the first data, determines whether or not a first condition is met based on the first data, determines first control data to control the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, and controls the display unit based on the first control data."
[0205] The server device according to the 38th aspect is, in the 37th aspect, "the communication line includes the Internet."
[0206] A server device according to the 39th aspect is, in the 37th or 38th aspect, "the at least one processor includes a central processing unit (CPU), a microprocessor, and / or a graphics processing unit (GPU)."
[0207] Thus, the technology of this disclosure can provide computer programs, methods, and server devices that do not impair user comfort compared to conventional methods. [Explanation of symbols]
[0208] 2. Communication Network 10 devices 11. Terminal 1 12 Second Terminal 14, 24 Central Processing Unit 15, 25 Main memory 16, 26 Input / Output Interfaces 17, 27 Input devices 18, 28 Auxiliary storage device 19, 29 Output devices 20 Server Devices 21. First Server System 21A1 Distribution Server Device 21A2 Server Storage Device 22 Second Server System 70 equipment 80, 80A, 313 Avatars 81 chairs 102a First Sensor 102b Second sensor 102c Camera 102d Microphone 104 Processing Unit 110 Communications Department 120 Acquisition Department 130 Control Unit 140 Display section 150 User Interface Section 160 Storage section 210 Communications Department 220 Storage section 230 Control Unit 300 virtual spaces 301 Icons (area) 310 Virtual venue 311, 312 display area 314 Display area 321 points 322 line segments 323 icons 330 Slider 331 First element 332 Second element 1000 System 1400 computing environment 1410 Processing Unit 1420 memory 1430 Configuration 1440 storage 1450 Input device 1460 Output device 1470 Communication connection 1480 Software Instructions 1490 Computing Cloud
Claims
[Claim 1] A computer program that runs on at least one processor, First data is obtained regarding the avatar in the virtual space operated using the first terminal of the first user. Based on the first data, a first display including the avatar and an object which is a display area for displaying predetermined content is displayed on the display unit of the first terminal. If the number of avatars in the virtual space exceeds a predetermined number, or if a specific avatar is present in the virtual space, the system will activate the function to start playing the predetermined content on the target. Computer program.