Method, server, terminal, and base station

Abstract

A method performed by a server, in which control information indicating that a first terminal stays in a first area of a real space is received (S7431 or S7432), information corresponding to the first terminal is transmitted to a second terminal that is displaying a first virtual space corresponding to the first area of the real space, and the second terminal is configured to display a second virtual space corresponding to the first area of the real space. An image corresponding to the first terminal is displayed on a display screen of the second terminal (S7433).

Description

Technical Field

[0001] This disclosure relates to methods, servers, terminals, and base stations. Background Technology

[0002] A method for making characters appear in virtual space is proposed. For example... Figure 75 As shown, the server has a character module and spatial information. Therefore, when a terminal connects to the server, the server uses the spatial information to make the character appear in the virtual space.

[0003] (Existing technical literature)

[0004] (Patent Documents)

[0005] Patent Document 1: Japanese Patent Application Publication No. 2015-122075

[0006] Patent Document 2 International Publication No. 2020 / 122220

[0007] Patent Document 3 International Publication No. 2021 / 045181

[0008] Patent Document 4 International Publication No. 2021 / 215080 Summary of the Invention

[0009] The problem that the invention aims to solve

[0010] As a prior art, there is the technology shown in Patent Document 1, which allows characters to appear only in virtual space. However, the technology shown in Patent Document 1 is not a technology that links virtual space with real space, but is limited to allowing characters to move only in virtual space. Therefore, the problem is that the provided system is not a more diverse system suitable for the real environment in which the terminal and the user exist.

[0011] Therefore, this disclosure makes the character (virtual avatar) appear in the virtual space based on the location of the terminal (or user) in the real space.

[0012] Methods for solving problems

[0013] According to one aspect of the invention disclosed herein, the server includes a communication unit and a processor. The communication unit receives information indicating that a first terminal is in a first area of ​​real space. The processor generates information of a first virtual avatar corresponding to the first terminal. The communication unit sends the information of the first virtual avatar to a second terminal that is displaying a first virtual space corresponding to the first area of ​​real space, so that the display screen of the second terminal is displayed.

[0014] Furthermore, these general or specific methods can be implemented by systems, methods, integrated circuits, computer programs, or recording media such as computer-readable CD-ROMs, or by any combination of systems, methods, integrated circuits, computer programs, and recording media.

[0015] Invention Effects

[0016] The server disclosed herein enables a first virtual avatar corresponding to a terminal residing in a first area of ​​real space to be displayed in a first virtual space corresponding to the first area of ​​real space. Accordingly, it is possible to easily participate in the virtual space corresponding to the real space where the terminal resides.

[0017] By linking with the location of the real space where devices such as terminals exist, the corresponding characters (virtual avatars) appear in the virtual space, thereby providing a more diverse system that is suitable for the real environment in which the terminal and / or user exist. Attached Figure Description

[0018] Figure 1 An example of the system configuration in Implementation 1 is shown.

[0019] Figure 2 An example of the configuration of the server in Implementation 1 is shown.

[0020] Figure 3A Another example of the system configuration in Implementation 1 is shown.

[0021] Figure 3B This is a timing diagram illustrating an example of communication between the server and the terminal in Implementation 1.

[0022] Figure 4A An example of a real space in Implementation 1 is shown.

[0023] Figure 4B An example of the correspondence between real space and virtual space in Implementation 1 is shown.

[0024] Figure 5 Another example of the system configuration in Implementation 1 is shown.

[0025] Figure 6 An example of the configuration of the physical space and the base station in Implementation 1 is shown.

[0026] Figure 7A An example of sending information in Implementation 1 is shown.

[0027] Figure 7B Another example of sending information in Implementation 1 is shown.

[0028] Figure 8 Another example of the configuration of the physical space and base station in Implementation 1 is shown.

[0029] Figure 9 Another example of the configuration of the physical space and base station in Implementation 1 is shown.

[0030] Figure 10A Another example of the correspondence between real space and virtual space in Implementation 1 is shown.

[0031] Figure 10B Another example of the correspondence between real space and virtual space in Implementation 1 is shown.

[0032] Figure 11 Another example of the system configuration in Implementation 1 is shown.

[0033] Figure 12 Another example of the configuration of the physical space and base station in Implementation 1 is shown.

[0034] Figure 13 Another example of the configuration of the physical space and base station in Implementation 1 is shown.

[0035] Figure 14 Another example of the configuration of the physical space and base station in Implementation 1 is shown.

[0036] Figure 15 An example of an antenna configuration is shown.

[0037] Figure 16A An example of beamforming performed by a base station and a terminal is shown.

[0038] Figure 16B This illustrates another example of beamforming performed by a base station and a terminal.

[0039] Figure 16C An example of the coordinate system in Implementation 1 is shown.

[0040] Figure 17A An example of role display in the virtual space in Implementation 1 is shown.

[0041] Figure 17B Another example of role display in the virtual space in Implementation 1 is shown.

[0042] Figure 18 An example of the system configuration in Implementation 2 is shown.

[0043] Figure 19A An example of the configuration of the server in Implementation 2 is shown.

[0044] Figure 19B An example of the system configuration in Implementation 2 is shown.

[0045] Figure 19C An example of the object-role correspondence establishment process in Implementation 2 is shown.

[0046] Figure 20 An example of the system configuration in Implementation 2 is shown.

[0047] Figure 21 An example of the system configuration in Implementation 2 is shown.

[0048] Figure 22 An example of base station capability information in Implementation 3 is shown.

[0049] Figure 23 An example of terminal capability information in Implementation 3 is shown.

[0050] Figure 24A An example of the configuration of a base station in Implementation 3 is shown.

[0051] Figure 24B Another example of the configuration of the base station in Implementation 3 is shown.

[0052] Figure 24C Another example of the configuration of the base station in Implementation 3 is shown.

[0053] Figure 25A An example of the configuration of the terminal in Implementation 3 is shown.

[0054] Figure 25B Another example of the configuration of the terminal in Implementation 3 is shown.

[0055] Figure 25C Another example of the configuration of the terminal in Implementation 3 is shown.

[0056] Figure 25D Another example of the configuration of the terminal in Implementation 3 is shown.

[0057] Figure 26 An example of the operation of the base station in Implementation 3 is shown.

[0058] Figure 27 An example of terminal setting information in Implementation 3 is shown.

[0059] Figure 28A An example of the interaction between the terminal, base station, and server in Implementation Method 3 is shown.

[0060] Figure 28B An example of the setting of the character display area and non-display area in the virtual space in Implementation Method 3 is shown.

[0061] Figure 28C This illustrates another example of the setting of the character display area and non-display area in the virtual space in Implementation 3.

[0062] Figure 28D This illustrates another example of the setting of the character display area and non-display area in the virtual space in Implementation 3.

[0063] Figure 28E This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0064] Figure 29A An example of a situation in real space in Implementation 3 is shown.

[0065] Figure 29B An example of the display method setting in Implementation Method 3 is shown.

[0066] Figure 29C Another example of the display method setting in Implementation Method 3 is shown.

[0067] Figure 29D This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0068] Figure 29E This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0069] Figure 30A This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0070] Figure 30B An example of push notification settings in Implementation 3 is shown.

[0071] Figure 30C This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0072] Figure 31A This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0073] Figure 31B An example of push notification settings in Implementation 3 is shown.

[0074] Figure 31C This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0075] Figure 31D This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0076] Figure 31E This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0077] Figure 32A This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0078] Figure 32B Another example of the display method setting in Implementation Method 3 is shown.

[0079] Figure 32C Another example of the display method setting in Implementation Method 3 is shown.

[0080] Figure 32D Another example of the display method setting in Implementation Method 3 is shown.

[0081] Figure 32E Another example of the display method setting in Implementation Method 3 is shown.

[0082] Figure 32F This illustrates another example of the interaction between the terminal, base station, and server in Implementation 3.

[0083] Figure 33A An example of the system configuration in Implementation 4 is shown.

[0084] Figure 33B An example of the system configuration in Implementation 4 is shown.

[0085] Figure 33C Another example of the system configuration in Implementation 4 is shown.

[0086] Figure 33D Another example of the system configuration in Implementation 4 is shown.

[0087] Figure 34A An example of the interaction between the terminal, base station, and server in Implementation 5 is shown.

[0088] Figure 34B An example of the character's action settings in Implementation 5 is shown.

[0089] Figure 34C This illustrates another example of the interaction between the terminal, base station, and server in Implementation 5.

[0090] Figure 34DThis illustrates another example of the interaction between the terminal, base station, and server in Implementation 5.

[0091] Figure 35 An example of the interaction between the device and the server in Implementation 5 is shown.

[0092] Figure 36A An example of the state of the real space in Implementation 6 is shown.

[0093] Figure 36B An example of the state of the virtual space in Implementation 6 is shown.

[0094] Figure 37A An example of the state of a virtual space is shown.

[0095] Figure 37B This shows another example of the state of virtual space.

[0096] Figure 38A An example of the system configuration in Implementation 6 is shown.

[0097] Figure 38B Another example of the system configuration in Implementation 6 is shown.

[0098] Figure 39 An example of the interaction between the advertising providing device or information providing device and the server in Embodiment 6 is shown.

[0099] Figure 40 An example of the interaction between a terminal or device and a server in Implementation 6 is shown.

[0100] Figure 41 Another example of the interaction between the terminal or device and the server in Implementation 6 is shown.

[0101] Figure 42 Another example of the interaction between the advertising providing device or information providing device and the server in Implementation 6 is shown.

[0102] Figure 43 Another example of the interaction between the terminal or device and the server in Implementation 6 is shown.

[0103] Figure 44 This illustrates another example of the interaction between the advertising or information providing device in Implementation 6, the terminal or device, and the server.

[0104] Figure 45 An example of the system configuration in Implementation 7 is shown.

[0105] Figure 46An example of the configuration of the modulation signal sent by the terminal in Embodiment 7 is shown.

[0106] Figure 47A An example of the configuration of the modulation signal transmitted by the base station and the terminal in Implementation 7 is shown.

[0107] Figure 47B An example of the configuration of the modulation signal transmitted by the base station and the terminal in Implementation 7 is shown.

[0108] Figure 48A An example of the interaction between the terminal and the server in Implementation 8 is shown.

[0109] Figure 48B An example of the action settings for a character set by the terminal in Implementation Method 8 is shown.

[0110] Figure 48C An example of the state of the terminal and sensor in Implementation 8 is shown.

[0111] Figure 48D An example of the structure of the information sent by the terminal in Implementation 8 is shown.

[0112] Figure 48E An example of the structure of the information transmitted by the base station in Implementation 8 is shown.

[0113] Figure 48F An example of the status of the base station and sensor in Implementation 8 is shown.

[0114] Figure 48G An example of the state of the terminal and camera device in Implementation 8 is shown.

[0115] Figure 48H An example of the system configuration in Implementation 8 is shown.

[0116] Figure 48I An example of the state of the terminal and camera device in Implementation 8 is shown.

[0117] Figure 49 An example of the action settings for a character set by the terminal in Implementation Method 8 is shown.

[0118] Figure 50A An example of a setting related to the display of attributes for a role equivalent to a terminal in Implementation 9 is shown.

[0119] Figure 50B An example of the configuration of terminal setting information transmitted by the terminal in Embodiment 9 is shown.

[0120] Figure 51This illustrates another example of the interaction between the terminal, base station, and server in Implementation 9.

[0121] Figure 52 An example of a terminal-like role in the virtual space in Implementation 9 is shown.

[0122] Figure 53A An example of the state of the real space in Implementation 10 is shown.

[0123] Figure 53B An example of the state of the real space in Implementation 10 is shown.

[0124] Figure 54A An example of the state of a virtual space equivalent to a real space in Implementation 10 is shown.

[0125] Figure 54B An example of the state of a virtual space equivalent to a real space in Implementation 10 is shown.

[0126] Figure 54C An example of the state of a virtual space equivalent to a real space in Implementation 10 is shown.

[0127] Figure 55A An example of the state of the real space in Implementation 10 is shown.

[0128] Figure 55B An example of the state of the real space in Implementation 10 is shown.

[0129] Figure 56A An example of the state of a virtual space equivalent to a real space in Implementation 10 is shown.

[0130] Figure 56B An example of the state of a virtual space equivalent to a real space in Implementation 10 is shown.

[0131] Figure 56C An example of the state of a virtual space equivalent to a real space in Implementation 10 is shown.

[0132] Figure 57 An example of the interaction between the advertising providing device or information providing device in embodiment 10 and the server is shown.

[0133] Figure 58 An example of the interaction between the advertising providing device or information providing device in embodiment 10 and the server is shown.

[0134] Figure 59 An example of the interaction between a terminal or device and a server in Implementation 10 is shown.

[0135] Figure 60 An example of the system configuration in Implementation 10 is shown.

[0136] Figure 61 An example of the interaction between a terminal or device and a server in Implementation 10 is shown.

[0137] Figure 62A An example of the status of the sensor, terminal, and base station in Implementation 11 is shown.

[0138] Figure 62B An example of the status of the sensor, terminal, and base station in Implementation 11 is shown.

[0139] Figure 62C An example of the configuration of the terminal in Implementation 11 is shown.

[0140] Figure 63A An example of the interaction between a terminal or device and a server in Implementation 11 is shown.

[0141] Figure 63B An example of the interaction between a sensor and a terminal or device and a server in Implementation 11 is shown.

[0142] Figure 64A An example of the configuration of the server in Implementation 11 is shown.

[0143] Figure 64B An example of the configuration of the analysis unit in Embodiment 11 is shown.

[0144] Figure 65 An example of the state of the real space in Implementation 11 is shown.

[0145] Figure 66 An example of a display screen shown by the first terminal in Embodiment 11 is shown.

[0146] Figure 67A An example of the state of the real space in Implementation 11 is shown.

[0147] Figure 67B An example of the interaction between the device and the server in Implementation 11 is shown.

[0148] Figure 67C An example of the interaction between the terminal and the device and the server in Implementation 11 is shown.

[0149] Figure 68 The location of the corresponding device in the virtual space in Implementation 11 is shown.

[0150] Figure 69 An example of the state of the real space in Implementation 11 is shown.

[0151] Figure 70A An example of the interaction between the terminal and the server in Implementation 11 is shown.

[0152] Figure 70B An example of a virtual space for a user checking out using a terminal in Implementation 11 is shown.

[0153] Figure 71A An example of the interaction between the device and the server in Implementation 11 is shown.

[0154] Figure 71B An example of the interaction between the terminal and the device and the server in Implementation 11 is shown.

[0155] Figure 71C An example of the state of the user in the real space in Implementation 11 is shown.

[0156] Figure 71D An example of a virtual space for a user checking out using a terminal in Implementation 11 is shown.

[0157] Figure 72 An example of the configuration of the modulation signal transmitted by the base station in Implementation 12 is shown.

[0158] Figure 73 An example of the configuration of the modulation signal sent by the terminal in Embodiment 12 is shown.

[0159] Figure 74A The basic structure of the system in each implementation is shown.

[0160] Figure 74B An example of the basic processing of the system in each implementation is shown.

[0161] Figure 75 This demonstrates the previous system configuration for bringing characters to life in virtual space. Detailed Implementation

[0162] The first method based on one aspect of the invention disclosed herein is a method executed by a server, wherein control information indicating that a first terminal is in a first area of ​​a real space is received, information corresponding to the first terminal is sent to a second terminal that is displaying a first virtual space, and the display screen of the second terminal displays an image corresponding to the first terminal, wherein the first virtual space corresponds to the first area of ​​the real space.

[0163] The method described above can display information corresponding to a terminal residing in a first area of ​​the real space in a first virtual space corresponding to that first area of ​​the real space. Therefore, it is easy to participate in the virtual space corresponding to the real space where the terminal is residing.

[0164] A second method based on one aspect of the invention known in this disclosure, wherein in the first method, the second terminal is located outside a first region of the real space.

[0165] The method described above enables terminals that participate in the first virtual space regardless of their location, and terminals that participate in the first virtual space based on their location in a first area of ​​the real space, to coexist. Accordingly, it makes communication possible between users participating in the virtual space corresponding to the real space where the terminal resides, and users participating in the virtual space regardless of their location.

[0166] A third method based on one aspect of the invention known in this disclosure, wherein in the first method, the control information is information indicating that the first terminal is communicating with the first base station.

[0167] The above method establishes a correspondence between regions of the real space and base stations, thereby making it easy to establish a correspondence between regions of the virtual space and regions of the real space.

[0168] Based on a fourth method of the invention as disclosed herein, in the third method, a first region of real space is established to correspond with the first base station and a second base station different from the first base station.

[0169] The above method improves the flexibility of establishing correspondence between base stations and virtual spaces by enabling multiple base stations in the real space to correspond with the same virtual space.

[0170] Based on the fifth method of one aspect of the invention known in this disclosure, in the third method, a first virtual space is established to correspond to a first region of real space and a second region of real space that is different from the first region of real space.

[0171] The above method improves the flexibility of establishing correspondence between regions in the real space and the virtual space by making multiple regions in the real space correspond to the same virtual space.

[0172] Based on the sixth method of one aspect of the invention known in this disclosure, in the third method, a correspondence is established between a first region of real space and a first region of virtual space.

[0173] The above method allows for detailed settings of areas within a virtual space that correspond to areas in the real space, thereby improving the flexibility of establishing a correspondence between areas in the real space and the virtual space.

[0174] According to the seventh method based on one aspect of the invention disclosed herein, in the third method, the location information of the first terminal is obtained from the first base station, and the position of the image displayed in the first virtual space corresponding to the first terminal is changed according to the location information of the first terminal.

[0175] The method described above can change the position of the image displayed in the virtual space corresponding to the first terminal according to the detailed position of the terminal in the real space area, thereby providing a virtual space service based on a more detailed terminal position.

[0176] According to one aspect of the invention disclosed herein, the server includes a communication unit and a processor. The communication unit receives control information indicating that a first terminal is in a first area of ​​real space. The processor generates information corresponding to the first terminal. The communication unit sends the information to a second terminal that is displaying a first virtual space corresponding to the first area of ​​real space, so that the display screen of the second terminal is displayed.

[0177] The server described above can display a first virtual avatar corresponding to a terminal residing in a first area of ​​real space in a first virtual space corresponding to that first area of ​​real space. Therefore, it can easily participate in the virtual space corresponding to the real space where the terminal resides.

[0178] The eighth method, based on one aspect of the invention disclosed herein, is a method executed by a terminal, communicating with a first base station configured in a first area of ​​real space, and sending control information, including an identifier of the first base station and an identifier of the terminal, to a server providing a first virtual space corresponding to the first area of ​​real space.

[0179] The above method can easily enable a terminal that is in the first area of ​​the real space to participate in the first virtual space corresponding to the first area of ​​the real space.

[0180] According to a ninth method based on an aspect of the invention known in this disclosure, in the eighth method, sensing for generating location information of the terminal is performed with the first base station, and the location information is sent to the server.

[0181] The above method can provide virtual space services that correspond to the detailed location of the terminal within a real space area.

[0182] A terminal based on one aspect of the invention disclosed herein includes a communication unit and a processor. The communication unit communicates with a first base station configured in a first area of ​​real space. The processor generates control information including an identifier of the first base station and an identifier of the terminal, and sends the control information to a server that provides a first virtual space corresponding to the first area of ​​real space.

[0183] The terminal in the above form can easily participate in the first virtual space corresponding to the first area of ​​the real space, which is the first area of ​​the real space.

[0184] The 10th method, based on one aspect of the invention disclosed herein, is a method performed by a base station configured in a first area of ​​real space, wherein communication is made with a first terminal residing in the first area of ​​real space, and control information including an identifier of the first base station and an identifier of the first terminal is sent to a server providing a first virtual space corresponding to the first area of ​​real space.

[0185] The above method can easily enable a terminal that is stationary in the first area of ​​the real space to participate in the first virtual space corresponding to the first area of ​​the real space.

[0186] Based on the eleventh method of one aspect of the invention known in this disclosure, in the tenth method, sensing for generating location information of the first terminal is performed, and the location information is sent to the server.

[0187] The above method can provide virtual space services that correspond to the detailed location of the terminal within a real space area.

[0188] According to one aspect of the invention disclosed herein, a base station includes a communication unit and a processor. The base station is configured in a first area of ​​real space. The communication unit communicates with a first terminal residing in the first area of ​​real space. The processor generates control information including an identifier indicating the first base station and an identifier indicating the first terminal. The communication unit sends the control information to a server that provides a first virtual space corresponding to the first area of ​​real space.

[0189] The base station described above can easily enable a terminal residing in the first area of ​​the real space to participate in the first virtual space corresponding to the first area of ​​the real space.

[0190] Furthermore, these general or specific methods can be implemented by systems, methods, integrated circuits, computer programs, or recording media such as computer-readable CD-ROMs, or by any combination of systems, methods, integrated circuits, computer programs, or recording media.

[0191] The transmitting apparatus of this disclosure will now be described in detail with reference to the accompanying drawings.

[0192] Furthermore, the embodiments described below are all general or specific examples. The numerical values, shapes, materials, constituent elements, arrangement positions of constituent elements, connection methods, steps, and order of steps shown in the following embodiments are all examples, and their purpose is not to limit the invention based on this disclosure. Moreover, constituent elements in the following embodiments that are not described in the independent technical solution showing the highest concept will be described as arbitrary constituent elements.

[0193] (Implementation Method 1)

[0194] This embodiment describes the structure of a system that makes a character appear in a virtual space based on the location of a terminal existing in real space, as well as the operation of each device.

[0195] Alternatively, real space can be referred to as "(physical) reality" or "universe." Furthermore, real space can also be "augmented reality (AR)" (a world that virtually enhances the real world). As an example, real space can also be considered the physical world we inhabit. Other names for real space are also possible. All of the above applies in this instruction manual.

[0196] Furthermore, virtual space can also be referred to as "cyberspace," "metaverse," "one of the multiverses," "virtual space," "virtual reality (VR)," or "virtual world." Other names for virtual space are also possible. All of the above applies throughout this manual.

[0197] Furthermore, the character can be referred to as a "virtual avatar" or "object." As an example, a virtual avatar can be considered a clone of the user with the terminal appearing in games, on the internet, or in virtual space. Alternatively, the character can be given other names. All of the above applies throughout this manual.

[0198] Figure 1 An example of a system configuration in this embodiment, which "makes a character appear in a virtual space based on the location of a terminal that exists in the real space," is shown.

[0199] The inner side of the ellipse 100_1 is real space #1. Therefore, terminal #1 of 101_1 and terminal #2 of 101_2 exist within real space #1. However, although real space is defined as the inner side of the ellipse, it may not be represented by the inner side of the ellipse. For the sake of simplicity, real space is represented by the inner side of the ellipse. This is consistent throughout this embodiment and this specification.

[0200] exist Figure 1 In the context of 102_1, although base station #1 exists in real space #1, base station #1 of 102_1 can also exist in real space outside of real space #1.

[0201] Base station #1 of 102_1 communicates with devices including server 104 via network 103. This communication can be considered as an example of communication conducted via wired and / or wireless means.

[0202] Furthermore, base station #1 of 102_1 communicates with terminals including "terminal #1 of 101_1 and terminal #2 of 101_2", for example, via wireless communication. (It can also be via wired and / or wireless communication.)

[0203] Therefore, base station #1 of 102_1 has a transmitting unit for wireless communication and a receiving unit for wireless communication.

[0204] Similarly, the terminals including "Terminal #1 of 101_1 and Terminal #2 of 101_2" have a transmitting unit for wireless communication and a receiving unit for wireless communication.

[0205] Furthermore, base station #1 of 102_1 includes a transmitting unit for sensing and a receiving unit for sensing. Additionally, the transmitting unit for sensing and the transmitting unit for wireless communication can exist separately or be shared. Base station #1 of 102_1 may also include a location estimation system such as GPS (Global Positioning System).

[0206] The terminals including "Terminal #1 of 101_1 and Terminal #2 of 101_2" have a transmitting unit for sensing and a receiving unit for sensing. Furthermore, the transmitting unit for sensing and the transmitting unit for wireless communication can exist separately or can be shared. The terminals including "Terminal #1 of 101_1 and Terminal #2 of 101_2" may also have a location estimation system such as GPS.

[0207] Therefore, base station #1 of 102_1 is considered as an estimate of terminals including "terminal #1 of 101_1 and terminal #2 of 101_2". At this time, as shown in Patent Documents 2, 3, and 4, base station #1 of 102_1 can obtain the location information (or sensing result information) of the terminals including "terminal #1 of 101_1 and terminal #2 of 101_2" through any of the following methods.

[0208] Method 1:

[0209] Base station #1 of 102_1 transmits a sensing signal. The terminal then receives this sensing signal and estimates its location (or obtains the sensing result). The terminal sends this location information (or sensing result information) to base station #1 of 102_1. Based on this, base station #1 of 102_1 obtains the location information (or sensing result information) of the terminals including "terminal #1 of 101_1" and "terminal #2 of 101_2".

[0210] Method 2:

[0211] Base station #1 of 102_1 transmits a sensing signal. When the state of this sensing signal changes at the terminal, this change is captured by base station #1 of 102_1 (receiving the radio waves equivalent to the sensing signal), and base station #1 of 102_1 estimates the terminal's location (or obtains the sensing result). Based on this, base station #1 of 102_1 obtains the location information (or sensing result information) of the terminals including "terminal #1 of 101_1" and "terminal #2 of 101_2".

[0212] Method 3:

[0213] Terminals such as "Terminal #1 of 101_1" and "Terminal #2 of 101_2" send signals for sensing. Base station #1 of 102_1 then receives these signals and estimates the location (or obtains the sensing result). Based on this, base station #1 of 102_1 obtains the location information (or sensing result information) of the terminals including "Terminal #1 of 101_1" and "Terminal #2 of 101_2".

[0214] Thus, the signal used for sensing can be transmitted by base station #1 of 102_1 or by the terminal. Furthermore, the method by which base station #1 of 102_1 obtains the location information (or sensing result information) of the terminals including "terminal #1 of 101_1 and terminal #2 of 101_2" is not limited to method 1, method 2, or method 3, and can also be widely applied to methods described in documents including Patent Document 2, Patent Document 3, and Patent Document 4.

[0215] Alternatively, terminals including "Terminal #1 of 101_1" and "Terminal #2 of 101_2" can estimate their own positions using a location estimation system such as GPS. In this case, the terminals send the estimated position information to base station #1 of 102_1, thereby obtaining the position information of terminals including "Terminal #1 of 101_1" and "Terminal #2 of 101_2".

[0216] As a sensing process in a base station or terminal, it can be, for example, as shown in Patent Documents 2, 3, and 4, "a sensing process based on the direction of arrival using methods such as MUSIC (Multiple Signal Classification) and direction estimation," or "a distance sensing process based on the distance using methods such as receiving timing difference or transmitting / receiving timing difference."

[0217] Furthermore, as a sensing process in base stations and terminals, it is applicable to various methods used in NR (New Radio) systems, such as: "Location (sensing) based on reference signal timing difference," "Location (sensing) based on reference signal received power (the received power of a reference signal measured at the terminal (or base station))," "Location (sensing) based on angle of arrival (the angle of arrival of a radio wave transmitted from the transmitter as viewed from the receiver's side, generally measured based on the time difference of arrival of radio waves received by two or more antennas)," "Ranging (sensing) based on RX-Tx time difference," "Ranging (sensing) utilizing RTT (Round Trip Time)," "Ranging (sensing) utilizing AoA (Angle of Arrival) and / or AoD (Angle of Departure)," and "Ranging (sensing) utilizing TDOA (Time Difference of Arrival)." Arrival: Distance (sensing) of the time difference of arrival (the difference in the arrival times of signals from multiple base stations (or multiple devices)).

[0218] When performing sensing processing in a base station or terminal, multiple antennas can be used to perform triangulation, as shown in Patent Documents 2, 3, and 4, to estimate the position (or obtain sensing results). Alternatively, when performing sensing processing in a base station or terminal, other devices can be used to perform triangulation, as shown in Patent Documents 2, 3, and 4, to estimate the position (or obtain sensing results).

[0219] Furthermore, as an example of sensing, consider the following processing methods: Estimating the position of an object; detecting the presence or absence of an object; estimating the distance between a first object and a second object; predicting the material or substance of an object; detecting the motion of an object; estimating the surrounding environment of a sensing device; estimating the distance between a sensing device and an object; detecting the shape of an object; estimating gestures; estimating human motion; estimating the shape of a part of a human body; estimating the motion of a part of a human body; detecting a human; detecting a part of a human body; recognizing a human; recognizing a part of a human body; estimating the motion of an object; estimating the shape of an object; detecting an object; recognizing an object.

[0220] Furthermore, in the process of detecting the position of an object, there may be cases where the object's motion is detected simultaneously with the object's detection. Moreover, in the process of detecting the presence or absence of an object or detecting the shape of an object, the object can be identified. In other words, one or more of the processes described above can be executed during sensing.

[0221] exist Figure 1 The system includes a storage unit for maintaining data related to the virtual space, a control unit for controlling the appearance and actions of characters within the virtual space, and a server 104 for updating and controlling information about the virtual space based on data from other devices. Details regarding the server's structure and operation will be explained later. Figure 1 The system may contain, for example, terminal #101 of 101_101, terminal #2 of 101_102, and other devices.

[0222] The base station #1 of 102_1, server 104, terminal #101 of 101_101, terminal #2 of 101_102, and equipment are connected to network 103, enabling communication between the devices such as the base station #1 of 102_1, server 104, terminal #101 of 101_101, terminal #2 of 101_102, and equipment.

[0223] Furthermore, terminal #101 of 101_101 and terminal #2 of 101_102 communicate with base station #1 of 102_1. Thus, terminal #101 of 101_101 and terminal #2 of 101_102 communicate with devices such as server 104, terminal #101 of 101_101, terminal #2 of 101_102, and equipment via base station #1 of 102_1 and network 103.

[0224] Furthermore, the system configuration in this embodiment is not subject to... Figure 1 Due to limitations, only one or more terminals are required, as are one or more base stations and one or more servers.

[0225] Figure 2 yes Figure 1 Here is an example of the configuration of server 104. Regarding server 104, for example, interface 200 takes input signal 201 as input and outputs output signal 202. Furthermore, interface 200 is connected to spatial information storage unit 211, role information storage unit 212 for each terminal, role control unit 213 based on real-world location, output information generation unit 214, and role generation unit 215. Although referred to as an interface here, it could also be a bus.

[0226] The spatial information storage unit 211 is the part that stores information about virtual space. Furthermore, "information about virtual space" can be, for example, "two-dimensional spatial data," "three-dimensional spatial data," or "data transformed when representing three-dimensional spatial data in two dimensions." Moreover, "virtual space objects that are equivalent to objects existing in real spaces such as buildings, facilities, equipment, squares, and parks" can also be configured in virtual space. Therefore, information about virtual space can also include information about "virtual space objects."

[0227] Furthermore, information about the virtual space can be updated, for example, through input signal 201. For example, information about the virtual space, such as updates to the objects used in the virtual space and updates to the positions of the objects used in the virtual space, is stored in the space information storage unit 211 through input signal 201.

[0228] The operation of the role information storage unit 212 for each terminal will be explained in detail later.

[0229] The operation of the role control unit 213, which is based on the location in real space, will be explained in detail later.

[0230] The output information generation unit 214 generates output information about the virtual space for provision to terminals and other devices based on information obtained from the space information storage unit 211, information obtained from the role information storage unit 212 for each terminal, and information obtained from the role control unit 213 based on the location in the real space. The output information about the virtual space is then output from the server 104 as an output signal 202. Furthermore, the output information about the virtual space will be sent to one or more terminals connected to the server 104.

[0231] Therefore, a device such as a terminal that receives the information from the output signal 202 generates display content for the virtual space based on the output signal 202, and displays it on a built-in display device and / or an external display device.

[0232] At this time, the display device can be, for example, a mobile phone, a portable phone, a smartphone, a tablet computer, a tablet PC (Personal Computer), a computer (which may or may not have a display), a laptop computer, a television, a device connected to a display, a game console, a portable game console, AR glasses, AR goggles, a display capable of AR display, a device connected to a display capable of AR display, VR glasses, VR goggles, a display capable of VR display, a device connected to a display capable of VR display, MR (Mixed Reality) glasses, a display capable of MR display, a device connected to a display capable of MR display, a car navigation system, a head-mounted display, a device connected to a head-mounted display, a display, a device connected to a display, a projector, a device connected to a projector, etc., but is not limited thereto.

[0233] Furthermore, the configuration of the server is not subject to... Figure 2 The examples are limited.

[0234] right Figure 2 The operation of the role information storage unit 212 for each terminal will be explained. As an example, the role corresponding to terminal #1 of 101_1 will be explained.

[0235] For example, terminal #1 of 101_1 Figure 1 As shown, communication with server 104 can be achieved via base station #1 of 102_1, or as... Figure 3A As shown, communication with server 104 is conducted via network 103 (not via base station #1 of 102_1).

[0236] Therefore, the terminal can communicate with the server 104 via base station #1 of 102_1, or via network 103.

[0237] As described above, when a terminal communicates with server 104, it establishes an association with the role corresponding to the terminal. The process of establishing this association is explained below.

[0238] like Figure 3B As shown, the terminal sends terminal information to server 104 (301). Furthermore, the terminal information is information that allows server 104 to identify the terminal (and / or user), such as SIM (Subscriber Identity Module) information, telephone number information, email address information (accessible to the user or terminal), user ID, terminal ID, SNS (Social networking service) information, etc.—"terminal and / or user information." Therefore, server 104 receives the terminal information (351).

[0239] Therefore, the terminal sends the role information to the server 104 (302). As a result, the server 104 receives the role information (352).

[0240] Additionally, when generating role information, the terminal can... Figure 2 The terminal can obtain character source information from the character generation unit 215 of the server 104, or from a device different from the server 104. Based on this, the terminal can generate character information. Furthermore, as another method, the terminal can also generate characters using its own functions.

[0241] Therefore, server 104 stores the grouped information of terminal information and the role information of that terminal into... Figure 2 The role information storage unit 212 for each terminal. Therefore, Figure 2 The role information storage unit 212 stores "group information of terminal information and role information of that terminal" for each terminal. For example, in Figure 1 In this case, Figure 2The role information storage unit 212 stores the "group information of terminal information and role information of terminal #1 of 101_1", the "group information of terminal information and role information of terminal #2 of 101_2", the "group information of terminal information and role information of terminal #101 of 101_101", and the "group information of terminal information and role information of terminal #102 of 101_102".

[0242] exist Figure 3B In the description, the explanation of working as "terminal information" can also replace "terminal information," and can be implemented in the same way as "user information or identification information." Furthermore, in other explanations, the explanation of working as "terminal information" can also replace "terminal information," and can be implemented in the same way as "user information or identification information."

[0243] right Figure 2 The operation of the role control unit 213, which is based on the location in real space, will be explained. The relationship between real space and virtual space will also be explained.

[0244] Figure 4A An example of real space is shown. For example... Figure 4A As shown, in real space, the inner side of ellipse 100_0 is named real space #0, the inner side of ellipse 100_0 is named real space #1, and the inner side of ellipse 100_2 is named real space #2. Additionally, real spaces other than "real space #0, real space #1, and real space #2" can also exist within real space.

[0245] Figure 4B It shows Figure 4A The relationship between real space and virtual space in the game.

[0246] For example, establishing the following associations,

[0247] · Figure 4A The "real space #0" and "virtual space #0" are linked together.

[0248] · Figure 4A The "real space #1" and "virtual space #1" are linked together.

[0249] · Figure 4A The "real space #2" and "virtual space #2" are linked together.

[0250] For example, "real space #X" and "virtual space #X" (where X is considered an integer greater than 0) can be digital twins. However, "real space #X" and "virtual space #X" do not necessarily have to be completely digital twins; for example, only a portion of "real space #X" and "virtual space #X" may be digital twins. Furthermore, the sizes of the spaces represented by "real space #X" and "virtual space #X" can be the same or different.

[0251] It is also possible that when the position in "real space #X" is determined, the position in "virtual space #X" is also determined (this will be explained later).

[0252] In addition, digital twin refers to the technological concept of mapping and reproducing data about things and / or the environment obtained in physical reality (e.g., real space) into cyberspace (e.g., virtual space). Because it uses IoT (Internet of Things) technology to reflect data and / or information obtained from sensor devices in real-time space into cyberspace like a mirror, it is called digital twin, or "digital mapping."

[0253] right Figure 2 The working example of the role control unit 213 based on the position in real space will be explained.

[0254] like Figure 1 As shown, for example, terminal #1 of 101_1 is considered to exist in real space #1. Terminal #1 of 101_1 is linked with base station #1 of 102_1 to perform sensing-related work. Accordingly, base station #1 of 102_1 and terminal #1 of 101_1 share the location information of terminal #1 of 101_1 in real space #1. At this time, the location information of terminal #1 of 101_1 in real space #1 can be "absolute location information such as longitude and latitude of terminal #1 of 101_1" or "differential information between the location of terminal #1 of 101_1 and the location of base station #1 of 102_1 (which can also be called relative location information)".

[0255] Therefore, base station #1 of 102_1 transmits the location information of terminal #1 of 101_1 in real space #1 to server 104. Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #1, thus knowing "the location of terminal #1 of 101_1 in real space #1". Furthermore, as the location information of terminal #1 of 101_1 in real space #1, if server 104 obtains the "difference information between the location of terminal #1 of 101_1 and the location of base station #1 of 102_1", server 104 can obtain the location information of base station #1 of 102_1. Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #1, thus knowing "the location of terminal #1 of 101_1 in real space #1". And, server 104, via base station #1 of 102_1, allows terminal #1 of 101_1 to obtain its own information.

[0256] Server 104 Figure 2 The role information storage unit 212 shown for each terminal obtains the information of terminal #1 of 101_1 and outputs the role information corresponding to terminal #1 of 101_1.

[0257] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of terminal #1 of 101_1 in real space #1, and outputs information for controlling the position of the role corresponding to terminal #1 of 101_1 in virtual space #1 which has established a correspondence with real space #1.

[0258] Therefore, server 104 Figure 2 The output information generation unit 2 shown above, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #1 of 101_1" output by the role information storage unit 212 of each terminal, and the "information for controlling the position of the role corresponding to terminal #1 of 101_1 in the virtual space #1 corresponding to the real space #1" output by the role control unit 213 based on the position in the real space, configures the "role corresponding to terminal #1 of 101_1" to the "position of the role corresponding to terminal #1 of 101_1 in the virtual space #1 corresponding to the real space #1" in the virtual space #1. The server 104... Figure 2The output information generation unit 214 shown generates output information about virtual space #1 containing "the role corresponding to terminal #1 of 101_1", including an output signal 202 that outputs output information about virtual space #1 containing "the role corresponding to terminal #1 of 101_1" from server 104. At this time, the output signal 202 may also include information about other virtual spaces (e.g., virtual space #2, virtual space #3, ...).

[0259] Therefore, when terminal #1 of 101_1 moves in real space #1, and the position of terminal #1 of 101_1 in real space #1 is updated, according to the above description, the position of the "role corresponding to terminal #1 of 101_1" in the virtual space #1 corresponding to real space #1 is updated, and this is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about the virtual space #1 containing "the role corresponding to terminal #1 of 101_1", and the output signal 202 is output from the server 104.

[0260] Furthermore, as described above, terminal #1 of 101_1 can also use its GPS or other location estimation system to estimate its position in real space #1, and base station #1 of 102_1 and terminal #1 of 101_1 can share the location information of terminal #1 of 101_1 in real space #1. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way.

[0261] Furthermore, although this explanation uses terminal #1 of 101_1 and base station #1 of 102_1, the same implementation can be achieved using other terminals and other base stations.

[0262] Therefore, as Figure 5 As shown, for example, terminal #1 of 101_1 moves to real space #2. Terminal #1 of 101_1 and base station #2 of 102_2 work together to perform sensing-related tasks. Accordingly, base station #2 of 102_2 and terminal #1 of 101_1 share the location information of terminal #1 of 101_1 in real space #2. At this time, the location information of terminal #1 of 101_1 in real space #2 can be "absolute location information such as longitude and latitude of terminal #1 of 101_1", or it can be "the difference between the location of terminal #1 of 101_1 and the location of base station #2 of 102_2 (which can also be called relative location information)".

[0263] Therefore, base station #2 of 102_2 transmits the location information of terminal #1 of 101_1 in real space #2 to server 104. Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #2, thus knowing "the location of terminal #1 of 101_1 in real space #2". Furthermore, as the location information of terminal #1 of 101_1 in real space #2, given that server 104 obtains the "difference information between the location of terminal #1 of 101_1 and the location of base station #2 of 102_2", server 104 can obtain the location information of base station #2 of 102_2. Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #2, thus knowing "the location of terminal #1 of 101_1 in real space #2". Moreover, server 104 obtains the information of terminal #1 of 101_1 from terminal #1 of 101_1 via base station #2 of 102_2.

[0264] Server 104 Figure 2 The role information storage unit 212 shown for each terminal obtains the information of terminal #1 of 101_1 and outputs the role information corresponding to terminal #1 of 101_1.

[0265] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of terminal #1 of 101_1 in real space #2, and outputs information for controlling the position of the role corresponding to terminal #1 of 101_1 in virtual space #2 which has established a correspondence with real space #2.

[0266] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #1 of 101_1" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #1 of 101_1 in the virtual space #2 corresponding to the real space #2" output by the role control unit 213 based on the real space position, configures the "role corresponding to terminal #1 of 101_1" to the "position of the role corresponding to terminal #1 of 101_1 in the virtual space #2 corresponding to the real space #2" in the virtual space #2. The server 104... Figure 2The output information generation unit 214 shown generates output information about virtual space #2 containing "the role corresponding to terminal #1 of 101_1", including an output signal 202 that outputs output information about virtual space #2 containing "the role corresponding to terminal #1 of 101_1" from server 104. At this time, the output signal 202 may also include information about other virtual spaces (e.g., virtual space #1, virtual space #3, ...).

[0267] Therefore, when terminal #1 of 101_1 moves in real space #2, and the position of terminal #1 of 101_1 in real space #2 is updated, according to the above description, the position of the "role corresponding to terminal #1 of 101_1" in the virtual space #2 corresponding to real space #2 is updated, and this is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about the virtual space #2 containing "the role corresponding to terminal #1 of 101_1", and the output signal 202 is output from the server 104.

[0268] Furthermore, as described above, terminal #1 of 101_1 uses its GPS or other location estimation system to estimate its position in real space #2, and base station #2 of 102_2 and terminal #1 of 101_1 can share the position information of terminal #1 of 101_1 in real space #2. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way.

[0269] Furthermore, although the explanation was given using terminal #1 of 101_1 and base station #2 of 102_2, the same implementation can be achieved using other terminals and other base stations.

[0270] As described above, although the relationship between the IDs in the real space and the IDs in the virtual space, and the corresponding work of each department, have been explained, the relationship between the IDs in the real space and the IDs in the virtual space is not subject to... Figure 4B Due to limitations of the examples provided, other examples will be provided later.

[0271] Next, we will explain the relationship between the physical space and the community ID (identification code).

[0272] Figure 6 An example of a real-world space and base station configuration is shown. Additionally, regarding... Figure 1 The same job will be assigned the same number.

[0273] like Figure 6As shown, the inner side of ellipse 100_0 is set as real space #0, the inner side of ellipse 100_1 is set as real space #1, the inner side of ellipse 100_2 is set as real space #2, ...

[0274] Therefore, the communication range of base station #0 of 102_0 is considered to include real space #0, the communication range of base station #1 of 102_1 is considered to include real space #1, and the communication range of base station #2 of 102_2 is considered to include real space #2.

[0275] Additionally, base station #0 of 102_0, base station #1 of 102_1, and base station #2 of 102_2 are... Figure 1 , Figure 5 It communicates with server 104 in the middle.

[0276] at this time, Figure 1 Base station #1 of 102_1 and Figure 5 Base station #2 of 102_2 sends a message to server 104. Figure 7A The information shown.

[0277] like Figure 7A As shown, Figure 1 Base station #1 of 102_1 and Figure 5 Base station #2 of 102_2 sends the cell ID information 701, terminal information 702, and location information 703 to server 104.

[0278] For example, Figure 1 Base station #1 of 102_1 sends the cell ID information 701, the terminal information of terminal #1 of 101_1 (and the terminal information of terminal #2 of 101_2) as terminal information 702, and the location information of terminal #1 of 101_1 (and the terminal information of terminal #2 of 101_2) as location information 703 to server 104.

[0279] At this point, server 104, for example, based on the cell ID information 701, knows the ID of the real space (in this case, real space #1), and accordingly... Figure 4B The "real-world ID and virtual-world ID" allow the character corresponding to terminal #1 of 101_1 to appear in virtual-world #1. Furthermore, the detailed work process is the same as previously described.

[0280] In this way, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and the cell" where the terminal exists by further associating the "real space ID and virtual space ID" with the cell ID.

[0281] Additionally, the terminals (here, terminal #1 of 101_1 and terminal #2 of 101_2) can also... Figure 7B The information shown is sent to base station #1 of 102_1. Therefore, the terminal can obtain the cell ID information included in the modulation signal sent by base station #1 of 102_1, and send the cell ID information 751 to base station #1 of 102_1. Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to base station #1 of 102_1. Then, base station #1 of 102_1 transmits this information to server 104.

[0282] Figure 8 An example of a real-world space and base station configuration is shown. Additionally, regarding... Figure 1 The same job is assigned the same number.

[0283] like Figure 8 As shown, the inner side of ellipse 100_0 is set as real space #0, the inner side of ellipse 100_1 is set as real space #1, the inner side of ellipse 100_2 is set as real space #2, ...

[0284] Therefore, the communication range of base station #0_0 of 102_0_0 includes real space #0, and the communication range of base station #0_1 of 102_0_1 also includes real space #0. Furthermore, other base stations may also have real space #0 as their communication range.

[0285] Additionally, base station #0_0 of 102_0_0 and base station #0_1 of 102_0_1 are... Figure 1 , Figure 5 It communicates with server 104 in the middle.

[0286] At this time, base station #0_0 of 102_0_0 sends a message to server 104. Figure 7A The information shown.

[0287] like Figure 7A As shown, base station #0_0 of 102_0_0 sends the cell ID information 701, the terminal information 702, and the location information 703 to server 104.

[0288] Additionally, base station #0_0 of 102_0_0 communicates with terminal #1 of 101_1, for example.

[0289] For example, base station #0_0 of 102_0_0 sends the cell ID information 701, the terminal information of terminal #1 of 101_1 as terminal information 702, and the location information of terminal #1 of 101_1 as location information 703 to server 104.

[0290] At this point, server 104, for example, based on the cell ID information 701, knows the ID of the real space (in this case, real space #0), and accordingly... Figure 4B The "real-world ID and virtual-world ID" allow the character corresponding to terminal #1 of 101_1 to appear in virtual-world #0. Furthermore, the detailed work process is the same as previously described.

[0291] In this way, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and the cell" where the terminal exists by further associating the "real space ID and virtual space ID" with the cell ID.

[0292] Additionally, the terminal (in this case, terminal #1 of 101_1) can also... Figure 7B The information shown is sent to base station #0_0 of 102_0_0.

[0293] Therefore, the terminal can obtain the cell ID information included in the modulation signal sent by base station #0_0 of 102_0_0, and send the cell ID information 751 to base station #0_0 of 102_0_0.

[0294] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to base station #0_0 of 102_0_0. Then, base station #0_0 of 102_0_0 transmits this information to server 104.

[0295] Furthermore, base station #0_1 of 102_0_1 sends a message to server 104. Figure 7A The information shown.

[0296] like Figure 7A As shown, base station #0_1 of 102_0_1 sends the cell ID information 701, the terminal information 702, and the location information 703 to server 104.

[0297] Additionally, base station #0_1 of 102_0_1 communicates with terminal #2 of 101_2, for example.

[0298] For example, base station #0_1 of 102_0_1 sends the cell ID information 701, the terminal information of terminal #2 of 101_2 as terminal information 702, and the location information of terminal #2 of 101_2 as location information 703 to server 104.

[0299] At this point, server 104, for example, based on the cell ID information 701, knows the ID of the real space (in this case, real space #0), and accordingly... Figure 4BThe "real space ID and virtual space ID" allow the character corresponding to terminal #2 of 101_2 to appear in virtual space #0. Furthermore, the details of the work are the same as those already explained.

[0300] In this way, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and the cell" where the terminal exists by further associating the "real space ID and virtual space ID" with the cell ID.

[0301] Additionally, the terminal (in this case, terminal #2 of 101_2) can also... Figure 7B The information shown is sent to base station #0_1 of 102_0_1.

[0302] Therefore, the terminal can obtain the cell ID information included in the modulation signal sent by base station #0_1 of 102_0_1, and send the cell ID information 751 to base station #0_1 of 102_0_1.

[0303] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to base station #0_1 of 102_0_1. Then, base station #0_1 of 102_0_1 transmits this information to server 104.

[0304] Thus, for example Figure 8 As shown, there are multiple base stations in the real space #0, and based on this, the real space #0 is associated with multiple cell IDs.

[0305] The communication range of base station #1_0 (102_1_0) includes real space #1, and the communication range of base station #1_1 (102_1_1) also includes real space #1. Additionally, other base stations may also have real space #1 as their communication range.

[0306] Additionally, base station #1_0 of 102_1_0 and base station #1_1 of 102_1_1 are... Figure 1 , Figure 5 It communicates with server 104 in the middle.

[0307] At this time, base station #1_0 of 102_1_0 sends a message to server 104. Figure 7A The information shown.

[0308] like Figure 7A As shown, base station #1_0 of 102_1_0 sends the cell ID information 701, the terminal information 702, and the location information 703 to server 104.

[0309] Additionally, base station #1_0 of 102_1_0 communicates with terminal #3 of 101_3, for example.

[0310] For example, base station #1_0 of 102_1_0 sends the cell ID information 701, the terminal information of terminal #3 of 101_3 as terminal information 702, and the location information of terminal #3 of 101_3 as location information 703 to server 104.

[0311] At this point, server 104, for example, based on the cell ID information 701, knows the ID of the real space (in this case, real space #1), and accordingly... Figure 4B The "real-world ID and virtual-world ID" allow the character corresponding to terminal #3 of 101_3 to appear in virtual-world #1. Furthermore, the detailed work process is the same as previously described.

[0312] In this way, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and the cell" where the terminal exists by further associating the "real space ID and virtual space ID" with the cell ID.

[0313] Additionally, the terminal (in this case, terminal #3 of 101_3) can... Figure 7B The information shown is sent to base station #1_0 of 102_1_0.

[0314] Therefore, the terminal can obtain the cell ID information included in the modulation signal sent by base station #1_0 of 102_1_0, and send the cell ID information 751 to base station #1_0 of 102_1_0.

[0315] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to base station #1_0 of 102_1_0. Then, base station #1_0 of 102_1_0 transmits this information to server 104.

[0316] Furthermore, base station #1_1 of 102_1_1 sends a message to server 104. Figure 7A The information shown.

[0317] like Figure 7A As shown, base station #1_1 of 102_1_1 sends the cell ID information 701, the terminal information 702, and the location information 703 to server 104.

[0318] Additionally, base station #1_1 of 102_1_1 communicates with terminal #4 of 101_4, for example.

[0319] For example, base station #1_1 of 102_1_1 sends the cell ID information 701, the terminal information of terminal #4 of 101_4 as terminal information 702, and the location information of terminal #4 of 101_4 as location information 703 to server 104.

[0320] At this point, server 104, for example, based on the cell ID information 701, knows the ID of the real space (in this case, real space #1), and accordingly... Figure 4B The "real-world ID and virtual-world ID" allow the character corresponding to terminal #4 of 101_4 to appear in virtual-world #1. Furthermore, the detailed work is the same as previously described.

[0321] In this way, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and the cell" where the terminal exists by further associating the "real space ID and virtual space ID" with the cell ID.

[0322] Additionally, the terminal (in this case, terminal #4 of 101_4) can also... Figure 7B The information shown is sent to base station #1_1 of 102_1_1.

[0323] Therefore, the terminal obtains the cell ID information included in the modulation signal sent by base station #1_1 of 102_1_1, and sends the cell ID information 751 to base station #1_1 of 102_1_1.

[0324] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to base station #1_1 of 102_1_1. Then, base station #1_1 of 102_1_1 transmits this information to server 104.

[0325] Thus, for example Figure 8 As shown, there are multiple base stations in the real space #1, and therefore, the real space #1 can be associated with multiple cell IDs.

[0326] Furthermore, the communication range of base station #2_0 (102_2_0) includes real space #2, and the communication range of base station #2_1 (102_2_1) also includes real space #2. Additionally, other base stations may also have real space #2 as their communication range.

[0327] Figure 9 An example of a real-world space and base station configuration is shown. Additionally, regarding... Figure 1 The same job is assigned the same number.

[0328] like Figure 9As shown, the inner side of ellipse 100_0 is set as real space #0, the inner side of ellipse 100_1 is set as real space #1, the inner side of ellipse 100_2 is set as real space #2, ...

[0329] Therefore, the communication range of base station #0 of 102_0 includes real space #0, real space #1, and real space #2.

[0330] Additionally, base station #0 of 102_0 and Figure 1 , Figure 5 It communicates with server 104 in the middle.

[0331] At this time, base station #0 of 102_0 sends a message to server 104. Figure 7A The information shown.

[0332] like Figure 7A As shown, base station #0 of 102_0 sends the cell ID information 701, the terminal information 702, and the location information 703 to server 104.

[0333] Additionally, base station #0 of 102_0 communicates with terminal #5 of 101_5, for example.

[0334] For example, base station #0 of 102_0 sends the cell ID information 701, the terminal information of terminal #5 of 101_5 as terminal information 702, and the location information of terminal #5 of 101_5 as location information 703 to server 104.

[0335] At this point, server 104, for example, based on the cell ID information 701, knows the ID of the real space (here, any one of real space #0, real space #1, or real space #2), and accordingly... Figure 4B The "real space ID and virtual space ID" allow the character corresponding to terminal #1 of 101_1 to appear in any of the virtual spaces #0, #1, or #2. Furthermore, the detailed working process is the same as previously described.

[0336] In this way, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and the cell" where the terminal exists by further associating the "real space ID and virtual space ID" with the cell ID.

[0337] Additionally, the terminal (in this case, terminal #1 of 101_1) can... Figure 7B The information shown is sent to base station #0 of 102_0.

[0338] Therefore, the terminal can obtain the cell ID information included in the modulation signal sent by base station #0 of 102_0, and send the cell ID information 751 to base station #0 of 102_0.

[0339] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to base station #0 of 102_0. Then, base station #0 of 102_0 transmits this information to server 104.

[0340] Thus, for example Figure 9 As shown, a base station can include multiple real spaces as the range within which it can communicate, and thus, a cell ID can be associated with multiple real spaces.

[0341] right Figure 2 Another example of the operation of the role control unit 213 based on the location in real space will be used to illustrate this.

[0342] Figure 4A An example of real space is shown. For example... Figure 4A As shown, in real space, the inner side of ellipse 100_0 is named real space #0, the inner side of ellipse 100_0 is named real space #1, and the inner side of ellipse 100_2 is named real space #2. Additionally, real spaces other than "real space #0, real space #1, and real space #2" can also exist in real space.

[0343] Figure 10A , Figure 10B It shows that Figure 4A Take, for example, the relationship between real space and virtual space.

[0344] For example, establish the following associations, etc.

[0345] • Establish associations between “Real Space #0” and “Virtual Space #0”, “Virtual Space #1”, and “Virtual Space #2”.

[0346] • Establish a connection between “Real Space #1”, “Real Space #2” and “Virtual Space #3”.

[0347] • Establish associations between “Real Space #3”, “Real Space #4”, “Virtual Space #4”, and “Virtual Space #5”.

[0348] • Establish associations between “Real Space #5”, “Real Space #6”, “Virtual Space #6”, “Virtual Space #7”, and “Virtual Space #8”.

[0349] • Establish associations between “Real Space #7”, “Real Space #8”, “Real Space #9”, and “Real Space #10” and “Virtual Space #9” and “Virtual Space #10”.

[0350] For example, "real space #X" and "virtual space #Y" (where X and Y are integers greater than or equal to 0) can be digital twins. However, "real space #X" and "virtual space #Y" may not be completely digital twins; for example, only a portion of "real space #X" and "virtual space #Y" may be digital twins. Furthermore, the sizes of the spaces represented by "real space #X" and "virtual space #Y" can be the same or different.

[0351] Furthermore, the relationship between the positions in "virtual space #Y" and the positions in "real space #X" can be determined when the positions in "real space #X" are determined.

[0352] right Figure 2 The working example of the role control unit 213 based on the position in real space will be explained.

[0353] Other examples Figure 11 As shown, the terminal communicates with the base station, and the terminal and the base station perform sensing-related tasks. Thus, the base station can communicate with the server 104 via network 103.

[0354] For example, terminal #1 of 101_1 exists Figure 10A In the real space #0 recorded in the diagram, terminal #1 of 101_1 and base station #0 of 102_0 work together to perform sensing-related tasks. (Base station #0 of 102_0 is a base station with real space #0 within its communication range.) Accordingly, base station #0 of 102_0 and terminal #1 of 101_1 share the location information of terminal #1 of 101_1 in real space #0. At this time, the location information of terminal #1 of 101_1 in real space #0 can be "absolute location information such as the longitude and latitude of terminal #1 of 101_1", or it can be "the difference between the location of terminal #1 of 101_1 and the location of base station #0 of 102_0 (which can also be called relative location information)".

[0355] Therefore, base station #0 of 102_0 transmits the location information of terminal #1 of 101_1 in real space #0 to server 104 (it can also transmit the cell ID of base station #0 of 102_0). Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #0, thus knowing "the location of terminal #1 of 101_1 in real space #0". Furthermore, if server 104 obtains "the difference information between the location of terminal #1 of 101_1 and the location of base station #0 of 102_0" as the location information of terminal #1 of 101_1 in real space #0, server 104 can obtain the location information of base station #0 of 102_0. Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #0, thus knowing "the location of terminal #1 of 101_1 in real space #0". Furthermore, server 104 obtains information about terminal #1 of 101_1 from terminal #1 of 101_1 via base station #0 of 102_0.

[0356] Server 104 Figure 2 The role information storage unit 212 shown for each terminal obtains the information of terminal #1 of 101_1 and outputs the role information corresponding to terminal #1 of 101_1.

[0357] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of terminal #1 of 101_1 in real space #0, and outputs information for controlling the position of the role corresponding to terminal #1 of 101_1 in virtual space #0, or virtual space #1, or virtual space #2 that has been associated with real space #0.

[0358] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #1 of 101_1" output by the role information storage unit 212 of each terminal, and the "information for controlling the position of the role corresponding to terminal #1 of 101_1 in virtual spaces #0, #1, and #2 that are associated with real space #0" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #1 of 101_1" in any one of virtual spaces #0, #1, and #2 that are associated with real space #0 at the "position of the role corresponding to terminal #1 of 101_1 in virtual spaces #0, #1, and #2 that are associated with real space #0". The server 104... Figure 2The output information generation unit 214 shown generates output information about virtual spaces #0, #1, and #2 containing "the role corresponding to terminal #1 of 101_1", including an output signal 202 that outputs the output information about virtual spaces #0, #1, and #2 containing "the role corresponding to terminal #1 of 101_1" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0359] Therefore, when terminal #1 of 101_1 moves in real space #0, and the position of terminal #1 of 101_1 in real space #0 is updated, according to the above description, the position of the "role corresponding to terminal #1 of 101_1" in virtual spaces #0, #1, and #2, which are associated with real space #0, is updated, and this is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #0, virtual spaces #1, and virtual spaces #2 containing "the role corresponding to terminal #1 of 101_1", and the output signal 202 is output from the server 104.

[0360] Furthermore, in the above description, terminal #1 of 101_1 uses its GPS or other location estimation system to estimate its own position in real space #0. Alternatively, base station #0 of 102_0 and terminal #1 of 101_1 can share the location information of terminal #1 of 101_1 in real space #0. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way.

[0361] Furthermore, although the explanation was given using terminal #1 of 101_1 and base station #0 of 102_0, the same implementation can be achieved using other terminals and other base stations.

[0362] Therefore, terminal #1 of, for example, 101_1, moves to... Figure 10AThe real space #1. Terminal #1 of 101_1, for example, links with base station #1 of 102_1 to perform sensing-related tasks. (Base station #1 of 102_1 is a base station with a communication range of real space #1.) Accordingly, base station #1 of 102_1 and terminal #1 of 101_1 share the location information of terminal #1 of 101_1 in real space #1. At this time, the location information of terminal #1 of 101_1 in real space #1 can be "absolute location information such as longitude and latitude of terminal #1 of 101_1", or it can be "differential information between the location of terminal #1 of 101_1 and the location of base station #1 of 102_1 (also called relative location information)".

[0363] Therefore, base station #1 of 102_1 transmits the location information of terminal #1 of 101_1 in real space #1 to server 104. Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #1, thus knowing "the location of terminal #1 of 101_1 in real space #1". Additionally, if server 104 obtains "the difference between the location of terminal #1 of 101_1 and the location of base station #1 of 102_1" as the location information of terminal #1 of 101_1 in real space #1, server 104 can also obtain the location information of base station #1 of 102_1. Based on this, server 104 obtains the location information of terminal #1 of 101_1 in real space #1, thus knowing "the location of terminal #1 of 101_1 in real space #1". Furthermore, server 104 obtains information about terminal #1 of 101_1 from terminal #1 of 101_1 via base station #1 of 102_1.

[0364] Server 104 Figure 2 The role information storage unit 212 shown for each terminal obtains the information of terminal #1 of 101_1 and outputs the role information corresponding to terminal #1 of 101_1.

[0365] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of terminal #1 of 101_1 in real space #1, and outputs information for controlling the position of the role corresponding to terminal #1 of 101_1 in virtual space #3 which has established correspondence with real spaces #1 and #2.

[0366] Therefore, server 104 Figure 2The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #1 of 101_1" output by the role information storage unit 212 of each terminal, and the "information for controlling the position of the role corresponding to terminal #1 of 101_1 in the virtual space #3 corresponding to real spaces #1 and #2" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #1 of 101_1" to the "position of the role corresponding to terminal #1 of 101_1 in the virtual space #3 corresponding to real spaces #1 and #2" in the virtual space #3. The server 104... Figure 2 The output information generation unit 214 shown generates output information about the virtual space #3 containing "the role corresponding to terminal #1 of 101_1", including an output signal 202 that outputs the output information about the virtual space #3 containing "the role corresponding to terminal #1 of 101_1" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0367] Therefore, terminal #1 of 101_1 moves in real space #1. When the position of terminal #1 of 101_1 in real space #1 is updated, according to the above description, the position of "the role corresponding to terminal #1 of 101_1" in the virtual space #3, which is corresponding to real spaces #1 and #2, is updated, and this is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about the virtual space #3 containing "the role corresponding to terminal #1 of 101_1", and the output signal 202 is output from the server 104.

[0368] Furthermore, in the above description, terminal #1 of 101_1 uses its GPS or other location estimation system to estimate its own position in real space #1. Alternatively, base station #1 of 102_1 can share the location information of terminal #1 of 101_1 in real space #1 with terminal #1 of 101_1. Regarding other operations, as long as they are performed as described above, the same implementation can be achieved.

[0369] Furthermore, although the explanation was given using terminal #1 of 101_1 and base station #1 of 102_1, the same implementation can be achieved using other terminals and other base stations.

[0370] right Figure 2 The operation of the role control unit 213, which is based on the location in real space, will be explained.

[0371] Other examples Figure 11As shown, the terminal communicates with the base station, and both the terminal and the base station perform sensing-related tasks. The base station then communicates with the server 104 via network 103.

[0372] For example, terminal #2 of 101_2 exists Figure 10A In the real space #1 recorded in the diagram, terminal #2 of 101_2 and base station #1 of 102_1 work together to perform sensing-related tasks. (Base station #1 of 102_1 is a base station with a communication range of real space #1.) Accordingly, base station #1 of 102_1 and terminal #2 of 101_2 share the location information of terminal #2 of 101_2 in real space #1. At this time, the location information of terminal #2 of 101_2 in real space #1 can be "absolute location information such as longitude and latitude of terminal #2 of 101_2", or it can be "differential information between the location of terminal #2 of 101_2 and the location of base station #1 of 102_1 (also called relative location information)".

[0373] Therefore, base station #1 of 102_1 transmits the location information of terminal #2 of 101_2 in its real space #1 to server 104 (it can also transmit the cell ID of base station #1 of 102_1). Based on this, server 104 obtains the location information of terminal #2 of 101_2 in its real space #1, thus knowing "the location of terminal #2 of 101_2 in its real space #1". Alternatively, if server 104 obtains "the difference information between the location of terminal #2 of 101_2 and the location of base station #1 of 102_1" as the location information of terminal #2 of 101_2 in its real space #1, server 104 can also obtain the location information of base station #1 of 102_1. Based on this, server 104 obtains the location information of terminal #2 of 101_2 in its real space #1, thus knowing "the location of terminal #2 of 101_2 in its real space #1". Furthermore, server 104 obtains information about terminal #2 of 101_2 from terminal #2 of 101_2 via base station #1 of 102_1.

[0374] Server 104 Figure 2 The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #2 of 101_2 because it obtains the information of terminal #2 of 101_2.

[0375] Furthermore, server 104 Figure 2The position-based role control unit 213 shown in the real space obtains the position information of the terminal #2 of 101_2 in the real space #1, and outputs information for controlling the position of the character corresponding to the terminal #2 of 101_2 in the virtual space #3 that has established a correspondence with the real spaces #1 and #2.

[0376] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #2 of 101_2" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #2 of 101_2 in the virtual space #3 corresponding to real spaces #1 and #2" output by the role control unit 213 based on the position in the real space, configures the "role corresponding to terminal #2 of 101_2" to the "position of the role corresponding to terminal #2 of 101_2 in the virtual space #3 corresponding to real spaces #1 and #2" in the server 104. Figure 2 The output information generation unit 214 shown generates output information about the virtual space #3 containing the "role corresponding to terminal #2 of 101_2", including an output signal 202 that outputs the output information about the virtual space #3 containing the "role corresponding to terminal #2 of 101_2" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0377] Therefore, terminal #2 of 101_2 moves in real space #1. When the position of terminal #2 of 101_2 in real space #1 is updated, according to the above description, the position of the "role corresponding to terminal #2 of 101_2" in the virtual space #3 corresponding to real spaces #1 and #2 is updated, and this is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about the virtual space #3 containing "the role corresponding to terminal #2 of 101_2", and the output signal 202 is output from the server 104.

[0378] Furthermore, as described above, terminal #2 of 101_2 uses its GPS or other location estimation system to estimate its own position in real space #1. Alternatively, base station #2 of 102_2 and terminal #2 of 101_2 can share the location information of terminal #2 of 101_2 in real space #1. Other operations can be implemented in the same way as described above.

[0379] Furthermore, although the explanation was given using terminal #2 of 101_2 and base station #1 of 102_1, the same implementation can be achieved using other terminals and other base stations.

[0380] Therefore, for example, terminal #2 of 101_2 moves to Figure 10A The real space #3 in the system. Terminal #2 of 101_2, for example, links with base station #3 of 102_3 to perform sensing-related tasks. (Base station #3 of 102_3 is a base station with a communication range of real space #3.) Accordingly, base station #3 of 102_3 and terminal #2 of 101_2 share the location information of terminal #2 of 101_2 in real space #3. At this time, the location information of terminal #2 of 101_2 in real space #3 can be "absolute location information such as longitude and latitude of terminal #2 of 101_2", or it can be "differential information between the location of terminal #2 of 101_2 and the location of base station #3 of 102_3 (also called relative location information)".

[0381] Therefore, base station #3 of 102_3 transmits the location information of terminal #2 of 101_2 in its real space #3 to server 104. Based on this, server 104 obtains the location information of terminal #2 of 101_2 in its real space #3, thus knowing the "location of terminal #2 of 101_2 in its real space #3". Furthermore, if server 104 obtains the "difference information between the location of terminal #2 of 101_2 and the location of base station #3 of 102_3" based on the location information of terminal #2 of 101_2 in its real space #3, server 104 can also obtain the location information of base station #3 of 102_3. Based on this, server 104 obtains the location information of terminal #2 of 101_2 in its real space #3, thus knowing the "location of terminal #2 of 101_2 in its real space #3". Moreover, server 104 obtains information about terminal #2 of 101_2 from terminal #2 of 101_2 via base station #3 of 102_3.

[0382] Server 104 Figure 2 The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #2 of 101_2 because it obtains the information of terminal #2 of 101_2.

[0383] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of the terminal #2 of 101_2 in the real space #3, and outputs information for controlling the position of the character corresponding to the terminal #2 of 101_2 in the virtual spaces #4 and #5 that have been established with the real spaces #3 and #4.

[0384] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #2 of 101_2" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #2 of 101_2 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #2 of 101_2" in the "position of the role corresponding to terminal #2 of 101_2 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" in the virtual spaces #4 and #5 of the server 104. Figure 2 The output information generation unit 214 shown generates output information about virtual spaces #4 and #5 containing "the role corresponding to terminal #2 of 101_2", including an output signal 202 about the output information of virtual spaces #4 and #5 containing "the role corresponding to terminal #1 of 101_1", which is output from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0385] Therefore, terminal #2 of 101_2 moves in real space #3. When the position of terminal #2 of 101_2 in real space #3 is updated, according to the above description, the position of the "role corresponding to terminal #2 of 101_2" in virtual spaces #4 and #5, which are corresponding to real spaces #3 and #4, is updated, and this is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #4 and #5 containing “roles corresponding to terminal #2 of 101_2”, and the output signal 202 is output from the server 104.

[0386] Furthermore, in the above description, terminal #2 of 101_2 uses its GPS or other location estimation system to estimate its own position in real space #3. Alternatively, base station #3 of 102_3 can share the location information of terminal #2 of 101_2 in real space #3. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way.

[0387] Furthermore, although the explanation was given using terminal #2 of 101_2 and base station #3 of 102_3, the same implementation can be achieved using other terminals and other base stations.

[0388] right Figure 2The operation of the role control unit 213, which is based on the location in real space, will be explained.

[0389] Other examples Figure 11 As shown, the terminal communicates with the base station, and both the terminal and the base station perform sensing-related tasks. The base station then communicates with the server 104 via network 103.

[0390] For example, terminal #3 of 101_3 exists Figure 10A In the real space #3 recorded in the diagram, terminal #3 of 101_3 and base station #3 of 102_3 work together to perform sensing-related tasks. (Base station #3 of 102_3 is a base station with a communication range of real space #3.) Accordingly, base station #3 of 102_3 and terminal #3 of 101_3 share the location information of terminal #3 of 101_3 in real space #3. At this time, the location information of terminal #3 of 101_3 in real space #3 can be "absolute location information such as longitude and latitude of terminal #3 of 101_3", or it can be "differential information between the location of terminal #3 of 101_3 and the location of base station #3 of 102_3 (also called relative location information)".

[0391] Therefore, base station #3 of 102_3 transmits the location information of terminal #3 of 101_3 in real space #3 to server 104 (it can also transmit the cell ID of base station #3 of 102_3). Based on this, server 104 obtains the location information of terminal #3 of 101_3 in real space #3, thus knowing "the location of terminal #3 of 101_3 in real space #3". Alternatively, if server 104 obtains "the difference information between the location of terminal #3 of 101_3 and the location of base station #3 of 102_3" as the location information of terminal #3 of 101_3 in real space #3, server 104 can also obtain the location information of base station #3 of 102_3. Based on this, server 104 obtains the location information of terminal #3 of 101_3 in real space #3, thus knowing "the location of terminal #3 of 101_3 in real space #3". Furthermore, server 104 obtains information about terminal #3 of 101_3 from terminal #3 of 101_3 via base station #3 of 102_3.

[0392] Server 104 Figure 2 The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #3 of 101_3 because it obtains the information of terminal #3 of 101_3.

[0393] Furthermore, server 104 Figure 2The role control unit 213 shown in the real space position obtains the position information of terminal #3 of 101_3 in real space #3, and outputs information for controlling the position of the role corresponding to terminal #3 of 101_3 in virtual space #4 and virtual space #5, which are corresponding to real space #3 and #4.

[0394] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #3 of 101_3" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #3 of 101_3 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #3 of 101_3" to the "position of the role corresponding to terminal #3 of 101_3 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" in virtual spaces #4 and #5 of server 104. Figure 2 The output information generation unit 214 shown generates output information about virtual spaces #4 and #5 containing "the role corresponding to terminal #3 of 101_3", including an output signal 202 that outputs the output information about virtual spaces #4 and #5 containing "the role corresponding to terminal #3 of 101_3" from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0395] Therefore, terminal #3 of 101_3 moves in real space #3. When the position of terminal #3 of 101_3 in real space #3 is updated, according to the above description, the position of the "role corresponding to terminal #3 of 101_3" in virtual space #4 and virtual space #5, which are corresponding to real spaces #3 and #4, is updated. This is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #4 and virtual spaces #5 containing “roles corresponding to terminal #3 of 101_3”, and the output signal 202 is output from the server 104.

[0396] Furthermore, as described above, terminal #3 of 101_3 uses its GPS or other location estimation system to estimate its own position in real space #3. Alternatively, base station #3 of 102_3 and terminal #3 of 101_3 can share the location information of terminal #3 of 101_3 in real space #3. Regarding other operations, as long as they are performed as described above, the same implementation can be achieved.

[0397] Furthermore, although the explanation was given using terminal #3 of 101_3 and base station #3 of 102_3, the same implementation can be achieved using other terminals and other base stations.

[0398] Therefore, terminal #3 of, for example, 101_3, is moved to... Figure 10B In the real space #5, terminal #3 of 101_3, for example, links with base station #5 of 102_5 to perform sensing-related tasks. (Base station #5 of 102_5 is a base station with a communication range of real space #5.) Accordingly, base station #5 of 102_5 and terminal #3 of 101_3 share the location information of terminal #3 of 101_3 in real space #5. At this time, the location information of terminal #3 of 101_3 in real space #5 can be "absolute location information such as longitude and latitude of terminal #3 of 101_3", or it can be "differential information between the location of terminal #3 of 101_3 and the location of base station #5 of 102_5 (also called relative location information)".

[0399] Therefore, base station #5 of 102_5 transmits the location information of terminal #3 of 101_3 in real space #5 to server 104. Based on this, server 104 obtains the location information of terminal #3 of 101_3 in real space #5, thus knowing "the location of terminal #3 of 101_3 in real space #5". Furthermore, if server 104 obtains "the difference information between the location of terminal #3 of 101_3 and the location of base station #5 of 102_5" as the location information of terminal #3 of 101_3 in real space #5, server 104 can also obtain the location information of base station #5 of 102_5. Based on this, server 104 obtains the location information of terminal #3 of 101_3 in real space #5, thus knowing "the location of terminal #3 of 101_3 in real space #5". Moreover, server 104 obtains information about terminal #3 of 101_3 from terminal #3 of 101_3 via base station #5 of 102_5.

[0400] Server 104 Figure 2 The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #3 of 101_3 because it obtains the information of terminal #3 of 101_3.

[0401] Furthermore, server 104 Figure 2The role control unit 213 shown in the real space position obtains the position information of terminal #3 of 101_3 in real space #5, and outputs information for controlling the position of the role corresponding to terminal #3 of 101_3 in virtual spaces #6, #7, and #8 that have established corresponding real spaces #5 and #6.

[0402] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #3 of 101_3" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #3 of 101_3 in virtual spaces #6, #7, and #8 corresponding to real spaces #5 and #6" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #3 of 101_3" to the "position of the role corresponding to terminal #3 of 101_3 in virtual spaces #6, #7, and #8 corresponding to real spaces #5 and #6" in virtual spaces #6, #7, and #8 of server 104. Figure 2 The output information generation unit 214 shown generates output information about virtual spaces #6, #7, and #8 containing "the role corresponding to terminal #3 of 101_3", including an output signal 202 about the output information about virtual spaces #6, #7, and #8 containing "the role corresponding to terminal #1 of 101_1", which is output from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0403] Therefore, terminal #3 of 101_3 moves to real space #5. When the position of terminal #3 of 101_3 in real space #5 is updated, following the above description, the positions of the "roles corresponding to terminal #3 of 101_3" in virtual spaces #6, #7, and #8, which are corresponding to real spaces #5 and #6, are updated, and this is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #6, #7, and #8 containing “roles corresponding to terminal #3 of 101_3”, and the output signal 202 is output from the server 104.

[0404] Furthermore, as described above, terminal #3 of 101_3 uses its GPS or other location estimation system to estimate its own position in real space #5. Alternatively, base station #5 of 102_5 can share the location information of terminal #3 of 101_3 in real space #5 with terminal #3 of 101_3. Other operations can be implemented in the same way as described above.

[0405] Furthermore, although the explanation was given using terminal #3 of 101_3 and base station #5 of 102_5, the same implementation can be achieved using other terminals and other base stations.

[0406] right Figure 2 The operation of the role control unit 213, which is based on the location in real space, will be explained.

[0407] Other examples Figure 11 As shown, the terminal communicates with the base station, and both the terminal and the base station perform sensing-related tasks. The base station then communicates with the server 104 via network 103.

[0408] For example, terminal #4 of 101_4 exists Figure 10B In the real space #5 recorded in the diagram, terminal #4 of 101_4 and base station #5 of 102_5 work together to perform sensing-related tasks. (Base station #5 of 102_5 is a base station with a communication range of real space #5.) Accordingly, base station #5 of 102_5 and terminal #4 of 101_4 share the location information of terminal #4 of 101_4 in real space #5. At this time, the location information of terminal #4 of 101_4 in real space #5 can be "absolute location information such as longitude and latitude of terminal #4 of 101_4", or it can be "differential information between the location of terminal #4 of 101_4 and the location of base station #5 of 102_5 (also called relative location information)".

[0409] Therefore, base station #5 of 102_5 transmits the location information of terminal #4 of 101_4 in real space #5 to server 104 (it can also transmit the cell ID of base station #5 of 102_5). Based on this, server 104 obtains the location information of terminal #4 of 101_4 in real space #5, thus knowing "the location of terminal #4 of 101_4 in real space #5". Furthermore, if server 104 obtains "the difference information between the location of terminal #4 of 101_4 and the location of base station #5 of 102_5" as the location information of terminal #4 of 101_4 in real space #5, server 104 can obtain the location information of base station #5 of 102_5. Based on this, server 104 obtains the location information of terminal #4 of 101_4 in real space #5, thus knowing "the location of terminal #4 of 101_4 in real space #5". Furthermore, server 104 obtains information about terminal #4 of 101_4 from terminal #4 of 101_4 via base station #5 of 102_5.

[0410] Server 104 Figure 2The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #4 of 101_4 because it obtains the information of terminal #4 of 101_4.

[0411] Furthermore, server 104 Figure 2 The role control unit 213 shown, which is based on the location in the real space, obtains the position information of terminal #4 of 101_4 in the real space #5, and outputs information for controlling the position of the character corresponding to terminal #4 of 101_4 in the virtual spaces #6, #7, and #8 that have been established with the real spaces #5 and #6.

[0412] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #4 of 101_4" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #4 of 101_4 in virtual spaces #6, #7, and #8 corresponding to real spaces #5 and #6" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #4 of 101_4" to the "position of the role corresponding to terminal #4 of 101_4 in virtual spaces #6, #7, and #8 corresponding to real spaces #5 and #6" in virtual spaces #6, #7, and #8 of server 104. Figure 2 The output information generation unit 214 shown generates output information about virtual spaces #6, #7, and #8 containing the "role corresponding to terminal #4 of 101_4", including an output signal 202 that outputs the output information about virtual spaces #6, #7, and #8 containing the "role corresponding to terminal #4 of 101_4" from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0413] Therefore, terminal #4 of 101_4 moves in real space #5. When the position of terminal #4 of 101_4 in real space #5 is updated, according to the above description, the position of the "role corresponding to terminal #4 of 101_4" in virtual spaces #6, #7, and #8, which are corresponding to real spaces #5 and #6, is updated. This is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #6, #7, and #8 containing “roles corresponding to terminal #4 of 101_4”, and the output signal 202 is output from the server 104.

[0414] Furthermore, as described above, terminal #4 of 101_4 uses its GPS or other location estimation system to estimate its own position in real space #5. Alternatively, base station #5 of 102_5 can share the location information of terminal #4 of 101_4 in real space #5 with terminal #4 of 101_4. Other operations can be implemented in the same way as described above.

[0415] Furthermore, although the explanation was provided using terminal #4 of 101_4 and base station #5 of 102_5, the same implementation can be achieved using other terminals and other base stations.

[0416] Therefore, terminal #4 of, for example, 101_4, moves to... Figure 10B The real space #7. Terminal #4 of 101_4, for example, links with base station #7 of 102_7 to perform sensing-related tasks. (Base station #7 of 102_7 is a base station with a communication range of real space #7.) Accordingly, base station #7 of 102_7 and terminal #4 of 101_4 share the location information of terminal #4 of 101_4 in real space #7. At this time, the location information of terminal #4 of 101_4 in real space #7 can be "absolute location information such as longitude and latitude of terminal #4 of 101_4" or "differential information between the location of terminal #4 of 101_4 and the location of base station #7 of 102_7" (which can also be called relative location information).

[0417] Therefore, base station #7 of 102_7 transmits the location information of terminal #4 of 101_4 in real space #7 to server 104. Based on this, server 104 obtains the location information of terminal #4 of 101_4 in real space #7, thus knowing "the location of terminal #4 of 101_4 in real space #7". Furthermore, if server 104 obtains "the difference between the location of terminal #4 of 101_4 and the location of base station #7 of 102_7" as the location information of terminal #4 of 101_4 in real space #7, server 104 can obtain the location information of base station #7 of 102_7. Based on this, server 104 obtains the location information of terminal #4 of 101_4 in real space #7, thus knowing "the location of terminal #4 of 101_4 in real space #7". Moreover, server 104 obtains information about terminal #4 of 101_4 from terminal #4 of 101_4 via base station #7 of 102_7.

[0418] Server 104 Figure 2The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #4 of 101_4 because it obtains the information of terminal #4 of 101_4.

[0419] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of terminal #4 of 101_4 in real space #7, and outputs information for controlling the position of the role corresponding to terminal #4 of 101_4 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9 and #10.

[0420] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #4 of 101_4" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #4 of 101_4 in virtual spaces #9 and #10 corresponding to real spaces #7, #8, #9, and #10" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #4 of 101_4" to the "position of the role corresponding to terminal #4 of 101_4 in virtual spaces #9 and #10 corresponding to real spaces #7, #8, #9, and #10" in virtual spaces #9 and #10 of server 104. Figure 2 The output information generation unit 214 shown generates output information about virtual spaces #9 and #10 containing "the role corresponding to terminal #4 of 101_4", including an output signal 202 about the output information of virtual spaces #9 and #10 containing "the role corresponding to terminal #1 of 101_1", which is output from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0421] Therefore, terminal #4 of 101_4 moves in real space #7. When the position of terminal #4 of 101_4 in real space #7 is updated, according to the above description, the position of the "role corresponding to terminal #4 of 101_4" in virtual spaces #9 and #10, which are corresponding to real spaces #7, #8, #9, and #10, is updated. This is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #9 and #10 containing “roles corresponding to terminal #4 of 101_4”, and the output signal 202 is output from the server 104.

[0422] Furthermore, as described above, terminal #4 of 101_4 uses its GPS or other location estimation system to estimate its own position in real space #7. Alternatively, base station #7 of 102_7 can share the location information of terminal #4 of 101_4 in real space #7 with terminal #4 of 101_4. Other operations can be implemented in the same way as described above.

[0423] Furthermore, although the explanation was provided using terminal #4 of 101_4 and base station #7 of 102_7, the same implementation can be achieved using other terminals and other base stations.

[0424] right Figure 2 The operation of the role control unit 213, which is based on the location in real space, will be explained.

[0425] Other examples Figure 11 As shown, the terminal communicates with the base station, and both the terminal and the base station perform sensing-related tasks. The base station then communicates with the server 104 via network 103.

[0426] For example, terminal #5 of 101_5 exists Figure 10B In the real space #7 recorded in the diagram, terminal #5 of 101_5 and base station #7 of 102_7 work together to perform sensing-related tasks. (Base station #7 of 102_7 is a base station with a communication range of real space #7.) Accordingly, base station #7 of 102_7 and terminal #5 of 101_5 share the location information of terminal #5 of 101_5 in real space #7. At this time, the location information of terminal #5 of 101_5 in real space #7 can be "absolute location information such as longitude and latitude of terminal #5 of 101_5", or it can be "differential information between the location of terminal #5 of 101_5 and the location of base station #7 of 102_7 (also called relative location information)".

[0427] Therefore, base station #7 of 102_7 transmits the location information of terminal #5 of 101_5 in real space #7 to server 104 (it can also transmit the cell ID of base station #7 of 102_7). Based on this, server 104 obtains the location information of terminal #5 of 101_5 in real space #7, thus knowing "the location of terminal #5 of 101_5 in real space #7". Furthermore, if server 104 obtains "the difference information between the location of terminal #5 of 101_5 and the location of base station #7 of 102_7" as the location information of terminal #5 of 101_5 in real space #7, server 104 can obtain the location information of base station #7 of 102_7. Based on this, server 104 obtains the location information of terminal #5 of 101_5 in real space #7, thus knowing "the location of terminal #5 of 101_5 in real space #7". Furthermore, server 104 obtains information about terminal #5 of 101_5 from terminal #5 of 101_5 via base station #7 of 102_7.

[0428] Server 104 Figure 2 The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #5 of 101_5 because it obtains the information of terminal #5 of 101_5.

[0429] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of terminal #5 of 101_5 in real space #7, and outputs information for controlling the position of the role corresponding to terminal #5 of 101_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9 and #10.

[0430] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #5 of 101_5" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #5 of 101_5 in virtual spaces #9 and #10 corresponding to real spaces #7, #8, #9, and #10" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #5 of 101_5" to the "position of the role corresponding to terminal #5 of 101_5 in virtual spaces #9 and #10 corresponding to real spaces #7, #8, #9, and #10" in virtual spaces #9 and #10 of server 104. Figure 2The output information generation unit 214 shown generates output information about virtual spaces #9 and #10 containing "the role corresponding to terminal #5 of 101_5", including an output signal 202 that outputs the output information about virtual spaces #9 and #10 containing "the role corresponding to terminal #5 of 101_5" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0431] Therefore, terminal #5 of 101_5 moves in real space #7. When the position of terminal #5 of 101_5 in real space #7 is updated, according to the above description, the position of the "role corresponding to terminal #5 of 101_5" in virtual spaces #9 and #10, which are corresponding to real spaces #7, #8, #9, and #10, is updated. This is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #9 and #10 containing “roles corresponding to terminal #5 of 101_5”, and the output signal 202 is output from the server 104.

[0432] Furthermore, as described above, terminal #5 of 101_5 uses its GPS or other location estimation system to estimate its own position in real space #7. Alternatively, base station #7 of 102_7 can share the location information of terminal #5 of 101_5 in real space #7 with terminal #5 of 101_5. Regarding other operations, as long as they are performed as described above, the same implementation can be achieved.

[0433] Furthermore, although the explanation was given using terminal #5 of 101_5 and base station #7 of 102_7, the same implementation can be achieved using other terminals and other base stations.

[0434] Therefore, terminal #5 of 101_5, for example, moves to... Figure 10B The real space #9 in the system. Terminal #5 of 101_5, for example, links with base station #9 of 102_9 to perform sensing-related tasks. (Base station #9 of 102_9 is a base station with a communication range of real space #9.) Accordingly, base station #9 of 102_9 and terminal #5 of 101_5 share the location information of terminal #5 of 101_5 in real space #9. At this time, the location information of terminal #5 of 101_5 in real space #9 can be "absolute location information such as longitude and latitude of terminal #5 of 101_5", or it can be "differential information between the location of terminal #5 of 101_5 and the location of base station #9 of 102_9 (also called relative location information)".

[0435] Therefore, base station #9 of 102_9 transmits the location information of terminal #5 of 101_5 in real space #9 to server 104. Based on this, server 104 obtains the location information of terminal #5 of 101_5 in real space #9, thus knowing "the location of terminal #5 of 101_5 in real space #9". Additionally, if server 104 obtains "the difference between the location of terminal #5 of 101_5 and the location of base station #9 of 102_9" as the location information of terminal #5 of 101_5 in real space #9, server 104 can also obtain the location information of base station #9 of 102_9. Based on this, server 104 obtains the location information of terminal #5 of 101_5 in real space #9, thus knowing "the location of terminal #5 of 101_5 in real space #9". Furthermore, server 104 obtains information about terminal #5 of 101_5 from terminal #5 of 101_5 via base station #9 of 102_9.

[0436] Server 104 Figure 2 The role information storage unit 212 shown for each terminal outputs the role information corresponding to terminal #5 of 101_5 because it obtains the information of terminal #5 of 101_5.

[0437] Furthermore, server 104 Figure 2 The role control unit 213 shown in the real space position obtains the position information of terminal #5 of 101_5 in real space #9, and outputs information for controlling the position of the role corresponding to terminal #5 of 101_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9 and #10.

[0438] Therefore, server 104 Figure 2 The output information generation unit 214 shown in the diagram, based on information obtained from the spatial information storage unit 211, the "role information corresponding to terminal #5 of 101_5" output by the role information storage unit 212 for each terminal, and the "information for controlling the position of the role corresponding to terminal #5 of 101_5 in virtual spaces #9 and #10 corresponding to real spaces #7, #8, #9, and #10" output by the role control unit 213 based on the position in real space, configures the "role corresponding to terminal #5 of 101_5" to the "position of the role corresponding to terminal #5 of 101_5 in virtual spaces #9 and #10 corresponding to real spaces #7, #8, #9, and #10" in virtual spaces #9 and #10 of server 104. Figure 2The output information generation unit 214 shown generates output information about virtual spaces #9 and #10 containing "the role corresponding to terminal #5 of 101_5", including an output signal 202 about the output information of virtual spaces #9 and #10 containing "the role corresponding to terminal #1 of 101_1", which is output from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0439] Therefore, terminal #5 of 101_5 moves in real space #9. When the position of terminal #5 of 101_5 in real space #9 is updated, according to the above description, the position of the "role corresponding to terminal #5 of 101_5" in virtual spaces #9 and #10, which are corresponding to real spaces #7, #8, #9, and #10, is updated. This is done through server 104. Figure 2 The output information generation unit 214 shown generates an output signal 202 that includes output information about virtual spaces #9 and #10 containing “roles corresponding to terminal #5 of 101_5”, and the output signal 202 is output from the server 104.

[0440] Furthermore, as described above, terminal #5 of 101_5 uses its GPS or other location estimation system to estimate its own position in real space #9. Alternatively, base station #9 of 102_9 and terminal #5 of 101_5 can share the location information of terminal #5 of 101_5 in real space #9. Regarding other operations, as long as they are performed as described above, the same implementation can be achieved.

[0441] Furthermore, although the explanation was given using terminal #5 of 101_5 and base station #9 of 102_9, the same implementation can be achieved using other terminals and other base stations.

[0442] As described above, although the relationship between the ID in the real space and the ID in the virtual space, and the work of the various parts accompanying this relationship, the relationship between the ID in the real space and the ID in the virtual space is not subject to... Figure 10B As the examples are limited, as long as an association is established between the ID of one or more real spaces and the ID of one or more virtual spaces, it can be implemented as described above.

[0443] What will be explained next is that... Figure 10A , Figure 10BThe relationship between the real space and cell ID (identification) of the base stations existing in real space #0, real space #1, real space #2, real space #3, real space #4, real space #5, real space #6, real space #7, real space #8, real space #9, real space #10, ...

[0444] Base stations existing in real space #0, base stations existing in real space #1, base stations existing in real space #2, base stations existing in real space #3, base stations existing in real space #4, base stations existing in real space #5, base stations existing in real space #6, base stations existing in real space #7, base stations existing in real space #8, base stations existing in real space #9, base stations existing in real space #10, ... for example, could be... Figure 12 , Figure 13 , Figure 14 It exists in the form shown.

[0445] Figure 12 An example of a real-world space and base station configuration is shown. For example... Figure 12 As shown, the inner side of ellipse 100_a0 is considered as the real space #a0, the inner side of ellipse 100_a1 is considered as the real space #a1, the inner side of ellipse 100_a2 is considered as the real space #a2, and so on.

[0446] Therefore, the communication range of base station #b0 of 102_b0 includes real space #a0, the communication range of base station #b1 of 102_b1 includes real space #a1, and the communication range of base station #b2 of 102_b2 includes real space #a2.

[0447] Additionally, base station #b0 of 102_b0, base station #b1 of 102_b1, and base station #b2 of 102_b2 are as follows: Figure 11 It communicates with server 104 as shown.

[0448] At this time, base stations #b0 (102_b0), #b1 (102_b1), and #b2 (102_b2) send data to server 104. Figure 7A The information shown.

[0449] like Figure 7A As shown, the base station sends the cell ID information 701, the terminal information 702, and the location information 703 to the server 104.

[0450] For example, base station #b0, which becomes 102_b0, sends the cell ID information 701, the terminal information 702 that communicated with base station #b0 of 102_b0, and the location information 703 of other terminals to server 104.

[0451] At this point, server 104, for example, knows the ID of the real space (in this case, real space #a0) based on the cell ID information 701, and accordingly... Figure 10A , Figure 10B The system uses "real-world IDs and virtual-world IDs" to allow the corresponding character to appear in the virtual space. Furthermore, the detailed procedures are the same as previously described.

[0452] In this way, by further associating the "real space ID and virtual space ID" with the cell ID, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and cell" where the terminal exists.

[0453] In addition, the terminal can also... Figure 7B The information shown is sent to the base station (here, base station #b0 of 102_b0). Therefore, the terminal obtains the cell ID information included in the modulation signal sent by the base station and can send the cell ID information 751 to the base station. Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to the base station. The base station then transmits this information to the server 104.

[0454] Furthermore, although the relationship between real space and base stations is shown... Figure 12 However, Figure 12 This is just one example; the relationship between the real space and the base station (cell ID) is not influenced by... Figure 12 The examples are limited.

[0455] As an example, for example Figure 12 The base station #b0 of 102_b0 is able to communicate with terminals existing in "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)" (etc.) and can perform sensing processing.

[0456] At this time, the cell ID of base station #b0 of 102_b0 is associated with "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)" (etc.). That is, when base station #b0 of 102_b0 can communicate and perform sensing processing with the terminal existing in "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)", the terminal's role appears in the virtual space corresponding to "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)".

[0457] Figure 13 An example of a real-world space and base station configuration is shown. For example... Figure 13 As shown, the inner side of ellipse 100_a0 is considered as the real space #a0, the inner side of ellipse 100_a1 is considered as the real space #a1, the inner side of ellipse 100_a2 is considered as the real space #a2, and so on.

[0458] Therefore, the communication range of base station #b0_0 of 102_b0_0 includes real space #a0, and the communication range of base station #b0_1 of 102_b0_1 also includes real space #a0. Alternatively, other base stations may exist that use real space #a0 as their communication range.

[0459] Additionally, base station #b0_0 of 102_b0_0 and base station #b0_1 of 102_b0_1 are as follows: Figure 11 It communicates with server 104 as shown.

[0460] At this time, base stations such as #b0_0 of 102_b0_0 and #b0_1 of 102_b0_1 send data to server 104. Figure 7A The information shown.

[0461] like Figure 7A As shown, the base station sends the cell ID information 701, the terminal information 702, and the location information 703 to the server 104.

[0462] For example, base station #b0_0 of 102_b0_0 sends the cell ID information 701, the terminal information 702 communicating with base station #b0_0 of 102_b0_0, and the location information 703 of other terminals to server 104.

[0463] At this point, server 104, for example, knows the ID of the real space (in this case, real space #a0) based on the cell ID information 701, and accordingly... Figure 10A , Figure 10BThe "real-world ID and virtual-world ID" allow the character corresponding to the terminal to appear in the virtual space. Furthermore, the detailed working process is the same as previously described.

[0464] In this way, by further associating the "real space ID and virtual space ID" with the cell ID, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and cell" where the terminal exists.

[0465] In addition, the terminal can also... Figure 7B The information shown is sent to the base station (here, base station #b0_0 of 102_b0_0). Therefore, the terminal obtains the cell ID information included in the modulation signal sent by the base station and can send the cell ID information 751 to the base station.

[0466] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to the base station. The base station then transmits this information to the server 104.

[0467] Furthermore, base station #b0_1 of 102_b0_1 sends a message to server 104. Figure 7A The information shown.

[0468] like Figure 7A As shown, the base station sends the cell ID information 701, the terminal information 702, and the location information 703 to the server 104.

[0469] For example, base station #b0_1 of 102_b0_1 sends the cell ID information 701, the terminal information 702 communicating with base station #b0_1 of 102_b0_1, and the location information 703 of other terminals to server 104.

[0470] At this point, server 104, for example, knows the ID of the real space (in this case, real space #a0) based on the cell ID information 701, and accordingly... Figure 10A , Figure 10B The "real-world ID and virtual-world ID" allow the character corresponding to the terminal to appear in the virtual space. Furthermore, the detailed working process is the same as previously described.

[0471] The effect achieved in this way is that by further associating the "real space ID and virtual space ID" with the cell ID, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and cell" where the terminal exists.

[0472] In addition, the terminal can also... Figure 7BThe information shown is sent to the base station (here, base station #b0_1 of 102_b0_1). Therefore, the terminal obtains the cell ID information included in the modulation signal sent by the base station and can send the cell ID information 751 to the base station.

[0473] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to the base station. The base station then transmits this information to the server 104.

[0474] Thus, for example Figure 13 As shown, there are multiple base stations in the real space #a0. Therefore, the real space #a0 can be associated with multiple cell IDs.

[0475] The communication range of base station #b1_0 (102_b1_0) includes real space #a1, and the communication range of base station #b1_1 (102_b1_1) also includes real space #a1. Alternatively, other base stations may also exist that use real space #a1 as their communication range.

[0476] Additionally, base station #b1_0 of 102_b1_0 and base station #b1_1 of 102_b1_1 are as follows: Figure 11 It communicates with server 104 as shown.

[0477] At this time, base stations such as #b1_0 of 102_b1_0 and #b1_1 of 102_b1_1 send data to server 104. Figure 7A The information shown.

[0478] like Figure 7A As shown, the base station sends the cell ID information 701, the terminal information 702, and the location information 703 to the server 104.

[0479] For example, base station #b1_0 of 102_b1_0 sends the cell ID information 701, the terminal information 702 communicating with base station #b1_0 of 102_b1_0, and the location information 703 of other terminals to server 104.

[0480] At this point, server 104, for example, knows the ID of the real space (in this case, real space #a1) based on the cell ID information 701, and accordingly... Figure 10A , Figure 10B The "real-world ID and virtual-world ID" allow the character corresponding to the terminal to appear in the virtual space. Furthermore, the detailed working process is the same as previously described.

[0481] The effect achieved in this way is that by further associating the "real space ID and virtual space ID" with the cell ID, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and cell" where the terminal exists.

[0482] In addition, the terminal can also... Figure 7B The information shown is sent to the base station (here, base station #b1_0 of 102_b1_0). Therefore, the terminal obtains the cell ID information included in the modulation signal sent by the base station and can send the cell ID information 751 to the base station.

[0483] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to the base station. The base station then transmits this information to the server 104.

[0484] Furthermore, base station #b0_1 of 102_b1_1 sends a message to server 104. Figure 7A The information shown.

[0485] like Figure 7A As shown, the base station sends the cell ID information 701, the terminal information 702, and the location information 703 to the server 104.

[0486] For example, base station #b1_1 of 102_b1_1 sends the cell ID information 701, the terminal information 702 communicating with base station #b1_1 of 102_b1_1, and the location information 703 of other terminals to server 104.

[0487] At this point, server 104, for example, knows the ID of the real space (in this case, real space #a1) based on the cell ID information 701, and accordingly... Figure 10A , Figure 10B The "real-world ID and virtual-world ID" allow the character corresponding to the terminal to appear in the virtual space. Furthermore, the details of the process are the same as previously described.

[0488] The effect achieved in this way is that by further associating the "real space ID and virtual space ID" with the cell ID, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and cell" where the terminal exists.

[0489] In addition, the terminal can also... Figure 7B The information shown is sent to the base station (here, base station #b1_1 of 102_b1_1). Therefore, the terminal obtains the cell ID information included in the modulation signal sent by the base station and can send the cell ID information 751 to the base station.

[0490] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to the base station. The base station then transmits this information to the server 104.

[0491] Thus, for example Figure 13 As shown, there are multiple base stations in the real space #a1. Therefore, the real space #a1 can be associated with multiple cell IDs.

[0492] Furthermore, the communication range of base station #b2_0 of 102_b2_0 includes real space #b2, and the communication range of base station #b2_1 of 102_b2_1 also includes real space #b2. Alternatively, other base stations may also exist that use real space #b2 as their communication range.

[0493] Furthermore, although the relationship between real space and base stations is shown... Figure 13 However, Figure 13 This is just one example; the relationship between the real space and the base station (cell ID) is not influenced by... Figure 13 The examples are limited.

[0494] As an example, for example Figure 13 The base station #b0_0 of 102_b0_0 can communicate with and perform sensing processing on terminals present in "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)" (etc.).

[0495] At this time, the cell ID of base station #b0_0 of 102_b0_0 is associated with "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)" (etc.). That is, when base station #b0_0 of 102_b0_0 communicates and performs sensing processing with terminals existing in "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)", the role of that terminal appears in the virtual space corresponding to "real space #a1 (or a part of real space #a1)" and / or "real space #a2 (or a part of real space #a2)".

[0496] Figure 14 An example of a real-world space and base station configuration is shown. For example... Figure 14 As shown, the inner side of ellipse 100_a0 is considered as the real space #a0, the inner side of ellipse 100_a1 is considered as the real space #a1, the inner side of ellipse 100_a2 is considered as the real space #a2, and so on.

[0497] Therefore, the communication range of base station #b0 of 102_b0 includes real space #a0, real space #a1, and real space #a2.

[0498] Additionally, base station #b0 of 102_b0, such as Figure 11 It communicates with server 104 as shown.

[0499] At this time, base station #b0 of 102_b0 sends a message to server 104. Figure 7A The information shown.

[0500] like Figure 7A As shown, base station #b0 of 102_b0 sends the cell ID information 701, terminal information 702, and location information 703 to server 104.

[0501] For example, base station #b0 of 102_b0 sends the cell ID information 701, the terminal information 702 communicating with base station #b0 of 102_b0, and the location information 703 of other terminals to server 104.

[0502] At this point, server 104, for example, knows the ID of the real space based on the cell ID information 701 (here, any one of real space #b0, real space #b1, or real space #b2), and accordingly... Figure 10A , Figure 10B The "real-world ID and virtual-world ID" allow the character corresponding to the terminal to appear in the virtual space. Furthermore, the detailed working process is the same as previously described.

[0503] The effect achieved in this way is that by further associating the "real space ID and virtual space ID" with the cell ID, the server can enable the role corresponding to the terminal to appear in the "virtual space corresponding to the real space and cell" where the terminal exists.

[0504] In addition, the terminal can also... Figure 7B The information shown is sent to base station #b0 of 102_b0.

[0505] Therefore, the terminal obtains the cell ID information included in the modulation signal sent by base station #b0 of 102_b0, and can send the cell ID information 751 to base station #b0 of 102_b0.

[0506] Furthermore, the terminal can also send its own terminal information 702 and its location information 753 to base station #b0 of 102_b0. Then, base station #b0 of 102_b0 transmits this information to server 104.

[0507] Thus, for example Figure 14As shown, a base station can also include multiple real spaces as the range within which communication is possible, and based on this, the cell ID is associated with multiple real spaces.

[0508] Furthermore, although the relationship between real space and base stations is shown... Figure 14 However, Figure 14 This is just one example; the relationship between the real space and the base station (cell ID) is not influenced by... Figure 14 The examples are limited.

[0509] In the examples above, although examples of "associating the real space with the virtual space," "associating the real space with the cell ID," or "associating the real space, cell ID, and virtual space" were given, it could also be "associating the cell ID with the virtual space." In this case, it can be implemented simply by treating the description of "real space" in the above explanation as "cell ID."

[0510] In this embodiment, the processing of sensing between the base station and the terminal is described as an example. The features of this process will be explained.

[0511] Figure 15 This is an example of the antenna configuration found in base stations and terminals. Figure 15 In this context, 1501 refers to an antenna (element). For example, a base station or terminal may have 16 antennas, which enable transmit directional control (transmit beamforming) and receive directional control (receive beamforming).

[0512] Therefore, base stations and terminals can perform Figure 16A , Figure 16B The transmit directionality control (transmit beamforming) and receive directionality control (receive beamforming) are shown.

[0513] For example Figure 16C Consider three-dimensional space as shown. Therefore, there are x-axis, y-axis, and z-axis.

[0514] like Figure 16A As shown, for example, through Figure 15 The antenna 1600 of the base station or terminal shown can form a "transmit beam and / or receive beam 1601", that is, it can form multiple "transmit beams and / or receive beams 1601" in the x-y axis direction, and as shown... Figure 16B As shown, for example, through Figure 15 The antenna 1600 of the base station or terminal shown can form a "transmit beam and / or receive beam 1602", that is, it can form multiple "transmit beams and / or receive beams 1602" in the z-axis direction.

[0515] Therefore, base stations and terminals can perform three-dimensional sensing processing, and based on this, base stations and terminals can perform three-dimensional position estimation (for example, in addition to planar position such as latitude and longitude, there is also position estimation in the height direction).

[0516] Furthermore, the examples of 3D sensing are not limited to this one; the terminal can also perform 3D position estimation through other position estimation systems.

[0517] As described above, the server 104, which obtains the location information of the terminal via the base station, brings out the role equivalent to the terminal based on the location information of the terminal. A specific example of this will be explained.

[0518] For example, consider the following situation.

[0519] • The terminal establishes an association with a character that takes the shape of a "person". The server 104, based on the terminal's location information, causes a character that takes the shape of a "person" and is similar to the terminal to appear in the virtual space.

[0520] The terminal and base station perform sensing processing, and the base station and / or the terminal obtain the terminal's location information. Then, server 104 obtains the terminal's location information. (Alternatively, the terminal obtains its own location information through other location estimation systems.)

[0521] • A user carrying the terminal is, for example, riding a bus that is traveling on a road. At this time, the terminal is located a few meters above the ground and moves at the speed of the bus.

[0522] In this situation, the base station and the terminal perform sensing processing (or the terminal uses other location estimation systems), and the terminal detects a location "located on the road (the longitude and latitude of the road can also be obtained) and at a height of 4m above the ground".

[0523] Therefore, server 104 obtains the three-dimensional position of the terminal, for example... Figure 17A As shown, server 104 can perform the process of making a "character in the shape of a "person" that is equivalent to a terminal appear in a virtual space at a height of 4m above the ground on the road (1700_1).

[0524] As described above, server 104 can represent the role equivalent to a terminal in the virtual space in a way that is closer to its location in the real space.

[0525] Furthermore, as another example, server 104 obtains the three-dimensional position of the terminal, for example... Figure 17BAs shown, server 104 can process the appearance of a "character in the shape of a 'person' that is equivalent to a terminal" on the ground of a road in virtual space (e.g., at a height of 0m) (1700_2).

[0526] Based on the above, server 104 can represent the role equivalent to a terminal in the virtual space in a way that highly corrects the position existing in the real space.

[0527] Furthermore, as mentioned above, regarding the terminal's position in three dimensions in real space, the method for the appearance of the character equivalent to the terminal in virtual space can be switched between a first method and a second method. The first method is " Figure 17A The method shown is equivalent to a three-dimensional entrance method; the second method is " Figure 17B The shown is an entrance method that has been corrected for height (depending on the correction method, it will become an equivalent of a two-dimensional entrance method).

[0528] The terminal can configure which method (first or second) to use. In this case, the terminal sends the configuration information and transmits it to the server 104 via a base station or network. Alternatively, the terminal can also transmit the configuration information to the server 104 via the network.

[0529] Alternatively, the server 104 can also set which method, the first or the second, to use.

[0530] Furthermore, the decision of which method, the first or the second, to use can also be made by the base station. In this case, the base station sends the decision information and transmits it to the server 104 via the network.

[0531] Therefore, server 104, based on this setting information, causes the character equivalent to the terminal to appear in the virtual space.

[0532] Next, for Figure 1 , Figure 5 The operation of terminal #101 in 101_101 and terminal #102 in 101_102 will be explained.

[0533] Terminal #101 of 101_101, terminal #102 of 101_102, etc. Figure 3A As shown, communication with server 104 is achieved via network 103 without going through a base station.

[0534] As described above, terminals such as terminal #101 of 101_101 and terminal #102 of 101_102, when communicating with server 104, perform the corresponding procedures for establishing the role corresponding to the terminal.

[0535] like Figure 3B As shown, the terminal sends terminal information to server 104 (301). Furthermore, the terminal information is information that server 104 can use to identify the terminal (and / or user), such as SIM (Subscriber Identity Module) information, phone number information, email address information (usable by the user or terminal), user ID, terminal ID, SNS (Social networking service) information, etc., which constitute "terminal and / or user information." Therefore, server 104 obtains the terminal information (351).

[0536] Therefore, the terminal sends the role information to the server 104 (302). As a result, the server 104 receives the role information (352).

[0537] Additionally, when generating role information, the terminal can... Figure 2 The terminal can obtain character source information from the character generation unit 215 of the server 104, or it can obtain character source information from a device different from the server 104. Based on this, the terminal can generate character information. Furthermore, as another method, the terminal can also generate characters using its own functions.

[0538] Therefore, server 104 stores the terminal information and the terminal's role information as a group. Figure 2 The role information storage unit 212 for each terminal. Therefore, Figure 2 The role information storage unit 212 stores "group information of terminal information and role information of each terminal" for each terminal.

[0539] exist Figure 3B In the description, although its operation is explained as "terminal information," it can also replace "terminal information," and can be implemented in the same way even as "user information or identification information." Furthermore, in other descriptions, although its operation is explained as "terminal information," it can also replace "terminal information," and can be implemented in the same way even as "user information or identification information."

[0540] As described above, the character information storage unit 212 stores... Figure 1 , Figure 5 The information in 101_101 is "the information of the terminal information and the role information of the terminal". The information in 101_102 is "the information of the terminal information and the role information of the terminal".

[0541] Therefore, to Figure 1 , Figure 5The user operating terminal #101 in 101_101 accesses server 104 via network 103. For example, for Figure 1 , Figure 5 The user operating from terminal #101 of 101_101 accesses server 104 via network 103. Figure 2 The character action control unit 216 shown is used. The user operates terminal #101 of 101_101 to make the character corresponding to terminal #101 of 101_101 appear in the virtual space, or to make the character corresponding to terminal #101 of 101_101 move in the virtual space. Thus, the part that controls the character becomes... Figure 2 Character motion control unit 216.

[0542] Furthermore, users can use the role equivalent to terminal #101 (101_101) to communicate with other roles in the virtual space, establish contact, send messages, chat online (or make voice calls), etc. Additionally, users can move the role equivalent to terminal #101 (101_101) in the virtual space regardless of its real-world location. Thus, the part controlling the role becomes... Figure 2 Character motion control unit 216.

[0543] Similarly, for Figure 1 , Figure 5 The user operating terminal #102 in 101_102 accesses server 104 via network 103. For example, for Figure 1 , Figure 5 The user operating from terminal #101 of 101_101 accesses server 104 via network 103. Figure 2 The character action control unit 216 shown is used. The user operates terminal #102 of 101_102 to make the character corresponding to terminal #102 of 101_102 appear in the virtual space, or to make the character corresponding to terminal #102 of 101_102 move in the virtual space. Thus, the part that controls the character becomes... Figure 2 Character motion control unit 216.

[0544] Furthermore, users can utilize the role equivalent to terminal #102 (101_102) to communicate, establish contact, send messages, chat online (or make voice calls), etc., with other roles (or other terminals) existing in the virtual space. Additionally, users can move the role equivalent to terminal #102 (101_102) within the virtual space, regardless of its real-world location. Thus, the part controlling the role becomes... Figure 2Character motion control unit 216.

[0545] The following example illustrates the actions of each character corresponding to each terminal in "virtual space #1," which is associated with real space #1. Therefore, using... Figure 1 Let me explain.

[0546] As already explained, Figure 1 The virtual space #1, which is associated with the real space #1, is generated by server 104. Thus, as shown... Figure 1 As shown, since terminal #1 of 101_1 and terminal #2 of 101_2 exist in real space #1, server 104 generates virtual space #1 by having terminals "equivalent to terminal #1 of 101_1" and "equivalent to terminal #2 of 101_2" appear in virtual space #1. Therefore, server 104 controls the positions of the terminals "equivalent to terminal #1 of 101_1" in virtual space #1 according to the position of terminal #1 of 101_1 in real space, and similarly, server 104 controls the positions of the terminals "equivalent to terminal #2 of 101_2" in virtual space #1 according to the position of terminal #2 of 101_2 in real space.

[0547] Additionally, for those that do not exist Figure 1 The user operating terminal #101 of 101_101 in the real space #1 accesses server 104 through network 103. The user operates terminal #101 of 101_101, causing the character equivalent to terminal #101 of 101_101 to appear in virtual space #1, or causing the character equivalent to terminal #101 of 101_101 to move in virtual space #1.

[0548] Therefore, a user operating terminal #101 of 101_101 can use the role equivalent to terminal #101 of 101_101 to communicate, establish contact, send messages, and chat online (or make voice calls) with a "role equivalent to terminal #1 of 101_1 existing in real space #1" (the user using this role) existing in virtual space #1. Furthermore, a user operating terminal #101 of 101_101 can use the role equivalent to terminal #101 of 101_101 to communicate, establish contact, send messages, and chat online (or make voice calls) with a "role equivalent to terminal #102 of 101_102 that does not exist in real space #1" existing in virtual space #1.

[0549] Furthermore, the user operating terminal #1 of 101_1 can use the role equivalent to terminal #101 of 101_1 to communicate, make contact, send messages, chat online (or make calls by voice) with the "role equivalent to terminal #101 of 101_101 that does not exist in real space #1" (the user using the role) that exists in virtual space #1.

[0550] Furthermore, the actions a user takes in virtual space, acting as a terminal, towards other terminal roles (or users using terminals), are not limited to the examples mentioned above (communication, online chat, etc.). For instance, these could also include "sending images (still images), sending moving images, sending advertisements, distributing advertisements, distributing coupons," and so on.

[0551] In this way, "users who use terminals that exist in real space and are associated with virtual space" and "users who use terminals to enter virtual space" can communicate, thereby achieving the effect of being able to communicate with more users.

[0552] As described above, the effect is that by using the location information of the terminal in the real space, the corresponding role (virtual avatar) of the terminal appears in the virtual space corresponding to the real space, thereby providing a more diverse system suitable for the real environment in which the terminal and the user of the terminal exist. Furthermore, the terminal and the user of the terminal can communicate with more other terminals (other users) in both the real space and the virtual space, and the convenience is improved.

[0553] In this embodiment, the base station is described. It can be implemented even if the base station is any of the following: "TRP (Tx(Transmission) / Rx(Reception)point), repeater, access point, broadcast station, gNB (g Node B), eNB (e Node B), node, server, satellite, mobile device (based on "electric mobile devices such as electric cars, electric motorcycles (e-motorcycles), electric bicycles, mobile robots, electric scooters, electric-assisted bicycles, electric-assisted scooters", automobiles, motorcycles, bicycles, ships, aircraft, airplanes, etc.), terminal, portable phone, smartphone, tablet computer, laptop computer, computer, personal computer, home appliance (household electrical machinery), factory equipment, IoT (Internet of Things) device, etc. communication equipment / broadcasting equipment, etc." Therefore, the base station in this embodiment can also be referred to as "TRP, repeater, access point, broadcasting station, gNB, eNB, node, server, satellite, mobile device, terminal, portable phone, smartphone, tablet computer, laptop computer, computer, personal computer, home appliance, factory equipment, IoT device, and other communication equipment / broadcasting equipment, etc." The same applies to all of the above in this specification.

[0554] Furthermore, while the terminal is described in this embodiment, it can be implemented even if the terminal is any of the following: "TRP, base station, repeater, access point, broadcast station, gNB, eNB, node, server, satellite, mobile device (as an example above), terminal, portable phone, smartphone, tablet computer, laptop computer, computer, personal computer, home appliance, factory equipment, IoT device, and other communication / broadcasting equipment." Therefore, the terminal in this embodiment can also be referred to as "TRP, base station, repeater, access point, broadcast station, gNB, eNB, node, server, satellite, mobile device (as an example above), terminal, portable phone, smartphone, tablet computer, laptop computer, computer, personal computer, home appliance, factory equipment, IoT device, and other communication / broadcasting equipment," and the same applies to all of the above.

[0555] Furthermore, devices such as base stations and terminals can utilize one or more transmitting antennas to transmit one or more modulated signals or signals for sensing. All of the above applies in this specification.

[0556] In the above description, "signals transmitted by the terminal, such as modulated signals or signals used for sensing" can belong to any of UL-SCH (uplink shared channel), PUCCH (physical uplink control channel), PUSCH (physical uplink shared channel), PRACH (physical random access channel), etc. However, it is not limited to these.

[0557] Furthermore, in the above description, "signals transmitted by the base station, such as downlink frames, reference signals, and control signals," can belong to any of the following: PCH (paging channel), BCH (broadcast channel), DL-SCH (downlink shared channel), BCCH (broadcast control channel), PCCH (paging control channel), CCCH (common control channel), common search space, PBCH (physical broadcast channel), SS (Synchronization Signals), PDCCH (physical downlink control channel), and PDSCH (physical downlink shared channel). However, it is not limited to these.

[0558] In this embodiment, server 104 is used Figure 1 The example described illustrates how "terminal-like characters" such as Terminal #1 of 101_1, Terminal #2 of 101_2, Terminal #101 of 101_101, and Terminal #102 of 101_102 appear in virtual space and are controlled in virtual space. These "terminal-like characters" in virtual space can be any character, any object, or any virtual avatar. Therefore, in this embodiment, it is possible to implement the concept even if the description of "character" is treated as an "object" or a "virtual avatar."

[0559] Furthermore, for example, the "role equivalent to a terminal" in virtual space can also be a "role (or object, virtual avatar) like a person", "role (or object, virtual avatar) like an animal", "role (or object, virtual avatar) like a bird", "role (or object, virtual avatar) like a flying object (drone, aircraft, airplane)", "role (or object, virtual avatar) like a motor vehicle", "role (or object, virtual avatar) like a bicycle", "role (or object, virtual avatar) like a motorcycle", "role (or object, virtual avatar) like a tram", "role (or object, virtual avatar) like a train", or "role (or object, virtual avatar) like a robot", but it is not limited to these.

[0560] Alternatively, server 104 can determine which of a predefined multiple terminal types the terminal belongs to, and display the object corresponding to each state, or the object selected from the object group, in the virtual space. The correspondence between terminal types and objects is not limited to the examples above. For example, it can correspond to objects with different animal shapes depending on the terminal type, or it can correspond to objects with the same shape but different colors depending on the terminal type.

[0561] Furthermore, the same applies to the above points in this specification.

[0562] exist Figure 1 In this example, since terminal #1 of 101_1 exists in real space #1, server 104, for example, causes the role of terminal #1, equivalent to 101_1, to appear in virtual space #1 corresponding to real space #1, and controls the role of terminal #1, equivalent to 101_1. Thus, an example is shown where server 104 provides information of virtual space #1 to the terminal including terminal #1 of 101_1.

[0563] Alternatively, server 104 generates information for AR display, which is then provided to terminals #1 (101_1), #2 (101_2), etc., existing in real space #1. Server 104 can then provide this AR display information to terminals #1 (101_1), #2 (101_2), etc., existing in real space #1. When a terminal with AR display capabilities exists in real space #1, that terminal receives the AR display information, causing characters, objects, etc., to be displayed at designated locations.

[0564] Server 104 generates information for AR display based on the information in virtual space #1. At this time, server 104 generates "information on characters and objects to be displayed overlaid in real space" and "position information of characters and objects in real space required for overlay display" based on the "information and position of characters and objects existing in virtual space #1". Then, server 104 sends the "information on characters and objects to be displayed overlaid in real space" and the "position information of characters and objects in real space required for overlay display" to the "terminal with AR display function" existing in real space #1. The "terminal with AR display function" displays characters and objects at the designated positions based on the "information on characters and objects to be displayed overlaid in real space" and the "position information of characters and objects in real space required for overlay display".

[0565] in addition, Figure 1 The terminals that exist in real space #1 and / or do not exist in real space #1, such as "Terminal #1 of 101_1, Terminal #2 of 101_2", can be processed as follows.

[0566] The terminal estimates its own position by comparing the position of 3D map information with sensing data (LIDAR (Light Detection and Ranging) or point group data obtained through a camera, etc.). In this position estimation, for example, the terminal estimates the position or orientation information in the 3D map information as its own position information. Based on its estimated position, the terminal obtains shape data or data showing the configuration positions of surrounding objects from server 104. Based on its own position information, the terminal displays the objects on a display screen showing images captured by the terminal's camera, or on a transparent display of smart goggles, etc.

[0567] In addition, when estimating its own position, the terminal can also detect surrounding planes such as the ground or tabletops. While the detected plane is assumed to be horizontal or near-horizontal, it can also be a vertical plane such as a wall, or a plane with any angle, including horizontal or vertical planes. Furthermore, the terminal can detect objects including these and provide them to the server 104, displaying them in the virtual space, and can also process them as objects for display in the AR space.

[0568] Therefore, when displaying an object, the terminal can adjust the position of the object on the display screen based on the detected planar information, rather than directly using the information set on the object's location. Furthermore, this applies to both virtual space displays and AR displays.

[0569] Furthermore, while the example given is displaying objects in virtual space or AR based on the terminal's estimated location, it's also possible to display objects in virtual space or AR using location information obtained through other methods. Such location information could be, for example, location information estimated by a base station, location information estimated by other devices, or location information obtained via GPS. Here, when using the terminal's location information estimated by a base station, displaying a character in virtual space based on the location information estimated by the base station reduces the possibility of discrepancies between the object seen by the character in virtual space and the object displayed in AR in real space.

[0570] (Implementation Method 2)

[0571] In this embodiment, a variation of embodiment 1 will be described, specifically the structure of a system that makes a character appear in a virtual space based on the location of a terminal existing in the real space, and the operation of each device.

[0572] Alternatively, real space can be referred to as "(physical) reality" or "universe." Furthermore, real space can also be "AR (Augmented Reality)" (a world that virtually enhances the real world). As an example of real space, it can be understood as the physical world we inhabit. Other names can also be used for real space. All of the above applies in this instruction manual.

[0573] Furthermore, virtual space can also be referred to as "cyberspace," "metaverse," "one of the multiverses," "virtual space," "VR (Virtual Reality)," or "virtual world." Other names for virtual space are also possible. All of the above applies in this instruction manual.

[0574] Furthermore, the character can be referred to as a "virtual avatar" or "object." An example of a virtual avatar is a clone of the user that appears in games, online, or virtual spaces. Other names can also be used for the character. All of the above applies throughout this manual.

[0575] Figure 18 This example illustrates the structure of a system in this embodiment that "makes a character appear in a virtual space based on the location of a terminal existing in the real space." Figure 18 In China, for the sake of Figure 1 Identical jobs are assigned the same number, with some of the description omitted.

[0576] The inner side of the ellipse 100_1 is real space #1. Therefore, object #1 of 1801_1 and object #2 of 1801_2 exist in real space #1. However, although real space is defined as the inner side of the ellipse, it may not be represented by the inner side of the ellipse. For the sake of simplicity, real space is represented by the inner side of the ellipse. This is consistent throughout this embodiment and this specification.

[0577] exist Figure 18 Although the camera device #1 of 1802_1 is considered to exist in real space #1, the camera device #1 of 1802_1 can also exist in real space outside of real space #1.

[0578] The imaging device #1 of 1802_1 is a device for capturing still images, moving images, etc., and can be, for example, a camera, smartphone, computer, surveillance camera, or camcorder. Furthermore, the imaging device #1 of 1802_1 can also be a device with sensing capabilities utilizing light, radio waves, etc., or a sensor utilizing light, radio waves, etc., such as infrared light. Therefore, although it is referred to as an imaging device here, it is not limited to this terminology and can also be simply called a device or a sensing device.

[0579] The object #1 of 1801_1 and the object #2 of 1801_2 can be "person", "animal", "mobile machine such as car, motorcycle, bicycle, etc". They can also be "person's personal belongings", "equipment", "object, subject".

[0580] The camera device #1 of 1802_1 communicates with a device including server 104 via network 103. Examples of this communication can be considered as wired and / or wireless communication.

[0581] Furthermore, the camera device #1 of 1802_1 can communicate with objects including "object #1 of 1801_1 and object #2 of 1801_2", for example, wirelessly. (It can also be via wired and / or wireless communication.)

[0582] Therefore, the camera device #1 of 1802_1 has a transmitting unit and a receiving unit for wireless or wired communication.

[0583] Therefore, objects including "object #1 of 1801_1 and object #2 of 1801_2" can also have a transmitting unit for wireless communication and a receiving unit for wireless communication.

[0584] The camera device #1 of 1802_1 may also include a transmitting unit for sensing and a receiving unit for sensing. Furthermore, the transmitting unit for sensing and the transmitting unit for wireless communication may exist separately or be shared. The camera device #1 of 1802_1 may also include a location estimation system such as GPS.

[0585] Furthermore, the camera device #1 of 1802_1 can also hold information about the location where the camera device #1 of 1802_1 is set.

[0586] The objects including "Object #1 of 1801_1" and "Object #2 of 1801_2" can also have a transmitting unit for sensing and a receiving unit for sensing. Furthermore, the transmitting unit for sensing and the transmitting unit for wireless communication can exist separately or be shared. The objects including "Object #1 of 1801_1" and "Object #2 of 1801_2" can also have a location estimation system such as GPS.

[0587] At this time, as a method, the camera device #1 of 1802_1 estimates the object including "object #1 of 1801_1 and object #2 of 1801_2".

[0588] Furthermore, the estimation of objects including "object #1 of 1801_1" and "object #2 of 1801_2" performed by the camera device #1 of 1802_1 refers to, for example, the process by which the camera device #1 of 1802_1 detects objects existing within its sensing range and estimates their positions. The estimation of objects may also include a process of determining what the object is, that is, a process of detecting the type of object. Furthermore, the estimation of objects may also include a process of detecting the movement or state of the object. Although the estimation of objects including "object #1 of 1801_1" and "object #2 of 1801_2" is described, the object may be only one, not multiple. Furthermore, if the object to be estimated is not located within the sensing range, the absence of detected object can be considered a detection result.

[0589] At this time, as shown in, for example, Patent Documents 2, 3, and 4, the camera device #1 of 1802_1 can acquire the position information (or sensing result information) of the object including "object #1 of 1801_1 and object #2 of 1801_2" by any of the following methods.

[0590] Method 2-1:

[0591] Camera device #1 of 1802_1 sends a signal for sensing. The object then receives this signal and estimates its position (or obtains a sensing result). The object sends this position information (or sensing result information) to camera device #1 of 1802_1. Based on this, camera device #1 of 1802_1 obtains the position information (or sensing result information) of the object including "object #1 of 1801_1" and "object #2 of 1801_2".

[0592] Method 2-2:

[0593] Camera device #1 of 1802_1 sends a signal for sensing. The state of this signal changes within the object, and this change is captured by camera device #1 of 1802_1 (receiving the radio waves equivalent to the signal used for sensing). Camera device #1 of 1802_1 estimates the position of the object (or obtains the sensing result). Based on this, camera device #1 of 1802_1 obtains the position information (or sensing result information) of the object, including "object #1 of 1801_1" and "object #2 of 1801_2".

[0594] Method 2-3:

[0595] The objects, including "object #1 of 1801_1" and "object #2 of 1801_2", send signals for sensing. Then, the camera device #1 of 1802_1 receives these signals and estimates the position (or obtains the sensing result). Based on this, the camera device #1 of 1802_1 obtains the position information (or sensing result information) of the objects including "object #1 of 1801_1" and "object #2 of 1801_2".

[0596] Thus, the signal used for sensing can be transmitted by the camera device #1 of 1802_1 or by the object itself. Furthermore, the method by which the camera device #1 of 1802_1 obtains the position information (or sensing result information) of the object including "object #1 of 1801_1 and object #2 of 1801_2" is not limited to methods 2-1, 2-2, and 2-3, and can be widely applied to methods described in documents including Patent Document 2, Patent Document 3, and Patent Document 4.

[0597] Alternatively, the objects including "object #1 of 1801_1" and "object #2 of 1801_2" can estimate their own positions using a location estimation system such as GPS. In this case, the objects send the estimated position information to the camera device #1 of 1802_1, thereby obtaining the position information of the objects including "object #1 of 1801_1" and "object #2 of 1801_2".

[0598] Furthermore, in methods 2-1, 2-2, and 2-3, the camera device #1 of 1802_1 is considered as... Figure 1 Base station #1 of 102_1 in the middle, treating the object as Figure 1 When the terminal is in the same state as in Embodiment 1, it becomes the same situation. Therefore, in Embodiment 1, as long as the base station #1 of 102_1 is regarded as the camera device #1 of 1802_1 and the terminal is regarded as the object, it is possible to Figure 18 The description of Implementation Method 1 is applicable here. Therefore, detailed descriptions are omitted here.

[0599] The following describes method 2-4, which differs from methods 2-1, 2-2, and 2-3.

[0600] Methods 2-4:

[0601] Figure 18 The camera device #1 in 1802_1 is, for example, a device equipped with one or more sensors selected from image sensor, infrared sensor, and photodiode. Therefore, the camera device #1 of 1802_1 uses the sensors to detect and / or identify the object including "object #1 of 1801_1" and "object #2 of 1801_2". Thus, the camera device #1 of 1802_1 obtains the position information of the object including "object #1 of 1801_1" and "object #2 of 1801_2".

[0602] Alternatively, the camera device #1 of 1802_1 can maintain the location information, and the location where the camera device #1 of 1802_1 is set can be used as the location of the objects including "object #1 of 1801_1" and "object #2 of 1801_2". Another method is that the objects including "object #1 of 1801_1" and "object #2 of 1801_2" are equipped with a location estimation device, such as their own GPS, which can directly transmit their obtained location information to the camera device #1 of 1802_1, or transmit their obtained location information to the camera device #1 of 1802_1 via "other devices or networks".

[0603] The example to be described in methods 2-4 is an example of when the camera device #1 of 1802_1 detects and / or identifies an object including "object #1 of 1801_1 and object #2 of 1801_2".

[0604] The objects, including "object #1 of 1801_1" and "object #2 of 1801_2", are, for example, hats, clothes, jewelry, or people. Thus, object #1 of 1801_1 is associated, for example, with a person's character #1 (which can be a character based on the shape of a person, robot, etc. However, the shape of the character is not limited to these examples; it can simply be a character). Server 104 maintains this information. The processing of "information regarding the association between object #1 of 1801_1 and character #1" will be explained later. Furthermore, objects may also include detectable and recognizable identification codes, patterns, colors, shapes, text, etc., used for identification.

[0605] The camera device #1 of 1802_1 detects and identifies the object #1 of 1801_1, for example, using a sensor. At this time, for example, moving images and still images can be acquired. Furthermore, this detection and identification processing can also be performed by the camera device #1 of 1802_1. Moreover, the data and information acquired by the camera device #1 of 1802_1 can be transmitted to the server 104, whereby the server 104 can also perform the detection and identification processing.

[0606] Therefore, based on the information that "object #1 of 1801_1 has been identified," server 104 causes character #1, which is associated with object #1 of 1801_1, to appear in virtual space #1. Furthermore, when causing character #1 to appear in virtual space #1, server 104 can determine the location, for example, based on the location where camera device #1 of 1802_1 is set. Moreover, the location of "object #1 of 1801_1" can be obtained by server 104 through communication, and server 104 determines the location where character #1 appears in virtual space #1 based on this location information.

[0607] The objects, including "object #1 of 1801_1" and "object #2 of 1801_2", are, for example, hats, clothes, jewelry, or animals. Thus, object #1 of 1801_1 is associated, for example, with animal character #1 (which could also be a character based on the shape of an animal, robot, etc. However, the shape of the character is not limited to these examples; it could simply be a character). Server 104 maintains this information. The processing of "information regarding the association between object #1 of 1801_1 and character #1" will be explained later. Furthermore, objects can also include detectable and recognizable identifiers, patterns, colors, shapes, text, etc., used for identification.

[0608] The camera device #1 of 1802_1 detects and identifies the object #1 of 1801_1, for example, using a sensor. At this time, for example, moving images and still images can be acquired. Alternatively, this detection and identification process can also be performed by the camera device #1 of 1802_1. Furthermore, the data and information acquired by the camera device #1 of 1802_1 can be transmitted to the server 104, where the server 104 performs the detection and identification process.

[0609] Therefore, based on the information that "object #1 of 1801_1 has been identified," server 104 causes character #1, which is associated with object #1 of 1801_1, to appear in virtual space #1. Furthermore, when causing character #1 to appear in virtual space #1, server 104 can determine the location, for example, based on the location where camera device #1 of 1802_1 is set. Moreover, the location of "object #1 of 1801_1" can be obtained by server 104 through communication, and server 104 can determine the location where character #1 appears in virtual space #1 based on this location information.

[0610] The objects including "object #1 of 1801_1" and "object #2 of 1801_2" are, for example, cars, bicycles, or motorcycles. Additionally, if the object is a car, motorcycle, or something with a license plate, the object can also be a license plate. Thus, object #1 of 1801_1 is associated, for example, with role #1 of a "car, bicycle, or motorcycle" (which can be a role based on the shape of a car, bicycle, motorcycle, robot, etc. However, the shape of the role is not limited to these examples; it can simply be a role). Server 104 maintains this information. The processing of "information regarding the association between object #1 of 1801_1 and role #1" will be explained later. Furthermore, the object can also include an identification code that can be detected and recognized, a pattern, color, shape, text, etc., used for recognition.

[0611] The camera device #1 of 1802_1 detects and identifies the object #1 of 1801_1, for example, using a sensor. At this time, for example, moving images and still images can be acquired. Alternatively, this detection and identification process can also be performed by the camera device #1 of 1802_1. Furthermore, the data and information acquired by the camera device #1 of 1802_1 can be transmitted to the server 104, where the server 104 performs the detection and identification process.

[0612] Therefore, based on the information that "object #1 of 1801_1 has been identified," server 104 causes character #1, which is associated with object #1 of 1801_1, to appear in virtual space #1. Furthermore, when causing character #1 to appear in virtual space #1, server 104 can determine the location, for example, based on the location where camera device #1 of 1802_1 is set. Alternatively, the location of "object #1 of 1801_1" can be obtained by server 104 through communication, and server 104 can determine the location where character #1 appears in virtual space #1 based on this location information.

[0613] The objects including "object #1 of 1801_1" and "object #2 of 1801_2" are, for example, buildings, shops, signs (advertisements), facilities, streetlights, trees, flowers, etc. Thus, object #1 of 1801_1 is associated with, for example, role #1 (which could also be a role equivalent to an object. However, the shape of the role is not limited to these examples; it could simply be a role). Server 104 maintains this information. The processing of "information regarding the association between object #1 of 1801_1 and role #1" will be explained later. Furthermore, objects can also include detectable and recognizable identifiers, patterns, colors, shapes, text, etc., used for identification.

[0614] The camera device #1 of 1802_1, for example, uses a sensor to detect and identify the object #1 of 1801_1. At this time, for example, moving images and still images can be acquired. Alternatively, this detection and identification process can also be performed by the camera device #1 of 1802_1. Furthermore, the data and information acquired by the camera device #1 of 1802_1 can be transmitted to the server 104, where the server 104 performs the detection and identification process.

[0615] Therefore, based on the information that "object #1 of 1801_1 has been identified," server 104 causes character #1, which is associated with object #1 of 1801_1, to appear in virtual space #1. Furthermore, when causing character #1 to appear in virtual space #1, server 104 can determine the location, for example, based on the location where camera device #1 of 1802_1 is set. Alternatively, the location of "object #1 of 1801_1" can be obtained by server 104 through communication, and server 104 can determine the location where character #1 appears in virtual space #1 based on this location information.

[0616] exist Figure 18The system includes a storage unit for maintaining "data related to the virtual space," a control unit for controlling the appearance and actions of characters in the virtual space, and a server 104 for "updating and controlling information in the virtual space based on data from other devices." Furthermore, details regarding the server's structure and operation will be provided later. Figure 18 The system may contain, for example, terminal #101 of 101_101, terminal #2 of 101_102, and devices.

[0617] The camera device #1 of 1802_1, server 104, terminal #101 of 101_101, terminal #2 of 101_102, and other devices are connected to network 103, thereby enabling communication between the "base station #1 of 102_1, server 104, terminal #101 of 101_101, terminal #2 of 101_102, and other devices".

[0618] Furthermore, object #1 of 1801_1 and object #2 of 1801_2 can also communicate with camera device #1 of 1802_1.

[0619] Therefore, terminal #101 of 101_101 and terminal #2 of 101_102 can communicate with devices such as "server 104, object #1 of 1801_1, object #2 of 1801_2, and equipment" via camera device #1 of 1802_1 and network 103.

[0620] Furthermore, the system configuration in this embodiment is not subject to... Figure 18 As a limitation, only one or more objects are required, and only one or more camera devices and one or more servers are required.

[0621] Figure 19A yes Figure 18 Here is an example of the configuration of server 104. In server 104, for example, interface 200 takes input signal 201 as input and outputs output signal 202. Furthermore, interface 200 is connected to spatial information storage unit 211, role information storage unit 1912 for each object, role control unit 213 based on real-space location, output information generation unit 214, role generation unit 215, and role information storage unit 212 for each terminal. Additionally, although called an interface, it could also be a bus.

[0622] Spatial information storage unit 211 is the part that stores information about virtual space. Furthermore, "information about virtual space" can be, for example, "two-dimensional spatial data," "three-dimensional spatial data," or "data transformed to represent three-dimensional spatial data in two dimensions." Moreover, "virtual space objects, such as buildings, facilities, equipment, plazas, and parks, which are equivalent to objects existing in real space," can be configured in the virtual space. Therefore, information about virtual space can also include information about "virtual space objects."

[0623] Furthermore, information about the virtual space can be updated, for example, through input signal 201. For example, information about the virtual space, such as updates to the objects used in the virtual space and updates to the positions of the objects used in the virtual space, is stored in the space information storage unit 211 through input signal 201.

[0624] The operation of the role information storage unit 1912 for each object will be explained in detail later.

[0625] The operation of the role control unit 213, which is based on the location in real space, will be explained in detail later.

[0626] The operation of the role information storage unit 212 for each terminal will be explained in detail later.

[0627] The output information generation unit 214 generates output information about the virtual space for provision to terminals and other devices based on information obtained from the spatial information storage unit 211, information obtained from the role information storage unit 1912 for each object, and information obtained from the role control unit 213 based on the location in real space. Furthermore, it can also generate output information about the virtual space for provision to terminals and other devices based on information obtained from the role information storage unit 212 for each terminal.

[0628] Therefore, the output information regarding the virtual space is output from server 104 as output signal 202. Additionally, the output information regarding the virtual space is sent to one or more terminals connected to server 104.

[0629] Therefore, a device such as a terminal that receives the information from the output signal 202 generates display content for the virtual space based on the output signal 202 and displays it on a display device built into the device and / or an external display device.

[0630] At this time, the display device may include, for example, mobile phones, mobile phones, smartphones, tablets, tablet PCs (Personal Computers), computers (which may be equipped with a display or be able to connect to a display), laptops, televisions, devices connected to a display, game consoles, portable game consoles, AR glasses, AR goggles, displays capable of AR display, devices connected to displays capable of AR display, VR glasses, VR goggles, displays capable of VR display, devices connected to displays capable of VR display, MR (Mixed Reality) goggles, displays capable of MR display, devices connected to displays capable of MR display, car navigation systems, head-mounted displays, devices connected to head-mounted displays, displays, devices connected to displays, projectors, devices connected to projectors, etc., but are not limited thereto.

[0631] Furthermore, the configuration of the server is not subject to... Figure 19A The examples are limited.

[0632] right Figure 19A The operation of the role information storage unit 1912 for each object will be explained. As an example, the operation of terminal #1 using 101_1 will be explained.

[0633] For example, terminal #1 of 101_1 Figure 19B As shown, communication with server 104 is conducted via network 103. Additionally, terminal #1 of 101_1 is used for registration and... Figure 18 The terminal associated with role #1 of object #1 in 1801_1.

[0634] As shown above, when the terminal communicates with the server 104, it establishes an association with the role corresponding to the object. The process of establishing this association will be explained below.

[0635] like Figure 19C As shown, the terminal sends the object information to the server 104 (1901). Furthermore, the object information is information that the server 104 can use to identify the object, and it is... Figure 18 The camera device #1 in 1802_1 can extract feature information by performing detection and recognition. For example, if the camera device #1 in 1802_1 is an image sensor, the object information can be data from still images or moving images, or it can be information about the features of the object extracted from still images or moving images. However, it is not limited to this example. Therefore, the server 104 obtains the object information (1951).

[0636] Therefore, the terminal sends the role information to the server 104 (1902). As a result, the server 104 receives the role information (1952).

[0637] Additionally, when generating role information, the terminal can... Figure 19A The terminal can obtain character source information from the character generation unit 215 of the server 104, or it can obtain character source information from a device different from the server 104. Based on this, the terminal can generate character information. Alternatively, the terminal can also use its own functions to generate characters.

[0638] Therefore, server 104 stores the grouped information of object information and object role information into... Figure 19A The information storage unit for each object's role was established in 1912. Therefore, Figure 19A The object-based role information storage unit 1912 stores "grouped information of object information and object role information" for each object. For example, in... Figure 18 In this case, Figure 19A The object role information storage unit 1912 stores the "group information of object information and object role information" for object #1 of 1801_1 and the "group information of object information and object role information" for object #2 of 1801_2.

[0639] In addition, such as using Figure 19B , Figure 19C As explained, the terminal can also be used in the registration of the object-specific role information storage unit 1912, which stores information grouped together as "object information and object role information" for each object. Furthermore, the terminal can also send information about itself to the server 104. In this case, information such as "SIM (Subscriber Identity Module) information, telephone number information, (user's or terminal's) email address information, user's identification ID, terminal ID, SNS (Social networking service) information, and 'user information or identification information'" can be used as terminal-specific information. Therefore, Figure 19A The server 104's role information storage unit 1912, which stores information about the terminal in relation to "group information of object information and object role information", can also store information about the terminal.

[0640] At this point, the terminal corresponding to the role becomes capable of communicating with other roles (other users, other terminals) in the virtual space.

[0641] right Figure 19AThe operation of the role control unit 213, which is based on the location in real space, will be explained. The relationship between real space and virtual space will also be explained.

[0642] Figure 4A An example of real space is shown. For example... Figure 4A As shown, in real space, the inner side of ellipse 100_0 is named real space #0, the inner side of ellipse 100_1 is named real space #1, and the inner side of ellipse 100_2 is named real space #2. Additionally, real spaces other than "real space #0, real space #1, and real space #2" can also exist within real space.

[0643] Figure 4B It shows Figure 4A The relationship between real and virtual space in the game. For example, it could be the following relationship, etc.

[0644] · Figure 4A The "real space #0" and "virtual space #0" are linked together.

[0645] · Figure 4A The "real space #1" and "virtual space #1" are linked together.

[0646] · Figure 4A The "real space #2" and "virtual space #2" are linked together.

[0647] For example, "real space #X" and "virtual space #X" (where X is considered an integer greater than 0) can be digital twins. However, "real space #X" and "virtual space #X" do not necessarily have to be completely digital twins; for example, only a portion of "real space #X" and "virtual space #X" may be digital twins. Furthermore, the sizes of the spaces represented by "real space #X" and "virtual space #X" can be the same or different.

[0648] It is also possible that when the position in "real space #X" is determined, the position in "virtual space #X" is also determined (this will be explained later).

[0649] right Figure 19A The working example of the role control unit 213 based on the position in real space will be explained.

[0650] like Figure 18As shown, for example, object #1 of 1801_1 exists in real space #1, and object #1 of 1801_1 is detected and identified by camera device #1 of 1802_1. Furthermore, camera device #1 of 1802_1 estimates the position of object #1 of 1801_1 in real space #1. At this time, camera device #1 of 1802_1 can estimate the position of object #1 of 1801_1 based on its own position and the detection position of object #1 of 1801_1. Camera device #1 of 1802_1 and object #1 of 1801_1 undergo sensing processing, and camera device #1 of 1802_1 can also estimate the position of object #1 of 1801_1.

[0651] Therefore, camera device #1 of 1802_1 transmits the location information of object #1 of 1801_1 in real space #1 to server 104. Based on this, server 104 obtains the location information of object #1 of 1801_1 in real space #1, thus knowing "the location of object #1 of 1801_1 in real space #1". Furthermore, server 104 obtains information about object #1 of 1801_1 from camera device #1 of 1802_1. Additionally, server 104 can also obtain the location information of object #1 of 1801_1 in real space #1 from other devices.

[0652] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle outputs the role information corresponding to object #1 of 1801_1 after obtaining the information of object #1 of 1801_1.

[0653] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the location in real space, acquires the position information of object #1 of 1801_1 in real space #1, and outputs information for controlling the position of the role corresponding to object #1 of 1801_1 in virtual space #1, which has established a correspondence with real space #1.

[0654] Therefore, server 104 Figure 19A The output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #1 of 1801_1" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #1 of 1801_1 in the virtual space #1 corresponding to the real space #1" output by the role control unit 213 based on the position in the real space, configures the "role corresponding to object #1 of 1801_1" to the "position of the role corresponding to object #1 of 1801_1 in the virtual space #1 corresponding to the real space #1" in the virtual space #1 corresponding to the real space #1. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual space #1 containing "the role corresponding to object #1 of 1801_1", including an output signal 202 that outputs the output information about virtual space #1 containing "the role corresponding to object #1 of 1801_1" and outputs it from server 104. At this time, the output signal 202 may also include information about other virtual spaces (e.g., virtual space #2, virtual space #3, ...).

[0655] Therefore, when object #1 of 1801_1 moves in real space #1, and the position of object #1 of 1801_1 in real space #1 is updated, according to the above description, the position of the "role corresponding to object #1 of 1801_1" in the virtual space #1 corresponding to real space #1 is updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about the virtual space #1 containing "the role corresponding to the object #1 of 1801_1", and the output signal 202 is output from the server 104.

[0656] Furthermore, as described above, the location estimation system, such as GPS, possessed by object #1 of 1801_1 can also be used to estimate the location of object #1 of 1801_1 in real space #1, and the location information of object #1 of 1801_1 in real space #1 can be obtained by server 104 via other devices. Regarding other tasks, as long as they are performed as described above, they can be implemented in the same way.

[0657] Furthermore, although the description was given using object #1 of 1801_1 and camera device #1 of 1802_1, the same implementation can be carried out using other objects and other camera devices.

[0658] Therefore, as Figure 20 As shown, for example, object #1 of 1801_1 moves in real space #2.

[0659] Object #1 of 1801_1 is detected and identified by camera device #2 of 1802_2. Furthermore, camera device #2 of 1802_2 estimates the position of object #1 of 1801_1 in real space #2. At this time, camera device #2 of 1802_2 can estimate the position of object #1 of 1801_1 based on its own position and the detection position of object #1 of 1801_1. Camera device #2 of 1802_2 and object #1 of 1801_1 can also undergo sensing processing, and camera device #2 of 1802_2 estimates the position of object #1 of 1801_1.

[0660] Therefore, camera device #2 of 1802_2 transmits the location information of object #1 of 1801_1 in real space #2 to server 104. Based on this, server 104 obtains the location information of object #1 of 1801_1 in real space #2, thus knowing "the location of object #1 of 1801_1 in real space #2". Furthermore, server 104 obtains information about object #1 of 1801_1 from camera device #2 of 1802_2. Additionally, server 104 can also obtain the location information of object #1 of 1801_1 in real space #2 from other devices.

[0661] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle outputs the role information corresponding to object #1 of 1801_1 after obtaining the information of object #1 of 1801_1.

[0662] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the position in real space, acquires the position information of object #1 of 1801_1 in real space #2, and outputs information for controlling the position of the role corresponding to object #1 of 1801_1 in virtual space #2, which has established a correspondence with real space #2.

[0663] Therefore, server 104 Figure 19A The output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #1 of 1801_1" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #1 of 1801_1 in the virtual space #2 corresponding to the real space #2" output by the role control unit 213 based on the position in the real space, configures the "role corresponding to object #1 of 1801_1" to the "position of the role corresponding to object #1 of 1801_1 in the virtual space #2 corresponding to the real space #2" in the virtual space #2. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual space #2 containing "the role corresponding to object #1 of 1801_1", including an output signal 202 that outputs the output information about virtual space #2 containing "the role corresponding to object #1 of 1801_1" and outputs it from server 104. At this time, the output signal 202 may also include information about other virtual spaces (e.g., virtual space #1, virtual space #3, ...).

[0664] Therefore, when object #1 of 1801_1 moves in real space #2, and the position of object #1 of 1801_1 in real space #2 is updated, according to the above description, the position of the "role corresponding to object #1 of 1801_1" in the virtual space #2 corresponding to real space #2 is updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about the virtual space #2 containing "the role corresponding to object #1 of 1801_1", and the output signal 202 is output from the server 104.

[0665] Furthermore, as described above, object #1 of 1801_1 can utilize its GPS or other location estimation system to estimate its position in real space #2, and obtain the position information of object #1 of 1801_1 in real space #2 from server 104 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same manner.

[0666] Furthermore, although the description was given using object #1 of 1801_1 and camera device #2 of 1802_2, the same implementation can be carried out using other objects and other camera devices.

[0667] As described above, although the relationship between the ID in the real space and the ID in the virtual space, and the corresponding work of each department, have been explained, the relationship between the ID in the real space and the ID in the virtual space is not affected by... Figure 4B Due to limitations of the examples provided, other examples will be provided later.

[0668] right Figure 19A Other examples of the operation of the role control unit 213 based on the location in real space will be explained.

[0669] Figure 4A An example of real space is shown. For example... Figure 4A As shown, in real space, the inner side of ellipse 100_0 is named real space #0, the inner side of ellipse 100_1 is named real space #1, and the inner side of ellipse 100_2 is named real space #2. Additionally, real spaces other than "real space #0, real space #1, and real space #2" can also exist within real space.

[0670] Figure 10A , Figure 10B It shows that Figure 4A This illustrates the relationship between real and virtual space. For example, the following relationships are shown.

[0671] • Establish associations between “Real Space #0” and “Virtual Space #0”, “Virtual Space #1”, and “Virtual Space #2”.

[0672] • Establish a connection between “Real Space #1”, “Real Space #2” and “Virtual Space #3”.

[0673] • Establish associations between “Real Space #3”, “Real Space #4”, “Virtual Space #4”, and “Virtual Space #5”.

[0674] • Establish associations between “Real Space #5”, “Real Space #6”, “Virtual Space #6”, “Virtual Space #7”, and “Virtual Space #8”.

[0675] • Establish associations between “Real Space #7”, “Real Space #8”, “Real Space #9”, and “Real Space #10” and “Virtual Space #9” and “Virtual Space #10”.

[0676] For example, "real space #X" and "virtual space #Y" (where X and Y are considered integers greater than or equal to 0) can be digital twins. However, "real space #X" and "virtual space #Y" do not necessarily have to be completely digital twins; for example, "real space #X" and "virtual space #Y" could be partially digital twins. Furthermore, the sizes of the spaces represented by "real space #X" and "virtual space #Y" can be the same or different. And, when the sizes of the spaces represented by "real space #X" and "virtual space #Y" are different, the scales of "real space #X" and "virtual space #Y" can differ or be the same according to the axes that define the space. Here, the axes defining the space refer to the three axes of a three-dimensional coordinate system in three-dimensional space, and the two axes of a two-dimensional coordinate system in two-dimensional space.

[0677] Furthermore, it could also be a relationship where, when the position in "real space #X" is determined, the position in "virtual space #Y" is also determined.

[0678] In addition, there is at least one camera device in the real space. Figure 21 This example is shown. Additionally, for Figure 21 Zhongyu Figure 1 , Figure 18 Identical jobs are assigned the same number, with some of the description omitted.

[0679] like Figure 21 As shown, the camera device #0 of 1802_0 exists in the real space #0 of 100_0 and can communicate with the server 104 via network 103.

[0680] The camera device #1 of 1802_1 exists in the real space #1 of 100_1 and can communicate with the server 104 via network 103.

[0681] …The camera device #N of 1802_N exists in the real space #N of 100_N and can communicate with the server 104 via network 103. Furthermore, N is an integer greater than 2.

[0682] Therefore, the camera device #i of 1802_i exists in the real space #i of 100_i and can communicate with the server 104 via network 103. Furthermore, i is an integer greater than 0 and less than N.

[0683] Furthermore, the number of camera devices present in the real space is not limited to this example; it is acceptable as long as there is one or more camera devices present in the real space.

[0684] right Figure 19A The working example of the role control unit 213 based on the position in real space will be explained.

[0685] exist Figure 21 In the system, for example, object #1 of 1801_1 exists Figure 10A In the real space #0 of 100_0 described in the document, object #1 of 1801_1 is detected and identified by camera device #0 of 1802_0. Furthermore, camera device #0 of 1802_0 estimates the position of object #1 of 1801_1 in the real space #0. At this time, camera device #0 of 1802_0 can estimate the position of object #1 of 1801_1 based on its own position and the detection position of object #1 of 1801_1, or camera device #0 of 1802_0 and object #1 of 1801_1 can perform sensing processing, and camera device #0 of 1802_0 estimates the position of object #1 of 1801_1.

[0686] Therefore, camera device #0 of 1802_0 transmits the location information of object #1 of 1801_1 in real space #0 to server 104. Based on this, server 104 obtains the location information of object #1 of 1801_1 in real space #0, thus knowing "the location of object #1 of 1801_1 in real space #0". Furthermore, server 104 obtains information about object #1 of 1801_1 from camera device #0 of 1802_0. Additionally, server 104 can also obtain the location information of object #1 of 1801_1 in real space #0 from other devices.

[0687] Server 104 Figure 19AThe role information storage unit 1912 of each object in the middle outputs the role information corresponding to object #1 of 1801_1 after obtaining the information of object #1 of 1801_1.

[0688] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the location in real space, acquires the location information of object #1 of 1801_1 in real space #0, and outputs information for controlling the position of the role corresponding to object #1 of 1801_1 in virtual space #0, virtual space #1, or virtual space #2 that is associated with real space #0.

[0689] Therefore, server 104 Figure 19A The output information generation unit 214, based on information obtained from the spatial information storage unit 211, the "role information corresponding to object #1 of 1801_1" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #1 of 1801_1 in virtual spaces #0, #1, and #2 that are associated with real space" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #1 of 1801_1" to the "position of the role corresponding to object #1 of 1801_1 in virtual spaces #0, #1, and #2 that are associated with real space #0" in one of the virtual spaces #0, #1, and #2, through the server 104. Figure 19A The output information generation unit 214 generates output information about virtual spaces #0, #1, and #2 containing "the role corresponding to object #1 of 1801_1", including an output signal 202 that outputs the output information about virtual spaces #0, #1, and #2 containing "the role corresponding to object #1 of 1801_1" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0690] Therefore, when object #1 of 1801_1 moves in real space #0, and the position of object #1 in real space #0 of 1801_1 is updated, according to the above description, the positions of the "roles corresponding to object #1 of 1801_1" in virtual spaces #0, #1, and #2, which are associated with real space #0, are updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual spaces #0, virtual spaces #1, and virtual spaces #2 containing “roles corresponding to object #1 of 1801_1”, and the output signal 202 is output from the server 104.

[0691] Furthermore, as described above, object #1 of 1801_1 can also utilize its GPS or other location estimation system to estimate its position in real space #0, and the server 104 can obtain the position information of object #1 of 1801_1 in real space #0 via other devices. Other operations can be performed in the same manner as described above.

[0692] Furthermore, although the description was given using object #1 of 1801_1 and camera device #0 of 1802_0, the same implementation can be carried out using other objects or other camera devices.

[0693] Therefore, object #1 of, for example, 1801_1, moves to... Figure 10A The real space of 100_1 in the middle #1.

[0694] Object #1 of 1801_1 is detected and identified by camera device #1 of 1802_1. Furthermore, camera device #1 of 1802_1 estimates the position of object #1 of 1801_1 in real space #1. At this time, camera device #1 of 1802_1 can estimate the position of object #1 of 1801_1 by its own position and the detection position of object #1 of 1801_1, or it can perform sensing processing with object #1 of 1801_1, and then estimate the position of object #1 of 1801_1 by camera device #1 of 1802_1.

[0695] Therefore, camera device #1 of 1802_1 transmits the location information of object #1 of 1801_1 in real space #1 to server 104. Based on this, server 104 obtains the location information of object #1 of 1801_1 in real space #1, thus knowing "the location of object #1 of 1801_1 in real space #1". Furthermore, server 104 obtains information about object #1 of 1801_1 from camera device #1 of 1802_1. Additionally, server 104 can also obtain the location information of object #1 of 1801_1 in real space #1 from other devices.

[0696] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle outputs the role information corresponding to object #1 of 1801_1 after obtaining the information of object #1 of 1801_1.

[0697] Furthermore, server 104 Figure 19AThe role control unit 213, which is based on the position in real space, acquires the position information of object #1 of 1801_1 in real space #1, and outputs information for controlling the position of the role corresponding to object #1 of 1801_1 in virtual space #3, which is corresponding to real spaces #1 and #2.

[0698] Therefore, server 104 Figure 19A The output information generation unit 214, based on information obtained from the spatial information storage unit 211, the "role information corresponding to object #1 of 1801_1" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #1 of 1801_1 in the virtual space #3 corresponding to real spaces #1 and #2" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #1 of 1801_1" to the "position of the role corresponding to object #1 of 1801_1 in the virtual space #3 corresponding to real spaces #1 and #2" in the virtual space #3. The server 104... Figure 19A The output information generation unit 214 generates output information about the virtual space #3 containing the "role corresponding to object #1 of 1801_1", including an output signal 202 that outputs the output information about the virtual space #3 containing the "role corresponding to object #1 of 1801_1" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0699] Therefore, when object #1 of 1801_1 moves in real space #1, and the position of object #1 of 1801_1 in real space #1 is updated, according to the above description, the position of the "role corresponding to object #1 of 1801_1" in virtual space #3, which is corresponding to real spaces #1 and #2, is updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about the virtual space #3 containing "the role corresponding to object #1 of 1801_1", and the output signal 202 is output from the server 104.

[0700] Furthermore, as described above, object #1 of 1801_1 can also use its GPS or other location estimation system to estimate its position in real space #1, and the server 104 can obtain the position information of object #1 of 1801_1 in real space #1 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way. Moreover, although the description used object #1 of 1801_1 and camera device #1 of 1802_1, the same implementation can be achieved using other objects or other camera devices.

[0701] right Figure 19A The working example of the role control unit 213 based on the position in real space will be explained.

[0702] exist Figure 21 In the system, for example, object #2 of 1801_2 exists Figure 10A In the real space #1 described in the document 100_1, object #2 of 1801_2 is detected and identified by camera device #1 of 1802_1. Furthermore, for example, camera device #1 of 1802_1 estimates the position of object #2 of 1801_2 in the real space #1. At this time, camera device #1 of 1802_1 can estimate the position of object #2 of 1801_2 by its own position and the detection position of object #2 of 1801_2, or it can perform sensing processing between camera device #1 of 1802_1 and object #2 of 1801_2, with camera device #1 of 1802_1 estimating the position of object #2 of 1801_2.

[0703] Therefore, camera device #1 of 1802_1 transmits the location information of object #2 of 1801_2 in real space #1 to server 104. Based on this, server 104 obtains the location information of object #2 of 1801_2 in real space #1, thus knowing "the location of object #2 of 1801_2 in real space #1". Furthermore, server 104 obtains information about object #2 of 1801_2 from camera device #1 of 1802_1. Additionally, server 104 can also obtain the location information of object #2 of 1801_2 in real space #1 from other devices.

[0704] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle obtains the information of object #2 of 1801_2, and then outputs the role information corresponding to object #2 of 1801_2.

[0705] Furthermore, server 104 Figure 19AThe role control unit 213, which is based on the position in the real space, acquires the position information of object #2 of 1801_2 in the real space #1, and outputs information for controlling the position of the role corresponding to object #2 of 1801_2 in the virtual space #3 that has established a correspondence with the real spaces #1 and #2.

[0706] Therefore, server 104 Figure 19A The output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #2 of 1801_2" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #2 of 1801_2 in the virtual space #3 corresponding to real spaces #1 and #2" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #2 of 1801_2" to the "position of the role corresponding to object #2 of 1801_2 in the virtual space #3 corresponding to real spaces #1 and #2" in the virtual space #3. The server 104... Figure 19A The output information generation unit 214 generates output information about the virtual space #3 containing the "role corresponding to object #2 of 1801_2", including an output signal 202 that outputs the output information about the virtual space #3 containing the "role corresponding to object #2 of 1801_2" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0707] Therefore, when object #2 of 1801_2 moves in real space #1, and the position of object #2 in real space #1 is updated, according to the above description, the position of the "role corresponding to object #2 of 1801_2" in virtual space #3, which is corresponding to real spaces #1 and #2, is updated, and this is done through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about the virtual space #3 containing "the role corresponding to the object #2 of 1801_2", and the output signal 202 is output from the server 104.

[0708] Furthermore, as described above, object #2 of 1801_2 can also utilize its own GPS or other position estimation system to estimate its position in real space #1, and the server 104 can obtain the position information of object #2 of 1801_2 in real space #1 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way.

[0709] Furthermore, although the description was given using object #2 of 1801_2 and camera device #1 of 1802_1, the same implementation can be carried out using other objects and other camera devices.

[0710] Therefore, object #2 of, for example, 1801_2, moves to Figure 10A In the real space #3 of 100_3, object #2 of 1801_2 is detected and identified by camera device #3 of 1802_3. Furthermore, for example, camera device #3 of 1802_3 estimates the position of object #2 of 1801_2 in real space #3. At this time, camera device #3 of 1802_3 can estimate the position of object #2 of 1801_2 by its own position and the detection position of object #2 of 1801_2, or it can perform sensing processing between camera device #3 of 1802_3 and object #2 of 1801_2, and estimate the position of object #2 of 1801_2 by camera device #3 of 1802_3.

[0711] Therefore, camera device #3 of 1802_3 transmits the location information of object #2 of 1801_2 in real space #3 to server 104. Based on this, server 104 obtains the location information of object #2 of 1801_2 in real space #3, thus knowing "the location of object #2 of 1801_2 in real space #3". Furthermore, server 104 obtains information about object #2 of 1801_2 from camera device #3 of 1802_3. Additionally, server 104 can also obtain the location information of object #2 of 1801_2 in real space #3 from other devices.

[0712] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle obtains the information of object #2 of 1801_2, and then outputs the role information corresponding to object #2 of 1801_2.

[0713] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the position in real space, acquires the position information of object #2 of 1801_2 in real space #3, and outputs information for controlling the position of the role corresponding to object #2 of 1801_2 in virtual spaces #4 and #5 that are corresponding to real spaces #3 and #4.

[0714] Therefore, server 104 Figure 19AThe output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #2 of 1801_2" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #2 of 1801_2 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #2 of 1801_2" to the "position of the role corresponding to object #2 of 1801_2 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" in virtual spaces #4 and #5. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual spaces #4 and #5 containing "the role corresponding to object #2 of 1801_2", including an output signal 202 that outputs the output information about virtual spaces #4 and #5 containing "the role corresponding to object #2 of 1801_2" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0715] Therefore, object #2 of 1801_2 moves in real space #3. When the position of object #2 of 1801_2 in real space #3 is updated, according to the above description, the position of the "role corresponding to object #2 of 1801_2" in virtual spaces #4 and #5, which are corresponding to real spaces #3 and #4, is updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual spaces #4 and #5 containing “roles corresponding to object #2 of 1801_2”, and the output signal 202 is output from the server 104.

[0716] Furthermore, as described above, object #2 of 1801_2 can also use its GPS or other position estimation system to estimate its position in real space #3, and the server 104 can obtain the position information of object #2 of 1801_2 in real space #3 via other devices. Other operations can be performed in the same way as described above. Moreover, although the description used object #2 of 1801_2 and camera device #3 of 1802_3, the same implementation can be achieved using other objects or other camera devices.

[0717] right Figure 19A The working example of the role control unit 213 based on the position in real space will be explained.

[0718] exist Figure 21In the system, for example, object #3 of 1801_3 exists Figure 10A In the real space #3 of 100_3 described in the document, the object #3 of 1801_3 is detected and identified by the camera device #3 of 1802_3. Furthermore, for example, the camera device #3 of 1802_3 estimates the position of the object #3 of 1801_3 in the real space #3. At this time, the camera device #3 of 1802_3 can estimate the position of the object #3 of 1801_3 by its own position and the detection position of the object #3 of 1801_3, or it can perform sensing processing with the object #3 of 1801_3, and then estimate the position of the object #3 of 1801_3 by the camera device #3 of 1802_3.

[0719] Therefore, camera device #3 of 1802_3 transmits the location information of object #3 of 1801_3 in real space #3 to server 104. Based on this, server 104 obtains the location information of object #3 of 1801_3 in real space #3, thus knowing "the location of object #3 of 1801_3 in real space #3". Furthermore, server 104 obtains information about object #3 of 1801_3 from camera device #3 of 1802_3. Additionally, server 104 can also obtain the location information of object #3 of 1801_3 in real space #3 from other devices.

[0720] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle outputs the role information corresponding to object #3 of 1801_3 after obtaining the information of object #3 of 1801_3.

[0721] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the position in real space, acquires the position information of object #3 of 1801_3 in real space #3, and outputs information for controlling the position of the role corresponding to object #3 of 1801_3 in virtual space #4 and virtual space #5, which are corresponding to real space #3 and #4.

[0722] Therefore, server 104 Figure 19AThe output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #3 of 1801_3" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #3 of 1801_3 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #3 of 1801_3" to the "position of the role corresponding to object #3 of 1801_3 in virtual spaces #4 and #5 corresponding to real spaces #3 and #4" in virtual spaces #4 and #5. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual spaces #4 and #5 containing "the role corresponding to object #3 of 1801_3", including an output signal 202 that outputs the output information about virtual spaces #4 and #5 containing "the role corresponding to object #3 of 1801_3" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0723] Therefore, when object #3 of 1801_3 moves in real space #3, and the position of object #3 of 1801_3 in real space #3 is updated, according to the above description, the positions of the "roles corresponding to object #3 of 1801_3" in virtual spaces #4 and #5, which are corresponding to real spaces #3 and #4, are updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual space #4 and virtual space #5 containing “role corresponding to object #3 of 1801_3”, and the output signal 202 is output from the server 104.

[0724] Furthermore, as described above, object #3 of 1801_3 can also utilize its GPS or other location estimation system to estimate its position in real space #3, and the server 104 can obtain the position information of object #3 of 1801_3 in real space #3 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way.

[0725] Furthermore, although the description was given using object #3 of 1801_3 and camera device #3 of 1802_3, the same implementation can be carried out using other objects and other camera devices.

[0726] Therefore, for example, object #3 of 1801_3 moves to Figure 10BIn the real space #5 of 100_5, object #3 of 1801_3 is detected and identified by camera device #5 of 1802_5. Furthermore, for example, camera device #5 of 1802_5 estimates the position of object #3 of 1801_3 in real space #5. At this time, camera device #5 of 1802_5 can also estimate the position of object #3 of 1801_3 by its own position and the detection position of object #3 of 1801_3, or it can perform sensing processing with object #3 of 1801_3, and estimate the position of object #3 of 1801_3 by camera device #5 of 1802_5.

[0727] Therefore, camera device #5 of 1802_5 transmits the location information of object #3 of 1801_3 in real space #5 to server 104. Based on this, server 104 obtains the location information of object #3 of 1801_3 in real space #5, thus knowing "the location of object #3 of 1801_3 in real space #5". Furthermore, server 104 obtains information about object #3 of 1801_3 from camera device #5 of 1802_5. Additionally, server 104 can also obtain the location information of object #3 of 1801_3 in real space #5 from other devices.

[0728] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle outputs the role information corresponding to object #3 of 1801_3 after obtaining the information of object #3 of 1801_3.

[0729] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the position in real space, acquires the position information of object #3 of 1801_3 in real space #5, and outputs information for controlling the position of the role corresponding to object #3 of 1801_3 in virtual spaces #6, #7, and #8, which are established in real spaces #5 and #6.

[0730] Therefore, server 104 Figure 19AThe output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #3 of 1801_3" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #3 of 1801_3 in virtual spaces #6, #7, #8 corresponding to real spaces #5, #6" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #3 of 1801_3" to the "position of the role corresponding to object #3 of 1801_3 in virtual spaces #6, #7, #8 corresponding to real spaces #5, #6" in virtual spaces #6, #7, #8. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual spaces #6, #7, and #8 containing "the role corresponding to object #3 of 1801_3", including an output signal 202 that outputs the output information about virtual spaces #6, #7, and #8 containing "the role corresponding to object #3 of 1801_3" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0731] Therefore, object #3 of 1801_3 moves in real space #5. When the position of object #3 of 1801_3 in real space #5 is updated, according to the above description, the positions of the "roles corresponding to object #3 of 1801_3" in virtual spaces #6, #7, and #8, which are corresponding to real spaces #5 and #6, are updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual spaces #6, #7, and #8 containing “roles corresponding to object #3 of 1801_3”, and the output signal 202 is output from the server 104.

[0732] Furthermore, as described above, object #3 of 1801_3 can also use its GPS or other position estimation system to estimate its position in real space #5, and the server 104 can obtain the position information of object #3 of 1801_3 in real space #5 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way. Moreover, although the description used object #3 of 1801_3 and camera device #5 of 1802_5, the same implementation can be achieved using other objects or other camera devices.

[0733] right Figure 19A The working example of the role control unit 213 based on the position in real space will be explained.

[0734] exist Figure 21 In the system, for example, object #4 of 1801_4 exists Figure 10B In the real space #5 of 100_5 described in the document, object #4 of 1801_4 is detected and identified by camera device #5 of 1802_5. Furthermore, camera device #5 of 1802_5 estimates the position of object #4 of 1801_4 in the real space #5. At this time, camera device #5 of 1802_5 can estimate the position of object #4 of 1801_4 by its own position and the detection position of object #4 of 1801_4, or it can perform sensing processing with object #4 of 1801_4, and then estimate the position of object #4 of 1801_4 by camera device #5 of 1802_5.

[0735] Therefore, camera device #5 of 1802_5 transmits the location information of object #4 of 1801_4 in real space #5 to server 104. Based on this, server 104 obtains the location information of object #4 of 1801_4 in real space #5, thus knowing "the location of object #4 of 1801_4 in real space #5". Furthermore, server 104 obtains information about object #4 of 1801_4 from camera device #5 of 1802_5. Additionally, server 104 can also obtain the location information of object #4 of 1801_4 in real space #5 from other devices.

[0736] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle obtains the information of object #4 of 1801_4, and then outputs the role information corresponding to object #4 of 1801_4.

[0737] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the position in real space, acquires the position information of object #4 of 1801_4 in real space #5, and outputs information for controlling the position of the role corresponding to object #4 of 1801_4 in virtual spaces #6, #7, and #8 that have been established with real spaces #5 and #6.

[0738] Therefore, server 104 Figure 19AThe output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #4 of 1801_4" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #4 of 1801_4 in virtual spaces #6, #7, #8 corresponding to real spaces #5, #6" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #4 of 1801_4" in virtual spaces #6, #7, #8 corresponding to real spaces #5, #6 to the position of the "role corresponding to object #4 of 1801_4" in virtual spaces #6, #7, #8 corresponding to real spaces #5, #6. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual spaces #6, #7, and #8 containing "the role corresponding to object #4 of 1801_4", including an output signal 202 that outputs the output information about virtual spaces #6, #7, and #8 containing "the role corresponding to object #4 of 1801_4" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0739] Therefore, object #4 of 1801_4 moves in real space #5. When the position of object #4 of 1801_4 in real space #5 is updated, according to the above description, the positions of the "roles corresponding to object #4 of 1801_4" in virtual spaces #6, #7, and #8, which are corresponding to real spaces #5 and #6, are updated, through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual spaces #6, #7, and #8 containing “roles corresponding to object #4 of 1801_4”, and the output signal 202 is output from the server 104.

[0740] Furthermore, as described above, object #4 of 1801_4 can utilize its own GPS or other location estimation system to estimate its position in real space #5, and can obtain the position information of object #4 of 1801_4 in real space #5 from server 104 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same manner.

[0741] Furthermore, although the description was given using object #4 of 1801_4 and camera device #5 of 1802_5, the same implementation can be carried out using other objects and other camera devices.

[0742] Thus, for example, object #4 of 1801_4 moves to Figure 10BIn the real space #7 of 100_3, object #4 of 1801_4 is detected and identified by camera device #7 of 1802_7. Furthermore, for example, camera device #7 of 1802_7 estimates the position of object #4 of 1801_4 in the real space #7. At this time, camera device #7 of 1802_7 can estimate the position of object #4 of 1801_4 by its own position and the detection position of object #4 of 1801_4, or it can perform sensing processing with object #4 of 1801_4, and estimate the position of object #4 of 1801_4 by camera device #7 of 1802_7.

[0743] Therefore, camera device #7 of 1802_7 transmits the location information of object #4 of 1801_4 in real space #7 to server 104. Based on this, server 104 obtains the location information of object #4 of 1801_4 in real space #7, thus knowing "the location of object #4 of 1801_4 in real space #7". Furthermore, server 104 obtains information about object #4 of 1801_4 from camera device #7 of 1802_7. Additionally, server 104 can also obtain the location information of object #4 of 1801_4 in real space #7 from other devices.

[0744] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle obtains the information of object #4 of 1801_4, and then outputs the role information corresponding to object #4 of 1801_4.

[0745] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the location in the real space, obtains the position information of object #4 of 1801_4 in the real space #7, and outputs the position information of the role corresponding to object #4 of 1801_4 in the virtual spaces #9 and #10 that have been established with the real spaces #7, #8, #9 and #10.

[0746] Therefore, server 104 Figure 19AThe output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #4 of 1801_4" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #4 of 1801_4 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9, and #10" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #4 of 1801_4" in virtual spaces #9 and #10 to the "position of the role corresponding to object #4 of 1801_4 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9, and #10". The server 104... Figure 19A The output information generation unit 214 generates output information about virtual spaces #9 and #10 containing "the role corresponding to object #4 of 1801_4", including an output signal 202 that outputs the output information about virtual spaces #9 and #10 containing "the role corresponding to object #4 of 1801_4" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0747] Therefore, object #4 of 1801_4 moves in real space #7. When the position of object #4 of 1801_4 in real space #7 is updated, according to the above description, the positions of the "roles corresponding to object #4 of 1801_4" in virtual spaces #9 and #10, which are corresponding to real spaces #7, #8, #9, and #10, are updated. This is done through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual spaces #9 and #10 containing “roles corresponding to object #4 of 1801_4”, and the output signal 202 is output from the server 104.

[0748] Furthermore, as described above, object #4 of 1801_4 can also use its GPS or other location estimation system to estimate its position in real space #7, or the server 104 can obtain the position information of object #4 of 1801_4 in real space #7 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way. Moreover, although the description used object #4 of 1801_4 and camera device #7 of 1802_7, the same implementation can be achieved using other objects or other camera devices.

[0749] right Figure 19A The working example of the role control unit 213 based on the position in real space will be explained.

[0750] exist Figure 21 In the system, for example, object #5 of 1801_5 exists Figure 10B In the real space #7 of 100_7 described in the document, object #5 of 1801_5 is detected and identified by camera device #7 of 1802_7. Furthermore, camera device #7 of 1802_7 estimates the position of object #5 of 1801_5 in the real space #7. At this time, camera device #7 of 1802_7 can estimate the position of object #5 of 1801_5 by using its own position and the detection position of object #5 of 1801_5, or it can perform sensing processing between camera device #7 of 1802_7 and object #5 of 1801_5, and then estimate the position of object #5 of 1801_5 by camera device #7 of 1802_7.

[0751] Therefore, camera device #7 of 1802_7 transmits the location information of object #5 of 1801_5 in real space #7 to server 104. Based on this, server 104 obtains the location information of object #5 of 1801_5 in real space #7, thus knowing "the location of object #5 of 1801_5 in real space #7". Furthermore, server 104 obtains information about object #5 of 1801_5 from camera device #7 of 1802_7. Additionally, server 104 can also obtain the location information of object #5 of 1801_5 in real space #7 from other devices.

[0752] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle obtains the information of object #5 of 1801_5, and then outputs the role information corresponding to object #5 of 1801_5.

[0753] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the position in real space, acquires the position information of object #5 of 1801_5 in real space #7, and outputs information for controlling the position of the role corresponding to object #5 of 1801_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9 and #10.

[0754] Therefore, server 104 Figure 19AThe output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #5 of 1801_5" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #5 of 1801_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9, and #10" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #5 of 1801_5" to the "position of the role corresponding to object #5 of 1801_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9, and #10" in virtual spaces #9 and #10. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual spaces #9 and #10 containing "the role corresponding to object #5 of 1801_5", including an output signal 202 that outputs the output information about virtual spaces #9 and #10 containing "the role corresponding to object #5 of 1801_5" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0755] Therefore, object #5 of 1801_5 moves in real space #1. When the position of object #5 of 1801_5 in real space #1 is updated, according to the above description, the positions of the "roles corresponding to object #5 of 1801_5" in virtual spaces #9 and #10, which are corresponding to real spaces #7, #8, #9, and #10, are updated. This is done through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual spaces #9 and #10 containing “roles corresponding to object #5 of 1801_5”, and the output signal 202 is output from the server 104.

[0756] Furthermore, as described above, object #5 of 1801_5 can also use its own GPS or other location estimation system to estimate its position in real space #7, or it can obtain the position information of object #5 of 1801_5 in real space #7 from server 104 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way.

[0757] Furthermore, although the description was given using object #5 of 1801_5 and camera device #7 of 1802_7, the same implementation can be carried out using other objects and other camera devices.

[0758] Therefore, for example, object #5 of 1801_5 moves to Figure 10BIn the real space #9 of 100_3, object #5 of 1801_5 is detected and identified by camera device #9 of 1802_9. Furthermore, for example, camera device #9 of 1802_9 estimates the position of object #5 of 1801_5 in real space #9. At this time, camera device #9 of 1802_9 can estimate the position of object #5 of 1801_5 by using its own position and the detection position of object #5 of 1801_5, or it can perform sensing processing between camera device #9 of 1802_9 and object #5 of 1801_5, and estimate the position of object #5 of 1801_5 by camera device #9 of 1802_9.

[0759] Therefore, camera device #9 of 1802_9 transmits the location information of object #5 of 1801_5 in real space #9 to server 104. Based on this, server 104 obtains the location information of object #5 of 1801_5 in real space #9, thus knowing "the location of object #5 of 1801_5 in real space #9". Furthermore, server 104 obtains information about object #5 of 1801_5 from camera device #9 of 1802_9. Additionally, server 104 can also obtain the location information of object #5 of 1801_5 in real space #9 from other devices.

[0760] Server 104 Figure 19A The role information storage unit 1912 of each object in the middle obtains the information of object #5 of 1801_5, and then outputs the role information corresponding to object #5 of 1801_5.

[0761] Furthermore, server 104 Figure 19A The role control unit 213, which is based on the position in real space, acquires the position information of object #5 of 1801_5 in real space #9, and outputs information for controlling the position of the role corresponding to object #5 of 1801_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9 and #10.

[0762] Therefore, server 104 Figure 19AThe output information generation unit 214, based on the information obtained from the spatial information storage unit 211, the "role information corresponding to object #5 of 1801_5" output by the role information storage unit 1912 for each object, and the "information for controlling the position of the role corresponding to object #5 of 1801_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9, and #10" output by the role control unit 213 based on the position in real space, configures the "role corresponding to object #5 of 1801_5" to the "position of the role corresponding to object #5 of 1801_5 in virtual spaces #9 and #10 that have established corresponding relationships with real spaces #7, #8, #9, and #10" in virtual spaces #9 and #10. The server 104... Figure 19A The output information generation unit 214 generates output information about virtual spaces #9 and #10 containing "the role corresponding to object #5 of 1801_5", including an output signal 202 that outputs the output information about virtual spaces #9 and #10 containing "the role corresponding to object #5 of 1801_5" and outputs it from the server 104. At this time, the output signal 202 may also include information about other virtual spaces.

[0763] Therefore, object #5 of 1801_5 moves in real space #9. When the position of object #5 of 1801_5 in real space #9 is updated, according to the above description, the positions of the "roles corresponding to object #5 of 1801_5" in virtual spaces #9 and #10, which are corresponding to real spaces #7, #8, #9, and #10, are updated. This is done through server 104. Figure 19A The output information generation unit 214 generates an output signal 202 that includes output information about virtual spaces #9 and #10 containing “roles corresponding to object #5 of 1801_5”, and the output signal 202 is output from the server 104.

[0764] Furthermore, as described above, object #5 of 1801_5 can also estimate its own position in real space #9 using a location estimation system such as GPS, or it can obtain the position information of object #5 of 1801_5 in real space #9 from server 104 via other devices. Regarding other operations, as long as they are performed as described above, they can be implemented in the same way. Moreover, although the description used object #5 of 1801_5 and camera device #9 of 1802_9, the same implementation can be achieved using other objects or other camera devices.

[0765] As described above, although the relationship between the IDs in the real space and the IDs in the virtual space, and the operation of each part under this relationship, have been explained, the relationship between the IDs in the real space and the IDs in the virtual space is not subject to... Figure 10A , Figure 10B As the examples are limited, as long as one or more real space IDs are associated with one or more virtual space IDs, it can be implemented as described above.

[0766] As described above, the server 104, which obtains the location information of the object through the camera device, makes the character equivalent to the object appear in the virtual space based on the location information of the object. The following is a specific example of this.

[0767] For example, the situation is as shown below.

[0768] • The object is associated with the role that becomes a "person", "animal", or "possible animal". The server 104 makes the role that becomes the object appear in the virtual space based on the terminal's location information.

[0769] The camera device acquires the location information of the object. Therefore, the server 104 obtains the location information of the object.

[0770] • The "person," "animal," or "possible object" in the real space corresponding to the object, such as riding a bus and the bus moving on a road. At this time, the object is located a few meters above the ground and moves at the speed of the bus.

[0771] In the above situation, the camera device detects that "the object is located on the road (the longitude and latitude of the road can be obtained) and is 4m above the ground".

[0772] Therefore, server 104 obtains the three-dimensional position of the object, for example... Figure 17A As shown, server 104 can perform a process such as making a "character that becomes an object in the shape of a 'person,' 'animal,' or 'animal body'" appear in the virtual space at a position (1700_1) 4m above the ground on the road.

[0773] Furthermore, the camera device can detect and identify surrounding information beyond the object, and can also make the surrounding conditions identified along with the object appear in virtual space.

[0774] Furthermore, the role equivalent to the object is not limited to "human", "animal" or "animal body", but can be arbitrary.

[0775] As described above, server 104 enables the role equivalent to an object to be represented in the virtual space in a way that is closer to its location in the real space.

[0776] Furthermore, as another example, server 104 obtains the three-dimensional position of the object, for example... Figure 17B As shown, server 104 performs a process that causes a "character that becomes an object in the shape of a 'person,' 'animal,' or 'possible animal'" to appear on the ground of a road in the virtual space (e.g., at a height of 0m) (1700_2).

[0777] Based on the above description, server 104 can represent the role equivalent to an object in a virtual space by adjusting its height relative to its position in real space. This allows for the creation of a virtual space that improves upon physical incomprehensibility in real space (e.g., phenomena such as people levitation), while simultaneously creating a situation where personal information is difficult to deduce based on information related to the role equivalent to the object, thereby achieving the effect of protecting personal information.

[0778] Furthermore, as mentioned above, relative to the terminal's three-dimensional position in real space, in virtual space, the role equivalent to an object can be positioned in a "virtual space". Figure 17A The first method shown appears in a manner equivalent to three dimensions. Figure 17B The second method shown is to make an appearance by correcting the height (depending on the correction method, it will become a method that appears in a way equivalent to two dimensions) and then switch to it.

[0779] The setting of which method, the first or the second, to use can be performed when setting the object on server 104.

[0780] Alternatively, the setting of which method, the first or the second, to use can also be performed by server 104.

[0781] Therefore, server 104, based on the settings, causes the character that is equivalent to the object to appear in the virtual space.

[0782] Next, for Figure 18 , Figure 20 , Figure 21 The operation of terminal #101 of 101_101 and terminal #102 of 101_102 will be explained.

[0783] Terminal #101 of 101_101 and terminal #102 of 101_102 communicate with server 104 via network 103.

[0784] When terminals such as terminal #101 of 101_101 and terminal #102 of 101_102 communicate with server 104, they are also in the process of establishing an association with the role corresponding to the terminal.

[0785] like Figure 3B As shown, the terminal sends terminal information to server 104 (301). Furthermore, the terminal information is information that server 104 can use to identify the terminal (and / or user), such as SIM (Subscriber Identity Module) information, phone number information, email address information (usable by the user or terminal), user ID, terminal ID, SNS (Social networking service) information, etc.—"terminal and / or user information." Therefore, server 104 obtains the terminal information (351).

[0786] Therefore, the terminal sends the role information to the server 104 (302). As a result, the server 104 receives the role information (352).

[0787] Additionally, when generating role information, the terminal can also... Figure 19A The character generation unit 215 of server 104 can obtain information about the source of a character, and can also obtain such information from a device different from server 104. Based on this, the terminal can generate character information. Furthermore, as another method, the terminal can also use its own functions to generate a character.

[0788] Therefore, server 104 stores the terminal information and the terminal's role information as a group. Figure 2 The role information storage unit 212 for each terminal. Therefore, Figure 2 The role information storage unit 212 stores "group information of terminal information and role information of the terminal" for each terminal.

[0789] Figure 3B The description of the operation as "terminal information" in the instructions can also be replaced by "user information or identification information" and implemented in the same way. Furthermore, the description of the operation as "terminal information" in other instructions can also be replaced by "user information or identification information" and implemented in the same way.

[0790] As described above, the character information storage unit 212 stores... Figure 18 , Figure 20 , Figure 21The information in 101_101 is "the information of the terminal information and the role information of the terminal". The information in 101_102 is "the information of the terminal information and the role information of the terminal".

[0791] Therefore, the operation Figure 18 , Figure 20 , Figure 21 In the example, user #101 of terminal 101 in 101_101 accesses server 104 via network 103. For example, operation Figure 18 , Figure 20 , Figure 21 The user of terminal #101 in 101_101 sends a request to server 104 via network 103. Figure 19A The character action control unit 216 is connected. Then, the user operates terminal #101 of 101_101, causing the character corresponding to terminal #101 of 101_101 to appear in the virtual space, or causing the character corresponding to terminal #101 of 101_101 to move in the virtual space. Thus, the part that controls the character becomes... Figure 19A Character motion control unit 216.

[0792] Furthermore, users can also use the role of terminal #101, which is equivalent to 101_101, to communicate with other roles in the virtual space, or to make contact, send messages, or chat online (or make calls by voice).

[0793] Furthermore, users can move the character equivalent to terminal #101 of 101 in virtual space in a manner independent of the real-world location of terminal #101 of 101_101. Thus, the part controlling the character becomes... Figure 19A Character motion control unit 216.

[0794] Similarly, for Figure 18 , Figure 20 , Figure 21 The user operating terminal #102 in 101_102 accesses server 104 via network 103. For example, for Figure 18 , Figure 20 , Figure 21 The user operating terminal #102 in 101_102 communicates with server 104 via network 103. Figure 2 The character action control unit 216 shown is connected. Then, the user operates terminal #102 of 101_102, causing the character corresponding to terminal #102 of 101_102 to appear in the virtual space, or causing the character corresponding to terminal #102 of 101_102 to move in the virtual space. Thus, the part that controls the character becomes... Figure 19ACharacter motion control unit 216.

[0795] Furthermore, users can use the role of terminal #102, which is equivalent to 101_102, to communicate with other roles in the virtual space, or to make contact, send messages, or chat online (or make voice calls).

[0796] Furthermore, users can move the character equivalent to terminal #102 (101_102) in virtual space in a manner independent of the real-world location of terminal #102 (101_102). Thus, the part controlling the character becomes... Figure 19A Character motion control unit 216.

[0797] The following example illustrates the actions of various characters in "virtual space #1," which is linked to real space #1. Therefore, using... Figure 18 Please provide an explanation.

[0798] As already explained, with Figure 18 The virtual space #1 associated with the real space #1 shown is generated by server 104. Therefore, as... Figure 18 As shown, since object #1 of 1801_1 and object #2 of 1801_2 exist in real space #1, server 104 generates virtual space #1 by having objects appear in virtual space #1 in a manner that are "equivalent to object #1 of 1801_1" and "equivalent to object #2 of 1801_2". Therefore, server 104 controls the position of the objects in virtual space #1 that are "equivalent to object #1 of 1801_1" according to their position in real space, and similarly, server 104 controls the position of the objects in virtual space #1 that are "equivalent to object #2 of 1801_2" according to their position in real space.

[0799] Additionally, for those that do not exist Figure 18 The user operating terminal #101 of 101_101 in the real space #1 accesses server 104 via network 103. The user operates terminal #101 of 101_101, causing the character equivalent to terminal #101 of 101_101 to appear in virtual space #1, or causing the character equivalent to terminal #101 of 101_101 to move in virtual space #1.

[0800] Therefore, the user operating terminal #101 of 101_101, using the role equivalent to terminal #101 of 101_101, can communicate with the "role equivalent to object #1 of 1801_1 existing in real space #1" (the user using the role) existing in virtual space #1, or can establish contact, send messages, or engage in online chat (or make voice calls). As already explained, at this time, the user operating terminal #101 of 101_101 communicates with the terminal corresponding to the "role equivalent to object #1 of 1801_1," or the user using the terminal, or establishes contact, sends messages, or engages in online chat (or makes voice calls).

[0801] Furthermore, the user operating terminal #101 of 101_101 can use the role equivalent to terminal #101 of 101_101 to communicate with the "role equivalent to terminal #102 of 101_102 that does not exist in real space #1" (the user using the role) that exists in virtual space #1, or can make contact, send messages, or chat online (or make calls by voice).

[0802] Furthermore, the user operating the terminal corresponding to object #1 of 1801_1 can use the role of terminal #101, which is equivalent to 101_1, to communicate with the "role of terminal #101, which is equivalent to 101_101, which does not exist in the real space #1" (the user using the role) that exists in the virtual space #1, or can make contact, send messages, or chat online (or make a call by voice).

[0803] Furthermore, the actions a user performs in virtual space using a role corresponding to the terminal towards a terminal (or a user using the terminal) that is equivalent to another role are not limited to the examples mentioned above (communication, online chat, etc.). For example, it could also be "sending images (still images), sending moving images, sending advertisements, distributing advertisements, distributing coupons," etc.

[0804] Accordingly, "users who use terminals in real spaces that correspond to objects and are associated with virtual spaces" and "users who use terminals to enter virtual spaces" can communicate, thereby achieving the effect of communicating with more users.

[0805] As described above, the effect is that by establishing a corresponding role (virtual avatar) for the object based on the location information of the object in the real space, the virtual avatar appears in the virtual space corresponding to the real space. This provides a more diverse system suitable for the real environment in which the object, the terminal, and the user of the terminal exist. Furthermore, the terminal and the user of the terminal can communicate with more other terminals (other users) in both the real and virtual spaces, thereby improving convenience.

[0806] In this embodiment, although a camera device has been described, the camera device can also be provided by a base station. In this case, the same implementation can be carried out even if the base station is any of the following: "TRP (Tx(Transmission) / Rx(Reception)point), repeater, access point, broadcast station, gNB (g Node B), eNB (e Node B), node, server, satellite, mobile device (electric mobile device such as "electric car, electric motorcycle (e-motorcycle), electric bicycle, mobile robot, electric scooter, electric-assisted bicycle, electric-assisted scooter", automobile, motorcycle, bicycle, ship, aircraft, airplane, etc.), terminal, portable telephone, smartphone, tablet computer, laptop computer, computer, personal computer, home appliance (household electrical machinery), factory equipment, IoT (Internet of Things) device, etc. communication equipment / broadcasting equipment, etc." Therefore, a base station can also be referred to as "TRP, repeater, access point, broadcast station, gNB, eNB, node, server, satellite, mobile device, terminal, portable phone, smartphone, tablet, laptop, computer, personal computer, home appliance, factory equipment, IoT device, and other communication / broadcasting equipment, etc." All of the above are the same in this specification.

[0807] Furthermore, while the terminal has been described in this embodiment, it can be implemented in the same way even if the terminal is any of the following: "TRP, base station, repeater, access point, broadcast station, gNB, eNB, node, server, satellite, mobile device, terminal, portable phone, smartphone, tablet computer, laptop computer, computer, personal computer, home appliance, factory device, IoT device, etc., communication device / broadcasting device, etc." Therefore, the terminal in this embodiment can be referred to as "TRP, base station, repeater, access point, broadcast station, gNB, eNB, node, server, satellite, mobile device, terminal, portable phone, smartphone, tablet computer, laptop computer, computer, personal computer, home appliance, factory device, IoT device, etc., communication device / broadcasting device, etc." All of the above applies in this specification.

[0808] Furthermore, for example, when the device transmits modulated signals or signals for sensing, it can utilize one or more transmitting antennas to transmit one or more modulated signals or signals for sensing. The same applies to all of the above in this specification.

[0809] The "signals transmitted by the terminal, such as modulation signals or signals used for sensing" mentioned above can belong to any of UL-SCH, PUCCH, PUSCH, PRACH, etc. However, they are not limited to these.

[0810] Furthermore, the "signals transmitted by the base station, such as downlink frames, reference signals, and control signals" mentioned above can belong to any of the following: PCH, BCH, DL-SCH, BCCH, PCCH, CCCH, common search space, PBCH, SS, PDCCH, PDSCH, etc. However, they are not limited to these.

[0811] Although the example described in this embodiment is that server 104 can... Figure 18 The "roles corresponding to the objects" of "object #1 of 1801_1" and "object #2 of 1801_2", and the "roles equivalent to terminals" such as "terminal #101 of 101_101" and "terminal #102 of 101_102" appear in the virtual space. The "roles corresponding to the objects" and "roles equivalent to terminals" are controlled in the virtual space. However, the "roles corresponding to the objects" and "roles equivalent to terminals" in the virtual space can be any role, any object, or any virtual avatar. Therefore, in this embodiment, even if the record of "role" is treated as a record of "object" or "virtual avatar", the same implementation is possible.

[0812] Furthermore, while "roles corresponding to objects" and "roles equivalent to terminals" in virtual space can be "roles (or objects, virtual avatars) like humans", "roles (or objects, virtual avatars) like animals", "roles (or objects, virtual avatars) like birds", "roles (or objects, virtual avatars) like flying objects (drones, aircraft, airplanes)", "roles (or objects, virtual avatars) like motor vehicles", "roles (or objects, virtual avatars) like bicycles", "roles (or objects, virtual avatars) like motorcycles", "roles (or objects, virtual avatars) like trams", "roles (or objects, virtual avatars) like trains", or "roles (or objects, virtual avatars) like robots", they are not limited to these categories.

[0813] Furthermore, server 104 can determine which of a predefined multiple terminal types the terminal belongs to, and display the objects corresponding to each state, or the objects selected from the object group, in the virtual space. The correspondence between terminal types and objects is not limited to the examples above. For example, it can correspond to objects that have different animal shapes depending on the terminal type, or it can correspond to objects that have the same shape but different colors, even though they belong to the same terminal type.

[0814] Therefore, server 104 can determine which of a predefined multiple object types the object belongs to, and display the object corresponding to each state, or the object selected from the object group, in the virtual space. The correspondence between object types and objects is not limited to the examples above. For example, a correspondence can be established between objects whose shapes differ due to their object type, or between objects whose shapes are the same but whose colors differ, even if they are of the same object type.

[0815] Furthermore, the same applies to the above points in this specification.

[0816] exist Figure 18 Since object #1 of 1801_1 exists in real space #1, server 104, for example, causes the character corresponding to object #1 of 1801_1 to appear in virtual space #1 corresponding to real space #1. For example, a user controls the character corresponding to object #1 of 1801_1 using a terminal or the like. Thus, an example is shown where server 104 provides information about virtual space #1 to the terminal.

[0817] Alternatively, server 104 generates information for AR display, which is then provided to objects #1 (1801_1), #2 (1801_2), etc., existing in real space #1. Server 104 can then provide this AR display information to terminals corresponding to the objects "object #1 (1801_1), #2 (1801_2), etc." existing in real space #1. When a terminal with AR display capabilities exists in real space #1, that terminal receives the AR display information and displays the characters, objects, etc., at the designated locations.

[0818] Server 104 generates information for AR display based on the information in virtual space #1. At this time, server 104 generates "information on characters and objects to be displayed overlaid in real space" and "position information of characters and objects in real space required for overlay display" based on the "information and position of characters and objects in virtual space #1". Then, server 104 sends the "information on characters and objects to be displayed overlaid in real space" and the "position information of characters and objects in real space required for overlay display" to the "terminal with AR display function" existing in real space #1. The "terminal with AR display function" displays characters and objects at the designated positions based on the "information on characters and objects to be displayed overlaid in real space" and the "position information of characters and objects in real space required for overlay display".

[0819] Alternatively, the terminal can also perform the following processing.

[0820] The terminal estimates its own position by comparing 3D map information with sensor data (such as point cluster data obtained by LiDAR or cameras). In this position estimation, the terminal estimates the position or orientation information in the 3D map information, for example, as its own position information. Based on its estimated position, the terminal obtains shape data and / or configuration location data of surrounding objects from server 104. Based on its own position information, the terminal displays the objects on a display screen showing images captured by the terminal's camera, or on a transparent display of smart goggles, etc.

[0821] In addition, when estimating its own position, the terminal can also detect surrounding planes such as the ground or tabletops. Here, the detected plane can be a horizontal or near-horizontal surface, a vertical plane such as a wall, or a plane with any angle including both horizontal and vertical. Furthermore, the terminal detects these objects and provides them to the server 104, which can then be displayed in the virtual space or processed as objects for display in the AR space.

[0822] Therefore, when displaying an object, the terminal does not directly utilize the information about the object's set position, but rather adjusts the object's position on the display screen based on the detected planar information. Furthermore, this applies to both virtual space displays and AR displays.

[0823] Furthermore, while the example of displaying objects in virtual space or AR based on the terminal's estimated location has been described, objects can also be displayed in virtual space or AR based on location information obtained through other methods. Location information obtained through other methods could include the terminal's location information estimated by the base station, the terminal's location information estimated by other devices, or location information obtained via GPS. Here, by utilizing the terminal's location information estimated by the base station, and displaying a character in virtual space based on the location information estimated by the base station, the possibility of discrepancies arising between the object seen by that character in virtual space and the object displayed via AR in real space can be reduced.

[0824] Furthermore, the virtual space construction method described in Embodiment 1 and the virtual space construction method described in Embodiment 2 can be used together. Specifically, the virtual space may contain: a "role that is associated with the virtual space and is equivalent to a terminal existing in the real space" as described in Embodiment 1, a "role that is associated with the virtual space and is equivalent to an object existing in the real space" as described in this embodiment, and a "role that is controlled by a terminal".

[0825] (Implementation Method 3)

[0826] In this embodiment, a specific example of the modulated signal transmitted by the base station and terminal described in Embodiment 1 will be explained. As an example, [the following will be described using...] Figure 1 Let me explain.

[0827] Figure 22 It shows that Figure 1 The base station capability information 2200 included in the modulation signal transmitted by base station #1 (e.g., base station 102_1) is an example. The base station capability information 2200 includes, for example, "information 2211 on whether to provide location information services," "information 2212 on whether to provide virtual space services," and "information 2213 on whether it is a real space that supports a method for making a terminal-like character appear in virtual space based on location information in real space." At this time, the base station sends the base station capability information 2200 to the terminal.

[0828] In addition, the base station capability information 2200 may be composed of at least one of the following: "information 2211 on whether to provide location information services", "information 2212 on whether to provide virtual space services", or "information 2213 on whether to provide real space information that supports a method for making a terminal-like character appear in virtual space based on location information in real space".

[0829] "Information 2211 on whether to provide location information service" is "information used by the base station to notify whether there is a function to estimate the location of the terminal".

[0830] For example, the "Information 2211 on whether to provide location information service" is a 1-bit message. Therefore, when "Information 2211 on whether to provide location information service" is "1", it corresponds to the base station transmitting a modulated signal for location estimation of the terminal and receiving a modulated signal from the terminal. Thus, when the terminal receives the "Information 2211 on whether to provide location information service" message as "1", the base station and the terminal interact for location estimation of the terminal.

[0831] Furthermore, if the "Information 2211 on whether to perform location information service" is "0", then it does not correspond to the base station transmitting the modulated signal for location estimation of the terminal or receiving the modulated signal from the terminal. Therefore, when the terminal receives the "Information 2211 on whether to perform location information service" which is "0", the base station and the terminal do not interact for location estimation of the terminal. Therefore, the terminal will not request the base station to perform its own location estimation. Furthermore, the terminal will not request services that establish association with the virtual space utilizing location information, as described in Embodiment 1.

[0832] "Information 2212 on whether to provide virtual space services" refers to "information on whether the base station corresponds to the provision of virtual space as described in Implementation 1" or "information on whether there is virtual space within the communication range of the base station".

[0833] For example, "Information 2212 on whether to provide virtual space services" is a 1-bit message. Therefore, when "Information 2212 on whether to provide virtual space services" is "1", it indicates that the base station corresponds to the virtual space provided as described in Implementation Method 1. Thus, when the terminal receives "Information 2211 on whether to provide location information services" which is "1", the terminal can request access to the virtual space.

[0834] If the "Information 2212 on whether to provide virtual space services" is "0", it indicates that the base station does not correspond to the provision of virtual space as described in Implementation 1. Therefore, if the terminal receives the "Information 2211 on whether to provide location information services" message with a value of "0", the terminal will not request access to the virtual space.

[0835] As another example, when "Information 2212 on whether to provide virtual space services" is "1", it indicates that a virtual space exists within the range that the base station can communicate with. Therefore, when the terminal receives "Information 2211 on whether to provide location information services" with "1", the terminal can request access to the virtual space.

[0836] When "Information 2212 on whether to provide virtual space services" is "0", it indicates that there is no virtual space within the range that the base station can communicate with. Therefore, when the terminal receives "Information 2211 on whether to provide location information services" with the information "0", the terminal does not request access to the virtual space.

[0837] "Whether the information 2213 of the real space is supporting the method of making a character equivalent to the terminal appear in the virtual space based on the location information in the real space" means whether the information "the base station described in Implementation 1 obtains the location information of the terminal and communicates with the server in order to make a character equivalent to the terminal that has obtained the location information appear in the virtual space" is executed.

[0838] For example, "Information 2213 on the real space of whether it supports the method of making a character equivalent to a terminal appear in the virtual space based on the location information in the real space" is 1 bit of information.

[0839] Therefore, when the "Information 2213 on whether to provide location information in the virtual space based on location information in the real space" is "1", it indicates that "the base station can perform a service to provide virtual space within its own communication range, obtain the location information of the terminal, and enable the character equivalent to the terminal that obtained the location information to appear in the virtual space". Thus, when the terminal receives the "Information 2211 on whether to perform location information service" which is "1", the terminal can request the base station to "enable the character based on its own location information to appear in the virtual space".

[0840] If the "Information 2213 on whether to provide real space information for a method that allows a character equivalent to a terminal to appear in virtual space based on location information in real space" is "0", then it indicates that "the base station does not perform services for providing virtual space within its own communication range". Therefore, if the terminal receives the "Information 2211 on whether to perform location information service" with the information "0", the terminal does not request the base station to "allow a character based on its own location information to appear in virtual space based on its own location information".

[0841] As described above, the base station sends base station capability information to the terminal, so that the terminal can determine whether the base station corresponds to the "service of making a character appear in the virtual space based on the location of the terminal existing in the real space" described in Implementation Method 1. The advantage of this is that the terminal can appropriately accept the service.

[0842] Figure 23 It shows that Figure 1 This example illustrates the configuration of terminal capability information 2300 included in the modulated signal transmitted by terminals #1 (101_1), #2 (101_2), #101 (101_101), and #102 (101_102). Terminal capability information 2300 includes, for example, information such as "whether it corresponds to providing services in virtual space (2311)," "whether it corresponds to location information services (2312)," and "whether it supports a method for enabling a terminal-like character to appear in virtual space based on location information in real space (2313)." The terminal then transmits the terminal capability information 2300 to the base station.

[0843] In addition, the terminal capability information 2300 may be composed of at least one of the following: "information 2311 on whether it provides services for virtual space", "information 2312 on whether it corresponds to location information services", or "information 2313 on whether it supports a method for making a character equivalent to the terminal appear in virtual space based on location information in real space".

[0844] "Information 2311 regarding whether the service provided to the virtual space is appropriate" refers to "information regarding whether the terminal is appropriate for the service provided to the virtual space described in Implementation 1 via the base station".

[0845] For example, the information "whether to provide services to the virtual space, information 2311" is 1 bit. Therefore, when "whether to provide services to the virtual space, information 2311" is "1", it indicates that the virtual space described in Embodiment 1 is being provided to the corresponding terminal. Thus, when the base station receives the information "whether to perform location information service, information 2211" which is "1", the base station can begin interaction with the terminal to provide the virtual space service described in Embodiment 1.

[0846] If the "Information 2311 on whether to provide services for the virtual space" is "0", then the provision of services for the virtual space described in Implementation 1 is shown, but not for the corresponding terminal. Therefore, if the base station receives the "Information 2211 on whether to perform location information service" which is "0", the base station will not start the interaction with the terminal to provide the services for the virtual space described in Implementation 1.

[0847] "Information 2312 on whether it corresponds to location information service" is "information used by the terminal to notify whether it has the function of obtaining its own location information".

[0848] For example, "Information 2312 regarding whether it corresponds to location information service" is a 1-bit piece of information. Therefore, when "Information 2312 regarding whether it corresponds to location information service" is "1", the terminal indicates the transmission of a modulated signal used for its own location estimation and the reception of a modulated signal from the base station. Thus, when the base station receives "Information 2312 regarding whether it corresponds to location information service" as "1", it initiates an interaction between the base station and the terminal for estimating the terminal's location.

[0849] Furthermore, if the "Information 2312 on whether it corresponds to location information service" is "0", the terminal indicates that it does not correspond to the transmission of the modulated signal used for its own location estimation or the reception of the modulated signal from the base station. Therefore, when the base station receives the "Information 2312 on whether it corresponds to location information service" which is "0", the base station and the terminal do not perform any interaction for estimating the terminal's location.

[0850] In addition, the location estimation of the terminal can be performed by the base station or by the terminal itself.

[0851] "Is the information 2313 supporting a method for making a character equivalent to a terminal appear in a virtual space based on location information in the real space?" Yes, is the information supporting "the base station described in Implementation 1 obtains the location information of the terminal and communicates with the server in order to make a character equivalent to the terminal that obtained the location information appear in a virtual space?"

[0852] For example, the information "whether it is a method that supports making a character equivalent to a terminal appear in virtual space based on location information in real space" is 1 bit. Therefore, when "whether it is a method that supports making a character equivalent to a terminal appear in virtual space based on location information in real space" is "1", it indicates "a terminal corresponding to a system where the base station and server obtain the terminal's location information and make a character equivalent to a terminal appear in virtual space based on the location information". Therefore, when the base station receives the "1" information "whether it is a method that supports making a character equivalent to a terminal appear in virtual space based on location information in real space", the base station can provide the terminal with the service of "making a character appear in virtual space based on the terminal's location information".

[0853] If the "Information 2313 on whether it supports a method for making a character equivalent to a terminal appear in virtual space based on location information in real space" is "0", then it indicates that "this is not a terminal corresponding to a system in which the base station and server obtain the terminal's location information and make a character equivalent to a terminal appear in virtual space based on the location information". Therefore, if the base station receives the "Information 2313 on whether it supports a method for making a character equivalent to a terminal appear in virtual space based on location information in real space" with a value of "0", the base station will not provide the terminal with the service of "making a character based on the terminal's location information appear in virtual space".

[0854] As described above, the terminal sends terminal capability information to the base station, so that the base station can determine whether the terminal corresponds to the "service of making a character appear in the virtual space based on the location of the terminal existing in the real space" described in Implementation Method 1. The advantage of this is that the base station can provide the service appropriately.

[0855] For sending Figure 22 The configuration example of the base station shown in the base station capability information 2200 will be explained.

[0856] Figure 24A This is a first example of a base station configuration. For instance, interface 2400 takes a first input signal 2401 as input and outputs a first output signal 2402. The first input signal 2401 and the first output signal 2402 are signals used for wireless communication and are related to the antenna's transmission and reception.

[0857] Furthermore, interface 2400 takes the second input signal 2403 as input and outputs the second output signal 2404. The second input signal 2403 and the second output signal 2404 are signals used for communication with server 104.

[0858] Interface 2400 is connected to wireless communication processing unit 2411, position estimation processing unit 2412, and virtual space association processing unit 2413. Alternatively, although it is called an interface, it could also be a bus.

[0859] The wireless communication processing unit 2411 is for performing operations with... Figure 1 The terminal in the system performs wireless communication transmission processing and reception processing.

[0860] The position estimation processing unit 2412 is with Figure 1The system interacts with the terminal, performing the generation of a transmission signal and the processing of a reception signal for terminal location estimation. Specific examples of the processing have been described in Implementation 1, so their description is omitted here. Thus, the location estimation processing unit 2412 obtains the terminal's location information. Alternatively, the base station may transmit the terminal's location information to a server.

[0861] The virtual space association processing unit 2413 obtains terminal information and terminal location information, processes this information, and transmits it to the server. Accordingly, the server performs processing to make the character corresponding to the terminal appear in the virtual space. Then, the server transmits data such as "data for virtual space display, terminal control data, and data transmitted to the terminal" to the base station. (This data is acquired by the wireless communication processing unit 2411 and processed for transmission to the terminal.) Furthermore, the base station may also have functional units other than the "wireless communication processing unit 2411, location estimation processing unit 2412, and virtual space association processing unit 2413." For example, the base station may also have a location estimation processing unit using other systems such as GPS, and an interface for connecting to other devices.

[0862] For example, if the base station has a location estimation processing unit that uses other systems such as GPS, the terminal's location can be estimated based on its own location when estimating the terminal's location. Furthermore, if the base station has an interface for connecting to other devices, it can also connect to other devices.

[0863] The composition of a base station is not subject to Figure 24A The examples are limited.

[0864] in addition, Figure 24A The base station in the configuration is the same as the base station described in Implementation 1 for "the method of making a character equivalent to a terminal appear in virtual space based on the terminal's location information in real space". Therefore, when transmitting... Figure 22 When the base station capability information is 2200, the following transmission is performed.

[0865] For example, "Information 2211 on whether to provide location information services" is 1 bit of information. Therefore, Figure 24A The base station sets "Whether to perform location information service information 2211" to "1", indicating that the base station corresponds to the transmission of modulation signals used to estimate the location of the terminal and the reception of modulation signals from the terminal.

[0866] For example, "Information 2212 on whether to provide virtual space services" is 1 bit of information. Therefore, Figure 24AThe base station sets "Information 2212 on whether to provide virtual space services" to "1", indicating that the base station corresponds to the provision of virtual space described in Implementation 1.

[0867] As other examples Figure 24A The base station sets "Information 2212 on whether to provide services in virtual space" to "1", indicating that there is a virtual space for the range that the base station can communicate with.

[0868] For example, "whether it is real space information 2213 that supports the method of making a character equivalent to a terminal appear in virtual space based on location information in real space" is 1 bit of information. Therefore, Figure 24A The base station sets "whether it is real space information 2213 that supports the method of making the role equivalent to the terminal appear in the virtual space based on the location information in the real space" to "1", indicating that "the base station performs a service to provide virtual space within its own communication range, obtains the location information of the terminal, and is able to make the role equivalent to the terminal that has obtained the location information appear in the virtual space".

[0869] Furthermore, other examples could be: Figure 24A The base station sets "whether it is a real space information 2213 that supports the method of making the role equivalent to the terminal appear in the virtual space based on the location information in the real space" to "0", indicating that "the base station does not perform services for providing virtual space within its own communication range".

[0870] As sent Figure 22 Other configuration examples of the base station shown in the base station capability information 2200 are related to... Figure 24B Please provide an explanation. Additionally, regarding... Figure 24A The same work is assigned the same number, and part of the description is omitted.

[0871] Figure 24B This is an example of a base station configuration. For instance, interface 2400 takes a first input signal 2401 as input and outputs a first output signal 2402. The first input signal 2401 and the first output signal 2402 are signals used for wireless communication, becoming signals related to transmission and reception via the antenna.

[0872] Furthermore, interface 2400 takes the second input signal 2403 as input and outputs the second output signal 2404. The second input signal 2403 and the second output signal 2404 are signals used for communication with servers, etc.

[0873] Interface 2400 is connected to wireless communication processing unit 2411 and position estimation processing unit 2412. Alternatively, although it is called an interface, it could also be a ...

Claims

1. A method is a method executed by a server, In the method, receiving control information indicating that the first terminal is staying in a first area of ​​the real space, Information corresponding to the first terminal is sent to a second terminal that is displaying a first virtual space, so that a display screen of the second terminal displays an image corresponding to the first terminal, wherein the first virtual space corresponds to a first area of ​​the real space.

2. The method according to claim 1, The second terminal is located outside the first area of ​​the real space.

3. The method according to claim 1, The control information is information indicating that the first terminal is communicating with the first base station.

4. The method according to claim 3, A first area of ​​the real space is associated with the first base station and a second base station different from the first base station.

5. The method according to claim 3, The first virtual space is associated with a first area of ​​the real space and a second area of ​​the real space different from the first area of ​​the real space.

6. The method according to claim 3, A correspondence is established between the first area of ​​the real space and the first area of ​​the first virtual space.

7. The method according to claim 3, Further in the method, acquiring location information of the first terminal from the first base station, The position of an image corresponding to the first terminal in the first virtual space is changed according to the position information of the first terminal.

8. A server comprising a communication unit and a processor, The communication unit receives control information indicating that the first terminal is staying in the first area of ​​the real space, The processor generates information corresponding to the first terminal, The communication unit transmits the information to a second terminal that is displaying a first virtual space, and causes a display screen of the second terminal to display the first virtual space, wherein the first virtual space corresponds to a first area of ​​the real space.

9. A method is a method executed by a terminal, In the method, communicating with a first base station disposed in a first area of ​​real space, Control information including an identifier indicating the first base station and an identifier indicating the terminal is transmitted to a server providing a first virtual space corresponding to a first area of ​​the real space.

10. The method according to claim 9, In the method, further, performing sensing with the first base station for generating location information of the terminal, The location information is sent to the server.

11. A terminal comprising a communication unit and a processor, The communication unit communicates with a first base station arranged in a first area of ​​the real space, The processor generates control information including an identifier indicating the first base station and an identifier indicating the terminal, The control information is transmitted to a server that provides a first virtual space corresponding to a first area of ​​the real space.

12. A method, performed by a base station configured in a first area of ​​real space, In the method, communicating with a first terminal residing in a first area of ​​the real space, Control information including an identifier indicating a first base station and an identifier indicating the first terminal is transmitted to a server providing a first virtual space corresponding to a first area of ​​the real space.

13. The method according to claim 12, In the method, further, performing sensing for generating location information of the first terminal, The location information is sent to the server.

14. A base station comprising a communication unit and a processor, wherein the base station is arranged in a first area of ​​a real space. The communication unit communicates with a first terminal staying in a first area of ​​the real space, The processor generates control information including an identifier indicating the first base station and an identifier indicating the first terminal, The communication unit transmits the control information to a server that provides a first virtual space corresponding to a first area of ​​the real space.

Images