Virtual space management device

Abstract

This virtual space management device provides, to a user, a virtual space in which a plurality of individual spaces corresponding one-to-one to a plurality of cities are integrated. The virtual space management device comprises: a determination unit that, on the basis of attribute information indicating attributes of a user, determines visual effects for a visit city visited by the user among a plurality of cities in the virtual space; a generation unit that applies the visual effects determined by the determination unit in common to a plurality of buildings belonging to the visited city, thereby generating an individual space of the visited city; and a provision unit that provides the individual space generated by the generation unit to a terminal device used by the user.

Description

Virtual space management device

[0001] The present invention relates to a virtual space management device.

[0002] Conventionally, attempts have been made to solve local issues and provide new services by linking information between cities and users by using virtual spaces managed by each city and linking data between cities. Patent Literature 1 discloses an information processing device that identifies detected user behavior, determines customization information corresponding to the identified behavior, determines how to customize the virtual space, and processes spatial information that is the basis of the virtual space in accordance with the determined customization information.

[0003] JP 2013-250897 A

[0004] "docomo Open House '23 Exhibit: Developing communication activation technology through massive simultaneous connection, value understanding, and behavioral change - Meta-communication realized by integrating networks and services -", ​​[online], February 1, 2023, [Retrieved August 10, 2023], Internet, <URL: https: / / www.docomo.ne.jp / info / news_release / 2023 / 02 / 01_00.html>

[0005] However, in conventional devices, customization of virtual objects placed in a user's private space is performed but customization of virtual objects placed in a public space is not taken into consideration, so when a user visits each city in the virtual space, the user is not provided with a sufficiently impressive visiting experience.

[0006] The present invention has been made to solve the above-mentioned problems, and aims to generate a virtual space that reflects the user's unique worldview, providing the user with an impressive or attractive visiting experience.

[0007] A preferred aspect of the virtual space management device of the present invention is a virtual space management device that provides a user with a virtual space that integrates multiple individual spaces that correspond one-to-one to multiple cities, and includes: a determination unit that determines the visual effects for a city that the user visits from among the multiple cities in the virtual space based on attribute information that indicates the user's attributes; a generation unit that generates an individual space for the visited city by commonly applying the visual effects determined by the determination unit to multiple buildings that belong to the visited city; and a provision unit that provides the individual space generated by the generation unit to a terminal device used by the first user.

[0008] According to the virtual space management device of the present invention, a virtual space that reflects a user's unique worldview is generated, providing the user with an impressive or attractive visiting experience.

[0009] 1 is a diagram showing the overall configuration of an information processing system including a virtual space management device according to a first embodiment. FIG. 1 is a schematic diagram showing an example of a network using a city OS. FIG. 2 is a block diagram showing an example of the configuration of the terminal device of FIG. 1. FIG. 3 is a block diagram showing an example of the configuration of an individual server of FIG. 1. FIG. 4 is a block diagram showing an example of the configuration of the management server of FIG. 1. FIG. 5 is a schematic diagram showing an example of a neural network model applied to a learning model according to a first embodiment. FIG. 6 is a diagram showing an example of a scene in a virtual space to which no visual effects have been applied. FIG. 7 is a diagram showing an example of a scene in a virtual space to which a visual effect dedicated to a first user has been applied. FIG. 8 is a diagram showing an example of a scene in a virtual space to which a visual effect dedicated to a second user has been applied. FIG. 9 is a diagram showing an example of a scene in which avatars are moving around in the virtual space of FIG. 7. FIG. 8 is a diagram showing an example of a scene in which avatars are moving around in the virtual space of FIG. 9. FIG. 10 is a diagram showing an example of a reception counter of a government office in an individual space. FIG. 11 is a flowchart showing a first operation of the processing device of FIG. 5. FIG. 12 is a flowchart showing a second operation of the processing device of FIG. 5. FIG. 13 is a flowchart showing a third operation of the processing device of FIG. 5. FIG. 14 is a diagram showing an example of a scene in a virtual space to which an item included in visual effect information has been applied.

[0010] 1. First Embodiment Hereinafter, the configuration of a virtual space management device according to a first embodiment of the present invention will be described with reference to FIGS.

[0011] 1.1. Configuration of the First Embodiment 1.1.1. Overall Configuration

[0012] 1 is a diagram showing the overall configuration of an information processing system 1 including a virtual space management device according to the first embodiment. The information processing system 1 includes a terminal device 10, an individual server 20, a management server 30, and a communication network NET.

[0013] The terminal devices 10 include terminal devices 10-1, 10-2, ..., 10-K, 10-L, ..., 10-N. Here, N is any natural number, and K and L are any natural numbers smaller than N. In this embodiment, the configurations of the terminal devices 10-1 to 10-N are identical to one another. Note that the terminal devices 10 may include terminal devices that do not have the same configuration.

[0014] First user U Ｋ is a user who uses the terminal device 10-K. Ｌ is a user who uses the terminal device 10-L. Note that users who use terminal devices other than the terminal device 10-K and the terminal device 10-L are not shown in FIG.

[0015] The individual servers 20 include individual servers 20-1, 20-2, ..., 20-J, and 20-M. Here, M is any natural number, and J is any natural number smaller than M. In this embodiment, the individual servers 20-1 to 20-M have the same configuration. Note that the individual servers 20 may include individual servers that do not have the same configuration.

[0016] The individual servers 20 are servers that primarily provide administrative services for each city. Here, cities are divided into municipal units such as cities, towns, and villages, or regional units that include several cities, towns, and villages. The individual servers 20 operate a City OS as the platform for providing administrative services. The City OS is an open administrative management system that can link with existing administrative information systems by standardizing the platform and API (Application Programming Interface). The City OS runs application software for administration, logistics, transportation, and the like, for example.

[0017] Figure 2 is a schematic diagram showing an example of a network using each city OS. As shown in Figure 2, the city OS is operated on a local government or regional basis. The city OSs 80-1 to 80-4 are configured to be able to cooperate with each other. There is a one-to-one correspondence between each city OS and the individual servers 20-1 to 20-M.

[0018] City OS 80-1 in City A is connected to services #1, #2, #3, and #7 via a standard API. City OS 80-1 in City A is also connected to data #a, #b, #c, and #f via a standard API.

[0019] The city OS 80-2 in Town B is connected to services #4, #5, and #6 via a standard API. The city OS 80-2 in Town B is also connected to data #d, #e, and #f via a standard API.

[0020] City OS 80-4 in City D and service #7 are connected via a standard API. Therefore, city OS 80-1 in City A and city OS 80-4 in City D share service #7. Also, city OS 80-1 in City A and city OS 80-2 in Town B share data #f.

[0021] City OS 80-1 in City A, City OS 80-2 in Town B, City OS 80-3 in Village C, and City OS 80-4 in City D are directly or indirectly connected, and each City OS is interoperable. Each City OS can cooperate with each other to circulate various data within and outside each city.

[0022] In the information processing system 1, terminal devices 10-1 to 10-N, individual servers 20-1 to 20-M, and a management server 30 are communicably connected to one another via a communication network NET. The information processing system 1 is a system that provides a virtual space management service to each user of the terminal devices 10-1 to 10-N.

[0023] The management server 30 is a server that manages the virtual space. The management server 30 acquires various information from the terminal device 10 via the communication network NET and provides a virtual space management service to the terminal device 10. The virtual space is a space that integrates a plurality of individual spaces that correspond one-to-one to a plurality of cities. In other words, the virtual space is a space that integrates a plurality of individual spaces that correspond one-to-one to the individual servers 20-1 to 20-M.

[0024] 1.1.2. Configuration of Terminal Device Fig. 3 is a block diagram showing an example configuration of the terminal device 10-K in Fig. 1. As shown in Fig. 3, the terminal device 10-K includes a processing device 11, a storage device 12, a communication device 13, a display 14, an input device 15, an imaging device 16, a sound recording device 17, and a positioning device 18. The elements included in the terminal device 10 are connected to each other by a single or multiple buses for communicating information.

[0025] The processing device 11 is a processor that controls the entire terminal device 10, and is configured using, for example, one or more chips. The processing device 11 is configured using, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, a register, etc. Note that some or all of the functions of the processing device 11 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The processing device 11 executes various processes in parallel or sequentially.

[0026] The storage device 12 is a recording medium that can be read and written by the processing device 11. The storage device 12 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), and an electrically erasable programmable read-only memory (EEPROM). The volatile memory is, for example, a random access memory (RAM).

[0027] The storage device 12 stores a plurality of programs including a control program PR1 to be executed by the processing device 11. The storage device 12 also functions as a work area for the processing device 11.

[0028] The communication device 13 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 13 is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 13 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 13 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE 1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0029] The display 14 is a device that displays images and text information. The display 14 displays various images under the control of the processing device 11. For example, various display panels such as a liquid crystal panel and an organic EL (Electro Luminescence) panel are suitably used as the display 14.

[0030] The input device 15 is a first user U ＫFor example, the input device 15 includes a keyboard, a touchpad, a touch panel, and a pointing device such as a mouse. If the input device 15 includes a touch panel, it may also function as the display 14.

[0031] The imaging device 16 outputs a captured image Gx obtained by capturing an image of the external world. The imaging device 16 includes, for example, a lens, an imaging element, an amplifier, and an AD converter. Light collected through the lens is converted into an analog imaging signal by the imaging element. The amplifier amplifies the imaging signal and outputs it to the AD converter. The AD converter converts the amplified analog imaging signal into imaging information, which is a digital signal. The converted imaging information is output to the processing device 11 as the captured image Gx.

[0032] The recording device 17 outputs audio information Ox obtained by recording surrounding sounds. The recording device 17 includes, for example, a microphone, an amplifier, and an AD converter. The surrounding sounds are converted into analog audio signals by the microphone. The amplifier amplifies the audio signals and outputs them to the AD converter. The AD converter converts the amplified analog audio signals into audio information Ox, which is a digital signal. The converted audio information Ox is output to the processing device 11.

[0033] The positioning device 18 acquires position information of the terminal device 10. The positioning device 18 may be, for example, a GNSS (Global Navigation Satellite System) receiver. The GNSS receiver receives radio signals transmitted from one or more GNSS satellites. GNSS is a positioning system that uses positioning satellites from countries around the world, including GPS (Global Positioning System) satellites. The radio signals include information such as the position information of the satellite that transmitted the radio signals and the transmission time of the radio signals. The GNSS receiver performs positioning based on the one or more received radio signals and outputs the position information of the GNSS receiver to the processing device 11.

[0034] The positioning device 18 may be, for example, a VPS (Visual Positioning Service) device. Ｋ The first user U Ｋ The VPS device outputs the image information acquired from the imaging device to a location information server (not shown) via the communication device 13. The VPS device acquires VPS information as location information from the location information server via the communication device 13. The location information is used by the first user U. Ｋ the position in the real space of the first user U Ｋ includes the direction in which the real space is viewed.

[0035] The terminal device 10-K displays the display 14 or the first user U Ｋ The XR glasses are worn on the head of a user and display virtual objects placed in a virtual space. Here, XR glasses is a general term for VR (Virtual Reality) glasses, AR (Augmented Reality) glasses, and MR (Mixed Reality) glasses.

[0036] The virtual objects include, for example, virtual objects representing data such as still images, videos, three-dimensional CG models, HTML files, and text files, as well as virtual objects representing applications. Examples of text files include memos and source code. Examples of applications include browsers, applications for using SNS, and applications for generating document files.

[0037] The terminal device 10-K includes a personal computer, a tablet terminal, a smartphone, a smart watch, etc. The terminal device 10-K is preferably a mobile terminal device such as a tablet or a smartphone. Note that the XR glasses may be connected to the communication network NET without going through the terminal device 10.

[0038] The processing device 11 functions as an acquisition unit 111, an output unit 112, and a display control unit 113, for example, by reading and executing a control program PR1 from the storage device 12.

[0039] The acquisition unit 111 acquires various information transmitted from the individual servers 20-1 to 20-M and the management server 30, the captured image Gx output from the imaging device 16, the audio information Ox output from the recording device 17, and the location information output from the positioning device 18.

[0040] The output unit 112 outputs the captured image Gx, the audio information Ox, and the position information to the management server 30 via the communication device 13. The output unit 112 also receives the captured image Gx, the audio information Ox, and the position information from the first user U using the input device 15. Ｋ The information input by the first user U is output to the management server 30 via the communication device 13. Ｋ The information input by the user includes, for example, text information input on a chat tool.

[0041] The display control unit 113 causes the display 14 to display various pieces of information based on the various pieces of information acquired by the acquisition unit 111. For example, the display control unit 113 causes the display 14 to display an image showing a virtual object. When XR glasses are connected to the terminal device 10-K, the display control unit 113 causes the display 14 to display an image showing a virtual object for the first user U. Ｋ In other words, an image showing a virtual object is displayed on the display of the XR glasses according to the orientation of the XR glasses.

[0042] 1.1.3. Configuration of Individual Server Fig. 4 is a block diagram showing an example configuration of the individual server 20-J in Fig. 1. As shown in Fig. 4, the individual server 20-J includes a processing device 21, a storage device 22, a communication device 23, a display 24, and an input device 25. The elements included in the individual server 20 are connected to each other by one or more buses for communicating information.

[0043] The processing device 21 is a processor that controls the entire individual server 20, and is configured using, for example, one or more chips. The processing device 21 is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, and a register. Note that some or all of the functions of the processing device 21 may be realized by hardware such as a DSP, ASIC, PLD, or FPGA. The processing device 21 executes various processes in parallel or sequentially.

[0044] The storage device 22 is a recording medium that can be read and written by the processing device 21. The storage device 22 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM.

[0045] The storage device 22 stores a plurality of programs, including a control program PR2, to be executed by the processing device 21, as well as a city OS COS, a three-dimensional CG model CGM, and visual effect information VEI. The three-dimensional CG model CGM is a model of a plurality of buildings placed in the public space of the city. The visual effect information VEI is information about the visual effects on the virtual space that are determined for each user who visits the city in the virtual space. The storage device 22 also functions as a work area for the processing device 21.

[0046] The communication device 23 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 23 is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 23 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 23 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE 1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0047] The display 24 is a device that displays images and text information. The display 24 displays various images under the control of the processing device 21. For example, various display panels such as a liquid crystal panel and an organic EL panel are suitably used as the display 24.

[0048] The input device 25 is a device that accepts operations by an administrator of the information processing system 1. For example, the input device 25 includes a keyboard, a touchpad, a touch panel, and a pointing device such as a mouse. If the input device 25 includes a touch panel, it may also function as the display 24. In particular, the administrator of the information processing system 1 can modify the control program PR2 by using the input device 25.

[0049] The processing device 21 functions as an acquisition unit 211, an output unit 212, and a display control unit 213, for example, by reading and executing a control program PR2 from the storage device 22.

[0050] The acquisition unit 211 acquires various types of information transmitted from other individual servers and the management server 30 .

[0051] The output unit 212 outputs the visual effect information VEI stored in the storage device 22 to the management server 30 via the communication device 13 .

[0052] The display control unit 213 displays various pieces of information on the display 24 based on the various pieces of information acquired by the acquisition unit 211. For example, the display control unit 213 can transmit information on three-dimensional CG models of buildings in a city to the display 24 and display the buildings in the virtual space on the display 24.

[0053] 1.1.4. Configuration of the Management Server Fig. 5 is a block diagram showing an example configuration of the management server 30 of Fig. 1. As shown in Fig. 5, the management server 30 includes a processing device 31 as a virtual space management device, a storage device 32, a communication device 33, a display 34, and an input device 35. The elements included in the management server 30 are connected to each other by a single or multiple buses for communicating information. The management server 30 is an example of a virtual space management device.

[0054] The processing device 31 is a processor that controls the entire management server 30, and is configured using, for example, one or more chips. The processing device 31 is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, and a register. Note that some or all of the functions of the processing device 31 may be realized by hardware such as a DSP, ASIC, PLD, or FPGA. The processing device 31 executes various processes in parallel or sequentially.

[0055] The storage device 32 is a recording medium that can be read and written by the processing device 31. The storage device 32 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM.

[0056] The storage device 32 stores a plurality of programs including a control program PR3 to be executed by the processing device 31, teacher data TD1, a learning model LM1, a large-scale language model LLM, and an ID database IDB. The storage device 32 also functions as a work area for the processing device 31.

[0057] The communication device 33 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 33 is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 33 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 33 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE 1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0058] The display 34 is a device that displays images and text information. The display 34 displays various images under the control of the processing device 31. For example, various display panels such as a liquid crystal panel and an organic EL panel are suitably used as the display 34.

[0059] The input device 35 is a device that accepts operations by an administrator of the information processing system 1. For example, the input device 35 includes a keyboard, a touchpad, a touch panel, and a pointing device such as a mouse. If the input device 35 includes a touch panel, it may also function as the display 34. In particular, the administrator of the information processing system 1 can modify the control program PR3 by using the input device 35.

[0060] The processing device 31 functions as a judgment unit 311, an acquisition unit 312, a decision unit 313, a generation unit 314, a provision unit 315, an avatar control unit 316, and a learning unit 317, for example, by reading and executing a control program PR3 from the storage device 32.

[0061] The processing device 31 creates a virtual space VS that integrates a plurality of individual spaces for a first user U. Ｋ The individual spaces correspond one-to-one to the cities. As described above, in each of the cities, an individual server 20 operates a city OS as a platform for providing administrative services.

[0062] The determination unit 311 determines whether the first user U Ｋ When a user visits city J in the virtual space, the first user U Ｋ It is determined whether the first user U has visited city A in the virtual space for the first time. Ｋ When the first user U visits city J in the virtual space for the first time, the processing device 31 performs the following steps to assign the first user U's name to buildings in the virtual space, as will be described later. Ｋ The first user U determines a dedicated visual effect. City J is an example of a visited city. The visited city is a city selected from among a plurality of cities in the virtual space VS by the first user U. Ｋ is a city to visit.

[0063] On the other hand, the first user UＫ If this is not the first time that the first user U visits city J in the virtual space, the processing device 31 Ｋ A dedicated visual effect is provided to the first user U Ｋ The visual effect is determined as the visual effect determined when the first user U visits city J for the first time. Ｋ The visual effect determined when the user first visits City J is stored as visual effect information VEI in the storage device 22 of the individual server 20-J corresponding to City J.

[0064] The acquisition unit 312 acquires the first user U from the terminal device 10-K and the individual servers 20-1 to 20-M. Ｋ The behavior history of the first user U in the virtual space including the individual spaces for each city is acquired. Ｋ utterance of the first user U Ｋ Posting to a social networking service (SNS) and a first user U in the virtual space Ｋ The spatial movement history includes at least one of the spatial movement history.

[0065] The determination unit 313 determines whether the first user U Ｋ From the behavior history of the first user U Ｋ The attribute information may be, for example, the attribute information of the first user U Ｋ This information includes information about the user's age, gender, occupation, hobbies, preferences, etc.

[0066] The first user U Ｋ The behavior history of the first user U in the real space Ｋ utterance of the first user U in the real space Ｋ Posting to SNS, the first user U in the real world Ｋ The recording of the speech content and the recording of information about the spatial movement history may be determined in advance by the first user U according to a rule or the like. Ｋ It is advisable to obtain the consent of the

[0067] The determination unit 313 determines whether the first user U Ｋ Based on the attribute information indicating the attributes of the first user U Ｋdetermines the visual effects for each virtual city you visit.

[0068] More specifically, the determination unit 313 determines the first user U by using, for example, a known value understanding technique. Ｋ The first user U Ｋ The value understanding technology analyzes the emotions of the first user U, which is seamlessly acquired in the real space and the virtual space. Ｋ and analyzes information about the spatial movement history of the first user U. Ｋ This is a technology for understanding emotions (see Non-Patent Document 1).

[0069] First user U Ｋ The analysis of information based on the speech content and the analysis of information related to spatial movement history can be realized by a well-known large-scale language model (LLM).

[0070] Here, the visual effect means at least one of the color, tone, texture, pattern, etc., that is applied to the surface of the building constructed by the three-dimensional CG model.

[0071] The generation unit 314 generates the visual effect determined by the determination unit 313 for the first user U. Ｋ By assigning the same name to multiple buildings belonging to the cities visited by the first user U, Ｋ In other words, the generation unit 314 generates an individual space of the city visited by the first user U. Ｋ By applying the same visual effect to multiple buildings belonging to the cities visited by the first user U, Ｋ The system generates individual spaces in the cities visited by the user. The structures include buildings, houses, commercial facilities, public facilities, hospitals, factories, warehouses, etc.

[0072] The providing unit 315 provides the individual space generated by the generating unit 314 to the first user U. Ｋ The providing unit 315 provides the terminal device 10-K used by the first user U Ｋ the position in the virtual space of the first user U Ｋ Based on information about the direction in which the terminal device 10-K is facing, information about the individual space is provided to the terminal device 10-K.

[0073] The avatar control unit 316 controls the first user U in the virtual space. Ｋ More specifically, the avatar control unit 316 controls the behavior of the avatar of the first user U from the terminal device 10-K. Ｋ The location information of the avatar of the first user U Ｋ The avatar control unit 316 acquires operation information of the input device 15 by the user. The avatar control unit 316 controls the first user U in the virtual space displayed on the display 14 or the display of the XR glasses in accordance with the acquired position information of the avatar and the operation information of the input device 15. Ｋ Controls the behavior of the avatar.

[0074] The learning unit 317 has a teacher data acquisition unit 317a and a model generation unit 317b. The teacher data acquisition unit 317a prepares multiple pieces of teacher data TD1 and stores the prepared multiple pieces of teacher data TD1 in the storage device 32. The multiple pieces of teacher data TD1 are configured by associating input data with output data. The teacher data acquisition unit 317a prepares a learning model LM1 before learning. During machine learning, the teacher data acquisition unit 317a randomly acquires a set of teacher data from the storage device 32 from the multiple pieces of teacher data TD1, for example.

[0075] The model generation unit 317b generates a trained learning model LM1 by having the learning model LM1 learn multiple pieces of teacher data TD1. More specifically, the model generation unit 317b performs machine learning using multiple pieces of teacher data TD1 stored in the storage device 32. That is, by inputting the multiple pieces of teacher data TD1 into the learning model LM1, the model generation unit 317b trains the learning model LM1 to learn correlations between the input data and output data that make up the multiple pieces of teacher data TD1, thereby generating a trained learning model LM1.

[0076] The multiple sets of training data TD1 include multiple sets of data sets. Each set of data sets is composed of a set of input data including an "image of a city" and output data including "clothing worn by a third-party avatar." In supervised learning, the output data is, for example, called a correct answer label. In this way, keywords included in the input data are associated with colors and patterns associated with the keywords as output data.

[0077] 6 is a schematic diagram showing an example of a neural network model 90 applied to the learning model LM1 according to the first embodiment. The neural network model 90 includes an input layer 91, an intermediate layer 92, and an output layer 93.

[0078] The input layer 91 has neurons whose number corresponds to the number of words or character strings as input data, and words or character strings are input to each neuron.

[0079] The intermediate layer 92 is configured by, for example, a convolutional neural network. The intermediate layer 92 transforms the feature quantities extracted from the "city image" input via the input layer 91 using an activation function, and outputs the result as a one-dimensional array of feature vectors.

[0080] The output layer 93 outputs output data including "clothes worn by the third-party avatar" based on the feature vector output from the intermediate layer 92.

[0081] Between each phase of the neural network model 90, synapses are established that connect the neurons between the layers.

[0082] The model generation unit 317b inputs multiple pieces of training data TD1 into the neural network model 90, and causes the neural network model 90 to perform machine learning of the correlation between the input data "image of a town" and the output data "clothing worn by a third-party avatar." More specifically, the model generation unit 317b first selects one set of data from the multiple pieces of training data TD1, and inputs the "image of a town" constituting the one set of data into the input layer 91 of the neural network model 90 as input data.

[0083] The model generation unit 317b uses an evaluation function that compares the output data output from the output layer 93 as an inference result, i.e., "clothes worn by a third-party avatar," with the output data that constitutes the set of data, i.e., the correct label of "clothes worn by a third-party avatar," and adjusts the weights associated with each synapse so that the value of the evaluation function becomes smaller. Adjusting the weights associated with each synapse is called backpropagation.

[0084] For each of the multiple sets of data sets in the multiple sets of training data TD1, the model generation unit 317b sequentially inputs the "city image" constituting the data set as input data to the input layer 91 of the neural network model 90. The model generation unit 317b compares each piece of input data with the output data corresponding to the input data, and iteratively adjusts the weights associated with each synapse so as to reduce the value of the evaluation function.

[0085] When the model generation unit 317b determines that a predetermined learning termination condition is satisfied, it terminates the machine learning and stores the neural network model 90 at that time as a trained learning model LM1 in the storage device 32. The predetermined learning termination condition is, for example, that the number of iterations of the series of learning processes described above reaches a predetermined number, and that the value of the evaluation function becomes smaller than an allowable value.

[0086] 1.1.6. Overview of the Operation of the Processing Device 31 FIG. 7 is a diagram showing an example of a landscape in the virtual space VS to which no visual effects have been applied. For example, FIG. 7 shows a landscape of J City corresponding to individual server 20-J. FIG. 7 shows buildings 101-105 as three-dimensional CG models (CGM). As shown in FIG. 7, when no visual effects have been applied, the surface colors, patterns, etc. of the buildings 101-105 in the virtual space VS differ for each building based on the colors, patterns, etc. in the real space. When no visual effects have been applied, the three-dimensional CG models (CGM) in the virtual space VS are created based on photographic data of the real space, such as satellite photographs or aerial photographs.

[0087] As such, the appearances of the buildings 101 to 105 in the virtual space VS, which are virtual objects in a public space, often lack a sense of unity. If the appearances of the buildings 101 to 105 are not consistent, the cityscape will lack distinctiveness. Therefore, no matter which city a visitor visits, the cityscape will be similar, and the visitor may not have an impressive experience.

[0088] The three-dimensional CG model CGM without the visual effects is stored in the storage device 22 of the individual server 20-J. Note that Fig. 7 is an auxiliary diagram for explaining the first embodiment, and the space shown in Fig. 7 is not provided to any terminal device.

[0089] FIG. 8 shows the first user U Ｋ 8 is a diagram showing an example of a scene in the virtual space VS to which a special visual effect is applied. FIG. 8 shows a scene in the same field of view as FIG. 7. As shown in FIG. 8, the building 101 Ｋ ~105 Ｋ correspond to the buildings 101 to 105 in FIG. Ｋ ~105 Ｋ The building 101 is given a common color and pattern for visual effect. Ｋ ~105 Ｋ The colour and pattern will be uniform.

[0090] First user U Ｋ When a first user U visits city J in the virtual space VS,Ｋ The individual space DS-J is displayed on the display of the terminal device 10-K or on the XR glasses. Ｋ As a result, the first user U can see the scenery with the colors and patterns shown in FIG. Ｋ In this way, the impression of J City is formed by the unified landscape of J City.

[0091] A first user U in city J in the virtual space VS Ｋ Information about the dedicated visual effects is stored in the storage device 22 of the individual server 20-J corresponding to City J in the virtual space VS.

[0092] FIG. 9 shows the second user U Ｌ FIG. 1 is a diagram illustrating an example of a scene in a virtual space VS to which a special visual effect is applied. Ｌ is a user who uses the terminal device 10-L, and the first user U Ｋ 9 shows a scene in the same field of view as in FIGS. 7 and 8. As shown in FIG. 9, the building 101 Ｌ ~105 Ｌ correspond to the buildings 101 to 105 in FIG. Ｌ ~105 Ｌ The building 101 is given a common color and pattern for visual effect. Ｌ ~105 Ｌ The surface color and pattern are uniform.

[0093] Building 101 Ｌ ~105 Ｌ The surface color and pattern of the building 101 in FIG. Ｋ ~105 Ｋ The color and pattern of the surface of the second user U Ｌ When a user visits city J in the virtual space VS, a second user U Ｌ The individual space DS-J is displayed on the display of the terminal device 10-L or on the XR glasses. Ｌ 9. Therefore, the second user U Ｌ In this way, the impression of J City is formed by the unified landscape of J City.

[0094] A second user U in city J in the virtual space VS Ｌ Information about the dedicated visual effects is stored in the storage device 22 of the individual server 20-J corresponding to City J in the virtual space VS.

[0095] In this way, even if the first user U visits the same city in the virtual space VS, Ｋ How the scenery looks to the second user U Ｌ The way the landscape appears to each of us is different.

[0096] For example, the first user U Ｋ When the hobbies of tennis and travel are extracted as the attribute information of the building 101, the determining unit 313 assigns a bright color to the building 101 based on the keywords tennis and travel. Ｋ ~105 Ｋ The second user U Ｌ When reading is extracted as the hobby from the attribute information of the building 101, the determining unit 313 selects a color with a calm impression from the keyword reading. Ｌ ~105 Ｌ The color is determined as follows.

[0097] Another index of the attribute information is the user's impression of each city. Ｋ When the name of a city among multiple cities appears as a keyword in the user's past utterances or posting history, at least one term related to the impression of the city picked up within a predetermined period including the time when the name of the city appeared is extracted.

[0098] For example, if the determination unit 313 extracts the keyword "Kamakura" as a city, the determination unit 313 extracts terms related to the impression of "Kamakura" within a predetermined period including the time when the keyword appears.

[0099] The determination unit 313 determines the image of "Kamakura" by inputting the extracted terms as prompts into a well-known large-scale language model. Known examples of large-scale language models include ChatGPT (https: / / openai.com / chatgpt) and StableLM (https: / / stability.ai / blog / stability-ai-launches-the-first-of-its-stablelm-suite-of-language-models).

[0100] For example, within a predetermined period, a first user U Ｋ When the determining unit 313 extracts terms such as "ocean" and "surfing" from the utterances and posts, the image of "Kamakura is a surfing town" is obtained. In this case, the image of "Kamakura" is, for example, a bright image bathed in plenty of sunlight.

[0101] For example, within a predetermined period, a second user U Ｌ When the determining unit 313 extracts terms such as temples, famous places, historical figures, etc. from the utterances and posts, the image of "Kamakura is a historic town" is obtained. In this case, the image of "Kamakura" is, for example, an image of calm colors.

[0102] Fig. 10 is a diagram showing an example of avatars moving around in the virtual space VS of Fig. 7. In other words, Fig. 10 is a diagram showing an example of a landscape in the virtual space VS to which no visual effects have been applied and an example of an avatar to which no visual effects have been applied.

[0103] In FIG. 10, the first user U Ｋ The user's own avatar is avatar 201, and the avatars of other users, i.e., third parties, are avatars 202, 203, and 204. The appearance of each of the avatars 201 to 204, including their clothing, is set in advance by each user. Therefore, there is often no consistency in the appearance of each avatar. Note that FIG. 10 is an auxiliary diagram for explaining the first embodiment, and the space shown in FIG. 10 is not provided to any terminal device.

[0104] 11 is a diagram showing an example of avatars moving around in the virtual space VS of FIG. 8. In other words, FIG. 11 shows the first user U Ｋ 11 is a diagram illustrating an example of a landscape and an avatar in a virtual space VS to which a special visual effect is applied. Ｋ The dedicated visual effect is Ｋ The appearance of the first user U Ｋ Avatar 202 other than avatar 201 Ｋ ~204 Ｋ That is, the generation unit 314 generates the appearance of the first user U Ｋ Avatar 202 other than avatar 201 Ｋ ~204 Ｋ It gives the same visual effect to

[0105] The determination unit 313 determines whether the first user U Ｋ Based on the attribute information of the first user U Ｋ A third-party avatar 202 travels through the virtual space VS visited by Ｋ ~204 Ｋ For example, the first user U Ｋ If the determining unit 313 obtains the image that "Kamakura is a surfing town" from the utterances, posts, etc. of the third party, the image of "Kamakura" will be, for example, a bright image bathed in plenty of sunlight. Ｋ ~204 Ｋ The clothing to be worn by the team was decided to be a T-shirt with a yacht design that evokes the sea.

[0106] The correlation between the "image of the city" and the "clothing worn by the third-party avatar" is machine-learned in advance by the learning unit 317 using a large amount of data.

[0107] The generation unit 314 generates the appearance of the third-party avatar determined by the determination unit 313 for the first user U. Ｋ A third-party avatar 202 belonging to a city visited by Ｋ ~204 Ｋ , the first user U ＫIndividual spaces in J city visited by DS-J Ｋ Generate.

[0108] The providing unit 315 provides the individual space DS-J generated by the generating unit 314. Ｋ the first user U Ｋ Therefore, the first user U Ｋ The first user U Ｋ The appearance of the avatar 201 of the first user U Ｋ The user is recognized as having a preset appearance, and the third-party avatar 202 Ｋ ~204 Ｋ is recognized as wearing a T-shirt with a yacht design. Ｋ A unified third-party avatar 202 Ｋ ~204 Ｋ People's impressions of J City are formed based on its appearance.

[0109] Avatar 202 when the visual effect of FIG. 11 is applied Ｋ ~204 Ｋ The data relating to the appearance of is stored in the storage device 22 of the individual server 20-J corresponding to J city.

[0110] 12 is a diagram showing an example of avatars moving around in the virtual space VS of FIG. 9. In other words, FIG. 12 shows the second user U Ｌ 12 is a diagram illustrating an example of a landscape and an avatar in a virtual space VS to which a special visual effect is applied. Ｌ The dedicated visual effect is Ｌ The appearance of the avatar 202 of the first user U Ｌ Avatar 201 other than avatar 202 Ｌ , 203 Ｌ , and 204 Ｌ That is, the generation unit 314 applies the appearance of the second user U Ｌ Avatar 201 other than avatar 202 Ｌ , 203 Ｌ , and 204 Ｌ It gives the same visual effect to

[0111] The determination unit 313 determines whether the second user U Ｌ Based on the attribute information of the second user U Ｌ A third-party avatar 201 travels between the virtual space VS visited by the user and the city on the Ｌ , 203 Ｌ , and 204 Ｌ For example, the second user U Ｌ If the determining unit 313 obtains the image that "Kanda is a town for reading" from the utterances, posts, etc. of the third party, the image of "Kanda" will be a calm and quiet image. Ｌ , 203 Ｌ , and 204 Ｌ He decides to wear a plain monochrome shirt.

[0112] The correlation between the "image of the city" and the "clothing worn by the third-party avatar" is machine-learned in advance by the learning unit 317 using a large amount of data.

[0113] The generation unit 314 generates the appearance of the third-party avatar determined by the determination unit 313 for the second user U. Ｌ By applying this to a third-party avatar belonging to a city visited by the second user U, Ｌ Individual spaces in the city visited by DS-J Ｌ In other words, the second user U Ｌ Individual spaces in the city visited by DS-J Ｌ The appearance of the third-party avatar determined by the determination unit 313 is displayed to the second user U. Ｌ The generation unit 314 generates the city map by applying the city map to a third party avatar belonging to the city to be visited.

[0114] The providing unit 315 provides the individual space DS-J generated by the generating unit 314. Ｌ to the second user U Ｌ Therefore, the second user U Ｌ The second user U Ｌ The appearance of the avatar 202 of the second user U Ｌ The user is recognized as having a preset appearance, and the third-party avatar 201Ｌ , 203 Ｌ , and 204 Ｌ is recognized as wearing a plain monotone shirt. Ｌ There is a unified third-party avatar 201 Ｌ , 203 Ｌ , and 204 Ｌ People's impressions of J City are formed based on its appearance.

[0115] Avatar 201 when the visual effect of FIG. 12 is applied Ｌ , 203 Ｌ , and 204 Ｌ The data relating to the appearance of is stored in the storage device 22 of the individual server 20-J corresponding to J city.

[0116] FIG. 13 shows the individual space DS-J Ｋ 1 is a diagram showing an example of a reception counter 61 of a government office 60 in a city. Ｋ is the individual space DS-J Ｋ By visiting the government office 60 in the individual space DS-J Ｋ You can receive administrative services from City J that correspond to your needs.

[0117] As shown in FIG. 13, a first user U Ｋ The first user U refers to a list of procedures 62 at a reception counter 61 of a government office 60 and selects a desired procedure from the list 62. If the desired procedure is to obtain a birth certificate, the first user U Ｋ selects "Birth Certificate" from the list 62.

[0118] First user U Ｋ a user ID for accessing the virtual space VS of the first user U Ｋ The administrative personal number of the first user U is linked to the administrative personal number of the first user U. Ｋ User ID of the first user U Ｋ The relationship between the above and the administrative personal number is stored as an ID database IDB in the storage device 32 of the management server 30.

[0119] That is, the avatar control unit 316 controls the first user U ＫBy the operation of the first user U in the government office 60 in the virtual space VS, Ｋ The avatar control unit 316 then causes the avatar 201 of the first user U to perform a procedure using the user ID for accessing the virtual space VS. Ｋ We will provide services equivalent to the administrative services of City J in the real world.

[0120] 1.2. Operation of the Virtual Space Management Device According to the First Embodiment 1.2.1. First Operation of the Processing Device 31 Fig. 14 is a flowchart showing the first operation of the processing device 31 of Fig. 5. The first operation of the processing device 31 will be described below with reference to Fig. 14. The routine of Fig. 14 is started, for example, when the processing device 31 is started, and is executed every time a certain period of time has elapsed.

[0121] In step S11, the processing device 31 functions as the determination unit 311 to determine whether the first user U Ｋ Determine whether the first user U has visited city J in the virtual space VS for the first time. Ｋ Whether or not the first user U has visited City J in the virtual space VS for the first time can be determined by, for example, storing the first user U's name in the storage device 22 of the individual server 20-J corresponding to City J. Ｋ The determination is made based on whether or not a visual effect corresponding to the

[0122] That is, the first user U is stored in the storage device 22 of the individual server 20-J. Ｋ If no visual effect corresponding to Ｋ It is determined that the first user U has visited city J for the first time. Ｋ If the visual effect corresponding to Ｋ is determined to have already visited city J.

[0123] In step S11, the first user U ＫWhen it is determined that the first user U has visited city J for the first time, that is, when the determination result in step S11 is positive, the processing device 31 functions as the acquisition unit 312, and in step S12, acquires information about the first user U from the individual servers 20-1 to 20-M and the terminal device 10-K. Ｋ Obtain the behavioral history of the user.

[0124] Next, in step S13, the processing device 31 functions as the determination unit 313 to determine the first user U from the acquired behavior history, etc. Ｋ Extract attribute information.

[0125] Next, in step S14, the processing device 31 functions as the determination unit 313 to determine the first user U Ｋ Based on the attribute information, the colors and patterns of the buildings belonging to city J, i.e., the visual effects, are determined.

[0126] Next, in step S15, the processing device 31 functions as the determination unit 313 to determine the first user U Ｋ Based on the attribute information, the appearance of the third person's avatar in City J, i.e., the visual effect, is determined.

[0127] Next, in step S16, the processing device 31 functions as the determination unit 313 to determine the first user U in city J in the determined virtual space VS. Ｋ The visual effect corresponding to the J city is stored in the storage device 22 of the individual server 20-J corresponding to the J city.

[0128] Next, in step S17, the processing device 31 functions as the generation unit 314 to generate the individual space DS-J by applying the determined visual effect to a plurality of buildings belonging to city J and the avatars of third parties. Ｋ Generate.

[0129] Next, in step S18, the processing device 31 functions as the providing unit 315 to provide the generated individual space DS-J Ｋ to the first user U Ｋ The terminal device 10-K then provides the information to the terminal device 10-K, and the routine is temporarily terminated.

[0130] In step S11, the first user U Ｋ If it is determined that this is not the first time that the user has visited City J, that is, if the determination result in step S11 is negative, the processing device 31 functions as the generation unit 314, and in step S17, generates the individual space DS-J by applying the visual effects stored in the storage device 22 of the individual server 20-J to the plurality of buildings belonging to City J and the avatars of third parties. Ｋ Generate.

[0131] In the above routine, the first user U Ｋ The example shows a case where a user visits city J in the virtual space VS, but the processing device 31 executes the same processing as the above routine when any user visits any city.

[0132] 1.2.2 Second Operation of Processing Device 31 Fig. 15 is a flowchart showing the second operation of the processing device 31 of Fig. 5. The second operation of the processing device 31 will be described below with reference to Fig. 15. The routine of Fig. 15 is started, for example, when the processing device 31 is started, and is executed every time a certain period of time has elapsed.

[0133] In step S21, the processing device 31 functions as the avatar control unit 316 to acquire avatar operation information and avatar position information.

[0134] Next, in step S22, the processing device 31 functions as the avatar control unit 316 to determine whether the avatar 201 has arrived at the reception counter 61 of the government office 60.

[0135] In step S22, if the avatar control unit 316 determines that the avatar 201 has not arrived at the reception counter 61 of the government office 60, that is, if the determination result in step S22 is negative, the processing device 31 temporarily terminates this routine.

[0136] On the other hand, in step S22, if the avatar control unit 316 determines that the avatar 201 has arrived at the reception counter 61 of the government office 60, that is, if the judgment result in step S22 is positive, the processing device 31 functions as the avatar control unit 316 and displays a list of procedures 62 in step S23.

[0137] Next, in step S24, the processing device 31 functions as the avatar control unit 316 to obtain avatar operation information.

[0138] Next, in step S25, the processing device 31 functions as the avatar control unit 316 to determine whether or not any of the procedures in the displayed list 62 has been selected by the avatar 201.

[0139] In step S25, if the avatar control unit 316 determines that none of the procedures in the displayed list of procedures 62 has been selected by the avatar 201, that is, if the determination result in step S25 is negative, the processing device 31 functions as the avatar control unit 316 and re-acquires the avatar operation information in step S24.

[0140] On the other hand, if the avatar control unit 316 determines in step S25 that one of the procedures in the displayed list of procedures 62 has been selected by the avatar 201, that is, if the determination result in step S25 is positive, the processing device 31 functions as the avatar control unit 316, and proceeds with processing in accordance with the selected procedure in step S26, and then temporarily terminates this routine.

[0141] In the above routine, the first user U Ｋ The example shows a case where a user visits city J in the virtual space VS, but the processing device 31 executes the same processing as the above routine when any user visits any city.

[0142] 1.2.3. Third Operation of Processing Device 31 FIG. 16 is a flowchart showing the third operation of the processing device 31 of FIG. 5. Hereinafter, the third operation of the processing device 31 will be described with reference to FIG. 16. The third operation is an operation related to the machine learning method performed by the learning unit 317. The routine of FIG. 15 is started, for example, when the processing device 31 is started, and is executed every time a certain time period has elapsed.

[0143] In step S31, the processing device 31 functions as the teacher data acquisition unit 317a to prepare a plurality of pieces of teacher data TD1 as advance preparations for starting machine learning, and stores the prepared plurality of pieces of teacher data TD1 in the storage device 32. The number of pieces of teacher data to be prepared here may be set in consideration of the inference accuracy required for the learning model LM1 to be finally obtained.

[0144] Next, in step S32, the processing device 31 functions as the teacher data acquisition unit 317a to prepare a pre-learning learning model LM1 in order to start machine learning. The pre-learning learning model LM1 prepared here employs the neural network model 90 shown in FIG. 6, and the weights of each synapse are set to an initial value. Each neuron in the input layer 91 is associated with an "image of a city" as input data constituting the plurality of teacher data TD1. Each neuron in the output layer 93 is associated with "clothes worn by a third-party avatar" as output data constituting the plurality of teacher data TD1.

[0145] Next, in step S33, the processing device 31 functions as the teacher data acquisition unit 317a to acquire, for example, a set of data randomly from the plurality of teacher data TD1 stored in the storage device 32.

[0146] Next, in step S34, the processing device 31 functions as the model generation unit 317b, inputting the input data included in the set of data sets to the input layer 91 of the prepared learning model LM1 before or during learning. As a result, output data is output as an inference result from the output layer 93 of the learning model LM1. However, this output data has been generated by the learning model LM1 before or during learning. Therefore, in the pre-learning or learning state, the data output as the inference result indicates information different from the output data included in the set of data sets, i.e., the correct label.

[0147] Next, in step S35, the processing device 31 functions as the model generation unit 317b, and performs machine learning by comparing the output data included in the set of data acquired in step S33, i.e., the correct label, with the output data output as an inference result from the output layer 93 in step S34, and adjusting the weight of each synapse. In this way, the model generation unit 317b causes the learning model LM1 to learn the correlation between the input data and the output data.

[0148] Next, in step S36, the processing device 31 functions as the model generation unit 317b, and determines whether a predetermined learning termination condition has been satisfied based on the inference result and the value of an evaluation function based on the output data included in one set of data, i.e., the correct label. Note that the model generation unit 317b may determine whether the predetermined learning termination condition has been satisfied based on the inference result and the remaining number of unlearned data sets stored in the storage device 32.

[0149] In step S36, if the model generation unit 317b determines that the learning termination condition is not satisfied and that machine learning should be continued, i.e., if the judgment result in step S36 is negative, the processing device 31 functions as the model generation unit 317b and performs the processes from step S33 to step S35 multiple times on the learning model LM1 under learning using an unlearned dataset.

[0150] On the other hand, if the model generation unit 317b determines in step S36 that the learning termination condition has been satisfied, i.e., if the determination result in step S36 is positive, the processing device 31 functions as the model generation unit 317b, and adjusts the weights associated with each synapse in step S37, thereby storing the machine-learned learning model LM1, i.e., the adjusted weight parameter group, in the storage device 32, and temporarily terminates this routine.

[0151] 15, the case where online learning is used as a method for adjusting weights has been described, but batch learning, mini-batch learning, etc. may also be used. Furthermore, whether a predetermined learning termination condition has been met may be determined based on the error rate.

[0152] 1.3. Effects of the First Embodiment According to the above description, the processing device 31 as a virtual space management device according to the first embodiment includes a determination unit 313, a generation unit 314, and a provision unit 315. The determination unit 313 determines whether the first user U Ｋ Based on the attribute information indicating the attributes of the first user U, among the multiple cities in the virtual space VS, Ｋ The generating unit 314 generates an individual space of the visited city by commonly applying the visual effect determined by the determining unit 313 to a plurality of buildings belonging to the visited city. The providing unit 315 provides the individual space generated by the generating unit 314 to the first user U. Ｋ The terminal device 10-K is used by the user.

[0153] According to this aspect, for each visited city, the first user U Ｋ The visual effects are set in common based on the attribute information of the first user U. Therefore, a unified cityscape is formed. Ｋ A virtual space VS that reflects the unique worldview of the first user U is generated. Ｋ This provides a memorable or attractive visitor experience for the

[0154] Furthermore, the determination unit 313 determines whether the first user U Ｋ determines a visual effect when the first user U visits the visiting city in the virtual space VS for the first time, Ｋ If the user revisits a visited city, the visual effect is maintained.

[0155] According to this aspect, the color and design of the virtual objects in the virtual space VS that were set at the time of the first visit for each city are maintained. Ｋ Even if a visitor returns to a city, their previous worldview is maintained.

[0156] Furthermore, the determination unit 313 determines the first user U based on the attribute information. Ｋ The generation unit 314 determines the appearance of the avatar of the third person who travels to and from the visited city in the virtual space VS that the first user U visits. Ｋ By applying this to the third-party avatars 202, 203, and 204 belonging to the cities visited by the first user U, Ｋ Individual spaces in the cities visited by DS-J Ｋ The providing unit 315 generates the individual space DS-J generated by the generating unit 314. Ｋ the first user U Ｋ The terminal device 10-K is used by the user.

[0157] According to this aspect, the first user U Ｋ No matter what clothes the third party avatar is wearing, the first user U Ｋ Since the appearance changed based on the attribute information of the first user U is visible, Ｋ The world view of the game is expressed more impressively.

[0158] Furthermore, the determination unit 313 determines whether the first user U Ｋ When the first user U visits a city in the virtual space VS for the first time, the first user U determines the appearance of the avatar of the third person. Ｋ If the player revisits a visited city, he or she will maintain the appearance of a third-party avatar.

[0159] According to this aspect, the first user U ＫWhen the first user U revisits a visited city, the appearance of the third-party avatar is maintained. Ｋ Even if a visitor returns to a city, their previous worldview is maintained.

[0160] Furthermore, the determination unit 313 determines whether the first user U Ｋ When the name of a city among multiple cities appears as a keyword in the user's past utterances or posting history, at least one term related to the impression of the city picked up within a predetermined period including the time when the name of the city appeared is extracted.

[0161] According to this aspect, a first user U Ｋ The impression is extracted more accurately.

[0162] The processing device 31 also includes an avatar control unit 316. The avatar control unit 316 controls the first user U in the government office 60 in the virtual space VS. Ｋ The first user U Ｋ We provide services equivalent to administrative services in the real world.

[0163] According to this aspect, the first user U can receive administrative services without visiting a government office in the real world. Ｋ This will improve convenience.

[0164] 2. Modifications The present disclosure is not limited to the above-described exemplary embodiments. Specific modifications are exemplified below. Two or more modifications selected from the following examples may be combined. Furthermore, the above-described embodiments and the following modifications may be combined in any manner as long as they are not mutually contradictory.

[0165] 2.1 Variation 1 In the first embodiment, the visual effect information VEI is applied to the colors and patterns of multiple buildings belonging to City J in the virtual space VS and the visuals of third-party avatars traveling through City J in the virtual space VS. However, the visual effect information VEI may also include items related to the user's "image of the city."

[0166] 17 is a diagram showing an example of a scene in the virtual space VS to which the items included in the visual effect information VEI are applied. Ｋ The figure shows a scene when a first user U visits city J in the virtual space VS. Ｋ Since the user has an image of J city as a surfing town, the determining unit 313 selects a surfboard 301 as a visual effect. Ｋ , 302 Ｋ will be placed on street corners.

[0167] For example, if a city evokes an image of "reading" for the user, bronze statues of literary masters will be placed on street corners, and if a city evokes an image of "festivals" for the user, paper lanterns will be placed on street corners.

[0168] 2.2. Modification 2 In the first embodiment, the three-dimensional CG models CGM of the multiple buildings belonging to each city are stored in the storage devices 22 of the individual servers 20-1 to 20-M corresponding to each city, respectively, but they may also be collectively stored in the storage device 32 of the management server 30.

[0169] In the first embodiment, information relating to the visual effects specific to each user in the virtual space VS of each city is stored as visual effect information VEI in the storage devices 22 of the individual servers 20-1 to 20-M corresponding to each city. However, the visual effect information VEI stored in each storage device 22 may be collectively stored in the storage device 32 of the management server 30.

[0170] 2.3. Modification 3 In the first embodiment, the management server 30 is provided as a separate entity from the individual servers 20-1 to 20-M, but the functions of the management server 30 may be distributed among the individual servers 20-1 to 20-M.

[0171] 2.4. Modification 4 In the first embodiment, the determination unit 313 determines the color and pattern of a building using the large-scale language model LLM. However, a learning model that learns the correlation between the "image of the city" and the "color and pattern of a building" through supervised learning may also be used.

[0172] 2.5. Modification 5 In the first embodiment, the determination unit 313 determines the clothing to be worn by the third-party avatar using a learning model LM1 that has learned the correlation between "city images" and "clothing worn by the third-party avatar" through supervised learning. However, to determine the clothing to be worn by the third-party avatar, a learning model trained through unsupervised learning using a large amount of data including "city images" and "clothing worn by the third-party avatar" may also be used.

[0173] The determination unit 313 may also determine the clothing to be worn by the third-party avatar using a well-known large-scale language model. For example, the determination unit 313 may determine the clothing to be worn by the third-party avatar by inputting, into the large-scale language model, a prompt related to the extracted "city image" of City J and a prompt to output characteristics of clothing that match the "city image" of City J.

[0174] 3. Others (1) In the above-described embodiment, storage device 12, storage device 22, and storage device 32 are exemplified by ROM and RAM, but they may also be flexible disks, magneto-optical disks (e.g., compact disks, digital versatile disks, Blu-ray (registered trademark) disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy (registered trademark) disks, magnetic strips, databases, servers, or other suitable storage media. Furthermore, the programs may be transmitted from a network via telecommunications lines. Furthermore, the programs may be transmitted from a communications network (NET) via telecommunications lines.

[0175] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0176] (3) In the above-described embodiment, input and output information may be stored in a specific location (for example, a memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.

[0177] (4) In the above-described embodiment, the determination may be made based on a value (0 or 1) represented using one bit, a Boolean value (true or false), or a comparison of numerical values ​​(e.g., comparison with a predetermined value).

[0178] (5) The order of the exemplary procedures, sequences, flowcharts, etc. illustrated in the above-described embodiments may be rearranged unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0179] (6) Each function illustrated in Figures 1 to 17 is realized by any combination of hardware and / or software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (e.g., wired, wireless, etc.) and these multiple devices. A functional block may be realized by combining software with the single device or the multiple devices.

[0180] (7) The programs exemplified in the above-described embodiments should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, hardware description language, or by other names.

[0181] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0182] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.

[0183] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or corresponding other information.

[0184] (10) In the above-described embodiments, the terminal device 10 may be a mobile station (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate term. In this disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

[0185] (11) In the above-described embodiments, the terms "connected," "coupled," or any variations thereof refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0186] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0187] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching a table, database, or other data structure), and ascertaining something that is considered to be a "determining." Also, "determining" and "determining" may include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and so on. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0188] (14) In the above embodiments, when the terms "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or," as used in this disclosure, is not intended to be an exclusive or.

[0189] (15) In this disclosure, where articles are added by translation, such as a, an, and the in English, this disclosure may include the nouns following these articles being plural.

[0190] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0191] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0192] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0193] 1...information processing system, 10, 10-1, 10-2, 10-K, 10-L, 10-N...terminal device, 30...management server, 101 to 105, 101 Ｋ ~105 Ｋ , 101 Ｌ ~105 Ｌ ...Buildings, 201, 201 Ｌ , 202, 202 Ｋ , 203, 203 Ｋ , 203 Ｌ , 204, 204 Ｋ , 204 Ｌ ...Avatar, 313...Determination unit, 314...Generation unit, 315...Provision unit, 316...Avatar control unit, DS-J Ｋ , D.S.-J. Ｌ ...individual space, LLM...large-scale language model, U Ｋ ...first user, U Ｌ ...Second user, VS...Virtual space

Claims

1. A virtual space management device that provides a user with a virtual space that integrates multiple individual spaces that correspond one-to-one to multiple cities, comprising: a determination unit that determines visual effects for a city visited by the user from among the multiple cities in the virtual space based on attribute information that indicates the attributes of the user; a generation unit that generates an individual space for the visited city by commonly applying the visual effects determined by the determination unit to multiple buildings that belong to the visited city; and a provision unit that provides the individual space generated by the generation unit to a terminal device used by the user.

2. The virtual space management device according to claim 1, wherein the determination unit determines the visual effect when the user visits the visited city for the first time, and maintains the visual effect when the user visits the visited city again.

3. The virtual space management device described in claim 1, wherein the determination unit determines the appearance of a third-party avatar traveling through the visited city based on the attribute information, and the individual space of the visited city is generated by the generation unit by applying the appearance of the third-party avatar determined by the determination unit to the third-party avatar belonging to the visited city.

4. The virtual space management device according to claim 3, wherein the determination unit determines the appearance when the user visits the visited city for the first time, and maintains the appearance when the user visits the visited city again.

5. The virtual space management device of claim 1, wherein the determination unit extracts at least one term related to the impression of the city that was picked up within a specified period including the time when the name of a city among the plurality of cities appeared as a keyword in the user's past utterances or posting history.

6. A virtual space management device as described in claim 1, comprising an avatar control unit which provides the user with services equivalent to administrative services in the real space by having the user's avatar complete procedures at a government office in the virtual space using a user ID for accessing the virtual space.

Images