Computer program and terminal device

The computer program enhances the user interface for virtual spaces by integrating control units to manage service-related applications within the virtual space, addressing operability challenges and improving overall interaction.

JP2025060115AActive Publication Date: 2025-04-10HIKKY CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023170643
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-09-29
Publication Date
2025-04-10
Estimated Expiration
2043-09-29

AI Technical Summary

Technical Problem

Operation in metaverse spaces can be challenging due to user interface issues, affecting operability, and this problem is common to all virtual spaces.

Method used

A computer program that functions as a terminal device, incorporating an input unit, a control unit, and an output unit, which controls applications related to services different from the virtual space in response to user operations within the virtual space, and displays relevant images for both the virtual space and the service.

Benefits of technology

The solution improves the user interface for operating virtual spaces by enabling seamless interactions between virtual space operations and service-related applications, enhancing overall operability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025060115000001_ABST
    Figure 2025060115000001_ABST
Patent Text Reader

Abstract

To allow an improvement of a user interface in terms of operations in a virtual space.SOLUTION: A computer program is to cause a computer to function as a terminal device comprising: an input unit that receives user's operations; a control unit that controls an application related to a service different from the virtual space in response to the operation in a virtual space among the user's operations received by the input unit; and an output unit that displays an image related to the virtual space and an image related to the service.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a computer program and a terminal device. [Background technology]

[0002] In recent years, the utilization of the metaverse space, which is a virtual space where multiple users interact by operating avatars, has been attracting attention. For example, a technology for displaying advertisements in the metaverse space has been proposed (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-146228 Summary of the Invention [Problem to be solved by the invention]

[0004] However, operation in the metaverse space is not necessarily easy for everyone, and improvements in the user interface, such as operability, are desired. The metaverse space is one aspect of virtual space, and such issues are not limited to the metaverse space but are common to all virtual spaces. The present invention has been made in view of the above circumstances, and provides a technique that enables an improvement in the user interface when operating in a virtual space. [Means for solving the problem]

[0005] One aspect of the present invention is a computer program for causing a computer to function as a terminal device that includes an input unit that accepts user operations, a control unit that controls an application related to a service different from the virtual space in accordance with operations in a virtual space among the user operations on the input unit, and an output unit that displays images related to the virtual space and images related to the service.

[0006] One aspect of the present invention is the above-mentioned computer program, wherein the control unit displays information about the object as an image related to the service in response to an operation in the virtual space, the operation being performed on an object placed in the virtual space.

[0007] One aspect of the present invention is the computer program described above, wherein the control unit displays an image related to the service in response to an operation on an avatar placed in the virtual space, among operations in the virtual space.

[0008] One aspect of the present invention is the computer program described above, wherein the control unit displays, as an image related to the service, an image of an object in the virtual space that is determined to have collided with a collider set for that object, the collider set for the avatar.

[0009] One aspect of the present invention is a terminal device comprising an input unit that accepts user operations, a control unit that controls an application related to a service different from the virtual space in accordance with operations in a virtual space among the user operations on the input unit, and an output unit that displays images related to the virtual space and images related to the service. [Effects of the Invention]

[0010] The present invention makes it possible to improve the user interface for operating the metaverse space. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a schematic block diagram showing the system configuration of a virtual space providing system 100 according to the present invention. [Figure 2] 2 is a schematic block diagram showing a specific example of the functional configuration of the terminal device 10. FIG. [Figure 3]10 is a diagram showing a specific example of a screen displayed on the output unit 13 of the terminal device 10. FIG. [Figure 4] 10 is a diagram showing another specific example of a screen displayed on the output unit 13 of the terminal device 10. FIG. [Figure 5] 10 is a diagram showing a specific example of a screen displayed on the output unit 13 of the terminal device 10. FIG. [Figure 6] 10 is a diagram showing a specific example of a screen displayed on the output unit 13 of the terminal device 10. FIG. [Figure 7] 10 is a diagram showing another specific example of a screen displayed on the output unit 13 of the terminal device 10. FIG. [Figure 8] FIG. 2 is a diagram illustrating an outline of an example of the hardware configuration of an information processing device 90 applied to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] FIG. 1 is a schematic block diagram showing the system configuration of a virtual space providing system 100 of the present invention. The virtual space providing system 100 includes a terminal device 10, a virtual space providing device 20, and a service providing device 30. The service providing device 30 is a device that provides a service other than the provision of a virtual space to a user. The terminal device 10, the virtual space providing device 20, and the service providing device 30 are communicably connected via a network 70. The network 70 may be a network using wireless communication or a network using wired communication. The network 70 may be configured using, for example, the Internet or a local area network (LAN). The network 70 may also be configured by combining multiple networks.

[0013] 2 is a schematic block diagram showing a specific example of the functional configuration of the terminal device 10. The terminal device 10 is configured using information equipment such as a smartphone, tablet, personal computer, dedicated device, etc. The terminal device 10 includes a communication unit 11, an input unit 12, an output unit 13, a storage unit 14, and a control unit 15.

[0014] The communication unit 11 is a communication device. The communication unit 11 may be configured as, for example, a network interface. The communication unit 11 communicates data with other devices via the network 70 in accordance with the control of the control unit 15. The communication unit 11 may be a device that performs wireless communication or a device that performs wired communication.

[0015] The input unit 12 is configured using existing input devices such as a keyboard, a pointing device (mouse, tablet, etc.), buttons, a touch panel, etc. The input unit 12 is operated by a user when inputting user instructions to the terminal device 10. The input unit 12 may be an interface for connecting the input device to the terminal device 10. In this case, the input unit 12 inputs an input signal generated in the input device in response to a user input to the terminal device 10. The input unit 12 may be configured using a microphone and a voice recognition device. In this case, the input unit 12 acquires an acoustic signal generated by the user's speech, performs voice recognition on the words spoken by the user, and inputs character string information of the recognition result to the terminal device 10. The voice recognition process may be performed by the control unit 15. The input unit 12 may be configured in any way as long as it is configured to be able to input user instructions to the terminal device 10.

[0016] The output unit 13 outputs at least an image in a form that can be recognized by the user. The output unit 13 may be, for example, an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The output unit 13 may be an interface for connecting an image display device to the terminal device 10. In this case, the output unit 13 generates a video signal for displaying image data and outputs the video signal to the image display device connected to the output unit 13. The output unit 13 may further include a device for outputting sound, such as a speaker. The output unit 13 may further include an interface for connecting an audio output device, such as a speaker or headphones, to the terminal device 10. In this case, the output unit 13 generates an audio signal for reproducing audio data and outputs the audio signal to the audio output device connected to the output unit 13. The output unit 13 may be configured as a touch panel integrated with the input unit 12.

[0017] The storage unit 14 is configured using a storage device such as a magnetic hard disk drive or a semiconductor storage device. The storage unit 14 stores data used by the control unit 15. The storage unit 14 stores data required when the control unit 15 performs processing.

[0018] The control unit 15 is configured using a processor such as a CPU (Central Processing Unit) and a memory (main storage device). The control unit 15 functions as a service application control unit 151 and a virtual space control unit 152 by the processor executing a program. Note that all or part of the functions of the control unit 15 may be realized using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above program may be recorded on a computer-readable recording medium. Examples of computer-readable recording media include portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, and a semiconductor storage device (e.g., a solid-state drive (SSD)), and storage devices such as a hard disk or semiconductor storage device built into a computer system. The above program may be transmitted via a telecommunications line.

[0019] The control unit 15 may execute, for example, an application installed on its own device (terminal device 10). A specific example of such an application is an application provided to the terminal device 10 as a dedicated application for the virtual space providing system 100. For example, the virtual space control unit 152 may be realized by executing such an application. Another specific example of an application installed on the terminal device 10 is an application used when receiving a service from the service providing device 30. Specific examples of such an application include a web browser application and a dedicated application provided by the service providing device 30. Hereinafter, such an application used when receiving a service from the service providing device 30 will be referred to as a "service app." For example, the service app control unit 151 may be realized by executing such a web browser application. In the following explanation, an example will be explained in which the service app control unit 151 is realized by executing a web browser application.

[0020] These applications may be pre-installed on the terminal device 10, or may be downloaded each time a virtual space is connected. For example, if implemented as an application that runs on a web browser, the terminal device 10 may download and execute the application from a device (for example, the web server itself or another server) designated by the web server in response to the terminal device 10 connecting to the web server. The control unit 15 operates according to the program of the application being executed.

[0021] The service application control unit 151 operates in accordance with a web browser application installed in the terminal device 10. For example, the service application control unit 151 transmits data to a web server (e.g., the service providing device 30) using a predetermined protocol in response to a user's operation on the input unit 12. For example, when the service application control unit 151 receives data from the web server (e.g., the service providing device 30), it generates a screen in response to the received data and displays it on the output unit 13. The service application control unit 151 may output information indicating the user's operation on the browser to the virtual space control unit 152.

[0022] The virtual space control unit 152 operates in accordance with an application of the virtual space providing system 100 running on the terminal device 10. For example, the virtual space control unit 152 generates operation information within the virtual space in response to a user's operation on the input unit 12, generates a screen showing the virtual space in response to the operation information, and displays it on the output unit 13. Such operations include an avatar movement instruction, an avatar operation instruction, a display range change instruction, an object selection instruction, and an avatar selection instruction. An avatar movement instruction is an instruction for moving an avatar in the metaverse space. An avatar operation instruction is an instruction for causing an avatar to perform a predetermined action. A display range change instruction is an instruction for changing the position or size of the display range of the metaverse space displayed on the terminal device 10. An object selection instruction is an instruction for selecting an object (object) located in the metaverse space. Specific examples of objects include items that can be held by an avatar, objects representing products that the user can purchase, and decorations, devices, and facilities within the metaverse space. An avatar selection instruction is an instruction for selecting another avatar present in the metaverse space. Other examples of avatars include avatars controlled by other users, and avatars that are not controlled by a user but are controlled by a computer (so-called NPCs).

[0023] An avatar movement instruction may also serve as an avatar action instruction, and an avatar movement instruction may also serve as a display range change instruction. For example, an avatar movement instruction to move the avatar forward may also serve as an avatar action instruction to make the avatar walk forward, and may also serve as a display range change instruction to move the display range in the avatar's moving direction. Furthermore, for example, an avatar action instruction to make the avatar turn right may also serve as a display range change instruction to rotate the display range to the right. Avatar movement instructions and avatar action instructions are collectively referred to as avatar operation instructions.

[0024] The virtual space control unit 152 may determine whether a user's avatar has touched an object in the virtual space. For example, the virtual space control unit 152 determines that a user's avatar has touched an object when the user's avatar is located within a predetermined range of the object. The virtual space control unit 152 may use colliders set for the object and avatar to make this determination. A collider is a range for determining whether a collision with an avatar or an object occurs. For example, it is possible to determine whether an avatar has collided (come into contact) with an object when the collider of the avatar has collided with a collider set for the object. It is also possible to determine whether two objects have collided with each other when their colliders collide. Colliders may also be used in determining the object selection instruction described above. For example, it is possible to determine that an object has been selected when it is determined that a pointer used for a selection instruction has collided with a collider set for the object.

[0025] The virtual space control unit 152 may determine whether a user's avatar has touched another avatar in the virtual space. For example, the virtual space control unit 152 may determine that a user's avatar has touched another avatar when the user's avatar is located within a predetermined range of the other avatar. The virtual space control unit 152 may use a collider set for each avatar to make this determination. For example, a collision between two avatars can be determined based on whether the colliders of the two avatars have collided with each other.

[0026] The virtual space control unit 152 may transmit operation information to the virtual space providing device 20. In this case, some or all of the processes performed by the virtual space control unit 152 described above may be executed by the virtual space providing device 20. Furthermore, upon receiving data from the virtual space providing device 20, the virtual space control unit 152 generates a screen showing the inside of the virtual space in accordance with the received data and displays the screen on the output unit 13. The virtual space control unit 152 may generate user operation information for the service application control unit 151 based on the user's operation in the virtual space, and output the generated operation information to the service application control unit 151.

[0027] The virtual space providing device 20 is configured using an information processing device such as a personal computer or a server device. The virtual space providing device 20 generates image information of the virtual space and transmits it to the terminal device 10. The virtual space provided by the virtual space providing device 20 may include, for example, avatars that can be operated by the users of the terminal devices 10. An example of a virtual space in which avatars are placed is the metaverse space.

[0028] The image information provided to each terminal device 10 by the virtual space providing device 20 may be data of the image itself, or may be information required to generate the image. Information required to generate the image includes, for example, data indicating objects, textures, or other avatars located around each user's avatar. When the virtual space providing device 20 transmits data of the image itself as image information, each user's terminal device 10 may directly display the received image information as part or all of the screen of the output unit 13. When the virtual space providing device 20 transmits information required to generate an image as image information, each user's terminal device 10 may generate an image showing the field of view of each user's avatar based on the received image information and display it as part or all of the screen of the output unit 13.

[0029] The service providing device 30 is configured using an information processing device such as a personal computer or a server device. It provides a predetermined service to the user of the terminal device 10 by communicating data with a web browser installed on the terminal device 10. The service providing device 30 may be, for example, a product sales system that sells products that physically exist in the real world to users. When the service providing device 30 is a product sales system, the service providing device 30 may confirm a purchase process by a user in response to a user operation on a user interface displayed on the browser of the terminal device 10, and may execute processes related to accounting and product shipping.

[0030] FIG. 3 is a diagram showing a specific example of a screen displayed on the output unit 13 of the terminal device 10. The screen displayed on the output unit 13 of the terminal device 10 is roughly divided into two types of areas: a first area and a second area. The first area is a display area controlled by the virtual space control unit 152, in which the virtual space is displayed. The content of an operation performed in the first area is acquired by the virtual space control unit 152 and used to move an avatar in the virtual space, operate objects, and switch displays. The first area is a so-called in-game area. The second area is a display area controlled by the service app control unit 151, in which, for example, a browser screen is displayed. The content of an operation performed in the second area is acquired by the service app control unit 151 and used to operate text, objects, hyperlinks, etc. on the browser. The second area is a so-called out-of-game area.

[0031] An operation performed when an in-game area is activated is accepted and processed by the virtual space control unit 152 as an operation performed in the virtual space. An operation performed when an out-of-game area is activated is accepted and processed by the service application control unit 151 as an operation performed outside the virtual space. For example, an operation performed when the cursor is positioned in the in-game area or an operation performed when the in-game area is selected (e.g., clicked) may be treated as an operation performed when the in-game area is activated. For example, an operation performed when the cursor is positioned in the out-of-game area or an operation performed when the out-of-game area is selected (e.g., clicked) may be treated as an operation performed when the out-of-game area is activated.

[0032] In FIG. 3, the area indicated by the reference numeral 51 is a first area, and the areas indicated by the reference numerals 52 and 53 are second areas. A virtual space is displayed in the first area 51. Information about services provided by the service providing device 30 is displayed in the second area 52 and the second area 53. For example, the second area 52 may display a user interface (hereinafter referred to as a "purchase UI") for performing operations to purchase products that exist in the real world. For example, the second area 53 may display information about a store that handles real products (store information). Specific examples of store information include the name of the store, a description of the store, and a list of products handled at the store.

[0033] 4 is a diagram showing another specific example of a screen displayed on the output unit 13 of the terminal device 10. In FIG. 4, the screen shown in FIG. 3 includes an overlapping area (an area displayed in an overlapping manner) indicated by reference numeral 54. The overlapping area is one aspect of the second area. That is, the overlapping area is controlled by the service application control unit 151. The overlapping area may be implemented, for example, as a modal window, a pop-up window, or in another aspect.

[0034] FIG. 5 is a diagram showing a specific example of a screen displayed on the output unit 13 of the terminal device 10. In FIG. 5, in the virtual space displayed in the first area 51, an avatar 511 is located in a store where products can be purchased. In the store, multiple virtual products 512 that simulate products that exist in the real world (hereinafter referred to as "real products") are displayed. For example, a virtual product 512 that simulates a real product, such as a white T-shirt, is displayed. In addition, in the second area 53, a list of real products that can be purchased in the store in the virtual space where the avatar 511 is located is displayed. The list of real products displays information about one or more real products. For example, in FIG. 5, an image (computer graphic or photograph), name, and price are displayed for each of five real products. The second area 53 may display all real products that can be purchased in the store in the virtual space displayed in the first area 51. For example, the real products displayed in the second area 53 may change as the screen is scrolled downward, thereby displaying substantially all real products.

[0035] FIG. 6 is a diagram illustrating a specific example of a screen displayed on the output unit 13 of the terminal device 10. In the virtual space shown in the first area 51 of FIG. 6, an avatar 511 is in contact with a virtual product 512. Such contact may be determined using the colliders of the avatar 511 and the virtual product 512, as described above. Information about the real product corresponding to the virtual product 512 that the avatar 511 has contacted is displayed in the second area 52. In the example of FIG. 6, an image (computer graphic or photograph), name, size selection area, product variation selection area, and purchase quantity selection area are displayed for the real product. The size selection area, product variation selection area, and purchase quantity selection area are examples of a purchase UI. A user who wishes to purchase a real product corresponding to the virtual product 512 can actually purchase the real product by operating the purchase UI displayed in the second area 53. For example, if the user selects a desired option in each selection area and then operates the “Add to Cart” button, the screen in the second area 53 transitions to a purchase screen. When the user operates a button on the purchase screen to instruct purchase, such as "Purchase," the product purchase procedure is carried out in accordance with pre-registered user information.

[0036] A specific example of the processing flow from the display of the screen shown in Fig. 5 through the display of the screen shown in Fig. 6 to the purchase of a product will be described. When a user operates a service app (e.g., a web browser) to access a specific virtual space, the virtual space control unit 152 communicates with the virtual space providing device 20 and receives image information. The virtual space control unit 152 displays an image of the virtual space in the first area 51 based on the received image information. The virtual space control unit 152 updates the image in the first area 51 at a predetermined timing (e.g., timing according to the update rate of the virtual space display).

[0037] When the avatar 511 enters a predetermined area for purchasing a product in the virtual space (for example, a store area in the virtual space), the virtual space control unit 152 requests the service app control unit 151 to acquire and display store information corresponding to the store area in the virtual space into which the avatar 511 has entered. The fact that the avatar 511 has entered the store area may be determined, for example, using a collider for the avatar 511 and the store. The service app control unit 151 requests store information from the service providing device 30 in response to the request. At this time, a network address (for example, a URL or IP address) that the service app control unit 151 should access to acquire the store information may be included as part of the image information. In this case, the virtual space control unit 152 may pass the network address to the service app control unit 151 as information indicating the access destination.

[0038] The service providing device 30 transmits store information to the terminal device 10 in response to the request. The service app control unit 151 displays information about the store in the second area 53 based on the received store information. The information about the store may include, for example, the name of the store and information about real products sold in the store. In this embodiment, a specific example of the information about the store includes a list of real products sold in the store. Therefore, the service app control unit 151 displays the list of real products in the second area 53. The image displayed in this state is the image shown in FIG. 5.

[0039] The user operates the avatar 511 to move the avatar 511 close to the virtual product 512. Then, a determination process using the colliders of the avatar 511 and the virtual product 512 determines that the avatar 511 has come into contact with the virtual product 512. This determination may be performed by the virtual space control unit 152 or by the virtual space providing device 20. The virtual space control unit 152 requests the service application control unit 151 to acquire and display product information of a real product corresponding to the virtual product 512 that the avatar 511 has come into contact with. In response to the request, the service application control unit 151 requests the product information from the service providing device 30. At this time, a network address (e.g., a URL or an IP address) that the service application control unit 151 should access to acquire the product information may be included as part of the image information. In this case, the virtual space control unit 152 may pass the network address to the service application control unit 151 as information indicating the access destination.

[0040] The service providing device 30 transmits product information to the terminal device 10 in response to the request. The service application control unit 151 displays information about the product in the second area 52 based on the received product information. The information about the product may include, for example, an image or name of the product. The service application control unit 151 may display a purchase UI for a real product corresponding to the virtual product 512 in the second area 52. The image displayed in this state is the image shown in FIG. 6.

[0041] The display of such product information and the display of the UI for purchasing the real product may be triggered by a trigger other than the contact between the avatar 511 and the virtual product 512 as described above. For example, the display may be triggered by the user directly operating the virtual product 512 placed in the virtual space. Specific examples of such operations include, for example, an operation of pointing a cursor and clicking, or an operation of touching. The operations are not limited to these.

[0042] When a user operates the purchase UI displayed in the second area 52 to add a real product to the cart, the service app control unit 151 transmits to the service providing device 30 a notification that the operation of adding the real product to the cart has been performed. The service providing device 30 transmits to the terminal device 10 a screen (e.g., a payment screen) to be displayed in response to the real product being added to the cart. The service app control unit 151 displays, for example, a screen for performing a payment operation in the second area 52 based on the information transmitted from the service providing device 30. When the user performs a payment operation (e.g., operating the purchase button or the payment button) on the screen displayed in the second area 52, the service app control unit 151 transmits to the service providing device 30 a notification that the payment operation has been performed. The service providing device 30 performs payment processing based on the information transmitted from the service app control unit 151.

[0043] FIG. 7 is a diagram showing another specific example of a screen displayed on the output unit 13 of the terminal device 10. In FIG. 7, the screen shown in FIG. 5 includes an overlapping area indicated by the reference numeral 54. In FIG. 7, the overlapping area is displayed as a modal window. For example, when a user operates (clicks, touches, etc.) a virtual product 512 placed in a virtual space, the virtual space control unit 152 requests the service application control unit 151 to acquire and display product information of a real product corresponding to the operated virtual product 512. In response to the request, the service application control unit 151 requests the product information from the service providing device 30. The specific processing is as described above.

[0044] The service providing device 30 transmits the product information to the terminal device 10 in response to the request. The service application control unit 151 displays information about the product in the second area 52 based on the received product information. The service application control unit 151 may also display a purchase UI for a real product corresponding to the virtual product 512 in the superimposed area 54. The image displayed in this state is the image shown in FIG. 7.

[0045] When a user operates the purchase UI displayed in the superimposed area 54 to add a real product to the cart, the service app control unit 151 transmits to the service providing device 30 a notification that the operation of adding the real product to the cart has been performed. The service providing device 30 transmits to the terminal device 10 a screen (e.g., a payment screen) to be displayed in response to the real product being added to the cart. The service app control unit 151 displays, for example, a screen for performing a payment operation in the superimposed area 54 based on the information transmitted from the service providing device 30. When the user performs a payment operation (e.g., operating the purchase button or the payment button) on the screen displayed in the superimposed area 54, the service app control unit 151 transmits to the service providing device 30 a notification that the payment operation has been performed. The service providing device 30 performs payment processing based on the information transmitted from the service app control unit 151.

[0046] In the specific example of the processing described above, the display of product information and a purchase UI is triggered by contact between the avatar 511 and the virtual product 512 or by a user's direct operation on the virtual product 512. The display mode may differ depending on each trigger. For example, when contact between the avatar 511 and the virtual product 512 is determined, product information may be displayed in the second area 52 as shown in Fig. 6, and when a user performs a direct operation on the virtual product 512, a product display may be displayed in the superimposed area 54 as shown in Fig. 7.

[0047] In the virtual space providing system 100 of this embodiment, the second area is controlled in response to an operation performed in the first area (the virtual space area, the in-game area) of the terminal device 10. This improves the user interface for operating the virtual space. That is, operations performed in the virtual space can be performed not only in the virtual space but also in areas other than the virtual space. This makes it possible, for example, for an operation in the virtual space to affect a display in an area other than the virtual space, or for a service to be provided in the real space (e.g., the sale of a real product) in response to an operation in the virtual space.

[0048] FIG. 8 is a diagram illustrating an outline of an example of the hardware configuration of an information processing device 90 applied to this embodiment. The information processing device 90 includes a processor 91, a main memory device 92, a communication interface 93, an auxiliary memory device 94, an input / output interface 95, and an internal bus 96. The processor 91, the main memory device 92, the communication interface 93, the auxiliary memory device 94, and the input / output interface 95 are communicably connected to each other via the internal bus 96. The information processing device 90 may be applied to, for example, the terminal device 10, the virtual space providing device 20, and the service providing device 30. In this case, for example, the communication unit 11 may be configured using the communication interface 93. For example, the memory unit 14 may be configured using the auxiliary memory device 94. Furthermore, the control unit 15 may be configured using the processor 91 and the main memory device 92.

[0049] (Variation) In this embodiment, a display area outside the virtual space (out-game) is controlled in response to an operation in the virtual space (in-game). Conversely, the virtual space (in-game) may be controlled in response to an operation in a display area outside the virtual space (out-game). That is, operation information in the virtual space (in-game) may be received in response to an operation in the out-game. For example, the virtual space control unit 152 may use part or all of the user's operation information in the second area 52 or the second area 53 as part or all of the operation information in the first area 51. In this case, the service application control unit 151 outputs the user's operation information in the second area 52 or the second area 53 to the virtual space control unit 152. For example, the virtual space control unit 152 may move the avatar 511 in the virtual space based on the user's operation information in the second area 52 or the second area 53. For example, the virtual space control unit 152 may cause the avatar 511 in the virtual space to perform a specific action based on the user's operation information in the second area 52 or the second area 53. For example, in response to an operation to purchase a specific product in second area 52, avatar 511 may perform a purchasing action or a predetermined action (e.g., jumping, dancing, etc.) that is associated in advance with the purchased product. For example, virtual space control unit 152 may change the display in the virtual space (e.g., change the display orientation, display magnification, viewpoint position, etc.) based on information about the user's operation in second area 52 or second area 53.

[0050] Although an embodiment of the present invention has been described above in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs within the scope of the gist of the present invention. [Explanation of symbols]

[0051] 100...virtual space providing system, 10...terminal device, 11...communication unit, 12...input unit, 13...output unit, 14...storage unit, 15...control unit, 151...service application control unit, 152...virtual space control unit, 20...virtual space providing device, 30...service providing device

Claims

1. an input unit for accepting user operations; a control unit that controls an application related to a service different from the virtual space in response to an operation in a virtual space among operations performed by a user on the input unit; an output unit that displays an image related to the virtual space and an image related to the service; A computer program for causing a computer to function as a terminal device comprising:

2. The computer program product according to claim 1 , wherein the control unit displays information about an object placed in the virtual space as an image related to the service in response to an operation on the object, among operations in the virtual space.

3. The computer program product according to claim 1 , wherein the control unit displays an image related to the service in response to an operation on an avatar placed in the virtual space, among operations in the virtual space.

4. The computer program according to claim 3 , wherein the control unit displays, as an image related to the service, an image related to an object in the virtual space that is determined to have collided with a collider set for that object and a collider set for the avatar.

5. an input unit for accepting user operations; a control unit that controls an application related to a service different from the virtual space in response to an operation in a virtual space among operations performed by a user on the input unit; an output unit that displays an image related to the virtual space and an image related to the service; A terminal device comprising:

6. an input unit for accepting user operations; a control unit that receives operation information in the virtual space in response to an operation in an application related to a service different from the virtual space, among operations by the user on the input unit; an output unit that displays an image related to the virtual space and an image related to the service; A computer program for causing a computer to function as a terminal device comprising:

7. an input unit for accepting user operations; a control unit that receives operation information in the virtual space in response to an operation in an application related to a service different from the virtual space, among operations by the user on the input unit; an output unit that displays an image related to the virtual space and an image related to the service; A terminal device comprising:

Citation Information

Patent Citations

  • Computer game method, computer game system connected to electronic trade transaction system operated on network and software recording medium

    JP2001195475A

  • Information processor and method for displaying information object

    JP2003167659A

  • Terminal device, product information display program, product information display method, and server device

    JP2011159062A

  • Virtual space display device, virtual space display system and program

    JP2012234355A

  • System, method and program for distributing moving image

    JP2019195536A