Information processing device, information processing system, and information processing method

The information processing device and system address the issue of user congestion in AR by displaying congestion levels and dynamically managing virtual object placement, preventing overcrowding and ensuring a safer AR experience.

WO2024247174A1PCT designated stage expired Publication Date: 2024-12-05MAXELL LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/020317
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing Augmented Reality (AR) technologies do not effectively manage user congestion around virtual objects, leading to potential overcrowding and safety issues during shared experiences, as they lack mechanisms to prevent or mitigate congestion.

Method used

An information processing device and system that collects user congestion information and displays the degree of crowding around virtual objects, allowing for dynamic adjustments such as hiding or relocating virtual objects when congestion exceeds a threshold, thereby preventing overcrowding.

Benefits of technology

Effectively prevents overcrowding and enhances user safety by informing participants of congestion levels and dynamically managing the display or placement of virtual objects, ensuring a safer and more enjoyable AR experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023020317_05122024_PF_FP_ABST
    Figure JP2023020317_05122024_PF_FP_ABST
Patent Text Reader

Abstract

Provided is an information processing device capable of displaying virtual content, which is content that is held by a user and includes a virtual object, wherein the information processing device is characterized in that: the information processing device acquires, from an operation-side server, virtual object information that indicates a virtual object disposed at a specific position and user congestion information that is collected by the server and indicates the degree of congestion of users around the virtual object, the information being generated by an operation-side server used in generating the virtual object and providing the virtual content; and the information processing device performs a display operation in a first display mode for displaying a position relating to the position where the virtual object is disposed and the degree of congestion of the users around the position where the virtual object is disposed on the basis of the acquired virtual object information and user congestion information, and in a second display mode for reproducing and displaying the virtual content.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing system, and information processing method

[0001] The present invention relates to an information processing device, an information processing system, and an information processing method.

[0002] In recent years, Augmented Reality (AR) technology, which adds digital information to the real world and reflects and augments virtual objects in a virtual space created using CG (Computer Graphics) or the like in the real space, has been widely used, and information processing devices that allow users to easily handle virtual objects while recognizing the real space in three dimensions have become widespread. An example of such an application is when a virtual object such as a popular character appears (is placed) in a specific location in the real space, and multiple people wearing the information processing device enjoy viewing the same placed virtual object or participating in virtual content corresponding to the virtual object.

[0003] As an example of an information processing device that displays virtual objects and virtual content by superimposing virtual objects such as characters on real space, Patent Document 1 states, "An information processing device according to one embodiment of the present technology includes an acquisition unit and a playback control unit. The acquisition unit acquires avoidance area information regarding an avoidance area to be avoided by at least one of the entry of the target person or the entry of a virtual object for the target person displayed for the target person, the avoidance area information being generated based on at least one of the position of another object different from the target person for whom virtual content is to be played back or the position of a virtual object for that other object displayed for the other object. The play control unit controls the playback of the virtual content for the target person based on the acquired avoidance area information."

[0004] International Patent Publication No. 2022 / 196199

[0005] Patent Document 1 discloses a technique for controlling the playback of virtual content by setting an avoidance area to prevent overlapping of virtual objects with each other or of virtual objects with people. However, the technique described in Patent Document 1 does not take into consideration the possibility of crowding if too many people gather together when multiple people view the same virtual object or play (play, information gathering, learning, etc.) by playing virtual content corresponding to the virtual object. This not only makes it impossible to enjoy virtual content such as games or events, but could also lead to accidents in the worst case scenario.

[0006] Therefore, there is a need to provide an information processing device, an information processing system, and an information processing method that can suppress congestion and crowding around a virtual object and avoid congestion and crowding when multiple people view the same virtual object or play by reproducing virtual content corresponding to the virtual object.

[0007] Furthermore, virtual content corresponding to virtual objects can not only be played back from pre-prepared content, but participants in the play can also process and edit the virtual content itself to change its shape, content, etc.

[0008] Among the inventions disclosed in this application, the outline of a representative invention will be briefly explained as follows.

[0009] The information processing device is capable of displaying virtual content owned by a user and including virtual objects. The information processing device acquires, from a server, virtual object information indicating a virtual object placed at a specific position, and user congestion information indicating the degree of congestion of users around the virtual object, which is generated by the server used to generate the virtual object and provide the virtual content. Based on the acquired virtual object information and user congestion information, the information processing device performs display operations in a first display mode that displays a position display regarding the placement position of the virtual object and the degree of congestion of users around the placement position of the virtual object, and a second display mode that plays and displays the virtual content.

[0010] The information processing system includes an information processing device owned by a user and capable of displaying virtual content, which is content including virtual objects, and an operator-side information processing server used to generate the virtual objects and provide the virtual content. The operator-side information processing server generates virtual object information indicating a virtual object placed at a specific position and collects user congestion levels around the virtual object to generate user congestion information indicating the user congestion levels. The information processing device acquires the virtual object information and the user congestion information from the operator-side information processing server, and, based on the acquired virtual object information and user congestion information, performs display operations in a first display mode that displays a position display regarding the placement position of the virtual object and a user congestion level around the placement position of the virtual object, and a second display mode that plays and displays the virtual content.

[0011] The information processing method is a method performed using an information processing device owned by a user and capable of displaying virtual content, which is content including virtual objects, and an operator-side information processing server used to generate the virtual objects and provide the virtual content. This information processing method includes the steps of: generating virtual object information indicating a virtual object placed at a specific position by the operator-side information processing server; collecting user congestion levels around the virtual object to generate user congestion information indicating the user congestion level; acquiring the virtual object information and the user congestion information from the operator-side information processing server by the information processing device; and performing display operations in a first display mode that displays a position display regarding the placement position of the virtual object and a user congestion level around the placement position of the virtual object based on the virtual object information and user congestion information acquired by the information processing device; and playing and displaying the virtual content in a second display mode.

[0012] By using the technology of the present invention, it is possible to realize an information processing device, an information processing system, and an information processing method that can suppress congestion and crowding around a virtual object and avoid congestion and crowding when multiple people view the same virtual object or play by reproducing virtual content corresponding to the virtual object. Furthermore, problems, configurations, and effects other than those described above will become clear from the description of the following embodiments.

[0013] 4A , 4B, 4C, 4D, 4E, 4F, 4G, 4G, 4H, 4G ... FIG. 1 is an example of a diagram illustrating a display screen of an information processing device according to the present embodiment when an HMD is used as the information processing device. FIG. 2 is another example of a diagram illustrating the appearance of an information processing device and an information processing system according to the present embodiment when an HMD is used as the information processing device. FIG. 3 is another example of a diagram illustrating a display screen of an information processing device according to the present embodiment when an HMD is used as the information processing device. FIG. 4 is another example of a diagram illustrating a display screen of an information processing device according to the present embodiment when an HMD is used as the information processing device. FIG. 5 is an example of a diagram illustrating a display screen of an information processing device according to the present embodiment. FIG. 6 is an example of a diagram illustrating another display screen of an information processing device according to the present embodiment. FIG. 7 is an example of a diagram illustrating a system that centrally manages information to prevent congestion when there are multiple operating companies that place virtual objects.

[0014] An example of an embodiment of the present invention will be described below with reference to the drawings. A specific example of an information processing device according to this embodiment will be described using a smartphone that displays objects in real space and virtual space on a display screen. FIG. 1 is a diagram illustrating an example of the exterior of an embodiment of an information processing device and information processing system according to this embodiment. In FIG. 1, a user 100 owns a smartphone 101, and other users (121, 122, 131, 132, 141, 142) also own smartphones. An operator information processing server 110 generates virtual objects (120, 130, 140) and places the generated virtual objects (120, 130, 140) at specific positions in real space. The operator information processing server 110 also has virtual content that is played by running application software (apps) corresponding to each virtual object (120, 130, 140). That is, the operator information processing server 110 generates and owns an app with virtual content such as movements of popular characters and game actions, and a user who registers the app with the operator can activate the registered app by specifying a virtual object on their smartphone and play or view the virtual content reproduced by the app. The operator information processing server 110 also generates virtual object information that indicates the positions of the generated and placed virtual objects (120, 130, 140) and the virtual content.

[0015] 1 , other users (121, 122) who own smartphones similar to the user 100 are gathered in an area 129 around the virtual object 120. Other users (131, 132) who own smartphones similar to the user 100 are gathered in an area 139 around the virtual object 130. Other users (141, 142) who own smartphones similar to the user 100 are gathered in an area 149 around the virtual object 140. The smartphones owned by the users (100, 121, 122, 131, 132, 141, 142) and the operator information processing server 110 communicate wirelessly with each other via an external network using base station communication or the like. The operator information processing server 110 collects location information of users (100, 121, 122, 131, 132, 141, 142) who have registered for the app using a GNSS (Global Navigation Satellite System) function of the smartphone that measures the current location on Earth via wireless communication, and acquires the degree of user congestion around the virtual object (120, 130, 140) as user congestion information. Note that other examples of methods for acquiring user location information include using location information from a smartphone base station to which the user's smartphone is connected, or using a VPS (Visual Positioning Service) function that identifies the current location and direction from video captured by a camera built into the smartphone or a camera built into another information processing device connected to the smartphone. These methods may be used alone or in combination to acquire user location information. If an HMD with a built-in camera is used as another information processing device connected to a smartphone, the VPS function can be used without having to take the trouble of holding the smartphone to take a picture.

[0016] Meanwhile, smartphones owned by users (100, 121, 122, 131, 132, 141, 142) acquire virtual object information and user congestion information around the virtual object from the operator information processing server 110, and display the virtual object's location and the user congestion level around the virtual object on a display screen based on the acquired virtual object information and user congestion information. For example, the smartphone 101 displays, on the display screen 102 of the smartphone 101, virtual objects (120, 130, 140) located at specific locations and the user congestion level around the virtual object (120, 130, 140). Therefore, by configuring the smartphone owned by the user in a first position display mode (first display mode) that displays the location of the virtual object and the user congestion level around the virtual object's location, the user 100 can visually confirm the user congestion level around the virtual object. This allows participating users who gather around the virtual object to view the virtual object or participate in its virtual content to be informed of the congestion and crowding level around the virtual object, allowing participating users to decide whether or not to participate, thereby preventing crowding. Therefore, by preventing crowding of users, not only can virtual content such as games and events be enjoyed but the risk of accidents can also be eliminated. In addition, on smartphones, virtual objects are displayed on a map screen, and the degree of user congestion around the virtual objects is also displayed on the map screen, making it possible to accurately and precisely grasp the positional relationship between the virtual objects and the degree of user congestion around them.

[0017] FIG. 2 is an example diagram illustrating the appearance of an embodiment of an information processing device and an information processing system when the user congestion level around a virtual object exceeds a threshold. In FIG. 2, parts with the same reference numerals as those shown in FIG. 1 perform the same operations as those already described, and therefore detailed descriptions thereof are omitted. FIG. 2 illustrates a case in which many users (121, 122, 123, 124, 125, 126, 127, 128) gather within the area 129 surrounding the virtual object 120, causing the user congestion level within the area 129 surrounding the virtual object 120 to exceed a threshold. When the user congestion level exceeds the threshold, the smartphone 101 stops displaying the position of the virtual object 120 at a position surrounded by a frame 202 on the display screen 102. Therefore, when a certain number of users gather around the virtual object, the display of the virtual object's position is stopped, and users no longer recognize the existence of the virtual object and stop gathering around the virtual object. Thus, it is possible to prevent more users from gathering around a virtual object where the user congestion level exceeds a threshold, thereby realizing avoidance of crowding around a virtual object with a high user congestion level.

[0018] FIG. 3 is a diagram illustrating an example of the appearance of an embodiment of an information processing device and an information processing system when a user owning a smartphone is in a specific area where the user congestion level exceeds a threshold. In FIG. 3, parts with the same reference numerals as those shown in FIGS. 1 and 2 perform the same operations as those already described, and therefore detailed descriptions thereof are omitted. In FIG. 3, a user 123 owning a smartphone 301 is in a specific area 302 where the user congestion level exceeds a threshold. When the user congestion level exceeds the threshold, the smartphone 301 stops displaying the position of the virtual object 120 displayed at a position surrounded by a frame 304 on the display screen 303. In other words, the location of the virtual object is hidden from users in the congested area. This can encourage users in the congested area around the virtual object to move away from the congested area with high user congestion, thereby accelerating and promoting congestion avoidance. This example is effective when a user who is within the display range of the virtual object is not yet able to see the virtual object due to, for example, an obstacle blocking their view. For users who are within the displayable range of a virtual object and are already displaying the virtual object, the display of the virtual object itself can be stopped as described below, thereby encouraging them to leave the crowded area.

[0019] 4A and 4B are diagrams illustrating the appearance of exemplary embodiments of an information processing device and an information processing system when the user congestion level around a virtual object exceeds a threshold. In FIGS. 4A and 4B, parts with the same reference numerals as those shown in FIGS. 1, 2, and 3 perform the same operations as those already described, and therefore detailed descriptions thereof will be omitted. In FIG. 4A, when the user congestion level in the surrounding area 129 of the virtual object 120 exceeds a threshold, the virtual object 120 is placed or moved to another position and displayed as a virtual object 401. As the virtual object 120 is placed and moved to the virtual object 401, some or all of the users who had gathered around the virtual object 120 move to the area around the virtual object 401. As shown in FIG. 4B, users (401, 402, 403) are people who have moved into the surrounding area 405 of the virtual object 401. Therefore, if the degree of user congestion around a virtual object exceeds a threshold, the virtual object can be placed or moved to another position to disperse users gathering around the virtual object, making it possible to avoid crowding around a virtual object with a high degree of user congestion.

[0020] Another method for dispersing users gathering around a virtual object may be to copy the virtual object and place the same virtual object in another location. Referring to FIG. 4A , virtual object 120 is left in its original location, while virtual object 401 is placed in another location. Furthermore, a different virtual object that users will want to see, such as a miniature of the virtual object, may be placed on the path leading to the copied virtual object placed in another location, thereby motivating users to move to another location. Users may be motivated to move by having a miniature of the virtual object lead them to another location. Furthermore, users may be motivated to move by, for example, displaying an additional virtual object that can only be seen by users who have moved to another location.

[0021] Next, an information processing device and an information processing system will be described when a second playback display mode (second display mode) is configured to play back and display virtual content corresponding to a virtual object on a smartphone. Figures 5A and 5B are diagrams illustrating the appearance of exemplary embodiments of an information processing device and an information processing system in the second playback display mode when the user congestion level around the virtual object exceeds a threshold. In Figures 5A and 5B, parts designated by the same reference numerals as those shown in Figures 1, 2, 3, 4A, and 4B operate in the same manner as those already described, and therefore detailed descriptions thereof will be omitted. In Figure 5A, users (121, 122) are present within the surrounding area 129 of the virtual object 120, and the user congestion level has not exceeded the threshold. In this case, the smartphone 101 owned by the user 100 displays the movement of a character 501 (in this example, a bear character) as virtual content corresponding to the virtual object 120 on the display screen 102 along with the scenery within the field of view. In contrast, in FIG. 5B , many users (121, 122, 123, 124, 125, 126, 127, and 128) are gathered within the surrounding area 129 of the virtual object 120, resulting in a state in which the user congestion level exceeds a threshold. In this case, the smartphone 101 stops playback and display of the virtual content character 501 (a bear character). That is, when performing display operations in the second playback display mode, if the user congestion level around the virtual object exceeds a threshold, playback and display of the virtual content corresponding to the virtual object is stopped. This prevents users from gathering around the virtual object once a certain number of users viewing the virtual content have gathered around the virtual object, thereby preventing crowding around a virtual object with a high user congestion level. In addition to playback of character actions, examples of virtual content corresponding to a virtual object include playback of play actions for playing a game, etc.

[0022] In addition, while the target users for the congestion level around a virtual object have been defined as users who have registered an app, it may also be limited to users who have the registered app running and are playing it. In this case, target users tend to spend long periods of time around the virtual object while actually using the app, which is expected to enable more accurate and precise detection of the congestion level. As another example of a target user definition, a user who has registered an app and approaches a virtual object by a certain distance or more may be considered a target user for congestion level assessment, even if the app is not running. This allows for earlier congestion avoidance. The distance between the user and the virtual object may be calculated from location information acquired by the user's app using a GNSS sensor or the like of the information processing device and location information of the location where the virtual object is placed. Furthermore, the size of the area surrounding the virtual object may be changed depending on the definition range of the target users for the congestion level around the virtual object. For example, if the target user is a user who has registered an app, the virtual object area may be narrower than the area surrounding the virtual object when the target user is a user who has registered an app. Furthermore, the threshold for user congestion level may be changed as needed depending on the definition range of the target users and the size of the area surrounding the virtual object. The level of congestion among general users who are not registered with the operator may also be factored into the level of congestion around the virtual object. In this case, the user congestion threshold and the area around the virtual object may be adjusted appropriately. The level of congestion among general users who own smartphones can be determined, for example, by obtaining from the smartphone's carrier the number of users using their smartphones connected to mobile phone base stations around the virtual object. Alternatively, multiple user congestion thresholds may be set, and the virtual object's location display may be graded according to the threshold level. This allows for graded warnings of congestion. For example, the congestion threshold may be set to three levels: low, medium, and high. When the congestion level reaches medium, the virtual object's location display flashes, and when the congestion level reaches high, the virtual object's location display disappears.If the user sees a display showing a medium level of congestion and is far from the virtual object, the user can use this information to decide to cancel their participation, as the level of congestion is expected to become high during movement.

[0023] Next, Figure 6 is a block diagram showing an example of the configuration of an information processing device and information processing system according to this embodiment. In Figure 6, the smartphone 101 is configured appropriately using a camera 301, a distance measurement sensor 302, a GNSS sensor 303, an acceleration sensor 304, a gyro sensor 305, a geomagnetic sensor 306, a display device 307, an operation input interface 308, a processor 320, a memory 330 storing a program 331 and information data 332, a vibration generating device 341, an audio input device 342, an audio output device 343, and a network communication device 345, and each component is connected to each other via a bus 350. Smartphones (361, 362, 363) have the same configuration as the smartphone 101 and are owned by users other than the user 100. Note that smartphones owned by users other than the user 100, other than the smartphones (361, 362, 363), are not shown in the figure.

[0024] The operator information processing server 370 is configured using a processor 371, a memory 372, and a network communication device 373 as appropriate, and each component is interconnected via a bus 374. The processor 371 controls the respective functional operations through a virtual object information generation process 375 and a user congestion information generation process 376. The virtual object information generation process 375 generates a virtual object to be placed at a specific location, and generates virtual content corresponding to the generated virtual object and the location of the virtual object as virtual object information. The user congestion information generation process 376 collects the locations of smartphones registered with the app, such as smartphones (101, 361, 362, 363), via an external network 380 using a network communication device 373, and generates user congestion information indicating the level of congestion of users who own the smartphone. The generated virtual object information and user congestion information are stored in the memory 372 and supplied to each smartphone via the external network 380 by the network communication device 373. Next, each component of the smartphone 101 that receives the virtual object information and user congestion information supplied from the operator information processing server 370 will be described in detail.

[0025] Camera 301 is a device that captures the field of view in front of smartphone 101, and acquires a camera-captured image by converting light incident through a lens into an electrical signal using an image sensor. Camera 301 captures the user's field of view, which serves as the background for the playback display of virtual content, in a second playback display mode in which virtual content corresponding to a virtual object is played back and displayed. Furthermore, if there is a user in front of user 100 who is looking at a virtual object or participating in the virtual content, camera 301 can be used to directly capture that user, and camera 301 can be used to collect information on the level of user congestion around the virtual object.

[0026] The ranging sensor 302 is a sensor that can measure the distance and angle to an object and capture the three-dimensional shape of the object, such as an object. Examples of sensors that can be used include a LiDAR (Light Detection and Ranging) sensor that irradiates an object with infrared or other laser light, measures the reflected scattered light, and analyzes and detects the distance to a distant object and the state of the object, a TOF (Time Of Flight) sensor that measures the distance by irradiating a subject with pulsed light and measuring the reflection time for each pixel, and a millimeter-wave radar that emits millimeter-wave radio waves, captures the reflected waves, and detects the distance to the object and the state of the object.

[0027] As with the camera 301, if there is a user in front of the user 100 who is looking at a virtual object or participating in the virtual content, the distance measurement sensor 302 can directly capture that user and use it to collect information on the level of user congestion around the virtual object.

[0028] The GNSS sensor 303 is a device that receives signals from GNSS (Global Navigation Satellite System) satellites in the sky and detects the current position of the smartphone 101. This makes it possible to detect the position of the user 100 who owns the smartphone 101.

[0029] The acceleration sensor 304 detects acceleration, which is a change in speed per unit time, and can detect movement, vibration, shock, and the like. The acceleration sensor 304 provided in the smartphone 101 can detect the tilt and orientation of the smartphone 101 worn by the user 100. The gyro sensor 305 detects angular velocity in the rotational direction and can detect the vertical, horizontal, and diagonal orientation of the smartphone 101. Therefore, the acceleration sensor 304 and the gyro sensor 305 can be used to detect the orientation of the smartphone 101, such as the tilt and orientation. The geomagnetic sensor 306 detects the Earth's magnetic force and detects the direction in which the smartphone 101 is facing. A three-axis sensor that detects geomagnetic fields in the up-down direction in addition to the front-back and left-right directions can be used to detect the movement of the smartphone 101 by capturing changes in geomagnetic field in response to the movement of the smartphone 101. These sensors make it possible to detect the orientation of the user 100 wearing the smartphone 101.

[0030] The display device 307 is configured to display the display contents via a highly transparent touch panel made of liquid crystal or the like, and displays the respective display contents in the first position display mode and the second playback display mode.

[0031] The operation input interface 308 is configured to allow the user 100 to input information to the smartphone 101, and detects touch operations using a finger, a touch pen, or the like as operation input using a touch panel configured on the display surface of the display device 307. The operation input interface 308 allows the user 100 to set and input information that the user 100 wants to input. The smartphone 101 may also acquire input operation information using, for example, a keyboard or key buttons. The user 100 may utter a voice indicating an input operation, and the smartphone 101 may collect the sound using the voice input device 342 and acquire the input operation information. An example of operation input is when the user 100 specifies and inputs a virtual object for which the user wants to know the user congestion level.

[0032] The processor 320 is configured with a CPU or the like, and controls each component of the smartphone 101 by executing an operating system (OS) 333 and an application program 334 for operation control, etc., stored in the memory 330, thereby realizing functions of the OS, middleware, applications, etc., and other functions. The processor 320 controls the operation of each function in a virtual object and user position display process 321, a virtual content playback and display process 322, and a user congestion level detection process 323.

[0033] The memory 330 is configured with a nonvolatile storage device or the like, and stores various programs 331 and information data 332 handled by the processor 320 or the like. The information data 332 stores virtual object information 335 indicating the position of a virtual object and its virtual content, user congestion information 336 indicating the degree of congestion of users around the virtual object, and the like.

[0034] The vibration generating device 341 is configured to generate vibrations under control of the processor 320, and converts notification instruction information for the user 100 transmitted by the smartphone 101 into vibrations. The vibration generating device 341 transmits vibrations to the hand holding the smartphone 101, thereby notifying the user 101 that information requiring notification or instruction has been generated. An example of notification instruction information for the user is information informing that the degree of congestion of users around a virtual object has reached a threshold value or higher.

[0035] The voice input device 342 is configured to collect external sounds and the user's own voice using a microphone and convert them into voice data. The user 101 speaks a voice indicating an instruction such as an input operation, and the voice input device 342 collects the sound and captures the instruction information such as the input operation, thereby enabling the user to conveniently execute an operation in response to the instruction information.

[0036] The audio output device 343 is configured to output audio from a speaker based on audio data, and can provide audio notification instruction information to the user 101. For example, it is possible to improve convenience by issuing an audio notification that the degree of user congestion around a virtual object has reached a threshold value or higher.

[0037] The network communication device 345 is a communication device that wirelessly communicates with an external operator information processing server 370 via an external network 380 using base station communication or the like. The network communication device 345 can receive virtual object information, user congestion information, and the like stored in the operator information processing server 370, as well as apps that operate virtual content corresponding to virtual objects. Note that, as the base station communication, long-distance wireless communication such as W-CDMA (Wideband Code Division Multiple Access) or GSM (Global System for Mobile communications) may be used. In addition, when the operator information processing server 370 is within a range where short-range wireless communication is possible, wireless communication may be performed using a short-range wireless communication device such as an electronic tag, Bluetooth (registered trademark), IrDA (Infrared Data Association, registered trademark), Zigbee (registered trademark), HomeRF (Home Radio Frequency, registered trademark), or wireless LAN (IEEE802.11a, IEEE802.11b, IEEE802.11g).

[0038] The virtual object and user position display process 321 displays the placement position of the virtual object and the degree of user congestion around the virtual object position in a first position display mode based on the virtual object information and user congestion information received from the operator information processing server 370.

[0039] The virtual content playback / display process 322 plays back and displays the virtual content corresponding to the virtual object in the second playback / display mode based on the virtual object information and user congestion information received from the operator information processing server 370 .

[0040] The user congestion level detection process 323 detects whether the user congestion level around the virtual object exceeds a threshold value.

[0041] With the above configuration, the smartphone 101 performs a display operation in a first position display mode, which displays the placement position of a virtual object and the degree of user congestion around the virtual object position based on the acquired virtual object information and user congestion information through the virtual object and user position display process 321. The smartphone 101 also performs a display operation in a second playback display mode, which displays virtual content corresponding to a virtual object based on the acquired virtual object information and user congestion information through the virtual content playback display process 322. This allows users around the virtual object to be informed of the degree of congestion and prevents crowding. Furthermore, if the smartphone 101 detects through the user congestion detection process 323 that the degree of user congestion around the virtual object exceeds a threshold, the smartphone 101 stops displaying the position of the virtual object or moves the placement position of the virtual object in the first position display mode. If the smartphone 101 detects through the user congestion detection process 323 that the degree of user congestion around the virtual object exceeds a threshold, the smartphone 101 stops displaying the playback of the virtual content in the second playback display mode. Therefore, when the degree of user congestion around the virtual object is high, it is possible to indicate to the users around the virtual object that they are crowded together, thereby preventing congestion and crowding around the virtual object.

[0042] Next, the basic operation of the information processing device and information processing system according to this embodiment will be described using a flowchart. FIGS. 7A-7C are example flowcharts illustrating the basic operation of the information processing device and information processing system according to this embodiment. In FIG. 7A, an information processing device such as a smartphone 101 acquires, from the operator information processing server 110, virtual object information indicating a virtual object generated by the operator information processing server 110 and placed at a specific position, and user congestion information indicating the degree of user congestion around the virtual object collected by the operator information processing server (S701). If the information processing device does not perform a display operation of the virtual object based on the degree of user congestion around the virtual object based on the acquired user congestion information (S702), the information processing device displays the placement position of the virtual object and the degree of user congestion around the virtual object position in a first position display mode (S703). Alternatively, the information processing device plays and displays virtual content corresponding to the virtual object in a second playback display mode (S703). This allows the user to be informed of the degree of user congestion around the virtual object. Furthermore, the user can enjoy playing games and the like by playing virtual content.

[0043] On the other hand, when the information processing device performs a display operation of a virtual object according to the user congestion level around the virtual object position based on the acquired user congestion information (S702), the display operation is changed depending on whether the user congestion level exceeds a threshold (S704). When the user congestion level exceeds a threshold in the first position display mode (S704, S705), the information processing device stops displaying the position of a virtual object placed at a specific position (S706, S707), or places or moves the virtual object to another position and displays it (S706, S708). Furthermore, the information processing device displays the user congestion level around the virtual object position regardless of whether the virtual object is hidden or moved (S709). Therefore, when the user congestion level exceeds a threshold and is high, the virtual object position can be hidden from users to prevent users from gathering around the virtual object. Alternatively, the virtual object's position can be moved to disperse users.

[0044] An example of the display operation (first mode) in the first position display mode from S705 to S709 is shown in FIG. 7B . The first mode starts, and the information processing device determines whether to stop displaying the position of the virtual object or change the placement position of the virtual object (S801). Here, the user may set in advance which process to perform in the information processing device, and the information processing device may determine which process to perform based on the setting. Alternatively, which process to perform may be set on the server side, and the information processing device may determine which process to perform based on the setting.

[0045] When stopping the display of the positions of the virtual objects, the information processing apparatus stops the display of the positions of the virtual objects in the area where it has been determined in S704 that the degree of user congestion has exceeded the threshold (S802).

[0046] When changing the placement position of a virtual object, the information processing device changes the position of the virtual object by placing or moving the virtual object in the area where it was determined in S704 that the user congestion level has exceeded the threshold to another position (S803).

[0047] Furthermore, the information processing device displays the current degree of user congestion around the virtual object (S804).

[0048] 7A , if the degree of user congestion exceeds a threshold value in the second playback display mode (S704, S705), the information processing device stops playback and display of the virtual content corresponding to the virtual object (S710). Therefore, if the degree of user congestion exceeds the threshold value and is high, the virtual content is made invisible to users, and it is possible to prevent users from gathering around the virtual object.

[0049] An example of the display operation (second mode) in the second playback display mode in S705 and S710 is shown in Fig. 7C . When the second mode starts, the information processing device stops playback and display of the virtual content corresponding to the virtual object in the area where it was determined in S704 that the user congestion level has exceeded the threshold (S901).

[0050] Returning to FIG. 7A , the explanation continues. If the user congestion level does not exceed the threshold (S704), the information processing device proceeds to sequence S703, where it performs display operation in the first position display mode or the second playback display mode. If the display operation in the first position display mode or the second playback display mode is to be ended (S711), the information processing device ends all sequences. On the other hand, if the display operation in the first position display mode or the second playback display mode is not to be ended (S711), the information processing device returns to sequence S701, where it enters a state of acquiring virtual object information and user congestion information. Thus, the information processing device and the information processing system can prevent congestion and crowding around the virtual object and can avoid congestion and crowding.

[0051] Next, a case where an HMD is used as the information processing device owned by a user in the information processing device and information processing system according to this embodiment will be described with reference to FIGS. 8A , 8B , 8C , 8D , and 8E . The HMD is a device worn on the user's head and displays a virtual space consisting of virtual objects together with real space on a display device or the like provided on the front of the head. It is an information processing device that has components equivalent to those of the smartphone 101 and enables the same functions. FIG. 8A is a diagram schematically illustrating the exterior of an example of an information processing device and information processing system according to this embodiment when an HMD is used as the information processing device. FIG. 8B is an example of a diagram illustrating an HMD display screen in the first position display mode when the user congestion level does not exceed a threshold and is not high. FIG. 8C is a diagram schematically illustrating the exterior of an example of an information processing device and information processing system according to this embodiment when the user congestion level exceeds a threshold and is high. FIG. 8D is an example of a diagram illustrating an HMD display screen in the first position display mode when the user congestion level exceeds a threshold and is high. FIG. 8E is an example of a diagram illustrating an HMD display screen in the second playback display mode. In Figures 8A, 8B, 8C, 8D, and 8E, parts shown in Figures 1, 2, 3, 4A, 4B, 5A, and 5B and assigned the same reference numerals have the same operations as those already described, and therefore detailed description thereof will be omitted.

[0052] In FIG. 8A , user 100 wears an HMD 800, which can display and visualize real space and virtual space, on his or her head. While viewing a view such as a building 801 in front of him or her, user 100 views a virtual space consisting of virtual objects (120, 130, 140) and users around the virtual objects (120, 130, 140). FIG. 8B shows a display screen 810 of the HMD 800 viewed by the user in the state shown in FIG. 8A . The display screen 810 displays a view such as the building 801 in front of him or her, as well as a virtual space 820 showing the positions of the virtual objects (120, 130, 140) and the degree of congestion of users around the virtual objects (120, 130, 140). Thus, as with the smartphone 101, participating users who gather around a virtual object to view the virtual object or participate in its virtual content can be informed of the congestion or crowding around the virtual object, allowing participating users to decide whether or not to participate, thereby preventing crowding.

[0053] 8C , similar to the case shown in FIG. 2 , illustrates a case where many users (121, 122, 123, 124, 125, 126, 127, 128) gather within the peripheral region 129 of the virtual object 120, causing the user congestion level within the peripheral region 129 of the virtual object 120 to exceed a threshold. When the user congestion level exceeds the threshold, the HMD 800 stops displaying the position of the virtual object 120, which is displayed on the display screen 810 at a position surrounded by a frame 821, as shown in FIG. 8D . As a result, users no longer perceive the existence of a virtual object with a high congestion level, and therefore do not gather around that virtual object. Thus, it is possible to prevent more users from gathering around a virtual object whose user congestion level exceeds a threshold, thereby realizing the avoidance of crowding around a virtual object with a high user congestion level.

[0054] 8E shows a display screen 810 of the HMD 800 in a second playback / display mode in which virtual content corresponding to a virtual object is played back and displayed, where the user congestion level around the virtual object does not exceed a threshold. In this case, the user 100 enters the surrounding area 129 in which the virtual content is visible, and at the position of the user 100 shown in FIGS. 5A and 5B , the user 100 can visually recognize the movement of a character 830 (in this example, a bear character) as virtual content corresponding to the virtual object 120, along with scenery such as buildings 511 within the field of view. On the other hand, if the user congestion level exceeds a threshold, the display of the character 830 (a bear character) is stopped. This makes it possible to prevent further users from congregating around a virtual object once a certain number of users viewing the virtual content have gathered around the virtual object, thereby avoiding crowding around a virtual object with a high user congestion level.

[0055] 9A, 9B, and 9C show another example of a screen displaying the location of a virtual object and the user congestion level on the display screen 102 of the smartphone 101 shown in FIG. 1 etc. In FIG. 9A, the user congestion level is indicated by the number of people around the virtual object. The number of people may be a rough number that allows an understanding of the congestion level. In FIG. 9B, the location of the virtual object and the user congestion level are displayed in list format. In this example, the surrounding congestion level is expressed in three levels: high, medium, and low. Displaying in list format has advantages such as allowing virtual objects placed in distant locations that cannot be displayed in map format to be viewed at a glance, and facilitating search and sorting. In FIG. 9C, the placement period or planned placement period is displayed along with the placement position of the object. Confirming the placement period is effective in mitigating congestion, as it can be seen that a virtual object with a long placement period will be visible for a longer period, and congestion can be expected to be leveled out within the period.

[0056] An example of a system that centrally manages information to prevent congestion when there are multiple operators who place virtual objects will be described with reference to FIG. 10 .

[0057] When there are multiple operating companies that place virtual objects, it is possible to avoid situations where app registrants from different companies gather in the same place and become crowded by managing the location display of the virtual objects on a common server 1001. The server 1001 that commonly manages the location information of virtual objects may be managed by one of the operating companies that place the virtual objects, or may be managed jointly. Alternatively, it may be managed by a company other than the operating company that places the virtual objects.

[0058] Hereinafter, an operator that places virtual objects may be referred to as a virtual object operator, and an operator that jointly manages the location information of virtual objects may be referred to as a shared location information operator.

[0059] In the absence of a shared location information provider, each virtual object provider must choose the location and period for placing their virtual objects, but there is a possibility that their placement may overlap with the locations and periods of other virtual object providers. In such cases, it becomes difficult for a single virtual object provider to alleviate congestion.

[0060] Therefore, the virtual object business transmits information such as the placement location and placement period of the virtual object placed by the virtual object business to the common location information business via network 1002, and the common location information business receives the information, registers it on its server, stores it, and makes it displayable so that other virtual object businesses can view it. Note that the information passed from the virtual object business to the common location information business may also include the user congestion level of users who have registered their apps with each virtual object business.

[0061] Other virtual object providers determine the placement location and period of their virtual objects by taking into account the information on the placement locations and periods of other providers' virtual objects registered on the server of the common location information provider. In the example of Figure 10, Company A registers a placement plan for a virtual object, Company B references Company A's virtual object placement plan, and Company B can register its placement plan for a virtual object at a position that does not overlap with Company A's virtual object. Note that Company B may also take into account the placement period of Company A's virtual object and register its placement plan for a virtual object at the same position as Company A's virtual object but for a different period from Company A's virtual object. This makes it possible to avoid overlapping placement of virtual objects between virtual object providers, thereby alleviating congestion around virtual objects even when there are multiple virtual object providers.

[0062] A user who has registered an app with each virtual object provider can avoid congestion by referring only to congestion information displayed by that virtual object provider on an information processing device, but it may also be possible to refer to the placement locations, period information, user congestion levels, etc. of virtual objects of other virtual object providers displayed by a common location information provider on an information processing device. This allows users to avoid passing through areas that are congested due to virtual objects placed by other virtual object providers, for example.

[0063] The information registered on the server of the common location information provider may be displayed as a virtual object and congestion status on a map as shown in Figure 9A, or may be displayed in list format as shown in Figure 9B so that it can be sorted and searched.

[0064] The information registered on the server of the common location information provider includes the placement location, placement period, placement priority, genre, size, etc. of the virtual object. For example, a high priority can be set for a virtual object to be used at a public event, etc., and if the placement location or period overlaps with that of a virtual object for entertainment purposes that is set to a lower priority, the common location information provider may refuse to register the virtual object for entertainment purposes, or may cancel it if it was registered first. This allows for the placement of a virtual object with a higher priority when the placement location and period are limited.

[0065] The priority information may be used to hide the display of virtual objects when the area is crowded. For example, if a high-priority virtual object and a low-priority virtual object are placed and displayed close to each other and then the level of crowding increases, the information processing device acquires the priority information from a virtual object provider or a common location information provider via communications and stops displaying the virtual object with the lower priority first. If the virtual objects are managed by different virtual object providers, the virtual object providers may cooperate with each other to exchange information via the common location information provider, and the information processing device may acquire the priority information from the common location information provider via communications and stop displaying the virtual object with the lower priority.

[0066] Furthermore, if the user group interested in a particular virtual object is identified, by categorizing the virtual objects that interest each user group and registering them with genre information, other virtual object providers can place virtual objects of the same genre in nearby locations and for a certain period of time, preventing congestion due to people moving around or moving around multiple times. Also, by placing virtual objects of the same genre at a certain distance from each other, crowding can be prevented and congestion can be better controlled.

[0067] By providing information about the size and display range of a virtual object, it is possible to place other virtual objects in a position where they will not overlap with adjacent virtual objects when placed.

[0068] The common location information provider may adjust the placement location and period of virtual objects registered by each virtual object provider based on information such as priority, genre, size, etc. Furthermore, at the time of registration, the common location information provider may provide recommendation or warning information based on the registration information, such as "A virtual object of the same genre is scheduled to be placed nearby."

[0069] The installation of server 1001 that commonly manages the location information of virtual objects is not essential, and similar processing can be achieved by each virtual object business directly exchanging information with each other. Also, a virtual object business may register information on server 1001 and acquire information from server 1001 via communication with a common location information business, but a virtual object business may also directly communicate with server 1001 to register information on server 1001 and acquire information from server 1001.

[0070] In the above description, a smartphone and an HMD have been taken as specific examples of the information processing device according to the present embodiment, but the present invention is applicable to all devices having similar functions. It goes without saying that the same effects and advantages can be obtained with information processing devices that display virtual objects in a virtual space, such as tablets, portable game devices, and video display devices.

[0071] According to the above embodiment, the following information processing device, information system, and information processing method are provided as examples.

[0072] (1) An information processing device that displays virtual objects and virtual content and is owned by a user who views virtual objects or plays and reproduces virtual content corresponding to the virtual objects, wherein the information processing device acquires, from an operator-side information processing server, virtual object information indicating a virtual object generated by the operator-side information processing server and placed at a specific position, and user congestion information indicating the degree of user congestion around the virtual object collected by the operator-side information processing server, and performs display operations in a first position display mode that displays the placement position of the virtual object and the degree of user congestion around the position of the virtual object, and a second playback display mode that plays and displays the virtual content corresponding to the virtual object, based on the acquired virtual object information and user congestion information.

[0073] (2) The information processing device according to (1) is characterized in that, when performing a display operation in the first position display mode, the information processing device positions and displays a virtual object on a map screen, and also displays the degree of user congestion around the virtual object on the map screen.

[0074] (3) The information processing device according to (1) is characterized in that, when performing a display operation in the first position display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the information processing device stops displaying the position of the virtual object placed at a specific position.

[0075] (4) The information processing device according to (1) is characterized in that, when performing a display operation in the first position display mode, if the information processing device is located within a range where the degree of user congestion around the virtual object position exceeds a threshold, the information processing device stops displaying the position of a virtual object placed at a specific position.

[0076] (5) The information processing device according to (1) is characterized in that, when performing a display operation in the first position display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the virtual object is placed or moved to another position and displayed.

[0077] (6) The information processing device according to (1) is characterized in that, when performing a display operation in the second playback display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the information processing device stops the playback display of the virtual content corresponding to the virtual object.

[0078] (7) An information processing system having an information processing device that is owned by a user who views virtual objects or plays and reproduces virtual content corresponding to the virtual objects, and that displays the virtual objects and virtual content, and an operator-side information processing server that collects virtual object information indicating virtual objects placed at specific positions and the degree of user congestion around the virtual objects to generate user congestion information indicating the degree of user congestion, wherein the information processing system is characterized in that the information processing device acquires the virtual object information and the user congestion information from the operator-side information processing server, and performs display operations in a first position display mode that displays the placement position of the virtual object and the degree of user congestion around the virtual object position based on the acquired virtual object information and user congestion information, and a second playback display mode that plays and displays the virtual content corresponding to the virtual object.

[0079] (8) In the information processing system described in (7), when the information processing device performs a display operation in the first position display mode, the information processing system is characterized in that it places and displays a virtual object on a map screen, and also displays the degree of user congestion around the virtual object position on the map screen.

[0080] (9) In the information processing system described in (7), the information processing device is an information processing system characterized in that, when performing a display operation in the first position display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the information processing device stops displaying the position of a virtual object placed at a specific position.

[0081] (10) In the information processing system described in (7), when the information processing device performs a display operation in the first position display mode, if the information processing device is located within a range where the degree of user congestion around the virtual object position exceeds a threshold, the information processing system stops displaying the position of a virtual object placed at a specific position.

[0082] (11) In the information processing system described in (7), when the information processing device performs a display operation in the first position display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the information processing system is characterized in that the virtual object is placed or moved to another position and displayed.

[0083] (12) In the information processing system described in (7), the information processing device is an information processing system characterized in that, when performing a display operation in the second playback display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the information processing device stops playback display of the virtual content corresponding to the virtual object.

[0084] (13) An information processing method in an information processing system including an information processing device that is owned by a user who views virtual objects or plays and reproduces virtual content corresponding to the virtual objects, and that displays the virtual objects and the virtual content, and an operator-side information processing server that collects virtual object information indicating virtual objects placed at specific positions and user congestion information indicating the user congestion level around the virtual objects, the information processing method including the steps of: the information processing device acquiring the virtual object information and the user congestion information from the operator-side information processing server; and the information processing device performing display operations in a first position display mode that displays the placement position of the virtual object and the user congestion level around the virtual object position, and a second playback display mode that plays and displays the virtual content corresponding to the virtual object, based on the acquired virtual object information and user congestion information.

[0085] (14) In the information processing method described in (13), when the information processing device performs a display operation in the first position display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the information processing device stops displaying the position of the virtual object placed at a specific position, or places or moves the virtual object to another position and displays it.

[0086] (15) The information processing method described in (13) is an information processing method having a step in which, when the information processing device performs a display operation in the second playback display mode, if the degree of congestion of users around the virtual object position exceeds a threshold, the information processing device stops the playback display of the virtual content corresponding to the virtual object.

[0087] Furthermore, based on the description of FIG. 10, the following computer, server, system, method, etc. may be provided as an example.

[0088] (1) A computer may be provided that can transmit a virtual object placement plan to a server that manages the virtual object placement plans of multiple virtual object providers or to a provider that operates the server, and that can obtain the virtual object placement plans of the virtual object providers managed by the server from the server or the provider that operates the server via communications.

[0089] (2) A server may be provided that can communicate with computers of different virtual object businesses and manages placement plans for virtual objects transmitted by each virtual object business. Also, a server may be provided that can communicate with computers used by businesses that manage placement plans for virtual objects of different virtual object businesses and manages placement plans for virtual objects of each virtual object business.

[0090] (3) A system may be provided that includes a server that manages the virtual object placement plans of multiple virtual object providers, and a computer to which the virtual object providers transmit their virtual object placement plans, wherein the computer is capable of obtaining the virtual object placement plans of the virtual object providers managed by the server from the server or a provider that operates the server via communication.

[0091] (4) A method may be provided that includes the steps of: a computer of a first virtual object business transmitting a placement plan for a virtual object to a computer of a second virtual object business; the computer of the second virtual object business displaying the placement plan for the transmitted virtual object; and the second virtual object business using the computer determining the placement plan for the virtual object.

[0092] (5) A method may be provided that includes the steps of: a computer of a first virtual object provider transmitting a virtual object placement plan to a server that manages virtual object placement plans of multiple virtual object providers or to a provider that operates the server; a computer of a second virtual object provider acquiring the virtual object placement plan of the first virtual object provider transmitted to the server or to the provider that operates the server; a computer of the second virtual object provider displaying the acquired virtual object placement plan; and a computer of the second virtual object provider transmitting the virtual object placement plan that the second virtual object provider has determined by referring to the display to the server or to the provider that operates the server.

[0093] (6) A method may be provided that includes a step in which a server that manages virtual object placement plans of multiple virtual object providers or a computer of a provider that operates the server acquires the virtual object placement plan of a first virtual object provider via communication, and a step in which the server or the computer of the provider that operates the server transmits the virtual object placement plan of the first virtual object provider to a computer of a second virtual object provider via communication.

[0094] The above-mentioned computers and servers may be, for example, known computers, and may be configured as appropriate using a processor, a storage device, a communication device, an input / output device, etc. The virtual object placement plan includes the placement position, placement period, placement priority, genre, size, etc. of the virtual object. The virtual object placement plan may be information that includes, in addition to the placement position, at least one of the placement period, placement priority, genre, and size of the virtual object.

[0095] The present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with other configurations.

[0096] Furthermore, the numerical values, messages, etc. appearing in the text and figures are merely examples, and the effects of the present invention will not be impaired even if different ones are used.

[0097] The information processing device includes a volatile storage device, and the processor 320 stores appropriate data in the volatile storage device during data processing. The memory 372 of the operator information processing server 370 is configured with a non-volatile storage device or the like. The operator information processing server 370 also includes a volatile storage device, and stores appropriate data in the volatile storage device during data processing.

[0098] Furthermore, the above-described configurations, functions, processing units, processing means, etc. may be partially or entirely implemented in hardware, for example, by designing them as integrated circuits. The above-described configurations, functions, etc. may also be implemented in software, with a processor interpreting and executing a program that implements each function. Information such as the program, table, and file that implements each function may be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD, or may be stored in a device on a communication network.

[0099] In addition, the control lines and information lines shown are those that are considered necessary for the explanation, and do not necessarily show all the control lines and information lines in the product. In reality, it can be assumed that almost all components are interconnected.

[0100] 100: User, 101, 301, 361, 362, 363: Smartphone, 102, 810: Display screen, 121, 122, 123, 124, 125, 126, 127, 128, 131, 132, 141, 142, 402, 403, 404: User, 120, 130, 140, 401: Virtual object, 301: Camera, 302: Distance measurement sensor, 303: GNSS sensor, 304: Acceleration sensor, 305: Gyro sensor, 306: Geomagnetic sensor, 307 : Display device, 308: Operation input interface, 320, 371: Processor, 330, 372: Memory, 341: Vibration generating device, 342: Audio input device, 343: Audio output device, 345, 373: Network communication device, 350, 374: Bus, 370: Operator's information processing server, 380, 1002: External network, 501, 830: Character, 800: HMD, 501, 801: Building, 820: Virtual space, 1001: Server

Claims

1. An information processing device owned by a user and capable of displaying virtual content which is content including virtual objects, wherein the information processing device acquires from a server of an operator used for generating the virtual objects and providing the virtual content, the virtual object information indicating a virtual object placed at a specific position, and user congestion information indicating a degree of congestion of users around the virtual object collected by the server, and the information processing device performs display operations in a first display mode which displays a position display regarding the placement position of the virtual object and a degree of congestion of users around the placement position of the virtual object, and a second display mode which plays and displays the virtual content, based on the acquired virtual object information and user congestion information.

2. An information processing device according to claim 1, characterized in that, when performing a display operation in a first display mode, the information processing device displays the placement position of a virtual object on a map screen, and also displays the degree of user congestion around the virtual object on the map screen.

3. An information processing device according to claim 1, characterized in that, when performing a display operation in a first display mode, the information processing device stops displaying the position of a virtual object placed at a specific position when the degree of congestion of users around the position of the virtual object exceeds a threshold value.

4. An information processing device as described in claim 1, characterized in that, when performing a display operation in a first display mode, the information processing device stops displaying the position of a virtual object placed at a specific position when the information processing device is located within a range in which the degree of congestion of users around the position of the virtual object exceeds a threshold value.

5. An information processing device according to claim 1, characterized in that, when performing a display operation in a first display mode, if the degree of congestion of users around a position where a virtual object is placed exceeds a threshold, the information processing device places the virtual object at a different position and displays the position of the virtual object, or moves the virtual object and displays the position of the virtual object.

6. An information processing device according to claim 1, characterized in that, when performing a display operation in a second display mode, the information processing device stops playback and display of virtual content corresponding to the virtual object when the degree of congestion of users around the placement position of the virtual object exceeds a threshold value.

7. An information processing system comprising: an information processing device owned by a user and capable of displaying virtual content, which is content including virtual objects; and an operator-side information processing server used to generate virtual objects and provide the virtual content, wherein the operator-side information processing server generates virtual object information indicating a virtual object placed at a specific position, and generates user congestion information indicating the user congestion level by collecting user congestion levels around the virtual object, and the information processing device acquires the virtual object information and the user congestion information from the operator-side information processing server, and performs display operations in a first display mode that displays a position display regarding the placement position of the virtual object and the user congestion level around the placement position of the virtual object, and a second display mode that plays and displays the virtual content, based on the acquired virtual object information and user congestion information.

8. An information processing system according to claim 7, characterized in that, when performing a display operation in a first display mode, the information processing device displays the placement position of a virtual object on a map screen, and also displays the degree of user congestion around the virtual object on the map screen.

9. An information processing system according to claim 7, characterized in that, when performing a display operation in a first display mode, the information processing device stops displaying the position of a virtual object placed at a specific position if the degree of congestion of users around the position of the virtual object exceeds a threshold value.

10. An information processing system as described in claim 7, characterized in that, when performing a display operation in a first display mode, the information processing device stops displaying the position of a virtual object placed at a specific position when the information processing device is located within a range in which the degree of congestion of users around the position of the virtual object exceeds a threshold value.

11. An information processing system as described in claim 7, characterized in that, when performing a display operation in a first display mode, if the degree of congestion of users around the placement position of a virtual object exceeds a threshold, the information processing device places the virtual object at a different position and displays the position of the virtual object, or moves the virtual object and displays the position of the virtual object.

12. An information processing system as described in claim 7, characterized in that, when performing a display operation in a second display mode, the information processing device stops playback and display of virtual content corresponding to the virtual object when the degree of congestion of users around the placement position of the virtual object exceeds a threshold value.

13. An information processing method using an information processing device owned by a user and capable of displaying virtual content, which is content including virtual objects, and an operator-side information processing server used to generate virtual objects and provide virtual content, the information processing method comprising the steps of: the operator-side information processing server generating virtual object information indicating a virtual object placed at a specific position, and collecting user congestion information indicating the degree of congestion of users around the virtual object, the information processing device acquiring the virtual object information and the user congestion information from the operator-side information processing server, and the information processing device performing display operations in a first display mode that displays a position display regarding the placement position of the virtual object and the degree of congestion of users around the placement position of the virtual object, and a second display mode that plays and displays the virtual content, based on the acquired virtual object information and user congestion information.

14. An information processing method according to claim 13, characterized in that the information processing device, when performing a display operation in a first display mode, includes a step of, when the degree of congestion of users around the placement position of a virtual object exceeds a threshold, stopping the display of the position of a virtual object placed at a specific position, or placing the virtual object at another position and displaying the position of the virtual object, or moving the virtual object and displaying the position of the virtual object.

15. An information processing method according to claim 13, characterized in that the information processing device, when performing a display operation in a second display mode, includes a step of stopping playback and display of virtual content corresponding to the virtual object when the degree of congestion of users around the placement position of the virtual object exceeds a threshold value.

Citation Information

Patent Citations

  • Information processing device, terminal device, and program

    JP2017170020A

  • Game program, recording medium, and game processing method

    JP2019080747A