Map generation program, map generation system, and map generation method

Abstract

To provide a map generation program, a map generation system, and a map generation method, which can easily generate a map indicating a virtual space corresponding to a real space.SOLUTION: A map generation program for causing a computer to realize: an object data acquisition unit configured to acquire object data relating to a real object based on photographic data obtained by photographing the real object in a real space; and a map generation unit configured to generate, based on the object data, a map indicating a virtual space corresponding to the real space, in which a virtual object corresponding to the real object is arranged at coordinates in the virtual space corresponding to a position of the real object in the real space.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a map generation program, a map generation system, and a map generation method.

Background Art

[0002] Conventionally, a technique of scanning a real space using a sensor to generate a map corresponding to the real space is known.

[0003] For example, in the system described in Patent Document 1, a three-dimensional map is generated based on scan data obtained using an omnidirectional laser rangefinder mounted on a moving body while moving the moving body with a remote control device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0005] However, the system described in Patent Document 1 is premised on acquisition of scan data by the omnidirectional laser rangefinder when generating a map. Therefore, in generation and update of the map, there has been a problem that information acquisition by a moving body equipped with the omnidirectional laser rangefinder is required.

[0006] Accordingly, an object of the present invention is to provide a map generation program, a map generation system, and a map generation method that can easily generate a map representing a virtual space corresponding to a real space.

Means for Solving the Problems

[0007] A map generation program according to one aspect of the present invention enables a computer to implement an object data acquisition unit that acquires object data relating to real objects based on image data of real objects in real space, and a map generation unit that generates a map showing a virtual space that corresponds to real space, in which virtual objects corresponding to real objects are placed at coordinates in the virtual space that correspond to the positions of real objects in real space, based on the object data.

[0008] A map generation system according to one aspect of the present invention comprises: an object data acquisition unit that acquires object data relating to real objects based on image data of real objects in real space; and a map generation unit that generates a map showing a virtual space that corresponds to the real space, in which virtual objects corresponding to real objects are placed at coordinates in the virtual space that correspond to the positions of real objects in real space, based on the object data.

[0009] A map generation method according to one aspect of the present invention involves a computer acquiring object data relating to real objects based on image data of real objects in real space, and generating a map based on the object data that shows a virtual space corresponding to the real space, in which virtual objects corresponding to real objects are placed at coordinates in the virtual space corresponding to the positions of real objects in real space.

[0010] In this invention, "part" does not merely mean a physical means, but also includes cases where the functions of that "part" are realized by software. Furthermore, even if the functions of one "part" or device are realized by two or more physical means, devices, or software modules, the functions of two or more "parts" or devices may be realized by one physical means, device, or software module. [Effects of the Invention]

[0011] According to the present invention, it is possible to provide a map generation program, a map generation system, and a map generation method that can easily generate a map showing a virtual space corresponding to a real space. [Brief explanation of the drawing]

[0012] [Figure 1] This figure shows an overview of the processing in a map generation system 100, which is one embodiment of the present invention. [Figure 2] This diagram shows the configuration of a map generation system 100, which is one embodiment of the present invention. [Figure 3] This figure shows an example of object data stored in the memory unit 111. [Figure 4] This figure shows an example of missing location information stored in the memory unit 111. [Figure 5] This figure shows an example of event registration information stored in the memory unit 111. [Figure 6A] This figure shows an example of real-world event information stored in the memory unit 111. [Figure 6B] This figure shows an example of virtual event information stored in the memory unit 111. [Figure 7] This flowchart shows an example of processing in the map generation system 100. [Figure 8A] This flowchart shows an example of processing in the map generation system 100. [Figure 8B] This flowchart shows an example of processing in the map generation system 100. [Figure 9] This flowchart shows an example of processing in the map generation system 100. [Modes for carrying out the invention]

[0013] A preferred embodiment of the present invention will be described with reference to the attached drawings. Figure 1 is a diagram showing an overview of the processing in a map generation system 100, which is one embodiment of the present invention.

[0014] The map generation system 100 is an information processing system implemented by a map generation program, and is an information processing system that generates a map representing a virtual space corresponding to the real space, based on photographic data obtained by photographing real objects in the real space.

[0015] First, the map generation system 100 acquires photographic data obtained by photographing real objects in the real space (S101). Subsequently, the map generation system 100 acquires object data related to the real objects based on the photographic data. The map generation system 100 generates a map representing a virtual space corresponding to the real space based on the object data (S102).

[0016] Further, the map generation system 100 acquires virtual event information related to events (virtual events) that occur in the virtual space (S103). The map generation system 100 generates reflection information for reflecting the virtual events into the real space, and provides the reflection information to an external information processing system (S104).

[0017] Further, the map generation system 100 acquires real event information related to events (real events) that occur in the real space (S105). Based on the real event information, the map generation system 100 generates reflection information for reflecting the real events into the virtual space, controls the display of the virtual space, and reflects the real events into the virtual space (S106).

[0018] Further, the map generation system 100 accepts, for example, registration of an event in the virtual space from a user (S107). When a predetermined condition is satisfied, the map generation system 100 causes the event to occur in the virtual space, and controls the display of the virtual space corresponding to the registered event (S108).

[0019] Here, the virtual space is not limited to a specific type, and may be, for example, virtual reality, augmented reality, mixed reality, metaverse, or the like.

[0020] Furthermore, although this embodiment describes a 3D map that reflects real space, the map generated by the map generation system 100 may be a 2D map, or it may be a diagram that simplifies and emphasizes to a certain extent the positional relationships or shapes of real objects in real space (for example, a bird's-eye view, a conceptual diagram, etc.).

[0021] Figure 2 shows the configuration of a map generation system 100, which is one embodiment of the present invention. The map generation system 100 is connected to a user terminal 200 and an information processing system 300 via a network such as the Internet. Details of the map generation system 100 will be described later.

[0022] The user terminal 200 is a computer used by users of the map generation system 100, and can be a smartphone, tablet, personal computer, etc.

[0023] Users can provide captured data to the map generation system 100 via the user terminal 200. Users can also register events in the virtual space with the map generation system 100 via the user terminal 200. Furthermore, users can experience the virtual space using the map generated by the map generation system 100 via the user terminal 200.

[0024] The information processing system 300 is an information processing system that operates to reflect virtual events in the real world based on reflection information obtained from the map generation system 100. The information processing system 300 may reflect virtual events in the real world based on the reflection information, or it may provide reflection information to another information processing system that controls the reflection of virtual events in the real world.

[0025] Note that while Figure 2 shows one user terminal 200 and one information processing system 300, the number of user terminals 200 and information processing systems 300 is not limited to these.

[0026] Next, the map generation system 100 will be described in detail. The map generation system 100 includes a storage unit 111, a shooting data acquisition unit 112, an object data acquisition unit 113, a map generation unit 114, a missing location identification unit 121, a missing data request transmission unit 122, an event registration unit 131, an event information acquisition unit 132, a reflection information generation unit 133, a display control unit 134, and a reflection information provision unit 135. Each of the units shown in Figure 2 can be realized, for example, by using a storage area or by having a processor execute a map generation program stored in the storage area.

[0027] The memory unit 111 stores information processed in the map generation system 100. The memory unit 111 can store, for example, the following: shooting data, object data, missing location information, event registration information, real event information, virtual event information, and reflection information.

[0028] The image data acquisition unit 112 acquires image data of real objects in real space and stores it in the memory unit 111.

[0029] Here, a real-world object may be any object existing in real space (e.g., a structure, a sign, plants, a vehicle, a person). The captured data is image or video data of the real-world object.

[0030] Furthermore, the photographic data of a real-world object may be either photographic data intentionally taken with the real-world object as the subject, or photographic data in which the real-world object was accidentally included.

[0031] The captured data may include, for example, information indicating the result of capturing a real object (e.g., pixel information), time information indicating when the real object was captured, and location information indicating where the real object was captured (e.g., information indicating latitude and longitude).

[0032] Furthermore, the shooting data may include information indicating the shooting direction or orientation of the shooting device (e.g., a smartphone or camera) used to photograph the real object, the rotation angle of the shooting device (pan (left and right) or tilt (up and down)), or the shooting altitude of the shooting device (e.g., height from sea level). This allows the map generation unit 114, described later, to generate a more accurate map based on more detailed shooting data.

[0033] The shooting time information may be information indicating the date or time the photo was taken, or it may be information indicating part of the date and time.

[0034] The image data acquisition unit 112 may acquire image data from, for example, the user terminal 200. This allows for the efficient collection of a large amount of current or past image data over a wide area.

[0035] In this case, the provision of photographic data by the user via the user terminal 200 may be a condition for using all or part of the virtual space represented by the map generated by the map generation system 100, and benefits for using the virtual space may be granted in exchange for providing photographic data. That is, for example, only users who provide photographic data may be able to use the map generated by the map generation system 100. This provides an incentive for users to provide photographic data.

[0036] Furthermore, the image data acquisition unit 112 may acquire image data from the information processing system 300. In this case, the image data acquisition unit 112 may acquire image data from a predetermined information processing system where image data is stored (for example, an information processing system that manages and operates an SNS (Social Networking Service)). This makes it possible to efficiently collect a large amount of current or past image data over a wide range of areas.

[0037] Furthermore, the image data acquisition unit 112 may acquire image data from, for example, the information processing system of a business operator (for example, a business operator whose business is to provide image data to the map generation system 100). In this case, the business operator may provide the map generation system 100 with image data collected from other companies (for example, users), or may provide the map generation system 100 with image data that the business operator has taken.

[0038] The object data acquisition unit 113 acquires object data about real-world objects based on the captured data and stores it in the storage unit 111.

[0039] Object data is data used to generate maps that represent virtual spaces corresponding to real-world spaces.

[0040] Object data includes, for example, location information indicating the position where a real object exists in real space (e.g., information indicating latitude and longitude), shape information indicating the shape of the real object that occupies real space (e.g., information indicating length, width, and height), and time information indicating the time corresponding to the object data (e.g., when the real object was photographed).

[0041] The object data acquisition unit 113 can acquire location information, for example, based on the shooting location information included in the shooting data.

[0042] Furthermore, the object data acquisition unit 113 can acquire positional information and shape information by performing image analysis on the captured data. Specifically, if the captured data is of a real object to be processed (target real object) and a real object whose position and shape in real space can be understood and which can serve as a reference for comparison (reference real object), then the positional information and shape information of the target real object can be acquired based on the relative comparison result between the target real object and the reference real object, using the position and shape of the reference real object as a reference.

[0043] More specifically, the reference reality object may be, for example, a structure that can serve as a landmark in real space, or a car or a person. For structures, cars, or people that can serve as landmarks in real space, their approximate location (e.g., latitude and longitude) or shape (e.g., length, width, and height) can be determined. The object data acquisition unit 113 then grasps the shape information of the target reality object based on the relative comparison result between the reference reality object and the target reality object. This allows for the easy generation of a map by analyzing the captured data.

[0044] The relative comparison between the target real-world object and the reference real-world object may be performed based on, for example, the width, depth, or height of the real-world object, the orientation of the real-world object, its altitude or elevation, or the length of its shadow. In this case, the object data acquisition unit 113 may acquire positional information and shape information based on information included in the captured data that indicates the shooting direction or orientation of the shooting terminal (e.g., smartphone or camera) that photographed the real-world object, the rotation angle of the shooting terminal's pan (left / right direction) or tilt (up / down direction), or the shooting altitude of the shooting terminal (e.g., height from sea level).

[0045] Furthermore, the object data acquisition unit 113 can acquire time information, for example, based on the shooting time information included in the shooting data. This allows the object data to retain information indicating when the shooting data that formed the basis of the position information and shape information was taken.

[0046] Furthermore, the object data acquisition unit 113 may acquire time information by performing image analysis on the captured data. Specifically, it may acquire time information by predicting the date and time of capture based on the surrounding real-world object scenery captured in the captured data (for example, the shape of the adjacent building, the degree of deterioration of tiles, the conditions of sunlight, etc.). This allows the object data to retain time information even if the captured data does not contain time information.

[0047] Furthermore, the object data acquisition unit 113 may acquire time information, for example, information indicating the time when the object data was generated. This allows the object data to retain time information even if the captured data does not contain time information.

[0048] Figure 3 shows an example of object data stored in the storage unit 111. The object data stored in the storage unit 111 includes, for example, an object ID, location information, shape information, and time information. Here, the object ID is information that identifies the object data.

[0049] The map generation unit 114 generates a map based on object data that shows a virtual space corresponding to the real space, in which virtual objects corresponding to the real objects are placed at coordinates in the virtual space that correspond to the positions of the real objects in the real space.

[0050] The map generated by the map generation unit 114 represents a virtual space corresponding to the real space. For example, based on all or part of the object data stored in the memory unit 111 (for example, object data of real objects existing within a specific location), the map generation unit 114 generates a map that shows a virtual space in which virtual objects with shapes (e.g., length, width, height) corresponding to real objects are placed at coordinates in the virtual space corresponding to the positions of real objects in the real space.

[0051] A virtual object is an object placed in a virtual space that corresponds to a real-world object. A virtual object may be, for example, an icon or polygon corresponding to a real-world object (for example, a shape corresponding to the shape of a structure), or it may be an object represented by a set of points (point cloud) associated with each coordinate in the virtual space. Here, each point is assigned a color, for example, for each object data or for each coordinate, and the entire point cloud represents the object that corresponds to the real-world object.

[0052] In other words, the virtual space shown by the map may be a virtual space in which icons or polygons (for example, shapes corresponding to the shape of a structure) corresponding to real-world objects are placed at coordinates in the virtual space that correspond to positions in the real world, or it may be a virtual space that virtually displays real-world objects using a set of points (point cloud) associated with each coordinate in the virtual space.

[0053] Furthermore, the map generation unit 114 may generate a map showing a virtual space corresponding to the real space at the time indicated by the time information contained in the object data. That is, the map generation unit 114 may generate a map that displays a virtual space corresponding to the real space during a specific period, based only on object data that contains time information within a specific period.

[0054] Specifically, the map generation unit 114 can generate a map showing a virtual space corresponding to a past real space, based on object data acquired based on photographic data of real objects taken in the past (for example, several decades ago).

[0055] Furthermore, the map generation unit 114 can generate maps based on historical materials such as old maps or illustrations. This allows the map generation system 100 to generate maps that show virtual spaces corresponding to real spaces in past eras (for example, the Edo period).

[0056] Furthermore, the map generation unit 114 may generate confidence information indicating the confidence level of the map generated based on object data, associated with the map. In this case, if the map displays a virtual space based on a point cloud, the confidence information may be associated with each point. In areas where the confidence level indicated by the confidence information is below a certain value, virtual objects may not be displayed. This allows the map generation system 100 to generate only maps with a certain level of confidence based on object data, thereby maintaining the accuracy of the map.

[0057] Furthermore, the reliability information may be generated according to, for example, the completeness of the object data or photographic data used to generate the map (e.g., the number of data points, the completeness of the data based on the angle of capture). In other words, a map generated based on a large amount of photographic data may have high reliability information.

[0058] The missing location identification unit 121 identifies the locations (missing locations) of real-world objects that are missing for map generation in the map generation unit 114, generates missing location information, and stores it in the memory unit 111.

[0059] If there is insufficient shooting data, the map generated by the map generation unit 114 may have some or all of the virtual objects missing from the map. The missing area identification unit 121 identifies the areas where all or part of the virtual objects are missing as missing areas. The missing area identification unit 121 may, for example, identify areas where the reliability information is below a certain value and generate missing area information.

[0060] Here, the missing data information may, for example, be information indicating the shooting location and direction, corresponding to the shooting data necessary to generate a map of the missing data. In other words, based on the shooting data taken from the shooting location and direction, it is expected that the missing data will be resolved.

[0061] Figure 4 shows an example of missing location information stored in the memory unit 111. The missing location information stored in the memory unit 111 includes, for example, object ID, additional shooting location information, and additional shooting direction information.

[0062] The additional shooting location information indicates the location where shooting data will be taken to address any missing areas. This additional shooting location information may be coordinates in a virtual space or a location in real space. Furthermore, it may include information indicating the shooting altitude of the shooting device (for example, height above sea level).

[0063] The additional shooting direction information indicates the direction in which to capture the shooting data needed to fill in any gaps. The additional shooting direction information may be information indicating a direction such as "northeast," or it may be information indicating a predetermined angle such as "45 degrees" (for example, an angle from true north).

[0064] Furthermore, the additional shooting direction information may include information indicating the shooting direction or orientation of the shooting device (e.g., a smartphone or camera) used to photograph real-world objects, or the pan (left-right) or tilt (up-down) rotation angle of the shooting device.

[0065] In this way, missing location information can be combined with additional shooting location information and additional shooting direction information to indicate, for example, that "an image is missing at the location of longitude XX, latitude YY, facing northeast and looking 45 degrees upwards." This allows users to collect the necessary shooting data for map generation based on more specific missing location information.

[0066] The missing data request transmission unit 122 transmits a missing data request to an external information processing system (for example, a user terminal 200 or an information processing system 300) requesting the corresponding image data based on the missing location information.

[0067] The user, via the user terminal 200, takes photographs of real-world objects in response to requests for missing data and provides the corresponding photographic data to the map generation system 100. The map generation unit 114 then generates a new map based on the provided photographic data. This enables the generation of a map for the missing areas.

[0068] Furthermore, users who respond to requests for missing data may be rewarded (for example, with points usable in the real or virtual world). This provides an incentive for users to provide the necessary photographic data for the missing areas.

[0069] In this way, the map generation system 100 can generate a map that accurately reflects real-world objects in a virtual space based on captured data. This allows the map to be used, for example, in autonomous driving of automobiles, drones, or robots where advanced navigation is required during operation; in the creation of hazard maps where accurate information is needed; and in the simulation of traffic and sunlight environments in urban development.

[0070] The event registration unit 131 accepts registration of events in the virtual space that occur according to predetermined conditions, acquires event registration information, and stores it in the storage unit 111. The event registration unit 131 can accept event registration, for example, through user operations via the user terminal 200.

[0071] An event in a virtual space is an occurrence that takes place within that virtual space. The content of an event is not limited to a specific object (e.g., treasure chest, item, advertisement), it could be, for example, the display of a specific object (e.g., treasure chest, item, advertisement), transactions in the virtual space, simulations or training taking place in the virtual space (e.g., disaster simulation, evacuation drill, social experiment), gatherings held in the virtual space (e.g., live performance, conference), events (e.g., festival), or notifications to users (e.g., reminders for personal appointments, reminders for building or equipment inspections or updates). Since a virtual space is a virtual space corresponding to the real world, events that can occur in the real world can also become events in the virtual space.

[0072] In other words, by registering an event, a user can generate an event in the virtual space at a predetermined time.

[0073] Event registration information is information relating to the registration of events in a virtual space that occur according to predetermined conditions, and includes, for example, event content information that shows the content of the event in the virtual space and event condition information that shows the conditions under which the event occurs.

[0074] Event content information is information that indicates the content of an event in the virtual space. That is, if the content of the event is to display a specific object at a specific coordinate, the event content information includes, for example, coordinate information indicating that specific coordinate and control information indicating the control content of the display in the virtual space at that specific coordinate, such as "Display Object A".

[0075] The coordinate information may represent coordinates in real space or coordinates in virtual space.

[0076] Event condition information is information that indicates the conditions under which the event described in the event content information occurs. The conditions indicated by the event condition information may be conditions indicating a specific date and time or weather, or conditions indicating that a specific event has occurred (for example, that another event has occurred, or that a user has passed through a specific coordinate). Furthermore, the conditions indicated by the event condition information may be conditions corresponding to events in the real world (for example, weather in the real world) or conditions corresponding to events in the virtual world (for example, that a user has passed through a specific coordinate in the virtual world).

[0077] Figure 5 shows an example of event registration information stored in the memory unit 111. The event registration information stored in the memory unit 111 includes, for example, an event registration ID, event content information, and event condition information. The event content information includes, for example, coordinate information and control information. The event registration ID is information that identifies the event registration information.

[0078] The event information acquisition unit 132 acquires real event information related to real events, which are events in the real world, and stores it in the memory unit 111. The event information acquisition unit 132 also acquires virtual event information related to virtual events, which are events in the virtual world, and stores it in the memory unit 111.

[0079] A real-world event is an event that occurs in the real world. The content of the event is not limited, but it may include things like the lighting up of structures, the display of advertisements, gatherings (e.g., live performances, conferences), events (e.g., festivals), the operation of devices (e.g., mobile vehicles such as autonomous vehicles or drones, or information terminals) (e.g., movement, sending and receiving information), software processing (e.g., operation of traffic lights, doors, elevators, or escalators), notifications to users, etc. An event may also be a process in an information processing system that performs a predetermined action. Among events that occur in virtual space, those that can be reflected in the real world can become real-world events.

[0080] A virtual event is an event that occurs in a virtual space. The content of the event is not limited, but may include, for example, the display of a specific object (e.g., a treasure chest, an item, an advertisement), transactions in the virtual space, simulations or training that take place in the virtual space (e.g., disaster simulations, evacuation drills, social experiments), gatherings held in the virtual space (e.g., live performances, conferences), events (e.g., festivals), the behavior of objects in the virtual space (e.g., movable objects available in the virtual space or objects used in the virtual space) (e.g., movement or display behavior in the virtual space), and notifications to users (e.g., reminders for personal appointments, reminders for inspections or updates of buildings or equipment). Since the virtual space is a virtual space corresponding to the real space, events that can occur in the real space can become events in the virtual space.

[0081] Virtual event information and real-world event information include, for example, event content information. Event content information includes, for example, coordinate information and control information. The coordinate information may be information indicating a position in real space or information indicating a position in virtual space.

[0082] Furthermore, the virtual event information may be virtual event information relating to an event registered as event registration information, or it may be virtual event information relating to an event that is not registered as event registration information. In other words, the event information acquisition unit 132 may acquire virtual event information in response to the occurrence of an event registered as event registration information, or it may acquire virtual event information in response to the occurrence of an event unrelated to event registration.

[0083] Figure 6A shows an example of real event information stored in the memory unit 111. Figure 6B shows an example of virtual event information stored in the memory unit 111.

[0084] Real-world event information includes, for example, a real-world event ID and event content information. Event content information includes, for example, coordinate information and control information. The real-world event ID is information that identifies the real-world event information.

[0085] Virtual event information includes, for example, a virtual event ID and event content information. Event content information includes, for example, coordinate information and control information. The virtual event ID is information that identifies the virtual event information.

[0086] The reflection information generation unit 133 generates virtual reflection information based on real event information to reflect real events in the virtual space and stores it in the storage unit 111. The reflection information generation unit 133 also generates real reflection information based on virtual event information to reflect virtual events in the real space corresponding to the virtual space.

[0087] Virtual reflection information is information used to reflect real-world events in a virtual space. If the real-world event is, for example, "the passage of a portable shrine," the virtual reflection information may be information used to display a virtual object corresponding to the portable shrine at coordinates in the virtual space that correspond to its location in the real world.

[0088] Reality-reflecting information is information used to reflect a virtual event in the real world. If the virtual event is, for example, "to light up Tower A in red," then the reality-reflecting information may be information used to light up Tower A in red in the real world. In other words, the reality-reflecting information may be information that requests the information processing system 300, which controls the lighting of Tower A, to light up in red.

[0089] Furthermore, if the virtual event is, for example, a "live performance by a singer," the reality-reflecting information may be information that requests the information processing system 300, which controls the display on monitors at the live venue in the real space, to display live video from the virtual space on those monitors.

[0090] The display control unit 134 controls the display of the virtual space corresponding to the event indicated by the event content information when the predetermined conditions indicated by the event condition information are met, based on the event registration information.

[0091] Furthermore, the display control unit 134 controls the display of the virtual space based on the virtual reflection information and reflects real-world events in the virtual space.

[0092] The display control unit 134 controls the display of the virtual space corresponding to the registered event or real event by, for example, performing the control indicated by the control information on the coordinates in the virtual space indicated by the coordinate information, based on the coordinate information and control information included in the event registration information or virtual reflection information.

[0093] In other words, if the event registration information is for the condition "rainy day" and "display object A at a specific coordinate P", the display control unit 134 displays object A at coordinate P in the virtual space in accordance with whether the condition "rainy day" has been met (for example, whether the amount of rainfall is above a certain value).

[0094] Furthermore, if the virtual reflection information is "light up Tower A in red," the display control unit 134 controls the display of Tower A in the virtual space to light up Tower A in red.

[0095] The reflection information provision unit 135 provides the reality reflection information to the information processing system 300.

[0096] The information processing system 300 executes events in the real world in response to virtual events based on reality-reflecting information. Specifically, if the reality-reflecting information is "light up Tower A in red," then, for example, the information processing system 300 that controls the lighting of Tower A will perform the action of turning the lighting of Tower A red based on the reality-reflecting information.

[0097] Furthermore, the information processing system 300 may provide reality-reflecting information to another information processing system (for example, another information processing system that controls the lighting of Tower A).

[0098] In this way, the map generation system 100 can reflect real-world events and virtual events in the virtual space and the real space, respectively. This makes it possible to incorporate the real space and its changes into a virtual reality (VR) or metaverse space, for example, and to generate a more realistic virtual reality (VR) or metaverse space.

[0099] Figure 7 is a flowchart illustrating an example of processing in the map generation system 100.

[0100] First, the image data acquisition unit 112 acquires image data of real-world objects (S701). The object data acquisition unit 113 acquires object data based on the image data (S702). The map generation unit 114 generates a map showing a virtual space corresponding to the real space based on the object data (S703).

[0101] Figures 8A and 8B are flowcharts illustrating examples of processing in the map generation system 100. Figure 8A is a flowchart illustrating an example of the processing for reflecting virtual events in the map generation system 100. Figure 8B is a flowchart illustrating an example of the processing for reflecting real events in the map generation system 100.

[0102] First, the event information acquisition unit 132 acquires virtual event information or real event information (S801a, S801b). Next, the reflection information generation unit 133 generates real reflection information or virtual reflection information based on the virtual event information or real event information, respectively (S802a, S802b). Then, the reflection information provision unit 135 provides the real reflection information to the information processing system 300 (S803a). In addition, the display control unit 134 controls the display of the virtual space corresponding to the event based on the virtual reflection information (S803b).

[0103] Figure 9 is a flowchart illustrating an example of processing in the map generation system 100. Figure 9 is a flowchart illustrating an example of processing related to registered events in the map generation system 100.

[0104] First, the event registration unit 131 receives registration of events in the virtual space that occur according to predetermined conditions, for example from a user terminal 200, and acquires event registration information (S901). Subsequently, the display control unit 134 controls the display of the virtual space corresponding to the event when the predetermined conditions indicated by the event registration information are met (S902).

[0105] One embodiment of the present invention has been described above. The map generation system 100 can generate a map showing a virtual space in which virtual objects corresponding to real objects are placed at coordinates in the virtual space corresponding to the positions of real objects in real space, based on object data corresponding to image data of real objects. This makes it possible to easily generate a virtual space corresponding to the real space based on image data.

[0106] Furthermore, the map generation system 100 can send a request for missing data to an external information processing system (e.g., a user terminal 200 or an information processing system 300) based on missing location information regarding the locations of real-world objects that are missing for map generation. This allows for the efficient acquisition of missing data for map generation from an external information processing system, and enables the simple generation of a virtual space corresponding to the real space.

[0107] Furthermore, the map generation system 100 can generate a map that shows a virtual space corresponding to the real space at the time indicated by the time information of the object data. This allows the user to experience, for example, a virtual space corresponding to the real space in the past.

[0108] Furthermore, the map generation system 100 can generate real-world reflection information based on virtual event information to reflect virtual events in the real world, and provide this real-world reflection information to an external information processing system. This makes it possible to reflect events that occur in the virtual world in the real world, thereby linking the virtual world and the real world.

[0109] Furthermore, the map generation system 100 can generate virtual reflection information based on real-world event information to reflect real-world events in the virtual space, and can control the display of the virtual space based on the virtual reflection information. This makes it possible to reflect events that occur in the real space in the virtual space, and to link the virtual space and the real space.

[0110] Furthermore, the map generation system 100 accepts event registrations in the virtual space, acquires event registration information, and, based on the event registration information, can control the display of the virtual space corresponding to the event when predetermined conditions are met. This allows the user to control the display of the virtual space according to conditions set by the user.

[0111] This embodiment is provided to facilitate understanding of the present invention and is not intended to limit its interpretation. The present invention may be modified or improved without departing from its spirit, and equivalents thereof are also included. [Explanation of Symbols]

[0112] 100 Map generation system, 111 Storage unit, 112 Image data acquisition unit, 113 Object data acquisition unit, 114 Map generation unit, 121 Missing location identification unit, 122 Missing data request transmission unit, 131 Event registration unit, 132 Event information acquisition unit, 133 Reflection information generation unit, 134 Display control unit, 135 Reflection information provision unit, 200 User terminal, 300 Information processing system

Claims

1. On the computer, A shooting data acquisition unit that acquires shooting data of real objects in real space from an information processing device having a shooting function, An object data acquisition unit acquires object data relating to the real object based on the aforementioned shooting data, A map generation unit generates a map showing a virtual space corresponding to the real space, where virtual objects corresponding to the real objects are placed at coordinates in the virtual space corresponding to the positions of the real objects in the real space, based on the object data. An event registration unit that accepts registrations of events in the virtual space that occur according to predetermined conditions and acquires event registration information, Based on the event registration information, a display control unit controls the display of the virtual space corresponding to the event when the predetermined conditions are met, A map generation program that makes this possible.

2. To the aforementioned computer, A missing location identification unit identifies the locations of the real-world objects that are missing for map generation in the map generation unit and generates information about the missing locations, A missing data request transmission unit transmits a missing data request to an external information processing system, which requests the corresponding image data based on the missing location information. A map generation program according to claim 1 that further realizes this.

3. The object data includes time information regarding the time when the real object was photographed. The map generation unit generates the map that shows the virtual space corresponding to the real space at the time indicated by the time information. The map generation program according to claim 1.

4. To the aforementioned computer, A virtual event acquisition unit that acquires virtual event information relating to a virtual event, which is an event in the aforementioned virtual space, A reflection information generation unit generates real-world reflection information to reflect the virtual event in the real space corresponding to the virtual space, based on the virtual event information. A reflection information provision unit that provides the aforementioned reality reflection information to an external information processing system, A map generation program according to any one of claims 1 to 3, which further realizes the above.

5. To the aforementioned computer, A real event acquisition unit that acquires real event information relating to a real event, which is an event in the aforementioned real space, A reflection information generation unit generates virtual reflection information to reflect the real event in the virtual space corresponding to the real space, based on the real event information. To further realize this, The display control unit controls the display of the virtual space based on the virtual reflection information. A map generation program according to any one of claims 1 to 3.

6. A shooting data acquisition unit that acquires shooting data of real objects in real space from an information processing device having a shooting function, An object data acquisition unit acquires object data relating to the real object based on the aforementioned shooting data, A map generation unit generates a map showing a virtual space corresponding to the real space, where virtual objects corresponding to the real objects are placed at coordinates in the virtual space corresponding to the positions of the real objects in the real space, based on the object data. An event registration unit that accepts registrations of events in the virtual space that occur according to predetermined conditions and acquires event registration information, Based on the event registration information, a display control unit controls the display of the virtual space corresponding to the event when the predetermined conditions are met, A map generation system equipped with the following features.

7. Computers An information processing device with a shooting function acquires shooting data of real objects in real space. Based on the aforementioned shooting data, object data relating to the real object is obtained, Based on the object data, a map is generated showing the virtual space corresponding to the real space, in which virtual objects corresponding to the real objects are placed at coordinates in the virtual space corresponding to the positions of the real objects in the real space. The system accepts registrations of events in the virtual space that occur according to predetermined conditions, and obtains event registration information. Based on the event registration information, if the predetermined conditions are met, control is performed to control the display of the virtual space corresponding to the event. Map generation method.

Images