Information processing system and program

Abstract

To efficiently edit managed data corresponding to the change of the state of a space accompanied with the layout change or extension / reconstruction of a room.SOLUTION: A display control unit that displays a first reception screen for receiving an instruction to create a new event using an existing event associated with one or a plurality of pieces of spatial information, in which the display control unit displays the first reception screen including a first reception area for receiving an instruction to associate existing spatial information associated with the existing event with the new event, and a second reception area for receiving designation of spatial information to be associated with the new event among the existing spatial information or new spatial information not yet associated with an event.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] In recent years, it has become common to acquire 3D information of real 3D space using laser scanners, LiDAR (Light Detection and Ranging), etc. Furthermore, by referencing spatial information that has been converted into digital data (spatial information), it is possible to grasp the situation on-site without being present, and to link it with existing management information for use.

[0003] Patent Document 1 discloses a technology for a management data acquisition system for indoor use in a building, in which coordinate information and a wireframe model of the indoor space and panoramic image data captured by an imaging device are stored in association with each other, along with the date and time of the image capture and information identifying the building. Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional technology does not take into consideration efficient editing of managed data in response to changes in the state of the space due to changes in the interior layout or extensions and renovations.

[0005] The present invention has been made in consideration of the above, and aims to efficiently edit managed data in response to changes in the state of space due to changes in the interior layout, extensions, renovations, etc. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the present invention provides a display control unit that displays a first reception screen that accepts instructions to create a new event using an existing event to which one or more pieces of spatial information are associated, and the display control unit displays the first reception screen that includes a first reception area that accepts instructions to associate existing spatial information associated with the existing event with the new event, and a second reception area that accepts designation of spatial information to be associated with the new event from the existing spatial information or new spatial information not yet associated with an event. [Effects of the Invention]

[0007] According to the present invention, it is possible to efficiently edit managed data in response to changes in the state of a space due to changes in the interior layout or extensions and renovations. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing system according to a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a functional configuration of the control unit. [Figure 3] FIG. 3 is a diagram showing an example of a display screen of a management application that manages spatial information. [Figure 4] FIG. 4 is a diagram showing an example of association between spatial information and events. [Figure 5] FIG. 5 is a diagram showing an example of a table in which associations between spatial information and events are recorded. [Figure 6] FIG. 6 is a diagram showing an example of an event creation screen for creating a new event. [Figure 7] FIG. 7 is a diagram showing an example of a screen displaying a newly created event. [Figure 8] FIG. 8 is a diagram showing another example of the event creation screen for creating a new event. [Figure 9]FIG. 9 is a diagram showing an example of a timeline and a space information list before and after an existing event is changed. [Figure 10] FIG. 10 is a diagram showing an example of an event change screen for changing an existing event. [Figure 11] FIG. 11 is a diagram showing an example of a viewer screen displayed by the management application. [Figure 12] FIG. 12 is a diagram showing an example of an arbitrary viewpoint view in which a selected office area is viewed from a specific viewpoint. [Figure 13] FIG. 13 is a diagram showing an example of an arbitrary viewpoint map including existing shooting position marks and added shooting position marks. [Figure 14] FIG. 14 is a diagram showing an example of an arbitrary viewpoint view in which only the added shooting position marks are displayed. [Figure 15] FIG. 15 is a diagram showing an example of a display screen including a timeline screen and a viewer screen. [Figure 16] FIG. 16 is a diagram showing another example of a display screen including a timeline screen and a viewer screen. [Figure 17] FIG. 17 is a flowchart illustrating an example of a processing procedure for editing an event according to the first embodiment. [Figure 18] FIG. 18 is a diagram illustrating an example of an event creation screen according to the second embodiment. [Figure 19] FIG. 19 is a flowchart illustrating an example of a processing procedure for editing an event according to the second embodiment. [Figure 20] FIG. 20 is a diagram illustrating an example of a functional configuration of a processing unit according to the third embodiment. [Figure 21] FIG. 21 is a diagram illustrating an example of a timeline screen according to the third embodiment. [Figure 22] FIG. 22 is a flowchart illustrating an example of a procedure for automatically editing an event according to the third embodiment. [Figure 23] FIG. 23 is a schematic diagram illustrating an example of an information processing system according to the fourth embodiment. [Figure 24]FIG. 24 is a diagram illustrating an example of a hardware configuration of an information processing device and a server device according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of an information processing system and a program will be described in detail with reference to the accompanying drawings.

[0010] (First embodiment) FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing system 1 according to the first embodiment.

[0011] The information processing system 1 includes an information processing device 10 and a storage device 11. The information processing device 10 and the storage device 11 are connected to each other so as to be able to communicate with each other.

[0012] The storage device 11 is a device that accumulates spatial information of a three-dimensional space (sometimes simply referred to as "space"), which is a real space. Spatial information is information that represents a space. Spatial information includes two-dimensional information, three-dimensional information, and information that combines two-dimensional information and three-dimensional information. The two-dimensional information is information acquired by, for example, capturing an image of a real space with a camera or the like. The three-dimensional information is information acquired by, for example, a ToF (Time-of-Flight) camera, a stereo camera, or the like. The ToF method is a method of irradiating an object with infrared light and calculating distance from the time it takes for the reflected light to return. A stereo camera is a camera that acquires depth information as distance information using the distance between two cameras and parallax information of the images acquired by each of the two cameras. Note that the three-dimensional information may be acquired by other methods, such as a system using LiDAR (Light Detection and Ranging) or photogrammetry.

[0013] The file format of the spatial information is not limited. The spatial information is represented, for example, by shape data (3D shape data) that represents the 3D shape of a 3D object contained in real space. The shape data is, for example, a point cloud file that represents 3D space with discrete points, or a polygon mesh file that represents 3D space with vertices and surfaces. A point cloud file may be referred to as a depth map, distance image, or the like. Shape data acquired by different devices or different distance measurement methods may be mixed. Furthermore, the 2D information that is spatial information may be, for example, a luminance image, and may be a spherical image with a wide angle of view (for example, 180 degrees or more) or an image with a narrow angle. Furthermore, the spatial information may include image information, point cloud information, polygon mesh information, and metadata that is explanatory information such as their positional relationship and overview.

[0014] Examples of point cloud files include files with extensions such as ".xyz", ".e57", and ".ply". Examples of polygon mesh files include files with extensions such as ".obj", ".fbx", and ".stl".

[0015] The storage device 11 outputs the accumulated spatial information to the information processing device 10.

[0016] The information processing device 10 is a device that displays a two-dimensional image obtained by viewing a three-dimensional space represented by spatial information from a virtual viewpoint of a virtual camera. The information processing device 10 is, for example, a smartphone, a tablet terminal, a personal computer, or the like.

[0017] The information processing device 10 includes a communication unit 12, a UI (user interface) unit 14, a control unit 20, a ROM (read only memory) 22, a RAM (random access memory) 24, and an HDD (hard disk drive) 26. These units are connected to each other via a bus 30 so as to be able to communicate with each other.

[0018] The communication unit 12 communicates with an external device via a network, etc. In this embodiment, the communication unit 12 communicates with the storage device 11.

[0019] The UI unit 14 includes a display unit 14A and an input unit 14B. The display unit 14A is a display that displays various types of information. The input unit 14B accepts operation instructions and input data from the user. The user inputs, for example, a user ID (Identification) and information related to the spatial information to be displayed (such as the name of a building). The input unit 14B is, for example, a keyboard, a pointing device, a mouse, etc. The display unit 14A and the input unit 14B may be an integrated touch panel.

[0020] The ROM 22, RAM 24, and HDD 26 are storage units of the information processing device 10 that store various types of information. The spatial information output from the storage device 11 may be stored in these storage units. Note that an SSD (Solid State Drive) may be used as the storage unit of the information processing device 10.

[0021] The control unit 20 manages spatial information as described below. The operation of the control unit 20 is realized by, for example, one or more processors. For example, the operation of the control unit 20 may be realized by having a processor such as a CPU (Central Processing Unit) execute a program, i.e., by software. Each of the above units may be realized by a processor such as a dedicated IC (Integrated Circuit), i.e., by hardware. Each of the above units may be realized by a combination of software and hardware. When multiple processors are used, each processor may realize one of the units, or may realize two or more of the units.

[0022] 2 is a diagram showing an example of the functional configuration of the control unit 20. The control unit 20 includes a reception unit 20A, a processing unit 20B, a display data generation unit 20C, and a display control unit 20D.

[0023] The reception unit 20A receives operation instructions and input data from the user to the input unit 14B. The operation instructions from the user include an instruction to create a new event or an instruction to change an existing event. The definition and details of events will be described later.

[0024] The processing unit 20B performs processes such as creating a new event and modifying an existing event.

[0025] The display data generation unit 20C generates display data to be displayed on the display unit 14A. The display data generation unit 20C generates a screen or an area within the screen on which a user can give operational instructions to a management application (described later), two-dimensional information for viewing spatial information in the management application, and the like. The display data generation unit 20C may also convert spatial information acquired from the storage device 11 into an arbitrary file format and then output the converted spatial information to the display control unit 20D. For example, the display data generation unit 20C may convert a point cloud format file into a polygon mesh format file using the method disclosed in Japanese Patent Application Laid-Open No. 2019-049533, and output the converted spatial information to the display control unit 20D.

[0026] The display control unit 20D displays the display data generated by the display data generation unit 20C on the display unit 14A.

[0027] Fig. 3 is a diagram showing an example of a display screen of a management application that manages spatial information. Fig. 3(a) shows an example of a list of projects displayed on a display screen 100. A project is a unit for managing space, as will be described later. Fig. 3(b) shows an example of a list of spatial information and a timeline, as will be described later, displayed on the display screen 100. The management application runs on a PC (Personal Computer) or a mobile terminal such as a smartphone or tablet, and may be a standalone application that is installed and used, or a web application that is used in a web browser.

[0028] In this embodiment, a unit for managing a space such as a building or a site is called a project. The space managed by one project varies depending on its purpose of use, and may be, for example, one floor of a building, the entire interior of a building, or the entire site including multiple buildings. Therefore, the size of the space managed by a project varies depending on its purpose of use. Note that a user can also create and manage multiple projects. For example, a user can manage multiple buildings and create and manage a project for each building.

[0029] In this embodiment, a set associated with spatial information is called an event. An event is generated by associating spatial information as described below. Spatial information may be divided into multiple pieces for each space (for example, by room), and the spatial information for each space may be further divided into multiple files. For example, a user can add a new event to a project at a new time when the state of the space changes. Examples of times when the state of the space changes include milestones such as after the completion of a building or before and after renovations, or times of daily changes such as large-scale cleaning or the introduction of equipment. Note that spatial information that is already associated with an event may be called "existing spatial information," and spatial information that has not yet been associated with an event may be called "new spatial information."

[0030] In Fig. 3(a), a project list screen 110 is displayed on the display screen 100, and multiple projects are shown on the project list screen 110. For example, the user can select a project by clicking on it using the pointing device of the input unit 14B, and the contents of the project can be displayed as shown in Fig. 3(b). In Fig. 3(b), the contents of Project 02, which manages the spatial information of the "XX Building," are displayed.

[0031] The space information list screen 120 in FIG. 3(b) displays a list of space information registered in the project. The timeline screen 130 displays a sequence (timeline) of events created in the project. The timeline screen 130 displays summary information of the events, such as the event name "Event 1" or "Event 2," the date the event was created, and a description of the event (shown as "xxxx" in the figure). By checking the summary information, the user can easily understand the purpose for which each event was created. The date the event was created may be displayed in hours, minutes, or seconds.

[0032] The spatial information list screen 120 displays the names of the rooms on each floor. In this example, the spatial information is information about a space such as a building or structure consisting of multiple floors, and information about each component (such as each area of ​​each room) is stored as spatial information in the storage device 11. When the user selects an event using the radio buttons on the timeline screen 130, the display control unit 20D displays information indicating the association between the selected event and the spatial information on the spatial information list screen 120. In FIG. 3(b), event 2 is selected on the timeline screen 130, and the spatial information list screen 120 shows that the spatial information of rooms A and C on the first floor and rooms D, E, and F on the second floor is associated with event 2. It also shows that room B on the first floor is not associated with event 2.

[0033] FIG. 4 is a diagram showing an example of association between spatial information and events. As shown in FIG. 4, multiple pieces of spatial information are registered for each room. The multiple pieces of spatial information are, for example, spatial information for different areas in one room. In FIG. 4(a), spatial information A-1 and A-2 for room A, spatial information C-1 and C-2 for room C, and spatial information E-1 and E-2 for room E are associated with event 1. In FIG. 4(b), spatial information A-1 and A-2 for room A, spatial information C-1 and C-2 for room C, spatial information D-1 for room D, spatial information E-1 and E-2 for room E, and spatial information F-1, F-2, F-3, F-4 for room F are associated with event 2. In this way, at least some of the spatial information associated with two events may be common. Note that the spatial information may be associated with an event collectively for each room as shown in FIG. 4, or may be associated with an event separately for each piece of spatial information.

[0034] FIG. 5 is a diagram showing an example of a table in which the association between spatial information and events is recorded. In table T1 in FIG. 5, "x" indicates that spatial information is associated with each event. For example, this indicates that event 1 is associated with spatial information A-1, A-2, C-1, and C-2. The management application stores such table T1 in a storage unit such as the HDD 26. Table T1 may also be stored in the storage device 11.

[0035] The user can additionally register spatial information to a project by pressing an add information button 121 included in the spatial information list screen 120 of FIG. 3(b). The user can additionally register new spatial information for a registered room using the add information button 121. The user can also additionally register a new room using the add information button 121 and add new spatial information to the new room. When additional spatial information is registered using the add information button 121, the additionally registered spatial information may be associated with an event. For example, as shown in FIG. 3(b), event 2 may be changed so that the additionally registered spatial information is associated with event 2 when event 2 is selected on the timeline screen 130. Furthermore, events (events 3 and 4) located above event 2 on the timeline screen 130 may also be changed so that the additionally registered spatial information is associated with these events.

[0036] Furthermore, the user can create a new event by pressing an event creation button 131 included in the timeline screen 130. In this embodiment, as will be described later, it is possible to create a new event from an existing event by duplicating the existing event, or to create a new event.

[0037] Note that spatial information associated with an event and spatial information not associated with an event may be displayed in different display formats. In Fig. 3(b), spatial information associated with an event is displayed with only the name of the room as in display format 122, and spatial information not associated with an event is displayed together with the information "not present in this event" as in display format 123. Note that spatial information not associated with an event may be displayed in a display format that can be visually distinguished from spatial information associated with an event by changing the display color, displaying characters or icons such as an exclamation mark, etc.

[0038] In FIG. 3(b), one spatial information list screen 120 and one timeline screen 130 are displayed on the display screen 100. However, two or more spatial information list screens 120 and two or more timeline screens 130 may be displayed on the display screen 100. This allows, for example, spatial information associated with event 1 and spatial information associated with event 2 to be simultaneously displayed on the display screen 100. Furthermore, when switching the selection of an event on the timeline screen 130 to switch the display of the spatial information list screen 120, for example, spatial information associated with event 1 and spatial information associated with event 2 can be switched and displayed on the display screen 100. This makes it easy to compare multiple events associated with at least some different spatial information. For example, as described below, if event 2 is created by duplicating event 1 and adding new spatial information to it, the spatial information associated with event 1 and the spatial information associated with event 2 will be at least partially common and at least partially different, and such multiple events can also be easily compared.

[0039] Next, the process of creating a new event will be described with reference to Figs. 6 to 8. Fig. 6 is a diagram showing an example of an event creation screen 140 for creating a new event. When the event creation button 131 is pressed, the display control unit 20D causes the display unit 14A to display the event creation screen 140 as shown in Fig. 6(a). At this time, the event creation screen 140 includes an event creation selection area 141 and a confirmation area 142.

[0040] The user can select whether to create a new event by duplicating an existing event or by creating a new event from scratch using the radio buttons in the event creation selection area 141. Here, we first describe an example of creating a new event by inheriting some or all of the information contained in an existing event and integrating it with additional spatial information. This type of case occurs when the 3D shape data of a building is changed only slightly, with only a partial appearance change, or when image data in a specific room is replaced extensively. An example of the former is when some of the equipment in the area is replaced. An example of the latter is when the wallpaper in a room is replaced. Furthermore, a new event may be created from an existing event when both the 3D information and image data for a specific room are replaced, leaving the overall shape of the building unchanged but changing both the 3D shape and appearance of the specific room. For example, this may occur when the layout of some rooms is changed, with desks, chairs, equipment, etc. being moved.

[0041] When a user selects "Create by duplicating an event" in the event creation selection area 141 and presses the "Next" button in the confirmation area 142, the display control unit 20D displays an event creation screen 140 as shown in FIG. 6(b) on the display unit 14A. At this time, the event creation screen 140 includes a duplication event selection area 143, an additional data selection area 144, and a confirmation area 142. The user can select an event and spatial information by checking the checkboxes in each area. In the example of FIG. 6(b), Event 2 is selected as the event to be duplicated in the duplication event selection area 143, and Room B and Room H are selected as the spatial information to be added in the additional data selection area 144. For example, if no spatial information has yet been registered in Room B or Room H, or if new spatial information is available to be registered in Room B or Room H, the user can register the spatial information in Room B or Room H using a file selection screen (not shown). Note that the registration of spatial information to each room is performed, for example, by the user specifying a spatial information file and associating the specified file with each room. This specifies the new spatial information to associate with the new event.

[0042] If the building is large, the user may be able to select an event to be duplicated by specifying a structure within the building. In this case, for example, when the user specifies a structure within the building using a screen (not shown), only events related to the specified structure are listed in the duplication event selection area 143, and the user may select an event to be duplicated from the listed events. In this case, the event list on the timeline screen 130 may be configured to display which structure each event is related to.

[0043] When the user makes a selection as shown in FIG. 6(b) and presses the "Next" button in the confirmation area 142, the display control unit 20D causes the display unit 14A to display an event creation screen 140 as shown in FIG. 6(c). At this time, the event creation screen 140 includes a confirmation area 142 and a handover data selection area 145 for selecting spatial information to be inherited from the event to be copied. The user can select the spatial information to be inherited by checking a checkbox. In the example of FIG. 6(c), the spatial information of rooms A, C, and E is selected as the spatial information to be inherited from event 2. Here, if there is new spatial information that can be newly registered in rooms A, C, and E, the user can register the new spatial information in rooms A, C, and E using a file selection screen (not shown).

[0044] When the user makes a selection as shown in Figure 6(c) and presses the "Next" button in the confirmation area 142, the display control unit 20D displays a spatial information list screen 120 and a timeline screen 130 as shown in Figure 7(a) on the display unit 14A.

[0045] 7A and 7B are diagrams showing an example of a screen displaying a newly created event. Event 5 is displayed as a new event on the timeline screen 130 in FIG. 7A, and spatial information list screen 120 displays spatial information associated with event 5 and spatial information not associated with event 5, as selected by the user. The timeline screen 130 also includes a summary information area 132 and a confirmation area 133. The user can change the summary information of the new event, such as the event name and description, displayed in the summary information area 132 to desired content by operating input unit 14B. The summary information of the new event may be automatically generated by processing unit 20B as an initial value.

[0046] When the user presses the "Confirm" button in the confirmation area 133, the processing unit 20B records the association between the new event 5 and the spatial information in table T1, and the display control unit 20D causes the display unit 14A to display the spatial information list screen 120 and the timeline screen 130 as shown in Fig. 7(b). Note that when the user presses the "Cancel" button in the confirmation area 142 or the confirmation area 133, the processing unit 20B returns the event creation process to the previous process, and the display control unit 20D causes the display unit 14A to display the previous screen.

[0047] As described above, in this embodiment, a new event can be created from an existing event by duplicating the existing event using the management application. The display screen 100 is an example of a display screen. The display screen shows multiple events with associated spatial information. The event creation screen 140 is an example of a first reception screen. The first reception screen accepts an instruction to create a new event using an existing event. The event creation selection area 141 and the duplication event selection area 143 are examples of a first reception area. The first reception area accepts an instruction to associate at least a portion of the existing spatial information associated with the existing event with the new event by selecting an existing event to use in creating the new event. The first reception area does not necessarily have to include both the event creation selection area 141 and the duplication event selection area 143. For example, an instruction to associate at least a portion of the existing spatial information with the new event can also be accepted by selecting an existing event to use in creating the new event in the duplication event selection area 143. The additional data selection area 144 is an example of a second reception area. The second reception area accepts the designation of new spatial information to be associated with the new event. The second reception area is not limited to the additional data selection area 144, but may also include an area for designating a file of spatial information to be added to the target designated in the additional data selection area 144. The "designation of new spatial information" is not limited to designating a room in which spatial information is to be registered, but may be performed, for example, by designating a file to be registered as spatial information. The takeover data selection area 145 is an example of a third reception area. The third reception area accepts the designation of existing spatial information to be associated with the new event or existing spatial information not to be associated with the new event. The "designation of existing spatial information" is not limited to designating a room in which spatial information has already been registered, but may be performed, for example, by designating a file registered as spatial information. The takeover data selection area 145 is not necessarily provided. For example, all spatial information of the existing event selected in the duplication event selection area 143 that has not been selected as new spatial information in the additional data selection area 144 may be automatically transferred to the new event.

[0048] 8 is a diagram showing another example of the event creation screen 140 for creating a new event. Here, an example will be described in which a new event is created using only additional spatial information. An event created using this method does not inherit data from existing events, but is composed only of the added data. This method can be used, for example, in cases such as large-scale renovation work in which 3D shape data and omnidirectional images of the entire building are comprehensively reacquired.

[0049] When a user selects "Create New" in the event creation selection area 141 and presses the "Next" button in the confirmation area 142, as shown in FIG. 8(a), the display control unit 20D causes the display unit 14A to display an event creation screen 140, as shown in FIG. 8(b) or 8(c). At this time, the event creation screen 140 includes an additional data selection area 146 and a confirmation area 142. In the examples of FIGS. 8(b) and 8(c), the spatial information of rooms A, B, C, and E is selected as the spatial information to be added. In the example of FIG. 8(b), the user can select the spatial information to be added by entering the spatial information to be added in text within the dashed rectangle in the additional data selection area 146. In the example of FIG. 8(c), the user selects the spatial information to be added by checking the checkbox in the additional data selection area 146. In this example, the spatial information of rooms A, B, C, and E is selected as the spatial information to be added. Here, if spatial information has not yet been registered for rooms A, B, C, and E, or if there is new spatial information that can be registered, the user can register new spatial information for rooms A, B, C, and E using a file selection screen not shown.

[0050] 8(b) or 8(c) and presses the "Next" button in the confirmation area 142, the display control unit 20D causes the display unit 14A to display a screen similar to that shown in Fig. 7(a). Then, when the user presses the "Confirm" button in the confirmation area 133 of the timeline screen 130, the processing unit 20B records the association between the new event 5 and the spatial information in table T1, and the display control unit 20D causes the display unit 14A to display the display screen 100 shown in Fig. 7(b).

[0051] In this manner, in this embodiment, a new event can be created using the management application without duplicating an existing event.

[0052] Next, a process for modifying an existing event will be described with reference to Figures 9 and 10. This process involves adding spatial information to an existing event and overwriting it. This method can be used, for example, when you want to add spatial information that was not captured when the event was created, or spatial information that was captured after the event was created. This type of process is used when, for example, it was not possible to capture the event when it was created, but it becomes possible to capture it at a later date, and there is no need to manage it separately as a different event.

[0053] 9A and 9B are diagrams showing an example of a timeline and a spatial information list before and after changing an existing event. FIG. 9A shows the display screen 100 before the event is changed. Here, event 4 is selected on the timeline screen 130, and the association between event 4 and the spatial information is displayed on the spatial information list screen 120. The event edit selection area 135 in FIG. 9A is displayed, for example, by the user operating a pointing device on the timeline screen 130. Specifically, when event 4 is selected and the user clicks near the area displaying "event 4," the display control unit 20D displays the event edit selection area 135.

[0054] FIG. 10 is a diagram showing an example of an event change screen 150 for changing an existing event. When the "Add spatial information" button is pressed in the event edit selection area 135, the display control unit 20D causes the display unit 14A to display an event change screen 150 as shown in Fig. 10. When the "Delete event" button is pressed in the event edit selection area 135, the display control unit 20D displays, for example, a deletion confirmation button (not shown), and when the confirmation button is pressed, event 4 is deleted. The "Add spatial information" button in the event edit selection area 135 may be a button displayed as "Add shooting data."

[0055] As shown in FIGS. 10(a) and 10(b), the event modification screen 150 includes an additional data selection area 151 and a confirmation area 152. In the examples of FIGS. 10(a) and 10(b), the spatial information of rooms C, G, and H is selected as the spatial information to be added. In the example of FIG. 10(a), the user can select the spatial information to be added by entering the spatial information to be added in text within the dashed rectangle in the additional data selection area 151. In the example of FIG. 10(b), the user selects the spatial information to be added by checking the checkbox in the additional data selection area 151. Note that an existing event may be modified so that existing or new spatial information can be added, and existing spatial information can be deleted using the data selection area 153, as shown in FIG. 10(c). In the example of FIG. 10(c), the user has selected to add the spatial information of room C to event 4 and to delete the spatial information of rooms A and E from event 4.

[0056] When the user selects as shown in Figure 10(a) or (b) and presses the "Next" button in the confirmation area 152, and then presses the "Confirm" button similar to that in the confirmation area 133 of Figure 7(a), the processing unit 20B records the association between the changed event 4 and the spatial information in table T1, and the display control unit 20D displays the display screen 100 as shown in Figure 9(b) on the display unit 14A.

[0057] In this manner, in this embodiment, the association between an existing event and spatial information can be changed using the management application. The event change screen 150 is an example of a second reception screen. The second reception screen accepts an instruction to change an existing event. The additional data selection area 151 is an example of a fourth reception area. The fourth reception area accepts the designation of additional spatial information to be added as an association to an existing event.

[0058] Next, the viewer function of the management application will be described with reference to FIGS. 11 to 16. FIG. 11 is a diagram showing an example of a viewer screen 160 displayed by the management application. In this example, spatial information of the work area of ​​Room F is selected, and its overhead view is displayed on the viewer screen 160. FIG. 12 is a diagram showing an example of an arbitrary viewpoint view of the selected work area viewed from a specific viewpoint. This arbitrary viewpoint view is, for example, a two-dimensional image generated by projecting spatial information of a celestial sphere image captured from a specific viewpoint in a specific direction. The user can view the selected spatial information by switching between such an overhead view and an arbitrary viewpoint view displayed on the viewer screen 160. The user can also change the angle of the overhead view or the viewpoint or angle of the arbitrary viewpoint view to check the contents of the component from various angles and viewpoints.

[0059] The user can display other spatial information photographed at the position of the shooting position mark 161 by clicking the shooting position mark 161 displayed on the arbitrary viewpoint map using a pointing device or the like. In this way, in order to link multiple pieces of spatial information and display the shooting position mark 161, the positional relationship between the pieces of spatial information must be clear. This linking method may use a metadata file containing information on the positional relationship between the pieces of spatial information, or may use a method in which the processing unit 20B analyzes the spatial information and automatically estimates the positional relationship.

[0060] When a new event is created from an existing event, the existing shooting position mark 161 indicating the spatial information inherited from the existing event and the added shooting position mark 162 indicating the spatial information added to the new event may be displayed in different display formats. For example, if the shooting positions corresponding to these pieces of spatial information are close to each other, the shooting position marks 161 may be displayed closely together on the viewer screen 160, resulting in a cluttered display and making it difficult to select marks. To address this issue, in this embodiment, the display control unit 20D may display the added shooting position mark 162 in an inverted color. FIG. 13 is a diagram showing an example of an arbitrary viewpoint view including the existing shooting position mark 161 and the added shooting position mark 162. In FIG. 13, the existing shooting position mark 161 and the added shooting position mark 162 are displayed in different colors.

[0061] To alleviate the above-mentioned problem, the viewer screen 160 may temporarily hide either the existing shooting position mark 161 or the added shooting position mark 162 so that the updated portion can be confirmed. Fig. 14 is a diagram showing an example of an arbitrary viewpoint view in which only the added shooting position mark 162 is displayed. For example, when viewing a new event, the display control unit 20D may switch between displaying the viewer screen 160 that displays only the existing shooting position mark 161 as shown in Fig. 12 and displaying only the new shooting position mark 162 as shown in Fig. 14.

[0062] The viewer screen 160 may have a function that enables spatial information associated with an event to be individually deleted by selecting the shooting position mark 161 or 162. Furthermore, when a new event is created from an existing event, the processing unit 20B may compare the similarity between the existing spatial information and the new spatial information, and if the similarity is high, delete the existing spatial information and replace it with the new spatial information. The replacement process may be performed automatically, but may also be performed with a procedure for the user to confirm the process to prevent it from being performed erroneously. Here, the similarity of the spatial information may be, for example, that the distance between corresponding positions is equal to or less than a predetermined value when the spatial information is a spherical image, or that an index indicating the similarity of the shape is equal to or less than a predetermined value when the spatial information is three-dimensional shape data.

[0063] Fig. 15 is a diagram showing an example of the display screen 100 including the timeline screen 130 and the viewer screen 160. The display control unit 20D can display the timeline screen 130 together with the viewer screen 160 on the display screen 100, as shown in Fig. 15, and can display arbitrary viewpoint views of the same room while switching between events. In this example, an arbitrary viewpoint view of room C is displayed on the viewer screen 160 of the display screen 100, and the timeline screen 130 is also displayed at the same time.

[0064] 15(a), event 2 is selected on the timeline screen 130, and the spatial information of room C associated with event 2 is displayed on the viewer screen 160. Since the spatial information displayed on the viewer screen 160 is also associated with event 1, the message "Same data" is displayed where event 1 is displayed on the timeline screen 130. Furthermore, since the spatial information of room C is not associated with event 4, the display of event 4 on the timeline screen 130 is grayed out and cannot be selected.

[0065] Fig. 15(b) shows an example of the display screen 100 that is displayed after selecting event 3 in Fig. 15(a). Since the spatial information displayed in Fig. 15(a) is not associated with event 3, among the spatial information of room C associated with event 3, spatial information of a viewpoint close to the spatial information displayed in Fig. 15(a) is displayed on the viewer screen 160. The angle at which the arbitrary viewpoint view is displayed (the projection direction of the omnidirectional image) is the same as that in Fig. 15(a).

[0066] Fig. 16 is a diagram showing another example of the display screen 100 including the timeline screen 130 and the viewer screen 160. In Fig. 15, event 4 is grayed out on the timeline screen 130, but as shown in Fig. 16, it may be possible to make it selectable without being grayed out. In Fig. 16(a), event 2 is selected on the timeline screen 130, and the spatial information of room C associated with event 2 is displayed on the viewer screen 160. Because the spatial information of room C is not associated with event 4, "! No data" is displayed in the location where event 4 is displayed on the timeline screen 130.

[0067] 16(b) shows an example of the display screen 100 that is displayed after selecting event 4 in FIG. 16(a). Here, the spatial information selected by the processing unit 20B from the spatial information associated with event 4 is displayed on the viewer screen 160. The processing unit 20B can select, for example, spatial information of a viewpoint closest to the viewpoint of the spatial information displayed in FIG. 16(a). In this example, the spatial information of room B is selected as the spatial information of a viewpoint closest to the viewpoint of the spatial information of room C, and is displayed on the viewer screen 160.

[0068] 17 is a flowchart showing an example of the processing procedure for editing an event according to this embodiment. First, the user selects whether to create or change the event as the editing of the event (step S10). When performing the event creation process, when the user presses the event creation button 131, the display control unit 20D displays the event creation screen 140 on the display screen 100 (step S11).

[0069] Next, when duplicating and creating an event is selected on the event creation screen 140 (step S12: Yes), the display control unit 20D displays a duplicate event selection area 143 and an additional data selection area 144 on the event creation screen 140. When the user selects an event to duplicate (step S13), selects space information to add (step S14), and presses the "Next" button in the confirmation area 142, the display control unit 20D displays a takeover data selection area 145 on the event creation screen 140.

[0070] Next, when the user selects the spatial information to be taken over (step S15) and presses the "Next" button in the confirmation area 142, the display control unit 20D displays a new event associated with the spatial information selected by the user on the display screen 100. Then, when the "Confirm" button in the confirmation area 133 is pressed (step S16: Yes), the processing unit 20B records the association between the new event and the spatial information in table T1 and saves the data (step S17). On the other hand, when the "Cancel" button in the confirmation area 133 is pressed (step S16: No), the processing unit 20B returns the event creation process to the process of selecting the spatial information to be taken over (step S15) (step S18).

[0071] When creation of a new event is selected on the event creation screen 140 in step S12 (step S12: No), the display control unit 20D displays the additional data selection area 146 on the event creation screen 140. When the user selects space information to add (step S19) and presses the "Next" button in the confirmation area 142, the display control unit 20D displays a new event associated with the space information selected by the user on the display screen 100. Then, when the "Confirm" button in the confirmation area 133 is pressed (step S16: Yes), the processing unit 20B records the association between the new event and the space information in table T1 and saves the data (step S17). On the other hand, when the "Cancel" button in the confirmation area 133 is pressed (step S16: No), the processing unit 20B returns the event creation process to the process of selecting space information to add (step S19) (step S18).

[0072] If the user selects to change the event in step S10, the display control unit 20D displays the event edit selection area 135 (step S20). Next, when the “Add spatial information” button is pressed in the event edit selection area 135, the display control unit 20D displays the event change screen 150, and the spatial information to be added is selected in the additional data selection area 151 (step S21). Subsequently, when the “Next” button in the confirmation area 152 is pressed, the display control unit 20D displays the changed event that reflects the user's selection on the display screen 100. Then, when the “Confirm” button in the confirmation area 133 is pressed (step S16: Yes), the processing unit 20B records the association between the changed event and the spatial information in table T1 and saves the data (step S17). On the other hand, when the “Cancel” button in the confirmation area 133 is pressed (step S16: No), the processing unit 20B returns the event change process to the process of selecting spatial information to add (step S21) (step S18).

[0073] As described above, according to this embodiment, when creating a new event by duplicating an existing event in response to changes such as changes to the room layout or renovations, the managed data can be efficiently edited by using the second reception area that accepts the specification of new spatial information to be associated with the new event. Furthermore, when changing an existing event, the managed data can be efficiently edited by using the fourth reception area that accepts the specification of additional spatial information to be associated with the existing event.

[0074] (Second embodiment) Next, a second embodiment will be described.

[0075] In this embodiment, when creating an event, a predetermined position on the timeline screen 130 is selected, and the created event is displayed at the selected predetermined position. In the following description of this embodiment, the same parts as in the first embodiment will be omitted, and only differences from the first embodiment will be described.

[0076] FIG. 18 is a diagram showing an example of an event creation screen 140 according to this embodiment. The difference from the first embodiment is that the event creation screen 140 includes a timeline area 147 and an event addition position selection area 148. The timeline area 147 is an example of a display area. The display area displays multiple existing events arranged in a predetermined order. The event addition position selection area 148 is an example of a fifth reception area. The fifth reception area receives an instruction to create a new event at a predetermined position in the display area.

[0077] When the event creation button 131 is pressed on the timeline screen 130 of FIG. 3(b), the display control unit 20D displays an event creation screen 140 including a timeline area 147 and an event addition position selection area 148, as shown in FIG. 18(a). The timeline area 147, like the timeline screen 130, is an area that displays a sequence of existing events. The event addition position selection area 148 is an area in which radio buttons indicated by dashed lines are arranged in the middle of existing events. The user can use the radio buttons in the event addition position selection area 148 to select a position on the timeline (event addition position) to add the event to be created.

[0078] For example, when the user selects an event addition position as shown in FIG. 18(a) and presses the "Next" button in the confirmation area 142, the display control unit 20D displays an event creation selection area 141 on the event creation screen 140 as shown in FIG. 18(b). Thereafter, the user can create a new event (event 5) in the same manner as in the first embodiment. When the event addition position is selected as shown in FIG. 18(a), the created event 5 is added between event 3 and event 4 on the timeline screen 130 as shown in FIG. 18(c).

[0079] 19 is a flowchart showing an example of the processing procedure for editing an event according to this embodiment. The difference from the first embodiment is that after the event creation screen 140 is displayed in step S31, the location where the event is to be added is selected in step S32. The processing in steps S30 to S31 in FIG. 19 is the same as the processing in steps S10 to S11 in FIG. 17.

[0080] After the event creation screen 140 is displayed in step S31 of Fig. 19, the user selects the location where the event is to be added using the event addition location selection area 148 (step S32). The other processes of steps S33 to S42 are the same as the processes of steps S12 to S21 of Fig. 17, and therefore their explanations are omitted.

[0081] Thus, according to this embodiment, when an event associated with spatial information is created as a new event, it becomes easy to place the new event at the desired position on a timeline displaying a sequence of existing events, making it possible to flexibly manage spatial information.

[0082] (Third embodiment) Next, a third embodiment will be described.

[0083] In this embodiment, when new spatial information is registered, the processing unit 20B analyzes the registered data and automatically edits events. When a user edits an event by determining attributes such as the purpose of use of the event or spatial information, know-how, such as how to determine the attributes, may become personal. Furthermore, if such know-how is to be compiled into a manual, the user must acquire this knowledge and skills. In this embodiment, event editing is automated to solve these problems. In the following description of this embodiment, descriptions of the same parts as in the first embodiment will be omitted, and differences from the first embodiment will be described.

[0084] 20 is a diagram showing an example of the functional configuration of the processing unit 20B according to this embodiment. As shown in FIG. 20, the processing unit 20B includes a data analysis unit 230, a data comparison unit 231, and an event editing unit 232.

[0085] The data analysis unit 230 analyzes newly registered spatial information (new data). For example, the data analysis unit 230 analyzes whether the new data is only image data or whether it also includes three-dimensional shape data and point cloud data. The data analysis unit 230 also analyzes the number of data items (number of files, etc.) in the new data.

[0086] The data comparison unit 231 compares the new data with the existing spatial information (existing data) and calculates the comparison result. As the comparison result, the data comparison unit 231 calculates, for example, the difference in the shooting date and time between the new data and the existing data, or the similarity between the two data.

[0087] The event editing unit 232 selects an event editing method based on the analysis result by the data analysis unit 230 and the comparison result by the data comparison unit 231, and edits the event using the selected editing method. The event editing methods include the method of creating a new event from an existing event, the method of creating a new event, and the method of changing an existing event, all of which are described in the first embodiment.

[0088] 21 is a diagram showing an example of a timeline screen 130 according to this embodiment. The difference from the first embodiment is that the timeline screen 130 includes an automatic event editing button 136 instead of the event creation button 131. When the automatic event editing button 136 is pressed, the processing unit 20B controls the data analysis unit 230, the data comparison unit 231, and the event editing unit 232 to execute automatic editing of the event.

[0089] FIG. 22 is a flowchart showing an example of a processing procedure for automatic event editing according to this embodiment. When a user registers new data in a project and presses the automatic event editing button 136, the data analysis unit 230 analyzes whether the new data consists of only image data. If the new data consists of only image data (step S50: Yes), the data comparison unit 231 calculates the difference in the shooting dates and times between the new data and the existing data. If the calculated difference in shooting dates and times is equal to or greater than D (step S51: Yes), the event editing unit 232 creates a new event from the existing event (step S52). More specifically, the event editing unit 232 creates a new event by inheriting some or all of the spatial information included in the existing event and integrating it with the newly registered spatial information. Note that D used in step S51 is a threshold value for the difference in shooting dates and times, and is a value that is preset through experiments or the like.

[0090] If the new data does not consist of only image data (step S50: No), the data comparison unit 231 calculates the similarity between the new data and the existing data and the number of pieces of new data. If the calculated similarity is S or more and the number of pieces of new data is N or more (step S53: Yes), the event editing unit 232 creates new data that associates only the new data (step S55). Note that S used in step S53 is a threshold value for the similarity, and N is a threshold value for the number of pieces of new data. Furthermore, S and N are values ​​that are set in advance through experiments, etc.

[0091] If the calculated difference in shooting date and time is less than D (step S51: No), the event editing unit 232 adds an association of the new data to the existing event (step S56). That is, the event editing unit 232 modifies the existing event.

[0092] In step S53, if the calculated similarity is not S or more, or if the number of new data items is not N or more (step S53: No), the data comparison unit 231 calculates the difference in shooting date and time between the new data and the existing data. If the calculated difference in shooting date and time is D or more (step S54: Yes), the event editing unit 232 creates a new event from the existing event (step S52). On the other hand, if the calculated difference in shooting date and time is not D or more (step S54: No), the event editing unit 232 adds an association of the new data item with the existing event (step S56). Note that the threshold value D used in step S54 may be a value different from D used in step S51, and is a value set in advance through experiments or the like.

[0093] When the editing in step S52, S55, or S56 is completed, the automatic event editing process ends. Note that before the editing content in step S52, S55, or S56 is confirmed, the display control unit 20D may present a confirmation screen such as that shown in Fig. 7(a) to the user, and the content of the automatic event editing may be confirmed by pressing the "Confirm" button in the confirmation area 133.

[0094] As described above, according to this embodiment, by automating the editing of events, it is possible to realize accurate editing that does not depend on the know-how or skills of the user, thereby reducing the burden on the user.

[0095] (Fourth embodiment) Next, a fourth embodiment will be described.

[0096] In this embodiment, the above-described information processing system 1 is realized with a hardware configuration different from that of the first to third embodiments. In the following description of this embodiment, the description of the same parts as those of the first to third embodiments will be omitted, and only the parts that are different from those of the first to third embodiments will be described.

[0097] In the first to third embodiments, an example has been described in which the information processing device 10 has the functions of the reception unit 20A, the processing unit 20B, the display data generation unit 20C, and the display control unit 20D. However, at least some of the functions included in the information processing device 10 may be installed in an external device or the like connected to a network or the like.

[0098] FIG. 23 is a schematic diagram illustrating an example of an information processing system 1B according to the fourth embodiment.

[0099] The information processing system 1B includes a storage device 11, an information processing device 10A, and a server device 10B. The storage device 11, the information processing device 10A, and the server device 10B are communicably connected via a network NW.

[0100] The information processing device 10A is a device that displays a two-dimensional image of a three-dimensional space represented by spatial information viewed from a virtual viewpoint of a virtual camera, and is, for example, a smartphone, a tablet terminal, or a personal computer. The information processing device 10A includes a communication unit 12, a UI unit 14, and a control unit 21. The communication unit 12, the UI unit 14, and the control unit 21 are communicatively connected. The control unit 21 includes a reception unit 20A, a display data generation unit 20C, and a display control unit 20D. The storage device 11, the communication unit 12, the UI unit 14, the reception unit 20A, the display data generation unit 20C, and the display control unit 20D are the same as those in the first to third embodiments. The communication unit 12 outputs user input data received by the reception unit 20A to the server device 10B.

[0101] The server device 10B includes a communication unit 13 and a control unit 23. The communication unit 13 communicates with the information processing device 10A and the storage device 11 via the network NW. The control unit 23 includes a processing unit 20B. The processing unit 20B is the same as in the first to third embodiments. The communication unit 13 edits data related to events and spatial information, and outputs the edited data to the information processing device 10A. This allows the information processing device 10A to display a timeline displaying events according to the edited data, data indicating the association between events and spatial information, and the like.

[0102] Next, the hardware configuration of the information processing device 10A and the server device 10B of this embodiment will be described.

[0103] FIG. 24 is a diagram showing an example of the hardware configuration of the information processing device 10A and the server device 10B according to this embodiment.

[0104] The information processing device 10A and server device 10B of this embodiment include a control unit such as a CPU 90A, a memory unit such as a ROM 90B and a RAM 90C, an I / F 90D that connects to a network and communicates, an HDD 90E, and a bus 90F that connects each unit.

[0105] The programs executed by the information processing device 10A and the server device 10B of this embodiment are provided in a state that they are pre-installed in the ROM 90B or the like.

[0106] The programs executed by the information processing device 10A and the server device 10B of this embodiment may be configured to be provided as a computer program product by being recorded in an installable or executable format on a computer-readable recording medium such as a CD-ROM, a flexible disk, a CD-R, or a DVD.

[0107] Furthermore, the programs executed by the information processing device 10A and the server device 10B of the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by the information processing device 10A and the server device 10B of the present embodiment may be provided or distributed via a network such as the Internet.

[0108] The programs executed by the information processing device 10A and the server device 10B of this embodiment can cause a computer to function as each unit of the information processing device 10A and the server device 10B of this embodiment. In this computer, the CPU 90A can read the programs from a computer-readable storage medium onto a main storage device and execute the programs.

[0109] Furthermore, the information processing device 10A and the server device 10B of the present embodiment may be realized as virtual machines that operate on a cloud system.

[0110] As described above, according to this embodiment, at least some of the functions required for the event editing process can be installed in an external device connected to a network or the like, thereby realizing the event editing process.

[0111] The programs executed by the information processing devices of each of the embodiments described above are provided as files in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

[0112] The programs executed by the information processing apparatuses of the embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.The programs executed by the information processing apparatuses of the embodiments may be provided or distributed via a network such as the Internet.

[0113] The programs of the embodiments may be provided in a state where they are pre-installed in a ROM or the like.

[0114] The program executed by the information processing device of each embodiment has a modular configuration including the above-mentioned units (reception unit 20A, processing unit 20B, display data generation unit 20C, and display control unit 20D), and in terms of actual hardware, the CPU (processor) reads and executes the program from the storage medium, thereby loading the above-mentioned units onto the main memory device and generating the above-mentioned units on the main memory device.

[0115] Each function of each of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0116] Additionally, the devices described in each embodiment represent only one of multiple computing environments for implementing the embodiments disclosed herein.

[0117] In some embodiments, the information processing apparatus includes a plurality of computing devices, such as a server cluster, configured to communicate with each other over any type of communications link, including a network, shared memory, etc., and to perform the processes disclosed herein.

[0118] Furthermore, the multiple computing devices can be configured to execute various combinations of the steps of the processes shown in Figures 17 and 19 and the multiple processes included in each step. For example, a predetermined process can be executed by a first computing device. Similarly, a predetermined process can be executed by a second computing device. Furthermore, the elements of the first computing device and the second computing device can be integrated into a single server device or can be separated into multiple devices.

[0119] Although the embodiments of the present invention have been described above, the first to fourth embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments may be embodied in various other forms, and various omissions, substitutions, and modifications may be made without departing from the spirit of the invention. These embodiments are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims.

[0120] For example, aspects of the present invention are as follows. <1> a display control unit that displays a first reception screen for receiving an instruction to create a new event associated with the space information; The information processing system is characterized in that the display control unit displays the first reception screen that accepts instructions to create the new event that is associated with at least a portion of existing spatial information associated with an existing event that has already been created and new spatial information that is not associated with the existing event. <2> The display control unit a first reception area for receiving an instruction to associate the existing spatial information with the new event; a second reception area that receives designation of the new spatial information to be associated with the new event; The above-mentioned <1> The information processing system is described in <3> The display control unit displaying the first reception screen including a third reception area for receiving designation of existing space information to be associated with the new event or existing space information not to be associated with the new event; <1> or <2> The information processing system is described in <4> the display control unit displays a second reception screen for receiving an instruction to change the existing event; the display control unit displays the second reception screen including a fourth reception area that receives designation of additional spatial information to be associated with the existing event; <1> ~ <3> The information processing system according to any one of the above items. <5> The display control unit a display area for displaying a plurality of existing events in a predetermined order; a fifth reception area for receiving an instruction to create the new event at a predetermined position in the display area; displaying the first reception screen including <1> ~ <4> The information processing system according to any one of the above items. <6> a display control unit that displays a display screen showing a plurality of events each associated with spatial information; spatial information associated with a first event included in the plurality of events and spatial information associated with a second event included in the plurality of events are spatial information that are at least partially common and at least partially different; The information processing system is characterized in that the display control unit displays the first event and the second event simultaneously or switchably on the display screen. <7> When the display screen includes information indicating the spatial information, the display control unit displays information indicating spatial information associated with the first event and information indicating spatial information not associated with the first event in different formats; <6> The information processing system is described in <8> when the display screen includes information indicating spatial information associated with the second event, the display control unit displays information indicating spatial information associated with the first event and information indicating spatial information not associated with the first event in different formats; <6> or <7> The information processing system is described in <9> a reception unit that receives an instruction to create an event associated with spatial information; a processor for creating a new event by associating at least a portion of existing spatial information associated with the existing event with the new event; The information processing system is characterized by comprising: <10> a display control unit that displays a first reception screen that receives an instruction to create an event associated with the spatial information as a new event; The display control unit a display area for displaying a plurality of existing events in a predetermined order; a fifth reception area for receiving an instruction to create the new event at a predetermined position in the display area; The information processing system is characterized in that the first reception screen includes: <11> a display control step of displaying a first reception screen for receiving an instruction to create a new event associated with space information; The display control process is an information processing method characterized by displaying the first reception screen that accepts instructions to create the new event associated with at least a portion of existing spatial information associated with an existing event that has already been created and new spatial information that is not associated with the existing event. <12> a display control step of displaying a display screen showing a plurality of events each associated with spatial information; spatial information associated with a first event included in the plurality of events and spatial information associated with a second event included in the plurality of events are spatial information that are at least partially common and at least partially different; The information processing method is characterized in that the display control step displays the first event and the second event on the display screen simultaneously or switchably. <13> a receiving step of receiving an instruction to create an event associated with the spatial information; creating a new event by associating at least a portion of existing spatial information associated with the existing event with the new event; The information processing method is characterized by comprising: <14> a display control step of displaying a first reception screen for receiving an instruction to create an event associated with the spatial information as a new event; The display control step includes: a display area for displaying a plurality of existing events in a predetermined order; a fifth reception area for receiving an instruction to create the new event at a predetermined position in the display area; and displaying the first reception screen including the above. <15> Computer, The display control unit functions as a display control unit that displays a first reception screen for receiving an instruction to create a new event associated with space information, The display control means is a program characterized by displaying the first reception screen that accepts instructions to create the new event that is associated with at least a portion of existing spatial information associated with an existing event that has already been created and new spatial information that is not associated with the existing event. <16> Computer, The display control means functions as a display control means for displaying a display screen showing a plurality of events each associated with spatial information, spatial information associated with a first event included in the plurality of events and spatial information associated with a second event included in the plurality of events are spatial information that are at least partially common and at least partially different; The display control means is a program that displays the first event and the second event simultaneously or switchably on the display screen. <17> Computer, a receiving means for receiving an instruction to create an event associated with spatial information; processing means for creating a new event by associating at least a portion of existing spatial information associated with an existing event with said new event; The program is characterized by functioning as follows. <18> Computer, The display control unit functions as a display control unit that displays a first reception screen for receiving an instruction to create an event associated with spatial information as a new event, The display control means a display area for displaying a plurality of existing events in a predetermined order; a fifth reception area for receiving an instruction to create the new event at a predetermined position in the display area; The program is characterized by displaying the first reception screen including: [Explanation of symbols]

[0121] 10, 10A Information processing equipment 10B Server device 11 Storage device 14A Display section 20A Reception 20B Processing section 20C Display data generation unit 20D Display control unit [Prior art documents] [Patent documents]

[0122] [Patent Document 1] Japanese Patent Publication No. 2023-77804

Claims

1. a display control unit that displays a first reception screen that receives an instruction to create a new event associated with space information; The information processing system is characterized in that the display control unit displays the first reception screen that accepts instructions to create the new event that is associated with at least a portion of existing spatial information associated with an existing event that has already been created and new spatial information that is not associated with the existing event.

2. The display control unit a first reception area for receiving an instruction to associate the existing spatial information with the new event; a second reception area that receives designation of the new spatial information to be associated with the new event; The information processing system of claim 1 , comprising:

3. The display control unit The information processing system according to claim 1 , wherein the first reception screen includes a third reception area for receiving designation of existing space information to be associated with the new event or existing space information not to be associated with the new event.

4. the display control unit displays a second reception screen for receiving an instruction to change the existing event; The information processing system according to claim 1 , wherein the display control unit displays the second reception screen including a fourth reception area that receives designation of additional spatial information to be associated with the existing event.

5. The display control unit a display area for displaying a plurality of existing events in a predetermined order; a fifth reception area for receiving an instruction to create the new event at a predetermined position in the display area; The information processing system according to claim 1 , wherein the first reception screen includes:

6. a display control unit that displays a display screen showing a plurality of events each associated with spatial information; spatial information associated with a first event included in the plurality of events and spatial information associated with a second event included in the plurality of events are spatial information that are at least partially common and at least partially different; The information processing system is characterized in that the display control unit displays the first event and the second event simultaneously or switchably on the display screen.

7. When the display screen includes information indicating the spatial information, 7. The information processing system according to claim 6, wherein the display control unit displays information indicating spatial information associated with the first event and information indicating spatial information not associated with the first event in mutually different formats.

8. when the display screen includes information indicating spatial information associated with the second event, 7. The information processing system according to claim 6, wherein the display control unit displays information indicating spatial information associated with the first event and information indicating spatial information not associated with the first event in mutually different formats.

9. a reception unit that receives an instruction to create an event associated with spatial information; a processor for creating a new event by associating at least a portion of existing spatial information associated with the existing event with the new event; An information processing system comprising:

10. Computer, The display control unit functions as a display control unit that displays a first reception screen for receiving an instruction to create a new event associated with space information, The display control means is a program characterized by displaying the first reception screen that accepts instructions to create the new event that is associated with at least a portion of existing spatial information associated with an existing event that has already been created and new spatial information that is not associated with the existing event.

11. Computer, The display control means functions as a display control means for displaying a display screen showing a plurality of events each associated with spatial information, spatial information associated with a first event included in the plurality of events and spatial information associated with a second event included in the plurality of events are spatial information that are at least partially common and at least partially different; The display control means displays the first event and the second event on the display screen simultaneously or switchably.

12. Computer, a receiving means for receiving an instruction to create an event associated with spatial information; processing means for creating a new event by associating at least a portion of existing spatial information associated with an existing event with said new event; A program characterized by functioning as

Images