Information processing system and recording medium

Abstract

An information processing system includes a display control unit that displays on a display a first reception screen for receiving an instruction to create a new event associated with spatial information, and receives, via the first reception screen, an instruction to create the new event associated with at least a portion of registered spatial information and new spatial information, the registered spatial information associated with a registered event having been created, and the new spatial information not associated with the registered event.

Description

INFORMATION PROCESSING SYSTEM AND RECORDING MEDIUM[Technical Field]

[0001] The present disclosure relates to an information processing system and a recording medium. [Background Art]

[0002] Recent laser scanners and Light Detection and Ranging (LiDAR) systems acquire three- dimensional (3D) information of a 3D space, which is a real space. Based on digitized spatial information (“spatial information”), a situation of a site is grasped at a place other than the site. The spatial information is also utilized in association with registered data being managed.PTL1 discloses a management data acquisition system for the indoor buildings, which stores coordinate information of the indoor space, a wireframe model, and panoramic image data captured by an imaging device, in association with the date and time of image capturing and information identifying the building.[Citation List][Patent Literature]

[0003] [PTL 1]Japanese Unexamined Patent Application Publication No. 2023-77804[Summary of Invention][Technical Problem]

[0004] However, in the above-described technology, the managed data is not efficiently updated in response to the change in the state of the space, for example, when the layout of the indoor space changes or when the indoor space is expanded or renovated.[Solution to Problem]

[0005] The present disclosure described herein provides an information processing system including a display control unit that displays on a display a first reception screen for receiving an instruction to create a new event associated with spatial information, and receives, via the first reception screen, an instruction to create the new event associated with at least a portion of registered spatial information and new spatial information, the registered spatial information associated with a registered event having been created, and the new spatial information not associated with the registered event.The present disclosure described herein provides an information processing system including: a display control unit that displays a display screen that includes a plurality of events each being associated with spatial information, the plurality of events including a first event and a second event, the spatial information associated with the first event and the spatial information associated with the second event being partially common and partially different from each other, and causes the first event and the second event to be simultaneously or selectively displayed on the display screen.The present disclosure described herein provides an information processing system, including: a reception unit that receives an instruction to create an event associated with spatial information, and a processing unit that creates a new event by associating, to the new event, at least a portion of registered spatial information associated with a registered event. The present disclosure described herein provides an information processing method performed by any one of the above-described information processing systems, and a recording medium storing a computer readable code for controlling a computer system functioning asany one of the above-described information processing system, to carry out the information processing method.[Advantageous Effects of Invention]

[0006] According to one aspect of the present disclosure, the managed data is efficiently updated in response to the change in the state of the space, for example, when the layout of the indoor space changes or when the indoor space is expanded or renovated.[Brief Description of Drawings]

[0007] A more complete appreciation of embodiments of the present disclosure and many of the attendant advantages and features thereof can be readily obtained and understood from the following detailed description with reference to the accompanying drawings.FIG 1 is a diagram illustrating an example of a hardware configuration of an information processing system according to a first embodiment.FIG. 2 is a diagram illustrating an example of a functional configuration of a control device.FIGs. 3A and 3B are diagrams illustrating examples of a display screen displayed by a management application that manages spatial information.FIGs. 4A and 4B are diagrams illustrating examples of the association between spatial information and an event.FIG. 5 is an example of a table storing the association between spatial information and an event.FIGs. 6A, 6B, and 6C are diagrams illustrating examples of an event creation screen for creating a new event.FIGs. 7A and 7B are diagrams illustrating examples of a screen that displays a created new event.FIGs. 8A, 8B, and 8C are diagrams illustrating another example of an event creation screen for creating a new event.FIGs. 9A and 9B are diagrams illustrating an example of a timeline and a space information list before a registered event is changed and after the registered event is changed.FIGs. 10A, 10B, and IOC are diagrams illustrating examples of an event change screen for changing a registered event.FIG. 11 is a diagram illustrating an example of a viewer screen displayed by a management application.FIG. 12 is a diagram illustrating an example of a given-viewpoint view in which a selected office area is viewed from a given viewpoint.FIG. 13 is a diagram illustrating an example of a given-viewpoint map including a registered image capturing position mark and a new image capturing position mark.FIG. 14 is a diagram illustrating an example of a given-viewpoint view in which only a new image capturing position mark is displayed.FIGs. 15A and 15B are diagrams illustrating examples of a display screen including a timeline screen and a viewer screen.FIGs. 16A and 16B are diagrams illustrating other examples of a display screen including a timeline screen and a viewer screen.FIG. 17 is a flowchart of a process to edit an event according to the first embodiment.FIGs. 18A, 18B, and 18C are diagrams illustrating examples of an event creation screen according to a second embodiment.FIG. 19 is a flowchart of a process to edit an event, according to the second embodiment.FIG. 20 is a diagram illustrating an example of a functional configuration of a processing unit according to a third embodiment.FIG. 21 is a diagram illustrating an example of a timeline screen according to the third embodiment.FIG. 22 is a flowchart of a process to automatically edit an event according to the third embodiment.FIG. 23 is a schematic diagram illustrating an information processing system according to a fourth embodiment.FIG. 24 is a diagram illustrating a hardware configuration of an information processing apparatus and a server apparatus according to the fourth embodiment.The accompanying drawings are intended to depict embodiments of the present disclosure and should not be interpreted to limit the scope thereof. The accompanying drawings are not to be considered as drawn to scale unless explicitly noted. Also, identical or similar reference numerals designate identical or similar components throughout the several views. [Description of Embodiments]

[0008] In describing embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that have a similar function, operate in a similar manner, and achieve a similar result.Referring now to the drawings, embodiments of the present disclosure are described below. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0009] The embodiments of an information processing apparatus and a recording medium storing a program are described in detail with reference to the drawings.

[0010] First EmbodimentFIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing system 1 according to a first embodiment.

[0011] The information processing system 1 includes an information processing apparatus 10 and a storage device 11. The information processing apparatus 10 and the storage device 11 are communicably connected to each other.

[0012] The storage device 11 accumulates spatial information of a three-dimensional (3D) space, which represents a real space. The 3D space may be referred to as a "space”. The spatial information includes various types of information representing the space. The spatial information includes various types of information used to generate two-dimensional (2D) data, 3D data, or data obtained by combining the 2D data and the 3D data. The 2D data is, for example, data acquired by capturing an image of the real space with a camera, and represents a 2D image. The 3D data is, for example, data acquired by a time-of-flight (ToF) camera or a stereo camera, and represents a 3D image. In the ToF method, an object to be measured is irradiated with infrared light. A distance to the object is calculated based on a time period from the time when the infrared light is emitted toward the object to the time when reflected light from the object returns. The stereo camera, with two cameras, obtains depth information as distance information, based on the distance between the two cameras and parallax information of images respectively obtained by the two cameras. The 3D data may be obtained using any other method, for example, by a system using Light Detection And Ranging (LiDAR) or photogrammetry.

[0013] Any file format may be used for the spatial information. The 3D data, which is one example of the spatial information, may include shape data (3D shape data) representing a 3D shape of a 3D object included in the real space. The shape data is, for example, a data file in a point cloud format that represents the 3D space by discrete points, or a data file in a polygon mesh format representing the 3D space by vertices and surfaces.The data file in the point cloud format may be referred to as, for example, a depth map or a distance image. The shape data may include the shape data acquired by different devices orthe shape data acquired using different distance measurement methods. The 2D data, which is another example of the spatial information, may be a brightness image. The 2D data may be an image having a narrow angle of view, in alternative to a spherical image having a wide angle of view of 180 degrees or more. The spatial information may further include metadata. Examples of the metadata include, but not limited to, information regarding the image (“image information”), information regarding the point cloud or the polygon mesh, information indicating the positional relationship of the point cloud to the polygon mesh, and the description regarding various data included in the spatial information.

[0014] The data file in the point cloud format may be represented by an extension such as ". xyz", ". e57", and ". ply". The data file in the polygon mesh format may be represented by an extension such as ". obj", ". fbx", and ". stl".

[0015] The storage device 11 outputs the accumulated spatial information to the information processing apparatus 10.

[0016] The information processing apparatus 10 displays the 2D image, which is obtained by viewing the 3D space represented by the spatial information from a virtual viewpoint of a virtual camera. The information processing apparatus 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

[0017] The information processing apparatus 10 includes a communication device 12, a user interface (UI) device 14, a control device 20, a read-only memory (ROM) 22, a randomaccess memory (RAM) 24, and a hard disk drive (HDD) 26. These elements are communicatively connected to one another via a bus 30.

[0018] The communication device 12 communicates with external devices via a network. In the present embodiment, the communication device 12 communicates with the storage device 11.

[0019] The UI device 14 includes a display device 14A and an input device 14B. The display device 14A is a display that displays various types of information, such as a liquid crystal display (LCD). The input device 14B receives an operation instruction or data input from a user. The user inputs, for example, identification such as a user ID, and information regarding the space, which may be displayed as the spatial information, such as the name of the building. The input device 14B is, for example, a keyboard or a pointing device such as a mouse. The display device 14A and the input device 14B may be combined into a single device, such as a touch panel.

[0020] The ROM 22, the RAM 24, and the HDD 26 are storage devices of the information processing apparatus 10 that store various types of information. The spatial information output from the storage device 11 may be stored in any of these storage devices. Alternatively, a solid-state drive (SSD) may be used as the storage device of the information processing apparatus 10.

[0021] The control device 20 manages the spatial information as described below. For example, an operation of the control device 20 may be performed by one or more processors. For example, the operation of the control device 20 may be performed by a central processing unit (CPU) that executes a software program. Alternatively, one or more of the above-described devices may be implemented by hardware such as a dedicated integrated circuit (IC). Alternatively, any of the above-described devices may be implemented by using software and hardware in combination. When a plurality of processors are used, each processor may implement the functions of one of the above-described devices or two or more of the abovedescribed devices.

[0022] FIG. 2 is a diagram illustrating an example of a functional configuration of the control device 20. The control device 20 includes a reception unit 20A, a processing unit 20B, a display data generation unit 20C, and a display control unit 20D.

[0023] The reception unit 20A receives the operation instruction and the input data from the user via the input device 14B.Examples of the operation instruction from the user include an instruction to create a new event and an instruction to change the registered event. The definition and details of the event are described below.

[0024] The processing unit 20B performs processes such as creating the new event and changing the registered event.

[0025] The display data generating unit 20C generates display data to be displayed on the display device 14 A. The display data generation unit 20C generates the display data to be displayed on a screen or an area in the screen to allow the user to instruct a management application to be described below to perform a specific operation. The display data generation unit 20C further generates the 2D data to be used by the management application to display the spatial information for view by the user. The display data generation unit 20C may convert a file format of the spatial information acquired from the storage device 11 into any desired file format, and output the converted spatial information to the display control unit 20D. For example, the display data generation unit 20C may use the method disclosed in Japanese Unexamined Patent Application Publication No. 2019-049533 to convert a data file of spatial information in a point cloud format into a data file in a polygon mesh format, and output the converted spatial information to the display control unit 20D.

[0026] The display control unit 20D displays the display data generated by the display data generating unit 20C on the display device 14 A.

[0027] FIGs. 3A and 3B are diagrams illustrating examples of a display screen displayed by the management application that manages the spatial information.FIG. 3A illustrates an example of a list of projects displayed on the display screen 100. The project is a unit for managing the space as described below. FIG. 3B illustrates an example of a list of spatial information and a timeline, which are displayed on the display screen 100, as described below. The management application operates on a personal computer (PC) or a mobile terminal such as a smartphone or a tablet terminal. The management application may be a stand-alone application installed on the PC or a web application operating on a web browser.

[0028] In this disclosure, a unit for managing the space such as a building or a site is called a project. The space managed in one project varies depending on the objective of the project. The space may be, for example, one floor in the building, the entire space inside the building, or the entire site including multiple buildings. The size of the space managed in one project thus varies depending on the objective of the project. The user may create and manage multiple projects. For example, in the case where the user manages multiple buildings, the user may create and manage a project for each building.

[0029] In the present disclosure, a set of data associated with the spatial information is referred to as an event. When created, the event is associated with particular spatial information. The spatial information may be classified by spaces, for example, by rooms. The spatial information for each space may be further divided into a plurality of data files. For example, the user may add a new event to the project at the time when the state of the space changes. For example, the state of the space changes at the key time such as after the completion of thebuilding construction or before and after the renovation of the building. Alternatively, the state of the space changes at the time when the change is observed in daily life, such as large- scale cleaning or introduction of new equipment. The spatial information that has been associated with the event may be called “registered spatial information", and the spatial information that has not been associated with the event may be called "new spatial information".

[0030] In FIG. 3 A, the display screen 100 includes a project list screen 110, which displays a plurality of projects. For example, the user selects a particular project by clicking the project using the pointing device of the input device 14B. In response to the selection, as illustrated in FIG. 3B, the display device 14A displays the contents of the selected project. FIG. 3B displays the contents of the project 02, in which the spatial information of the “Building XX “ is managed.

[0031] The display screen 100 of FIG. 3B includes a spatial information list screen 120, which displays a list of spatial information registered for the project 02. The display screen 100 of FIG. 3B further includes a timeline screen 130, which displays a sequence (timeline) of events created for the project 02. The timeline screen 130 displays, as summary information of the event, event names such as "Event 1" and "Event 2", the date the event was created for each event, and the description of the event (indicated by "xxxx" in FIG. 3B). With the summary information, the user can easily understand under what purpose each event was created. The creation date of the event may be expressed in units of hours, minutes, or seconds.

[0032] The spatial information list screen 120 displays the names of the rooms on each floor. In this example, the spatial information is information about the space, such as the building or structure made up of multiple floors. The storage device 11 stores, as the spatial information, information on the respective constituents of the building or structure, such as the respectiveareas of the respective rooms. When the user selects any one of the events with the radio button on the timeline screen 130, the display control unit 20D causes the spatial information list screen 120 to display information indicating the association between the selected event and the spatial information. In FIG. 3B, the event 2 is selected on the timeline screen 130, and the spatial information list screen 120 displays that the spatial information including the rooms A and C on the first floor and the rooms D, E, and F on the second floor is associated with the event 2. FIG. 3B further displays that the room B on the first floor is not associated with the event 2, with the information “No event”.

[0033] FIGs. 4A and 4B are diagrams illustrating examples of the association between spatial information and an event. As illustrated in FIGs. 4A and 4B, multiple items are registered for each room as the spatial information. For example, the items of the spatial information represent different areas in one room. In FIG. 4A, the areas A-l and A-2 of the room A, the areas C-l and C-2 of the room C, and the areas E-l and E-2 of the room E, each being the spatial information, are associated with the event 1.In FIG. 4B, the areas A-l and A-2 of the room A, the areas C-l and C-2 of the room C, the area D-l of the room D, the areas E-l and E-2 of the room E, and the areas F-l, F-2, F-3, and F-4 of the room F, each being the spatial information, are associated with the event 2. As illustrated in FIGs. 4A and 4B, there may be the case where at least a part of the spatial information associated one event and a part of the spatial information associated with another event may be the same. As described above referring to FIGs. 4A and 4B, all of the spatial information to be associated with a particular room may be collectively associated with the event. Alternatively, each item of the spatial information to be associated with a particular room may be associated with the event, independently from each other.

[0034] FIG. 5 is an example of a table storing the association between spatial information and an event. In the table T1 of FIG. 5, "x" indicates that the area, which is the spatial information,is associated with the event. For example, the event 1 is associated with the areas A-l, A-2,C-l, and C-2. In this disclosure, the spatial information, which is registered in the table T1 in association with the event, is the registered spatial information. The management application stores the table T1 in a memory such as the HDD 26. The table T1 may be stored in the storage device 11.

[0035] The user may additionally register the spatial information in the project by pressing an “Add information” button 121 on the spatial information list screen 120 in FIG. 3B. For example, the user presses the “Add information” button 121 to additionally register new spatial information for the room that has been registered. In another example, the user presses the “Add information” button 121 to additionally register a new room, and add new spatial information for the newly-registered room. In the case where the spatial information is additionally registered using the “Add information” button 121, the registered spatial information may be associated with the event. For example, referring to FIG. 3B, assuming that spatial information is additionally registered while the event 2 is selected on the timeline screen 130, information on the event 2 is updated so that the spatial information that is additionally registered is associated with the event 2. Further, information on the events may be updated, so that the spatial information that is additionally registered is also associated with the events (event 3 and event 4) that are placed above the event 2 on the timeline screen 130.

[0036] The user may create a new event by pressing a “Create event” button 131 on the timeline screen 130. In the present embodiment, as described below, the information processing apparatus 10 allows the user to create a new event, or to create a new event from the registered event by copying the registered event.

[0037] The spatial information associated with any event and the spatial information not associated with any event may be presented in different appearance, for example, in different formats or styles. In FIG. 3B, the spatial information associated with the event is displayed with only the name of the room, as indicated by the display format 122. The spatial information not associated with any event is displayed with information “No event,” as indicated by the display format 123. The spatial information that is not associated with the event may be displayed in a style that makes it visible and distinct from the spatial information associated with the event, for example, by changing the display color, or additionally displaying the letter such as an exclamation mark or the icon.

[0038] In FIG. 3B, one spatial information list screen 120 and one timeline screen 130 are displayed on the display screen 100. Alternatively, two or more spatial information list screens 120 and two or more timeline screens 130 may be displayed on the display screen 100. For example, the display screen 100 may simultaneously display the spatial information associated with the event 1 in one screen 120 and the spatial information associated with the event 2 in another screen 120. Further, in response to changing the selection of the event on the timeline screen 130 to change the display of the spatial information list screen 120, the display screen 100 may selectively display in the screen 120 the spatial information associated with the event 1 and the spatial information associated with the event 2 based on the selection. With this configuration, the user can easily compare two or more events that are associated with the spatial information that are partly different from one another. For example, as described below, if the event 2 is created by copying the event 1 and adding new spatial information to the copied event 1, the spatial information associated with the event 1 and the spatial information associated with the event 2 will have some spatial information that are common and the other spatial information that are different, but such events can be easily compared.

[0039] An example operation of creating a new event is described below with reference to FIGs. 6 to8. FIGs. 6A, 6B, and 6C are diagrams each illustrating an example of an event creation screen 140 that allows the user to create a new event. When the “Create event” button 131(FIG. 3B) is pressed, the display control unit 20D causes the display device 14A to display the event creation screen 140 as illustrated in FIG. 6A. The event creation screen 140 includes an event creation selection area 141 and a confirmation area 142.

[0040] With the radio buttons in the event creation selection area 141, the user can select whether to create a new event by copying the registered event or to create a new event without copying. The following describes the example case in which a new event is created by copying some or all of the information registered for the registered event and combining the copied information with additional spatial information. This example case includes the case in which the 3D shape data representing the indoor space of the building is changed only slightly such that only the appearance is partly changed, or the case in which image data of a particular room is replaced with image data of a wider area covering the particular room. The former example case includes the case where a part of the facilities in the area are replaced. The latter example case includes the case where the wallpaper in the room is changed. Alternatively, a new event may be created from the registered event when both of the 3D data and image data for a particular room are replaced. While the overall shape of the building does not change, both of the 3D shape and the appearance of the particular room are changed. This example case includes the case where the layout of the room is changed, for example, as a desk, a chair, or equipment is moved.

[0041] When the user selects “Create event by copying" in the event creation selection area 141 and presses the "Next" button in the confirmation area 142, the display control unit 20D causes the display device 14A to display an event creation screen 140 as illustrated in FIG. 6B. The event creation screen 140 includes a copied event selection area 143, an additional dataselection area 144, and a confirmation area 142. The user can select the event and the spatial information by checking a particular checkbox in the copied event selection area 143 and the additional data selection area 144, respectively. In FIG. 6B, the event 2 is selected in the copied event selection area 143 as the event to be copied, and the room B and the room H are selected in the additional data selection area 144 as the spatial information to be added. For example, when the spatial information has not been registered for the room B or the room H, or when there is new spatial information to be registered for the room B or the room H, the user may register spatial information for the room B or the room H using a file selection screen. The spatial information is registered for each room, for example, when the user designates a data file of spatial information, and the information processing apparatus 1 associates the data file of the spatial information with each room. In other words, the new spatial information to be associated with the new event is designated.

[0042] If the building is large, a specific structure within the building may be designated to select the event to be copied. For example, when the user designates a structure within the building via a screen, the display device 14A displays only events related to the designated structure in the copied event selection area 143 to allow the user to select a particular event to be copied from among the displayed events. The timeline screen 130 may display which event is related to which structure in the list of events.

[0043] When the user makes the selection as illustrated in FIG. 6B and presses the "Next" button in the confirmation area 142, the display control unit 20D causes the display device 14A to display an event creation screen 140 as illustrated in FIG. 6C. The event creation screen 140 includes the confirmation area 142, and a copied data selection area 145 for allowing the user to select the spatial information to be copied from the copied event.The user selects the spatial information to be copied by checking the corresponding checkbox. In FIG. 6C, the room A, the room C, and the room E are selected as the spatial information tobe copied from the event 2. If there is new spatial information to be additionally registered for any one of the rooms A, C, and E, the user registers the new spatial information for the rooms A, C, or E using a file selection screen.

[0044] When the user makes the selection as illustrated in FIG. 6C and presses the "Next" button in the confirmation area 142, the display control unit 20D causes the display device 14A to display a spatial information list screen 120 and a timeline screen 130 as illustrated in FIG. 7A.

[0045] FIGs. 7A and 7B are diagrams each illustrating an example of a screen that displays the created new event. The timeline screen 130 of FIG. 7A displays an event 5 as a new event, and the spatial information list screen 120 displays the spatial information associated with the event 5 and the spatial information that is not associated with the event 5, based on the selection by the user. The timeline screen 130 also includes a summary information area 132 and a confirmation area 133. The user may operate the input device 14B to change the summary information of the new event, such as the event name and the description illustrated in the summary information area 132, to any desired content. The summary information of the new event may have an initial value that is automatically generated by the processing unit 20B.

[0046] When the user presses the “Confirm” button in the confirmation area 133, the processing unit 20B records the association between the new event 5 and the spatial information in the table Tl. The display control unit 20D causes the display device 14A to display a spatial information list screen 120 and a timeline screen 130 as illustrated in FIG. 7B. When the user presses the "Cancel" button in the confirmation area 142 (FIGs. 6A to 6C) or the confirmation area 133 (FIG. 7A), the processing unit 20B returns the event creation process from thecurrent step to the previous step, and the display control unit 20D causes the display device 14A to display the previous screen.

[0047] As described above, with the management application, the information processing apparatus 10 creates a new event from the registered event by copying the registered event. The display screen 100 is an example of a display screen. The display screen illustrates two or more events each associated with spatial information. The event creation screen 140 is an example of a first reception screen. The first reception screen receives an instruction to create a new event using the registered event. The event creation selection area 141 and the copied event selection area 143 are examples of a first reception area. The first reception area receives an instruction to associate at least a portion of the registered spatial information associated with the registered event with the new event by selecting the registered event to be used in creating the new event. It is not necessary to provide both of the event creation selection area 141 and the copied event selection area 143 as the first reception area. For example, by selecting the registered event to be used to create the new event in the copied event selection area 143, the first reception area may receive an instruction to associate at least a portion of the registered spatial information with the new event. The additional data selection area 144 is an example of a second reception area. The second reception area receives the designation of new spatial information to be associated with the new event. The second reception area is not limited to the additional data selection area 144. The second reception area may include any area used by the user to designate a data file of spatial information to be added, as the spatial information designated in the additional data selection area 144. The new spatial information may be designated by designating a room for which the spatial information is registered. Alternatively, the new spatial information may be designated by designating a data file to be registered as the spatial information. The copied data selection area 145 is an example of a third reception area. The third reception area receives the designation of the registered spatial information to be associated with the new event or the registered spatial information not to beassociated with the new event. The registered spatial information may be designated by designating a room for which the spatial information has been registered. Alternatively, the registered spatial information may be designated by designating a data file having been registered as the spatial information. It is not necessary to provide the copied data selection area 145. For example, from among the registered events selected in the copy event selection area 143, all spatial information that has not been selected as the new spatial information in the additional data selection area 144 may be automatically copied to the new event.

[0048] FIGs. 8A, 8B, and 8C are diagrams each illustrating another example of the event creation screen 140 that allows the user to create a new event. The following describes the example case in which a new event is created using only the additional spatial information. The event created in this example does not inherit data from the registered event, but contains only the data that is added. This method is applicable, for example, when the large-scale renovation work is performed, so that the 3D shape data of the entire building and the spherical image are comprehensively re-acquired.

[0049] When the user selects “Create new event” in the event creation selection area 141 as illustrated in FIG. 8A and presses the “Next” button in the confirmation area 142, the display control unit 20D causes the display device 14A to display an event creation screen 140 as illustrated in FIG. 8B or FIG. 8C. The event creation screen 140 includes an additional data selection area 146 and a confirmation area 142. In FIGs. 8B and 8C, the room A, the room B, the room C, and the room E are selected as the spatial information to be added. In FIG. 8B, the user can select the spatial information to be added by entering the spatial information to be added in text within the dashed rectangle of the additional data selection area 146. In FIG. 8C, the user selects the spatial information to be added by checking the corresponding check box in the additional data selection area 146. In FIGs. 8B and 8C, the room A, the room B, the room C, and the room E are selected as the spatial information to be added. If the spatialinformation has not been registered for any one of the rooms A, B, C, and E, or if there is new spatial information to be additionally registered for any one of the rooms A, B, C, and E, the user registers the new spatial information for the rooms A, B, C, or E using a file selection screen.

[0050] When the user makes the selection as illustrated in FIG. 8B or 8C and presses the "Next" button in confirmation area 142, the display control unit 20D causes the display device 14A to display a screen similar to the display screen of FIG. 7A. When the user presses the “Confirm” button in the confirmation area 133 of the timeline screen 130, the processing unit 20B records the association between the new event 5 and the spatial information in the table Tl. The display control unit 20D causes the display device 14A to display a display screen 100 similar to the screen of FIG. 7B.

[0051] As described above, with the management application, the information processing apparatus 10 creates a new event without copying the registered event.

[0052] An example operation of changing the registered event is described below with reference to FIGs. 9 and 10. This operation is to overwrite the registered event after adding the spatial information to the registered event. This operation is applicable, for example, when the user desires to add, as the spatial information for the registered event, the image that is additionally captured after the event was created, for example, as the image was not captured. For example, there may be the case where the image was not captured when the registered event was created, but capturing of the image became possible at a later date, and there is no need to manage the captured image for the same event separately as the image for a different event.

[0053] FIGs. 9A and 9B are diagrams illustrating an example of a timeline and a space information list before the registered event is changed and after the event is changed. FIG. 9A illustrates adisplay screen 100 before the event is changed. The event 4 is selected on the timeline screen130, and the spatial information list screen 120 displays the association between the event 4 and the spatial information. In response to the user operating the pointing device, the display control unit 20D causes the display device 14A to display an event edit selection area 135 of FIG. 9A, for example, on the timeline screen 130. Specifically, when the user clicks near an area where the “event 4” is displayed while the event 4 is being selected, the display control unit 20D causes the display device 14A to display the event edit selection area 135.

[0054] FIGs. 10A, 10B, and 10C are diagrams illustrating an example of an event change screen 150 that allows the user to change the registered event.When the "Add spatial information" button is pressed in the event edit selection area 135 (FIG. 9A), the display control unit 20D causes the display device 14A to display the event change screen 150 as illustrated in FIG. 10A. When the “Delete event” button is pressed in the event edit selection area 135 (FIG. 9A), the display control unit 20D causes the display device 14A to display, for example, a confirmation button to confirm whether to delete. In response to pressing of the confirmation button, the event 4 is deleted. The "Add spatial information" button in the event editing selection area 135 may be displayed differently, for example, as a button labeled with "Add captured data."

[0055] As illustrated in FIGs. 10A and 10B, the event change screen 150 includes an additional data selection area 151 and a confirmation area 152. In FIGs. 10A and 10B, the room C, the room G, and the room H are selected as the spatial information to be added. In FIG. 10A, the user can select the spatial information to be added by entering the spatial information to be added in text within the dashed rectangle of the additional data selection area 151. In FIG. 10B, the user selects the spatial information to be added by checking the corresponding check box in the additional data selection area 151. The registered event may be changed by adding the registered spatial information or the new spatial information, or by deleting the registeredspatial information, using a data selection area 153 as illustrated in FIG. IOC. In FIG. IOC, the user selects to add the spatial information of the room C to the event 4, and to delete the spatial information of the room A and the room E from the event 4.

[0056] When the user makes the selection as illustrated in FIG. 10A or 10B and presses the "Next" button in the confirmation area 152, and then presses the "Confirm" button similar to the “Confirm” button of the confirmation area 133 in FIG. 7 A, the processing unit 20B records the association between the changed event 4 and the spatial information in the table Tl. The display control unit 20D causes the display device 14A to display a display screen 100 that is similar to the display screen 100 of FIG. 9B.

[0057] As described above, with the management information, the information processing apparatus10 changes the association between the registered event and the spatial information. The event change screen 150 is an example of a second reception screen. The second reception screen receives an instruction to change the registered event. The additional data selection area 151 is an example of a fourth reception area. The fourth reception area receives the designation of additional spatial information to be additionally associated with the registered event.

[0058] A viewer function of the management application is described below with reference to FIGs.11 to 16. FIG. 11 is a diagram illustrating an example of a viewer screen 160 displayed by the management application. In FIG. 11, the viewer screen 160 displays an overhead view of the spatial information representing a work area of the room F, which is selected. FIG. 12 is a diagram illustrating an example of a given-viewpoint view in which the selected office area is viewed from a given viewpoint. The given-viewpoint map is, for example, a 2D image generated by projecting the spherical image having been captured from the particular viewpoint in a given direction. The spherical image contains the spatial information of thework area of the room F. The user can view the selected spatial information, such as the selected image, by switching between the overhead view and the given-viewpoint view displayed on the viewer screen 160. The user operates the input device 14B to change the angle of the overhead view, or the viewpoint or the angle of the given-viewpoint view, and checks the details of the structure at various angles and from various viewpoints.

[0059] When the user clicks on the image capturing position mark 161 displayed on the givenviewpoint map using the pointing device, the display device 14A displays other spatial information, such as the image captured at the position indicated by the image capturing position mark 161. To display the image capturing position marks 161 each in association with the corresponding spatial information, the positional relationship between different spatial information are defined. For example, the image capturing position marks 161 and the spatial information are associated using a metadata file that contains information on the positional relationship of the spatial information. In another example, the processing unit 20B analyzes the spatial information and automatically estimates the positional relationship of the spatial information.

[0060] When the new event is created from the registered event, the registered image capturing position mark 161 indicating the spatial information inherited from the registered event and the new image capturing position mark 162 indicating the spatial information added to the new event may be displayed in different display styles. For example, if the image capturing positions for these spatial information are close to each other, the image capturing position marks 161 are displayed closely together on the viewer screen 160, making the image look cluttered. Accordingly, the user can hardly select the image capturing position mark 161. In view of the above, the display control unit 20D may display the new image capturing position mark 162 in an inverted color. FIG. 13 is a diagram illustrating an example of a givenviewpoint map including the registered image capturing position mark 161 and the new imagecapturing position mark 162. In FIG. 13, the registered image capturing position mark 161 and the new image capturing position mark 162 are displayed in different colors.

[0061] Alternatively, either the registered image capturing position mark 161 or the new image capturing position mark 162 may be temporarily hidden on the viewer screen 160 to allow the user to easily recognize the updated portion in the image. FIG. 14 is a diagram illustrating an example of a given-viewpoint view in which only the new image capturing position mark 162 is displayed. For example, when viewing the new event, the display control unit 20D may switch between the viewer screen 160 that displays only the registered image capturing position mark 161 as illustrated in FIG. 12 and the viewer screen 160 that displays only the new image capturing position mark 162 as illustrated in FIG. 14.

[0062] The viewer screen 160 may provide a function that allows the user to select the image capturing position mark 161 or 162, and individually delete the spatial information associated with the selected event. Further, when the new event is created from the registered event, the processing unit 20B may compare the similarity between the registered spatial information and the new spatial information. When the comparison indicates that the similarity is high, the processing unit 20B replaces the registered spatial information with the new spatial information, while deleting the registered spatial information. The replacement process may be performed automatically. Alternatively, the replacement process may be performed based on the confirmation by the user to prevent the spatial information from being deleted by mistake. In the case where the spatial information is the spherical image, the registered and new spatial information are determined to be similar when the distance between the corresponding positions is equal to or less than a predetermined value. In the case where the spatial information is 3D shape data, the registered and new spatial information are determined to be similar when the index indicating the unsimilarity in shape is equal to or less than a predetermined value.

[0063] FIGs. 15A and 15B are diagrams each illustrating an example of a display screen 100 including a timeline screen 130 and a viewer screen 160. As illustrated in FIGs. 15A and 15B, the display control unit 20D displays the timeline screen 130 together with the viewer screen 160 on the display screen 100. The display screen 100 selectively displays the givenviewpoint views of the same room, while the user switches between the events in the timeline screen 130. In FIGs. 15A and 15B, the display screen 100 simultaneously displays the givenviewpoint view of the room C on the viewer screen 160, and the timeline screen 130.

[0064] In FIG. 15A, as the event 2 is selected on the timeline screen 130, the spatial information of the room C associated with the event 2 is displayed on the viewer screen 160. Since the spatial information displayed on the viewer screen 160 is also associated with the event 1, the message "same data" is displayed at the location where the event 1 is displayed on the timeline screen 130. Since the spatial information of the room C is not associated with the event 4, the event 4 is grayed out on the timeline screen 130 such that the event 4 is not selectable.

[0065] FIG. 15B illustrates an example of the display screen 100 that is displayed after selecting the event 3 in FIG. 15A. Since the spatial information displayed in FIG. 15A is not associated with the event 3, the display control unit 20D displays, out of the spatial information of the room C being associated with the event 3, the spatial information having a viewpoint closest to the spatial information displayed in FIG. 15A on the viewer screen 160. The angle at which the given- viewpoint view is displayed (the projection direction of the spherical image) is the same for both of FIGs. 15A and 15B.

[0066] FIGs. 16A and 16B are diagrams each illustrating another example of the display screen 100 including the timeline screen 130 and the viewer screen 160. In FIGs. 15A and 15B, theevent 4 is grayed out on the timeline screen 130. Alternatively, as illustrated in FIGs. 16A and 16B, the event 4 may be made selectable without being grayed out. In FIG. 16 A, the event 2 is selected on the timeline screen 130, and the spatial information of the room C associated with the event 2 is displayed on the viewer screen 160. Since the spatial information of the room C is not associated with the event 4, “! No data” is displayed at the location where the event 4 is displayed on the timeline screen 130.

[0067] FIG. 16B illustrates an example of the display screen 100 that is displayed after selecting the event 4 in FIG. 16 A. The spatial information, which is selected by the processing unit 20B from among the spatial information associated with the event 4, is displayed on the viewer screen 160. For example, the processing unit 20B selects the spatial information having the viewpoint closest to the viewpoint of the spatial information displayed in FIG. 16A. In this example, the spatial information of the room B is selected as the spatial information having the viewpoint closest to the viewpoint of the spatial information of the room C, and is displayed on the viewer screen 160.

[0068] FIG. 17 is a flowchart of an example of an operation for editing an event.In step S10, the reception unit 20A receives an instruction to edit the event from the user, and determines whether the instruction indicates whether to create the event or change the event. When the reception unit 20 A receives pressing of the “Create event” button 131 (FIG. 3B) by the user, the display control unit 20D determines that the event creation process is to be performed, and the operation proceeds to step Si l. In step Si l, the display control unit 20D displays the event creation screen 140 (FIG. 6A) on the display screen 100.

[0069] In step S12, the display control unit 20D determines whether to create a new event by copying the event. When “Create event by copying” is selected on the event creation screen 140 (step S12: Yes), the display control unit 20D causes the display device 14A to display the copiedevent selection area 143 and the additional data selection area 144 on the event creation screen 140 (FIG. 6B). In step S 13, the reception unit 20A receives the selection of an event to be copied by the user, which is made on the copied event selection area 143. In step S14, the reception unit 20A receives the selection of spatial information to be added by the user, which is made on additional data selection area 144. When the display control unit 20D receives pressing of the “Next” button in the confirmation area 142, the display control unit 20D displays the copied data selection area 145 on the event creation screen 140 (FIG. 6C).

[0070] In step SI 5, when the user selects the spatial information to be copied and presses the “Next” button in the confirmation area 142, the display control unit 20D displays a new event associated with the spatial information selected by the user on the display screen 100 (FIG. 7A). When the "Confirm" button in the confirmation area 133 is pressed (step S16: Yes), in step S17, the processing unit 20B records the association between the new event and the spatial information in the table Tl. When the "Cancel" button in the confirmation area 133 is pressed (step S16: No), the processing unit 20B returns to the previous step of selecting spatial information to be added in the event creation process. More specifically, the operation returns to the step S15.

[0071] Referring back to S12, when “Create new event” is selected on the event creation screen 140 in step S12 (step S12: No), the display control unit 20D causes the display device 14A to display the additional data selection area 146 on the event creation screen 140 (FIG. 8B or 8C). In step S19, when the user selects the spatial information to be added and presses the “Next” button in the confirmation area 142, the display control unit 20D causes the display device 14A to display, on the display screen 100, a new event associated with the spatial information selected by the user.When the "Confirm" button in the confirmation area 133 is pressed (step S16: Yes), in step S17, the processing unit 20B records the association between the new event and the spatialinformation in the table Tl. When the "Cancel" button in the confirmation area 133 is pressed(step S16: No), the processing unit 20B returns to the previous step of selecting spatial information to be added in the event creation process. More specifically, the operation returns to the step S19.

[0072] Referring back to S10, when the reception unit 20A receives the selection to change the event from the user in step S10, the display control unit 20D determines that the event change process is to be performed, and displays the event edit selection area 135 in step S20 (FIG.9 A). When the display control unit 20D receives the pressing of the “Add spatial information” button in the event edit selection area 135, the display control unit 20D causes the display device 14A to display the event change screen 150 (FIG. 10A). In step S21, the reception unit 20A receives the selection of the spatial information to be added, which is input by the user via the additional data selection area 151. When the "Next" button in the confirmation area 152 is pressed, the display control unit 20D causes the display device 14A to display, on the display screen 100, the changed event that reflects the selection made by the user. When the "Confirm" button in the confirmation area 133 is pressed (step S16: Yes), in step S17, the processing unit 20B records the association between the changed event and the spatial information in the table Tl. When the "Cancel" button in the confirmation area 133 is pressed (step S16: No), the processing unit 20B returns to the previous step of selecting spatial information to be added in the event change process. More specifically, the operation returns to the step S21.

[0073] According to the present embodiment, the new event is created by copying the registered event, for example, to reflect the changed layout of the indoor space or expansion or renovation. Specifically, the data managed in the information processing system 1 can be efficiently edited, with the second reception area that allows the user to designate the new spatial information to be associated with the new event. In the case where the registered eventis changed, the data managed in the information processing system 1 can be efficiently edited, with the fourth reception area that allows the user to designate the additional spatial information to be added and associated with the registered event.

[0074] Second EmbodimentA second embodiment is described below.

[0075] In the present embodiment, in creating the event, a predetermined position on the timeline screen 130 is selected, and the created event is displayed at the selected predetermined position. The description of the same configurations as those of the first embodiment is omitted in the following description of the second embodiment, and differences from the first embodiment will be described.

[0076] FIGs. 18A, 18B, and 18C are diagrams each illustrating an example of the event creation screen 140. The difference from the first embodiment is that the event creation screen 140 includes a timeline area 147 and an event display position selection areas 148. The timeline area 147 is an example of a display area. The display area displays the registered events arranged in a predetermined order. The event display position selection area 148 is an example of a fifth reception area. The fifth reception area receives an instruction to create a new event to be displayed at a predetermined position in the display area.

[0077] When the ’’Create event” button 131 is pressed on the timeline screen 130 of FIG. 3B, the display control unit 20D causes the display device 14A to display the event creation screen 140 including the timeline area 147 and the event display position selection area 148 as illustrated in FIG. 18A. The timeline area 147 is an area that displays a sequence of the registered events in a similar manner as the display of the timeline screen 130. The event display position selection area 148 is an area in which one or more radio buttons, eachindicated by the dashed circle, are displayed in the middle of the registered events. The user may use the radio button in the event display position selection area 148 to select the position(event display position) on the timeline area 147 where the event to be created will be additionally displayed.

[0078] When the user selects the event display position, for example as illustrated in FIG. 18 A, and presses the “Next” button in the confirmation area 142, the display control unit 20D causes the display device 14A to display the event creation selection area 141 on the event creation screen 140 as illustrated in FIG. 18B. Subsequently, the user creates the new event (event 5) in the same manner as described above in the first embodiment. When the event display position is selected as illustrated in FIG. 18 A, the created event 5 is additionally displayed between the event 3 and the event 4 on the timeline screen 130 as illustrated in FIG. 18C.

[0079] FIG. 19 is a flowchart of an operation for editing an event according to the second embodiment. The difference from the first embodiment is that after the event creation screen 140 is displayed in step S31, the position where the event is to be added is selected in step S32. The processes performed in steps S30 to S31 in FIG. 19 are performed in the substantially similar manner as the processes performed in steps S10 to Sil in FIG. 17, and the description thereof is omitted.

[0080] After the event creation screen 140 is displayed in step S31 of FIG. 19, the user selects the position where the event is to be added using the event display position selection area 148 (step S32). The processes performed in steps S33 to S42 in FIG. 19 are performed in the substantially similar manner as the processes performed in steps S12 to S21 in FIG. 17, and the description thereof is omitted.

[0081] According to the present embodiment, in the case where the event associated with the spatial information is created as a new event, the information processing apparatus 10 allows the user to easily place the new event at a desired position on the timeline displaying a sequence of the registered events. Thus, the spatial information can be flexibly managed.

[0082] Third EmbodimentA third embodiment is described below.

[0083] In the present embodiment, when the new spatial information is registered, the processing unit 20B analyzes the registered data and automatically edits the event. In the above-described embodiments, the user edits an event by determining the attributes, such as the objective, of the event or the spatial information. The determination of the attributes may depend on each user, as it requires the know-how. To standardize the process of determining the attributes, or the know-how to do so, and create a manual, the user first needs to acquire the knowledge and skills. In view of the above, the process of editing the event is automated in the present embodiment.The description of the same configurations as those of the first embodiment is omitted in the following description of the third embodiment, and differences from the first embodiment will be described.

[0084] FIG. 20 is a diagram illustrating an example of a functional configuration of a processing unit 20B 1, which replaces the processing unit 20B of the first embodiment. As illustrated in FIG. 20, the processing unit 20B1 includes a data analyzer 230, a data comparator 231, and an event editor 232.

[0085] The data analyzer 230 analyzes the new spatial information (new data) that is additionally registered. The data analyzer 230 analyzes, for example, whether the new data includes onlyimage data or includes 3D shape data and point cloud data. The data analyzer 230 further analyzes the number of data files of the new data.

[0086] The data comparator 231 compares the new data with the registered spatial information (registered data) and calculates a comparison result. For example, the data comparator 231 calculates the difference in the image capturing date and time between the new data and the registered data, or calculates the similarity between the new data and the registered data, to generate the comparison result.

[0087] The event editor 232 selects a method of editing the event based on the analysis result of the data analyzer 230 and the comparison result of the data comparator 231, and edits the event using the selected editing method. Examples of the method of editing the event include the method of creating a new event from the registered event, the method of creating a new event, and the method of changing the registered event, as described in the first embodiment.

[0088] FIG. 21 is a diagram illustrating an example of the timeline screen 130. The difference from the first embodiment is that the timeline screen 130 of FIG. 21 includes an automatic event editing button 136 instead of the ’’Create event” button 131. When the automatic event editing button 136 is pressed, the processing unit 20B controls the data analyzer 230, the data comparator 231, and the event editor 232 to execute automatic editing of the event.

[0089] FIG. 22 is a flowchart of an example of a process of automatically editing an event.When the user registers new data in the project and presses the automatic event editing button 136, the data analyzer 230 analyzes the new data to determine whether the new data includes only image data.In step S50, when the new data includes only image data (step S50: Yes), the data comparator231 calculates the difference in image capturing date and time between the new data and the registered data.In step S51, when the calculated difference in image capturing date and time is equal to or greater than the value D (step S51: Yes), in step S52, the event editor 232 creates a new event from the registered events. More specifically, the event editor 232 creates a new event by inheriting some or all of the spatial information registered for the registered event and integrating the spatial information with new spatial information that is registered. The value D in step S51 is a threshold value used to determine the difference between the image capturing date and time, and is a value that is previously set, for example, based on the empirical data obtained through the experiments.

[0090] When the new data does not only include the image data in step S50 (step S50: No), the data comparator 231 calculates the degree of similarity between the new data and the registered data, and the number of data files in the new data. In step S53, when the calculated similarity is equal to or greater than the value S, and the number of data files in the new data is equal to or greater than the value N (step S53: Yes), in step S55, the event editor 232 creates a new event that associates only to the new data. The value S in step S53 is a threshold value used to determine the similarity, and the value N is a threshold value used to analyze the number of data files in the new data. Each of the value S and the value N is a value that is previously set, for example, based on the empirical data obtained though the experiments.

[0091] In step S51, when the calculated difference in image capturing date and time is not equal to or greater than the value D (step S51: No), in step S56, the event editor 232 associates the new data to the registered event.In other words, the event editor 232 changes the registered event.

[0092] In step S53, when the calculated similarity is less than the value S, or when the number of data files in the new data is less than the value N (step S53: No), the data comparator 231 calculates the difference in image capturing date and time between the new data and the registered data. When the calculated difference in image capturing date and time is equal to or greater than the value D (step S54: Yes), in step S52, the event editor 232 creates a new event from the registered event. When the calculated difference in image capturing date and time is not equal to or greater than the value D (step S54: No), in step S56, the event editor 232 associates the new data to the registered event. The threshold value D in step S54 may be a value different from value D in step S51, and is a value that is previously set, for example, based on the empirical data obtained through the experiments.

[0093] When the editing in step S52, S55 or S56 is completed, the automatic event editing process ends. Before the editing content of step S52, S55, or S56 is confirmed, the display control unit 20D may present a confirmation screen such as the screen of FIG. 7A to the user. In response to the pressing of the “Confirm” button in the confirmation area 133, the processing unit 20B1 confirms the content generated in the automatic event editing process.

[0094] As described above, according to the present embodiment, the event editing process is automated. Since the editing process, which does not depend on the know-how or skills of the user, can be performed with a sufficient level of accuracy, the burden on the user is reduced.

[0095] Fourth EmbodimentA fourth embodiment is described below.

[0096] In the present embodiment, an information processing system IB has a hardware configuration different from the hardware configuration of the information processing system1 of the first to third embodiments illustrated in FIG. 1. Description of the same configurations as those of the first to third embodiment is omitted in the following description of the fourth embodiment, and differences from the first to third embodiments will be described.

[0097] In the first to third embodiments, the information processing apparatus 10 includes the reception unit 20A, the processing unit 20B, the display data generation unit 20C, and the display control unit 20D, as the functional units. However, at least a part of the functional units included in the information processing apparatus 10 may reside in an external apparatus connected to the information processing apparatus 10 via a network.

[0098] FIG. 23 is a schematic diagram illustrating an information processing system IB according to the fourth embodiment.

[0099] The information processing system IB includes the storage device 11, an information processing apparatus 10A, and a server apparatus 10B. The storage device 11, the information processing apparatus 10A, and the server apparatus 10B are communicably connected to one another via a network NW.

[0100] The information processing apparatus 10A displays a 2D image, which is a view of a 3D space represented by spatial information from a virtual viewpoint of a virtual camera. The information processing apparatus 10A may be implemented by, for example, a smartphone, a tablet terminal, or a personal computer. The information processing apparatus 10A includes the communication device 12, the UI device 14, and a control device 21. The communication device 12, the UI device 14, and the control device 21 are communicably connected to one another. The control device 21 includes the reception unit 20A, the display data generation unit 20C, and the display control unit 20D. The storage device 11, the communication device12, the UI device 14, the reception unit 20A, the display data generation unit 20C, and the display control unit 20D are the same as or similar to those of the first to third embodiments.The communication device 12 outputs input data of the user received by the reception unit 20A to the server apparatus 10B.

[0101] The server apparatus 10B includes a communication device 13 and a control device 23. The communication device 13 communicates with the information processing apparatus 10A and the storage device 11 via the network NW. The control device 23 includes the processing unit 20B. The processing unit 20B is the same or similar to the processing unit 20B in the first to third embodiments. The communication device 13 edits data relating to the event or the spatial information, and outputs the edited data to the information processing apparatus 10A. With the information processing system IB, the information processing apparatus 10A displays, for example, a timeline in which the events are displayed according to the edited data, or data indicating the association between the event and the spatial information.

[0102] A hardware configuration of each of the information processing apparatus 10A and the server apparatus 10B are described below.

[0103] FIG. 24 is a diagram illustrating an example of a hardware configuration of the information processing apparatus 10A and the server apparatus 10B.

[0104] The information processing apparatus 10A and the server apparatus 10B each include a control device such as a CPU 90A, a storage device such as a ROM 90B and a RAM 90C, an I / F 90D that establishes a connection to a network and performs communication, an HDD 90E, and a bus 90F that connects these devices to one another.

[0105] A program to be executed by any of the information processing apparatus 10A and the server apparatus 10B may be preinstalled on the ROM 90B.

[0106] The program to be executed by any of the information processing apparatus 10A and the server apparatus 10B may be recorded as a file in an installable or executable format on a computer-readable recording medium such as a CD-ROM, a flexible disk, a CD-R, or a DVD and may be provided as a computer program product.

[0107] The program to be executed by any of the information processing apparatus 10A and the server apparatus 10B may be stored in a computer connected to a network such as the Internet, and downloaded via the network. Alternatively, the program to be executed by any of the information processing apparatus 10A and the server apparatus 10B may be provided or distributed via a network such as the Internet.

[0108] The program to be executed by the information processing apparatus 10A or the server apparatus 10B may cause a computer to function as the individual units of the corresponding one of the information processing apparatus 10A and the server apparatus 10B. The CPU 90A of the computer reads the program from the computer-readable storage medium to a main storage device, and executes the program.

[0109] The information processing apparatus 10A and the server apparatus 10B may each be implemented as a virtual machine that operates on the cloud system.

[0110] According to the present embodiment, the program that implements at least a part of the functional units for carrying out the event editing process may be installed in the external device connected to the information processing apparatus 10A via the network.

[0111] The program executed by the information processing apparatus of any one of the abovedescribed embodiments are provided as files in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a Digital Versatile Disk (DVD).

[0112] Alternatively, the program to be executed by the information processing apparatus according to any one of the above-described embodiments may be stored on a computer connected to a network such as the Internet and downloaded via the network. The program to be executed by the information processing apparatus according to any one of the above-described embodiments may be provided or distributed via a network such as the Internet.

[0113] Moreover, the program in any one of the above-described embodiments may be provided, for example, by being pre-installed in a ROM.

[0114] The program to be executed by the image forming apparatus according to any one of the above-described embodiments has a module configuration including the above-described functional units including, for example, the reception unit 20A, the processing unit 20B, the display data generation unit 20C, and the display control unit 20D. As actual hardware, a CPU (or processor) reads the program from the above-described storage medium and executes the program, such that the instructions are loaded onto the main storage device to implement the above-described functional units on the main storage device.

[0115] The functionality of the elements disclosed herein may be implemented using circuitry or processing circuitry which includes general purpose processors, special purpose processors, integrated circuits, application- specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), and / or combinations thereof which are configured or programmed, using one or more programs stored in one or more memories, to perform the disclosed functionality.Processors are considered processing circuitry or circuitry as they include transistors and other circuitry therein. In the disclosure, the circuitry, units, or means are hardware that carry out or are programmed to perform the recited functionality. The hardware may be any hardware disclosed herein which is programmed or configured to carry out the recited functionality.There is a memory that stores a computer program which includes computer instructions. These computer instructions provide the logic and routines that enable the hardware (e.g., processing circuitry or circuitry) to perform the method disclosed herein. This computer program can be implemented in known formats as a computer-readable storage medium, a computer program product, a memory device, a record medium such as a CD-ROM or DVD, and / or the memory of an FPGA or ASIC.

[0116] The illustrated server apparatuses are only illustrative of one of several computing environments for implementing the embodiments disclosed herein.

[0117] In some embodiments, the information processing apparatus includes multiple computing devices, such as a server cluster. The multiple computing devices are configured to communicate with each other over any type of communications link, including a network, a shared memory, etc. to collectively perform the processes disclosed herein.

[0118] Moreover, the multiple computing devices may be configured to share the processing steps disclosed, for example, in FIG. 17 or FIG. 19 in various combinations. For example, the processes performed by the information processing apparatus can be performed by the server apparatus. Similarly, the functionality of the server apparatus can be performed by the information processing apparatus. Further, the illustrated elements of the information processing apparatus and the server apparatus can be combined into a single server apparatus, or divided between a plurality of machines in combinations other than those described above.

[0119] The above-described embodiments are illustrative and do not limit the present invention. Thus, numerous additional modifications and variations are possible in light of the above teachings. For example, elements and / or features of different illustrative embodiments may be combined with each other and / or substituted for each other within the scope of the present invention. Any one of the above-described operations may be performed in various other ways, for example, in an order different from the one described above.

[0120] Aspects of the present disclosure are, for example, as follows.Aspect 1An information processing system includes a display control unit that displays a first reception screen for receiving an instruction to create a new event associated with spatial information. The display control unit displays the first reception screen, which receives an instruction to create the new event associated with at least a portion of registered spatial information and new spatial information. The registered spatial information is associated with a registered event having been created. The new spatial information is not associated with the registered event.Aspect 2In the information processing system of Aspect 1, the first reception screen includes: a first reception area for receiving an instruction to associate the registered spatial information with the new event; and a second reception area for receiving designation of the new spatial information to be associated with the new event.Aspect 3In the information processing system according to Aspect 1 or Aspect 2, the display control unit displays the first reception screen including a third reception area. The third reception area receives designation of the registered spatial information to be associated with the newevent or designation of the registered spatial information not to be associated with the new event.Aspect 4In the information processing system according to any one of Aspect 1 to Aspect 3, the display control unit displays a second reception screen for receiving an instruction to change the registered event. The display control unit displays, in the second reception screen, a fourth reception area for receiving designation of additional spatial information to be associated with the registered event.Aspect 5In the information processing system according to any one of Aspect 1 to Aspect 4, the display control unit displays the first reception screen. The first reception screen includes a display area for displaying a plurality of registered events in a predetermined order, and a fifth reception area for receiving the instruction to create the new event, the new event to be displayed at a predetermined position in the display area.Aspect 6An information processing system includes a display control unit that displays a display screen including a plurality of events each being associated with spatial information, the plurality of events including a first event and a second event. The spatial information associated with the first event and the spatial information associated with the second event are partially common and partially different from each other. The display control unit causes the first event and the second event to be simultaneously or selectively displayed on the display screen.Aspect 7In the information processing system according to Aspect 6, in a case where the display screen includes information indicating the spatial information, the display control unit displays information indicating the first spatial information associated with the first event andinformation indicating the spatial information not associated with the first event in different appearance.Aspect 8In the information processing system according to Aspect 6 or Aspect 7, in a case where the display screen includes information indicating the spatial information associated with the second event, the display control unit displays information indicating the first spatial information associated with the first event and information indicating the spatial information not associated with the first event in different appearance.Aspect 9An information processing system includes a reception unit that receives an instruction to create an event associated with spatial information, and a processing unit that creates a new event by associating, to the new event, at least a portion of registered spatial information associated with a registered event.Aspect 10An information processing system includes a display control unit that displays a first reception screen for receiving an instruction to create, as a new event, an event associated with spatial information. The display control unit displays a first reception screen, which includes: a display area that displays a plurality of registered events in a predetermined order; and a fifth reception area for receiving an instruction to create the new event, the new event to be displayed at a predetermined position in the display area.Aspect 11An information processing method includes a display control step of displaying a first reception screen for receiving an instruction to create a new event associated with spatial information. The display control step displays the first reception screen, which receives an instruction to create the new event associated with at least a portion of registered spatial information and new spatial information. The registered spatial information is associated witha registered event having been created. The new spatial information is not associated with the registered event.Aspect 12An information processing method includes a display control step of displaying a display screen that includes a plurality of events each being associated with spatial information, the plurality of events including a first event and a second event. The spatial information associated with the first event and the spatial information associated with the second event are partially common and partially different from each other. The display control step causes the first event and the second event to be simultaneously or selectively displayed on the display screen.Aspect 13An information processing method includes a step of receiving an instruction to create an event associated with spatial information, and creating a new event by associating, to the new event, at least a portion of registered spatial information associated with a registered event. Aspect 14An information processing method includes a display control step of displaying a first reception screen for receiving an instruction to create, as a new event, an event associated with spatial information. The display control step includes: a display area that displays a plurality of registered events in a predetermined order; and a fifth reception area for receiving an instruction to create the new event, the new event to be displayed at a predetermined position in the display area.Aspect 15A program causes a computer to function as a display control unit that displays a first reception screen for receiving an instruction to create a new event associated with spatial information. The display control unit displays the first reception screen, which receives an instruction to create the new event associated with at least a portion of registered spatial information and new spatial information. The registered spatial information is associated witha registered event having been created. The new spatial information is not associated with the registered event.Aspect 16A program causes a computer to function as a display control unit that displays a display screen that includes a plurality of events each being associated with spatial information, the plurality of events including a first event and a second event. The spatial information associated with the first event and the spatial information associated with the second event are partially common and partially different from each other. The display control unit causes the first event and the second event to be simultaneously or selectively displayed on the display screen.Aspect 17A program causes a computer to function as: a reception unit that receives an instruction to create an event associated with spatial information; and a processing unit that creates a new event by associating, to the new event, at least a portion of registered spatial information associated with a registered event.Aspect 18A program causes a computer to function as a display control unit that displays a first reception screen for receiving an instruction to create, as a new event, an event associated with spatial information. The display control unit displays the first reception screen, which includes: a display area that displays a plurality of registered events in a predetermined order; and a fifth reception area for receiving an instruction to create the new event, the new event to be displayed at a predetermined position in the display area.

[0121] The present invention can be implemented in any convenient form, for example using dedicated hardware, or a mixture of dedicated hardware and software. The present invention may be implemented as computer software implemented by one or more networked processing apparatuses. The processing apparatuses include any suitably programmedapparatuses such as a general purpose computer, a personal digital assistant, a Wireless Application Protocol (WAP) or third-generation (3G)-compliant mobile telephone, and so on. Since the present invention can be implemented as software, each and every aspect of the present invention thus encompasses computer software implementable on a programmable device. The computer software can be provided to the programmable device using any conventional carrier medium (carrier means). The carrier medium includes a transient carrier medium such as an electrical, optical, microwave, acoustic or radio frequency signal carrying the computer code. An example of such a transient medium is a Transmission Control Protocol / Intemet Protocol (TCP / IP) signal carrying computer code over an IP network, such as the Internet. The carrier medium may also include a storage medium for storing processor readable code such as a floppy disk, a hard disk, a compact disc read-only memory (CD- ROM), a magnetic tape device, or a solid state memory device.

[0123] This patent application is based on and claims priority to Japanese Patent Application No. 2024-121272, filed on July 26, 2024, in the Japan Patent Office, the entire disclosure of which is hereby incorporated by reference herein.[Reference Signs List]

[0124] 10, 10A Information processing device10B Server apparatus11 Storage device14A Display device 20A Reception unit 20B Processing unit20C Display data generation unit20D Display control unit

Claims

CLAIMS1. An information processing system comprising: a display control unit configured to display on a display a first reception screen for receiving an instruction to create a new event associated with spatial information, and receive, via the first reception screen, an instruction to create the new event associated with at least a portion of registered spatial information and new spatial information, the registered spatial information associated with a registered event having been created, and the new spatial information not associated with the registered event.

2. The information processing system according to claim 1, wherein the first reception screen includes: a first reception area for receiving an instruction to associate the at least portion of the registered spatial information with the new event; and a second reception area for receiving designation of the new spatial information to be associated with the new event.

3. The information processing system according to claim 1 or 2, wherein the first reception screen further includes a third reception area for receiving designation of the at least portion of the registered spatial information to be associated with the new event, or designation of another portion of the registered spatial information not to be associated with the new event.

4. The information processing system according to any one of claims 1 to 3, wherein the display control unit is configured to display, on the display, a second reception screen for receiving an instruction to change the registered event, and display, in the second reception screen, a fourth reception area for receiving designation of additional spatial information to be associated with the registered event.

5. The information processing system according to any one of claims 1 to 4, wherein the first reception screen includes: a display area for displaying a plurality of registered events including the registered event in a predetermined order; and a fifth reception area for receiving the instruction to create the new event, the new event to be displayed at a predetermined position in the display area.

6. An information processing system comprising: a display control unit configured to display a display screen that includes a plurality of events each being associated with spatial information, the plurality of events including a first event and a second event, the spatial information associated with the first event and the spatial information associated with the second event being partially common and partially different from each other, and cause the first event and the second event to be simultaneously or selectively displayed on the display screen.

7. The information processing system according to claim 6, wherein, in a case where the display screen includes information indicating the spatial information, the display control unit displays the information indicating the spatialinformation associated with the first event and information indicating the spatial information not associated with the first event in different appearance.

8. The information processing system according to claim 6 or 7, wherein, in a case where the display screen includes the information indicating the spatial information associated with the second event, the display control unit displays the information indicating the spatial information associated with the first event and the information indicating the spatial information not associated with the first event in different appearance.

9. An information processing system, comprising: a reception unit configured to receive an instruction to create an event associated with spatial information; and a processing unit configured to create a new event by associating, to the new event, at least a portion of registered spatial information associated with a registered event.

10. A recording medium storing a computer readable code for controlling a computer system to carry out an information processing method comprising: displaying on a display a first reception screen for receiving an instruction to create a new event associated with spatial information; and receiving, via the first reception screen, an instruction to create the new event associated with at least a portion of registered information and new spatial information, the registered spatial information associated with a registered event having been created, and the new spatial information not associated with the registered event.

11. A recording medium storing a computer readable code for controlling a computer system to carry out an information processing method comprising: displaying a display screen that includes a plurality of events each being associated with spatial information, the plurality of events including a first event and a second event, the spatial information associated with the first event and the spatial information associated with the second event being partially common and partially different from each other, and causing the first event and the second event to be simultaneously or selectively displayed on the display screen.

12. A recording medium storing a computer readable code for controlling a computer system to carry out an information processing method comprising: receiving an instruction to create an event associated with spatial information; and creating a new event by associating, to the new event, at least a portion of registered spatial information associated with a registered event.

Images