Information processing method and information processing system

Abstract

An information processing method according to the present invention comprises a first display process and a second display process. In the first display process, a display unit (52) displays at least one piece of group information that includes information pertaining to an output device (2) which outputs prescribed information and information pertaining to an acquisition device (3) which acquires the prescribed information output from the output device (2). In the second display process, when one piece of group information has been selected from among said at least one piece of group information, the display unit (52) displays an overhead view that indicates the installation locations of the output device (2) and the acquisition device (3) which are included in the selected group information and an object that indicates the output device (2) and the acquisition device (3).

Description

Information processing method and information processing system

[0001] The present disclosure relates to an information processing method and an information processing system.

[0002] Patent Literature 1 discloses a surveillance system that includes a surveillance device and multiple surveillance cameras that are communicatively connected to the surveillance device via a network. The surveillance device is connected to two monitors that display images transmitted from the surveillance cameras.

[0003] JP 2014-171054 A

[0004] The present disclosure provides an information processing method and the like that makes it easier to grasp not only information about an output device that outputs predetermined information, but also information about an acquisition device that acquires the predetermined information output by the output device.

[0005] An information processing method according to one aspect of the present disclosure includes a first display process and a second display process. The first display process is a process of displaying, on a display unit, one or more pieces of group information each including information about an output device that outputs predetermined information and information about an acquisition device that acquires the predetermined information output by the output device. The second display process is a process of, when any one piece of group information is selected, displaying, on the display unit, an overhead view showing installation locations of the output device and the acquisition device included in the selected group information, and objects showing the output device and the acquisition device.

[0006] The present disclosure has an advantage in that it is easy to grasp not only information about an output device that outputs predetermined information, but also information about an acquisition device that acquires the predetermined information output by the output device.

[0007] FIG. 1 is a block diagram showing an overall configuration including an information processing system according to an embodiment. FIG. 2 is a diagram showing an example of information stored in a group management database. FIG. 3 is a diagram showing an example of information stored in an adjustment log database. FIG. 4 is a flowchart showing an example of information registration in the group management database by executing a simulation. FIG. 5 is a flowchart showing an example of information registration in the group management database by executing an initial adjustment process. FIG. 6 is a flowchart showing an example of operation of the information processing system according to an embodiment. FIG. 7 is a diagram showing an example of a basic display on a display unit of an information processing terminal according to an embodiment. FIG. 8 is a diagram showing a first example of display on a display unit of an information processing terminal according to an embodiment. FIG. 9 is a diagram showing a second example of display on a display unit of an information processing terminal according to an embodiment. FIG. 10 is a flowchart showing an example of a third display process of the information processing system according to an embodiment. FIG. 11 is a flowchart showing a specific example of the third display process by the information processing system according to an embodiment. FIG. 12 is a diagram showing a third example of display on a display unit of an information processing terminal according to an embodiment. FIG. 13 is a diagram showing a fourth example of display on a display unit of an information processing terminal according to an embodiment. FIG. 14 is a diagram showing a fifth example of display on a display unit of an information processing terminal according to an embodiment. Fig. 15 is a diagram showing a sixth display example on the display unit of the information processing terminal according to the embodiment, Fig. 16 is a diagram showing a seventh display example on the display unit of the information processing terminal according to the embodiment, and Fig. 17 is a diagram showing an eighth display example on the display unit of the information processing terminal according to the embodiment.

[0008] [1. Findings that Form the Basis of the Present Disclosure] First, the inventor's viewpoint will be explained below.

[0009] Conventionally, systems have been known that monitor whether errors, such as misalignment of projected images, have occurred by capturing images projected by a projector with a camera. However, while such systems allow a user to grasp the status of the monitored projector, they have a problem in that the user cannot intuitively grasp which camera is monitoring the monitored projector. As a result, a user of such systems must associate the camera capturing the projected image with the monitored projector, which can complicate the process of configuring such systems. Another problem with such systems is that a user may associate the wrong camera with the projector.

[0010] In view of the above, the inventors have come up with the present disclosure.

[0011] Hereinafter, embodiments will be described with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component placement and connection forms, steps, step order, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components not described in independent claims will be described as optional components.

[0012] It should be noted that the drawings are schematic diagrams and are not necessarily strict illustrations. In addition, in the drawings, substantially the same components are denoted by the same reference numerals, and overlapping descriptions may be omitted or simplified.

[0013] (Embodiment) [2. Configuration] [2-1. Overall Configuration] First, an overall configuration including an information processing system 100 according to an embodiment will be described. FIG. 1 is a block diagram showing an overall configuration including an information processing system 100 according to an embodiment. The information processing system 100 is a system for managing a projector 2A which is an output device 2, and a camera 3A which is an acquisition device 3. In the embodiment, the information processing system 100 manages one or more groups, with the output device 2 and the acquisition device 3 being one group. In the embodiment, the information processing system 100 is realized by a server 1.

[0014] Here, the output device 2 is a device that outputs predetermined information. For example, the projector 2A is a device that projects an image onto a display surface such as a screen or a wall surface, and is a display device that outputs predetermined information (image). In the embodiment, an image may be projected onto the display surface by one projector 2A, or by multiple projectors 2A. In the latter case, the image is projected onto the display surface by multi-projection, in which a single image is constructed using images projected by each of the multiple projectors 2A.

[0015] Furthermore, the acquisition device 3 is a device that acquires predetermined information output by the output device 2. For example, the camera 3A is a device that captures an image projected by the projector 2A and acquires predetermined information (image) output by the output device 2 (projector 2A). In the embodiment, the camera 3A is used to monitor an image projected onto a display surface by one or more corresponding projectors 2A. The camera 3A is also used to perform an adjustment process that adjusts the position, etc., of an image projected onto a display surface by one or more corresponding projectors 2A.

[0016] When performing the adjustment process using the camera 3A, one or more markers 6, such as light-emitting markers such as LED (Light Emitting Diode) markers, are used. The markers 6 are placed at one or more positions (e.g., the four corners of the projection range) that serve as references for the projection range of the image within the imaging range of the camera 3A.

[0017] In the embodiment, the server 1 (information processing system 100) is used together with one or more projectors 2A, one or more cameras 3A, one or more terminals 4 (here, a first terminal 4A and a second terminal 4B), and an information processing terminal 5. The server 1, the one or more projectors 2A, the one or more cameras 3A, and the one or more terminals 4 can communicate with each other via a network N1 such as the Internet or a LAN (Local Area Network). The server 1 and the information processing terminal 5 can also communicate with each other via a network N2 that is different from the network N1 such as the Internet or a LAN.

[0018] The terminal 4 is a terminal used at an installation location where one or more projectors 2A and one or more cameras 3A are installed, and is, for example, a desktop or laptop personal computer, a tablet terminal, or the like. Here, as shown in FIG. 1 , the terminal 4 used at an installation location where "Projector 1," "Projector 2," and "Projector 3" that are projectors 2A, "Camera 1" and "Camera 2" that are cameras 3A, and "Marker 1" and "Marker 2" that are markers 6 are installed (hereinafter also referred to as the "first installation location") is referred to as the "first terminal 4A." Here, as shown in FIG. 1 , the terminal 4 used at an installation location where "Projector 4" that is projector 2A, "Camera 3" that is camera 3A, and "Marker 3" that is marker 6 are installed (hereinafter also referred to as the "second installation location") is referred to as the "second terminal 4B."

[0019] The terminal 4 includes a communication unit 41 and an adjustment unit 42. The adjustment unit 42 is realized by a processor included in the terminal 4 executing a computer program stored in a memory.

[0020] The communication unit 41 is a communication interface for communicating with the server 1 (information processing system 100). The communication unit 41 transmits an adjustment log, which is the result of the adjustment process performed by the adjustment unit 42, to the server 1 via the network N1. Note that the communication between the communication unit 41 and the server 1 may be wired communication or wireless communication.

[0021] The adjustment unit 42 executes an adjustment process. First, the adjustment unit 42 causes one or more corresponding cameras 3A to capture images projected onto the display surface by one or more projectors 2A. Then, the adjustment unit 42 executes an adjustment process to adjust the position of the image, etc., using the images captured by the one or more cameras 3A. The adjustment process includes, for example, geometric correction, black level adjustment, white balance adjustment, brightness adjustment, focus adjustment, color adjustment, or uniformity adjustment. The adjustment process may be a process in which, for each of one or more parameters to be adjusted (e.g., geometric correction parameters, etc.), the corresponding parameters are automatically adjusted so that the corresponding parameters fall within a predetermined range. Alternatively, the adjustment process may be a process in which a user manually adjusts each of the one or more parameters to be adjusted as appropriate using a GUI (Graphical User Interface) dedicated to the adjustment process.

[0022] The information processing terminal 5 is, for example, a terminal used by a user of the information processing system 100, and is, for example, a smartphone, a desktop or laptop personal computer, a tablet terminal, etc. The information processing terminal 5 includes a communication unit 51 and a display unit 52.

[0023] The communication unit 51 is a communication interface for communicating with the server 1 (information processing system 100). The communication unit 51 receives various information transmitted from the server 1 via the network N2. The communication unit 51 also transmits information input by a user operating the information processing terminal 5 to the server 1 via the network N2. Note that communication between the communication unit 51 and the server 1 may be wired communication or wireless communication.

[0024] The display unit 52 is, for example, a liquid crystal display or an organic EL (Electroluminescence) display, and displays various information transmitted from the server 1 (information processing system 100). The various information displayed on the display unit 52 will be described in detail in [3. Operation] below.

[0025] [2-2. Information Processing System] Next, the configuration of the information processing system 100 will be described in detail. As already mentioned, in the embodiment, the information processing system 100 is realized by a server 1. The information processing system 100 includes a communication unit 11, a processing unit 12, a storage device in which a group management database (hereinafter referred to as "DB") 13 is stored, and a storage device in which an adjustment log DB 14 is stored. The processing unit 12 may be realized by a dedicated circuit, or may be realized by a processor executing a computer program stored in memory. Note that the storage device in which the group management DB 13 and the storage device in which the adjustment log DB 14 are stored do not have to be included in the server 1, and may be an external storage device separate from the server 1.

[0026] The communication unit 11 is a communication interface for communicating with one or more terminals 4 and the information processing terminal 5. The communication unit 11 receives various information transmitted from each terminal 4 via the network N1. The communication unit 11 also transmits various information to the information processing terminal 5 via the network N2. Note that the communication interface for communicating with each terminal 4 and the communication interface for communicating with the information processing terminal 5 may be different from each other or may be the same.

[0027] The processing unit 12 executes a process for displaying various types of information on the display unit 52 of the information processing terminal 5. Specifically, the processing unit 12 executes a first display process, a second display process, and a third display process. In the embodiment, the processing unit 12 executes the second display process, but may not have a function for executing the third display process.

[0028] The first display process is a process of displaying one or more pieces of group information on the display unit 52. The one or more pieces of group information each include information about the projector 2A (output device 2) and information about the camera 3A (acquisition device 3). In the example shown in FIG. 1 , the group information for the group with "Group ID (Identifier): 1" includes at least information about "Projector 1" which is the output device 2 and information about "Camera 1" which is the acquisition device 3, and further includes information about "Marker 1" which is the marker 6. The one or more pieces of group information displayed on the display unit 52 by the first display process will be described in detail in [3. Operation] below.

[0029] Here, the information about the output device 2 only needs to include information that can distinguish the output device 2 from other devices, and may include, for example, an identifier or name of the output device 2. The information about the acquisition device 3 only needs to include information that can distinguish the acquisition device 3 from other devices, and may include, for example, an identifier or name of the acquisition device 3.

[0030] The second display process is a process that is executed when any one of the one or more pieces of group information is selected. The selection of group information is performed, for example, by a user who views the one or more pieces of group information displayed on the display unit 52 and operates the information processing terminal 5. The second display process is a process that displays, on the display unit 52, an overhead view showing the installation locations of the projector 2A (output device 2) and the camera 3A (acquisition device 3) included in the selected group information, and objects showing the projector 2A and the camera 3A. The overhead view and the objects displayed on the display unit 52 by the second display process will be described in detail in [3. Operation] below.

[0031] Furthermore, in the embodiment, the second display process includes a process of further displaying status information indicating the respective statuses of the projector 2A (output device 2) and the camera 3A (acquisition device 3) on the display unit 52. The status information may include, for example, information indicating whether the power of each of the projector 2A and the camera 3A is on, or information indicating whether each of the projector 2A and the camera 3A is operating normally. The status information may also include, for example, information indicating the projection range of the projector 2A, or information indicating the imaging range of the camera 3A.

[0032] The third display process is a process of displaying notification information indicating a change in status information on the display unit 52 when the status of at least one of the projector 2A (output device 2) and the camera 3A (acquisition device 3) has changed from a reference status. For example, assume that the reference status is a status in which the projector 2A is operating normally. In this case, in the third display process, when some abnormality occurs in the projector 2A, notification information indicating that an abnormality has occurred in the projector 2A is displayed on the display unit 52. The notification information displayed on the display unit 52 will be described in detail in [3. Operation] below.

[0033] The processing unit 12 also processes various pieces of information acquired from each of the one or more terminals 4, and executes a process of storing the processed pieces of information in the group management DB 13 and the adjustment log DB 14. This process will be described in detail in [3. Operation] below.

[0034] The group management DB 13 is a data set related to information about one or more groups. FIG. 2 is a diagram illustrating an example of information stored in the group management DB 13. As illustrated in FIG. 2, the group management DB 13 stores, for each group, a group ID, which is an identifier of the group, information indicating one or more devices included in the group, and initial values ​​of adjustment parameters for each of the one or more devices, in association with each other. Note that the group management DB 13 stores, for example, one or more identifiers assigned to each of one or more devices as information indicating the one or more devices. Here, the adjustment parameters include, for example, the position and projection range of the projector 2A if the device is a projector 2A; the position and imaging range of the camera 3A if the device is a camera 3A; and the number and positions of the markers 6 if the device is a marker 6.

[0035] For example, the group indicated by "Group ID: 1" is linked to the identifiers of "Camera 1," "Projector 1," and "Marker 1," as well as the initial values ​​of the position and imaging range of "Camera 1," the initial values ​​of the position and projection range of "Projector 1," and the initial values ​​of the number and position of "Marker 1."

[0036] Furthermore, when a simulation, which will be described later, is executed, the group management DB 13 also stores 3D data generated by the simulation in association with the group ID.

[0037] The adjustment log DB 14 is a data set related to the adjustment log. Fig. 3 is a diagram showing an example of information stored in the adjustment log DB 14. As shown in Fig. 3, the adjustment log DB 14 stores, for each group, a group ID that is an identifier of the group, information indicating one or more devices included in the group, and an adjustment log that indicates adjustment parameters for each of the one or more devices, in association with each other. Note that the adjustment log DB 14 stores, for example, one or more identifiers assigned to each of the one or more devices as information indicating the one or more devices.

[0038] For example, the group indicated by "Group ID: 2" is linked to the identifiers of "Camera 2," "Projector 2," "Projector 3," and "Marker 2," as well as the adjustment log of "Camera 2" (position and imaging range), the adjustment log of "Projector 2" (position and projection range), the adjustment log of "Projector 3" (position and projection range), and the adjustment log of "Marker 2" (number and position).

[0039] 3. Operation The operation of the information processing system 100 according to the embodiment will be described below.

[0040] <3-1. Registration Process> First, before describing the operation of the information processing system 100, a registration process for registering information necessary for the operation of the information processing system 100 in the group management DB 13 and the adjustment log DB 14 will be described.

[0041] 4 is a flowchart showing an example of registering information in the group management DB 13 by executing a simulation. Here, the simulation is a process of placing objects simulating one or more devices in a virtual space simulating an installation location and simulating the operation of the one or more devices. The one or more devices include, for example, a projector 2A, a camera 3A, and a marker 6. The terminal that executes the simulation may be any one of the one or more terminals 4 or the information processing terminal 5. Furthermore, the terminal that executes the simulation may be a terminal other than the one or more terminals 4 and the information processing terminal 5.

[0042] First, a worker operates a terminal on which a simulation application is installed to perform a simulation. Here, the worker performs a simulation based on information about one or more devices used by a group (S101). For example, the worker inputs information about "Camera 1," "Projector 1," and "Marker 1" used by a group indicated by "Group ID: 1" at a first installation location into the terminal, and performs a simulation.

[0043] The terminal that executes the simulation generates 3D data including objects that simulate each of the one or more devices and a virtual space that the objects are installed in. Here, the terminal generates 3D data including objects that simulate each of "camera 1," "projector 1," and "marker 1," and a virtual space that simulates a first installation location where the objects are installed.

[0044] The terminal then transmits the 3D data to the server 1 (information processing system 100) via the network N1. When the communication unit 11 receives the 3D data, the processing unit 12 of the server 1 links the received 3D data to a group and registers the data in the group management DB 13 (S102). For example, if the 3D data has "group ID: 1", the processing unit 12 links the 3D data to "group ID: 1" and registers the data in the group management DB 13.

[0045] The terminal that executes the simulation also generates adjustment parameters for each of the one or more devices. Here, the terminal generates the position and imaging range of "camera 1," the position and projection range of "projector 1," and the number and positions of "markers 1" as adjustment parameters for each of the one or more devices.

[0046] Then, the terminal transmits data including adjustment parameters for each of the one or more devices to the server 1 (information processing system 100) via the network N1. When the communication unit 11 receives the data, the processing unit 12 of the server 1 links the initial values ​​of the adjustment parameters for each of the one or more devices included in the received data to the group management DB 13 and registers them (S103). For example, if the data is assigned a "group ID: 1," the processing unit 12 links the adjustment parameters for each of the one or more devices included in the data to the "group ID: 1" and registers them in the group management DB 13 as the initial values ​​of the adjustment parameters for each of the one or more devices. Here, the position and imaging range of "camera 1," the position and projection range of "projector 1," and the number and positions of "markers 1" are registered in the group management DB 13 as the initial values ​​of the adjustment parameters for each of the one or more devices.

[0047] 5 is a flowchart showing an example of information registration in the group management DB 13 by executing an initial adjustment process. Here, the initial adjustment process is a process in which an operator actually installs one or more devices at an installation site and adjusts adjustment parameters of each of the one or more devices while operating the one or more devices. In this embodiment, the operator executes the initial adjustment process while referring to the results of a simulation.

[0048] First, the worker performs an initial adjustment process by operating a terminal corresponding to the group (in other words, a terminal 4 installed at the installation location of one or more devices) (S201). For example, when performing the initial adjustment process for the group indicated by "group ID: 1," the worker performs the initial adjustment process by operating a first terminal 4A installed at the first installation location. Specifically, in the initial adjustment process, the worker inputs adjustment parameters for each of the one or more devices into the terminal. Here, the worker inputs the position and imaging range of "camera 1," the position and projection range of "projector 1," and the number and positions of "markers 1" at the first installation location into the terminal.

[0049] The terminal executing the initial adjustment process stores the input data as an adjustment log in its memory. The terminal also transmits the adjustment log to the server 1 (information processing system 100) via the network N1 (S202). When the processing unit 12 of the server 1 receives the adjustment log via the communication unit 11 (S203), the processing unit 12 updates the initial values ​​of the adjustment parameters of one or more devices based on the received adjustment log and registers the updated values ​​in the group management DB 13 (S204). For example, if the adjustment log is assigned "group ID: 1," the processing unit 12 updates the adjustment parameters of one or more devices associated with "group ID: 1" registered in the group management DB 13 using the adjustment parameters of the one or more devices included in the adjustment log. Here, the position and imaging range of "camera 1," the position and projection range of "projector 1," and the number and positions of "markers 1" included in the adjustment log are registered in the group management DB 13 as the initial values ​​of the adjustment parameters of the one or more devices.

[0050] Then, the processing unit 12 of the server 1 registers the received adjustment log in the adjustment log DB 14 (S205). For example, if the adjustment log has "group ID: 1" attached, the processing unit 12 associates "group ID: 1" with the adjustment log and stores them in the adjustment log DB 14.

[0051] As described above, in the embodiment, the operator first performs a simulation and then performs the initial adjustment process, but this is not limiting. For example, the operator may perform the initial adjustment process without performing a simulation.

[0052] <3-2. Basic Operation> Next, a basic operation of the information processing system 100 according to the embodiment will be described. Fig. 6 is a flowchart showing an example of the operation of the information processing system 100 according to the embodiment. In the following, it is assumed that the user operates the information processing terminal 5, and a signal instructing the server 1 (information processing system 100) to provide a GUI is transmitted from the information processing terminal 5 to the server 1 (information processing system 100).

[0053] First, the processing unit 12 of the server 1 executes a first display process (S301). Specifically, the processing unit 12 reads out one or more pieces of group information registered in the group management DB 13, and transmits the one or more pieces of group information to the information processing terminal 5 via the network N2. As a result, the display unit 52 of the information processing terminal 5 displays the received one or more pieces of group information.

[0054] Here, if the user selects one of the one or more groups while viewing the one or more group information displayed on the display unit 52 (S302: Yes), the processing unit 12 of the server 1 executes a second display process (S303). Specifically, when the processing unit 12 receives information indicating the selection of one of the groups from the information processing terminal 5 via the communication unit 11, the processing unit 12 reads out 3D data associated with the group registered in the group management DB 13 and transmits the 3D data to the information processing terminal 5 via the network N2. As a result, the display unit 52 of the information processing terminal 5 displays the virtual space (bird's-eye view) of the installation location and the objects included in the received 3D data. Note that if the user does not select any group (S302: No), only the one or more group information continues to be displayed on the display unit 52.

[0055] When transmitting one or more pieces of group information to the information processing terminal 5, the processing unit 12 of the server 1 may also transmit 3D data corresponding to each piece of group information to the information processing terminal 5. In this case, when the information processing terminal 5 receives an input to select one of the groups, it can display the virtual space and objects corresponding to the group on the display unit 52 without communicating with the server 1. In this case, it can be said that the processing unit 12 of the server 1 indirectly executes the second display process via the information processing terminal 5.

[0056] <3-3. Display Examples> Hereinafter, display examples of various types of information displayed on the display unit 52 of the information processing terminal 5 will be described.

[0057] <Basic Display Example> Fig. 7 is a diagram showing a basic display example on the display unit 52 of the information processing terminal 5 according to the embodiment. As shown in Fig. 7, a first area A1, a second area A2, and a third area A3 are displayed on the display unit 52.

[0058] The first area A1 is an area where one or more pieces of group information are displayed. In the example shown in Fig. 7, the first area A1 displays a list of multiple pieces of group information. The area indicated by the dashed line in the first area A1 is a selection area A11 that displays group information selected by the user. In this example, the user has selected the "Tokyo" group, the "Event A" group, and the "2F Garden" group, which is included in the "Stage A" group.

[0059] The second area A2 is an area where an overhead view (here, a virtual space) and objects corresponding to the group information selected in the first area A1 are displayed. In the example shown in Fig. 7, the second area A2 displays a virtual space showing the installation location corresponding to the "2F Garden" group, three first objects Ob11, Ob12, and Ob13 that respectively simulate the three projectors 2A installed in the installation location, and an image I1 projected by the three projectors 2A.

[0060] Thus, in the basic display example, the objects (here, first objects Ob11 to Ob13) are not simply displayed in the second area A2, but are also displayed in the second area A2 together with their positions in the virtual space (bird's-eye view). In other words, in the second display process, the positions of the objects in the bird's-eye view are also displayed on the display unit 52. In the display examples described below, the objects are also displayed on the display unit 52 together with their positions in the bird's-eye view.

[0061] Also displayed in the second area A2 are three detail windows W1, W2, and W3 showing detailed information about the three first objects Ob11, Ob12, and Ob13, respectively. For example, the detail window W1 displays the name of the projector 2A corresponding to the first object Ob11 and information indicating that the power of the projector 2A is on.

[0062] The third area A3 is an area where status information indicating the respective statuses of the projector 2A (output device 2) and the camera 3A (acquisition device 3) is displayed. In the example shown in Fig. 7, a status area A31 indicating the respective statuses of the three projectors 2A is displayed in the third area A3. Although not shown in Fig. 7, a status area indicating the status of the camera 3A may also be displayed.

[0063] 7, the second area A2 and the third area A3 are displayed on the display unit 52, but until a group is selected in the first area A1, the second area A2 and the third area A3 do not have to be displayed on the display unit 52. Furthermore, it is sufficient for the display unit 52 to display the first area A1 and the second area A2, and the third area A3 does not have to be displayed.

[0064] <First Display Example> Fig. 8 is a diagram showing a first display example on the display unit 52 of the information processing terminal 5 according to the embodiment. The example shown in Fig. 8 shows only the second area A2 displayed on the display unit 52. In the example shown in Fig. 8, the second area A2 displays a virtual space showing an installation location corresponding to the "2F Garden" group, three first objects Ob11, Ob12, and Ob13 that respectively simulate three projectors 2A installed at the installation location, and an image I1 projected by the three projectors 2A. The second area A2 also displays two second objects Ob21 and Ob22 that respectively simulate two cameras 3A installed at the installation location.

[0065] 8, the trapezoidal area indicated by a solid line based on the second object Ob21 represents the imaging range of the camera 3A corresponding to the second object Ob21. The trapezoidal area indicated by a dashed line based on the second object Ob22 represents the imaging range of the camera 3A corresponding to the second object Ob22.

[0066] These areas are not displayed on the display unit 52 until the user selects one of the two second objects Ob21, Ob22. Then, when the user selects one of the two second objects Ob21, Ob22, the imaging range of the camera 3A corresponding to the selected second object is displayed on the display unit 52. This allows the user to understand the imaging range of the selected camera 3A.

[0067] <Second Display Example> Fig. 9 is a diagram showing a second display example on the display unit 52 of the information processing terminal 5 according to the embodiment. As with the first display example, the example shown in Fig. 9 shows only the second area A2 displayed on the display unit 52. Below, a description of points common to the first display example will be omitted.

[0068] 9, the quadrangular pyramid-shaped area indicated by solid lines based on the first object Ob11 represents the projection range of the projector 2A corresponding to the first object Ob11. The quadrangular pyramid-shaped area indicated by dashed lines based on the first object Ob12 represents the projection range of the projector 2A corresponding to the first object Ob12. The quadrangular pyramid-shaped area indicated by dashed lines based on the first object Ob13 represents the projection range of the projector 2A corresponding to the first object Ob13.

[0069] These areas are not displayed on the display unit 52 until the user selects one of the three first objects Ob11, Ob12, and Ob13. Then, when the user selects one of the three first objects Ob11, Ob12, and Ob13, the projection range of the projector 2A corresponding to the selected first object is displayed on the display unit 52. This allows the user to understand the projection range of the selected projector 2A.

[0070] Before describing the third to seventh display examples, an example of the third display process of the information processing system 100 according to the embodiment will be described. The third to seventh display examples described below each show various types of information displayed on the display unit 52 of the information processing terminal 5 by the third display process.

[0071] 10 is a flowchart showing an example of the third display process of the information processing system 100 according to the embodiment. The following description is based on the assumption that the initial adjustment process has already been executed, i.e., that the initial values ​​of the adjustment parameters of one or more devices have already been set. The following description focuses on the adjustment process on one of the multiple terminals 4.

[0072] First, an adjustment process is executed on any terminal 4 (S401). Then, after executing the adjustment process, the terminal 4 transmits the execution result of the adjustment process as an adjustment log to the server 1 (information processing system 100) via the network N1 (S402).

[0073] When the communication unit 11 receives the adjustment log (S403), the processing unit 12 of the server 1 updates the adjustment log by overwriting the received adjustment log onto the adjustment log stored in the adjustment log DB 14 (S404). For example, if the adjustment log has "group ID: 1", the processing unit 12 overwrites the adjustment log associated with "group ID: 1" stored in the adjustment log DB 14 with the adjustment log, thereby updating it.

[0074] Then, the processing unit 12 of the server 1 analyzes the received adjustment log (S405). Here, the processing unit 12 analyzes the adjustment log by comparing the adjustment parameters of each of the one or more devices included in the received adjustment log with the initial values ​​of the adjustment parameters of each of the one or more devices registered in the group management DB 13. Note that step S405 may be executed automatically when the adjustment log is received, or may be executed when the user performs a predetermined operation on the information processing terminal 5.

[0075] If the analysis results in a change in the adjustment parameters of any of the devices (S406: Yes), the processing unit 12 of the server 1 transmits notification information indicating that there has been a change in the status of the device to the information processing terminal 5 via the network N2, thereby causing the notification information to be displayed on the display unit 52 of the information processing terminal 5 (S407). On the other hand, if there has been no change in the adjustment parameters of any of the devices (S406: No), the processing unit 12 causes the display unit 52 to maintain the current display of various information.

[0076] Fig. 11 is a flowchart showing a specific example of the third display process by the information processing system 100 according to the embodiment. Fig. 11(a) shows an example in which the imaging range of the camera 3A has changed as an adjustment parameter of the device, and Fig. 11(b) shows an example in which the projection range of the projector 2A has changed as an adjustment parameter of the device. Note that the example shown in Fig. 11 represents an example of processing that is executed when the user operates the information processing terminal 5 to select one of the devices.

[0077] In the example shown in FIG. 11A, the user selects camera 3A included in an arbitrary group (S501). Then, the processing unit 12 of the server 1 reads and acquires the imaging range of the selected camera 3A linked to the group ID indicating the group from the group management DB 13 (S502). The processing unit 12 also reads and acquires the adjustment log linked to the group ID indicating the group from the adjustment log DB 14 (S503). The processing unit 12 then compares the imaging range of the selected camera 3A with the imaging range of camera 3A included in the adjustment log, and corrects the imaging range of the selected camera 3A (S504). The processing unit 12 then superimposes and displays the corrected imaging range of camera 3A on the display unit 52 of the information processing terminal 5 (S505). Therefore, the display unit 52 displays the imaging range of camera 3A before correction (i.e., the initial value of the imaging range of camera 3A) and the imaging range of camera 3A after correction. This allows the user to know that there has been a change in the imaging range of camera 3A.

[0078] In the example shown in FIG. 11B, a user selects a projector 2A included in an arbitrary group (S601). The processing unit 12 of the server 1 then reads and acquires the projection range of the selected projector 2A associated with the group ID representing the group from the group management DB 13 (S602). The processing unit 12 also reads and acquires the adjustment log associated with the group ID representing the group from the adjustment log DB 14 (S603). The processing unit 12 then compares the projection range of the selected projector 2A with the projection range of the projector 2A included in the adjustment log, and corrects the projection range of the selected projector 2A (S604). The processing unit 12 then superimposes the corrected projection range of the projector 2A and displays it on the display unit 52 of the information processing terminal 5 (S605). Therefore, the projection range of projector 2A before correction (i.e., the initial value of the projection range of projector 2A) and the projection range of projector 2A after correction are displayed on display unit 52. This allows the user to understand that there has been a change in the projection range of projector 2A.

[0079] <Third Display Example> Fig. 12 is a diagram showing a third display example on the display unit 52 of the information processing terminal 5 according to the embodiment. As with the first display example, the example shown in Fig. 12 shows only the second area A2 displayed on the display unit 52. Below, a description of points common to the first display example will be omitted.

[0080] 12, the error icon E1 near the first object Ob11 indicates that there has been some change in the state of the projector 2A corresponding to the first object Ob11. The error icon E2 near the second object Ob21 indicates that there has been some change in the state of the camera 3A corresponding to the second object Ob21. By looking at the error icons E1 and E2, the user can understand that there has been some change in the state of the projector 2A and the state of the camera 3A.

[0081] <Fourth Display Example> Fig. 13 is a diagram showing a fourth display example on the display unit 52 of the information processing terminal 5 according to the embodiment. As with the third display example, the example shown in Fig. 13 shows only the second area A2 displayed on the display unit 52. Below, a description of points common to the third display example will be omitted.

[0082] 13, a rectangular area A41 indicated by a dashed line near the first object Ob11 represents the initial projection range of the projector 2A corresponding to the first object Ob11. Furthermore, a rectangular area A42 indicated by a solid line near the first object Ob11 represents the current projection range of the projector 2A corresponding to the first object Ob11. By looking at these areas A41 and A42, the user can understand in which direction and to what extent the projection range of the projector 2A has deviated from the initial projection range.

[0083] 13, the second object Ob21 indicated by a dashed line represents the initial position of the camera 3A corresponding to the second object Ob21. The second object Ob21 indicated by a solid line represents the current position of the camera 3A corresponding to the second object Ob21. By looking at these second objects Ob21, the user can understand in which direction and by how much the position of the camera 3A has deviated from the initial position.

[0084] <Fifth Display Example> Fig. 14 is a diagram showing a fifth display example on the display unit 52 of the information processing terminal 5 according to the embodiment. As with the third display example, the example shown in Fig. 14 shows only the second area A2 displayed on the display unit 52. Hereinafter, a description of points common to the third display example will be omitted.

[0085] 14, a rectangular area A51 indicated by a dashed line represents the correctable limit of the projection range of the projector 2A corresponding to the first object Ob11. A rectangular area A52 indicated by a solid line represents the current projection range of the projector 2A corresponding to the first object Ob11. Two elliptical areas A53 and A54 represent that the correctable range of the projection range of the projector 2A corresponding to the first object Ob11 is approaching its limit. By looking at these areas A51 to A54, the user can understand that the correctable range of the projection range of the projector 2A corresponding to the first object Ob11 is approaching its limit.

[0086] <Sixth Display Example> Fig. 15 is a diagram showing a sixth display example on the display unit 52 of the information processing terminal 5 according to the embodiment. As with the third display example, the example shown in Fig. 15 shows only the second area A2 displayed on the display unit 52. Hereinafter, a description of points common to the third display example will be omitted.

[0087] In the example shown in Fig. 15, three first objects Ob11, Ob12, and Ob13 simulating three projectors 2A installed on the ground are displayed in the second area A2. In Fig. 15, an area A61 indicated by a triangular dashed line with the first object Ob13 as the reference represents the initial adjustment area for the black level of the projector 2A corresponding to the first object Ob13. An area A62 indicated by a triangular solid line with the first object Ob13 as the reference represents the current adjustment area for the black level of the projector 2A corresponding to the first object Ob13. By looking at these triangular areas A61 and A62, the user can understand that the black level adjustment area has shifted due to a positional shift of the projector 2A.

[0088] <Seventh Display Example> Fig. 16 is a diagram showing a seventh display example on the display unit 52 of the information processing terminal 5 according to the embodiment. As with the third display example, the example shown in Fig. 16 shows only the second area A2 displayed on the display unit 52. Hereinafter, a description of the points common to the third display example will be omitted.

[0089] In the image I1 shown in Fig. 16, a rectangular area A71 that is darker than other areas indicates that the brightness of the light source of the projector 2A, which has that area as its projection range, has decreased from its initial state. Whether the brightness of the light source of the projector 2A has decreased from its initial state can be estimated, for example, using an appropriate light source life analysis algorithm. By looking at this rectangular area A71, the user can understand that the life of the light source of the projector 2A is shortening.

[0090] In the first to seventh display examples described above, a virtual space simulating the installation location is displayed as a bird's-eye view on the display unit 52 of the information processing terminal 5. However, this is not limiting. For example, the display unit 52 of the information processing terminal 5 may display a planar map including the installation location as a bird's-eye view, as in the eighth display example described below.

[0091] <Eighth Display Example> Fig. 17 is a diagram showing an eighth display example on the display unit 52 of the information processing terminal 5 according to the embodiment. In the example shown in Fig. 17, only the second area A2 displayed on the display unit 52 is shown. Also, in the example shown in Fig. 17, a plan view including the installation location corresponding to the group information selected in the first area A1 is displayed in the second area A2 as a bird's-eye view. Also, in the example shown in Fig. 17, a second object Ob23 simulating a camera 3A installed at the installation location and two detail windows W4 and W5 corresponding to two projectors 2A (not shown) are displayed. Note that in Fig. 17, the trapezoidal area indicated by a solid line based on the second object Ob23 represents the imaging range of the camera 3A corresponding to the second object Ob23.

[0092] An error icon E2 indicating that some change has occurred in the status of the corresponding camera 3A is displayed near the second object Ob23. Furthermore, an error icon E1 indicating that some change has occurred in the status of the corresponding projector 2A is displayed in the details window W5. Furthermore, the content of the error for the corresponding projector 2A (here, a deviation in the projection range) is displayed as a character string near the details window W5.

[0093] By looking at the second area A2, the user can understand the projector 2A and camera 3A at the installation location. Furthermore, by performing an operation to select the second object Ob23, the user can view the image captured by the camera 3A. In the example shown in Fig. 17 , the image captured by the camera 3A is displayed to the left of the second object Ob23. By looking at this image, the user can understand that there is a discrepancy between the projection ranges of the two projectors 2A.

[0094] [4. Advantages, etc.] Advantages of the information processing system 100 (information processing method) according to the embodiment will be described below. As already mentioned, the system described in [1. Knowledge Forming the Basis of the Present Disclosure] has the problem that, while a user can grasp the status of a monitored projector, the user cannot intuitively grasp which camera is monitoring the monitored projector. In other words, the system has the problem that, while a user can grasp information about the output device (projector), the user cannot grasp information about the acquisition device (camera). As a result, a user of the system must associate the acquisition device with the output device, which tends to complicate the work required to build the system. Another problem with the system is that a user may associate the wrong acquisition device with the output device.

[0095] In contrast, the information processing system 100 according to the embodiment can display one or more pieces of group information, each of which includes information about the output device 2 (projector 2A) and information about the acquisition device 3 (camera 3A), on the display unit 52. Furthermore, in the information processing system 100 according to the embodiment, when any piece of group information is selected, an overhead view showing the installation locations of the output device 2 (projector 2A) and the acquisition device 3 (camera 3A) included in the selected group information, and objects showing the output device 2 and the acquisition device 3, can be displayed on the display unit 52. Therefore, the information processing system 100 according to the embodiment has an advantage that the user can understand what output device 2 and acquisition device 3 are installed at the installation location by looking at the display unit 52, making it easier to understand not only information about the output device 2 but also information about the acquisition device 3. Another advantage is that the user does not need to associate the acquisition device 3 with the output device 2, and the user will not associate the wrong acquisition device 3 with the output device 2.

[0096] 5. Other Embodiments Although the embodiments have been described above, the present disclosure is not limited to the above-described embodiments.

[0097] For example, in the above embodiment, the information processing system 100 displays various pieces of information on the display unit 52 of the information processing terminal 5, but this is not limiting. For example, the information processing system 100 may use a display provided in the server 1 as a display unit and display various pieces of information on the display.

[0098] In the above embodiment, the information processing system 100 is realized by a single device (server 1), but this is not limiting. For example, the information processing system 100 may be realized by multiple devices. In other words, multiple components included in the information processing system 100 may be distributed across two or more devices.

[0099] In the above embodiment, the information processing system 100 is realized by the server 1, but this is not limiting. For example, the information processing system 100 may be provided in an information processing terminal such as a personal computer installed in a closed space. In other words, the information processing system 100 may be realized by cloud computing or edge computing.

[0100] In the above-described embodiment, the processing performed by a specific processing unit may be performed by another processing unit. The order of multiple processing operations may be changed, or multiple processing operations may be performed in parallel.

[0101] In the above-described embodiments, each component may be realized by executing a software program suitable for that component, or by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0102] Furthermore, each component may be realized by hardware. Each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0103] Furthermore, the general or specific aspects of the present disclosure may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0104] The present disclosure may also be realized as an information processing method executed by a computer such as the information processing system of the above-described embodiment. The present disclosure may also be realized as a program (computer program product) for causing a computer to execute such an information processing method, or as a computer-readable non-transitory recording medium on which such a program is recorded.

[0105] In addition, this disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art would think of, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the intent of this disclosure.

[0106] (Summary) As described above, the information processing method according to the first aspect includes a first display process and a second display process. The first display process is a process of displaying, on the display unit 52, one or more pieces of group information each including information about an output device 2 that outputs predetermined information and information about an acquisition device 3 that acquires the predetermined information output by the output device 2. The second display process is a process of, when any one piece of group information from the one or more pieces of group information is selected, displaying, on the display unit 52, an overhead view showing the installation locations of the output device 2 and the acquisition device 3 included in the selected group information, and objects showing the output device 2 and the acquisition device 3.

[0107] In such an information processing method, the user can understand what kind of output device 2 and acquisition device 3 are installed at the installation location by looking at the display unit 52. Therefore, such an information processing method has the advantage that the user can easily understand not only information about the output device 2 that outputs predetermined information, but also information about the acquisition device 3 that acquires the predetermined information output by the output device 2.

[0108] Also, for example, in the information processing method according to the second aspect, in the first aspect, the second display process further causes the display unit 52 to display the position of the object in the bird's-eye view.

[0109] Such an information processing method has the advantage that the user can easily understand where the output device 2 and the acquisition device 3 are installed at the installation location by looking at the position of the object displayed on the display unit 52.

[0110] Also, for example, in the information processing method according to the third aspect, in the first or second aspect, the second display process further displays status information indicating the respective statuses of the output device 2 and the acquisition device 3 on the display unit 52.

[0111] Such an information processing method has the advantage that the user can easily understand the status of each of the output device 2 and the acquisition device 3 by looking at the status of each of the output device 2 and the acquisition device 3 displayed on the display unit 52.

[0112] Also, for example, in the information processing method according to the fourth aspect, in any one of the first to third aspects, at least one of the one or more group information is obtained by placing an object in a virtual space that simulates the installation location and performing a simulation that simulates the operation of the output device 2 and the acquisition device 3.

[0113] Such an information processing method has the advantage that by performing a simulation, the group information can be displayed on the display unit 52 before the user actually installs the output device 2 and the acquisition device 3 at the installation location, making it easier for the user to understand the group information.

[0114] Also, for example, the information processing method according to the fifth aspect further includes a third display process for displaying notification information indicating a change in the status information on the display unit 52 when the status of at least one of the output device 2 and the acquisition device 3 changes from a reference state in the third aspect.

[0115] Such an information processing method has the advantage that the user can easily understand that there has been a change in the status of at least one of the output device 2 and the acquisition device 3 by looking at the notification information displayed on the display unit 52.

[0116] Also, for example, in the information processing method according to the sixth aspect, in any one of the first to fifth aspects, the output device 2 is a display device (projector 2A) that outputs an image, and the acquisition device 3 is a camera 3A that captures and acquires the image output by the display device.

[0117] In such an information processing method, the user can see what kind of display device and camera 3A are installed at the installation location by looking at the display unit 52, which has the advantage that the user can easily understand not only information about the display device but also information about the camera 3A.

[0118] Also, for example, in the information processing method according to the seventh aspect, in the sixth aspect, the second display process further displays on the display unit 52 the range (projection range) of the image output by the display device (projector 2A) and the imaging range of the camera 3A.

[0119] Such an information processing method has the advantage that the user can easily understand how the display device (projector 2A) is outputting the image and how the camera 3A is capturing the image by looking at the range of the image and the capturing range displayed on the display unit 52.

[0120] Furthermore, for example, the information processing system 100 according to the eighth aspect includes a processing unit 12. The processing unit 12 executes a first display process and a second display process. The first display process is a process of displaying, on the display unit 52, one or more pieces of group information each including information about an output device 2 that outputs predetermined information and information about an acquisition device 3 that acquires the predetermined information output by the output device 2. The second display process is a process of, when any of the one or more pieces of group information is selected, displaying, on the display unit 52, an overhead view showing installation locations of the output device 2 and the acquisition device 3 included in the selected group information, and objects showing the output device 2 and the acquisition device 3.

[0121] In such an information processing system 100, the user can understand what kind of output device 2 and acquisition device 3 are installed at the installation location by looking at the display unit 52. Therefore, such an information processing system 100 has the advantage that the user can easily understand not only information about the output device 2 that outputs predetermined information, but also information about the acquisition device 3 that acquires the predetermined information output by the output device 2.

[0122] The present disclosure is applicable to, for example, a system for monitoring an output device and an acquisition device.

[0123] REFERENCE SIGNS LIST 1 Server 2 Output device 3 Acquisition device 4 Terminal 5 Information processing terminal 6 Marker 11 Communication unit 12 Processing unit 13 Group management DB 14 Adjustment log DB 2A Projector 3A Camera 41 Communication unit 42 Adjustment unit 4A First terminal 4B Second terminal 51 Communication unit 52 Display unit 100 Information processing system A1 First area A2 Second area A3 Third area A11 Selection area A31 Status area A41, A42, A51 to A54, A61, A62, A71 Area E1, E2 Error icon I1 Image N1, N2 Network Ob11, Ob12, Ob13 First object Ob21, Ob22, Ob23 Second object W1, W2, W3, W4, W5 Detail window

Claims

1. An information processing method comprising: a first display process for displaying on a display unit one or more pieces of group information each including information on an output device that outputs specified information and information on an acquisition device that acquires the specified information output by the output device; and a second display process for, when any one of the one or more pieces of group information is selected, displaying on the display unit an overhead view showing installation locations of the output device and the acquisition device included in the selected group information, and objects showing the output device and the acquisition device.

2. The information processing method according to claim 1, wherein in the second display process, the position of the object in the overhead view is further displayed on the display unit.

3. The information processing method according to claim 1 or 2, wherein in the second display process, status information indicating the respective statuses of the output device and the acquisition device is further displayed on the display unit.

4. An information processing method according to claim 1 or 2, wherein at least one of the one or more group information is obtained by placing the object in a virtual space simulating the installation location and performing a simulation to simulate the operation of the output device and the acquisition device.

5. The information processing method according to claim 3, further comprising a third display process for displaying, on the display unit, notification information indicating that there has been a change in the status information when the status of at least one of the output device and the acquisition device has changed from a reference state.

6. The information processing method according to claim 1 or 2, wherein the output device is a display device that outputs video, and the acquisition device is a camera that captures and acquires the video output by the display device.

7. The information processing method according to claim 6, wherein in the second display process, the range of the image output by the display device and the imaging range of the camera are further displayed on the display unit.

8. An information processing system comprising: a processing unit that executes a first display process for displaying on a display unit one or more pieces of group information each including information on an output device that outputs specified information and information on an acquisition device that acquires the specified information output by the output device; and a second display process for, when any one of the one or more pieces of group information is selected, displaying on the display unit an overhead view showing installation locations of the output device and the acquisition device included in the selected group information, and objects showing the output device and the acquisition device.