Display device, management apparatus, and display method

Abstract

To extract and display candidates of equipment to be used, in a simple way.SOLUTION: A display device 2 includes: a log storage unit which records, as log information, members or attributes of the members, a first object disposed in a predetermined region, and a first position where the first object is disposed; a log selection unit which selects the log information including a predetermined member or an attribute of the predetermined member; and a landscape generation unit which generates an image in which the first object is disposed in the first position in the predetermined region, based on the selected log information.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a display device, a management device, and a display method. [Background technology]

[0002] In recent years, users have been selecting which facility to use based on the purpose of use, the presence or absence of specific equipment, etc. Such facilities are usually difficult to use simultaneously by multiple users with different purposes during the same time period, so reservations are made to use the facilities.

[0003] On the other hand, computer processing is being used to display the layout of rooms in facilities on a display screen, and to generate simulation images in which various objects are freely arranged within the displayed rooms.

[0004] Patent Document 1 proposes a system that acquires floor plan information from photographed images of a room and displays an image in which 3D models of furniture selected according to the user's preferences are overlaid on the room. The system acquires the user's preferences by asking questions about the user's preferences, and by comparing the answers to the questions with furniture information parameters stored in a log, it is possible to identify the most suitable furniture as potential purchases. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-103527 Summary of the Invention [Problem to be solved by the invention]

[0006] Generally, when reserving shared facilities, users must use a computer to find facilities that fit their intended use and then make a reservation using a reservation system. However, users want to be able to reserve facilities as easily as possible while checking the status of candidate facilities.

[0007] The present disclosure provides a display device, a management device, and a display method that can display candidate facilities to be used in a simple manner. [Means for solving the problem]

[0008] The display device according to the present disclosure includes a log storage unit that records a member or an attribute of the member, a first object placed in a predetermined area, and a first position where the first object is placed as log information, a log selection unit that selects the log information that includes the predetermined member or an attribute of the predetermined member, and a landscape generation unit that generates an image in which the first object is placed at the first position in the predetermined area based on the selected log information. This makes it possible to generate an image in which an object is placed at a predetermined position in a predetermined area while utilizing past data.

[0009] The management device according to the present disclosure includes a display device and a reservation management server that makes reservations for equipment in which the first object is placed at a first position. This allows facility reservation management to be performed using an image in which an object is placed at a predetermined position in a predetermined area while utilizing past data. [Effects of the Invention]

[0010] According to the present disclosure, it is possible to provide a display device, a management device, and a display method that can display candidate facilities to be used in a simple manner. [Brief explanation of the drawings]

[0011] [Figure 1]FIG. 2 illustrates an example of a configuration of a management device according to the first embodiment; [Figure 2] FIG. 10 is a diagram illustrating the first half of the operation flow of the management device according to the first embodiment. [Figure 3] FIG. 10 is a diagram illustrating the second half of the operational flow of the management device according to the first embodiment. [Figure 4] FIG. 10 is a diagram illustrating an example of a configuration of a display device according to a second embodiment. [Figure 5] FIG. 10 is a diagram showing an operation flow of the display device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Embodiment 1 The management system according to the present embodiment will be described below with reference to the drawings.

[0013] As shown in FIG. 1, the management device 1 will be described as a management system that reserves resources. Here, resources may include any of equipment, facilities, devices, instruments, and devices. Resources do not need to be installed in advance at the location where they are used. Furthermore, the location where the resources are used may be a room or a predetermined area. The management device 1 includes an input unit 11, a control unit 12, a storage unit 13, and an output unit 14. Note that the following describes the management of resources in a predetermined experiment. In particular, resources used in a predetermined experiment may be referred to as experimental equipment, and the predetermined area where the experimental equipment is used may be referred to as a laboratory.

[0014] The input unit 11 may accept various operations from the user via a touch panel display, or may accept various operations from the user using various buttons, a keyboard, or a mouse. The input unit 11 may also include a microphone and a camera. Here, a user is someone who reserves resources using the management device 1. The control unit 12 includes a processor implemented using a CPU (Central Processing Unit) etc. The control unit 12 may include a main storage device implemented using a RAM (Random Access Memory) etc., or an auxiliary storage device implemented using a hard disk, an SSD (Solid State Drive), a memory card, a ROM (Read Only Memory) etc. The storage unit 13 includes a main storage device and an auxiliary storage device. The output unit 14 may include a display or a head mounted display (HMD). The management device 1 may be configured as a smartphone or a PC.

[0015] The management device 1 can be realized by a configuration of a display device such as a terminal used by a user and a management device that manages laboratories and reservations. In this case, the display device has a conversation input section 111 and a command input section 112 of the input unit 11, which will be described later, and an experiment scene display section 141 of the output unit 14, and the other components can be included in the management device, but is not limited to this configuration.

[0016] The input unit 11 outputs the input information to the control unit 12 and the storage unit 13. The control unit 12 and the storage unit 13 can input and output information to and from each other. The output unit 14 outputs information processed under the control of the control unit 12.

[0017] The input unit 11 includes a conversation input unit 111 , a command input unit 112 , and an experimental scene photographing unit 113 .

[0018] The conversation input unit 111 is an input unit that inputs the user's voice. An information terminal device such as a smartphone or a PC can be used as the conversation input unit 111. Here, the conversation input unit 111 outputs the acquired user conversation to a topic extraction unit 121 of the control unit 12, which will be described later.

[0019] The command input unit 112 is an input unit for checking and operating the image of the experiment scene and the scene of the laboratory output by the output unit 14 described below. Typically, the command input unit 112 is an input unit for inputting based on manual operation by the user. An information terminal device such as a smartphone or a PC can be used as the command input unit 112. More specifically, the command input unit 112 can use a touch panel if it is a smartphone or a tablet, or a mouse, keyboard, etc. if it is a PC or the like.

[0020] The experimental scene photographing unit 113 is a camera used to photograph the experimental scene on the day of the experiment. The experimental scene photographing unit 113 can be a plurality of cameras installed in the laboratory. The camera can be a small UAV (Unmanned Aerial Vehicle) or any other device that can acquire the coordinates of people and experimental equipment within the photographed experimental scene.

[0021] The control unit 12 includes a topic extraction unit 121 , an experiment scene generation unit 122 , and an equipment position determination unit 123 .

[0022] The topic extraction unit 121 receives input of the conversation content from the conversation input unit 111 and extracts topics. Specifically, the topic extraction unit 121 extracts, from the conversation content, the experiment members, the purpose of the experiment, the experiment equipment, and the location of the experiment equipment as topics. Here, the experiment members are people who use the laboratory. The experiment members may include users who reserve the laboratory using the management device 1. The topic extraction unit 121 can use voice recognition technology using artificial intelligence. The topic extraction unit 121 may include a machine learning model that learns the relationship between voice and text. The topic extraction unit 121 may store predetermined words related to various topics, including the experiment members, the purpose of the experiment, the experiment equipment, and the location of the experiment equipment, in association with the topic type. The topic extraction unit 121 may convert the voice of the conversation content into text using a machine learning model, and if the converted text contains a predetermined word, extract a topic based on the topic type stored in association with the word.

[0023] The experimental scene generation unit 122 generates three-dimensional experimental scene data using AR (Augmented Reality) technology. Here, the experimental scene data is data for generating an image showing experimental equipment arranged in a laboratory. The experimental scene generation unit 122 can generate new experimental scene data that differs from the stored experimental scene data based on the topics extracted by the topic extraction unit 121 and the experimental scene data stored in the storage unit 13 described below.

[0024] The equipment position determination unit 123 determines the locations in the laboratory where the experimental equipment should be installed based on the information about the locations of the experimental equipment obtained from the topic extraction unit 121. For example, the equipment position determination unit 123 represents the entire laboratory using three-dimensional coordinates, and based on the information about the locations of the experimental equipment obtained from the topic extraction unit 121, determines the location within these three-dimensional coordinates where each piece of experimental equipment should be installed.

[0025] The storage unit 13 includes an experiment scene data log server 131, an experiment equipment data server 132, and a reservation management server 133. In reality, the storage unit 13 is a server provided on a network, and may be a single server device, or each may be an independent server device.

[0026] The experiment scene data log server 131 stores text information and 3D model data information. The text information in the experiment scene data log server 131 records information such as the date and time of the experiment, the department that conducted the experiment, the experiment members, the purpose of the experiment, and the experimental equipment used. The 3D model data information in the experiment scene data log server 131 includes floor plan information showing the appearance of the experiment room, including information on the shape of the experiment room and objects arranged in the experiment room, and coordinate information showing the installation location of the experiment equipment, and data for generating a 3D model of the experiment scene is recorded as experiment scene data. In other words, this 3D model data information is CAD (Computer Aided Design) data or the like. The information on objects arranged in the experiment room included in the 3D model data information in the experiment scene data log server 131 may include information on objects that are installed in the experiment room and difficult to move (e.g., tables) and information on objects that are installed in the experiment room and easy to move (e.g., chairs). The experiment scene data log server 131 may store images of experiment scenes including people and experiment equipment captured by the experiment scene photographing unit 113. The control unit 12 may perform image recognition processing on the images captured by the experiment scene photographing unit 113 to recognize people and experiment equipment. The experiment scene data log server 131 may store data of the recognized people and experiment equipment.

[0027] The experimental equipment data server 132 stores text information and 3D model data information. The text information in the experimental equipment data server 132 records the experimental equipment, the department that manages the experimental equipment, and the serial number. The 3D model data information in the experimental equipment data server 132 records data for generating a 3D model of the experimental equipment based on the dimensional data of the experimental equipment. In other words, this 3D model data information is CAD data or the like. The experimental equipment data server 132 stores information about the experimental equipment in advance.

[0028] The reservation management server 133 stores text information. The text information in the reservation management server 133 records information such as the date and time of the experiment, the department conducting the experiment, the person making the reservation, the purpose of the experiment, and the experimental equipment to be used. The reservation management server 133 may be updated based on information input from the conversation input unit 111 or command input unit 112 each time a user reserves a laboratory. Examples of data stored in the experiment scene data log server 131, the experiment equipment data server 132, and the reservation management server 133 are shown in Tables 1, 2, and 3 below, respectively. Here, a given row in any of the tables is called a record. [Table 1] [Table 2] [Table 3]

[0029] The output unit 14 includes an experiment scene display unit 141 and an equipment transport unit 142 .

[0030] The experiment scene display unit 141 displays the experiment scene generated by the experiment scene generation unit 122 and the equipment position determination unit 123. For example, the experiment scene display unit 141 is the screen of an information terminal device such as a smartphone or PC held by the user.

[0031] Furthermore, when a user makes a reservation for equipment by operating the command input unit 112, the experimental scene display unit 141 can display equipment that is output as a candidate, display thumbnail images of the equipment if there are multiple candidates, and display a reservation confirmation screen, etc.

[0032] For example, the equipment position determination unit 123 acquires the experiment member (person D1) and experiment equipment (equipment R1) included in the topic extracted by the topic extraction unit 121. The equipment position determination unit 123 searches the experiment scene data log server 131 for a record including the experiment member person D1 included in the topic, and acquires data M1 as laboratory data. If multiple records are found, the equipment position determination unit 123 selects any one of the records.

[0033] The equipment position determination unit 123 searches the experimental equipment data server 132 for a record including the experimental equipment R1 included in the topic, and acquires data S1 as data on the experimental equipment.

[0034] The equipment position determination unit 123 places the experimental equipment R1 indicated by data S1 in the laboratory indicated by data M1. If data M1 includes dimensional data of a table in the laboratory, the equipment position determination unit 123 calculates the position of the center of the table from the dimensions of the table included in data M1, and places the experimental equipment R1 at that position.

[0035] The experimental scene generation unit 122 generates experimental scene data based on the information placed by the equipment position determination unit 123. This generated experimental scene data becomes new experimental scene data that is not available in the experimental scene data log server 131.

[0036] If a record that matches the topic extracted by the topic extraction unit 121 is stored in the experiment scene data log server 131, the experiment scene generation unit 122 may generate an experiment scene based on the matching record.

[0037] The experiment scene generation unit 122 may store the generated experiment scene data in the reservation management server 133.

[0038] The equipment transport unit 142 is a robot arm, a forklift, etc. The equipment transport unit 142 can place the experimental equipment at the position determined by the equipment position determination unit 123.

[0039] Next, we will explain the operation flow of the management device 1. Figures 2 and 3 are diagrams showing an example of the operation flow of the management device 1. Note that Figure 2 shows the first half of the process, and Figure 3 shows the second half of the process, forming a series of operation flows.

[0040] A conversation content related to an experiment is input to the conversation input unit 111. The topic extraction unit 121 extracts members who plan to use the laboratory as members who plan to conduct the experiment from the conversation content input by the conversation input unit 111 (step S101).

[0041] The control unit 12 refers to the experiment members extracted by the topic extraction unit 121 and searches the experiment scene data log server 131 for experiment scene data in which the planned experiment members have previously conducted experiments. Here, the experiment scene data log server 131 stores the experiment members and the experiment scene data in association with each other, as shown in Table 1. The control unit 12 searches for records among the experiment members that match the planned experiment members, and selects the experiment scene data included in the searched record. If multiple records are searched, the control unit 12 selects any one of the records.

[0042] The experimental scene generation unit 122 searches for selected past experimental scene data from the experimental scene data log server 131 to generate an experimental scene. Furthermore, the experimental scene display unit 141 displays the experimental scene generated by the experimental scene generation unit 122 (step S102). In this step, the experimental scene generation unit 122 can also use the attributes of the members scheduled to conduct the experiment, i.e., information on the attributes of the experiment members, as information to refer to when searching from the experimental scene data log server 131 to narrow down the selection of experimental scene data. In other words, the experimental scene generation unit 122 may use the department to which the experiment members belong as an attribute and search the experimental scene data log server 131 for an experiment implementation department that matches the department to which the user belongs.

[0043] The control unit 12 determines whether the experimental scene generated and displayed in step S102 matches the laboratory to be used (step S103). As an example, the control unit 12 determines whether the user's experimental scene displayed on the experimental scene display unit 141 matches the laboratory to be used, and inputs the determination result by operating the command input unit 112. If the control unit 12 determines that the displayed experimental scene matches the laboratory to be used (Yes in step S103), the control unit 12 proceeds to step S106. If the control unit 12 determines that the displayed experimental scene does not match the laboratory to be used (No in step S103), the control unit 12 proceeds to step S104.

[0044] The topic extraction unit 121 extracts the purpose of using the laboratory from the conversation content input by the conversation input unit 111 (step S104).

[0045] The control unit 12 searches for experimental scene data by referring to the information on the purpose of use of the laboratory extracted by the topic extraction unit 121 and extracting a record that is closest to the content recorded as the purpose of use in the experimental scene data log server 131 shown in Table 1. As an example, the control unit 12 determines whether the wording of the extracted information on the purpose of use matches the wording recorded as the purpose of use in the experimental scene data log server 131, and searches for experimental scene data associated with the matching purpose of use.

[0046] The experimental scene generation unit 122 generates an experimental scene based on the experimental scene data that is closest to the intended use extracted by the experimental scene data log server 131. Furthermore, the experimental scene display unit 141 displays the experimental scene generated by the experimental scene generation unit 122 (step S105). After that, the process returns to step S103 and a new judgment is made.

[0047] For example, if it is determined again that the experimental scene displayed in step S103 does not match the laboratory to be used, in steps S104 and S105, the control unit 12 can control the experimental scene generation unit 122 so that the same experimental scene data is not generated.

[0048] The control unit 12 determines whether all of the experimental equipment to be used is arranged in the displayed experimental scene (step S106). As an example, the control unit 12 determines whether the experimental equipment to be used is arranged in the experimental scene displayed in the experimental scene display unit 141 by the user, and inputs the determination result by operating the command input unit 112. If the control unit 12 determines that all of the experimental equipment is arranged in the displayed experimental scene (Yes in step S106), the control unit 12 proceeds to step S109. If the control unit 12 determines that all of the experimental equipment is not arranged in the displayed experimental scene (No in step S106), the control unit 12 proceeds to step S107.

[0049] The topic extraction unit 121 extracts information about the experimental equipment to be used from the conversation content input by the conversation input unit 111 (step S107). The control unit 12 searches for the extracted information about the experimental equipment to be used from each record of the experimental equipment data server 132 shown in Table 2.

[0050] The experimental scene generation unit 122 generates an experimental scene by adding the equipment searched for in the experimental equipment data server 132 to the experimental scene data that is determined to match the laboratory to be used in step S103. Furthermore, the experimental scene display unit 141 displays the experimental scene generated by the experimental scene generation unit 122 (step S108). After that, the process returns to step S106 and makes another determination.

[0051] The control unit 12 determines whether all of the experimental equipment to be used is placed in the predetermined positions in the displayed experimental scene (step S109). As an example, the user determines whether all of the experimental equipment to be used is placed in the user's desired positions in the experimental scene displayed in the experimental scene display unit 141, and inputs the determination result by operating the command input unit 112. If the control unit 12 determines that all of the experimental equipment is placed in the displayed experimental scene (Yes in step S109), the control unit 12 proceeds to step S112. If the control unit 12 determines that at least some of the experimental equipment is not placed in the displayed experimental scene (No in step S109), the control unit 12 proceeds to step S110.

[0052] The topic extraction unit 121 extracts topics from the conversation content input by the conversation input unit 111. The equipment position determination unit 123 determines the position of the experimental equipment by referring to the information on the placement of the experimental equipment to be used extracted by the topic extraction unit 121 (step S110). The equipment position determination unit 123 can calculate coordinate information on the desired placement position of each piece of experimental equipment to be used.

[0053] The experiment scene display unit 141 moves and displays the 3D image data of the experiment equipment used to the coordinates specified in step S110 on the experiment scene image (step S111). After that, the process returns to step S109 and makes the determination again.

[0054] The control unit 12 makes a reservation for the laboratory to be used and the experimental equipment to be used based on the information on the experimental members who will be using the laboratory, the purpose of using the laboratory, and the equipment to be used, extracted by the topic extraction unit 121 up until step S109 (step S112). That is, the reservation management server 133 records the experiment scene data including the laboratory and experimental equipment that the user has determined to be intended in step S109. At this time, the user may input the date and time when the laboratory and experimental equipment will be used.

[0055] The control unit 12 determines whether it is the day when the equipment is to be used (step S113). If it is not the day when the equipment is to be used (No in step S113), the control unit 12 waits until the day when the equipment is to be used and repeats the same determination for each day. If it is the day when the equipment is to be used (Yes in step S113), the control unit 12 proceeds to step S114.

[0056] The control unit 12 reads out the experimental scene data of the reserved subject from the reservation management server 133 (step S114). The equipment transport unit 142 transports the experimental equipment to a predetermined position in accordance with the read-out experimental scene data so that the state of the experimental equipment in the laboratory in the experimental scene data matches the actual position of the experimental equipment in the laboratory.

[0057] The experimental scene photographing unit 113 photographs and records the scene of the laboratory at the start of the experiment (step S115). The experimental scene data log server 131 stores the photographed scene data of the experimental equipment. The timing of photographing by the experimental scene photographing unit 113 can be changed as desired, and photographing can be performed in response to input by the user to the command input unit 112.

[0058] This allows information about the experiment members, the purpose of using the facility, and the experimental equipment and its layout extracted from conversations in conference rooms, etc. to be used to generate possible equipment conditions in a virtual space when the experiment members use the facility, and present these to the user.

[0059] In the above flow, it has been explained that only one experimental scenery image is presented at a time, for example, in step S102, step S105, step S108, step S111, etc., but it is also possible to display multiple experimental scenery image candidates.

[0060] In addition, the laboratory scene data stored in the experiment scene data log server 131 can record the experiment members who were in the laboratory, their attributes, the experimental equipment placed in the laboratory, and the location where this experimental equipment is placed, all in association with each other.

[0061] In this way, by storing various types of information in association with the laboratory scene data in the experiment scene data log server 131, when laboratory candidates are output based on the information of a specific user in step S103, it is possible to extract laboratory candidates based on the attributes of the experiment members in addition to the information of the experiment members. Alternatively, it is possible to use the attributes of the experiment members instead of the information of the experiment members.

[0062] In this way, the management device 1 can present candidate experiment scenes to the user by using the experiment members and their attribute information. Note that the information used to display candidate experiment scene images in the management device 1 is not limited to this information, and the conditions can be changed as desired.

[0063] In addition, the control unit 12 can not only search for candidate laboratories based on user input, but also extract words related to experiments from conversations such as regular meetings, and present candidate facilities based on these extracted topics, thereby reducing the effort required for users to make reservations.

[0064] Embodiment 2 In the first embodiment, the management device 1 has been described assuming that the facilities reserved by the user are laboratories and experimental equipment, but these targets are not limited to laboratories and experimental facilities. In the second embodiment, the display device 2 will be described using an example of a facility in which predetermined objects are arranged in a predetermined area. Note that, with regard to the components constituting the display device 2 of the second embodiment, parts that perform the same functions as those of the management device 1 shown in the first embodiment are given the same reference numerals, and descriptions thereof will be omitted. Here, a user is a person who uses the display device 2 to display the facilities, and a member is a person who uses the facilities.

[0065] Here, the display device 2 will be described as having the same configuration as the management device 1, particularly a display function for generating an image in which a first object is placed at a first position in a predetermined area for the user.

[0066] In other words, the management device 1 shown in the first embodiment is a device that adds a management function for making reservations for facilities to the display device 2, and can be considered as a device that includes a reservation management server that makes reservations for the facility in which a first object is placed at a first position when one of a plurality of landscape images is selected in response to a user operation. Note that the management device 1 may be configured to include all of the configurations of the display device 2.

[0067] As shown in FIG. 4, the display device 2 includes an input unit 21, a control unit 22, a log storage unit 23, and an output unit 24.

[0068] The input unit 21 includes a conversation input unit 111 , a command input unit 112 , and a landscape photographing unit 213 .

[0069] The scenery photographing unit 213 is a camera used to photograph scenery of the target facility. The scenery photographing unit 213 can be a plurality of cameras.

[0070] The control unit 22 includes a topic extraction unit 221 , a scenery generation unit 222 , an object position determination unit 223 , and a log selection unit 224 .

[0071] The topic extraction unit 221 extracts information on the members, the attributes of the members, the first objects that are physical objects placed in the facility, and the first positions where the first objects are placed.

[0072] The scenery generation unit 222 generates new scenery data in which an object is placed at a position desired by the user in the facility, based on the members extracted by the topic extraction unit 221 and the scenery data stored in the log storage unit 23. That is, the scenery generation unit 222 generates a scenery image in which a first object is placed at a first position in the facility.

[0073] The object position determination unit 223 calculates the coordinate position of the object within the facility desired by the user from the information on the object position obtained from the topic extraction unit 221, and determines the installation position.

[0074] The log selection unit 224 searches the log storage unit 23 for and selects log information that includes the members or member attributes extracted by the topic extraction unit 221 .

[0075] As an example, the log selection unit 224 can select any log information by accepting a user operation via the command input unit 112. Here, the attribute of a specific member includes any of the department, division, department, section, or affiliation to which the specific member belongs. Also, the log information refers to information stored in the scenery data log server 231 and the object data server 232, which will be described later.

[0076] The log storage unit 23 includes a scenery data log server 231 and an object data server 232. The log storage unit 23 corresponds to the storage unit 13 described in the first embodiment, and will be described as not including the reservation management server 133.

[0077] The log storage unit 23 records at least the first object placed in a predetermined area and the first position where the first object is placed as log information.

[0078] Specifically, the scenery data log server 231 stores text information and 3D model data information. The text information in the scenery data log server 231 records information about the date and time the facility was used, the department that used the facility, the member that used the facility, the purpose of using the facility, and the object that was used. The 3D model data information in the scenery data log server 231 includes floor plan information that shows the appearance of the facility, including information about the shape of the facility and the objects arranged within the facility, and coordinate information that shows the installation position of the objects, and data for generating a 3D model of the facility is recorded as scenery data.

[0079] Here, the scenery data log server 231 can record the members, the attributes of the members, the first object placed in the facility, and the first position where the first object is placed.

[0080] Text information and 3D model data information are stored in the object data server 232. The text information in the object data server 232 records the department that manages each object and its serial number.

[0081] The output unit 24 includes a scenery display unit 241 .

[0082] The scenery display unit 241 displays the scenery generated by the scenery generation unit 222 and the object position determination unit 223 .

[0083] Next, the operation flow of the display device 2 will be described with reference to Fig. 5. Note that Fig. 5 is a partially simplified version of the operation flow of the management device 1 related to the laboratory shown in Figs. 2 and 3, and detailed description thereof will be omitted.

[0084] The topic extraction unit 221 extracts members, member attributes, purpose of use, objects, and object placement from the conversation content (step S201). In step S201, the object position determination unit 223 may calculate the coordinate position of the object within the facility desired by the user from the position information of the first object, which is the object, obtained from the topic extraction unit 221, and determine the position to install it as the first position. This process can also be said to be a process combining steps S101, S104, S107, and S110 in the first embodiment. The topic extraction unit 221 may extract any of members, member attributes, purpose of use, objects, and object placement as topics from the conversation content.

[0085] The log selection unit 224 searches the scenery data log server 231 for scenery data that matches the purpose of use, object, and object placement among the extracted topics (step S202). The scenery data log server 231 stores scenery data of members who have used a specific facility in the past. The log selection unit 224 may search the scenery data log server 231 for scenery data that matches any of the purpose of use, object, and object placement among the extracted topics.

[0086] The log selection unit 224 further searches the search results of step S202 for members or scenery data that matches the member attributes (step S203). The log selection unit 224 may search the scenery data log server 231 for scenery data that matches the members and member attributes from among the extracted topics. The log selection unit 224 may process steps S202 and S203 simultaneously, or may process step S203 first and then step S202.

[0087] The scenery generating unit 222 generates a scenery image in which the first object is placed at the first position of the equipment. The scenery display unit 241 displays the generated scenery image (step S204).

[0088] The input unit 21 may accept input of members, purpose of use of the facility, objects, and object placement after step S204. Furthermore, the scenery display unit 241 can change the content to be displayed based on these inputs from the input unit 21.

[0089] From the above, the log selection unit 224 refers to the members or member attributes included in the topics extracted by the topic extraction unit 221, and searches for scenery data stored in the scenery data log server 231 based on the members or member attributes who used the facility. The scenery display unit 241 displays the searched scenery data. Because the attributes of the members or member included in the topics match the attributes of the members or member who used the facility, the scenery display unit 241 can display the facility whose status the user wants to understand.

[0090] Embodiment 3 Another example of the display device 2 will be described.

[0091] The scenery photographing unit 213 can photograph the point at which the member is gazing at the facility at predetermined intervals (hereinafter referred to as the gaze point) and record the photograph in the scenery data log server 231. Here, the facility may be an object located in a predetermined area.

[0092] In this case, when generating a landscape image, the scenery generation unit 222 can use the information on the gaze points stored in the scenery data log server 231 to generate an image of the most common gaze point for each candidate landscape image.

[0093] As a specific example, if the gaze point of a member who works for long periods of time at a predetermined position within the equipment is often to the right of the member's front, the scenery data log server 231 can record information that the member is gazing at the right of the front at the predetermined position within the equipment. That is, the log storage unit 23 includes, as recorded information, a record of the member's gaze point in a predetermined area for each predetermined time. The log storage unit 23 may represent the gaze point as three-dimensional coordinates, with the predetermined position within the equipment as the origin.

[0094] Thereafter, the scenery generation unit 222 generates an image including this gaze point. Specifically, the scenery generation unit 222 can generate a scenery image that includes the most gaze points. For example, the scenery generation unit 222 can generate an image by cutting out one viewpoint that includes this gaze point from the 3D model of the facility, and it is also possible to cut out multiple viewpoints per facility.

[0095] The scenery generation unit 222 may calculate a statistical value of the point of gaze. The scenery generation unit 222 may calculate any one of the average, median, and mode of the coordinate values ​​of the point of gaze for each dimension as a statistical value. The scenery generation unit 222 may calculate coordinates that become statistical values ​​as the point of gaze. The scenery generation unit 222 may calculate coordinates within a predetermined range from the statistical values ​​as the point of gaze. The scenery generation unit 222 may generate a scenery image including the calculated point of gaze.

[0096] Here, since the gaze point differs depending on the member using the facility, the scenery generating unit 222 can generate scenery images by cutting out the scenery from a different viewpoint for each member.

[0097] Furthermore, the scenery data log server 231 can also create an image of the scenery in which the member's gaze point is clearly displayed.

[0098] This allows the display device 2 to generate a scenery image in which the gaze points that are important to the member are displayed. In other words, the scenery data log server 231 further includes, as recorded information, records of the gaze points of the member for each predetermined time while using the facility, and the scenery generation unit 222 can generate a scenery image including the gaze points. Furthermore, for example, the display device 2 can generate multiple scenery images including such gaze points as thumbnail images and present them to the user.

[0099] Here, consider a case where the scenery generation unit 222 searches for records in S203 and there are multiple target records. The scenery generation unit 222 generates a scenery image for each record so that it includes the most frequent gaze point. The scenery display unit 241 displays the scenery image for each record that includes the most frequent gaze point. The scenery display unit 241 displays a list of scenery that members who used the facilities gazed upon, allowing the user to grasp the status of multiple facilities.

[0100] This embodiment can also be applied to embodiment 1. That is, multiple landscape images are generated by the experimental landscape generation unit 122 instead of the landscape generation unit 222. When one of the multiple landscape images is selected in response to a user operation, the reservation management server 133 can make a reservation for the facility in which the first object is placed at the first position.

[0101] Embodiment 4 In the fourth embodiment, the management device 1 shown in the first embodiment, which is capable of reserving a laboratory, will be used for explanation. Also, consider a case where a specific laboratory has already been reserved for a second date and time, and another specific laboratory is reserved for a first date and time. Hereinafter, it is assumed that the users reserving the first date and time and the second date and time are different users, and will be referred to as the first user and the second user, respectively. However, the users reserving the first date and time and the second date and time do not necessarily have to be different users.

[0102] Here, we will focus on experimental equipment (second object) that is less important than the first object to a first user who reserves a specific date and time in the laboratory. As an example, the second object is something that is not used by the first user but is used by a second user, and it is sufficient for the first user to recognize that the second object is in the laboratory when checking the experiment scene. In this explanation, we will assume that the experiment member is only the first user.

[0103] In the management device 1, when a laboratory is reserved before a specified date and time, the second object and a second position where the second object is located are recorded in the reservation management server 133. On the other hand, when a laboratory is reserved after the specified date and time, the management device 1 records the second object and a third position where the second object is located in the reservation management server 133. In other words, the second object is used before and after the specified date and time, but is not used on the specified date and time.

[0104] On this premise, when generating an image of the experimental scene, the equipment position determination unit 123 determines either the second position or the third position of the laboratory as the position where the second object is to be placed if the difference in distance between the second position and the third position is smaller than a predetermined threshold. The experimental scene generation unit 122 can generate, as a virtual space, a model of the laboratory in which the second object is placed at the position determined by the equipment position determination unit 123.

[0105] As a result, the experimental scene generation unit 122 generates an image of the experimental scene including the second object that is not important to the first user. The experimental scene generation unit 122 may change the display method for the first object and the second object. The experimental scene generation unit 122 may display the image of the second object transparently. The experimental scene generation unit 122 may store the generated experimental scene in the experimental scene data log server 131.

[0106] The experimental scene generation unit 122 may determine experimental equipment that has been extracted as a topic by the topic extraction unit 121 as experimental equipment of high importance (first object), and may determine experimental equipment that has not been extracted as a topic as experimental equipment of low importance (second object). The experimental scene generation unit 122 may determine experimental equipment that has been extracted as a topic by the topic extraction unit 121 more times than a first predetermined value as experimental equipment of high importance (first object), and may determine experimental equipment that has been extracted as a topic less times than a second predetermined value as experimental equipment of low importance (second object).

[0107] A second object may be present at a predetermined position at a predetermined date and time in a laboratory reserved by a first user, and the first user can recognize its presence. The second object is placed at the predetermined position both before and after the predetermined date and time. Here, the predetermined position is either the second position or the third position. In other words, the equipment transporter 142 does not need to move the second object at the predetermined date and time. This allows the equipment transporter 142 to reduce the amount of work required to transport experimental equipment.

[0108] The experimental scene generation unit 122 may acquire the experimental scene stored in the experimental scene data log server 131 instead of generating an experimental scene for the second user. This allows the experimental scene generation unit 122 to reduce the amount of processing required to generate the experimental scene. The experimental scene generation unit 122 may display objects that are not important to the second user in a transparent manner.

[0109] The equipment position determining section 123 may determine the position where the second object is to be placed based on the second position and the third position. The equipment position determination unit 123 may determine an intermediate position between the second position and the third position as the position where the second object is to be placed. The equipment position determination unit 123 may determine the position where the second object is to be placed based on the second position and the third position, excluding the first position. The equipment position determination unit 123 may determine the position where the second object is to be placed based on the second position or the third position.

[0110] Consider a case where a laboratory is reserved before a predetermined date and time, but is not reserved after the predetermined date and time. The reservation management server 133 records a second object and a second position where the second object is located. The equipment position determination unit 123 may determine, for the first user, the second position of the laboratory as the position where the second object is located.

[0111] The same applies to a case where a laboratory is reserved after a predetermined date and time, but the laboratory is not reserved after the predetermined date and time. The reservation management server 133 records the second object and a third position where the second object is to be placed. The equipment position determination unit 123 may determine the third position of the laboratory as the position where the second object is to be placed for the first user.

[0112] The management device 1 can extract and display candidates for facilities to be used by experiment members in a simple manner.

[0113] The present invention is not limited to the above-described embodiment, and can be appropriately modified without departing from the spirit of the present invention. In other words, the above description has been omitted or simplified as appropriate for the sake of clarity, and a person skilled in the art can easily modify, add, or convert each element of the embodiment within the scope of the present invention. [Explanation of symbols]

[0114] 1 Management device 2 Display device 11 Input section 12 Control Unit 13 Storage section 14 Output section 111 Conversation input section 112 Command input section 113 Experimental Landscape Photography Club 121 Topic Extraction 122 Experimental Scenery Generation Section 123 Equipment Positioning Unit 131 Experimental Scene Data Log Server 132 Experimental Equipment Data Server 133 Reservation Management Server 141 Experimental Scene Display 142 Equipment Transportation Department 21 Input section 22 Control Unit 23 Log storage unit 24 Output section 213 Landscape Photography Club 221 Topic Extraction Unit 222 Landscape Generation Unit 223 Object position determination section 224 Log Selection Section 231 Landscape Data Log Server 232 Object Data Server 241 Landscape display section

Claims

1. a log storage unit that records, as log information, a member or an attribute of the member, a first object placed in a predetermined area, and a first position where the first object is placed; a log selection unit that selects the log information including a predetermined member or an attribute of the predetermined member; a scenery generating unit that generates an image in which the first object is placed at the first position in the predetermined area based on the selected log information, Display device.

2. The log storage unit The recorded information further includes a record of the member's gaze point in the predetermined area for each predetermined time period, the scenery generation unit generates the image based on statistics of the gaze points; The display device according to claim 1 .

3. The display device according to claim 1 or 2 is provided a reservation management server that makes reservations for the facility in which the first object is placed at the first location, Management device.

4. The scenery generation unit In the reservation management server, a facility is reserved before a predetermined date and time, and a second object and a second position where the second object is to be placed are recorded, and a facility is reserved after the predetermined date and time, and a third position where the second object is to be placed are recorded, generating the image with a second object positioned at either a second location or a third location in the facility; The management device according to claim 3 .

5. a step of recording, as log information, the member or an attribute of the member, a first object placed in a predetermined area, and a first position where the first object is placed; a step of selecting the log information including a predetermined member or an attribute of the predetermined member; generating an image in which the first object is placed at the first position in the predetermined area based on the selected log information; Display method.

Images