Environment forming device

Abstract

The present invention provides an environment forming device, comprising: a sample tank capable of accommodating more than one sample; a photographing unit for photographing the sample tank; an opening and closing door for opening and closing the sample tank; a display unit provided outside the opening and closing door; an operation unit for accepting an operation for specifying an observation area of ​​an object to be observed in the sample tank; and a display control unit for extracting an observation image representing the observation area from an image photographed by the photographing unit and displaying the extracted observation image on the display unit. Thus, even when the opening and closing door of the sample tank is closed, the condition in the sample tank can be observed as desired by the user.

Description

Technical Field

[0001] The invention relates to an environment forming device capable of adjusting the air environment in a sample tank. Background Art

[0002] Conventionally, as described in Japanese Patent Gazette No. 4478415, it is known that in a constant temperature incubator, cells placed at a predetermined position in a cell culture chamber are photographed by an imaging device and the photographed cell image is displayed on a display unit provided on an opening and closing door of the constant temperature incubator.

[0003] However, in the technology of Japanese Patent Gazette No. 4478415, only the image of the sample present at the specified position captured by the camera can be displayed on the door of the thermostat. Therefore, even if the user wants to store a plurality of samples in the thermostat and observe the state of each sample, such observation cannot be performed when the door of the thermostat is closed. Summary of the invention

[0004] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an environment forming device that allows the user to observe the condition in a sample tank as desired even when the opening and closing door of the sample tank is closed.

[0005] An environment forming device involved in one aspect of the present invention includes: a sample tank that can accommodate one or more samples; a shooting unit that shoots the inside of the sample tank; an opening and closing door that opens and closes the sample tank; a display unit that is arranged outside the opening and closing door; an operation unit that accepts an operation to specify an observation area of ​​an observation object in the sample tank; and a display control unit that extracts an observation image representing the observation area from the image captured by the shooting unit, and displays the extracted observation image on the display unit.

[0006] According to the above-described environment forming device, even when the opening and closing door of the sample tank is closed, the user can observe the condition in the sample tank as desired.

[0007] The objects, features and advantages of the described technology will become more apparent from the following detailed description and accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 This is an external view showing an example of an environmental testing device.

[0009] Figure 2 This is a block diagram showing an example of the electrical configuration of an environmental test device.

[0010] Figure 3 This figure shows a display example of the observation window screen and the installation instrument screen.

[0011] Figure 4This is a diagram showing an example of information pre-stored in the storage unit.

[0012] Figure 5 This is a flowchart showing the test operation of the sample in the environmental test device.

[0013] Figure 6 This figure shows an example of the display of the observation window screen and the installation instrument screen before the start of the test.

[0014] Figure 7 This figure shows an example of the display of the observation window screen and the installation instrument screen after the test starts.

[0015] Figure 8 This is a diagram showing a display example of the observation window screen and the installation instrument screen when the observation area is changed to the entire area in the sample tank.

[0016] Fig. 9 This is a diagram showing a display example of an observation window screen in which an observation image is not displayed.

[0017] Fig.10 This is a diagram showing a display example of the observation window screen and the installation instrument screen when the observation area is moved.

[0018] Fig.11 This is a diagram showing a display example of the observation window screen when the line of sight is moved.

[0019] Fig.12 The diagram shows a display example of the observation window screen when the observation area is enlarged and when the observation area is reduced.

[0020] Fig.13 It is a diagram showing a display example of an observation window screen in which an enlarged display is displayed.

[0021] Fig.14 It is a diagram showing a display example of the observation window screen in which the display position is changed.

[0022] Fig.15 It is a diagram showing a display example of input related information.

[0023] Fig.16 This is a diagram showing a display example of the history observation window screen. DETAILED DESCRIPTION

[0024] (Implementation Method)

[0025] Next, an environmental testing device 1 as one embodiment of the environment forming device according to the present invention will be described. Figure 1 1 is an external view showing an example of the environmental testing device 1. Figure 1, part (A) shows a top view of the environmental test device 1 , part (B) shows a front view of the environmental test device 1 , and part (C) shows a right side view of the environmental test device 1 .

[0026] like Figure 1 As shown in parts (A) to (C) of FIG. 1 , the environmental testing device 1 includes a sample tank 18 , an air conditioning tank 19 , an opening and closing door 2 , a display unit 6 , an operation unit 7 , and an image sensor 13 .

[0027] The sample tank 18 has an opening at the front. A support member is provided on the side wall inside the sample tank 18. The support member supports a sample rack that can carry one or more samples. The air conditioning tank 19 can adjust the air environment in the sample tank 18 according to the prescribed test conditions in order to conduct tests such as heat resistance and moisture resistance of each sample accommodated in the sample tank 18.

[0028] Specifically, a blow-out port and an inlet port (not shown) are provided on the partition wall 189 between the sample tank 18 and the air conditioning tank 19. The temperature and humidity of the air in the air conditioning tank 19 are adjusted by the air conditioning unit 3 described later, and the adjusted air is blown out from the blow-out port toward the sample tank 18. Accordingly, the sample tank 18 is supplied with air with adjusted temperature and humidity. By blowing air from the air conditioning tank 19 toward the sample tank 18, the air in the sample tank 18 is sucked into the air conditioning tank 19 from the inlet port. In this way, by repeatedly performing air circulation between the air conditioning tank 19 and the sample tank 18, the temperature and humidity of the air in the sample tank 18 are adjusted as the air environment in the sample tank 18.

[0029] Open and close door 2 by Figure 1 The door 2 is formed by opening and closing the opening of the sample tank 18 in the direction of the dotted arrow shown in the portion (A). The opening and closing door 2 is not limited thereto, and may be a structure that opens and closes the sample tank 18 by sliding in the up-down direction or in the left-right direction.

[0030] In addition, if Figure 1 As shown in parts (A) and (C), transparent durable glass 41a and camera 40a are provided above, below and in the center of the inner surface of the door 2 in the left-right direction. The camera 40a takes a picture of the inside of the sample tank 18 from the front through the durable glass 41a.

[0031] Similarly, transparent durable glass 41b and camera 40b are provided above, below and in the middle of the center position in the front-to-back direction of the right side wall of the sample tank 18. The camera 40b photographs the inside of the sample tank 18 from the right through the durable glass 41b. Transparent durable glass 41c and camera 40c are provided above, below and in the middle of the center position in the left-to-right direction of the partition wall 189. The camera 40c photographs the inside of the sample tank 18 from the rear through the durable glass 41c. In addition, the camera 40c is covered by a heat-insulating member (not shown) to avoid being affected by the air environment in the air conditioning tank 19. Transparent durable glass 41d and camera 40d are provided above, below and in the middle of the center position in the front-to-back direction of the left side wall of the sample tank 18. The camera 40d photographs the inside of the sample tank 18 from the left through the durable glass 41d.

[0032] In addition, the number and arrangement positions of the cameras 40a to 40d and the durable glasses 41a to 41d may be different from Figure 1 Examples are shown in parts (A) and (C). In addition, to prevent blurring, a ventilation mechanism for supplying dry air may be provided to the cameras 40a to 40d and / or the durable glasses 41a to 41d. In addition, to prevent blurring (condensation) or frost, a heating mechanism for heating the cameras 40a to 40d and / or the durable glasses 41a to 41d may be provided. The images captured by the cameras 40a to 40d may be still images or dynamic images.

[0033] like Figure 1 As shown in parts (A) to (C) of the display unit 6, the display unit 6 is formed of a liquid crystal display and is arranged on the front outside of the opening and closing door 2. The display unit 6 has a display area 61 that is substantially the same size as the front outside of the opening and closing door 2. The display unit 6 displays an operation screen and information for guiding the operation in the display area 61. In addition, the size of the display area 61 is not limited to being substantially the same size as the front outside of the opening and closing door 2, and may be smaller than the front outside of the opening and closing door 2.

[0034] The operation unit 7 is formed of a touch panel device and receives various operations from the user based on the position touched by the user's finger or a pointer such as a pen and the trajectory of the pointer's movement on the display area 61 of the display unit 6 .

[0035] Figure 1 As shown in part (B), the image sensor 13 is disposed at the upper end of the front outside of the door 2. The image sensor 13 captures an image of the periphery of the door 2 (hereinafter referred to as a peripheral image). In addition, the configuration position of the image sensor 13 is not limited thereto, and may be a position outside the display area 61 of the front outside of the door 2.

[0036] (Electrical Structure of Environmental Test Device 1)

[0037] Next, the electrical structure of the environmental testing device 1 will be described. Figure 2 1 is a block diagram showing an example of the electrical structure of the environmental testing device 1. Figure 2 As shown, the environmental testing device 1 includes an air conditioning unit 3 , a photographing unit 4 , an environmental sensor 5 , a storage unit 8 , a control unit 10 and an interface unit 9 in addition to the image sensor 13 , the display unit 6 and the operation unit 7 .

[0038] The air conditioning unit 3 adjusts the air environment in the sample tank 18 according to the specified test conditions. Specifically, the air conditioning unit 3 includes a heater, an evaporator, a humidifier, and a blower. The air conditioning unit 3 adjusts the temperature and humidity of the air in the sample tank 18 according to the specified test conditions. The test conditions include a target value of the temperature of the air in the sample tank 18 (hereinafter referred to as the target temperature) and a target value of the humidity of the air in the sample tank 18 (hereinafter referred to as the target humidity). In addition, the test conditions include a period (hereinafter referred to as the test period) during which the temperature and humidity of the air in the sample tank 18 are adjusted to reach the target temperature and target humidity.

[0039] The heater heats the air in the air conditioning tank 19 to increase the temperature of the air in the air conditioning tank 19. The evaporator cools the air in the air conditioning tank 19. Accordingly, the evaporator lowers the temperature of the air in the air conditioning tank 19 and dehumidifies the air in the air conditioning tank 19. The humidifier humidifies the air in the air conditioning tank 19 by supplying steam into the air conditioning tank 19. The blower generates wind at a predetermined wind speed. Using the wind generated by the blower, the air whose temperature and humidity are adjusted by the heater, the evaporator, and the humidifier is blown out from the blowout port into the sample tank 18. Accordingly, the air in the sample tank 18 is sucked into the air conditioning tank 19 from the suction port. In this way, by repeatedly circulating the air between the air conditioning tank 19 and the sample tank 18, the temperature and humidity of the air in the sample tank 18 are adjusted.

[0040] The imaging unit 4 is formed of the above-mentioned cameras 40 a to 40 d and the durable glasses 41 a to 41 d . The imaging unit 4 captures images of the inside of the sample tank 18 from multiple directions and outputs images obtained by the imaging to the control unit 10 .

[0041] The environment sensor 5 detects the air environment in the test tank 18. Specifically, the environment sensor 5 is formed of a temperature sensor and a humidity sensor. The environment sensor 5 detects the temperature of the air in the test tank 18 using the temperature sensor and detects the humidity of the air in the test tank 18 using the humidity sensor.

[0042] The storage unit 8 is formed of a storage device such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 8 stores various information under the control of the control unit 10. In addition, the storage unit 8 stores in advance an image representing an operation screen displayed on the display unit 6, various information used for control of the control unit 10, and the like.

[0043] For example, the storage unit 8 stores images showing the operation screen displayed on the display unit 6 , that is, the observation window screen W1 and the installation instrument screen W2 . Figure 3 2 is a diagram showing a display example of the observation window screen W1 and the installation instrument screen W2. Figure 3 As shown, the observation window screen W1 is formed by three display boxes A11, A12, and A13. The display box A11 includes a full area display key Ka and a non-display key Kc. In the display box A12, an observation image DP representing a designated observation area in the sample tank 18 is displayed by the display control unit 102 described later. The display box A13 includes a zoom-in button BS1, a zoom-out button BS2, four area designation buttons BM1 to BM4, and two sight line change buttons BR1 and BR2.

[0044] The instrument installation screen W2 is formed by three display columns A21, A22, and A23. In the display column A21, a message A211 indicating the status of the test (for example, test preparation) is displayed by the display control unit 102 described later. In the display column A22, the temperature A221 (for example, 68.3°C) and humidity A222 (for example, 47% rh) in the sample tank 18 detected by the environmental sensor 5 are displayed by the display control unit 102 described later as relevant information related to the observation area shown in the observation image DP. The display column A23 includes a setting button BST for setting the test conditions.

[0045] Figure 4 8 is a diagram showing an example of information pre-stored in the storage unit 8. Figure 4 As shown, in the storage unit 8, identification information (hereinafter referred to as user identification information) (for example, usr1) of a user (hereinafter referred to as a permitted user) who is permitted to use the environmental testing device 1, image data (hereinafter referred to as an authentication image) (for example, img1) representing the permitted user, and a password of the permitted user (for example, *****) are stored in association.

[0046] In addition, as described later, in the storage unit 8, under the control of the control unit 10, layout information is stored in association with the user identification information. The layout information indicates the layout when the operation screens are displayed on the display unit 6 by the permitted user corresponding to the user identification information (hereinafter referred to as the display layout). The layout information includes the identification information of each operation screen displayed on the display unit 6 (for example, W1), the coordinates indicating the display position of each operation screen (for example, x11, y11 ( Figure 3 )) and information indicating the width and height of each operation screen (for example, h11, w11 ( Figure 3 )).

[0047] The control unit 10 controls each unit of the environmental testing device 1. Specifically, the control unit 10 is formed of a microcomputer including a CPU (Central Processing Unit), a volatile memory such as a RAM (Random Access Memory), a nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read-Only Memory), a timing circuit for timing the current time, and the like.

[0048] The control unit 10 causes the CPU to execute a control program stored in the nonvolatile memory. Accordingly, the control unit 10 functions as an authentication unit 101 (acquisition unit), a display control unit 102, and an execution unit 103. The authentication unit 101, the display control unit 102, and the execution unit 103 will be described in detail later.

[0049] The interface unit 9 is provided with a communication interface circuit (not shown) for the control unit 10 to communicate with an external device such as a computer through a network such as a LAN (Local Area Network) or the Internet. In addition, the interface unit 9 is provided with a connector (not shown) to which an external storage device such as a USB (Universal Serial Bus) memory can be attached and detached. In addition, the interface unit 9 is provided with an external interface circuit (not shown) for the control unit 10 to communicate with an external storage device attached to the connector. Accordingly, the control unit 10 can communicate with an external device or an external storage device through the interface unit 9.

[0050] Furthermore, the environment forming device according to the present invention may be a constant temperature and humidity device or a heat treatment device (oven) that can adjust the air environment in a sample tank that accommodates one or more samples.

[0051] (Test process flow)

[0052] Next, the test operation of the sample in the environmental testing apparatus 1 will be described. Figure 51 is a flowchart showing the test operation of the sample in the environmental test device 1. In addition, in this description, the details of the authentication unit 101, the display control unit 102, and the execution unit 103 are described.

[0053] like Figure 5 As shown, first, the authentication unit 101 uses the surrounding image captured by the image sensor 13 to identify whether there is a user around the door 2 (step S1). Specifically, in step S1, when the authentication unit 101 determines that the surrounding image contains an image representing a person by performing a known image recognition process, it recognizes that there is a user around the door 2 (step S1; yes). At this time, the authentication unit 101 determines whether the recognized user is a permitted user (step S2).

[0054] Specifically, in step S2, the authentication unit 101 acquires an image representing a person included in the peripheral image captured by the image sensor 13 in step S1 as an image representing the recognized user (hereinafter referred to as a user image). The authentication unit 101 compares the feature amount of the user recognized by the acquired user image with the feature amount of each permitted user recognized by each authentication image pre-stored in the storage unit 8 by performing a known image recognition process.

[0055] Assume that as a result of the comparison, the feature quantity of the identified user is substantially consistent with the feature quantity of the permitted user identified based on a certain specific authentication image. At this time, the authentication unit 101 determines that the identified user is the permitted user corresponding to the specific authentication image (step S2; yes). In addition, the feature quantity of the user is substantially consistent with the feature quantity of the permitted user, which means that the feature quantity of the user is consistent with a predetermined ratio (for example, 90%) or more of the feature quantity of the permitted user.

[0056] On the other hand, when the authentication unit 101 determines in step S1 that the surrounding image does not include an image representing a person, it recognizes that there is no user around the opening and closing door 2 (step S1; No). At this time, the authentication unit 101 returns the process to step S1. Thereafter, the process after step S1 is performed. In addition, when the authentication unit 101 does not determine in step S2 that the identified user is a permitted user (step S2; No), the process returns to step S1. Thereafter, the process after step S1 is performed. Through these processes, when there is no person around the opening and closing door 2 and when there is a user who is not permitted to use the environmental testing device 1 around the opening and closing door 2, the process after step S3 can be avoided.

[0057] Assume that it is determined in step S2 that the user identified in step S1 is a permitted user (step S2; Yes). In this case, the authentication unit 101 acquires the user identification information associated with the specific authentication image from the storage unit 8 (step S3).

[0058] Then, the display control unit 102 acquires the layout information associated with the user identification information acquired in step S3 from the storage unit 8 (step S4). When the display control unit 102 acquires the layout information from the storage unit 8 (step S4; yes), the process is transferred to step S6. When the display control unit 102 fails to acquire the layout information (step S4; no), the process is transferred to step S5. In step S5, the display control unit 102 sets the display layout of each operation screen to a predetermined initial display layout (step S5), and transfers the process to step S6. The initial display layout is stored in the non-volatile memory or the storage unit 8 in advance.

[0059] In step S6 , the display control unit 102 causes the imaging unit 4 to start imaging the inside of the sample tank 18 , and causes the environmental sensor 5 to start detecting the temperature and humidity of the air in the sample tank 18 (step S6 ).

[0060] Next, the display control unit 102 displays the observation window screen W1 and the installed equipment screen W2 in the display area 61 using the initial display layout set in step S5 or the display layout acquired in step S4 (step S7 ).

[0061] For example, suppose that the initial display layout set in step S5 or the display layout acquired in step S4 is Figure 4 The display layout shown in the layout information “W1: (x11, y11, h11, w11), W2: (x12, y12, h12, w12)” associated with the user identification information “usr1” is shown.

[0062] Figure 6 1 is a diagram showing an example of the display of the observation window screen W1 and the installation instrument screen W2 before the start of the test. At this time, in step S7, the display control unit 102 follows the display layout shown in the layout information "W1: (x11, y11, h11, w11)", as shown in FIG. Figure 6 As shown, the operation screen identified by the user identification information “usr1”, that is, the observation window screen W1, is displayed at the position of the coordinates (x11, y11) in the display area 61. Furthermore, the display control unit 102 adjusts the height of the displayed observation window screen W1 to “h11” and the width to “w11”. Similarly, the display control unit 102 displays the operation screen identified by the user identification information “usr1”, that is, the installation device screen W2, at the position of the coordinates (x12, y12) in the display area 61 according to the display layout shown by the layout information “W2: (x12, y12, h12, w12)”. Furthermore, the display control unit 102 adjusts the height of the installation device screen W2 to “h12” and the width to “w12”.

[0063] Then, the display control unit 102 performs a known image extraction process to extract an observation image DP representing a designated observation area in the sample tank 18 from the image captured by the imaging unit 4. Then, the display control unit 102 displays the extracted observation image DP in the display field A12. For example, when the area of ​​the display field A12 corresponding to the opening and closing door 2 is a hollow part, the initial value of the observation area is determined to be an area that can be visually recognized when the user looks into the sample tank 18 from the front through the hollow part.

[0064] Furthermore, the display control unit 102 displays the temperature A221 (e.g., 68.3°C) and humidity A222 (e.g., 47% rh) in the sample tank 18 detected by the environmental sensor 5 in the display field A22 as relevant information related to the observation area shown in the observation image DP. Thus, the user can visually confirm not only the observation image DP showing the observation area, but also the temperature A221 and humidity A222 in the sample tank 18 related to the observation area. Therefore, the user can grasp the condition of the observation area in the sample tank 18 in more detail.

[0065] Therefore, the user can store the layout information indicating the display layout of the observation image DP with good visual confirmation for the user in the storage unit 8 in association with the user identification information of the user. According to this, the user can visually confirm the observation window screen W1 and the installation instrument screen W2 displayed in the display layout with good visual confirmation for the user. According to this, the user can more appropriately understand the status of the observation area shown by the observation image DP displayed on the display field A12 of the observation window screen W1 and the temperature and humidity of the air in the sample tank 18 associated with the observation area displayed on the installation instrument screen W2.

[0066] Assume that after step S7, the user opens the opening and closing door 2, supports the sample rack on the supporting member in the sample tank 18, and places one or more samples on the sample rack. Then, assume that the user presses the setting button BST and the like to perform the setting operation of the prescribed test conditions and the start operation of the prescribed test, and these operations are accepted by the operation unit 7. At this time, the execution unit 103 performs the test of the sample according to the accepted test conditions. Specifically, the execution unit 103 controls the air conditioning unit 3 in a manner to adjust the temperature and humidity of the air in the sample tank 18 according to the test conditions accepted by the operation unit 7.

[0067] When the test is started by the execution unit 103 (step S8; Yes), the display control unit 102 reflects the status of the test on the observation window screen W1 and the installation instrument screen W2 displayed on the display unit 6 (step S9).

[0068] Figure 71 is a diagram showing an example of the display of the observation window screen W1 and the installation instrument screen W2 after the test starts. Specifically, in step S9, the display control unit 102 performs a known image extraction process. Figure 7 As shown, the observation image DP showing the observation area is extracted from the image most recently captured by the imaging unit 4. Then, the display control unit 102 displays the extracted observation image DP in the display field A12.

[0069] Then, in step S9, the display control unit 102 Figure 7 As shown, the message A211 indicating the test status displayed in the display column A21 of the installation device screen W2 is updated to a message indicating that the test is in progress (for example, the program is running). The display control unit 102 displays the target temperature A223 (for example, 85.0°C) and the target humidity A224 (for example, 85% rh) included in the test conditions and the temperature A221 (for example, 68.3°C) and humidity A222 (for example, 47% rh) in the sample tank 18 most recently detected by the environmental sensor 5 in the display column A222 of the installation device screen W2. In addition, the display control unit 102 displays the temperature and humidity in the sample tank 18 detected by the environmental sensor 5 in a time series in the graph area A225 provided in the display column A22.

[0070] Assume that after step S9 and when the execution unit 103 has not started to be used (step S8; No), the operation performed by the user using a finger or a pen or other indicator on the display area 61 is accepted by the operation unit 7 (step S10; Yes). At this time, the execution unit 103 executes the processing corresponding to the operation accepted in step S10 (step S11). The details of step S10 and step S11 will be described later.

[0071] After step S11 is completed, the execution unit 103 determines whether to end the test (step S12). In addition, when the operation unit 7 does not accept the operation (step S10; No), the execution unit 103 also performs the judgment of step S12. Specifically, when the test is started in step S8, in step S12, the execution unit 103 determines that the test is ended when the user performs a prescribed test end operation and the operation is accepted by the operation unit 7. Alternatively, in step S12, the execution unit 103 determines that the test is ended when the test time set in the test conditions has passed. On the other hand, when the test is not started in step S8, in step S12, the execution unit 103 determines that the test is not ended (cannot be ended).

[0072] In step S12, when the execution unit 103 determines that the test is not to be terminated (cannot be terminated) (step S12; No), the processing after step S8 is repeated. On the other hand, when the execution unit 103 determines that the test is to be terminated in step S12 (step S12; Yes), a predetermined test termination processing is performed (step S13). Thus, the test operation of the sample in the environmental test device 1 is terminated.

[0073] For example, in step S13, the execution unit 103 sets the observation window screen W1 and the installation instrument screen W2 to non-display. In addition, in step S13, the execution unit 103 may change the layout information stored in association with the user identification information obtained in step S3 in the storage unit 8 to layout information representing the display layout of the observation window screen W1 and the installation instrument screen W2 currently displayed in the display area 61. Then, the execution unit 103 may set the observation window screen W1 and the installation instrument screen W2 to non-display. In addition, it is assumed that there is no layout information stored in association with the user identification information obtained in step S3 in the storage unit 8. At this time, in step S13, the execution unit 103 may store the layout information representing the display layout of the observation window screen W1 and the installation instrument screen W2 currently displayed in the display area 61 in the storage unit 8 in association with the user identification information obtained in step S3.

[0074] Below, refer to Figures 8 to 14 The processing performed in step S11 corresponding to the operation accepted in step S10 will be described.

[0075] (Processing Example 1)

[0076] like Figure 7 As shown, suppose that when the observation window screen W1 is displayed, the user touches the full area display key Ka. At this time, in step S10, the operation unit 7 accepts an operation (fourth operation) to designate the entire sample tank 18 as an observation area. At this time, the display control unit 102 executes a process corresponding to the operation in step S11.

[0077] Figure 8 1 is a diagram showing a display example of the observation window screen W1 and the installation instrument screen W2 when the observation area is changed to the entire area in the sample tank 18. Figure 8As shown, the display control unit 102 displays the initial area display key Ks instead of the full area display key Ka displayed in the display bar A11. The display control unit 102 resets the entire sample tank 18 as the observation area instead of the observation area shown in the observation image DP displayed in the observation window screen W1. Then, the display control unit 102 extracts the observation image DPa representing the reset observation area from the image captured by the imaging unit 4 by performing a known image extraction process. Then, the display control unit 102 enlarges the display bar A12 to a size capable of displaying the extracted observation image DPa, and displays the extracted observation image DPa in the enlarged display bar A12a. In addition, the display control unit 102 sets the area designation buttons BM1 to BM4 displayed in the display bar A13 to non-display.

[0078] According to this processing example, the user can display the observation image DPa showing the entire sample tank 18 in the display area 61 by touching the entire area display key Ka. This allows the user to observe the entire situation in the sample tank 18 at a glance.

[0079] (Processing Example 2)

[0080] If the display has Figure 8 In the case of the observation window screen W1 shown, the user touches the initial area display key Ks. At this time, in step S10, the operation unit 7 receives an operation to designate the observation area as the initial value. At this time, the display control unit 102 executes processing corresponding to the operation in step S11.

[0081] Specifically, if Figure 7 As shown, the display control unit 102 displays the full area display key Ka instead of the initial area display key Ks displayed in the display bar A11. The display control unit 102 resets the observation area to the initial value of the observation area and performs a known image extraction process. Accordingly, the display control unit 102 extracts the observation image DP representing the reset observation area from the image captured by the imaging unit 4. Then, the display control unit 102 reduces the display bar A12a to a size capable of displaying the extracted observation image DP, and displays the extracted observation image DP in the reduced display bar A12. In addition, the display control unit 102 displays the area designation buttons BM1 to BM4 in the display bar A13.

[0082] (Processing Example 3)

[0083] Assume that the user touches the non-display key Kc while the observation window screen W1 is displayed. In this case, in step S10, the operation unit 7 receives an operation (fifth operation) for non-displaying the observation image DP.

[0084] Fig. 91 is a diagram showing a display example of the observation window screen W1 in which the observation image DP is set to non-display. At this time, the display control unit 102 performs processing corresponding to the operation of setting the observation image DP to non-display in step S11. Specifically, Fig. 9 As shown, the display control unit 102 displays the redisplay key Kr in the display field A11. Then, the display control unit 102 hides the display field A12 or the display field A12a and the display field A13 and displays only the display field A11. Accordingly, the display control unit 102 hides the observation image DP displayed on the observation window screen W1.

[0085] According to this processing example, the user can hide the observation image DP by touching the non-display key Kc, thereby quickly preventing a third person who comes to the environmental testing apparatus 1 from visually checking the observation image DP and understanding the status of the observation area shown by the observation image DP.

[0086] In addition, if the display has Fig. 9 In the case of the observation window screen W1 shown in FIG. 1 , the user touches the redisplay key Kr. At this time, in step S10, the operation unit 7 receives the operation of redisplaying the observation image DP. At this time, the display control unit 102 performs a process corresponding to the operation in step S11, for example Figure 7 or Figure 8 As shown, the observation window screen W1 is redisplayed in the display area 61 in the display layout that was displayed before the processing corresponding to the operation of setting the observation image DP to non-display is performed.

[0087] (Processing Example 4)

[0088] In addition, if Figure 7 As shown, when the observation window screen W1 is displayed, the user touches any one of the four area designation buttons BM1 to BM4 included in the display bar A13. At this time, in step S10, the operation unit 7 accepts an operation to move the observation area in a direction corresponding to the area designation button BM1 to BM4 that has been touched (hereinafter referred to as an area movement operation). In addition, the direction corresponding to the area designation button BM1 is defined as the left direction. The direction corresponding to the area designation button BM2 is defined as the right direction. The direction corresponding to the area designation button BM3 is defined as the upward direction. The direction corresponding to the area designation button BM4 is defined as the downward direction.

[0089] At this time, the display control unit 102 performs processing corresponding to the area movement operation in step S11. Figure 7 As shown in FIG. 1 , when the observation window screen W1 is displayed, the user presses the area designation button BM1 included in the display field A13. At this time, the display control unit 102 displays the area designation button BM1 in the display field A13. Figure 7 The observation area represented by the observation image DP of the observation window screen W1 shown is reset as the observation area by moving the area by a predetermined distance in the left direction corresponding to the area designation button BM1. Then, the display control unit 102 extracts the observation image representing the reset observation area from the image captured by the imaging unit 4 by performing a known image extraction process. Then, the display control unit 102 displays the extracted observation image in the display field A12.

[0090] Fig.10 2 is a diagram showing an example of display of the observation window screen W1 and the installation instrument screen W2 when the observation area is moved. Figure 7 As shown in FIG. 1 , when the observation window screen W1 is displayed, the user presses the area designation button BM1 included in the display field A13 to execute the processing corresponding to the area movement operation. Thereafter, it is assumed that the area designation button BM3 is pressed to execute the processing corresponding to the area movement operation. In this case, as shown in FIG. Fig.10 shown in Figure 7 The observation area represented by the observation image DP of the observation window screen W1 shown is reset as the observation area by moving the observation area to the left corresponding to the area designation button BM1 by a predetermined distance and moving the observation area to the upper direction corresponding to the area designation button BM3 by a predetermined distance. Then, the observation image DPb representing the reset observation area is displayed in the display field A12.

[0091] According to this processing example, if the user touches any one of the four area designation buttons BM1 to BM4, the observation area moves in the direction corresponding to the area designation button BM1 to BM4 that has been touched. And, when the door 2 is closed, the observation image DP showing the observation area after the movement is displayed in the display area 61 of the display unit 6 provided outside the door 2. Therefore, even when the door 2 is closed, the user can observe the desired observation area in the sample tank 18 by visually confirming the displayed observation image DP.

[0092] (Processing Example 5)

[0093] Assume that when the observation window screen W1 is displayed, the user touches any one of the sight line change buttons BR1 and BR2 included in the display bar A13. At this time, in step S10, the operation unit 7 accepts an operation (first operation) to designate a sight line when observing the observation area to move the sight line in the direction corresponding to the sight line change button BR1 or BR2 that was touched as a new sight line when observing the observation area. At this time, the display control unit 102 performs a process corresponding to the operation in step S11. In addition, the direction corresponding to the sight line change button BR1 is specified as the right direction, and the direction corresponding to the sight line change button BR2 is specified as the left direction.

[0094] Fig.11 2 is a diagram showing an example of the display of the observation window screen when the line of sight is moved. Fig.11 As shown in part (A) of FIG. 1 , it is assumed that an observation image DP1 seen when observing the observation area with a certain line of sight (first line of sight) is displayed on the observation window screen W1. At this time, it is assumed that the user presses the line of sight change button BR2. At this time, the display control unit 102 resets the line of sight when observing the observation area by rotating the first line of sight to the left by a predetermined angle corresponding to the line of sight change button BR2. Then, as shown in FIG. Fig.11 As shown in part (B) of the display control unit 102, the display control unit 102 extracts the image DP2 seen when observing the observation area with the reset new line of sight from the image captured by the imaging unit 4 as the observation image. Then, the display control unit 102 displays the extracted observation image DP2 in the display field A12.

[0095] For example, Fig.11 As shown in part (C) of FIG. 1 , it is assumed that an observation image DP3 seen when observing the observation area with another certain line of sight (second line of sight) is displayed on the observation window screen W1. At this time, it is assumed that the user presses the line of sight change button BR1. At this time, the display control unit 102 resets the line of sight when observing the observation area by rotating the second line of sight to the right by a predetermined angle corresponding to the line of sight change button BR1. Then, as shown in FIG. Fig.11 As shown in part (D) of FIG. 1 , the display control unit 102 performs a known image extraction process to extract, from the image captured by the imaging unit 4, an image DP4 seen when the observation area is observed with the newly set line of sight as an observation image. Then, the display control unit 102 displays the extracted observation image DP4 in the display field A12.

[0096] According to this processing example, even when the door 2 is closed, the user can observe the desired observation area in the sample tank 18 with a desired line of sight by visually checking the observation image DP displayed in the display area of ​​the display unit 6 .

[0097] (Processing Example 6)

[0098] Assume that when the observation window screen W1 is displayed, the user touches the enlargement button BS1 included in the display field A13. In this case, in step S10, the operation unit 7 receives an operation (second operation) to enlarge the observation area. In this case, the display control unit 102 executes processing corresponding to the operation in step S11.

[0099] Fig.12 2 is a diagram showing a display example of the observation window screen W1 when the observation area is enlarged (zoom in) and reduced (zoom out). Fig.12 As shown in part (A) of FIG. 1 , it is assumed that the user presses the zoom button BS1 when the observation window screen W1 displays the observation image DP5. At this time, the display control unit 102 Fig.12 As shown in part (B), by performing known image extraction processing and image enlargement processing, an image DP6 obtained by enlarging the observation area represented by the observation image DP5 by a predetermined distance is extracted from the image captured by the imaging unit 4 as an observation image. Then, the display control unit 102 displays the extracted observation image DP6 in the display field A12.

[0100] Here, further, when the operation unit 7 receives an operation to enlarge the observation area, as shown in FIG. Fig.12 As shown in part (C) of FIG. 1 , in step S11, an image DP7 obtained by enlarging the observation area represented by the observation image DP6 by a predetermined distance is extracted as the observation image, and the extracted observation image DP7 is displayed in the display field A12. Further, when the operation unit 7 receives an operation to enlarge the observation area, as shown in FIG. Fig.12 As shown in part (D), in step S11, an image DP8 obtained by enlarging the observation area represented by the observation image DP7 by a predetermined distance is extracted as an observation image, and the extracted observation image DP8 is displayed in the display field A12.

[0101] According to this processing example, the user can display an enlarged image of the observation area as the observation image DP in the display area 61 of the display unit 6 by touching the enlargement button BS1. This allows the user to observe the observation area in more detail.

[0102] (Processing Example 7)

[0103] Assume that when the observation window screen W1 is displayed, the user touches the reduction button BS2 included in the display field A13. In this case, in step S10, the operation unit 7 receives the operation (third operation) of reducing the observation area. In this case, the display control unit 102 executes processing corresponding to the operation in step S11.

[0104] For example, Fig.12 As shown in part (D) of FIG. 1 , it is assumed that the user presses the zoom-out button BS2 when the observation window screen W1 displays the observation image DP8. At this time, the display control unit 102 Fig.12 As shown in part (C), by performing known image extraction processing and image reduction processing, an image DP7 obtained by reducing the observation area represented by the observation image DP8 by a predetermined distance is extracted from the image captured by the imaging unit 4 as an observation image. Then, the display control unit 102 displays the extracted observation image DP7 in the display field A12.

[0105] Here, it is further assumed that the operation unit 7 receives an operation to reduce the observation area. Fig.12 As shown in part (B) of FIG. 1 , in step S11, an image DP6 obtained by reducing the observation area represented by the observation image DP7 by a predetermined distance is extracted as the observation image, and the extracted observation image DP6 is displayed in the display field A12. It is further assumed that the operation unit 7 receives an operation to reduce the observation area. At this time, Fig.12 As shown in part (A), in step S11, an image DP5 obtained by reducing the observation area represented by the observation image DP6 by a predetermined distance is extracted as an observation image, and the extracted observation image DP5 is displayed in the display field A12.

[0106] According to this processing example, the user can display the image of the reduced observation area as the observation image in the display area 61 of the display unit 6 by touching the reduction button BS2. This allows the user to further bird's-eye view of the observation area.

[0107] (Processing Example 8)

[0108] When the user performs a zoom operation on the observation window screen W1, the operation unit 7 accepts an operation (sixth operation) of enlarging or reducing the observation window screen W1 in accordance with the zoom operation in step S10. At this time, the display control unit 102 executes a process corresponding to the operation in step S11. Similarly, when the user performs a zoom operation on the installation device screen W2, the operation unit 7 accepts an operation of enlarging or reducing the installation device screen W2 in accordance with the zoom operation in step S10. At this time, the display control unit 102 executes a process corresponding to the operation in step S11.

[0109] For example, Figure 7 As shown, it is assumed that the observation window screen W1 and the installation device screen W2 are displayed in the display area 61. At this time, it is assumed that the user performs a zoom operation to expand the distance between the two indicators touched on the observation window screen W1 by a predetermined distance. At this time, the operation unit 7 receives the operation of enlarging and displaying the observation window screen W1 at a predetermined magnification ratio in step S10.

[0110] Fig.13 1 is a diagram showing an example of a display of the observation window screen W1 displayed in an enlarged manner. Fig.13 As shown, the observation window screen W1 is enlarged and displayed at a predetermined magnification. Accordingly, the display control unit 102 enlarges and displays the observation image DP displayed in the display field A12 at a predetermined magnification. Similarly, it is assumed that the user performs a zoom operation to increase the distance between the two indicators touched on the installation device screen W2 by a predetermined distance. In this case, the operation unit 7 accepts an operation to enlarge and display the installation device screen W2 at a predetermined magnification in step S10. The display control unit 102 enlarges and displays the installation device screen W2 at a predetermined magnification in step S11.

[0111] On the other hand, Fig.13 As shown in the figure, it is assumed that the observation window screen W1 and the installation device screen W2 are displayed in the display area 61. At this time, it is assumed that the user performs a zoom operation to reduce the distance between the two indicators touched on the observation window screen W1 by a predetermined distance. At this time, the operation unit 7 receives an operation to reduce and display the observation window screen W1 at a predetermined reduction ratio in step S10. The display control unit 102 performs the operation in step S11 as shown in FIG. Figure 7 The observation window screen W1 is displayed in reduced size at a predetermined reduction ratio as shown. Similarly, when the user performs a zoom operation to reduce the distance between the two indicators touched on the installation device screen W2 by a predetermined distance, the operation unit 7 receives an operation to display the installation device screen W2 in reduced size at a predetermined reduction ratio in step S10. The display control unit 102 displays the installation device screen W2 in reduced size at a predetermined reduction ratio in step S11.

[0112] According to this processing example, the user can change the size of the observation window screen W1 and the installation device screen W2 to a size that is easy to visually check by performing zoom operations on the observation window screen W1 and the installation device screen W2.

[0113] In addition, it is assumed that the user performs a predetermined operation different from the zoom operation of increasing the distance between two indicators touched on the observation window screen W1 (or the installation device screen W2) by a predetermined distance (for example, a double-click operation on the observation window screen W1 (or the installation device screen W2)). In this case, the operation unit 7 may accept an operation of enlarging the observation window screen W1 (or the installation device screen W2) at a predetermined magnification.

[0114] Similarly, it is assumed that the user performs a predetermined operation different from the zoom operation for reducing the distance between two indicators touched on the observation window screen W1 (or the installation device screen W2) by a predetermined distance (for example, a double-click operation on the observation window screen W1 (or the installation device screen W2) displayed in an enlarged manner). In this case, the operation unit 7 may also accept an operation for reducing the display of the observation window screen W1 (or the installation device screen W2) at a predetermined reduction ratio.

[0115] (Processing Example 9)

[0116] When the user performs a swiping operation on the observation window screen W1, the operation unit 7 receives an operation (seventh operation) to change the display position of the observation window screen W1 in accordance with the swiping operation in step S10. At this time, the display control unit 102 performs a process corresponding to the operation in step S11. Similarly, when the user performs a swiping operation on the installation device screen W2, the operation unit 7 receives an operation to change the display position of the installation device screen W2 in accordance with the swiping operation in step S10. At this time, the display control unit 102 performs a process corresponding to the operation in step S11.

[0117] Fig.14 2 is a diagram showing a display example of the observation window screen W1a whose display position is changed. Fig.14 As shown in FIG. 1 , the observation window screen W1 is displayed at the position indicated by the dotted line portion in the display area 61. At this time, it is assumed that the user performs a sliding operation to move the indicator touched on the observation window screen W1 as indicated by the dotted arrow. At this time, the operation unit 7 receives an operation to change the display position of the observation window screen W1 in the direction and distance in which the indicator is moved by the sliding operation in step S10.

[0118] At this time, the display control unit 102 moves the display position of the observation window screen W1 in step S11 in the direction and distance in which the indicator is moved by the slide operation, thereby displaying the observation window screen W1a at the display position after the movement.

[0119] Similarly, it is assumed that the user performs a sliding operation to move the indicator touched on the installation device screen W2. In this case, the operation unit 7 receives an operation to change the display position of the installation device screen W2 in the direction and distance in which the indicator is moved by the sliding operation in step S10. The display control unit 102 moves the display position of the installation device screen W2 in the direction and distance in which the indicator is moved by the sliding operation in step S11.

[0120] According to this processing example, the user can change the display positions of the observation window screen W1 and the installation device screen W2 to positions that are easily visible by performing a slide operation to move the indicator touched on the observation window screen W1 and the installation device screen W2.

[0121] In addition, it is assumed that the user performs a predetermined operation different from the sliding operation of moving the indicator touched on the observation window screen W1 (or the installation instrument screen W2) (for example, a double-click operation in the vicinity of the observation window screen W1 (or the installation instrument screen W2)). In this case, it is also possible to set the operation unit 7 to accept an operation of changing the display position of the observation window screen W1 (or the installation instrument screen W2) (for example, an operation of changing to the position where the predetermined operation (for example, the double-click operation) was performed).

[0122] (Variant Implementation)

[0123] The above-described embodiments are merely examples of embodiments of the present invention and are not intended to limit the present invention to the above-described embodiments. For example, the following modified embodiments are possible.

[0124] (1) The operation unit 7 may further receive input of information related to the observation area shown in the observation image DP displayed on the observation window screen W1. In conjunction with this, the display control unit 102 may display the related information received by the operation unit 7 in the display area 61 of the display unit 6.

[0125] Specifically, the operation unit 7 and the display control unit 102 may be configured as follows. When a user performs a touch operation at a position in the display area 61 where the observation window screen W1 and the installation device screen W2 are not displayed (hereinafter referred to as a touch position), the operation unit 7 may accept the touch operation in step S10. At this time, the display control unit 102 may display a menu screen (not shown) in the display area 61 in step S11 as a process corresponding to the touch operation.

[0126] The menu screen may include a menu that displays an operation screen for inputting related information, and the related information is related to the observation area shown in the observation image DP displayed on the observation window screen W1. Here, it is assumed that the user touches the menu that displays an operation screen for inputting related information included in the menu screen. In this case, the operation unit 7 accepts the touch operation in step S10. In addition, the display control unit 102 may display the operation screen for inputting related information in the display area 61 as a process corresponding to the touch operation in step S11.

[0127] Fig.151 is a diagram showing an example of display of the input related information MSG1. Thereafter, if the user inputs related information using the operation screen, the operation unit 7 accepts the input operation of the related information in step S10. Fig.15 As shown, the relevant information MSG1 received by the operation unit 7 may be displayed at the touched position.

[0128] In addition, the display control unit 102 may further associate the related information input by the user and displayed with the identification information of the test started in step S8 and store it in the storage unit 8. The identification information of the test may include, for example, the implementation date of the test, user identification information of one or more authorized users who conduct the test, etc.

[0129] In conjunction with this, in step S4, the display control unit 102 may acquire not only the layout information but also the related information associated with the identification information of the test including the user identification information of the permitted user acquired in step S3 from the storage unit 8. Then, in step S7, the display control unit 102 may display the related information acquired from the storage unit 8 in the display area 61.

[0130] At this time, when a second permitted user who is different from the first permitted user and who observes the same observation area as the first permitted user who inputs the relevant information comes to the vicinity of the door 2, the relevant information input by the first permitted user can be visually confirmed. Therefore, by the first permitted user inputting matters found in the observation of the observation area as relevant information, the relevant information related to the observation area can be transmitted to the second permitted user.

[0131] (2) Fig.16 As shown, the display control unit 102 may further display a history observation window screen W3 showing one or more observation images DPh captured in the past, in parallel with the currently displayed observation window screen W1 , in the display area 61 of the display unit 6 . Fig.16 2 is a diagram showing a display example of the history observation window screen W3.

[0132] For example, the operation unit 7 and the display control unit 102 may be configured as follows. In step S6, the display control unit 102 may also periodically store the images captured by the camera unit 4 (hereinafter referred to as captured images) in the storage unit 8 in sequence after the camera unit 4 starts capturing images in the sample tank 18. Then, when the user performs a touch operation in the area of ​​the display area 61 where the observation window screen W1 and the instrument screen W2 are not displayed, the operation unit 7 accepts the touch operation in step S10. At this time, the display control unit 102 may display a menu screen (not shown) in the display area 61 as a process corresponding to the touch operation in step S11.

[0133] The menu screen may include a menu for displaying the history observation window screen W3. Here, it is assumed that the user touches the menu for displaying the history observation window screen W3 included in the menu screen. In this case, the operation unit 7 may accept the touch operation in step S10. Then, in this case, the display control unit 102 may perform the touch operation in step S11. Fig.16 As shown, the history observation window screen W3 can be displayed in parallel with the currently displayed observation window screen W1.

[0134] In addition, when the user performs a predetermined operation such as a touch operation in an area of ​​the display area 61 where the observation window screen W1 and the installation device screen W2 are not displayed, the operation unit 7 may accept the predetermined operation. Then, the display control unit 102 displays the history observation window screen W3 instead of displaying the menu screen as a process corresponding to the predetermined operation.

[0135] The history observation window screen W3 may be formed of, for example, three display fields A31, A32, and A33. The display field A31 may include an end key Ke. When the user touches the end key Ke and the operation unit 7 accepts the touch operation in step S10, the display control unit 102 may set the history observation window screen W3 to non-display in step S11.

[0136] In addition, the display bar A33 may include buttons for performing various operations for displaying one or more observation images DPh captured in the past in a time series. The various operations may include an operation for displaying one or more observation images DPh captured in the past in a time series, an operation for temporarily stopping the operation for displaying in a time series, an operation for displaying an observation image DPh displayed before or after the currently displayed observation image DPh, an operation for displaying the most past or most recently displayed observation image DPh, and the like.

[0137] Furthermore, the display control unit 102 may extract images representing the same observation area as the observation area of ​​the observation image DP displayed in the display field A12 of the observation window screen W1 from the one or more past captured images stored in the storage unit 8. Then, the one or more extracted images may be set as the one or more observation images DPh captured in the past.

[0138] Next, it is assumed that the user touches the button displayed in the display field A33, and the operation unit 7 accepts the touch operation in step S10. In this case, the display control unit 102 may display, in step S11, in the display field A32, the observation image DPh corresponding to the operation performed by the button that has been touched, among the one or more observation images DPh extracted.

[0139] For example, if the user touches a button for performing an operation to display the most recently captured observation image DPh, the display control unit 102 may display, in the display field A32, the observation image DPh extracted from the most recently captured image corresponding to the operation performed by the button among the one or more extracted observation images DPh.

[0140] In addition, it is also possible to display the one or more extracted observation images DPh in the display bar A32 in sequence at a specified time starting from the observation image DPh extracted from the most recent image without relying on the operation displayed in the display bar A33 or without setting the display bar A33 in the history observation window screen W3.

[0141] Alternatively, it is assumed that the user performs a touch operation on the graph area A225 of the installation instrument screen W2, and the operation unit 7 accepts the touch operation in step S10. In this case, the display control unit 102 may display, in step S11, in the display field A32, the observation image DPh extracted from the captured image captured at the time corresponding to the position of the touch operation among the one or more extracted observation images DPh.

[0142] According to this processing example, one or more observation images DPh captured in the past are displayed side by side with the observation image DP. Therefore, the user can easily understand the changes in the observation area status until the current status by comparing the current status of the observation area with the status of the observation area at one or more times in the past.

[0143] (3) The display control unit 102 may display information related to the observation area other than the observation image DP displayed on the observation window screen W1 , the target temperature and target humidity displayed on the installation instrument screen W2 , and the temperature and humidity of the air in the sample tank 18 detected by the environmental sensor 5 .

[0144] For example, sample information related to one or more samples contained in the sample tank 18 may be stored in the storage unit 8. The sample information may include identification information of each sample, an image of each sample, information indicating a tester who tested each sample, and the like.

[0145] In conjunction with this, the display control unit 102 can also acquire the sample information including the specific sample image by executing the known image recognition processing, when the specified feature quantity of the sample image included in the observation image DP is consistent with the specified feature quantity of the image of the sample captured included in a certain specific sample information (hereinafter referred to as the specific sample image). In addition, the display control unit 102 can also use the sample identification information included in the acquired sample information and the information indicating the tester who conducted the test on the sample as relevant information in step S9, and associate it with the sample image included in the observation image DP and display it.

[0146] In addition, a surface temperature sensor for detecting the surface temperature of each sample contained in the sample tank 18 may be further provided. In conjunction with this, the display control unit 102 may associate the image of the sample included in the observation image DP with the surface temperature of the sample detected by the surface temperature sensor as related information in step S9.

[0147] In addition, the environmental sensor 5 may be configured to detect the temperature distribution and wind speed distribution in the test trough 18 in addition to the temperature and humidity of the air in the test trough 18. In conjunction with this, the display control unit 102 may also display information indicating the detected temperature distribution and wind speed distribution as related information in the display area 61 in step S9.

[0148] (4) The method of authenticating the user and the method of acquiring the user identification information of the permitted user are not limited to the methods shown in step S1 and step S2.

[0149] For example, the environmental test device 1 may be provided with an image sensor 13, and the authentication unit 101 may display an authentication operation screen in the display area 61 for inputting the user identification information of the permitted user and the password of the permitted user. Then, in the authentication operation screen, when the user identification information and the password are input, the operation unit 7 may accept the input operation. Then, the authentication unit 101 may determine whether the accepted user identification information and password are stored in the storage unit 8 in association.

[0150] Then, when the authentication unit 101 determines that the received user identification information and password are stored in association in the storage unit 8, it may regard the user who inputs the user identification information and password as a permitted user and acquire the user identification information.

[0151] (5) In step S9, the display control unit 102 may also display the most recent observation image DP in the display field A12. Then, whenever the display control unit 102 displays the temperature A221 and humidity A222 in the sample tank 18 most recently detected by the environmental sensor 5 in the display field A22, the display control unit 102 stores the most recent observation image DP in the storage unit 8 in association with the temperature A221 and the humidity A222.

[0152] In conjunction with this, the control unit 10 may also respond to a request for sending information indicating the condition in the sample tank 18 received from an external device through the interface unit 9. Specifically, the control unit 10 may also send one or more observation images DP stored in the storage unit 8 and the temperature A221 and humidity A222 associated with the one or more observation images DP to the external device through the interface unit 9. Accordingly, the condition in the sample tank 18 may also be grasped in the external device that sends the request for sending.

[0153] (6) The display control unit 102 may not display the full area display key Ka in the display field A11, and in conjunction with this, may not display the initial area display key Ks in the display field A11. The display control unit 102 may not display the non-display key Kc in the display field A11. The display control unit 102 may not display the two sight line change buttons BR1 and BR2 in the display field A13. The display control unit 102 may not display the zoom-in button BS1 in the display field A13. The display control unit 102 may not display the zoom-out button BS2 in the display field A13.

[0154] (7) When the user performs a zoom operation on the observation window screen W1, the operation unit 7 may not accept an operation to enlarge or reduce the display of the observation window screen W1 in response to the zoom operation. When the user performs a slide operation on the observation window screen W1, the operation unit 7 may not accept an operation to change the display position of the observation window screen W1 in response to the slide operation.

[0155] (8) Assume that in step S13, the execution unit 103 updates the layout information of the observation window screen W1 stored in the storage unit 8 to the layout information of the observation window screen W1 currently displayed in the display area 61 (hereinafter referred to as updated layout information).

[0156] At this time, the update layout information may further include information indicating the line of sight when visually checking the observation area and information indicating enlargement or reduction of the observation area as information indicating the display layout of the observation window screen W1.

[0157] Thereafter, it is assumed that the updated layout information is acquired in step S4, and in step S7, the display control unit 102 displays the observation window screen W1 in the display layout indicated by the acquired updated layout information. At this time, the display control unit 102 resets the line of sight when visually confirming the observation area according to the information indicating the display layout of the observation image DP included in the acquired updated layout information. Then, the image seen when observing the observation area with the reset line of sight may be displayed in the display column A12, or the image of the observation area enlarged or the image of the observation area reduced may be displayed in the display column A12.

[0158] (9) The display column A11 may also include a portion for displaying a value greater than Figure 7 The observation window W1 shown is smaller than Figure 8 The display control unit 102 may display the observation window screen W1 of the observation window screen W1 shown in the example. Furthermore, when the one or more display keys are respectively touched by the user, the display control unit 102 may display the observation window screen W1 of a size corresponding to each of the touch-operated display keys, as in the processing example 1. In addition, the observation image DP showing the observation area set to a size corresponding to the size of the observation window screen W1 is displayed in the display field A12 of the observation window screen W1. In this way, the user can easily switch the display of the observation window screen W1 of multiple stages of sizes.

[0159] (10) The display control unit 102 may also set the observation window screen W1 and the installation instrument screen W2 to non-display after a specified time (for example, one hour) has passed after the observation window screen W1 and the installation instrument screen W2 have been displayed in the display area 61. Alternatively, the display control unit 102 may also periodically determine whether the surrounding image captured by the image sensor 13 contains an image representing a person by performing a known image recognition process after the observation window screen W1 and the installation instrument screen W2 have been displayed in the display area 61. Furthermore, when the display control unit 102 determines that the surrounding image does not contain an image representing a person, it may also set the observation window screen W1 and the installation instrument screen W2 to non-display. In this case, after the observation window screen W1 and the installation instrument screen W2 are set to non-display, the processing after step S1 may be executed.

[0160] In addition, the above-mentioned embodiment will be summarized as follows.

[0161] An environment forming device involved in one aspect of the embodiment includes: a sample tank capable of accommodating one or more samples; a photographing unit for photographing the inside of the sample tank; an opening and closing door for opening and closing the sample tank; a display unit arranged outside the opening and closing door; an operation unit for accepting an operation for specifying an observation area of ​​an observation object in the sample tank; and a display control unit for extracting an observation image representing the observation area from the image photographed by the photographing unit, and displaying the extracted observation image on the display unit.

[0162] According to this configuration, when the user performs an operation to designate an observation area, an observation image representing the designated observation area is displayed on the display unit provided outside the opening and closing door. Therefore, even when the opening and closing door is closed, the user can visually confirm the observation image displayed on the display unit and observe the desired observation area in the sample tank.

[0163] Furthermore, the operation unit may further receive a first operation for designating a line of sight when observing the observation area. When the operation unit receives the first operation, the display control unit may extract an image viewed when observing the observation area with the line of sight as the observation image.

[0164] According to this configuration, if the user performs a first operation of specifying a line of sight when observing the observation area, an image seen when observing the observation area with the specified line of sight is displayed as an observation image on a display unit provided outside the opening and closing door. Therefore, even when the opening and closing door is closed, the user can visually confirm the observation image displayed on the display unit and can observe the desired observation area in the sample tank as desired.

[0165] Furthermore, the operation unit may further receive a second operation for enlarging the observation area. The display control unit may extract an image in which the observation area is enlarged as the observation image when the operation unit receives the second operation.

[0166] According to this aspect, the user can display an image of the observation area enlarged as an observation image on the display unit by performing the second operation, thereby enabling the user to observe the observation area in more detail.

[0167] Furthermore, the operation unit may be further capable of accepting a third operation for reducing the observation area. When the operation unit accepts the third operation, the display control unit may extract an image in which the observation area is reduced as the observation image.

[0168] According to this aspect, the user can display the image of the reduced observation area as the observation image on the display unit by performing the third operation. This allows the user to further observe the observation area from a bird's-eye view.

[0169] In addition, the display control unit may further display relevant information related to the observation area on the display unit.

[0170] According to this aspect, the user can visually check not only the image showing the observation area but also the related information related to the observation area. Therefore, the user can understand the status of the observation area in the sample tank in more detail.

[0171] In addition, the operation unit may further receive an input operation of the related information.

[0172] According to this method, the user can refer not only to the image representing the observation area, but also to the relevant information related to the observation area input by the user. Therefore, for example, when the user observing the observation area is changed to another user, the user before the change can input the matters found in the observation of the observation area as the relevant information. In this way, the relevant information related to the observation area can be transmitted to the other user.

[0173] Furthermore, the display control unit may further display one or more observation images captured in the past and the observation image currently being displayed side by side on the display unit.

[0174] According to this method, one or more observation images captured in the past are displayed in parallel with the observation image. Therefore, the user can easily understand the changes in the observation area status until the current status by comparing the current status of the observation area with the status of the observation area at one or more times in the past.

[0175] In addition, the operation unit may be further capable of accepting a fourth operation of designating the entire interior of the sample tank as the observation area.

[0176] According to this aspect, the user can display an image showing the entire sample tank as an observation image on the display unit by performing the fourth operation. Thus, the user can observe the entire situation in the sample tank at a glance.

[0177] Furthermore, the environment forming device may further include: an acquisition unit that acquires user identification information; and a storage unit that stores the user identification information and layout information indicating a display layout when the observation image is displayed on the display unit in association with each other in advance. The display control unit may also acquire the layout information associated with the user identification information acquired by the acquisition unit from the storage unit, and display the observation image in the display layout indicated by the acquired layout information.

[0178] According to this method, the observation image is displayed in the display layout indicated by the layout information associated with the user's identification information. Therefore, the layout information indicating the display layout of the observation image with good visual confirmation for the user can be associated with the identification information of the user and stored in the storage unit. According to this, the user can more appropriately observe the observation area shown in the observation image by visually confirming the observation image displayed in the display layout with good visual confirmation for the user.

[0179] Furthermore, the operation unit may be capable of accepting a fifth operation of non-displaying the observation image. The display control unit may be capable of non-displaying the observation image when the operation unit accepts the fifth operation.

[0180] According to this aspect, the user can hide the observation image by performing the fifth operation. This can quickly prevent a third party who comes in front of the environment forming device from visually checking the observation image and understanding the status of the observation area shown by the observation image.

[0181] Furthermore, the operation unit may be capable of accepting a sixth operation of enlarging or reducing the observation image for display. The display control unit may be capable of enlarging or reducing the observation image for display if the operation unit accepts the sixth operation.

[0182] According to this aspect, the user can change the size of the observation image to a size that is easy to visually recognize by repeatedly performing the sixth operation.

[0183] Furthermore, the operation unit may be capable of accepting a seventh operation for changing a display position of the observation image. The display control unit may change a display position of the observation image when the operation unit accepts the seventh operation.

[0184] According to this aspect, the user can change the position of the observation image to a position that is easy to visually confirm by repeatedly performing the seventh operation.

Claims

1. An environment forming device, characterized in that include: A sample tank capable of accommodating more than one sample; A photographing unit, for photographing the inside of the sample tank; Open and close the door to open and close the sample tank; A display unit, arranged outside the opening and closing door; An operation unit that receives an operation for designating an observation area of ​​an observation object in the sample tank; as well as a display control unit that extracts an observation image representing the observation area from the image captured by the imaging unit and displays the extracted observation image on the display unit, The photographing unit photographs the inside of the sample tank from multiple directions. The operation unit is further capable of accepting a first operation and an area moving operation, wherein the first operation designates a line of sight that is rotated when observing the observation area in a direction corresponding to a line of sight change button that is touched among a plurality of line of sight change buttons displayed on the display unit as a new line of sight when observing the observation area, and the area moving operation moves the observation area a specified distance in a direction corresponding to a line of sight designation button that is touched among a plurality of line of sight designation buttons displayed on the display unit. The display control unit, when the operating unit accepts the area moving operation, extracts the observation image representing the observation area after being moved by the area moving operation, and displays the extracted observation image on the display unit. When the operating unit accepts the first operation, the display control unit extracts the image seen when observing the observation area with the line of sight as the observation image, and displays the extracted observation image on the display unit.

2. The environment forming device according to claim 1, characterized in that: The operation unit can further receive a second operation of enlarging the observation area. The display control unit extracts, when the operation unit accepts the second operation, an image in which the observation area is enlarged as the observation image.

3. The environment forming device according to claim 1, characterized in that: The operation unit can further receive a third operation of reducing the observation area. The display control unit extracts, when the operation unit accepts the third operation, an image in which the observation area is reduced as the observation image.

4. The environment forming device according to claim 1, characterized in that: The display control unit further displays relevant information related to the observation area on the display unit.

5. The environment forming device according to claim 4, characterized in that: The operation unit can further receive an input operation of the related information.

6. The environment forming device according to claim 1, characterized in that: The display control unit further causes the display unit to display one or more observation images captured in the past and the currently displayed observation image side by side.

7. The environment forming device according to claim 1, characterized in that: The operation unit can further receive a fourth operation of designating the entire interior of the sample tank as the observation area.

8. The environment forming device according to claim 1, characterized in that Also includes: An acquisition unit, which acquires identification information of a user; as well as The storage unit stores the identification information of the user and the layout information indicating the display layout when the observation image is displayed on the display unit in association with each other in advance, wherein: The display control unit acquires the layout information associated with the identification information of the user acquired by the acquisition unit from the storage unit, and displays the observation image in a display layout indicated by the acquired layout information.

9. The environment forming device according to claim 1, characterized in that: The operation unit is capable of accepting a fifth operation of non-displaying the observation image, The display control unit hides the observation image when the operation unit accepts the fifth operation.

10. The environment forming device according to claim 1, characterized in that: The operation unit is capable of accepting a sixth operation of displaying the observation image in an enlarged or reduced manner, The display control unit, when the operation unit accepts the sixth operation, enlarges or reduces the observation image for display.

11. The environment forming device according to claim 1, characterized in that: The operation unit is capable of accepting a seventh operation of changing a display position of the observation image, The display control unit changes a display position of the observation image when the operation unit accepts the seventh operation.

Images