Analysis model creation device and analysis and visualization system

Abstract

To provide a technique capable of improving the efficiency and accuracy of the spatial model creation of an analysis target.SOLUTION: An analysis model creation device 600 includes: an imaging unit 604, a spatial shape acquisition unit 606, an object recognition unit 610, and a model creation unit 612. The imaging unit 604 picks up an image of a real space in which an air conditioner is installed. The spatial shape acquisition unit 606 creates a spatial model corresponding to the real space based on the picked-up image of the real space. The object recognition unit 610 recognizes the air conditioner installed in the real space based on the picked-up image of the real space as an object. The model creation unit 612 creates an analysis spatial model for thermal fluid analysis by placing the above object on the above spatial model. The object recognition unit 610 sets the attributes of the air conditioner for the thermal fluid analysis on the recognized object.SELECTED DRAWING: Figure 17

Description

[Technical Field]

[0001] The present disclosure relates to data processing technology, and in particular to an analytical model creation device and an analytical visualization system. [Background technology]

[0002] In the system described in Patent Document 1, an operator uses a portable processing device to create a space model to be analyzed by placing air conditioners, fixtures, etc. in a virtual space. Then, an analysis of the air condition when the air conditioner is operating is performed on the created space model, and the analysis results are displayed on the processing device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-159090 Summary of the Invention [Problem to be solved by the invention]

[0004] In the system described in Patent Document 1, when creating a spatial model of the object to be analyzed, the worker needs to input information about the size of the space and select and place air conditioners. As a result, creating a spatial model of the object to be analyzed takes a relatively large amount of man-hours, and the accuracy of the spatial model is not high.

[0005] In view of the above, an object of the present disclosure is to provide a technique for improving the efficiency and accuracy of creating a spatial model of an analysis target. [Means for solving the problem]

[0006] In order to solve the above problems, an analytical model creation device according to one aspect of the present disclosure includes an imaging unit that captures images of a real space in which an air conditioner is installed, a spatial shape acquisition unit that creates a spatial model corresponding to the real space based on the image of the real space captured by the imaging unit, an object recognition unit that recognizes the air conditioner installed in the real space as an object based on the image of the real space captured by the imaging unit, and a model creation unit that creates an analytical spatial model to be subjected to thermal-fluid analysis by placing the object recognized by the object recognition unit in the spatial model created by the spatial shape acquisition unit. The object recognition unit sets attributes of the air conditioner related to the thermal-fluid analysis for the recognized object.

[0007] In addition, any combination of the above components, or any expression of the technology of the present disclosure converted between an apparatus, a system, a method, a computer program, or a recording medium on which a computer program is recorded, is also valid as an aspect of the present disclosure. [Effects of the Invention]

[0008] According to the present disclosure, the efficiency and accuracy of creating a spatial model of an analysis target can be improved. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing the overall configuration of a visualization system according to a first embodiment. [Figure 2] 2(a)-(g) are diagrams showing an outline of the operation of the visualization system of FIG. [Figure 3] FIG. 3 is a diagram illustrating an example of the first display screen according to this embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the second display screen according to this embodiment. [Figure 5] 5(a) and 5(b) are diagrams illustrating the third and fourth display screens according to this embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the fifth display screen according to this embodiment. [Figure 7]FIG. 7 is a diagram illustrating an example of the sixth display screen according to this embodiment. [Figure 8] 8(a) and 8(b) are diagrams illustrating operation screens for the conversion unit of FIG. [Figure 9] 9(a) and 9(b) are diagrams showing the external appearance of the mobile information terminal of FIG. [Figure 10] 10(a) to 10(e) are diagrams showing an outline of the operation of the mobile information terminal of FIG. [Figure 11] 11(a) to 11(c) are diagrams showing screens displayed on the display unit of FIG. [Figure 12] 12(a) to 12(d) are diagrams showing screens displayed on the display unit when the direction in which the portable information terminal of FIG. 1 is held is changed. [Figure 13] 13(a)-(h) are diagrams showing screens displayed on the display unit of FIG. [Figure 14] FIG. 14 is a diagram showing a screen displayed on the display unit in FIG. [Figure 15] 15(a) and 15(b) are diagrams showing screens displayed on the display unit of FIG. [Figure 16] 16(a) to 16(c) are diagrams showing screens displayed on the display unit of FIG. [Figure 17] FIG. 17 is a diagram showing the overall configuration of a visualization system according to the second embodiment. [Figure 18] FIG. 18 is a diagram illustrating an example of data stored in the device data storage unit. [Figure 19] FIG. 19 is a flowchart showing the operation of the analysis model creating device. [Figure 20] FIG. 20 is a diagram showing an example of the analytical space model screen. [Figure 21] FIG. 21 is a diagram showing an example of data stored in the device data storage unit of the first modified example. [Figure 22] FIG. 22 is a diagram showing an example of a captured image screen. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments for carrying out the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments are examples that embody the present disclosure and do not limit the technical scope of the present disclosure. Furthermore, the same components are denoted by the same reference numerals throughout the drawings, and their explanations are omitted. Furthermore, to avoid duplication, explanations for each of the details of each part that is not directly related to the present disclosure are omitted for each drawing.

[0011] Furthermore, each figure is a schematic diagram and is not necessarily an exact illustration. Therefore, for example, the scales of the figures do not necessarily match. Furthermore, in each figure, substantially the same components are given the same reference numerals, and redundant explanations are omitted or simplified.

[0012] <First Example> Below, the first embodiment, which is a premise example of the present disclosure, will be explained with reference to the drawings in the following order: (1) overall configuration, (2) settings for thermal fluid analysis, (3) thermal fluid analysis, (4) conversion of thermal fluid analysis results, and (5) display on a mobile information terminal.

[0013] (1) Overall structure FIG. 1 is an overall configuration diagram of a visualization system 1000 according to a first embodiment. The visualization system 1000 performs a thermal fluid analysis of a diffusive material having a sterilization effect in an analysis space, which is a space to be subjected to the thermal fluid analysis, based on analysis condition information, and displays the analysis results. The visualization system 1000 includes an input terminal 100, a processing device 120, a server 200, and a mobile information terminal 300. The input terminal 100 includes a setting unit 110, which includes an input unit 112 and an output unit 114. The processing device 120 includes an analysis unit 130 and a conversion unit 150. The analysis unit 130 includes an acquisition unit 132, a processing unit 134, a calculation unit 136, a determination unit 138, a storage unit 140, and an analysis result output unit 142. The conversion unit 150 includes an analysis result acquisition unit 152, a processing unit 154, and an output unit 156. The server 200 includes a database 210. The portable information terminal 300 includes a communication unit 310 , a control unit 320 , an operation unit 330 , a display unit 340 , an imaging unit 350 , and a storage unit 360 .

[0014] The input terminal 100 is a PC (Personal Computer) or a tablet terminal. The input unit 112 is a user interface that accepts operations from a user. The user interface is, for example, a touch panel or physical operation buttons. The input unit 112 creates analysis target data based on the operations from the user. The analysis target data includes information on the analysis space that is the target of the thermal fluid analysis.

[0015] 2(a)-(g) show an overview of the operation of the visualization system 1000. FIG. 2(a) shows an analysis space 10 included in the analysis target data created by the setting unit 110. The analysis space 10 is a virtual space modeled after an actual space (hereinafter referred to as "real space"), and is the space on which a thermal fluid analysis is performed. The real space is, for example, a living space in an ordinary house or an office space, and the living space or office space may include one or more rooms. Furthermore, the analysis space 10 also contains equipment such as air conditioners and desks, just like the real space. The input unit 112 receives information about the equipment, such as the model, size, and operating conditions, as equipment information. The equipment information is also included in the analysis target data.

[0016] Fig. 2(b) shows a marker 20 set in one of the rooms in the analysis space 10 shown in Fig. 2(a). The input unit 112 places the marker 20 in the analysis space 10 in the analysis target data by operation of the user, and specifies the coordinates of the marker 20. The marker 20 will be described later. Figs. 2(c)-(g) will be described later, returning to Fig. 1. The input unit 112 is connected to an acquisition unit 132 of the analysis unit 130 (described later) via wireless or wired communication so that they can communicate with each other.

[0017] The output unit 114 outputs the coordinates and device information of the marker 20 received by the input unit 112 to the analysis result acquisition unit 152 of the conversion unit 150 .

[0018] The processing device 120 is configured by a computer system having a processor and memory. The analysis unit 130 of the processing device 120 performs thermal fluid analysis calculations by having the processor execute a program stored in the memory based on the analysis target data. The acquisition unit 132 of the analysis unit 130 acquires analysis target data for the analysis space 10 that is the target of the thermal fluid analysis from the input unit 112. The acquisition unit 132 outputs the analysis target data to the processing unit 134.

[0019] The processing unit 134 causes the calculation unit 136 to execute a thermal fluid analysis calculation based on the analysis target data to simulate the situation in which air is blown from an air conditioner placed in the analysis space 10. The calculation unit 136 performs, for example, an analysis based on computational fluid dynamics (CFD) (hereinafter referred to as CFD analysis). The CFD analysis executes a thermal fluid analysis calculation on the analysis target data using a model such as Reynolds-Averaged Navier-Stokes equations (RANS), Direct Numerical Simulation (DNS), Large Eddy Simulation (LES), or Detached Eddy Simulation (DES).

[0020] For example, the calculation unit 136 performs CFD analysis based on the type of diffusive substance, the amount of diffusive substance generated, the wind direction and speed of the airflow, the self-decomposition coefficient of the diffusive substance, the diffusion coefficient of the diffusive substance, the adsorption and desorption coefficient of the diffusive substance, etc., to calculate the airflow flowing out from the air conditioner for each position in the analysis space 10 and the concentration of the diffusive substance contained in the airflow. Specifically, as shown in Fig. 2(c), the calculation unit 136 generates a three-dimensional distribution of the airflow and the concentration of the diffusive substance for each position in the analysis space 10. The self-decomposition coefficient of the diffusive substance, the diffusion coefficient of the diffusive substance, and the adsorption and desorption coefficient of the diffusive substance are well-known techniques, and therefore will not be described here.

[0021] The diffusing material is a material that has a sterilizing effect that sterilizes bacteria. Here, sterilization refers not only to the removal of bacteria or germs, but also to the removal of viruses. In other words, bacteria includes not only bacteria but also viruses. Examples of bacteria include, but are not limited to, Staphylococcus aureus, Pseudomonas aeruginosa, and Escherichia coli. An example of the diffusing material is hypochlorous acid (HClO). Another example of the diffusing material may be a material containing OH radicals generated by applying a high voltage to moisture in the air (e.g., nanoe (registered trademark)).

[0022] The determination unit 138 analyzes the thermo-fluid analysis results obtained by the calculation unit 136 and identifies the presence or absence of a distribution region where the analyzed physical property value results are outside a reference range (4 ppb to 10 ppb in the case of a diffusive material concentration). The memory unit 140 stores various information. The memory unit 140 stores algorithms for executing the processing of the processing unit 134 of the present disclosure. The memory unit 140 stores past thermo-fluid analysis results and information on each component used in the analytical calculations in the calculation unit 136 (model, shape, default conditions, diffusive material information, etc.). The analysis result output unit 142 outputs the thermo-fluid analysis results from the processing unit 134 to the conversion unit 150.

[0023] The analysis result acquisition unit 152 of the conversion unit 150 receives the thermal fluid analysis results from the analysis result output unit 142 and outputs the thermal fluid analysis results to the processing unit 154. The analysis result acquisition unit 152 also receives the coordinates of the marker 20 and the device information from the output unit 114 and outputs the coordinates of the marker 20 and the device information to the processing unit 154.

[0024] The processing unit 154 converts the thermal fluid analysis result 160 into AR data 162, as shown in FIG. 2(d). The AR data 162 is data for displaying the thermal fluid analysis result 160 as AR on the mobile information terminal 300. Although the AR data 162 and the thermal fluid analysis result 160 have different data formats, the AR data 162 also indicates the thermal fluid analysis result, and therefore, hereinafter, the "AR data 162" may also be referred to as the "thermal fluid analysis result 160." During the conversion, the coordinates and device information of the marker 20 are associated with the AR data 162. That is, in the analysis space 10 converted into the AR data 162 (hereinafter also referred to as the "analysis space 10"), the marker 20 is placed in the same position as before. The output unit 156 is capable of communicating with the server 200 wirelessly or via a wired connection, and transmits the AR data 162 to the server 200.

[0025] The database 210 of the server 200 receives the AR data 162 from the output unit 156. The database 210 stores the AR data 162. The database 210 transmits the AR data 162 to the mobile information terminal 300 in response to a request from the mobile information terminal 300.

[0026] The mobile information terminal 300 is a tablet terminal or a smartphone. The mobile information terminal 300 may also be a 2-in-1 mobile terminal (a terminal that can be used as both a laptop and a tablet depending on the situation) that is being used as a tablet terminal. The mobile information terminal 300 may be the same device as the input terminal 100. The communication unit 310 is capable of wirelessly communicating with the server 200 and receives AR data 162 from the server. The communication unit 310 outputs the AR data 162 to the control unit 320. The control unit 320 executes a program stored in the storage unit 360. Here, a program for visualizing the thermal fluid analysis result 160 using AR is executed. When executing the program, the control unit 320 accepts operations from a user via the operation unit 330. The operation unit 330 is a user interface that can accept operations from a user, such as a touch panel.

[0027] The image capturing unit 350 is a LiDAR (Light Detection and Ranging) camera or LiDAR sensor that captures an image and identifies the distance to an object included in the captured image. The image capturing unit 350 outputs the captured image to the control unit 320. The image includes information about the identified distance. The control unit 320 causes the display unit 340 to display the image captured by the image capturing unit 350.

[0028] 2(e) shows an image displayed on the display unit 340. A marker 420 is placed in the real space corresponding to the analytical space 10. Here, the relative position of the marker 20 placed in the analytical space 10 is the same as the relative position of the marker 420 placed in the real space 410. The image of the marker 420 is captured by the imaging unit 350.

[0029] 2(f) shows the processing in the control unit 320. The control unit 320 identifies the position of the marker 420 in the real space 410 based on the image captured by the imaging unit 350. The control unit 320 also identifies the position of the marker 20 in the analytical space 10 based on the AR data 162. The control unit 320 associates the marker 420 with the marker 20, thereby associating the coordinates of the real space 410 with the coordinates of the analytical space 10. In other words, the real space 410 and the analytical space 10 are aligned.

[0030] As a result, the control unit 320 displays the real space 410 in three dimensions on the display unit 340, as shown in Figure 2(g), and also displays the thermal fluid analysis result 160 obtained by the analysis unit 130 on the display unit 340, superimposed on the three-dimensionally displayed real space 410.

[0031] (2) Settings for thermal fluid analysis When a user starts a task by operating the input unit 112, the input terminal 100 displays a first display screen F1 of FIG. 3 on a display unit (not shown). FIG. 3 illustrates the first display screen F1. The user inputs vertex coordinates of the analytical space 10 on the first display screen F1. The shape of the analytical space 10 is defined by the user specifying the vertex coordinates on the first display screen F1 through an operation (e.g., a click) by the user. Here, the user clicks C1 on the first display screen F1 to determine the vertex coordinates of vertex T1 of the analytical space 10. Next, the user clicks C2 to determine the vertex coordinates of vertex T2 of the analytical space 10, and a wall W1 connecting vertex T1 and vertex T2 is displayed. After that, the user clicks C3 to C6 to determine the vertex coordinates of vertices T3 to T6 of the analytical space 10, and walls W2 to W5 connecting vertices T2 and T3, vertices T3 and T4, vertices T4 and T5, and vertices T5 and T6 are displayed. Finally, when the user clicks C7 at the same location as the click C1, that is, on the vertex T1, a wall W6 connecting the vertex T1 and the vertex T6 is displayed, and the shape of the analytical space 10 is defined.

[0032] Once the shape of the analytical space 10 is defined, the second display screen F2 shown in FIG. 4 is displayed. FIG. 4 illustrates the second display screen F2. The user inputs the reference dimensions of the analytical space 10 on the second display screen F2. The vertex coordinates can be based on any position on the first display screen F1. When the user clicks C11 and C12 on any two points (e.g., points where the dimensions are known) on the second display screen F2, a reference line L connecting the two points C11 and C12 is displayed. Thereafter, the dimension of the reference line L is determined by inputting the value of the reference dimension in the reference dimension input field 31, and the scale between the vertex coordinates determined on the first display screen F1 can be adjusted to the actual dimension. Furthermore, on the second display screen F2, the ceiling height of the analytical space 10 is determined by inputting the ceiling height of the analytical space 10 in the ceiling height input field 32.

[0033] Once the input of the reference dimensions and ceiling height is complete, the third display screen F3 shown in FIG. 5(a) is displayed. FIGS. 5(a)-(b) illustrate the third display screen F3 and the fourth display screen F4. The user inputs the layout of the components to be installed in the analytical space 10 on the third display screen F3. The user specifies the location in the analytical space where the component is to be placed by clicking C21 to C24 on the location on the third display screen F3 where the user wants to place the component. In addition, the user can place a wall in the area specified by the sliding operation S1 by clicking on the third display screen F3 and then performing the sliding operation S1.

[0034] When the placement operation on the third display screen F3 is completed, the fourth display screen F4 shown in FIG. 5(b) is displayed. The user enters details of the equipment or structure placed on the third display screen F3 on the fourth display screen F4. The fourth display screen F4 displays a list of components to be placed at the positions of each of the clicks C21 to C24 and the slide operation S1. For example, details such as the equipment, wind direction, wind volume, and concentration (diffused substance concentration) can be entered in each of the clicks C21 to C24. For example, when the user clicks on the component field of click C24 on the fourth display screen F4, a list of component types pre-registered in the storage unit 140, such as "Model A," "Model B," "Model C," and "Door," is displayed. The user can enter the required equipment in the component field of click C24 by selecting one of the component types displayed in the list. Similarly, details of wind direction, wind volume, and concentration for each type of component are pre-registered in the storage unit 140, and when the input field for wind direction, wind volume, or concentration is clicked, the input unit 112 accesses the storage unit 140, and a list of pre-registered details is displayed, allowing the user to select from among them. The coordinates of the position X in the X direction (left and right in FIG. 5(a)) and the position Y in the Y direction (up and down in FIG. 5(a)) are detected from the point where the user clicks or slides, and the position is automatically reflected in each input field. Return to FIG. 1. The information on the analysis space 10 created in this way is included in the analysis target data described above.

[0035] (3) Thermofluid analysis The calculation unit 136 executes a thermal fluid analysis calculation for the analysis space 10 based on the analysis target data. At that time, information about each component (model, shape, default conditions, diffusing material information, etc.) stored in the storage unit 140 is used for the thermal fluid analysis calculation. Through the thermal fluid analysis calculation, the calculation unit 136 simulates the airflow flowing out into the analysis space 10 from an air conditioner (air outlet) installed above the analysis space 10, and also simulates the diffusing material of a predetermined concentration contained in the airflow and diffusing into the analysis space 10.

[0036] Here, the airflow simulations include a simulation of the airflow blown out from an air conditioner (air outlet) and a simulation of the airflow containing a diffusing substance (hypochlorous acid). The airflow containing the diffusing substance (hypochlorous acid) is blown out, for example, from equipment other than the air conditioner (air outlet). In the simulations, the airflow is represented by a collection of vectors representing, for example, position, direction, and air volume. Meanwhile, in the simulation of the diffusing substance, the concentration of the diffusing substance at each position in the analysis space 10 is represented. In these simulations, the thermal fluid analysis results are represented by coordinates in the analysis space 10.

[0037] In a simulation of an airflow containing a diffusing substance (hypochlorous acid), multiple simulations may be performed while changing the amount of hypochlorous acid added. A simulation of an airflow containing a diffusing substance (nanoe) may also be performed. Furthermore, in a simulation of an airflow containing a diffusing substance (nanoe), multiple simulations may be performed while changing the amount of nanoe added.

[0038] The calculation unit 136 may perform thermal fluid analysis calculations for different pieces of analysis target data for the same analysis space 10. The different pieces of analysis target data are created, for example, by changing the air conditioner (air outlet) or the number of air conditioners (air outlets). The calculation unit 136 links the thermal fluid analysis results for the different pieces of analysis target data.

[0039] 6 illustrates the fifth display screen F5. The fifth display screen F5 is displayed on the display unit (not shown) of the input terminal 100 or the display unit (not shown) of the processing device 120. The fifth display screen F5 displays the progress of the thermo-fluid analysis calculation as the convergence status of the calculated physical property values as the calculation cycle progresses. Specifically, the convergence status of the thermo-fluid calculation for the turbulence energy, turbulence dissipation rate, various diffusing material concentrations, flow velocity, etc. is displayed.

[0040] 7 illustrates the sixth display screen F6. The sixth display screen F6 is displayed on a display unit (not shown) of the input terminal 100 or a display unit (not shown) of the processing device 120. The sixth display screen F6 displays the results of the thermal fluid analysis, particularly the distribution of the concentration of the diffusing material, in three dimensions in the analysis space 10.

[0041] (4) Conversion of thermo-fluid analysis results 8(a)-(b) illustrate an example of an operation screen for the conversion unit 150. The operation screen is displayed on a display unit (not shown) of the input terminal 100 or a display unit (not shown) of the processing device 120. As shown in FIG. 8(a), a data reference button 400, a conversion data input field 402, and a conversion button 404 are displayed. Clicking the data reference button 400 displays a list of the thermal fluid analysis results 160 output from the analysis result output unit 142. When one of the multiple thermal fluid analysis results 160 included in the list is selected, the data name of the thermal fluid analysis result 160 to be converted is displayed in the conversion data input field 402, as shown in FIG. 8(b). In this state, when the conversion button 404 is clicked, the processing unit 154 of the conversion unit 150 converts the thermal fluid analysis result 160 into AR data 162, as described above.

[0042] (5) Display on mobile information terminals 9(a)-(b) show the external appearance of a mobile information terminal 300. The mobile information terminal 300 is a tablet terminal including a rectangular, flat housing 302 with grips on the sides. FIG. 9(a) shows one surface 304 of the housing 302 and the back surface 306 of the housing 302. The one surface 304 and the back surface 306 are opposite surfaces and both have a rectangular shape. As shown in FIG. 9(a), a rectangular display unit 340 is provided on the one surface 304 of the housing 302. The display unit 340 also functions as a touch panel. As shown in FIG. 9(b), an imaging opening 352 for an imaging unit 350 is provided on the back surface 306 of the housing 302.

[0043] 10(a)-(e) show an overview of the operation of the mobile information terminal 300. 10(a)-(e) show the screen of the display unit 340. 10(a) shows multiple icons 430, and by touching an AR application icon 430, the control unit 320 launches the AR application stored in the storage unit 360. 10(b) shows the initial screen of the launched AR application. A message saying "Please capture the marker with the camera" is displayed in the center. Having confirmed this message, the user moves the marker 420 placed in the real space 410 to a position where it can be captured by the imaging unit 350.

[0044] Following this, in Fig. 10(c), the marker 420 placed in the real space 410 is displayed on the display unit 340. In Fig. 10(d), the imaging unit 350 captures an image of the marker 420 in the state of Fig. 10(c). As a result, as described above, the control unit 320 aligns the real space 410 with the analytical space 10. In Fig. 10(e), the walls W, equipment, and fixtures of the analytical space 10 are displayed in AR.

[0045] 11(a)-(c) show screens displayed on the display unit 340. FIG. 11(a) shows the layout of the screen of the display unit 340 when an AR application is launched on the mobile information terminal 300. Here, the mobile information terminal 300 is shown in a state where the left side of the mobile information terminal 300 is held in the left hand and the right side is held in the right hand, with the display unit 340 facing the user. The mobile information terminal 300 is also held in a landscape orientation. The lower left end 500 of the display unit 340 is located in a position that can be operated with the thumb or any finger of the user's left hand, and the lower right end 502 is located in a position that can be operated with the thumb or any finger of the user's right hand. The mobile information terminal 300 may be held in one hand of the user.

[0046] 11(b) shows the screen of the display unit 340 when an AR application is running. The AR application generates an image (hereinafter referred to as a "composite image") by superimposing, as AR, an image of the real space 410 captured by the imaging unit 350 and the thermal fluid analysis result 160 in which the real space 410 is set as the analysis space 10. At this time, the AR application aligns the coordinates of the image of the real space 410 with the coordinates of the analysis space 10 by aligning the markers 420 and 20. The display unit 340 displays the composite image generated by the AR application.

[0047] The display unit 340 displays, superimposed on the composite image, a concentration ON / OFF switch button 510, an airflow display mode switch button 512, a Before / After switch button 514, a concentration play / stop operation control button 520, a reset operation control button 522, an elapsed time 524, and an indicator 530. The concentration ON / OFF switch button 510, the airflow display mode switch button 512, the Before / After switch button 514, the concentration play / stop operation control button 520, the reset operation control button 522, and the elapsed time 524 are included in the operation unit 330 in FIG. 1 and accept operations (touch operations) from the user. The operation unit 330 is used to operate the images displayed on the display unit 340, in particular the thermal fluid analysis results 160.

[0048] The concentration ON / OFF switch button 510, the airflow display mode switch button 512, and the Before / After switch button 514 are switch buttons for switching the information displayed on the display unit 340. These switch buttons are located at the lower left end 500. The concentration play / stop operation control button 520, the reset operation control button 522, and the elapsed time 524 are operation control buttons for controlling the operation of the thermal fluid analysis result 160 displayed on the display unit 340. These operation control buttons are located at the lower right end 502. In other words, the composite image is displayed as wide as possible, and the switch buttons and operation control buttons that need to be operated are located as close as possible to the finger movement range, assuming that the mobile information terminal 300 is held with both hands. Alternatively, the switch buttons may be located at the lower right end 502 in FIG. 11, and the operation control buttons may be located at the lower left end 500.

[0049] The indicator 530 includes a diffusion material type indicator 532 that indicates the type of diffusion material and an airflow status indicator 534 that indicates the status of the airflow, and is disposed on the upper right side of the display unit 340. The indicator 530 may be disposed on the upper left side of the display unit 340. The indicator is constantly displayed while the AR application is being executed. Meanwhile, the operation control button is switched between being displayed and not displayed on the display unit 340 by detecting whether or not a finger has touched the display unit 340 within a predetermined period of time. That is, if the operation unit 330 does not detect a finger's touch on the operation control button for a predetermined period of time, the control unit 320 does not display the operation control button on the display unit 340. Meanwhile, if the operation unit 330 detects a finger's touch on the operation control button, the control unit 320 displays the operation control button on the display unit 340. The switching buttons, the switching operations performed by operating the operation control buttons, and the notifications by the indicator 530 will be described later.

[0050] 11(c) shows another screen of the display unit 340 when an AR application is running. Instead of the concentration ON / OFF switch button 510, airflow display mode switch button 512, and before / after switch button 514 of FIG. 11(b), an airflow display mode switch button 512, a ZIA addition amount display mode switch button 516, and a nanoe addition amount display mode switch button 518 are arranged at the bottom left end 500. The airflow display mode switch button 512, the ZIA addition amount display mode switch button 516, and the nanoe addition amount display mode switch button 518 are also switch buttons. "ZIA" is a shorthand notation for operational purposes and indicates air containing hypochlorous acid as a diffusing substance.

[0051] 12(a)-(d) show screens displayed on the display unit 340 when the orientation of the portable information terminal 300 is changed. As before, FIGS. 12(a)-(b) show a situation in which the portable information terminal 300 is held in a landscape orientation. As described above, the concentration ON / OFF switching button 510, airflow display mode switching button 512, and Before / After switching button 514 are located at the lower left end 500. Furthermore, the concentration play / stop operation control button 520, reset operation control button 522, and elapsed time 524 are located at the lower right end 502.

[0052] 12(c)-(d) illustrate a situation where the mobile information terminal 300 is held in a portrait orientation, unlike the previous situation. The mobile information terminal 300 includes an acceleration sensor (not shown) and a geomagnetic sensor (not shown), and the control unit 320 determines the orientation of the mobile information terminal 300 by combining the detection results of these sensors. When the control unit 320 determines that the mobile information terminal 300 is in a portrait orientation, it moves the lower left end 500 and the lower right end 502 to the positions shown in FIG. 12(d). Furthermore, the control unit 320 arranges the switching buttons and operation control buttons at the lower left end 500 and the lower right end 502 in the same manner as before. As a result, a concentration ON / OFF switching button 510, an airflow display mode switching button 512, and a before / after switching button 514 are arranged at the lower left end 500. Furthermore, a concentration play / stop operation control button 520, a reset operation control button 522, and an elapsed time 524 are arranged at the lower right end 502.

[0053] That is, the display unit 340 detects the gripping position of the housing 302, and switches the display position of the operation unit 330 so that it is superimposed on the composite image in the same position relative to the user's thumb. In this way, the display positions of the control buttons and operation control buttons change to optimal positions depending on whether the mobile information terminal 300 is held horizontally or vertically.

[0054] The switching buttons, operation control buttons, and indicators 530 shown in Figures 11(b) and 11(c) will be described in detail below. The concentration ON / OFF switching button 510 in Figure 11(b) is a button for switching whether or not to display the concentration of the diffusible substance (hypochlorous acid) in the thermal fluid analysis result 160. Each time the user touches the concentration ON / OFF switching button 510, the control unit 320 alternates between "concentration ON" and "concentration OFF" as the display of the concentration ON / OFF switching button 510. "Concentration ON" corresponds to displaying the concentration of the diffusible substance (hypochlorous acid), and "concentration OFF" corresponds to not displaying the concentration of the diffusible substance (hypochlorous acid).

[0055] The airflow display mode switching button 512 is a button for switching whether or not to display airflow in the thermal fluid analysis result 160, and for switching the type of airflow when airflow is displayed. Each time the user touches the airflow display mode switching button 512, the control unit 320 switches the display of the airflow display mode switching button 512 between "Airflow OFF", "Airflow Air", "Airflow Zia", and "Both Airflows" in order.

[0056] "Airflow OFF" corresponds to not displaying the airflow, "Airflow Air" corresponds to displaying the airflow blown out from the air conditioner (air outlet), and "Airflow Dia" corresponds to displaying the airflow containing the diffusible substance (hypochlorous acid). Here, "Airflow Dia" may be blown out from a device other than the air conditioner (air outlet). Furthermore, "Airflow Both" corresponds to displaying the airflow blown out from the air conditioner (air outlet) and the airflow containing the diffusible substance (hypochlorous acid).

[0057] 13(a)-(h) show screens displayed on the display unit 340. Fig. 13(a) shows a screen when "concentration OFF" is set using the concentration ON / OFF switching button 510 and "airflow OFF" is set using the airflow display mode switching button 512. In this case, the control unit 320 uses only the image of the real space 410 captured by the imaging unit 350 through the AR application to generate a composite image without using the thermal fluid analysis result 160. The display unit 340 displays the image of the real space 410 captured by the imaging unit 350 as the composite image.

[0058] 13(b) shows the screen when "Concentration OFF" is set using the concentration ON / OFF switching button 510 and "Airflow Air" is set using the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by using an AR application to overlay an image of the real space 410 captured by the imaging unit 350 and the thermal fluid analysis result 160 for the airflow blown out from the air conditioner (air outlet) as AR. The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350 and an air conditioner streamline 550 indicating the airflow blown out from the air conditioner (air outlet).

[0059] 13(c) shows a screen when "Concentration OFF" is set using the concentration ON / OFF switching button 510 and "Airflow Dia" is set using the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by using an AR application to overlay an image of the real space 410 captured by the imaging unit 350 and the thermal fluid analysis result 160 for the airflow containing the diffusing substance (hypochlorous acid) as AR. The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350 and a diffusing substance streamline 552 indicating the airflow containing the diffusing substance (hypochlorous acid).

[0060] 13(d) shows a screen when "Concentration OFF" is set using the concentration ON / OFF switching button 510 and "Both Airflows" is set using the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by using the AR application to overlay, as AR, an image of the real space 410 captured by the imaging unit 350, a thermo-fluid analysis result 160 about the airflow blown out from the air conditioner (air outlet), and a thermo-fluid analysis result 160 about the airflow containing a diffusing substance (hypochlorous acid). The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350, air conditioner streamlines 550 indicating the airflow blown out from the air conditioner (air outlet), and diffused substance streamlines 552 indicating the airflow containing a diffusing substance (hypochlorous acid).

[0061] 13(e) shows a screen when "concentration ON" is set using the concentration ON / OFF switching button 510 and "airflow OFF" is set using the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by using the AR application to overlay an image of the real space 410 captured by the imaging unit 350 and the thermal fluid analysis result 160 for the diffused substance concentration as AR. The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350 and a diffused substance concentration 560 indicating the diffused substance concentration.

[0062] When generating the composite image, the control unit 320 colors the diffusing material in the analytical space 10 with a predetermined color on the projected image of the real space 410. The control unit 320 also changes the transparency of the colored color depending on the concentration of the diffusing material. At this time, the color may be changed depending on the concentration of the diffusing material. The display unit 340 displays the diffusing material concentration 560 colored in this way.

[0063] 13(f) shows a screen when "Concentration ON" is set using the concentration ON / OFF switching button 510 and "Airflow" is set using the airflow display mode switching button 512. In this case, the control unit 320 uses the AR application to generate a composite image by overlaying, as AR, an image of the real space 410 captured by the imaging unit 350, a thermo-fluid analysis result 160 regarding the diffusing substance concentration, and a thermo-fluid analysis result 160 regarding the airflow blown out from the air conditioner (air outlet). The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350, a diffusing substance concentration 560 indicating the diffusing substance concentration, and an air conditioner streamline 550 indicating the airflow blown out from the air conditioner (air outlet).

[0064] 13(g) shows a screen when "Concentration ON" is set using the concentration ON / OFF switch button 510 and "Airflow Dia" is set using the airflow display mode switch button 512. In this case, the control unit 320 generates a composite image by using the AR application to overlay, as AR, an image of the real space 410 captured by the imaging unit 350, a thermo-fluid analysis result 160 regarding the diffusing substance concentration, and a thermo-fluid analysis result 160 regarding the airflow containing the diffusing substance (hypochlorous acid). The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350, a diffusing substance concentration 560 indicating the diffusing substance concentration, and a diffusing substance streamline 552 indicating the airflow containing the diffusing substance (hypochlorous acid).

[0065] 13(h) shows a screen displayed when "Concentration ON" is selected using the concentration ON / OFF switch button 510 and "Both Airflows" is selected using the airflow display mode switch button 512. In this case, the control unit 320 uses the AR application to generate a composite image by overlaying, as AR, an image of the real space 410 captured by the imaging unit 350, a thermal fluid analysis result 160 for the diffusive substance concentration, a thermal fluid analysis result 160 for the airflow blown out from the air conditioner (air outlet), and a thermal fluid analysis result 160 for the airflow containing the diffusive substance (hypochlorous acid). The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350, a diffusive substance concentration 560 indicating the diffusive substance concentration, an air conditioner streamline 550 indicating the airflow blown out from the air conditioner (air outlet), and a diffusive substance streamline 552 indicating the airflow containing the diffusive substance (hypochlorous acid).

[0066] 13(b)-(d) and 13(f)-(h), the control unit 320 displays airflows with a certain wind speed or greater as line segments along the flow direction, starting from the air conditioner (air outlet), on the display unit 340, so that the origin and direction of the airflow, e.g., air conditioner streamline 550 and diffused material streamline 552, can be understood. Furthermore, the control unit 320 represents the airflow as lines or dense, moving particles (dashed lines) so that the airflow's movement can be intuitively conveyed. In this case, the particles are displayed as moving according to the airflow speed. However, the movement of the moving particles is set to a speed that can be tracked by the eye, rather than an actual speed (several meters / seconds being too fast). Furthermore, the control unit 320 colors the airflow according to the type of diffused material. For example, airflows containing a diffused material (hypochlorous acid) are displayed in green, and airflows blown out from the air conditioner (air outlet) are displayed in white.

[0067] The display of airflow, for example, air conditioner streamlines 550 and diffused material streamlines 552, will be described in more detail below. When the control unit 320 superimposes an image of the real space 410 and the thermal fluid analysis result 160, the control unit 320 generates line segments along the flow direction of the airflow flowing out from the air conditioner (air outlet) based on the vectors included in the thermal fluid analysis result 160, and displays these on the display unit 340. At this time, the control unit 320 specifies the distance between the airflow line segments and the mobile information terminal 300 based on the distance between an object in the image acquired by the imaging unit 350 and the mobile information terminal 300. The control unit 320 also changes the length and thickness of the line segments depending on the specified distance, i.e., the perspective position in the displayed analysis space 10.

[0068] 14 shows a screen displayed on display unit 340. Here, air conditioner streamlines 550 and diffused material streamlines 552 are classified into nearby streamlines 554 that are relatively close to mobile information terminal 300 and distant streamlines 556 that are relatively far from mobile information terminal 300. Nearby streamlines 554 correspond to airflows close to the viewpoint, and distant streamlines 556 correspond to airflows far from the viewpoint. Nearby streamlines 554 are shown as thick, long line segments, and distant streamlines 556 are shown as thin, short line segments.

[0069] 11(c) is a button for switching the amount of diffusible substance (hypochlorous acid) added to the airflow. Each time the user touches the zia addition amount display mode switching button 516, the control unit 320 switches the display of the zia addition amount display mode switching button 516 between "Zia OFF," "Zia 20," "Zia 32," and "Zia 39" in order. In addition, the control unit 320 uses an AR application to generate a composite image including the thermal fluid analysis result 160 for the airflow with the different amounts of hypochlorous acid added, and displays the composite image on the display unit 340.

[0070] 11(c) is a button for switching the amount of diffusible substance (nanoe) added to the airflow. Each time the user touches the nanoe addition amount display mode switching button 518, the control unit 320 switches the display of the nanoe addition amount display mode switching button 518 between "nanoe OFF," "nanoe 10," "nanoe 20," and "nanoe 100," in that order. The control unit 320 also uses an AR application to generate a composite image including the thermal fluid analysis results 160 for the airflow with different amounts of nanoe added, and displays the composite image on the display unit 340.

[0071] 11(b), as described above, includes a diffusing material type indicator 532 and an airflow state indicator 534. The "nanoe" and "zia" included in the diffusing material type indicator 532 indicate the type of diffusing material when the thermofluid analysis result 160 for the diffusing material concentration is displayed. For example, when displaying the thermofluid analysis result 160 for the concentration of hypochlorous acid, the control unit 320 turns on the "zia" portion of the diffusing material type indicator 532 and turns off the "nanoe" portion.

[0072] "Air," "nanoe," or "zia" included in the airflow state indicator 534 indicates the type of diffusive material when the thermofluid analysis result 160 for the airflow is displayed. For example, when the control unit 320 displays the thermofluid analysis result 160 for the airflow that does not contain a diffusive material, the control unit 320 lights up the "Air" portion of the airflow state indicator 534. When the control unit 320 displays the thermofluid analysis result 160 for the airflow that contains a diffusive material (nanoe), the control unit 320 lights up the "nanoe" portion of the airflow state indicator 534. When the control unit 320 displays the thermofluid analysis result 160 for the airflow that contains a diffusive material (hypochlorous acid), the control unit 320 lights up the "zia" portion of the airflow state indicator 534.

[0073] 11(b)-(c) will be described in detail below. The Before / After switching button 514 is a button for switching between the thermo-fluid analysis results 160 for each of the different analysis target data. Each time the user touches the Before / After switching button 514, the control unit 320 alternates between "Before" and "After" as the display of the Before / After switching button 514.

[0074] 15(a)-(b) show screens displayed on the display unit 340. FIG. 15(a) shows the screen when "Before" is set using the Before / After switching button 514. FIG. 15(a) is displayed in the same manner as before. FIG. 15(b) shows the screen when "After" is set using the Before / After switching button 514. The control unit 320 generates a composite image using a thermal fluid analysis result 160 that is different from the thermal fluid analysis result 160 for the analysis target data used in FIG. 15(a). Here, a virtual air conditioner 570 has been added, and airflow is being blown out from the virtual air conditioner 570.

[0075] The concentration play / stop operation control button 520, reset operation control button 522, and elapsed time 524 shown in FIGS. 11(b)-(c) are described in detail below. Although not described above, the thermal fluid analysis result 160 in the calculation unit 136 or the composite image in the control unit 320 is not generated for a single timing, but is generated continuously at regular intervals over a predetermined time period from a start timing. The start timing refers to the timing at which the air conditioner (air outlet) starts blowing out the airflow or the timing at which the diffusing material starts attaching to the airflow. The regular intervals may be, for example, 1 second, 10 seconds, or 1 minute. The predetermined time is the time required for the concentration of the diffusing material in the analysis space 10 to converge. This can also be said to be the time required for the fluctuation values of the diffusing materials (diffusing material 1 to diffusing material 3) shown in FIG. 6 to converge. Convergence is determined by the difference between the average value of the concentration of the diffusing substance in the analysis space 10 at a predetermined timing and the average value of the concentration of the diffusing substance in the analysis space 10 at the timing one timing after the predetermined timing being within a certain range.

[0076] The density play / stop operation control button 520 is a button for instructing whether to display composite images generated continuously at regular intervals in chronological order or to stop the display. When the control unit 320 receives a display instruction from the density play / stop operation control button 520, the control unit 320 plays back the composite images in chronological order and displays them on the display unit 340. At this time, the elapsed time 524 indicates the time elapsed from the start timing.

[0077] 16(a)-(c) show screens displayed on the display unit 340. Here, as an example, "concentration ON" is set using the concentration ON / OFF switching button 510, and "airflow OFF" is set using the airflow display mode switching button 512. FIG. 16(a) shows a composite image at the start timing. Since it is the start timing, the concentration of the diffusive substance is low. Therefore, the diffusive substance concentration 560 is displayed with high transparency. FIG. 16(b) shows a composite image at the timing five minutes after the start timing. Because the diffusive substance has been added to the airflow for five minutes, the concentration of the diffusive substance has increased. Therefore, the diffusive substance concentration 560 is displayed with lower transparency than in the case of FIG. 16(a). FIG. 16(c) shows a composite image at the timing ten minutes after the start timing. Because the diffusive substance has been added to the airflow for ten minutes, the concentration of the diffusive substance has further increased. Therefore, the diffusive substance concentration 560 is displayed with lower transparency than in the case of FIG. 16(b). Similar changes are shown when air currents are included in the composite image.

[0078] In this way, when the display unit 340 displays the image of the real space 410 captured by the imaging unit 350 and the thermo-fluid analysis result 160 in which the space is set as the analysis space 10 in an overlaid manner as AR, the display unit 340 dynamically displays the state in which the thermo-fluid analysis result 160 changes over time. In particular, the display unit 340 displays, as the thermo-fluid analysis result 160, the results from the start of adding the diffusing material to the airflow until a predetermined time has elapsed in time.

[0079] The reset operation control button 522 is a button for instructing to return the time during which the composite image is being played back to the start timing. This can also be said to be a button for resetting the elapsed time since the addition of the diffusing material to the airflow began. When the control unit 320 receives a reset instruction via the reset operation control button 522, it returns the timing during which the composite image is being played back to the start timing.

[0080] The subject of the device, system, or method of the present disclosure includes a computer. The computer executes a program to realize the functions of the subject of the device, system, or method of the present disclosure. The computer includes, as its main hardware component, a processor that operates according to the program. The processor may be of any type, as long as it can realize the functions by executing the program. The processor may be composed of one or more electronic circuits, including a semiconductor integrated circuit (IC) or a large-scale integration (LSI). The electronic circuits may be integrated into a single chip or may be provided on multiple chips. The multiple chips may be integrated into a single device or may be provided on multiple devices. The program is recorded on a non-transitory recording medium, such as a computer-readable ROM, optical disk, or hard disk drive. The program may be pre-stored on the recording medium or may be supplied to the recording medium via a wide-area communication network, including the Internet.

[0081] According to this embodiment, when an image of the real space 410 and the thermal fluid analysis result 160 are overlaid and displayed as AR, the time-series changes in the thermal fluid analysis result 160 are dynamically displayed, thereby informing the user of changes in the environment over time. Furthermore, when generating a composite image, the diffusing material is colored with a predetermined color on the projected image of the real space 410, and the transparency of the color is changed depending on the concentration of the diffusing material, thereby visualizing the spatial concentration distribution of the diffusing material. Furthermore, the airflow is displayed with a predetermined color and a predetermined intensity depending on the concentration of the diffusing material, thereby visualizing the state of the airflow. Furthermore, the results from the start of adding the diffusing material to the airflow until a predetermined time has elapsed are displayed in chronological order, thereby improving the understanding of the temporal change in the spatial concentration distribution. Furthermore, since the predetermined time is the time until the concentration of the diffusing material converges, the temporal change in the concentration of the diffusing material can be notified.

[0082] The diffusing substance contains either hypochlorous acid or a substance containing OH radicals generated by applying high voltage to moisture in the air, making it easy to understand the disinfecting effect. The airflow is displayed using lines along the flow direction, with the length of the lines being longer for airflow closer to the viewpoint and shorter for airflow further from the viewpoint, making the airflow condition visible. The lines are also displayed moving according to the airflow speed, making the airflow condition visible.

[0083] Furthermore, the operation unit 330 is superimposed on a composite image in which an image of the real space 410 and the thermal fluid analysis result 160 are superimposed as AR. The operation unit 330 is positioned so that it can be operated with the thumb or any of the fingers when held in both hands or one hand of the user. This improves the user's operability in displaying the thermal fluid analysis result 160. The operation unit 330 superimposed on the composite image is positioned at either the lower left end 500 or the lower right end 502 of the display unit 340, thereby improving the user's operability. The switching button is positioned at the lower left end 500 of the display unit 340, and the operation control button is positioned at the lower right end 502 of the display unit 340, thereby improving the user's operability. The switching button is positioned at the lower right end 502 of the display unit 340, and the operation control button is positioned at the lower left end 500 of the display unit 340, thereby improving the user's operability.

[0084] Furthermore, by detecting whether or not a finger has touched display unit 340 within a predetermined time, the display of the operation control button is switched on and off, and indicator 530 is constantly displayed, thereby achieving both an expansion of the display area of the composite image and improved visibility of notifications. Furthermore, since indicator 530 is displayed at least at the top right end or top left end of display unit 340, indicator 530 can be displayed in a position separate from operation unit 330.

[0085] Furthermore, the operation control button includes an operation button for switching whether or not to stop the dynamic display and resetting the elapsed time since the addition of the diffusing material to the airflow started, thereby improving user operability. Furthermore, the switching button includes an operation button for switching whether or not to add the diffusing material to the airflow and switching the amount of diffusing material added to the airflow, thereby improving user operability. Furthermore, the gripping position of the housing 302 is detected, and the position where the operation unit 330 is superimposed on the composite image is switched and displayed so that it is in the same position as the user's thumb, thereby improving user operability.

[0086] <Second Example> The second embodiment of the present disclosure will be described, focusing on the differences from the first embodiment, which serves as a prerequisite. The same reference numerals will be used to designate the same or equivalent components as those in the first embodiment, and redundant descriptions will be omitted where appropriate.

[0087] The visualization system of the second embodiment automatically recognizes air conditioners installed in a real space based on images captured of the real space. Then, it automatically creates a space model (hereinafter also referred to as an "analysis space model") that is the target of thermal fluid analysis and in which air conditioner objects are placed. This improves the efficiency and accuracy of creating the analysis space model.

[0088] 17 is a diagram showing the overall configuration of a visualization system according to the second embodiment. The visualization system 1000 of the second embodiment differs from the visualization system 1000 of the first embodiment in that it includes an analysis model creation device 600 instead of the input terminal 100. The analysis model creation device 600 corresponds to the input terminal 100 of the first embodiment. Furthermore, a setting unit 602 of the analysis model creation device 600 corresponds to the setting unit 110 of the first embodiment.

[0089] The setting unit 602 of the analysis model creation device 600 includes an imaging unit 604, a spatial shape acquisition unit 606, an equipment data storage unit 608, an object recognition unit 610, a model creation unit 612, and an output unit 614. The imaging unit 604, the spatial shape acquisition unit 606, the equipment data storage unit 608, the object recognition unit 610, and the model creation unit 612 correspond to the input unit 112 of the first embodiment.

[0090] At least some of the multiple functional blocks included in the setting unit 602 of the analysis model creation device 600 may be implemented in a computer program, and this computer program may be installed in storage of the analysis model creation device 600. A processor (such as a CPU) of the analysis model creation device 600 may load this computer program into a main memory and execute it to fulfill the functions of the multiple functional blocks.

[0091] The analytical model creation device 600 may be a mobile information terminal equipped with an imaging device, or may be a tablet terminal or a smartphone. Furthermore, the analytical model creation device 600 may be the same device as the mobile information terminal 300 that displays the analysis results. For example, the imaging unit 604 may be realized by the imaging unit 350. The device data storage unit 608 may be realized by the storage unit 360. The spatial shape acquisition unit 606, the object recognition unit 610, and the model creation unit 612 may be realized by the control unit 320.

[0092] The imaging unit 604, spatial shape acquisition unit 606, equipment data storage unit 608, object recognition unit 610, model creation unit 612, and output unit 614 may be distributed across multiple devices, and these multiple devices may work together to realize the analysis model creation device 600. For example, the imaging unit 604, spatial shape acquisition unit 606, and output unit 614 may be implemented in a user's mobile information terminal (e.g., mobile information terminal 300). On the other hand, the equipment data storage unit 608, object recognition unit 610, and model creation unit 612 may be implemented in a server computer that communicates with the user's mobile information terminal.

[0093] The imaging unit 604 captures images of the real space where the air conditioner is installed, which is the real space where thermal fluid analysis is performed, in response to user operations. The images of the real space captured by the imaging unit 604 are hereinafter also referred to as "real space images." The imaging unit 604 acquires multiple real space images of the real space captured at various positions and angles in response to user movements and operations.

[0094] The spatial shape acquisition unit 606 uses a known technique to detect the internal shape of the captured real space based on multiple real space images captured by the imaging unit 604. The spatial shape acquisition unit 606 uses a known technique to create a spatial model that corresponds to the captured real space and reflects the detected internal shape of the real space. The spatial model and an analytical space model described below correspond to the analytical space 10 of the first embodiment.

[0095] FIG. 18 shows an example of data (hereinafter also referred to as "equipment data") stored in the equipment data storage unit 608. The equipment data includes data for identifying the type of air conditioner that appears in the real space image from among multiple types of air conditioners. Specifically, the equipment data includes the image ID, image data of the air conditioner, type (equipment type), housing dimensions, number of air outlets, air outlet position, and air outlet direction. The equipment data storage unit 608 stores multiple pieces of equipment data related to multiple equipment types. The multiple equipment types include, for example, four-way cassette type, two-way cassette type, ceiling-suspended type, ceiling-mounted type, and built-in all-duct type.

[0096] The image data can be considered captured images showing the appearance of the indoor unit of the air conditioner. A large number of image data are registered in the device data storage unit 608 for each device type. Figure 18 shows two image data (image IDs: 0001, 0002) registered for a four-way cassette type device. The large number of image data include images of the air conditioner captured under different illuminance levels. The large number of image data also include images of the air conditioner captured from various angles and distances. The images of the air conditioner are preferably images that show the state of the air conditioner installed in a real space, and preferably do not show parts hidden by, for example, the ceiling or walls. This can improve the accuracy of identifying the device type.

[0097] The casing dimensions are the width, height, and depth values of the air conditioner casing. The number of air outlets is the number of air outlets provided in the air conditioner. The air outlet position is the position of each of the one or more air outlets provided in the air conditioner. The air outlet position includes a relative position (distance, angle, and air outlet dimensions) with respect to a predetermined reference position (for example, the center of the air conditioner). The air outlet position includes information indicating the position of the air outlet that should be set for an air conditioner object when that object is placed in the space model.

[0098] The air outlet direction is information that indicates the basic wind direction of the airflow flowing out from the air outlet. The air outlet direction includes the angle with respect to a predetermined reference direction (for example, the front direction of the equipment). The air outlet position and air outlet direction are set for each air outlet. In the second embodiment, the housing dimensions, the number of air outlets, the air outlet position, and the air outlet direction were given as examples of the attributes of the air conditioner used in the thermal fluid analysis, but the attributes of the air conditioner may include other items.

[0099] The equipment data storage unit 608 also stores an equipment discrimination model as data for identifying the type of air conditioner shown in the real-space image from among multiple types of air conditioners. The equipment discrimination model is a mathematical model (which can also be considered a function approximator) that takes image data as input and outputs the equipment type of the air conditioner shown in the image. The equipment discrimination model is a mathematical model created by well-known machine learning using pairs (e.g., several thousand pairs) of image data and equipment type registered in the equipment data as training data.

[0100] The object recognition unit 610 recognizes air conditioners installed in the real space as air conditioner objects (hereinafter also referred to as "air conditioning objects") to be set in the space model based on the real space images captured by the imaging unit 604. Furthermore, the object recognition unit 610 uses a known method to recognize the positions in the real space where the air conditioners are installed based on the real space images, and recognizes the positions in the space model where the air conditioning objects should be placed. The object recognition unit 610 sets air conditioner attributes related to thermal fluid analysis for the recognized air conditioning objects.

[0101] The object recognition unit 610 sets the position of the air conditioner's air outlet as an attribute of the air conditioner. Based on the data stored in the equipment data storage unit 608, the object recognition unit 610 identifies the type of air conditioner shown in the real-space image and identifies the position of the air conditioner's air outlet.

[0102] In the second embodiment, the object recognition unit 610 inputs a real-space image into an equipment discrimination model stored in the equipment data storage unit 608, and acquires the equipment type of the air conditioner shown in the real-space image output from the equipment discrimination model. In practice, the equipment discrimination model may output a probability value corresponding to each of multiple equipment types. The object recognition unit 610 may identify the equipment type with the highest probability value as the equipment type of the air conditioner shown in the real-space image (hereinafter also referred to as the "corresponding equipment type").

[0103] As a variant example, the object recognition unit 610 may identify an equipment type similar to the air conditioner shown in the real-space image by performing template matching using the real-space image as an input image and multiple image data stored in the equipment data storage unit 608 as template images.

[0104] The model creation unit 612 creates an analytical space model to be subjected to thermal fluid analysis by placing the air conditioning objects recognized by the object recognition unit 610 in the space model created by the space shape acquisition unit 606. The object recognition unit 610 identifies the housing dimensions, number of air outlets, air outlet positions, and air outlet direction associated with the relevant equipment type in the equipment data storage unit 608. The object recognition unit 610 sets this identified information as attributes of the air conditioning object in the data of the analytical space model. As a variant, the object recognition unit 610 may identify at least one of the housing dimensions, number of air outlets, air outlet positions, and air outlet direction by analyzing an image of the air conditioner shown in a real space image.

[0105] The model creation unit 612 outputs the analysis target data including data of the analytical space model to the processing device 120. Similar to the input unit 112 in the first embodiment, the setting unit 602 places a marker 20 in the analytical space 10 in the analysis target data by a user operation and specifies the coordinates of the marker 20. Similar to the output unit 114 in the first embodiment, the output unit 614 outputs the coordinates of the marker 20 and device information received by the setting unit 602 to the analysis result acquisition unit 152 of the conversion unit 150.

[0106] The following describes the operation of the visualization system 1000 configured as described above. Explanations of operations that have already been explained in the first embodiment will be omitted where appropriate.

[0107] 19 is a flowchart showing the operation of the analysis model creation device 600. A plurality of image data of a plurality of equipment types is stored in advance in the equipment data storage unit 608. The equipment data storage unit 608 also stores an equipment discrimination model created in advance based on the plurality of image data.

[0108] The user activates the imaging unit 604 in the analysis model creation device 600, and captures images of a real space in which an air conditioner is installed and that is the target of thermal fluid analysis (hereinafter also referred to as the "target real space") from various positions and angles using the imaging unit 604. The imaging unit 604 acquires multiple real space images and outputs them to the spatial shape acquisition unit 606 (step S10). The spatial shape acquisition unit 606 recognizes the internal shape of the target real space based on the multiple real space images, and creates a spatial model that reflects the recognized internal shape (step S12).

[0109] The object recognition unit 610 detects air conditioners installed in the real space as air conditioning objects to be set in the space model based on multiple real space images and multiple image data stored in the equipment data storage unit 608, and also detects the positions at which the air conditioning objects should be set in the space model (step S14). The object recognition unit 610 also inputs the real space images into an equipment discrimination model stored in the equipment data storage unit 608 and acquires output data from the equipment discrimination model. The object recognition unit 610 identifies the equipment type (corresponding equipment type) of the air conditioner shown in the real space image according to the output data from the equipment discrimination model.

[0110] The model creation unit 612 creates an analytical space model to be subjected to thermal fluid analysis by placing the air conditioning objects recognized by the object recognition unit 610 in the space model (step S16). The model creation unit 612 uses image data associated with the relevant equipment type from among the multiple image data stored in the equipment data storage unit 608 as the appearance of the air conditioning objects to be placed in the analytical space model. The object recognition unit 610 sets the housing dimensions, number of air outlets, air outlet positions, and air outlet direction associated with the relevant equipment type in the equipment data storage unit 608 as attributes of the air conditioning objects in the analytical space model (step S18).

[0111] The model creation unit 612 displays an analytical space model screen on a display unit (not shown) of the analytical model creation device 600 (step S20). FIG. 20 shows an example of the analytical space model screen. The analytical space model screen 700 includes a model display area 702. The model creation unit 612 places an image of the analytical space model (analytical space model image 703) in the model display area 702. The analytical space model image 703 includes an air conditioning object 704 recognized by the object recognition unit 610. The air conditioning object 704 includes an air outlet 706 set by the object recognition unit 610.

[0112] The user selects, by tapping, from one or more air outlets 706 provided in the air conditioning object 704 on the analytical space model screen 700, the target air outlet 706 for inputting analytical conditions. When a certain air outlet 706 is selected (Y in step S22), the model creation unit 612 displays an analytical condition input field 708 related to the selected air outlet 706 (step S24). The analytical condition input field 708 is an area for inputting conditions for thermal fluid analysis. The analytical conditions include the air volume, air direction, diffuser concentration, and temperature related to the airflow flowing out from the air outlet 706. The model creation unit 612 sets the analytical conditions input by the user in the analytical condition input field 708 as attributes of the air conditioning object (attributes of the air outlet) in the analytical space model (step S26). The processing of steps S22 to S26 is repeatedly executed for each air outlet 706. If no air outlet 706 is selected in the model display area 702 (N in step S22), the processing of steps S24 and S26 is skipped.

[0113] After creating the analytical space model, the model creation unit 612 transmits the analysis target data including the data of the analytical space model to the processing device 120 (analysis unit 130). In addition, the output unit 614 transmits the coordinates and device information of the marker 20 to the analysis result acquisition unit 152 of the conversion unit 150.

[0114] Thereafter, the operations of the processing device 120, the server 200, and the mobile information terminal 300 are the same as those in the first embodiment. The processing device 120, as an analysis device, outputs the results of the thermal fluid analysis for the analytical space model created by the analytical model creation device 600. The mobile information terminal 300 acquires AR data indicating the results of the thermal fluid analysis stored in the server 200. The mobile information terminal 300, as a display device, outputs an image indicating the results of the thermal fluid analysis to the display unit 340. The mobile information terminal 300 displays an image of the real space captured by a predetermined imaging unit (e.g., imaging unit 350) and the results of the thermal fluid analysis superimposed on each other as AR.

[0115] The analytical model creation device 600 of the second embodiment automatically recognizes air conditioners installed in the real space based on captured images of the real space, and automatically creates an analytical space model in which air conditioner objects are placed. This improves the efficiency and accuracy of analytical space model creation, and as a result, the accuracy of thermal fluid analysis. The visualization system 1000 of the second embodiment can perform highly accurate thermal fluid analysis using the analytical space model created by the analytical model creation device 600, and can visualize the results using AR.

[0116] Furthermore, according to the analytical model creation device 600 of the second embodiment, the position of the air conditioner's air outlet is automatically set as an attribute of the air conditioner (air conditioning object), thereby further improving the efficiency and accuracy of creating the analytical space model. Furthermore, according to the analytical model creation device 600 of the second embodiment, the type of air conditioner that appears in an image captured of the real space and the position of the air conditioner's air outlet are automatically identified based on the data stored in the equipment data storage unit 608, thereby further improving the efficiency and accuracy of creating the analytical space model.

[0117] The present disclosure has been described above based on Example 1 and Example 2. The examples are merely illustrative, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component or each treatment process of the examples, and that such modifications are also within the scope of the present disclosure.

[0118] A first modified example of the second embodiment will be described. In the first modified example, an authentication label corresponding to the type (device type) of an air conditioner installed in a real space is set on the air conditioner. The authentication label may include a two-dimensional code or a barcode in which information indicating the type of air conditioner is coded. Typically, the authentication label is affixed to the surface of the housing of the air conditioner.

[0119] 21 shows an example of data stored in the equipment data storage unit 608 of the analysis model creation device 600 of the first modified example. The equipment data storage unit 608 stores equipment data including data of multiple authentication labels corresponding to multiple types of air conditioners. In the equipment data, a unique authentication label is set for each equipment type.

[0120] The object recognition unit 610 of the analysis model creation device 600 identifies the authentication label shown in the real space image and specifies the type of air conditioner shown in the real space image (corresponding equipment type) based on the identified authentication label. The equipment data storage unit 608 may store decoded data of each authentication label as data of each authentication label. The object recognition unit 610 may decode the authentication label shown in the real space image and specify, as the corresponding equipment type, the equipment type associated with authentication label data that is the same as or similar to the decoded data.

[0121] As in the second embodiment, the object recognition unit 610 sets the housing dimensions, number of air outlets, air outlet position, and air outlet direction associated with the relevant equipment type in the equipment data storage unit 608 as attributes of the air conditioning object in the analytical space model. According to the first modified example, the type of air conditioner shown in the real space image can be identified with even greater accuracy based on the authentication label set on the air conditioner.

[0122] A second modified example related to the second embodiment will be described. In the second modified example, the air outlet of the air conditioning model placed in the analytical space model is set by a user operation. Specifically, the object recognition unit 610 of the second modified example displays a user interface (a captured image screen, described later) that accepts a user operation to specify the position of the air outlet of the air conditioner shown in the real space image.

[0123] Fig. 22 shows an example of a captured image screen 800. The captured image screen 800 includes a captured image 802. The user specifies the position of an air outlet 806 of an air conditioner 804 displayed on the captured image screen 800 by a drag operation (also called a swipe operation). Fig. 22 shows the user's finger tracing the air outlet 806 from left to right. If the air conditioner 804 has multiple air outlets 806, the user specifies each of the multiple air outlets 806 by a drag operation.

[0124] The object recognition unit 610 sets the number of air outlets of the air conditioner and the position of each air outlet, which are input via the captured image screen, as attributes of the air conditioner (air conditioning object) in the analysis space model. The object recognition unit 610 may specify the position of the air outlet by a value indicating the position on the air conditioner (air conditioning object).

[0125] Furthermore, the object recognition unit 610 specifies the direction from the center of the air conditioner shown in the real space image to the position of each air outlet of the air conditioner input via the captured image screen (for example, the center of an area specified by a drag operation) as the air outlet direction of each air outlet. As described above, the air outlet direction may be specified as an angle with respect to a predetermined reference direction. The object recognition unit 610 sets the air outlet direction of each air conditioner outlet as an attribute of the air conditioner (air conditioning object) in the analytical space model.

[0126] In the second modified example, the object recognition unit 610 may set the device type, image data, and housing dimensions, which are attributes of the air conditioning object, from data stored in the device data storage unit 608, as in the second embodiment. On the other hand, the object recognition unit 610 may set the number of air outlets, air outlet positions, and air outlet direction, which are attributes of the air conditioning object, based on data input via the captured image screen 800. According to the second modified example, accurate thermal fluid analysis can be achieved based on the attributes of the air outlets specified by the user.

[0127] Any combination of the above-described multiple examples and multiple modifications is also useful as an embodiment of the present disclosure. A new example created by a combination combines the effects of the combined examples and modifications. It will also be understood by those skilled in the art that the functions to be performed by each component recited in the claims can be realized by each component shown in the examples and modifications alone or in combination.

[0128] An outline of one aspect of the present disclosure is as follows. (Item 1) an imaging unit (604) that captures an image of a real space in which the air conditioner is installed; a space shape acquisition unit (606) that creates a space model corresponding to the real space based on an image of the real space captured by the imaging unit (604); an object recognition unit (610) that recognizes an air conditioner installed in the real space as an object based on an image of the real space captured by the imaging unit (604); a model creation unit (612) that creates an analytical space model to be subjected to thermal fluid analysis by arranging the object recognized by the object recognition unit (610) in the space model created by the space shape acquisition unit (606), the object recognition unit (610) sets attributes of the air conditioner related to the thermal fluid analysis for the recognized object; An analytical model creation device (600).

[0129] (Item 2) The object recognition unit (610) sets the position of the air outlet of the air conditioner as an attribute of the air conditioner. Item 1. The analytical model creation device (600) according to item 1.

[0130] (Item 3) a storage unit that stores data for identifying the type of air conditioner shown in the image from among a plurality of types of air conditioners; The object recognition unit (610) identifies the type of air conditioner shown in the image and identifies the position of the air outlet of the air conditioner based on the data stored in the storage unit. Item 2. The analytical model creation device (600) according to item 2.

[0131] (Item 4) the storage unit stores, as the data, data of a plurality of authentication labels corresponding to the plurality of types of air conditioners; an authentication label corresponding to the type of air conditioner is set on the air conditioner installed in the real space; The object recognition unit (610) identifies an authentication label appearing in the image, and, based on the identified authentication label, identifies the type of air conditioner appearing in the image and the position of an air outlet of the air conditioner. Item 3. The analytical model creation device (600) according to item 3.

[0132] (Item 5) The object recognition unit (610) displays a user interface (800) that accepts a user operation to specify the position of an air conditioner air outlet shown in the image, and sets the position of the air conditioner air outlet input via the user interface (800) as an attribute of the air conditioner. Item 2. The analytical model creation device (600) according to item 2.

[0133] (Item 6) an analysis device (120) that outputs a result of a thermal fluid analysis for an analysis space model created by the analysis model creation device (600) according to any one of items 1 to 5; a display device (300) that outputs an image showing the results of the thermal fluid analysis; Equipped with The display device (300) is an analysis visualization system (1000) that displays an image of the real space captured by a predetermined imaging unit and the result of the thermal fluid analysis in an overlapping manner.

[0134] The present disclosure has been described above based on examples. These examples are merely illustrative, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component or each treatment process, and that such modifications are also within the scope of the present disclosure. [Explanation of symbols]

[0135] 10 Analysis space, 31 Reference dimension input field, 32 Ceiling height input field, 100 Input terminal, 110 Setting unit, 112 Input unit, 114 Output unit, 120 Processing device, 130 Analysis unit, 132 Acquisition unit, 134 Processing unit, 136 Calculation unit, 138 Determination unit, 140 Memory unit, 142 Analysis result output unit, 150 Conversion unit, 152 Analysis result acquisition unit, 154 Processing unit, 156 Output unit, 160 Thermal fluid analysis result, 162 AR data, 200 Server, 210 Database, 300 Portable information terminal, 302 Housing, 304 Front surface, 306 Rear surface, 310 Communication unit, 320 Control unit, 322 Concentration difference detection unit, 324 Synchronous display control unit, 330 operation unit, 340 display unit, 350 imaging unit, 352 imaging port, 360 memory unit, 400 data reference button, 402 conversion data input field, 404 conversion button, 410 real space, 420 marker, 430 icon, 500 bottom left end, 502 bottom right end, 510 concentration ON / OFF switch button, 512 airflow display mode switch button, 514 Before / After switch button, 515 multiple screen display switch button, 516 Zia addition amount display mode switch button, 518 Nanoe addition amount display mode switch button, 520 concentration play / stop operation control button, 522 reset operation control button, 524 elapsed time, 530 indicator, 532 diffusion material type indicator, 534 airflow status indicator, 550 Air conditioner streamline, 552 diffused material streamline, 554 nearby streamline, 556 distant streamline, 560 diffused material concentration, 570 virtual air conditioner, 600 analytical model creation device, 604 imaging unit, 606 spatial shape acquisition unit, 608 equipment data storage unit, 610 object recognition unit, 612 model creation unit, 1000 visualization system.

Claims

1. an imaging unit that captures an image of a real space in which the air conditioner is installed; a space shape acquisition unit that creates a space model corresponding to the real space based on an image of the real space captured by the imaging unit; an object recognition unit that recognizes an air conditioner installed in the real space as an object based on an image of the real space captured by the imaging unit; a model creation unit that creates an analytical space model to be subjected to thermal fluid analysis by arranging the object recognized by the object recognition unit in the space model created by the space shape acquisition unit, the object recognition unit sets attributes of the air conditioner related to the thermal fluid analysis for the recognized object. Analysis model creation device.

2. the object recognition unit sets a position of an air outlet of the air conditioner as an attribute of the air conditioner. The analytical model creation device according to claim 1 .

3. a storage unit that stores data for identifying the type of air conditioner shown in the image from among a plurality of types of air conditioners; the object recognition unit identifies the type of air conditioner shown in the image and identifies the position of an air outlet of the air conditioner based on the data stored in the storage unit; The analytical model creation device according to claim 2 .

4. the storage unit stores, as the data, data of a plurality of authentication labels corresponding to the plurality of types of air conditioners; an authentication label corresponding to the type of air conditioner is set on the air conditioner installed in the real space; the object recognition unit identifies an authentication label appearing in the image, and identifies the type of air conditioner appearing in the image based on the identified authentication label, and identifies the position of an air outlet of the air conditioner; The analytical model creating device according to claim 3 .

5. the object recognition unit displays a user interface that accepts a user operation for specifying a position of an air outlet of the air conditioner shown in the image, and sets the position of the air outlet of the air conditioner input via the user interface as an attribute of the air conditioner. The analytical model creation device according to claim 2 .

6. an analysis device that outputs a result of a thermal fluid analysis of the analytical space model created by the analytical model creation device according to any one of claims 1 to 5; a display device that outputs an image showing the results of the thermal fluid analysis; Equipped with The display device is an analysis visualization system that displays an image of the real space captured by a predetermined imaging unit and the results of the thermal fluid analysis in an overlapping manner.

Images