Mobile information terminal

The portable information terminal improves user operability by superimposing thermal fluid analysis results as AR on captured space images and optimizing control placement, effectively addressing challenges in displaying thermal fluid analysis results.

JP2025080059APending Publication Date: 2025-05-23PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023193050
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-11-13
Publication Date
2025-05-23

AI Technical Summary

Technical Problem

Existing technologies face challenges in improving user operability when displaying thermal fluid analysis results, particularly in portable information terminals.

Method used

A portable information terminal with a rectangular flat housing, a short display portion on one surface, an imaging portion on the rear, and an operation portion for interacting with the displayed image. The terminal superimposes thermal fluid analysis results as Augmented Reality (AR) on captured space images, with operation controls positioned for easy thumb or finger operation.

Benefits of technology

Enhances user operability by dynamically displaying time-series changes in thermal fluid analysis results, improving the visualization of airflow and diffusing material concentration, and optimizing control placement for intuitive operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025080059000001_ABST
    Figure 2025080059000001_ABST
Patent Text Reader

Abstract

To provide a technology that improves user operability when displaying a thermal fluid analysis result.SOLUTION: A mobile information terminal 300 includes a rectangular flat housing with a side serving as a grip part, a short display part 340 provided over the entire one surface of the housing, an imaging part 350 with an image capturing opening on a rear surface side of the one surface, and an operation part 330 for operating an image displayed on the display part 340. The display part 340 displays an image of a space captured by the imaging part and a thermal fluid analysis result in which the space is set as an analysis space in superimposition as AR (Augmented Reality), and displays the operation part 330 in superimposition on a composite image in which the thermal fluid analysis result is superimposed on the image of the space. The operation part 330 superimposed on the composite image is arranged in a position that can be operated by the thumb or any finger when a user grips the grip part with both hands or one hand.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a display technology, and more particularly to a portable information terminal that displays the results of thermal fluid analysis. [Background technology]

[0002] A remote control terminal is used to remotely operate an air conditioner. To improve the comfort of the air conditioner, it is necessary to inform the user of changes in airflow distribution in response to changes in the indoor layout while the air conditioner is in operation. For this reason, a three-dimensional airflow distribution derived by a simulation based on computational fluid dynamics is displayed on the remote control terminal (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-179638 A Summary of the Invention [Problem to be solved by the invention]

[0004] It is desirable to improve the operability for users when displaying such thermal fluid analysis results.

[0005] In view of the above, an object of the present disclosure is to provide a technique for improving user operability when displaying thermal fluid analysis results. [Means for solving the problem]

[0006] In order to solve the above problem, a portable information terminal according to an embodiment of the present disclosure includes a rectangular flat housing with a side portion as a grip portion, a short display portion provided over the entirety of one surface of the housing, an imaging portion with a shooting port provided on the rear side of the one surface, and an operation portion for operating an image to be displayed on the display portion. The display portion displays an image of the space captured by the imaging portion and a result of a thermo-fluid analysis in which the space is set as an analysis space, superimposed as AR (Augmented Reality), and displays the operation portion superimposed on a composite image in which the image of the space and the result of the thermo-fluid analysis are superimposed, and the operation portion superimposed on the composite image is disposed in a position that can be operated by the thumb or any of the fingers when the grip portion is held by both hands or one hand of a user.

[0007] In addition, any combination of the above components, and conversions between the expression methods, devices, systems, computer programs, or recording media having computer programs recorded thereon of the present disclosure are also valid as aspects of the present disclosure. Effect of the Invention

[0008] According to the present disclosure, it is possible to improve user operability when displaying thermal fluid analysis results. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing the overall configuration of a visualization system according to this embodiment. [Diagram 2] 2(a)-(g) are diagrams showing an outline of the operation of the visualization system of FIG. [Diagram 3] FIG. 3 is a diagram illustrating an example of a first display screen according to the present embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the second display screen according to the present embodiment. [Diagram 5] 5(a) and (b) are diagrams illustrating a third display screen and a fourth display screen according to this embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the fifth display screen according to the present embodiment. [Figure 7]FIG. 7 is a diagram illustrating an example of the sixth display screen according to the present embodiment. [Figure 8] 8(a) and (b) are diagrams illustrating examples of operation screens for the conversion unit of FIG. [Figure 9] 9(a) and 9(b) are diagrams showing the external appearance of the portable information terminal of FIG. [Figure 10] 10(a)-(e) are diagrams showing an outline of operations of the portable information terminal of FIG. [Figure 11] 11(a)-(c) are diagrams showing screens displayed on the display unit of FIG. [Figure 12] 12(a)-(d) are diagrams showing screens displayed on the display unit when the direction in which the portable information terminal in FIG. 1 is held is changed. [Figure 13] 13(a)-(h) are diagrams showing screens displayed on the display unit of FIG. [Figure 14] FIG. 14 is a diagram showing a screen displayed on the display unit in FIG. [Figure 15] 15(a)-(b) are diagrams showing screens displayed on the display unit of FIG. [Figure 16] 16(a)-(c) are diagrams showing screens displayed on the display unit of FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiment for carrying out the present disclosure will be described with reference to the attached drawings. Note that the following embodiment is an example of embodying the present disclosure, and does not limit the technical scope of the present disclosure. In addition, the same parts are given the same reference numerals throughout the drawings, and the description is omitted. Furthermore, the description of each part that is not directly related to the present disclosure is omitted in order to avoid duplication.

[0011] In addition, each figure is a schematic diagram and is not necessarily illustrated precisely. Therefore, for example, the scales in each figure do not necessarily match. In addition, in each figure, substantially the same configuration is given the same reference numeral, and duplicated explanations are omitted or simplified. Below, an embodiment of the present disclosure will be described with reference to the drawings in the order of (1) overall configuration, (2) settings for thermal fluid analysis, (3) thermal fluid analysis, (4) conversion of thermal fluid analysis results, and (5) display on a mobile information terminal.

[0012] (1) Overall structure FIG. 1 is an overall configuration diagram of a visualization system 1000. The visualization system 1000 performs a thermal fluid analysis calculation of a diffusive material having a sterilization effect in an analysis space, which is a space to be subjected to a thermal fluid analysis, based on analysis condition information, and displays the analysis result. The visualization system 1000 includes an input terminal 100, a processing device 120, a server 200, and a mobile information terminal 300. The input terminal 100 includes a setting unit 110, which includes an input unit 112 and an output unit 114. The processing device 120 includes an analysis unit 130 and a conversion unit 150. The analysis unit 130 includes an acquisition unit 132, a processing unit 134, a calculation unit 136, a determination unit 138, a storage unit 140, and an analysis result output unit 142, and the conversion unit 150 includes an analysis result acquisition unit 152, a processing unit 154, and an output unit 156. The server 200 includes a database 210. The portable information terminal 300 includes a communication unit 310 , a control unit 320 , an operation unit 330 , a display unit 340 , an imaging unit 350 , and a storage unit 360 .

[0013] The input terminal 100 is a PC (Personal Computer) or a tablet terminal. The input unit 112 is a user interface that accepts operations from a user. The user interface is, for example, a touch panel or physical operation buttons. The input unit 112 creates analysis target data based on the operation from the user. The analysis target data includes information on an analysis space that is the target of the thermal fluid analysis.

[0014] 2(a)-(g) show an outline of the operation of the visualization system 1000. FIG. 2(a) shows an analysis space 10 included in the analysis target data created by the setting unit 110. The analysis space 10 is a virtual space modeled after an actual space (hereinafter, referred to as "real space"), and is a space targeted for performing a thermal fluid analysis. The real space is, for example, a living space in a general house or an office space, and the living space or the office space may include one or more rooms. In addition, equipment such as air conditioners and desks are arranged in the analysis space 10 as in the real space. The input unit 112 receives information about the equipment, such as the model, size, and operating conditions, as equipment information. The equipment information is also included in the analysis target data.

[0015] Fig. 2(b) shows a marker 20 set in one of the rooms in the analysis space 10 shown in Fig. 2(a). The input unit 112 places the marker 20 in the analysis space 10 by a user's operation in the analysis target data, and specifies the coordinates of the marker 20. The marker 20 will be described later. Figs. 2(c)-(g) will be described later, returning to Fig. 1. The input unit 112 is connected to an acquisition unit 132 of the analysis unit 130, which will be described later, wirelessly or via wired communication so as to be able to communicate with each other.

[0016] The output unit 114 outputs the coordinates of the marker 20 and the device information received by the input unit 112 to the analysis result acquisition unit 152 of the conversion unit 150.

[0017] The processing device 120 is configured by a computer system having a processor and a memory. The analysis unit 130 of the processing device 120 executes a thermo-fluid analysis calculation by the processor executing a program stored in the memory based on the analysis target data. The acquisition unit 132 of the analysis unit 130 acquires analysis target data for the analysis space 10 that is the target of the thermo-fluid analysis from the input unit 112. The acquisition unit 132 outputs the analysis target data to the processing unit 134.

[0018] The processing unit 134 causes the calculation unit 136 to execute a thermal fluid analysis calculation based on the analysis target data in order to simulate a situation in which air is blown from an air conditioner arranged in the analysis space 10. The calculation unit 136 performs, for example, an analysis based on computational fluid dynamics (CFD) (hereinafter referred to as CFD analysis). The CFD analysis executes a thermal fluid analysis calculation for the analysis target data using a model such as Reynolds-Averaged Navier-Stokes equations (RANS), Direct Numerical Simulation (DNS), Large Eddy Simulation (LES), or Detached Eddy Simulation (DES).

[0019] For example, the calculation unit 136 performs a CFD analysis based on the type of diffusive substance, the amount of diffusive substance generated, the wind direction and speed of the airflow, the self-decomposition coefficient of the diffusive substance, the diffusion coefficient of the diffusive substance, the adsorption and desorption coefficient of the diffusive substance, etc., to calculate the airflow flowing out from the air conditioner for each position in the analysis space 10 and the concentration of the diffusive substance contained in the airflow. Specifically, as shown in Fig. 2(c), the calculation unit 136 generates a three-dimensional distribution of the airflow and the concentration of the diffusive substance for each position in the analysis space 10. The self-decomposition coefficient of the diffusive substance, the diffusion coefficient of the diffusive substance, and the adsorption and desorption coefficient of the diffusive substance are known techniques, and therefore will not be described here.

[0020] The diffusion material is a material having a sterilizing effect of sterilizing bacteria. Here, sterilization means not only the removal of bacteria or germs, but also the removal of viruses. In other words, bacteria includes not only bacteria but also viruses. Examples of bacteria include, but are not limited to, Staphylococcus aureus, Pseudomonas aeruginosa, and Escherichia coli. An example of the diffusion material is hypochlorous acid (HClO). Another example of the diffusion material may be a material containing OH radicals generated by applying a high voltage to moisture in the air (for example, nanoe (registered trademark)).

[0021] The determination unit 138 analyzes the thermo-fluid analysis results obtained by the calculation unit 136, and identifies the presence or absence of a distribution region in which the analyzed physical property value results are outside a reference range (4 ppb to 10 ppb in the case of the concentration of a diffusible material). The storage unit 140 stores various information. The storage unit 140 stores an algorithm for executing the processing of the processing unit 134 of the present disclosure. The storage unit 140 stores past thermo-fluid analysis results, and information on each component used in the analysis calculation in the calculation unit 136 (model, shape, default conditions, diffusible material information, etc.). The analysis result output unit 142 outputs the thermo-fluid analysis results in the processing unit 134 to the conversion unit 150.

[0022] The analysis result acquisition unit 152 of the conversion unit 150 receives the thermal fluid analysis result from the analysis result output unit 142, and outputs the thermal fluid analysis result to the processing unit 154. The analysis result acquisition unit 152 also receives the coordinates of the marker 20 and the device information from the output unit 114, and outputs the coordinates of the marker 20 and the device information to the processing unit 154.

[0023] The processing unit 154 converts the thermal fluid analysis result 160 into AR data 162 as shown in FIG. 2(d). The AR data 162 is data for displaying the thermal fluid analysis result 160 as AR on the mobile information terminal 300. The AR data 162 and the thermal fluid analysis result 160 have different data formats, but since the AR data 162 also indicates the thermal fluid analysis result, hereinafter, the "AR data 162" may be referred to as the "thermal fluid analysis result 160". During the conversion, the coordinates and device information of the marker 20 are associated with the AR data 162. That is, in the analysis space 10 converted into the AR data 162 (hereinafter, also referred to as the "analysis space 10"), the marker 20 is placed at the same position as before. The output unit 156 can communicate with the server 200 wirelessly or by wire, and transmits the AR data 162 to the server 200.

[0024] The database 210 of the server 200 receives the AR data 162 from the output unit 156. The database 210 stores the AR data 162. The database 210 transmits the AR data 162 to the portable information terminal 300 in response to a request from the portable information terminal 300.

[0025] The mobile information terminal 300 is a tablet terminal or a smartphone. The mobile information terminal 300 may be in a state of being used as a tablet terminal in a 2-in-1 mobile terminal (a terminal that can be used as both a notebook computer and a tablet depending on the scene of use). The mobile information terminal 300 may be the same device as the input terminal 100. The communication unit 310 can wirelessly communicate with the server 200 and receives the AR data 162 from the server. The communication unit 310 outputs the AR data 162 to the control unit 320. The control unit 320 executes a program stored in the storage unit 360. Here, a program for visualizing the thermal fluid analysis result 160 by AR is executed. When executing the program, the control unit 320 accepts an operation from a user to the operation unit 330. The operation unit 330 is a user interface that can accept an operation from a user, and is, for example, a touch panel.

[0026] The imaging unit 350 is a LiDAR (Light Detection and Ranging) camera or a LiDAR sensor, which captures an image and identifies the distance to an object included in the captured image. The imaging unit 350 outputs the captured image to the control unit 320. The image includes information on the identified distance. The control unit 320 causes the display unit 340 to display the image captured by the imaging unit 350.

[0027] 2(e) shows an image displayed on the display unit 340. A marker 420 is placed in the real space corresponding to the analytical space 10. Here, the relative position of the marker 20 placed in the analytical space 10 is the same as the relative position of the marker 420 placed in the real space 410. The image of the marker 420 is captured by the imaging unit 350.

[0028] 2(f) shows the processing in the control unit 320. The control unit 320 specifies the position of the marker 420 in the real space 410 based on the image captured by the imaging unit 350. The control unit 320 also specifies the position of the marker 20 in the analytical space 10 based on the AR data 162. The control unit 320 associates the marker 420 with the marker 20, thereby associating the coordinates of the real space 410 with the coordinates of the analytical space 10. That is, the real space 410 and the analytical space 10 are aligned.

[0029] As a result, the control unit 320 displays the real space 410 in three dimensions on the display unit 340, as shown in Figure 2(g), and also displays the thermal fluid analysis result 160 obtained by the analysis unit 130 on the display unit 340, superimposed on the three-dimensionally displayed real space 410.

[0030] (2) Settings for thermo-fluid analysis When the user starts the work by operating the input unit 112, the input terminal 100 displays the first display screen F1 of FIG. 3 on the display unit (not shown). FIG. 3 illustrates the first display screen F1. The user inputs the vertex coordinates of the analytical space 10 on the first display screen F1. The shape of the analytical space 10 is determined by the user specifying the vertex coordinates on the first display screen F1 by the user's operation (for example, clicking, etc.). Here, the user clicks C1 on the first display screen F1 to determine the vertex coordinates of the vertex T1 of the analytical space 10. Next, the user clicks C2 to determine the vertex coordinates of the vertex T2 of the analytical space 10, and a wall W1 connecting the vertex T1 and the vertex T2 is displayed. After that, the user clicks C3 to C6 to determine the vertex coordinates of the vertices T3 to T6 of the analytical space 10, and the walls W2 to W5 connecting the vertices T2 and T3, the vertices T3 and T4, the vertices T4 and T5, and the vertices T5 and T6 are displayed. Finally, when the user performs a click C7 on the same location as the click C1, that is, on the vertex T1, a wall W6 connecting the vertex T1 and the vertex T6 is displayed and the shape of the analytical space 10 is determined.

[0031] When the shape of the analytical space 10 is determined, the second display screen F2 shown in FIG. 4 is displayed. FIG. 4 illustrates the second display screen F2. In the second display screen F2, the user inputs the reference dimensions of the analytical space 10. The vertex coordinates can be based on any position on the first display screen F1. When the user clicks C11 and C12 on any two points (for example, points whose dimensions are known) on the second display screen F2, a reference line L connecting the two points clicked C11 and clicked C12 is displayed. Thereafter, the dimension of the reference line L is determined by inputting the value of the reference dimension in the reference dimension input field 31, so that the scale between the vertex coordinates determined in the first display screen F1 can be adjusted to the actual dimension. In addition, in the second display screen F2, the ceiling height of the analytical space 10 is determined by inputting the ceiling height of the analytical space 10 in the ceiling height input field 32.

[0032] When the input of the reference dimensions and ceiling height is completed, the third display screen F3 shown in Fig. 5(a) is displayed. Figs. 5(a)-(b) show examples of the third display screen F3 and the fourth display screen F4. The user inputs the arrangement of the components to be installed in the analytical space 10 on the third display screen F3. The user specifies the location in the analytical space where the component is to be placed by clicking C21-C24 on the location on the third display screen F3 where the component is to be placed. In addition, the user can place a wall in the area specified by the sliding operation S1 by clicking on the third display screen F3 and then performing the sliding operation S1.

[0033] When the arrangement operation on the third display screen F3 is completed, the fourth display screen F4 of FIG. 5(b) is displayed. The user inputs details of the equipment or structure arranged on the third display screen F3 on the fourth display screen F4. The fourth display screen F4 displays the components to be arranged at the positions of each of the clicks C21 to C24 and the slide operation S1 in a list format. For example, in the items of each of the clicks C21 to C24, details such as the equipment, wind direction, wind volume, and concentration (diffused substance concentration) can be input. For example, when the user clicks on the component field of the click C24 on the fourth display screen F4, the types of components registered in advance in the storage unit 140, such as "Model A", "Model B", "Model C", and "Door", are displayed in a list. The user can input the necessary equipment in the component field of the click C24 by selecting one of the types of components displayed in the list. Similarly, details of wind direction, wind volume, and concentration for each type of component are preregistered in the storage unit 140, and when the input field for wind direction, wind volume, or concentration is clicked, the input unit 112 accesses the storage unit 140 to display a list of preregistered details, allowing the user to select one of them. Position X in the X direction (left and right direction in FIG. 5(a)) and position Y in the Y direction (up and down direction in FIG. 5(a)) are detected by detecting the coordinates from the point where the user clicks or slides, and the position is automatically reflected in each input field. Return to FIG. 1. Information on the analysis space 10 created in this way is included in the above-mentioned analysis target data.

[0034] (3) Thermofluid analysis The calculation unit 136 executes a thermal fluid analysis calculation in the analysis space 10 based on the analysis target data. At that time, information on each component stored in the storage unit 140 (such as model, shape, default conditions, and diffusive material information) is used for the thermal fluid analysis calculation. Through the thermal fluid analysis calculation, the calculation unit 136 simulates the airflow flowing out from an air conditioner (air outlet) installed above the analysis space 10 into the analysis space 10, and also simulates the diffusive material of a predetermined concentration contained in the airflow and diffused into the analysis space 10.

[0035] Here, as the simulation of the airflow, a simulation of the airflow blown out from the air conditioner (air outlet) and a simulation of the airflow containing a diffusing substance (hypochlorous acid) are performed. The airflow containing the diffusing substance (hypochlorous acid) is blown out, for example, from a device other than the air conditioner (air outlet). In the simulation, the airflow is represented by a collection of vectors representing, for example, the position, direction, and air volume. Meanwhile, in the simulation of the diffusing substance, the concentration of the diffusing substance at each position in the analysis space 10 is represented. In these simulations, the thermal fluid analysis results are represented by the coordinates of the analysis space 10.

[0036] In a simulation of an airflow containing a diffusing substance (hypochlorous acid), multiple simulations may be performed while changing the amount of hypochlorous acid added. Also, a simulation of an airflow containing a diffusing substance (nanoe) may be performed. Furthermore, in a simulation of an airflow containing a diffusing substance (nanoe), multiple simulations may be performed while changing the amount of nanoe added.

[0037] The calculation unit 136 may execute a thermal fluid analysis calculation for each of different analysis target data for the same analysis space 10. The different analysis target data is created, for example, by changing the air conditioner (air outlet) or the number of air conditioners (air outlets). The calculation unit 136 links the thermal fluid analysis results for the different analysis target data.

[0038] 6 illustrates the fifth display screen F5. The fifth display screen F5 is displayed on the display unit (not shown) of the input terminal 100 or the display unit (not shown) of the processing device 120. On the fifth display screen F5, the progress of the thermo-fluid analysis calculation is displayed as the convergence status of the calculated physical property values ​​when the calculation cycle is advanced. Specifically, the convergence status of the thermo-fluid calculation for the turbulent energy, the turbulent dissipation rate, the concentration of various diffusing materials, the flow velocity, etc. is displayed.

[0039] 7 illustrates the sixth display screen F6. The sixth display screen F6 is displayed on a display unit (not shown) of the input terminal 100 or a display unit (not shown) of the processing device 120. On the sixth display screen F6, the result of the thermal fluid analysis, in particular the distribution of the concentration of the diffusing material, is displayed three-dimensionally in the analysis space 10.

[0040] (4) Conversion of thermo-fluid analysis results 8(a)-(b) show an example of an operation screen for the conversion unit 150. The operation screen is displayed on a display unit (not shown) of the input terminal 100 or a display unit (not shown) of the processing device 120. As shown in FIG. 8(a), a data reference button 400, a conversion data input field 402, and a conversion button 404 are shown. By clicking the data reference button 400, a list of the thermal fluid analysis results 160 output from the analysis result output unit 142 is displayed. When one of the multiple thermal fluid analysis results 160 included in the list is selected, the data name of the thermal fluid analysis result 160 to be converted is displayed in the conversion data input field 402 as shown in FIG. 8(b). In this state, when the conversion button 404 is clicked, the processing unit 154 of the conversion unit 150 converts the thermal fluid analysis result 160 into AR data 162 as described above.

[0041] (5) Display on mobile information terminals 9(a)-(b) show the external appearance of a mobile information terminal 300. The mobile information terminal 300 is a tablet terminal including a rectangular flat-plate-shaped housing 302 with a side serving as a grip. FIG. 9(a) shows one surface 304 of the housing 302 and shows the rear surface 306 of the housing 302. The one surface 304 and the rear surface 306 are opposite surfaces, and both have a rectangular shape. As shown in FIG. 9(a), a rectangular display unit 340 is provided on the one surface 304 of the housing 302. The display unit 340 also functions as a touch panel. As shown in FIG. 9(b), an imaging port 352 of an imaging unit 350 is provided on the rear surface 306 of the housing 302.

[0042] 10(a)-(e) show an overview of the operation of the mobile information terminal 300. FIG. 10(a)-(e) show the screen of the display unit 340. FIG. 10(a) shows a plurality of icons 430, and by touching an AR application icon 430, the control unit 320 starts the AR application stored in the storage unit 360. FIG. 10(b) shows the initial screen of the started AR application. A message saying "Please capture the marker with the camera" is displayed in the center. After checking this message, the user moves the marker 420 placed in the real space 410 to a position where it can be captured by the imaging unit 350.

[0043] Following this, in Fig. 10(c), the marker 420 placed in the real space 410 is displayed on the display unit 340. In Fig. 10(d), the imaging unit 350 captures an image of the marker 420 in the state of Fig. 10(c). As a result, as described above, the control unit 320 aligns the real space 410 with the analytical space 10. In Fig. 10(e), the walls W, equipment, and fixtures of the analytical space 10 are displayed in AR.

[0044] 11(a)-(c) show screens displayed on the display unit 340. FIG. 11(a) shows the layout of the screen of the display unit 340 when an AR application is started on the mobile information terminal 300. Here, a situation is shown in which the left side of the mobile information terminal 300 is held with the left hand and the right side with the right hand while the display unit 340 of the mobile information terminal 300 is facing the user. The mobile information terminal 300 is held in a landscape orientation. The left lower end 500 of the display unit 340 is a position that can be operated by the thumb or any finger of the user's left hand, and the right lower end 502 is a position that can be operated by the thumb or any finger of the user's right hand. The mobile information terminal 300 may be held with one hand of the user.

[0045] 11(b) shows the screen of the display unit 340 when the AR application is being executed. The AR application generates an image (hereinafter referred to as a "synthetic image") in which an image of the real space 410 captured by the imaging unit 350 and a thermal fluid analysis result 160 in which the real space 410 is set as the analysis space 10 are superimposed as AR. At that time, the AR application aligns the coordinates of the image of the real space 410 with the coordinates of the analysis space 10 by aligning the markers 420 and 20. The display unit 340 displays the synthetic image generated by the AR application.

[0046] The display unit 340 displays a concentration ON / OFF switching button 510, an airflow display mode switching button 512, a Before / After switching button 514, a concentration play / stop operation control button 520, a reset operation control button 522, an elapsed time 524, and an indicator 530, superimposed on the composite image. The concentration ON / OFF switching button 510, the airflow display mode switching button 512, the Before / After switching button 514, the concentration play / stop operation control button 520, the reset operation control button 522, and the elapsed time 524 are included in the operation unit 330 of Fig. 1, and accept operations (touch operations) from the user. The operation unit 330 is used to operate the images displayed on the display unit 340, in particular the thermal fluid analysis result 160.

[0047] The concentration ON / OFF switching button 510, the airflow display mode switching button 512, and the Before / After switching button 514 are switching buttons for switching information to be displayed on the display unit 340. These switching buttons are arranged at the lower left end 500. The concentration play / stop operation control button 520, the reset operation control button 522, and the elapsed time 524 are operation control buttons for controlling the operation of the thermal fluid analysis result 160 to be displayed on the display unit 340. These operation control buttons are arranged at the lower right end 502. In other words, the composite image is displayed as wide as possible, and the switching buttons and operation control buttons that need to be operated on the assumption that the mobile information terminal 300 is held with both hands are arranged as minimally as possible near the movable range of the fingers. Also, the switching buttons may be arranged at the lower right end 502 of FIG. 11, and the operation control buttons may be arranged at the lower left end 500.

[0048] The indicator 530 includes a diffusion material type indicator 532 indicating the type of diffusion material and an airflow state indicator 534 indicating the state of the airflow, and is disposed on the upper right side of the display unit 340. The indicator 530 may be disposed on the upper left side of the display unit 340. The indicator is always displayed while the AR application is being executed. Meanwhile, the motion control button detects whether or not a finger touches the display unit 340 within a predetermined time, and is switched between display and non-display within the display unit 340. That is, when the operation unit 330 does not detect a finger touch on the motion control button for a predetermined time, the control unit 320 does not display the motion control button on the display unit 340. Meanwhile, when the operation unit 330 detects a finger touch on the motion control button, the control unit 320 displays the motion control button on the display unit 340. Each switching button, a switching operation by operating each motion control button, and a notification by the indicator 530 will be described later.

[0049] Fig. 11(c) shows another screen of the display unit 340 when the AR application is being executed. Instead of the concentration ON / OFF switching button 510, the airflow display mode switching button 512, and the Before / After switching button 514 in Fig. 11(b), an airflow display mode switching button 512, a Zia addition amount display mode switching button 516, and a Nanoe addition amount display mode switching button 518 are arranged at the lower left end 500. The airflow display mode switching button 512, the Zia addition amount display mode switching button 516, and the Nanoe addition amount display mode switching button 518 are also switching buttons. "Zia" is an abbreviated symbol for operation, and indicates air containing hypochlorous acid as a diffusing substance.

[0050] 12(a)-(d) show screens displayed on the display unit 340 when the direction in which the portable information terminal 300 is held is changed. Fig. 12(a)-(b) shows a situation in which the portable information terminal 300 is held in a landscape orientation, as in the past. As described above, the concentration ON / OFF switching button 510, the airflow display mode switching button 512, and the Before / After switching button 514 are disposed at the lower left end 500. In addition, the concentration play / stop operation control button 520, the reset operation control button 522, and the elapsed time 524 are disposed at the lower right end 502.

[0051] 12(c)-(d) show a situation where the mobile information terminal 300 is held in a vertically long orientation, which is different from the previous situation. The mobile information terminal 300 includes an acceleration sensor (not shown) and a geomagnetic sensor (not shown), and the control unit 320 identifies the orientation of the mobile information terminal 300 by combining the detection results of these. When the control unit 320 identifies the orientation of the mobile information terminal 300 in a vertically long orientation, it moves the lower left end 500 and the lower right end 502 to the positions shown in FIG. 12(d). In addition, the control unit 320 arranges the switching buttons and the operation control buttons at the lower left end 500 and the lower right end 502 in the same manner as before. As a result, the concentration ON / OFF switching button 510, the airflow display mode switching button 512, and the Before / After switching button 514 are arranged at the lower left end 500. In addition, the concentration play / stop operation control button 520, the reset operation control button 522, and the elapsed time 524 are arranged at the lower right end 502.

[0052] That is, the display unit 340 detects the gripping position of the housing 302 in the hand, and switches the position at which the operation unit 330 is superimposed on the composite image so that it is in the same position with respect to the user's thumb. In this way, the display positions of the control buttons and the action control buttons change to optimal positions depending on whether the mobile information terminal 300 is held horizontally or vertically.

[0053] The switching buttons, operation control buttons, and indicators 530 shown in Fig. 11(b)-(c) will be described in detail below. The concentration ON / OFF switching button 510 in Fig. 11(b) is a button for switching whether or not to display the concentration of the diffusible substance (hypochlorous acid) in the thermal fluid analysis result 160. Every time the user touches the concentration ON / OFF switching button 510, the control unit 320 alternates between "concentration ON" and "concentration OFF" as the display of the concentration ON / OFF switching button 510. "Concentration ON" corresponds to displaying the concentration of the diffusible substance (hypochlorous acid), and "concentration OFF" corresponds to not displaying the concentration of the diffusible substance (hypochlorous acid).

[0054] The airflow display mode switching button 512 is a button for switching whether or not to display the airflow in the thermal fluid analysis result 160, and for switching the type of airflow when the airflow is displayed. Every time the user touches the airflow display mode switching button 512, the control unit 320 switches the display of the airflow display mode switching button 512 between "AIRFLOW OFF", "AIRFLOW AIR", "AIRFLOW ZIR", and "BOTH AIRFLOW" in order.

[0055] "Airflow OFF" corresponds to not displaying the airflow, "Airflow Air" corresponds to displaying the airflow blown out from the air conditioner (outlet), and "Airflow Zia" corresponds to displaying the airflow containing the diffusible substance (hypochlorous acid). Here, "Airflow Zia" may be blown out from a device other than the air conditioner (outlet). Also, "Both Airflows" corresponds to displaying the airflow blown out from the air conditioner (outlet) and the airflow containing the diffusible substance (hypochlorous acid).

[0056] 13(a)-(h) show screens displayed on the display unit 340. Fig. 13(a) shows a screen when "concentration OFF" is set by the concentration ON / OFF switching button 510 and "airflow OFF" is set by the airflow display mode switching button 512. In this case, the control unit 320 uses only the image of the real space 410 captured by the imaging unit 350 through the AR application to generate a composite image without using the thermal fluid analysis result 160. The display unit 340 displays the image of the real space 410 captured by the imaging unit 350 as the composite image.

[0057] 13(b) shows a screen when "concentration OFF" is set by the concentration ON / OFF switching button 510 and "airflow air" is set by the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by using an AR application to superimpose, as AR, the image of the real space 410 captured by the imaging unit 350 and the thermal fluid analysis result 160 for the airflow blown out from the air conditioner (air outlet). The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350 and an air conditioner streamline 550 indicating the airflow blown out from the air conditioner (air outlet).

[0058] 13(c) shows a screen when "concentration OFF" is set by the concentration ON / OFF switching button 510 and "airflow azia" is set by the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by superimposing, as AR, the image of the real space 410 captured by the imaging unit 350 and the thermal fluid analysis result 160 for the airflow containing the diffusing substance (hypochlorous acid) using an AR application. The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350 and the diffusing substance flow line 552 indicating the airflow containing the diffusing substance (hypochlorous acid).

[0059] 13(d) shows a screen when "concentration OFF" is set by the concentration ON / OFF switching button 510 and "both airflows" is set by the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by superimposing, as AR, an image of the real space 410 captured by the imaging unit 350, a thermal fluid analysis result 160 about the airflow blown out from the air conditioner (air outlet), and a thermal fluid analysis result 160 about the airflow containing a diffusing substance (hypochlorous acid) using an AR application. The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350, an air conditioner streamline 550 showing the airflow blown out from the air conditioner (air outlet), and a diffusing substance streamline 552 showing the airflow containing a diffusing substance (hypochlorous acid).

[0060] 13(e) shows a screen when "concentration ON" is set by the concentration ON / OFF switching button 510 and "airflow OFF" is set by the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by superimposing, as AR, the image of the real space 410 captured by the imaging unit 350 and the thermal fluid analysis result 160 for the diffuse substance concentration, using an AR application. The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350 and the diffuse substance concentration 560 indicating the diffuse substance concentration.

[0061] Here, when generating a composite image, the control unit 320 colors the diffusing material in the analytical space 10 with a predetermined color on the projected image of the real space 410. The control unit 320 also changes the transparency of the colored color according to the concentration of the diffusing material. At that time, the color may be changed according to the concentration of the diffusing material. The display unit 340 displays the diffusing material concentration 560 colored in this way.

[0062] 13(f) shows a screen when "concentration ON" is set by the concentration ON / OFF switching button 510 and "airflow air" is set by the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by superimposing, as AR, an image of the real space 410 captured by the imaging unit 350, a thermal fluid analysis result 160 regarding the diffuse substance concentration, and a thermal fluid analysis result 160 regarding the airflow blown out from the air conditioner (air outlet), using an AR application. The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350, a diffuse substance concentration 560 indicating the diffuse substance concentration, and an air conditioner streamline 550 indicating the airflow blown out from the air conditioner (air outlet).

[0063] 13(g) shows a screen when "concentration ON" is set by the concentration ON / OFF switching button 510 and "airflow dia" is set by the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by superimposing, as AR, an image of the real space 410 captured by the imaging unit 350, a thermal fluid analysis result 160 regarding the diffusing substance concentration, and a thermal fluid analysis result 160 regarding the airflow containing the diffusing substance (hypochlorous acid). The display unit 340 displays, as the composite image, the image of the real space 410 captured by the imaging unit 350, a diffusing substance concentration 560 indicating the diffusing substance concentration, and a diffusing substance flow line 552 indicating the airflow containing the diffusing substance (hypochlorous acid).

[0064] 13(h) shows a screen when "concentration ON" is set by the concentration ON / OFF switching button 510 and "both airflows" is set by the airflow display mode switching button 512. In this case, the control unit 320 generates a composite image by superimposing, as AR, an image of the real space 410 captured by the imaging unit 350, a thermal fluid analysis result 160 on the diffusive substance concentration, a thermal fluid analysis result 160 on the airflow blown out from the air conditioner (air outlet), and a thermal fluid analysis result 160 on the airflow containing the diffusive substance (hypochlorous acid). The display unit 340 displays, as the composite image, an image of the real space 410 captured by the imaging unit 350, a diffusive substance concentration 560 indicating the diffusive substance concentration, an air conditioner streamline 550 indicating the airflow blown out from the air conditioner (air outlet), and a diffusive substance streamline 552 indicating the airflow containing the diffusive substance (hypochlorous acid).

[0065] In Fig. 13(b)-(d) and Fig. 13(f)-(h), the control unit 320 displays the airflow having a certain wind speed or more as a line segment along the flow direction on the display unit 340, starting from the air conditioner (air outlet), so that the airflow, for example, the air conditioner flow line 550 and the diffusing material flow line 552 can be understood from where and how they are flowing. Furthermore, the control unit 320 expresses the airflow as a line or dense moving particles (dashed lines) so that the movement of the airflow can be conveyed sensuously. At that time, the particles are displayed to move according to the speed at which the airflow flows. However, the movement of the particles to be moved is set at a speed that can be followed by the eye, not at the actual speed (several m / s is too fast). Furthermore, the control unit 320 colors the airflow with a color according to the type of diffusing material. For example, the airflow containing the diffusing material (hypochlorous acid) is shown in green, and the airflow blown out from the air conditioner (air outlet) is shown in white.

[0066] The display of the airflow, for example, the air conditioner streamline 550 and the diffusion material streamline 552, will be described in more detail below. When the control unit 320 displays the image of the real space 410 and the thermal fluid analysis result 160 in an overlapping manner, the control unit 320 generates the airflow flowing out from the air conditioner (air outlet) as a line segment along the flow direction based on the vector included in the thermal fluid analysis result 160, and displays this on the display unit 340. At this time, the control unit 320 specifies the distance between the line segment of the airflow and the mobile information terminal 300 based on the distance between the object in the image acquired by the imaging unit 350 and the mobile information terminal 300. The control unit 320 also changes the length and thickness of the line segment according to the specified distance, that is, the perspective position in the displayed analysis space 10.

[0067] 14 shows a screen displayed on display unit 340. Here, air conditioner streamlines 550 and diffuse material streamlines 552 are classified into nearby streamlines 554 that are relatively close to mobile information terminal 300, and distant streamlines 556 that are relatively far from mobile information terminal 300. Nearby streamlines 554 correspond to airflows close to the viewpoint, and distant streamlines 556 correspond to airflows far from the viewpoint. Nearby streamlines 554 are shown with thick and long line segments, and distant streamlines 556 are shown with thin and short line segments.

[0068] The ZIA addition amount display mode switching button 516 in Fig. 11(c) is a button for switching the amount of diffusion material (hypochlorous acid) added to the airflow. Each time the user touches the ZIA addition amount display mode switching button 516, the control unit 320 switches the display of the ZIA addition amount display mode switching button 516 between "ZIA OFF", "ZIA 20", "ZIA 32", and "ZIA 39" in order. In addition, the control unit 320 generates a composite image including the thermal fluid analysis result 160 for the airflow with the different amounts of hypochlorous acid added by the AR application, and displays the composite image on the display unit 340.

[0069] 11(c) is a button for switching the amount of diffusive substance (nanoe) added to the airflow. Each time the user touches the nanoe addition amount display mode switching button 518, the control unit 320 switches the display of the nanoe addition amount display mode switching button 518 between "nanoe OFF", "nanoe 10", "nanoe 20", and "nanoe 100" in order. In addition, the control unit 320 uses the AR application to generate a composite image including the thermal fluid analysis result 160 for the airflow with the different amounts of nanoe added, and causes the display unit 340 to display the composite image.

[0070] 11(b) includes a diffusing material type indicator 532 and an airflow state indicator 534, as described above. "Nanoe" and "Zia" included in the diffusing material type indicator 532 indicate the type of diffusing material when the thermofluid analysis result 160 for the diffusing material concentration is displayed. For example, when displaying the thermofluid analysis result 160 for the concentration of hypochlorous acid, the control unit 320 turns on the "Zia" portion of the diffusing material type indicator 532 and turns off the "Nanoe" portion.

[0071] "Air", "Nanoe", and "Zia" included in the airflow state indicator 534 indicate the type of diffusive material when the thermofluid analysis result 160 for the airflow is displayed. For example, when the control unit 320 displays the thermofluid analysis result 160 for the airflow not containing a diffusive material, the control unit 320 lights up the "Air" portion of the airflow state indicator 534. When the control unit 320 displays the thermofluid analysis result 160 for the airflow containing a diffusive material (nanoe), the control unit 320 lights up the "Nanoe" portion of the airflow state indicator 534. When the control unit 320 displays the thermofluid analysis result 160 for the airflow containing a diffusive material (hypochlorous acid), the control unit 320 lights up the "Zia" portion of the airflow state indicator 534.

[0072] 11(b)-(c) will be described in detail below. The Before / After switching button 514 is a button for switching between the thermo-fluid analysis results 160 for each of the different analysis target data. Every time the user touches the Before / After switching button 514, the control unit 320 alternates between "Before" and "After" as the display of the Before / After switching button 514.

[0073] 15(a)-(b) show screens displayed on the display unit 340. FIG. 15(a) shows the screen when "Before" is set by the Before / After switching button 514. FIG. 15(a) is displayed in the same manner as before. FIG. 15(b) shows the screen when "After" is set by the Before / After switching button 514. The control unit 320 generates a composite image using a thermal fluid analysis result 160 different from the thermal fluid analysis result 160 for the analysis target data used in FIG. 15(a). Here, a virtual air conditioner 570 has been added, and airflow is being blown out from the virtual air conditioner 570.

[0074] In the following, the concentration play / stop operation control button 520, the reset operation control button 522, and the elapsed time 524 shown in Fig. 11(b)-(c) will be described in detail. Although omitted in the above description, the thermal fluid analysis result 160 in the calculation unit 136 or the composite image in the control unit 320 is not generated for one timing, but is generated continuously at regular intervals over a predetermined time from the start timing. The start timing is the timing at which the air conditioner (air outlet) starts blowing out the airflow, or the timing at which the diffusing material starts attaching to the airflow. The regular interval is, for example, one second, ten seconds, or one minute. The predetermined time is the time until the concentration of the diffusing material in the analysis space 10 converges. This can also be said to be the time until the fluctuation value of the diffusing material (diffusing material 1 to diffusing material 3) shown in Fig. 6 converges. Convergence is determined by the difference between the average value of the concentration of the diffusing material in the analysis space 10 at a specified timing and the average value of the concentration of the diffusing material in the analysis space 10 at the timing one timing after the specified timing being within a certain range.

[0075] The concentration play / stop operation control button 520 is a button for instructing whether to display the composite images generated continuously at regular intervals in chronological order or to stop the display. When the control unit 320 receives a display instruction from the concentration play / stop operation control button 520, the control unit 320 plays back the composite images in chronological order and displays them on the display unit 340. At this time, the elapsed time 524 indicates the elapsed time from the start timing.

[0076] 16(a)-(c) show screens displayed on the display unit 340. Here, as an example, "concentration ON" is set by the concentration ON / OFF switching button 510, and "airflow OFF" is set by the airflow display mode switching button 512. FIG. 16(a) shows a composite image at the start timing. Since it is the start timing, the concentration of the diffusing material is low. Therefore, the diffusing material concentration 560 is shown with high transparency. FIG. 16(b) shows a composite image at a timing 5 minutes after the start timing. Since the diffusing material has been added to the airflow for 5 minutes, the concentration of the diffusing material has increased. Therefore, the diffusing material concentration 560 is shown with lower transparency compared to the case of FIG. 16(a). FIG. 16(c) shows a composite image at a timing 10 minutes after the start timing. Since the diffusing material has been added to the airflow for 10 minutes, the concentration of the diffusing material has further increased. Therefore, the diffusing material concentration 560 is shown with lower transparency compared to the case of FIG. 16(b). Similar changes are shown when air currents are included in the composite image.

[0077] In this way, when the display unit 340 superimposes the image of the real space 410 captured by the imaging unit 350 and the thermo-fluid analysis result 160 in which the space is set as the analysis space 10 as AR, the display unit 340 dynamically displays the state in which the thermo-fluid analysis result 160 changes over time. In particular, the display unit 340 displays, as the thermo-fluid analysis result 160, the results from the start of adding the diffusing material to the airflow until a predetermined time has elapsed in time.

[0078] The reset operation control button 522 is a button for instructing to return the time during which the composite image is reproduced to the start timing. This can also be said to be a button for resetting the elapsed time since the addition of the diffusing material to the airflow started. When the control unit 320 receives a reset instruction from the reset operation control button 522, it returns the timing for reproducing the composite image to the start timing.

[0079] The subject of the device, system, or method in the present disclosure includes a computer. The computer executes a program to realize the function of the subject of the device, system, or method in the present disclosure. The computer includes a processor that operates according to a program as a main hardware configuration. The type of the processor does not matter as long as it can realize the function by executing the program. The processor is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or an LSI (Large Scale Integration). The multiple electronic circuits may be integrated into one chip or may be provided on multiple chips. The multiple chips may be integrated into one device or may be provided on multiple devices. The program is recorded on a non-transitory recording medium such as a computer-readable ROM, an optical disk, or a hard disk drive. The program may be stored in the recording medium in advance, or may be supplied to the recording medium via a wide area communication network including the Internet.

[0080] According to this embodiment, when the image of the real space 410 and the thermal fluid analysis result 160 are displayed in an overlapping manner as AR, the state in which the thermal fluid analysis result 160 changes over time is dynamically displayed, so that the time-series change in the environment can be notified. In addition, when generating a composite image, the diffusing material is colored with a predetermined color on the projected image of the real space 410, and the transparency of the colored color is changed according to the concentration of the diffusing material, so that the spatial concentration distribution of the diffusing material can be visualized. In addition, the airflow is displayed with a predetermined color and a predetermined darkness according to the concentration of the diffusing material, so that the state of the airflow can be visualized. In addition, the results from the start of the addition of the diffusing material to the airflow until a predetermined time has elapsed are displayed in a chronological order, so that the degree of understanding of the time-series change in the spatial concentration distribution can be improved. In addition, since the predetermined time is the time until the concentration of the diffusing material converges, the time-series change in the concentration of the diffusing material can be notified.

[0081] In addition, the diffusing substance contains either hypochlorous acid or a substance containing OH radicals generated by applying high voltage to moisture in the air, making it easy to understand the sterilization effect. Airflow is displayed with lines along the flow direction, and the length of the lines is displayed as long for airflows closer to the viewpoint and short for airflows farther from the viewpoint, making it possible to visualize the state of the airflow. The lines are also displayed by moving according to the speed of the airflow, making it possible to visualize the state of the airflow.

[0082] In addition, the operation unit 330 is superimposed on a composite image in which the image of the real space 410 and the thermal fluid analysis result 160 are superimposed as AR, and the operation unit 330 is arranged at a position where it can be operated by the thumb or any finger when the user holds it with both hands or one hand, so that the operability of the user for displaying the thermal fluid analysis result 160 can be improved. In addition, the operation unit 330 superimposed on the composite image is arranged at either the lower left end 500 or the lower right end 502 of the display unit 340, so that the operability of the user can be improved. In addition, a switching button is arranged at the lower right end 502 of the display unit 340, and an operation control button is arranged at the lower right end 502 of the display unit 340, so that the operability of the user can be improved. In addition, a switching button is arranged at the lower right end 502 of the display unit 340, and an operation control button is arranged at the lower left end 50 ...

[0083] In addition, by detecting whether or not a finger has been in contact with display unit 340 within a predetermined time, the display of the operation control button is switched between on and off, and indicator 530 is constantly displayed, so that it is possible to both expand the display area of ​​the composite image and improve the visibility of notifications. In addition, since indicator 530 is displayed at least on either the upper right end or the upper left end of display unit 340, indicator 530 can be displayed in a position separate from operation unit 330.

[0084] In addition, the operation control button has an operation button for operating at least one of switching whether or not to stop the dynamic display and resetting the elapsed time since the addition of the diffusing material to the airflow started, thereby improving the operability of the user. In addition, the switching button has an operation button for operating at least one of switching whether or not to add the diffusing material to the airflow and switching the amount of the diffusing material added to the airflow, thereby improving the operability of the user. In addition, the gripping position where the housing 302 is gripped by the hand is detected, and the position where the operation unit 330 is superimposed on the composite image is switched and displayed so as to be in the same position as the user's thumb, thereby improving the operability of the user.

[0085] An outline of one aspect of the present disclosure is as follows. (Item 1-1) A rectangular flat-plate-shaped housing (302); A rectangular display unit (340) provided on one surface (304) of the housing (302); an imaging unit (350) having an imaging port on the back surface (306) of the one surface (304); Equipped with the display unit (340) dynamically displays a time-series change in the thermal fluid analysis result (160) when displaying, as an augmented reality (AR) image of the space captured by the imaging unit (350) and the thermal fluid analysis result (160) in which the space is set as an analysis space (10) in an overlapping manner. A visualization device (300) for the results of thermal fluid analysis (160).

[0086] (Item 1-2) The thermal fluid analysis result (160) is an airflow flowing out from an air outlet installed above the analysis space (10) into the analysis space (10); A simulation of a diffuse material having a predetermined concentration contained in the airflow and diffused into the analysis space (10), the display unit (340), when displaying the image of the space and the thermal fluid analysis result (160) in an overlapping manner, colors the diffusing material in the analysis space (10) with a predetermined color on the projected image of the space, and changes the transparency of the color according to the concentration of the diffusing material. A visualization device (300) for the thermal fluid analysis results (160) described in Item 1-1.

[0087] (Item 1-3) The display unit (340) displays the airflow flowing out from the air outlet in a predetermined color and with a predetermined density according to the concentration of the diffusing substance. A visualization device (300) for the thermal fluid analysis results (160) described in Item 1-2.

[0088] (Items 1-4) the display unit (340) displays, as the thermal fluid analysis result (160), the results from the start of addition of the diffusing material to the airflow until a predetermined time has elapsed in chronological order. A visualization device (300) for a result of thermal fluid analysis (160) according to Item 1-2 or 1-3.

[0089] (Items 1-5) The predetermined time is a time required for the concentration of the diffusing material in the analysis space (10) to converge. A visualization device (300) for the thermal fluid analysis results (160) described in Items 1-4.

[0090] (Items 1-6) The diffusing substance includes any one of hypochlorous acid and a substance containing OH radicals generated by applying a high voltage to moisture in the air, A visualization device (300) for the thermal fluid analysis results (160) described in Item 1-2 or 1-3.

[0091] (Items 1-7) when the display unit (340) displays the image of the space and the thermal fluid analysis result (160) in an overlapping manner, the display unit (340) displays the airflow flowing out of the air outlet with a line segment along a flow direction, and displays the length of the line segment according to a perspective position in the displayed analysis space (10) so that an airflow closer to a viewpoint is longer and an airflow farther from the viewpoint is shorter. A visualization device (300) for a result of thermal fluid analysis (160) according to Item 1-2 or 1-3.

[0092] (Items 1-8) The display unit (340) displays the line segment by moving it according to the speed of the airflow. A visualization device (300) for the thermal fluid analysis results (160) described in Items 1-7.

[0093] (Item 2-1) A rectangular flat-plate-shaped housing (302) with a side portion as a grip portion; a rectangular display unit (340) provided over the entire surface (304) of the housing (302); an imaging unit (350) having an imaging port on the back surface (306) of the one surface (304); An operation unit (330) for operating an image to be displayed on the display unit (340); Equipped with the display unit (340) displays an image of the space captured by the imaging unit (350) and a result of a thermal fluid analysis (160) in which the space is set as an analysis space (10) in an overlapping manner as AR (Augmented Reality), and displays the operation unit (330) in a superimposed manner on a composite image in which the image of the space and the result of the thermal fluid analysis (160) are superimposed; The operation unit (330) superimposed on the composite image is disposed at a position that allows the operation unit to be operated by a thumb or any of the fingers when the user holds the grip unit with both hands or one hand. A mobile information terminal (300).

[0094] (Item 2-2) The operation unit (330) superimposed on the composite image is disposed at either the lower left end (500) or the lower right end (502) of the display unit (340). The mobile information terminal (300) according to Item 2-1.

[0095] (Item 2-3) The operation unit (330) provided at the lower left end portion (500) of the display unit (340) is a switching button (510, 512, 514, 516, 518) for switching information to be displayed on the display unit (340), The operation unit (330) provided at the lower right end portion (502) of the display unit (340) includes operation control buttons (520, 522, 524) for controlling the operation of the thermal fluid analysis result (160) to be displayed on the display unit (340). The mobile information terminal (300) according to Item 2-2.

[0096] (Item 2-4) The operation unit (330) provided at the lower right end portion (502) of the display unit (340) is a switching button (510, 512, 514, 516, 518) for switching information to be displayed on the display unit (340), The operation unit (330) provided at the lower left end portion (500) of the display unit (340) includes operation control buttons (520, 522, 524) for controlling the operation of the thermal fluid analysis result (160) to be displayed on the display unit (340). The mobile information terminal (300) according to Item 2-2.

[0097] (Item 2-5) The thermal fluid analysis result (160) is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The display unit (340) further includes an indicator (530) that indicates the type of the diffusion material and the state of the airflow, The operation control buttons (520, 522, 524) detect whether a finger touches the display unit (340) within a predetermined time period and are switched between displayed and hidden within the display unit (340); The indicator (530) is always displayed. The mobile information terminal (300) according to item 2-3 or 2-4.

[0098] (Item 2-6) The thermal fluid analysis result (160) is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The display unit (340) further includes an indicator (530) that indicates the type of the diffusion material and the state of the airflow, The indicator (530) is displayed at least at one of the upper right end or the upper left end of the display unit (340). The mobile information terminal (300) according to item 2-3 or 2-4.

[0099] (Item 2-7) The thermal fluid analysis result (160) is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The operation control buttons (520, 522, 524) include an operation button for operating at least one of switching on / off of the dynamic display and resetting the elapsed time from the start of the addition of the diffusing substance to the airflow. The mobile information terminal (300) according to item 2-3 or 2-4.

[0100] (Item 2-8) The thermal fluid analysis result (160) is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The switching buttons (510, 512, 514, 516, 518) include an operation button for operating at least one of switching whether or not the diffusion material is added to the airflow and switching the amount of the diffusion material added to the airflow. The mobile information terminal (300) according to item 2-3 or 2-4.

[0101] (Item 2-9) the display unit (340) detects a gripping position of the housing (302) gripped by a hand, and switches and displays the operation unit (330) so that the position at which the operation unit (330) is superimposed on the composite image is the same as the position of the thumb of the user. The mobile information terminal (300) according to Item 2-2.

[0102] The present disclosure has been described above based on the embodiments. These embodiments are merely illustrative, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component or each treatment process, and that such modifications are also within the scope of the present disclosure. [Explanation of symbols]

[0103] 10 Analysis space, 31 Reference dimension input field, 32 Ceiling height input field, 100 Input terminal, 110 Setting unit, 112 Input unit, 114 Output unit, 120 Processing device, 130 Analysis unit, 132 Acquisition unit, 134 Processing unit, 136 Calculation unit, 138 Judgment unit, 140 Memory unit, 142 Analysis result output unit, 150 Conversion unit, 152 Analysis result acquisition unit, 154 Processing unit, 156 Output unit, 160 Thermal fluid analysis result, 162 AR data, 200 Server, 210 Database, 300 Portable information terminal, 302 Housing, 304 One side, 306 Rear side, 310 Communication unit, 320 Control unit, 330 Operation unit, 340 Display unit, 350 Imaging unit, 352 shooting port, 360 memory unit, 400 data reference button, 402 conversion data input field, 404 conversion button, 410 real space, 420 marker, 430 icon, 500 bottom left end, 502 bottom right end, 510 concentration ON / OFF switch button, 512 airflow display mode switch button, 514 Before / After switch button, 516 Zia addition amount display mode switch button, 518 Nanoe addition amount display mode switch button, 520 concentration play / stop operation control button, 522 Reset operation control button, 524 elapsed time, 530 indicator, 532 diffusion material type indicator, 534 airflow state indicator, 550 air conditioner flow line, 552 diffusion material flow line, 554 nearby flow line, 556 remote flow line, 560 Diffuse substance concentration, 570 Virtual air conditioner, 1000 Visualization system.

Claims

1. A rectangular flat housing having a side edge as a grip portion; A rectangular display unit provided over the entire surface of the housing; an imaging unit having an imaging port on the rear side of the one surface; an operation unit for operating an image to be displayed on the display unit; Equipped with the display unit displays an image of the space captured by the imaging unit and a result of a thermal fluid analysis in which the space is set as an analysis space, superimposed as AR (Augmented Reality), and displays the operation unit superimposed on a composite image in which the image of the space and the result of the thermal fluid analysis are superimposed; The operation unit superimposed on the composite image is disposed at a position where the operation unit can be operated by a thumb or any of the fingers when the grip unit is gripped by both hands or one hand of a user. Mobile information terminal.

2. the operation unit superimposed on the composite image is disposed at either the lower left end or the lower right end of the display unit; 2. The portable information terminal according to claim 1.

3. the operation unit provided at the lower left end of the display unit is a switching button for switching information to be displayed on the display unit, The operation unit provided at the lower right end of the display unit is an operation control button for controlling the operation of the thermal fluid analysis result to be displayed on the display unit.

3. The portable information terminal according to claim 2.

4. the operation unit provided at the lower right end of the display unit is a switching button for switching information to be displayed on the display unit, The operation unit provided at the lower left end of the display unit is an operation control button for controlling the operation of the thermal fluid analysis result to be displayed on the display unit.

3. The portable information terminal according to claim 2.

5. The thermal fluid analysis result is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The display unit further includes an indicator that indicates the type of the diffusing material and the state of the airflow, the operation control button detects whether a finger touches the display unit within a predetermined time period and switches between being displayed and not displayed on the display unit; The indicator is always displayed.

5. The portable information terminal according to claim 3 or 4.

6. The thermal fluid analysis result is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The display unit further includes an indicator that indicates the type of the diffusing material and the state of the airflow, The indicator is displayed at least one of the upper right end or the upper left end of the display unit.

5. The portable information terminal according to claim 3 or 4.

7. The thermal fluid analysis result is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The operation control button includes an operation button for operating at least one of switching on / off of a dynamic display and resetting an elapsed time from the start of adding the diffusing substance to the airflow.

5. The portable information terminal according to claim 3 or 4.

8. The thermal fluid analysis result is a simulation of an airflow flowing out from an air conditioner and a diffusing material contained in the airflow, The switching button includes an operation button for operating at least one of switching whether or not the diffusing material is added to the airflow and switching the amount of the diffusing material added to the airflow.

5. The portable information terminal according to claim 3 or 4.

9. the display unit detects a gripping position of the housing held by a hand, and switches and displays the operation unit so that the position at which the operation unit is superimposed on the composite image is the same position as the thumb of the user.

3. The portable information terminal according to claim 2.

Citation Information

Patent Citations

  • Remote control terminal and air conditioning system

    JP2022179638A