Image processing device, hot-cold sense presentation device, control method for image processing device, and program

Abstract

To provide an image processing device, a hot-cold sense presentation device, a control method for an image processing device, and a program, capable of determining the presence or absence of temperature control for a desired object in an image and having a degree of freedom in a presented temperature control range.SOLUTION: A hot-cold sense presentation device 100 comprises an image data input part 101 in which the image data of an image is entered, an object detection part 104 to detect the object in the image and to identify the type of the object based on the image data, a temperature control determination part 111 to determine whether or not the temperature control for the object occupation area occupied by the object in the image is executed based on the identified result by the object detection part 104, and a temperature determination part 112 to determine the temperature in the area occupied by the object when the execution of the temperature control is determined as the determined result by the temperature control determination part 111.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image processing device, a thermal sensation presentation device, and a control method and program for an image processing device. [Background technology]

[0002] Conventionally, displays capable of displaying images using Peltier elements that can be switched between cooling and heating, arranged in a matrix, have been known (see, for example, Non-Patent Document 1). The display described in Non-Patent Document 1 can cool or heat the display by controlling each Peltier element while an image is being displayed. This allows a user who uses the display to feel cold or warm by touching the display, i.e., a thermal sensation is presented. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Kumiko Kushiyama, Yuki Doi, Shinji Sasada, and Noriaki Baba, "Thermo Drawing: Development of a temperature drawing system using a small tactile display with cold and hot display," Information Processing Society of Japan Interaction 2012, March 16, 2012, pp.723-728 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when the display described in Non-Patent Document 1 performs temperature control (temperature adjustment) of the entire image, even if the user desires to have the warm / cold sensation of a specific object in the image presented, the warm / cold sensation will also be presented in the part where the warm / cold sensation is not desired. Also, depending on various conditions such as the type of a specific object, the temperature control range cannot be freely adjusted or set.

[0005] The present invention has been made in view of the above problems, and aims to provide an image processing device, a thermal sensation presentation device, and a control method and program for the image processing device, which can determine whether or not to control the temperature of a desired object in an image and have a degree of freedom in the control range of the presented temperature. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the image processing device of the present invention is an image processing device capable of processing an image including an object, and is characterized in that it comprises an image data input means for inputting image data of the image, an object detection means for detecting the object in the image based on the image data, a type identification means for identifying the type of the object detected by the object detection means, a control judgment means for determining whether or not to perform temperature control on an object occupied area occupied by the object in the image based on the identification result by the type identification means, and a temperature determination means for determining the temperature of the object occupied area when it is determined as a judgment result by the control judgment means that the temperature control should be performed. Effect of the Invention

[0007] According to the present invention, it is possible to determine whether or not to control the temperature of a desired object in an image, and there is a degree of freedom in the control range of the temperature to be presented. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a hardware configuration of a thermal sensation presentation device according to a first embodiment. FIG. [Diagram 2] 4 is an image diagram for explaining the relationship between image data input to an image data input unit and hot / cold sensation presentation by a hot / cold sensation presentation unit. FIG. [Diagram 3] 13 is a diagram for explaining how a thermal sensation presentation area is linked to temperature data to generate thermal sensation presentation area data. FIG. [Figure 4] 11 is a flowchart showing a cold sensation presentation process executed by the hot / cold sensation presentation device. [Diagram 5]FIG. 11 is a block diagram showing a hardware configuration of a thermal sensation presentation device according to a second embodiment. [Figure 6] 6 is a conceptual diagram showing a state in which the warm / cold sensation providing device shown in FIG. 5 is used. FIG. [Figure 7] FIG. 11 is a block diagram showing a hardware configuration of a thermal sensation presentation device according to a third embodiment. [Figure 8] 8 is a conceptual diagram showing a state in which the thermal sensation providing device shown in FIG. 7 is used. FIG. [Figure 9] FIG. 13 is an external view showing the configuration of a thermal sensation presentation device according to a fourth embodiment. [Figure 10] FIG. 13 is an external view showing the configuration of a thermal sensation presentation device according to a fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Each embodiment of the present invention will be described in detail below with reference to the drawings. However, the configurations described in each of the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in each embodiment. For example, each part constituting the present invention can be replaced with any configuration that can exert a similar function. In addition, any configuration may be added. In addition, any two or more configurations (features) of each embodiment can be combined.

[0010] First Embodiment Hereinafter, the first embodiment will be described with reference to Figs. 1 to 4. Fig. 1 is a block diagram showing a hardware configuration of a hot and cold sensation presentation device according to the first embodiment. In Fig. 1, a hot and cold sensation presentation device (hot and cold sensation presentation device) 100 is a device to which an image processing device capable of processing an image including an object is applied. The hot and cold sensation presentation device 100 has an image data input unit (image data input means) 101, an image memory 102, a preprocessing unit 103, an object detection unit 104, a scene determination unit (scene determination means) 105, an area extraction unit 106, and an authentication unit (authentication means) 107. The hot and cold sensation presentation device 100 also has an object data memory 108, a temperature data table memory (storage means) 109, a temperature control unit 110, a temperature control memory 113, and a hot and cold sensation presentation unit 114. The hot and cold sensation presentation device 100 also has a memory (not shown) for storing various programs. The program is not particularly limited, and includes, for example, a program for causing a computer (CPU) to execute each part and each means (control method of an image processing device) of the thermal sensation presentation device 100.

[0011] Image data of an image is input to the image data input unit 101 (image data input step). The image data input unit 101 has an I / F (interface) for inputting a digital image data signal. This I / F is not particularly limited, and for example, an HDMI (registered trademark) terminal can be used. In this case, the image data input unit 101 receives a video signal conforming to the HDMI standard and extracts image data from the video signal. The image data input unit 101 writes the extracted image data to the image memory 102. Note that the image data input unit 101 may have an I / F into which a memory card capable of reading and writing high-resolution image data at high speed, such as an SD card or a CFexpress card, is inserted and removed. In this case, the image data input unit 101 reads image data recorded in the memory card and writes the image data to the image memory 102. The image memory 102 is, for example, a DRAM or an SRAM, and records image data. The preprocessing unit 103 reads the image data recorded in the image memory 102 and performs image processing on the image data. The image processing is suitable for processing performed by, for example, the object detection unit 104, the scene determination unit 105, the area extraction unit 106, and the authentication unit 107. Note that the image processing also includes gamma correction, shading correction, white balance correction, and the like performed on the YUV signal when the image data is composed of, for example, a YUV signal. Furthermore, when the image data is composed of a pixel pattern of a Bayer array, the image processing may also include demosaic processing that performs color interpolation processing so that one pixel has the values ​​of all RGB components, geometric transformation processing, noise reduction processing, and resizing processing. Furthermore, the preprocessing unit 103 writes the image data on which the image processing has been performed to the image memory 102.

[0012] The object detection unit 104 reads out the image data recorded in the image memory 102, and detects at least one predetermined object from the image based on the image data (object detection process). The object detection unit 104 can also detect the position and size of the object in the image. The object detection unit 104 then identifies the type of object detected in the object detection process (type identification process). The type of object is not particularly limited, and examples include animals such as humans, dogs, cats, birds, and insects, moving objects such as automobiles and airplanes, and still objects such as balls. When an animal, including a human, is identified as the type of object, the body parts of the animal are also identified. For example, when a human is identified, for example, the head, chest, abdomen, arms, legs, and the like are also identified. The object detection unit 104 writes the identification result of the type of object as object data associated with the reliability into the object data memory 108. For the object detection method for detecting an object and the type identification method for identifying the type of object, each of the known methods can be used. The object detection unit 104 may detect an object using machine learning or may identify the type of object using machine learning. In this case, the object detection unit 104 preferably has a GPU, a TPU, or the like. The object detection unit 104 may be configured as a trained class classifier using training data. As a machine learning algorithm, deep learning may be used, but is not limited thereto. For example, a support vector machine, a logistic regression, a decision tree, a random forest, or the like may be used. Such machine learning allows for more accurate object detection and object type identification. In this embodiment, the object detection unit 104 has a function as an object detection means for detecting an object in an image, and a function as a type identification means for identifying the type of object detected by the object detection means. That is, the object detection means and the type identification means are integrated into one object detection unit 104 (unit). This allows the hardware configuration of the warm / cold sensation presentation device 100 to be simplified. The object detection means and the type identification means may be configured as independent units. In this case, hardware (devices) suitable for the object detection means and the type identification means can be used.

[0013] The scene determination unit 105 reads out the image data recorded in the image memory 102, and determines what kind of scene the image is based on the image data. The scene determination unit 105 writes the determination result to the object data memory 108. The scene of the image is not particularly limited, and examples thereof include "indoors", "night scene", "evening scene", "scenery (spring)", "scenery (summer)", "scenery (autumn)", "scenery (winter)", and "backlit". The scene determination unit 105 is configured, for example, with a trained scene classifier that uses training data. The machine learning algorithm in the scene classifier is not particularly limited. The region extraction unit 106 reads out the image data recorded in the image memory 102, and detects at least one region of a predetermined type based on the image data. For each detected region, the region extraction unit 106 writes map information that maps the region occupying the image and the type of the region (for example, sky, human skin, grass, etc.) as region data to the object data memory 108. The region extraction unit 106 is configured, for example, with a trained region map generator that uses training data. The machine learning algorithm in the region map generator is not particularly limited.

[0014] The authentication unit 107 can authenticate the type of the object identified by the object detection unit 104. Specifically, the authentication unit 107 writes authentication data required for authentication in the object data memory 108 in advance, and reads the object data written by the object detection unit 104 from the object data memory 108. Then, when the object data has the type of the object that is the authentication target, the authentication unit 107 reads the authentication data from the object data memory 108. In addition to reading the authentication data, the authentication unit 107 cuts out the area of ​​the object that is the authentication target from the image data recorded in the image memory 102 and reads it as authentication target data. The authentication unit 107 performs object authentication by calculating the degree of agreement between the authentication data and the authentication target data, and writes the authentication result in the object data memory 108. The calculation of the degree of agreement between the authentication data and the authentication target data is not particularly limited. For example, the total amount of the difference absolute value of each pixel value between the authentication data and the authentication target data is calculated as the degree of agreement. If this total amount is less than a predetermined threshold, it is determined that the two data match each other. For example, if the type of object is a human face, the positions of the human's eyes, nose, mouth, etc. are extracted by a part extractor, and the degree of match between the positions of these parts and the positions of the parts in the authentication data is calculated. In addition, when the same object is photographed from multiple viewpoints and multiple image data are obtained, the three-dimensional shape of the object can be calculated based on these image data, and the degree of match can be calculated from the difference between the structure of the authentication data and the structure of the authentication target. In addition, the machine learning algorithm in the authentication unit 107 is not particularly limited. The object data memory 108 is, for example, a DRAM or an SRAM, and records, for example, information (data) about the object, information about the scene, information about the area, and the result of object authentication.

[0015] The temperature data table memory 109 is, for example, a DRAM or an SRAM, and stores temperature information related to the temperature for each type of object as a table. For example, the temperature information is 36 degrees when the type of object is "human", 38 degrees when the type of object is "dog", and 40 degrees when the type of object is "bird". For example, when the type of object is a high-temperature object such as "fireworks", the temperature information is stored as 50 degrees. The temperature data table memory 109 also stores temperature information related to the temperature for each scene determined by the scene determination unit 105 as a table. For example, the temperature information for each scene is 15 degrees when the scene is "night scene", 20 degrees when the scene is "evening scene", and 25 degrees when the scene is "indoors". The temperature data table memory 109 also stores temperature information related to the temperature for each type of area detected by the area extraction unit 106 as a table. For example, the temperature information for each type of area is 15 degrees when the type of area is "sky", 36 degrees when the type of area is "human skin", and 24 degrees when the type of area is "grass".

[0016] The temperature control unit 110 has a temperature control determination unit (control determination means) 111 and a temperature determination unit (temperature determination means) 112. The temperature control determination unit 111 reads out from the object data memory 108 the object data written by the object detection unit 104 to the object data memory 108. The temperature control determination unit 111 determines whether or not to execute temperature control for an object-occupied area occupied by an object in an image based on the identification result of the type of object included in this object data (control determination step). When it is determined that temperature control is to be executed as a result of the determination by the temperature control determination unit 111, the temperature determination unit 112 determines the temperature of the object-occupied area based on the temperature information stored in the temperature data table memory 109 (temperature determination step). In addition, the temperature determination unit 112 writes information related to the determined temperature into the temperature control memory 113. The warm / cold sensation presentation unit 114 presents, i.e., conveys, a sense of warm / cold to the user who uses the warm / cold sensation presentation device 100. The thermal sensation presentation unit 114 can read out the determined temperature written in the temperature control memory 113 from the temperature control memory 113 and reflect it in thermal sensation presentation.

[0017] FIG. 2 is an image diagram for explaining the relationship between image data input to the image data input unit and the warm / cold sensation presentation in the warm / cold sensation presentation unit. As shown in FIG. 2, the warm / cold sensation presentation unit 114 has a warm / cold sensation presentation area 304 that presents a warm / cold sensation. In the warm / cold sensation presentation area 304, a plurality of warm / cold sensation presentation elements 305, for example, made of Peltier elements, are arranged in a matrix (eight rows vertically and seven columns horizontally in the configuration shown in FIG. 2). On the other hand, the input image data 301 input to the image data input unit is data of an image including a person 303 and a tree 300. In the input image data 301, a rectangular person area 302 in which the person 303 is inscribed is acquired. In addition, the warm / cold sensation presentation unit 114 can scale the entire angle of view of the input image data 301 to the warm / cold sensation presentation area 304. At this time, in the warm / cold sensation presentation area 304, a person-corresponding area 306 is formed at a position corresponding to the person area 302, with the same aspect ratio relationship as the person area 302 being maintained. Then, a human hot / cold sense presentation region 307 is set, which is composed of the hot / cold sense presentation elements 305 overlapping at least a part of the human corresponding region 306. The human hot / cold sense presentation region 307 corresponds to an object occupying region in the image, and the temperature control determination unit 111 determines whether or not to execute temperature control, that is, whether or not to set the human hot / cold sense presentation region 307 as a target region for temperature control. When the human hot / cold sense presentation region 307 is set as a target region for temperature control, the temperature in the human hot / cold sense presentation region 307 is determined by the temperature determination unit 112. In the example shown in FIG. 2, the human hot / cold sense presentation region 307 is a region that presents the hot / cold sense of the human 303, so the temperature is determined to be 36 degrees. The user can feel the temperature (body temperature) of the human 303 by touching the human hot / cold sense presentation region 307 with a finger 308.

[0018] FIG. 3 is a diagram for explaining how the hot and cold sensation presentation area data is created by linking the hot and cold sensation presentation area with the temperature data. The hot and cold sensation presentation unit 401 shown in FIG. 3 is the hot and cold sensation presentation unit 114. The hot and cold sensation presentation unit 401 has a plurality of hot and cold sensation presentation elements 402 arranged in a matrix (eight rows vertically and seven columns horizontally in the configuration shown in FIG. 3) on the back side of the hot and cold sensation presentation unit 401. In this embodiment, the coordinates (0,0) to (7,6) are assigned to each hot and cold sensation presentation element 402 from the upper left to the lower right in FIG. 3. Each hot and cold sensation presentation element 402 is composed of, for example, a Peltier element, and can be cooled and heated by electrical control. This allows the temperature to be adjusted for each hot and cold sensation presentation element 402, and therefore a hot and cold sensation can be presented for each hot and cold sensation presentation element 402. In this manner, the plurality of hot and cold sensation presentation elements 402 constitute a hot and cold sensation presentation area 405 that presents a hot and cold sensation. The hot and cold sense presentation unit 401 can scale the entire angle of view of the input image data (for example, the input image data 301) to the entire hot and cold sense presentation region 405. In this case, the temperature control unit 110 calculates which coordinates of the hot and cold sense presentation element 402 in the hot and cold sense presentation region 405 correspond to the object region occupied by the object read from the input image data. The temperature control unit 110 assigns the temperature data of the object to the hot and cold sense presentation element 402 with the corresponding coordinates. For example, when the person-corresponding region 403 as the object region is a rectangular region surrounded by a dashed line in FIG. 3, the hot and cold sense presentation elements 402 overlapping at least a part of the person-corresponding region 403 are the hot and cold sense presentation elements 402 with coordinates (4,3), to (4,6), and (5,3) to (5,6). The hot / cold sense presentation elements 402 at the coordinates (4,3), to (4,6), and (5,3) to (5,6) constitute a human hot / cold sense presentation area 404. The temperature information "36 degrees" of the object type "person" read from the temperature data table memory 109 and determined by the temperature determination unit 112 is assigned to each of the hot / cold sense presentation elements 402 constituting the human hot / cold sense presentation area 404.

[0019] In this embodiment, the warm / cold sensation presentation unit 401 has a display 406 arranged on the front side of the warm / cold sensation presentation unit 401. The display 406 is not particularly limited, and may be, for example, an organic electroluminescence display or a liquid crystal display. As a result, the warm / cold sensation presentation unit 401 has a function as a display means for displaying input image data as an image, and can display an image including a human 407, for example, as shown in FIG. 3. The human corresponding area 403 is an area in which the human 407 is inscribed. In addition, each warm / cold sensation presentation element 402 functions as a temperature adjustment means for adjusting the temperature of the human 407 displayed on the display 406 to the temperature determined by the temperature determination unit 112. As a result, the user can feel the temperature of the human 407 by touching the warm / cold sensation presentation element 402 constituting the human warm / cold sensation presentation area 404 with a finger (body).

[0020] The display 406 (the hot / cold sense presentation unit 401) may visualize and display the temperature of the human hot / cold sense presentation region 404 on an image. This "visualization and display" is not particularly limited, but it is preferable to, for example, increase the density of red as the temperature of the human hot / cold sense presentation region 404 increases, and increase the density of blue as the temperature of the human hot / cold sense presentation region 404 decreases. This allows the body temperature to be visually grasped by viewing the display 406 without touching the human hot / cold sense presentation region 404. The display 406 may visualize and display the degree of deviation between the temperature of the human hot / cold sense presentation region 404 (object-occupied region) and the average body temperature of a human (animal) on an image. The "visualization and display" here is not particularly limited, but it is preferable to increase the density of red when the human hot / cold sense presentation region 404 deviates from the average body temperature in a temperature increasing direction, for example. Conversely, when the human hot / cold sensation presentation area 404 deviates from the average body temperature in the direction of decreasing temperature, it is preferable to increase the density of blue. As a result, when the temperature of the human 407 is higher than the average body temperature of humans due to heat stroke or the like, the human 407 can visually recognize that the body temperature is higher without touching the human hot / cold sensation presentation area 404 by visually checking the display 406. Also, for example, when an image includes multiple objects and object areas overlap in the hot / cold sensation presentation area 405, the object area may be assigned temperature information of the object with a higher temperature or the object with a lower temperature. Also, temperature information of objects based on the priority order of object types may be assigned. The priority order of object types may be determined arbitrarily in advance.

[0021] The warm / cold sensation presentation device 100 has a setting means (not shown) for setting in advance the type of object that can be a temperature control target by the warm / cold sensation presentation unit 114. As a result, for example, in the case of an image including a human 303 and a tree 300 as shown in Fig. 2, the type of object that can be a temperature control target can be set to the human 303, not the tree 300. The setting means is not particularly limited, and examples thereof include an operation unit that performs an operation to input various information, commands, etc. to the warm / cold sensation presentation device 100.

[0022] As described above, the temperature control determination unit 111 of the temperature control unit 110 reads out the object data written in the object data memory 108 by the object detection unit 104 from the object data memory 108. Then, the temperature control determination unit 111 determines whether or not to execute temperature control for the object-occupied area in the image based on the identification result of the type of object included in this object data, that is, the identification result by the object detection unit 104. In this determination, the temperature control determination unit 111 determines to execute temperature control when the type of object identified by the object detection unit 104 matches the type of object previously set by the setting means. In addition, when executing temperature control, the temperature control determination unit 111 calculates which area of ​​the warm / cold sensation presentation area of ​​the warm / cold sensation presentation unit 114 the object-occupied area occupied by the object corresponds to, based on the position and size of the object in the image that can be a temperature control target. The temperature control determination unit 111 determines the warm / cold sensation presentation area to be the temperature control target based on the calculation result. On the other hand, if the type of object identified by the object detection unit 104 does not match the type of object previously set by the setting means, the temperature control determination unit 111 determines not to execute temperature control. In addition, the temperature control determination unit 111 outputs information related to the type of object to the temperature determination unit 112. Based on this information, the temperature determination unit 112 outputs temperature data related to the type of object to the temperature control determination unit 111. As a result, the temperature control determination unit 111 receives the temperature data related to the type of object from the temperature determination unit 112, associates the temperature data with the thermal sensation presentation area, and writes them into the temperature control memory 113 as data for temperature control.

[0023] In this embodiment, the determination of whether or not to execute temperature control for the object-occupied region is performed based on whether the type of object identified by the object detection unit 104 matches the type of object previously set by the setting means, but is not limited thereto. For example, the determination may be performed based on whether the type of object identified by the object detection unit 104 is authenticated by the authentication unit 107. Specifically, the authentication unit 107 reads out the result of the object authentication written in the object data memory 108. If the authentication unit 107 determines that the authentication is successful, that is, the type of object identified by the object detection unit 104 is authenticated by the authentication unit 107, the temperature control determination unit 111 determines that the temperature control is to be executed. Following this determination, the temperature determination unit 112 also makes a determination. On the other hand, if the authentication unit 107 determines that the authentication is not successful, that is, the type of object identified by the object detection unit 104 is not authenticated by the authentication unit 107, the temperature control determination unit 111 may determine that the temperature control is not to be executed. The determination as to whether or not to execute temperature control based on the authentication result by the authentication unit 107 may be arbitrarily set by the thermal sensation presentation device 100.

[0024] The temperature data table memory 109 stores temperature data listed for each type of object. The temperature determination unit 112 reads out the temperature data for each type of object from the temperature data table memory 109 based on the type of object input from the temperature control determination unit 111. The temperature determination unit 112 outputs the read-out temperature data to the temperature control determination unit 111. Note that the thermal sensation presentation device 100 may further include a temperature data input unit in the image data input unit 101 that inputs temperature data corresponding to the entire angle of view of image data from outside the thermal sensation presentation device 100, for example. The temperature determination unit 112 may extract temperature data of the object region from the temperature data input through the temperature data input unit and output it to the temperature control determination unit 111. In addition, when the temperature data is composed of multiple temperature data inside the object region, a smoothing process may be performed on the multiple temperature data to obtain one temperature data, and the temperature data may be output to the temperature control determination unit 111. Also, different temperature data may be output for each warm / cold sensation presentation element 402 (see FIG. 3), that is, for each coordinate. Also, the warm / cold sensation presentation device 100 may have a temperature inference device that infers the temperature of a specific type of object that has been learned using learning data. In this case, input image data may be input to the temperature inference device, and temperature data that is an inference result obtained by the temperature inference device may be output to the temperature control determination unit 111 as temperature data of the object. In the case where there are multiple acquisition means for acquiring temperature data, such as extraction from input temperature data, reading of temperature data from a temperature data list, inference by a temperature inference device, etc., the acquisition means may be appropriately switched according to the type of object input from the temperature control determination unit 111. For example, when the type of object is "person", temperature data is acquired by inference by the temperature inference device. When the type of object is "dog" or "cat", temperature data is extracted from the input temperature data. When the type of object is "fireworks", temperature data is read from a temperature data table list. By switching the means of acquiring temperature data based on the type of object input from the temperature control judgment unit 111, it becomes possible to acquire more accurate temperature data even in cases where accurate temperature data cannot be acquired depending on the type of object, for example.In this way, when determining the temperature of the object-occupied area, the temperature determination section 112 can change the temperature determination method depending on the type of object to determine an appropriate temperature.

[0025] In addition, when the temperature determination unit 112 determines the temperature of the object occupancy area, it can set at least one of the upper limit and the lower limit of the temperature according to the type of object. For example, in the case of a high-temperature object such as "fireworks", the temperature of the object is 370 degrees for sparklers and 1100 degrees or more for balloon fireworks. If the thermal sensation providing element 305 is composed of a Peltier element, it is practically impossible to output such a high temperature. Even if it were possible to output a high temperature, the user would not be able to touch it. Therefore, in the case of a high-temperature object, it is preferable to set an upper limit on the temperature of the object. This allows the thermal sensation providing element 305 to adjust the temperature and allows the user to touch it. The upper limit depends on the type of object, but for example, when the type of object is "fireworks", it can be 50 degrees. The upper limit for each type of object is stored in advance in the temperature data table memory 109. In the temperature determination unit 112, the lower limit can be set in the same way as the upper limit of the temperature. Furthermore, when determining the temperature, a temperature between the upper limit and lower limit of the temperature that can be output by the warm / cold sensation providing element 305 may be used. For example, if the upper limit of the temperature that can be output by the warm / cold sensation providing element 305 is 40 degrees, the temperature may be uniformly set to 40 degrees for objects whose temperature exceeds 40 degrees. Furthermore, if the upper limit of the temperature that can be output by the warm / cold sensation providing element 305 is 5 degrees, the temperature may be uniformly set to 5 degrees for objects whose temperature is less than 5 degrees.

[0026] As described above, the scene determination unit 105 determines what kind of scene the image is, and writes the determination result to the object data memory 108. The temperature control determination unit 111 reads the determination result by the scene determination unit 105, i.e., scene information on what kind of scene the image is, from the object data memory 108, and outputs it to the temperature determination unit 112. The temperature determination unit 112 outputs temperature information of the scene based on the information read from the object data memory 108 to the temperature control determination unit 111. This allows the temperature control determination unit 111 to receive the temperature information of the scene from the temperature determination unit 112. In this case, the temperature control determination unit 111 may have a scene temperature generation function that acquires an offset temperature of the entire thermal sensation presentation area in the thermal sensation presentation unit 114 based on the temperature information of the scene, and writes it to the temperature control memory 113. As a result, for example, when the entire thermal sensation presentation area is an object area, an offset process is performed to add or subtract the temperature of the scene to the temperature data of the object. In addition, both the temperature data of the object and the temperature data of the scene may be reflected in the object region (the entire thermal sensation presentation region). In addition, for example, when the entire thermal sensation presentation region is the object region, the temperature of the scene may be ignored.

[0027] Furthermore, the temperature determination unit 112 may determine the temperature of the object-occupied area based on the determination result by the scene determination unit 105. Specifically, when the scene temperature generation function is enabled, the temperature determination unit 112 reads out temperature data prepared for each scene from the temperature data table memory 109 based on the scene information from the temperature control determination unit 111. The temperature determination unit 112 reflects the read temperature data in the temperature of the object-occupied area.

[0028] The temperature control determination unit 111 outputs the region data read from the object data memory 108 to the temperature determination unit 112. The temperature control determination unit 111 receives temperature information as a specific type region from the temperature determination unit 112. In this case, the temperature control determination unit 111 may have a region temperature generation function that writes the temperature information of the specific type region as an offset temperature to the temperature control memory 113. Thereby, for example, when the specific type region overlaps with the object region, an offset process is performed in which the temperature of the specific type region is added to or subtracted from the temperature data of the object. In addition, both the temperature data of the object and the temperature data of the specific type region may be reflected in the object region. For example, when the specific type region overlaps with the object region, the temperature of the specific type region may be ignored. When the region temperature generation function is enabled, the temperature determination unit 112 reads out the temperature data prepared for each type region in the temperature data table memory 109 based on the region data received from the temperature control determination unit 111. The temperature determination unit 112 reflects the read temperature data in the temperature of the object occupation region.

[0029] 4 is a flowchart showing a cold sensation presentation process executed by the hot / cold sensation presentation device 100. As shown in FIG.

[0030] In step S201, the pre-processing unit 103 reads the image data written in step S200 from the image memory 102, and performs image processing suitable for object detection processing in which the object detection unit 104 detects at least one predetermined object from the image. The pre-processing unit 103 writes the image data after image processing into the image memory 102.

[0031] In step S202, the object detection unit 104 reads the image data written in step S201 from the image memory 102 and performs object detection processing.

[0032] In step S203, object detection unit 104 judges whether or not at least one object has been detected. If it is judged in step S203 that an object has been detected, object detection unit 104 writes the detection result (position, size, etc. of the detected object) in object data memory 108, and the process proceeds to step S204. On the other hand, if it is judged in step S203 that an object has not been detected, the process ends.

[0033] In step S204, the object detection unit 104 identifies the type of the object detected in step S203, and writes the identification result in the object data memory .

[0034] In step S205, the temperature control determination unit 111 reads the identification result written in step S204 from the object data memory 108, and determines whether the type of object as the identification result matches the type of object to be subjected to the predetermined thermal sensation presentation control. If the result of the determination in step S205 indicates that they match, the process proceeds to step S206. On the other hand, if the result of the determination in step S205 indicates that they do not match, the process proceeds to step S207.

[0035] In step S206, the temperature determination unit 112 receives information about the type of object from the temperature control determination unit 111. The temperature determination unit 112 also reads out temperature data for the corresponding type of object from the list of temperature data in the temperature data table memory 109, and outputs it to the temperature control determination unit 111. The temperature control determination unit 111 associates the temperature data with the thermal sensation presentation area of ​​the corresponding object, and writes it in the temperature control memory 113.

[0036] In step S207, the temperature control determination unit 111 determines whether or not the processes in steps S204 to S206 have been completed for all objects detected by the object detection unit 104. If it is determined in step S207 that the processes have been completed, the process proceeds to step S208. On the other hand, if it is determined in step S207 that the processes have not been completed, the process returns to step S204, and the subsequent steps are executed in sequence.

[0037] In step S208, the temperature control unit 110 reads out temperature data associated with each hot / cold sensation presentation area from the temperature control memory 113, and controls each hot / cold sensation presentation area of ​​the hot / cold sensation presentation unit 114 to the corresponding temperature. This allows the user of the hot / cold sensation presentation device 100 to receive a hot / cold sensation by touching the hot / cold sensation presentation unit 401 with a finger, a palm, or the like.

[0038] In the above-described warm / cold sense presentation device 100, it is possible to determine whether or not to perform temperature control only for the object-occupied area occupied by the desired object to be temperature-controlled in the image. Then, as a result of this determination, when it is determined that temperature control is to be performed, it is possible to determine the temperature of only the object-occupied area. As a result, it is possible to grasp the temperature of the desired object in the image by touching the object-occupied area in the warm / cold sense presentation unit 401. Furthermore, regardless of the type of object, the temperature control range in the object-occupied area can be set freely, for example, by restricting the upper and lower limits of the temperature. Furthermore, in the warm / cold sense presentation device 100, the temperature control determination unit 111 can set a plurality of object-occupied areas. In this case, the temperature control determination unit 111 determines whether or not to perform temperature control for each object-occupied area. Then, the temperature determination unit 112 can determine the temperature for each object-occupied area. With this configuration, for example, when an animal including a human is identified as the type of object, the temperature control determination unit 111 can set an object-occupied area for each part of the animal's body (for example, the head, chest, etc.) and determine whether or not to perform temperature control for each object-occupied area. Then, the temperature determination unit 112 can determine the temperature of each object-occupied area set for each part of the body. This makes it possible to grasp the temperature of each part of the body, that is, to grasp which part of the body is hot or cold.

[0039] <Second embodiment> Hereinafter, the second embodiment will be described with reference to FIG. 5 and FIG. 6. The differences from the above-mentioned embodiment will be mainly described, and the description of the similar matters will be omitted. This embodiment is the same as the first embodiment except that the configurations of the temperature control unit and the hot and cold sensation presentation unit are different. FIG. 5 is a block diagram showing the hardware configuration of the hot and cold sensation presentation device according to the second embodiment. As shown in FIG. 5, the hot and cold sensation presentation device 500 has an image data input unit 501, an image memory 502, a pre-processing unit 503, an object detection unit 504, and an object data memory 508. In addition, the hot and cold sensation presentation device 500 has a temperature data table memory 509, a temperature control unit 510, a temperature control memory 513, and a hot and cold sensation presentation unit 514. The image data input unit 501 is the same as the image data input unit 101 in the first embodiment, the image memory 502 is the same as the image memory 102, and the pre-processing unit 503 is the same as the pre-processing unit 103, so the description of these will be omitted. Moreover, since object detection unit 504 is the same as object detection unit 104, and object data memory 508 is the same as object data memory 108, their descriptions will be omitted. Furthermore, temperature data table memory 509 is the same as temperature data table memory 109, and temperature control memory 513 is the same as temperature control memory 113, their descriptions will be omitted.

[0040] FIG. 6 is an image diagram showing a state in which the hot and cold sensation presentation device shown in FIG. 5 is used. As shown in FIG. 6, when using the hot and cold sensation presentation device 500, the user wears a head-mounted display (display means) 706. The head-mounted display 706 displays a virtual reality space 701 as an image. This allows the user to visually recognize a human 702, which is an object in the virtual reality space 701. The virtual reality space 701 is an image obtained from image data input to the image data input unit 501. The hot and cold sensation presentation unit 514 is a glove-shaped hot and cold sensation presentation unit 703 that can be worn on the hand of a user who visually recognizes the human 702 in the virtual reality space 701. The hot and cold sensation presentation unit 703 may be in the form of a ring that can be worn on a fingertip, for example, and the form is not limited to the above. In other words, the form is not limited to this as long as it is a shape that can present a hot and cold sensation to the user's hand or finger. A Peltier element as a temperature adjusting means for adjusting the temperature to the temperature determined by temperature control unit 510 is disposed in glove-shaped thermal sensation presenting unit 703, and comes into contact with the user's fingers, palm, back of the hand, etc. Temperature control unit 510 has a function capable of calculating the position and size of virtual reality space 701 and determining whether the user is touching human 702 or not.

[0041] In a state where the user wears the head mounted display 706 and the thermal sensation presentation unit 703, the user can touch a human 702 in a virtual reality space 701 displayed on the head mounted display 706 via the thermal sensation presentation unit 703. At that time, if the temperature control for the object type "human" is set to be enabled in advance, the temperature control unit 510 judges whether or not the user's finger 704 is touching the human 702. Then, if it is judged that the finger 704 is touching the human 702, the temperature control unit 510 reads out the temperature data of the object type "person" from the temperature data table memory 509. The temperature control unit 510 performs temperature control of the Peltier element arranged in the thermal sensation presentation unit 703 so that the finger 704 can feel the temperature of the object type "person". As a result, the temperature of the human 702 can be grasped by touching the human 702 with the finger 704. On the other hand, if it is judged that the finger 704 is not touching the human 702, the temperature control unit 510 does not perform temperature control of the Peltier element.

[0042] The method of determining whether the finger 704 is touching the human 702 is not particularly limited. For example, invisible laser light is irradiated from the head mounted display 706, and the reflected light from the finger 704 is received by a sensor of the head mounted display 706. This allows the temperature control unit 510 to measure the distance from the head mounted display 706 to the finger 704. Then, based on the difference between the distance and angle from the pupil position 705 of the user converted to any coordinate in the virtual reality space 701 to the finger 704 and the distance and angle from the pupil position 705 to the human 702, it becomes possible to determine whether the finger 704 is touching the human 702. For example, if the difference is within a certain numerical value, the temperature control unit 510 determines that the finger 704 is touching the human 702. On the other hand, if the difference is not within a certain numerical value, the temperature control unit 510 determines that the finger 704 is not touching the human 702.

[0043] The temperature control unit 510 may control the thermal sensation presentation in the thermal sensation presentation unit 703, taking into account the attenuation of temperature according to the distance between the finger 704 and the human 702. For example, a state in which the finger 704 (thermal sensation presentation unit 703) is touching the human 702 is set to 100%. Also, a state in which the finger 704 is not touching the human 702 but is relatively close is set to 0%. The temperature may be changed linearly according to the distance between 0% and 100%. For example, when the distance is 0%, no temperature control is performed, and when the distance has changed to 100%, the temperature is increased linearly by performing temperature control.

[0044] <Third embodiment> Hereinafter, the third embodiment will be described with reference to FIG. 7 and FIG. 8. The differences from the above-mentioned embodiment will be mainly described, and the description of the similar matters will be omitted. This embodiment is similar to the second embodiment except that the hot and cold sense presentation device has an object generation unit and a display unit. FIG. 7 is a block diagram showing the hardware configuration of the hot and cold sense presentation device according to the third embodiment. As shown in FIG. 7, the hot and cold sense presentation device 600 has an object generation data input unit 601, an object data memory 608, a temperature data table memory 609, a temperature control unit 610, a temperature control memory 613, a hot and cold sense presentation unit 614, an object generation unit 615, and a display unit 616. FIG. 8 is an image diagram showing a usage state of the hot and cold sense presentation device shown in FIG. 7. As shown in FIG. 8, in this embodiment, as in the second embodiment, when using the hot and cold sense presentation device 600, the user wears a head mounted display (display means) 806. The head mounted display 806 displays a virtual reality space 800 including a polygon object (three-dimensional image) 801 as an image. This allows the user to visually recognize a polygon object 801 in the virtual reality space 800. In this embodiment, the polygon object 801 is a human being. Similarly to the second embodiment, the temperature / cold sensation presentation unit 614 is a glove-shaped temperature / cold sensation presentation unit 802 that can be worn on the user's hand. The shape of the temperature / cold sensation presentation unit 802 may be, for example, a ring-shaped one that can be worn on the fingertip, and is not limited to the above-mentioned shape. In other words, the shape is not limited to this as long as it is capable of presenting a temperature / cold sensation to the user's hand or finger.

[0045] The object generation data input unit (image data input means) 601 has an I / F for inputting three-dimensional object generation data (image data) from the outside. This I / F is not particularly limited, and may be, for example, an I / F into which a memory card capable of reading and writing data at high speed, such as an SD card or a CFexpress card, can be inserted and removed. The object generation data input unit 601 reads out three-dimensional object generation data recorded in a memory card and writes the data to an object data memory 608. The "three-dimensional object generation data" is, for example, data including local three-dimensional coordinates of each polygon vertex for generating multiple polygons constituting an object (e.g., polygon object 801), which is an object. This data also includes texture mapping coordinates for applying texture to each polygon surface, texture data, material data for each polygon surface, object type information for determining the temperature of the object, and the like.

[0046] The object generating unit 615 generates a polygon object 801 to be displayed in the virtual reality space 800 based on the three-dimensional object generating data. The display unit 616 performs rendering processing on the polygon object 801 generated by the object generating unit 615, and displays the processing result (rendering result) as image data. As a result, the polygon object 801 is displayed in the virtual reality space 800 on the head mounted display 806, and the user can visually recognize the polygon object 801. In this embodiment, the temperature control unit 610 has a function as an object detection means for detecting the polygon object 801 and a function as a type identification means for identifying the type of the polygon object 801. Note that, in the thermal sensation presentation device 600, the object generating unit 615 may have a function as an object detection means and a function as a type identification means. In addition, the temperature control unit 610 has a function capable of calculating the position and size of the virtual reality space 800 and determining whether or not the user is touching the polygon object 801.

[0047] A user wearing a head mounted display 806 and a thermal sensation presentation unit 802 can touch a polygon object 801 in a virtual reality space 800 displayed on the head mounted display 806 via the thermal sensation presentation unit 802. At that time, if the temperature control for the object type "human" is enabled in advance, the temperature control unit 610 judges whether or not the user's finger 803 is touching the polygon object 801. Then, if it is judged that the finger 803 is touching the polygon object 801, the temperature control unit 610 reads out the temperature data of the object type "person" from the temperature data table memory 609. The temperature control unit 610 controls the temperature of the Peltier element arranged in the thermal sensation presentation unit 802 so that the finger 803 can feel the temperature of the object type "person". As a result, the temperature of the human can be grasped by touching the polygon object 801 with the finger 803. On the other hand, if it is determined that the finger 803 is not touching the polygon object 801, the temperature control unit 610 does not control the temperature of the Peltier element.

[0048] The method of determining whether or not the finger 803 is touching the polygon object 801 is not particularly limited. For example, invisible laser light is irradiated from the head mounted display 806, and the reflected light from the finger 803 is received by a sensor of the head mounted display 806. This allows the temperature control unit 610 to measure the distance from the head mounted display 806 to the finger 803. Then, a positional relationship between the finger position coordinates generated from the distance and angle from the user's pupil position 804 to the finger 803, which are converted into arbitrary coordinates in the virtual reality space 800, and the inner coordinates of the polygon object 801 in the virtual reality space 800 is acquired. Based on this positional relationship, it is possible to determine whether or not the polygon object 801 is touched. For example, when the finger position coordinates are located at the inner coordinates, it is determined that the polygon object 801 is touched. On the other hand, when the finger position coordinates are not located at the inner coordinates, it is determined that the polygon object 801 is not touched.

[0049] Furthermore, when the temperature of the temperature data associated with the polygon object 801 is lower than, for example, 20 degrees, the display unit 616 may notify that the polygon object 801 is cold when displaying the polygon object 801 after the rendering process. The notification method is not particularly limited, and examples thereof include a method of drawing an effect and a method of displaying a notification frame around the polygon object 801. Other notification methods include a method of drawing a notification icon near the polygon object 801, a method of displaying a notification message, a method of emitting a sound, and the like. By such notification, the user can know that the polygon object 801 is cold before touching the polygon object 801. Furthermore, when the temperature of the temperature data associated with the polygon object 801 is higher than, for example, 40 degrees, the display unit 616 may notify that the polygon object 801 is hot when displaying the polygon object 801 after the rendering process. This notification method is not particularly limited, and examples of the notification method include a method of drawing an effect and a method of displaying a notification frame around the polygon object 801. Other notification methods include a method of drawing a notification icon near the polygon object 801, a method of displaying a notification message, a method of emitting a sound, etc. By such notification, the user can know that the polygon object 801 is hot before touching it.

[0050] <Fourth embodiment> Hereinafter, the fourth embodiment will be described with reference to FIG. 9. The differences from the above-mentioned embodiment will be mainly described, and the description of the similar matters will be omitted. This embodiment is similar to the first embodiment except that the configuration of the warm / cold sense presentation unit is different. FIG. 9 is an external view showing the configuration of a warm / cold sense presentation device according to the fourth embodiment. As shown in FIG. 9, the warm / cold sense presentation device 90 has a screen (display means) 901 and a projector (image projection device) 907 arranged at a distance from the screen 901. The screen 901 may be omitted from the configuration of the warm / cold sense presentation device 90. In this case, the screen 901 is prepared separately from the warm / cold sense presentation device 90. The projector 907 irradiates, that is, projects, an image 904 obtained from input image data onto the screen 901. As a result, the image 904 is displayed on the screen 901. The image 904 includes a human 903 and a tree 900. This screen 901 is a warm / cold sensation presentation unit 114 having a plurality of Peltier elements (warm / cold sensation presentation elements 305) arranged in a matrix on the back side. The position of the screen 901 is adjusted relative to the projection angle of the projector 907. The part of the screen 901 that overlaps with a person 903 becomes a temperature control target, and the temperature is adjusted. While visually recognizing the person 903 projected on the screen 901, the user can feel the temperature corresponding to the person 903 by touching the part of the screen 901 that corresponds to the person 903.

[0051] <Fifth embodiment> Hereinafter, the fifth embodiment will be described with reference to FIG. 10. The differences from the above-mentioned embodiment will be mainly described, and the description of the similar matters will be omitted. This embodiment is similar to the first embodiment except that the configuration of the warm / cold sense presentation unit is different. FIG. 10 is an external view showing the configuration of a warm / cold sense presentation device according to the fifth embodiment. As shown in FIG. 10, the warm / cold sense presentation device 10 has a warm / cold sense presentation unit 1005 and a printing unit 1007. The printing unit 1007 may be omitted from the configuration of the warm / cold sense presentation device 10. In this case, the printing unit 1007 is prepared separately from the warm / cold sense presentation device 90. In addition, it is preferable that the printing unit 1007 is connected to the warm / cold sense presentation device 90 so as to be able to communicate with it. The printing unit 1007 outputs (prints out) a printed matter 1008 in which an image 1004 obtained from input image data is printed on a sheet 1001. As a result, the image 1004 is displayed on the sheet 1001. The image 1004 includes a human 1003 and a tree 1000.

[0052] The hot / cold sensation presentation unit 1005 is a hot / cold sensation presentation unit 114 having a plurality of Peltier elements (hot / cold sensation presentation elements 305) arranged in a matrix on the front side. Each Peltier element of the hot / cold sensation presentation unit 1005 may be convex. The hot / cold sensation presentation device 10 is used by superimposing a printed matter 1008 on the hot / cold sensation presentation unit 1005. The hot / cold sensation presentation unit 1005 preferably has a detection unit that detects that the printed matter 1008 has been superimposed, and a positioning unit that performs positioning with the printed matter 1008. The portion of the hot / cold sensation presentation unit 1005 that overlaps with the person 1003 becomes a temperature control target and is temperature-adjusted. The user can feel the temperature corresponding to the person 1003 by touching the person 1003 on the printed matter 1008 while visually recognizing the person 1003 on the printed matter 1008.

[0053] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by a process in which a program that realizes one or more functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors of a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. In addition, in each of the above-mentioned embodiments, the hot and cold sensation presentation device 100 is an example of an application of the image processing device, but this is not limited thereto, and examples include a hot and cold sensation presentation device that has an image processing device built in. Other application examples include a system having an image processing device and a hot and cold sensation presentation device that is configured separately from the image processing device and receives temperature information generated by the image processing device to present a hot and cold sensation.

[0054] The disclosure of each embodiment includes the following configurations, methods, and programs. (Configuration 1) An image processing device capable of processing an image including an object, comprising: an image data input means for inputting image data of the image; an object detection means for detecting the object in the image based on the image data; a type identification means for identifying a type of the object detected by the object detection means; a control determination means for determining whether or not to execute temperature control for an object occupying area in the image occupied by the object based on a result of the classification by the type classification means; and a temperature determination means for determining a temperature of the object-occupied area when it is determined by the control determination means that the temperature control is to be executed. (Configuration 2) A setting means for setting the type of the object in advance is provided, The image processing device according to configuration 1, characterized in that the control determination means determines to execute the temperature control when the type of the object identified by the type identification means matches the type of the object previously set by the setting means, and determines not to execute the temperature control when the type of the object identified by the type identification means does not match the type of the object previously set by the setting means. (Configuration 3) The control determination means is capable of setting a plurality of the object occupying regions, and determines whether or not to execute the temperature control for each of the object occupying regions; 3. The image processing device according to claim 1, wherein the temperature determining means is capable of determining a temperature for each of the object-occupied regions. (Configuration 4) A storage means for storing in advance temperature information relating to temperatures for each type of object, 4. The image processing device according to any one of configurations 1 to 3, wherein the temperature determining means determines the temperature of the object-occupied area based on the temperature information. (Configuration 5) The image processing device according to any one of configurations 1 to 4, characterized in that, when determining the temperature of the object-occupied area, the temperature determination means is capable of changing a method of determining the temperature depending on the type of the object. (Configuration 6) An image processing device described in any one of configurations 1 to 5, characterized in that the temperature determination means, when determining the temperature of the object-occupied area, is capable of setting at least one of an upper limit and a lower limit of the temperature depending on the type of the object. (Configuration 7) A scene determination means for determining a scene of the image is provided, 7. The image processing device according to any one of configurations 1 to 6, wherein the temperature determining means determines the temperature of the object-occupied area based on a result of the determination by the scene determining means. (Configuration 8) When the type identification means identifies an animal including a human as the type of the object, the control determination means sets the object occupancy area for each part of the animal's body and determines whether or not to execute the temperature control; 8. The image processing device according to any one of configurations 1 to 7, wherein the temperature determination means is capable of determining the temperature of each of the object-occupied regions set for each part of the body. (Configuration 9) A display means for displaying the image is provided, The image processing device according to configuration 8, wherein the display means is capable of displaying on the image a degree of deviation between the temperature of each object-occupied area determined by the temperature determination means and an average body temperature of the animal. (Configuration 10) A display means for displaying the image is provided, 10. The image processing device according to any one of configurations 1 to 9, wherein the display means is capable of displaying on the image an indication corresponding to the temperature of the object-occupied area determined by the temperature determination means. (Configuration 11) A display means for displaying the image; 11. The image processing device according to any one of configurations 1 to 10, further comprising: a temperature adjustment means for adjusting a temperature of the image displayed on the display means to a temperature of the object-occupied area determined by the temperature determination means. (Configuration 12) The image processing device according to configuration 11, wherein the temperature adjustment means is configured to be wearable on the body of a user who uses the display means. (Configuration 13) The image processing apparatus according to configuration 11 or 12, wherein the display means displays a virtual reality space as the image. (Configuration 14) The image processing apparatus according to any one of configurations 11 to 13, wherein the display means displays a three-dimensional image as the image. (Configuration 15) The image processing apparatus according to any one of configurations 11 to 13, wherein the display means projects the image onto a screen and displays the image on the screen. (Configuration 16) The image processing apparatus according to any one of configurations 11 to 13, wherein the display means displays the image by printing it on a sheet. (Configuration 17) A method for authenticating the type of the object identified by the type identification means, The image processing device according to any one of configurations 1 to 16, characterized in that when the type of the object identified by the type identification means is authenticated by the authentication means, a judgment is made by the control judgment means and a decision is made by the temperature determination means. (Configuration 18) The image processing device according to any one of configurations 1 to 17, wherein the object detection means detects the object using machine learning. (Configuration 19) The image processing device according to any one of configurations 1 to 18, wherein the type identification means identifies the type of the object using machine learning. (Configuration 20) The image processing device according to any one of configurations 1 to 19, wherein the object detection means and the type identification means are configured together in a single unit, or are configured in units independent of each other. (Configuration 21) A thermal sensation presentation device comprising the image processing device according to any one of configurations 1 to 20. (Method 1) A method for controlling an image processing device capable of processing an image including an object, comprising the steps of: an image data input step of inputting image data of the image; an object detection step of detecting the object in the image based on the image data; a type identification step of identifying the type of the object detected in the detection step; a control determination step of determining whether or not to execute temperature control for an object occupying area in the image occupied by the object based on a result of the type identification step; A control method for an image processing device, comprising: a temperature determination step of determining a temperature of the object-occupied area when it is determined in the control determination step that the temperature control is to be performed. (Program 1) A program for causing a computer to execute each of the means of the image processing device according to any one of configurations 1 to 19. [Explanation of symbols]

[0055] 100 Temperature / cold sensation presentation device 101 Image data input unit (image data input means) 104 Object detection unit 105 Scene judgment unit (scene judgment means) 107 Authentication section (authentication means) 109 Temperature Data Table Memory 111 Temperature control determination unit (control determination means) 112 Temperature determining section (temperature determining means) 114 Thermal sensation presentation section

Claims

1. An image processing apparatus capable of processing images containing objects, One or more processors, When executed by the one or more processors, the one or more processors Image data input means into which the image data of the aforementioned image is input, Based on the image data, an object detection means for detecting the object in the image, A type identification means for identifying the type of object detected by the object detection means, A determination means that determines whether or not to perform temperature control on the object-occupied region of the image based on the identification result of the type identification means, An image processing apparatus comprising: a memory that stores an instruction to function as a temperature determination means for determining the temperature of the object occupied area when the determination means determines, as a result of the determination, that the temperature control should be performed.

2. The memory stores instructions that, when executed by the one or more processors, cause the one or more processors to function as setting means for pre-setting the type of object. The image processing apparatus according to claim 1, characterized in that the determination means determines to perform the temperature control when the type of object identified by the type identification means matches the type of object preset by the setting means, and determines not to perform the temperature control when the type of object identified by the type identification means does not match the type of object preset by the setting means.

3. The aforementioned determination means can set multiple object-occupied regions and determines whether or not to perform the temperature control for each object-occupied region. The image processing apparatus according to claim 1, characterized in that the temperature determination means is capable of determining the temperature for each object-occupied region.

4. The system includes a storage means that has pre-stored temperature information relating to the temperature of each type of object, The image processing apparatus according to claim 1, wherein the temperature determination means determines the temperature of the object-occupied region based on the temperature information.

5. The image processing apparatus according to claim 1, characterized in that the temperature determination means can change the method of acquiring the temperature data according to the type of object when determining the temperature of the object-occupied area.

6. The image processing apparatus according to claim 1, characterized in that the temperature determination means can set at least one of the upper and lower limits of the temperature according to the type of object when determining the temperature of the object-occupied region.

7. The memory stores instructions that, when executed by the one or more processors, cause the one or more processors to function as a scene determination means for determining the scene of the image. The image processing apparatus according to claim 1, characterized in that the temperature determination means determines the temperature of the object-occupied region based on the determination result of the scene determination means.

8. The determination means, when the type identification means identifies an animal, including a human, as the type of object, determines whether or not to set the object-occupied area for each part of the animal's body and perform the temperature control. The image processing apparatus according to claim 1, characterized in that the temperature determination means is capable of determining the temperature of each object-occupied region set for each part of the body.

9. The system includes a display means for displaying the aforementioned image, The image processing apparatus according to claim 8, characterized in that the display means is capable of displaying on the image the degree of discrepancy between the temperature of each object occupied region determined by the temperature determination means and the average body temperature of the animal.

10. The system includes a display means for displaying the aforementioned image, The image processing apparatus according to claim 1, characterized in that the display means is capable of displaying information corresponding to the temperature of the object occupied region determined by the temperature determination means on the image.

11. A display means for displaying the aforementioned image, The image processing apparatus according to claim 1, further comprising: a temperature adjustment means for adjusting the temperature of the image displayed on the display means to the temperature of the object occupied region determined by the temperature determination means.

12. The image processing apparatus according to claim 11, characterized in that the temperature adjustment means is configured to be attachable to the body of a user utilizing the display means.

13. The image processing apparatus according to claim 11, characterized in that the display means displays a virtual reality space as the image.

14. The image processing apparatus according to claim 11, characterized in that the display means displays a three-dimensional image as the image.

15. The image processing apparatus according to claim 11, characterized in that the display means projects the image onto a screen and displays it on the screen.

16. The image processing apparatus according to claim 11, characterized in that the display means displays the image by printing it on a sheet.

17. The system includes authentication means capable of authenticating the type of object identified by the type identification means, The image processing apparatus according to claim 1, characterized in that when the type of object identified by the type identification means is authenticated by the authentication means, a determination is made by the determination means and a determination is made by the temperature determination means.

18. The image processing apparatus according to claim 1, characterized in that the object detection means detects the object using machine learning.

19. The image processing apparatus according to claim 1, characterized in that the type identification means identifies the type of object using machine learning.

20. The image processing apparatus according to claim 1, characterized in that the object detection means and the type identification means are configured as a single unit or as independent units.

21. A thermal sensation presentation device characterized by comprising the image processing device described in claim 1.

22. A method for controlling an image processing apparatus capable of processing images containing objects, The image data input process involves inputting the image data of the aforementioned image, An object detection step is performed to detect the object in the image based on the image data, A type identification step for identifying the type of object detected in the object detection step, A determination step, based on the identification result in the type identification step, determines whether or not to perform temperature control on the object-occupied region of the image occupied by the object, A control method for an image processing apparatus, characterized by comprising: a temperature determination step, which determines the temperature of the object-occupied region when it is determined as a result of the determination step that the temperature control should be performed; and a temperature determination step, which determines the temperature of the object-occupied region.

23. A program for causing a computer to execute each of the means of the image processing apparatus described in claim 1.

Images