Risk display device, risk display method and program

Abstract

A risk display device (10) has an image data acquisition unit (111), an identification unit (112), a measurement unit (113), a connecting line setting unit (114), a person icon generation unit (115), an image generation unit (116), and an output unit (117). The image data acquisition unit (111) acquires image data from a camera. The identification unit (112) identifies a plurality of persons from the image data. The measurement unit (113) measures the distance between the persons. The connecting line setting unit (114) sets an appearance of a connecting line corresponding to the distance. The person icon generation unit (115) generates person icons indicating the persons on the basis of the image data. The image generation unit (116) generates a risk image in which the plurality of person icons are connected to each other via the connecting lines. The output unit (117) outputs risk image data related to the risk image.

Description

[Technical field]

[0001] The present invention relates to a risk display device, a risk display method, and a non-transitory computer readable medium. [Background technology]

[0002] Various techniques have been proposed for determining the risk of infection of each person against an infectious disease when multiple people come into contact with each other.

[0003] For example, Patent Document 1 describes a technology for identifying gaze areas indicating the area gazed upon by each of multiple subjects who are present in a specified area and who may belong to a group, and for estimating the group based on the gaze areas of each of the identified multiple subjects.

[0004] Patent document 2 describes a technology that identifies the strength of infection-related relationships between rooms based on people's infection information and people's movement information between rooms, and displays information indicating the strength of the infection-related relationships between the identified rooms on a map.

[0005] Patent Document 3 describes a technique for displaying the extent of infection impact in a medical facility based on a person's movement route obtained from round information and the person's infection risk level. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2020-091622 A [Patent Document 2] JP 2018-169938 A [Patent Document 3] JP 2016-184196 A Summary of the Invention [Problem to be solved by the invention]

[0007] The above-mentioned technology displays the relationships between people and the risk of infection according to certain rules. However, the actual risk of infection is difficult to determine quantitatively, and in many cases the above content cannot be used to properly determine it.

[0008] The present disclosure has been made in consideration of such problems, and aims to provide a risk display device etc. that can centrally display multiple infection risks. [Means for solving the problem]

[0009] A risk display device according to one embodiment of the present disclosure has an image data acquisition means, a person identification means, a measurement means, a connection line setting means, a person icon generation means, an image generation means, and an output means. The image data acquisition means acquires image data from a camera. The person identification means identifies a plurality of people from the image data. The measurement means measures the distance between the people. The connection line setting means sets the appearance of a connection line corresponding to the distance. The person icon generation means generates a person icon representing the person based on the image data. The image generation means generates a risk image in which a plurality of the person icons are connected to each other via connection lines. The output means outputs risk image data related to the risk image.

[0010] In a risk display method according to an embodiment of the present disclosure, a computer executes the following method: the computer acquires image data from a camera; the computer identifies a plurality of people from the image data; the computer measures distances between the people; the computer sets an appearance of a connecting line corresponding to the distance; the computer generates a person icon representing the person based on the image data; the computer generates a risk image in which the plurality of person icons are connected to each other via the connecting lines; and the computer outputs risk image data related to the risk image.

[0011] A program according to an embodiment of the present disclosure causes a computer to execute the following steps: The computer acquires image data from a camera. The computer identifies a plurality of people from the image data. The computer measures distances between the people. The computer sets an appearance of a connecting line corresponding to the distance. The computer generates a person icon representing the person based on the image data. The computer generates a risk image in which the plurality of person icons are connected to each other via the connecting lines. The computer outputs risk image data related to the risk image. Effect of the Invention

[0012] According to the present disclosure, it is possible to provide a risk display device etc. that can centrally display multiple infection risks. [Brief description of the drawings]

[0013] [Figure 1] FIG. 2 is a block diagram of a risk display device according to the first embodiment. [Diagram 2] 4 is a flowchart showing a risk display method according to the first embodiment. [Diagram 3] FIG. 11 is a block diagram of a risk display system according to a second embodiment. [Figure 4] FIG. 11 is a diagram showing an example of a risk image generated by the risk display device according to the second embodiment. [Diagram 5] 13 is a flowchart showing a risk display method according to a third embodiment. [Figure 6] FIG. 11 is a diagram showing a first example of a risk image generated by the risk display device according to the third embodiment. [Figure 7] FIG. 11 is a diagram showing a second example of a risk image generated by the risk display device according to the third embodiment. [Figure 8] FIG. 13 is a block diagram of a risk display device according to a fourth embodiment. [Figure 9] 13 is a flowchart showing a risk display method according to a fourth embodiment. [Figure 10]FIG. 13 is a diagram showing an example of an image displayed by the risk display device according to the fourth embodiment. [Figure 11] FIG. 13 is a block diagram of a risk display system according to a modified example of the fourth embodiment. [Figure 12] FIG. 2 is a block diagram illustrating a hardware configuration of a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] The present invention will be described below through the embodiments of the invention, but the invention according to the claims is not limited to the following embodiments. In addition, not all of the configurations described in the embodiments are necessarily essential as means for solving the problems. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In each drawing, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary.

[0015] <Embodiment 1> Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram of a risk display device 10 according to the first embodiment. The risk display device 10 is a device for displaying the infection risk of each person against an infectious disease based on the contact situation between multiple people present in a specified facility, for example. The risk display device 10 is communicatively connected to a camera that captures the scenery inside the facility. The risk display device 10 is also communicatively connected to a specified display device that displays a risk image. The risk display device 10 mainly includes an image data acquisition unit 111, an identification unit 112, a measurement unit 113, a connection line setting unit 114, a person icon generation unit 115, an image generation unit 116, and an output unit 117. These components of the risk display device 10 are appropriately communicatively connected.

[0016] The image data acquisition unit 111 acquires image data generated at multiple different times by a camera installed to capture scenery within a specified facility. For example, the camera generates image data of about 15 frames, 30 frames, or 60 frames per second, and the image data acquisition unit 111 acquires the image data generated by the camera every 1 / 15, 1 / 30, or 1 / 60 seconds. For example, the image data may be acquired from one or more cameras connected to the image data acquisition unit 111. Furthermore, the camera connected to the image data acquisition unit 111 may be fixed to capture a specified angle of view, or may be movable to pan, tilt, or zoom. The image data acquisition unit 111 supplies the image data acquired from the camera to each component as appropriate.

[0017] The identification unit 112 receives the image data acquired by the image data acquisition unit 111, and identifies a person by detecting an image of a person (person image) included in the received image data. The identification unit 112 searches for an area having a feature amount matching the feature amount of the person image by, for example, performing a convolution process on the image data. The identification unit 112 then determines that the area matching the feature amount of the person image is a person image. When the image related to the image data includes multiple people, the identification unit 112 identifies each of the multiple people included in the image. The identification unit 112 supplies information about the identified person to the measurement unit 113. The information about the identified person includes, for example, position information of the person in the image.

[0018] The measurement unit 113 acquires image data from the image data acquisition unit 111, acquires information about people from the identification unit 112, and then measures the distances between the people. As a result, the measurement unit 113 holds information about the distances between multiple people. The measurement unit 113 supplies the connection line setting unit 114 with information about the identified person and information about the measured distances for that person.

[0019] The connection line setting unit 114 sets the appearance of the connection line based on the information on the distance received from the measurement unit 113. The connection line in this embodiment is a symbol for indicating the distance between two people. The connection line setting unit 114 sets the appearance of the connection line in a manner that allows the user to visually recognize the appearance of the connection line and grasp the distance between the people included in the image data. The appearance of the connection line includes, for example, any one of the length, thickness, color tone, or line type of the connection line.

[0020] More specifically, the connection line setting unit 114 may indicate the distance between people by the length of the connection line, for example. However, the appearance of the connection line set by the connection line setting unit 114 is not limited to the specific example described above. When the connection line setting unit 114 sets the appearance of the connection line, it supplies information related to this setting to the image generating unit 116.

[0021] The person icon generating unit 115 generates a person icon representing a person by using the image data received from the image data acquiring unit 111. For example, the person icon generating unit 115 extracts an image of the specified person and generates a person icon by using the extracted image. The person image extracted by the connection line setting unit 114 is, for example, an image of the person's face (face image). Note that the person icon may include text data. The person icon generating unit 115 supplies information on the generated person icon to the image generating unit 116.

[0022] The image generation unit 116 receives information on the appearance of the connection lines from the connection line setting unit 114, and also receives information on the person icons from the person icon generation unit 115. Then, the image generation unit 116 generates a risk image from the received information. The image generation unit 116 supplies the generated risk image to the output unit 117.

[0023] A risk image is an image in which a plurality of person icons are connected to each other via connection lines. More specifically, a risk image is an image in which two person icons are connected by a predetermined connection line. That is, in the risk image, the person icons represent photographed people, and the connection lines connecting the person icons represent the relationship between the people related to the two person icons connected by the connection lines. By displaying the risk image, the risk display device 10 shows the contact situation between people to a user viewing the risk image.

[0024] The output unit 117 receives risk image data from the image generation unit 116, and outputs the received risk image data to a display device to which the risk display device 10 is connected.

[0025] Next, the processing executed by the risk display device 10 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the risk display method according to the first embodiment. The risk display device 10 starts, for example, when a user who uses the risk display device 10 performs an operation to instruct the start of the risk display method.

[0026] First, the image data acquisition unit 111 acquires a plurality of image data from the camera (step S11). The image data acquisition unit 111 may temporarily store image data for a predetermined period and then supply the image data to other components. The predetermined period may be, for example, 10 minutes, 30 minutes, or 60 minutes.

[0027] Next, the identification unit 112 judges whether or not multiple people have been identified from the image data (step S12). If it is not judged that multiple people have been identified from the image data (step S12: NO), the risk display device 10 returns to step S11 and acquires new image data (step S11). If it is judged that multiple people have been identified from the image data (step S12: YES), the risk display device 10 proceeds to step S13.

[0028] In step S13, the measurement unit 113 measures the distances between the people from the image data (step S13). Note that the positions of the people in the image data may vary over time. Therefore, the measurement unit 113 may calculate predetermined statistical values, such as an average value or a minimum value, regarding the distances between the people. The measurement unit 113 supplies information regarding the measured distances between the identified people to the connection line setting unit 114.

[0029] Next, the connection line setting unit 114 sets the appearance of the connection line corresponding to the distance (step S14). After setting the appearance of the connection line, the connection line setting unit 114 supplies the set information to the image generating unit .

[0030] Next, the person icon generating unit 115 generates a person icon by using, for example, an image of a person included in the image data (step S15). The person icon generating unit 115 supplies information on the generated person icon to the image generating unit .

[0031] Next, the image generating unit 116 generates a risk image by using the information received from the connection line setting unit 114 and the information received from the person icon generating unit 115 (step S16).

[0032] Next, the output unit 117 outputs risk image data related to the risk image (step S17). When the output unit 117 outputs the risk image, the risk display device 10 ends a series of processes.

[0033] The risk display device 10 according to the first embodiment has been described above. The risk display device 10 has a processor and a storage device as components not shown. The storage device of the risk display device 10 includes a storage device including a non-volatile memory such as a flash memory or an SSD (Solid State Drive). In this case, the storage device of the risk display device 10 stores a computer program (hereinafter also simply referred to as a program) for executing the above-mentioned risk display method. The processor also reads the computer program from the storage device into a buffer memory such as a DRAM (Dynamic Random Access Memory) and executes the program.

[0034] Each of the components of the risk display device 10 may be realized by dedicated hardware. In addition, a part or all of each component may be realized by a general-purpose or dedicated circuit, processor, etc., or a combination of these. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. A part or all of each component of each device may be realized by a combination of the above-mentioned circuits, etc., and a program. In addition, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), etc. can be used as a processor. The description of the configuration described here may also be applied to other devices or systems described below in this disclosure.

[0035] Furthermore, when some or all of the components of the risk display device 10 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be arranged in a centralized or distributed manner. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., in a form in which each is connected via a communication network. Furthermore, the functions of the risk display device 10 may be provided in a SaaS (Software as a Service) format.

[0036] The first embodiment has been described above. The risk display device 10 according to the first embodiment, with the above-mentioned configuration, displays the contact status between people included in the image data captured by the camera. The risk image output by the risk display device 10 includes information on the distance between people. Therefore, a user viewing the risk image can intuitively grasp the contact status between people. For example, when one person is infected with an infectious disease, there is a demand to determine the infection risk of other people who have come into contact with the infected person. In response to such a demand, the risk display device 10 can present the contact status between people. That is, according to this embodiment, it is possible to provide a risk display device or the like that can centrally display the infection risks that occur in a complex manner.

[0037] <Embodiment 2> Next, a description will be given of a second embodiment. Fig. 3 is a block diagram of a risk display system according to the second embodiment. Fig. 3 shows a risk display system 1. The risk display system 1 includes a risk display device 10, a display 200, and a camera 300.

[0038] The risk display device 10 in this embodiment is communicatively connected to the camera 300 via the communication network N1, and acquires image data generated by the camera 300. The risk display device 10 is also communicatively connected to the display 200. The risk display device 10 generates a risk image from the image data acquired from the camera 300, and outputs the generated risk image to the display 200.

[0039] The display 200 is a display device including, for example, a liquid crystal display or an organic electroluminescence display. The display 200 is communicatively connected to the risk display device 10, receives image data related to a risk image from the risk display device 10, and displays the received image data. In the example shown in FIG. 3, the risk display device 10 and the display 200 are connected without going through the communication network N1, but they may be connected through the communication network N1. By visually checking the risk image displayed on the display 200, the user of the risk display system 1 can grasp the contact situation of the person included in the image captured by the camera 300.

[0040] The camera 300 is fixed at a predetermined position in the facility 900, and captures the scenery of the facility 900. The camera 300 is communicatively connected to the risk display device 10 via a communication network N1. As shown in the figure, for example, the camera 300 captures a scene in which a first person P1, a second person P2, a third person P3, and a fourth person P4 exist with an angle of view indicated by a dotted line, generates image data, and supplies it to the risk display device 10.

[0041] Next, a description will be given of the difference between the risk display device 10 in this embodiment and embodiment 1. In the risk display device 10 in this embodiment, the measurement unit 113 measures the distance between people and measures the time corresponding to this distance.

[0042] In this embodiment, the measurement unit 113 acquires image data from the image data acquisition unit 111, acquires information about people from the identification unit 112, and then measures the distances between the people and the time corresponding to these distances. As a result, the measurement unit 113 holds information about the distances between multiple people and the time elapsed at each distance. The measurement unit 113 supplies the connection line setting unit 114 with information about the identified person, as well as information about the measured distance and time for that person.

[0043] The connection line setting unit 114 sets the appearance of the connection line based on the information on distance and time received from the measurement unit 113. The connection line in this embodiment is a symbol for indicating the distance between two people and the time elapsed at that distance. The connection line setting unit 114 sets the appearance of the connection line in a manner that allows the user to visually recognize the appearance of the connection line and grasp the distance between the people included in the image data and the time elapsed at that distance. The appearance of the connection line includes, for example, any of the length, thickness, color tone, or line type of the connection line.

[0044] More specifically, the connection line setting unit 114 may indicate the distance between people by the length of the connection line, for example. Alternatively, the connection line setting unit 114 may indicate the length of time it takes to travel the distance between people by the thickness of the connection line, for example. However, the appearance of the connection line set by the connection line setting unit 114 is not limited to the specific example described above. When the connection line setting unit 114 sets the appearance of the connection line, it supplies information related to this setting to the image generation unit 116.

[0045] Next, a description will be given of the processing performed by the risk display device 10 in this embodiment that differs from that in embodiment 1. The risk display device 10 in this embodiment differs from embodiment 1 in the processing of step S13 in the flowchart described in FIG.

[0046] In step S13, the measurement unit 113 measures the distance between people and the time corresponding to the distance from the image data (step S13). Note that the position of the person in the image data may vary over time. Therefore, the measurement unit 113 may calculate a predetermined statistical value, such as an average value or a minimum value, regarding the distance between people. Similarly, the measurement unit 113 may calculate, for example, the passage of time within a predetermined distance range regarding the time at the distance of the person. The measurement unit 113 supplies information regarding the distance and information regarding the time measured for the identified person to the connection line setting unit 114.

[0047] With the above-mentioned configuration, the risk display device 10 measures the distance between each of the first person P1, the second person P2, the third person P3, and the fourth person P4 from the positions of the first person P1, the second person P2, the third person P3, and the fourth person P4 photographed by the camera 300. The risk display device 10 also measures the time associated with each distance between the first person P1, the second person P2, the third person P3, and the fourth person P4 from the image data acquired from the camera 300. The risk display device 10 then generates a risk image from the above-mentioned information, and outputs image data related to the generated risk image to the display 200.

[0048] Next, a risk image generated by the risk display device 10 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of a risk image generated by the risk display device 10 according to the second embodiment. Fig. 4 shows a contact situation with the first person P1 at the center for the first person P1, the second person P2, the third person P3, and the fourth person P4 shown in Fig. 3.

[0049] 4 shows a risk image R11. The risk image R11 includes a first icon P11, a second icon P21, a third icon P31, and a fourth icon P41. The first icon P11 is an icon indicating the first person P1. Similarly, the second icon P21 indicates the second person P2, the third icon P31 indicates the third person P3, and the fourth icon P41 indicates the fourth person P4. The person icon generating unit 115 extracts face images of the first person P1 to the fourth person P4 from the image data captured by the camera 300, respectively, to generate the first icon P11 to the fourth icon P41.

[0050] In Fig. 4, the first icon P11 and the second icon P21 are connected by a connection line L12. The connection line L12 indicates the contact state between the first person P1 and the second person P2. Specifically, the length D12 of the connection line L12 indicates the distance between the first person P1 and the second person P2. That is, the closer the distance between the first person P1 and the second person P2, the shorter the length D12 of the connection line L12 is displayed. Also, the farther the distance between the first person P1 and the second person P2, the longer the length D12 of the connection line L12 is displayed.

[0051] The width W12 of the connecting line L12 indicates the time that the first person P1 and the second person P2 were present at a distance corresponding to the length D12. In other words, the longer the time that the first person P1 and the second person P2 were present at a distance corresponding to the length D12, the thicker the width W12 of the connecting line L12 is displayed. The shorter the time that the first person P1 and the second person P2 were present at a distance corresponding to the length D12, the thinner the width W12 of the connecting line L12 is displayed.

[0052] The first icon P11 and the third icon P31 are connected by a connection line L13. The connection line L13 indicates the contact state between the first person P1 and the third person P3. Specifically, the length D13 of the connection line L13 indicates the distance between the first person P1 and the third person P3. The width W13 of the connection line L13 indicates the time during which the first person P1 and the third person P3 are at a distance corresponding to the length D13.

[0053] Similarly, the first icon P11 and the fourth icon P41 are connected by a connection line L14. The connection line L14 indicates the contact state between the first person P1 and the fourth person P4. Specifically, the length D14 of the connection line L14 indicates the distance between the first person P1 and the fourth person P4. The width W14 of the connection line L14 indicates the time during which the first person P1 and the fourth person P4 are present at a distance corresponding to the length D14.

[0054] The length and thickness of the connecting lines in the risk image R11 are set so that a user who views the risk image can easily understand the contact situation between people. The length of the connecting lines in the risk image R11 may be, for example, a reduced display of the distance measured by the measurement unit 113, or may be a distance measured by the measurement unit 113 multiplied by a predetermined coefficient.

[0055] The thickness of the connection line set by the connection line setting unit 114 corresponds to the cumulative time when the distance between the two people becomes closer than a predetermined threshold. The thickness of the connection line in the risk image R11 may be displayed as a thickness proportional to the time measured by the measurement unit 113, for example, or may be a thickness obtained by multiplying the time measured by the measurement unit 113 by a predetermined coefficient.

[0056] The risk image R11 shown in FIG. 4 has been described above. The connection line setting unit 114 in this embodiment sets the length of the connection line corresponding to the distance between people and the thickness of the connection line corresponding to time. The risk display device 10 may be set to generate the above-mentioned risk image only when the distance between people is smaller than a predetermined threshold. With this configuration, the risk display device 10 can generate a risk image according to the infection risk.

[0057] The length of the connection line set by the connection line setting unit 114 in this embodiment may correspond to the average value of the distance between two people when the distance between them is closer than a predetermined threshold. Also, the length of the connection line set by the connection line setting unit 114 may correspond to the minimum value of the distance between two people when the distance between them is closer than a predetermined threshold. Also, the risk display device 10 may be configured to be able to switch the content indicated by the length of the connection line in the risk image according to a user request. This allows the risk display device 10 to display the contact situation desired by the user.

[0058] As described above, the image generating unit 116 selects one person icon as a selected icon and arranges other person icons around the selected icon. In the example shown in Fig. 4, the selected icon is the first icon P11, and the other person icons are the second icon P21, the third icon P31, and the fourth icon P41. By visually recognizing the risk image R11, the user can intuitively grasp the contact situation between the first person P1 and other people (i.e., the second person P2, the third person P3, and the fourth person P4) existing around the first person P1.

[0059] When the image generating unit 116 receives a process for selecting one of the other person icons, the image generating unit 116 may arrange the selected person icon as a selected icon. For example, in FIG. 4, when the user performs an operation for selecting the second icon P21, the image generating unit 116 receives a process for selecting the second icon P21. In this case, the image generating unit 116 switches to a risk image that displays a contact situation between the second person P2 related to the second icon P21 and other people existing around the second person P2.

[0060] The above describes the second embodiment. As described above, the risk display device 10 can grasp the contact situation between the person related to the selected icon and other people around him / her in an integrated manner. In other words, according to the present embodiment, it is possible to provide a risk display device or the like that can display multiple infection risks in an integrated manner.

[0061] <Embodiment 3> Next, a description will be given of embodiment 3. In embodiment 3, the target measured by measurement unit 113 and the display mode of the risk image are different from the above-mentioned embodiments.

[0062] The measurement unit 113 in this embodiment measures the distance between people identified from the image data, the time corresponding to this distance, and the position and face direction of each person. That is, the measurement unit 113 measures the face direction of each person when the distance between two people is closer than a predetermined threshold. The measurement unit 113 holds information on the distance between each of multiple people, the time elapsed at that distance, and the position and face direction of the person. The measurement unit 113 supplies this information on the identified people to the connection line setting unit 114 and the image generation unit 116.

[0063] In this embodiment, the image generating unit 116 receives information on the position and face direction of each person from the measuring unit 113, in addition to information on the appearance of the connection line and information on the person icon. Then, the image generating unit 116 generates a risk image from the received information. That is, the image generating unit 116 arranges the person icon based on the face direction. More specifically, the image generating unit 116 arranges the positions of other person icons to be arranged around the selection icon based on a relative angle with respect to the face direction of the selection icon. The image generating unit 116 may also arrange the face direction of other person icons to be arranged around the selection icon based on a relative angle with respect to the face direction of the selection icon.

[0064] The above-mentioned relative angle and face direction may change over time when the person icons are closer than the above-mentioned threshold value. Therefore, the image generating unit 116 calculates the relative angle between the person icons and the face direction based on predetermined statistical values ​​such as the average value or the angle that remained the longest.

[0065] In addition, when generating a risk image, the image generating unit 116 in this embodiment extracts the distance between the person related to the selected icon and the people around it, and generates a risk image when the distance is less than a preset threshold. The image generating unit 116 supplies the generated risk image to the output unit 117.

[0066] Next, the processing performed by the risk display device 10 according to the third embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing a risk display method according to the third embodiment. The flowchart shown in Fig. 5 differs from the flowchart shown in Fig. 2 in that it has step S31 instead of step S13. The flowchart shown in Fig. 5 will be described below, focusing on the differences from the flowchart shown in Fig. 2.

[0067] In this embodiment, in the process (step S12) of determining whether the identification unit 112 has identified multiple people from the image data, if it is determined that multiple people have been identified from the image data (step S12: YES), the risk display device 10 proceeds to step S31.

[0068] In step S31, the measurement unit 113 measures the distance between people and the time corresponding to the distance from the image data. The measurement unit 113 also measures the position and face direction of a person identified in the image data (step S31). The measurement unit 113 supplies information on the distance between people and the time corresponding to the distance from among the measured information to the connection line setting unit 114. The measurement unit 113 also supplies information on the position and face direction of the identified person from among the measured information to the image generation unit 116.

[0069] After the above-mentioned processing, in step S17 in this embodiment, the image generating unit 116 generates a risk image taking into account the person's position and face direction.

[0070] An example of a risk image generated by the risk display device 10 will be described with reference to Fig. 6. Fig. 6 is a diagram showing a first example of a risk image generated by the risk display device according to the third embodiment. Fig. 6 shows a risk image R21. In the risk image R21, the first icon P11 is selected as the selected icon and is positioned in the center.

[0071] The first icon P11 is arranged such that the face of the first person P1 is extracted and the front of the facial image faces upward in the figure. That is, the upper side of the figure shows the front of the first person P1 related to the first icon P11. The lower side of the figure shows the rear of the first person P1 related to the first icon P11. Similarly, the right side of the figure shows the right side of the first person P1 related to the first icon P11, and the left side of the figure shows the left side of the first person P1 related to the first icon P11.

[0072] A circle C21 drawn with a dotted line is shown around the first icon P11. The first icon P11 is placed at the center of this circle C21. There is a distance D10 between the first icon P11 and the outer edge of the circle C21. The distance D10 corresponds to a distance threshold Dth preset in the facility 900. The image generating unit 116 displays, inside the circle C21, person icons of people who are around the first person P1 at a distance less than the threshold Dth.

[0073] In Fig. 6, the second icon P21, the third icon P31, and the fourth icon P41, which are related to other people, are arranged around the first icon P11. The second icon P21 is connected to the first icon P11 by the connection line L12 described in Fig. 4. Similarly, the third icon P31 is connected to the first icon P11 by the connection line L13, and the fourth icon P41 is connected to the first icon P11 by the connection line L14. In addition, the second icon P21, the third icon P31, and the fourth icon P41 are arranged at positions corresponding to the relative positional relationship with the first person P1 in the facility 900.

[0074] For example, the second person P2 associated with the second icon P21 was in front of the first person P1 in the facility 900. Therefore, the second icon P21 is disposed in front of the first icon P11. Similarly, the third person P3 was located to the right rear of the first person P1 in the facility 900. Therefore, the third icon P31 is disposed to the right rear of the first icon P11. The fourth person P4 was located to the left in front of the first person P1 in the facility 900. Therefore, the fourth icon P41 is disposed to the left in front of the first icon P11.

[0075] With the above-mentioned configuration, the risk display device 10 generates a risk image indicating the distance, time, and direction between the selected icon and other person icons.

[0076] With reference to Fig. 7, another example of a risk image generated by the risk display device 10 will be described. Fig. 7 is a diagram showing a second example of a risk image generated by the risk display device according to the third embodiment. Fig. 7 shows a risk image R22. The risk image R22 differs from the risk image R21 in Fig. 6 in that the face directions of other person icons present around the first icon P11, which is the selected icon, are also displayed.

[0077] For example, the second person P2 related to the second icon P21 was present in front of the first person P1 in the facility 900 and was mainly facing the first person P1. Therefore, the second icon P21 was placed in front of the first icon P11, and the front of the face image of the second icon P21 was facing the first icon P11. The third person P3 was present to the right rear of the first person P1 in the facility 900, and was not facing the first person P1, but was mainly facing to the right. Therefore, the third icon P31 was placed to the right rear of the first icon P11, and the front of the face image of the third icon P31 was facing in a direction deviated from the first icon P11 to the right. The fourth person P4 was present to the left front of the first person P1 in the facility 900 and was mainly facing the second person P2. Therefore, the fourth icon P41 was placed to the left front of the first icon P11, and the front of the face image of the fourth icon P41 was facing the second icon P21.

[0078] By displaying the above-mentioned risk image R22, the risk display device 10 can display the details of the contact situation between people in a manner that allows the user to easily understand. Therefore, according to this embodiment, it is possible to provide a risk display device or the like that can centrally display multiple infection risks that occur.

[0079] <Fourth embodiment> Next, a fourth embodiment will be described. The fourth embodiment differs from the above-mentioned embodiments in that an infection risk value is displayed. FIG. 8 is a block diagram of a risk display device 20 according to the fourth embodiment. The risk display device 20 in this embodiment has an infection risk value calculation unit 118 and a lip state detection unit 119.

[0080] The infection risk value calculation unit 118 calculates an infection risk value based on at least the distance and time between two people. The infection risk value is an index indicating the possibility of infection with a preset infectious disease, and is indicated by a preset numerical value. For example, the infection risk value is defined by a numerical value from 0 to 1. In this case, for example, 0 means the lowest infection risk, and 1 means the highest infection risk. The higher the value of the "infection risk", the higher the possibility of infection. More specifically, for example, a situation in which two people talk face to face at close range has a relatively high infection risk. Information that is an element for calculating the infection risk value is, for example, the distance between the two people, the time required for the distance, and the direction of the faces of each person. Information that is an element for calculating the infection risk value may also include the lip state of the person. The lip state may include, for example, information on whether the person is talking, whether the person is wearing a mask, whether the person is coughing or sneezing, and the like. When the infection risk value calculation unit 118 calculates the infection risk value, it supplies information on the calculated infection risk value to the connection line setting unit 114.

[0081] The lip state detection unit 119 detects the state of the lips of each person from the image data. For example, the lip state detection unit 119 detects whether a person is opening or closing their mouth, or coughing or sneezing. When the lip state detection unit 119 detects the lip state, it supplies information on the detected lip state to the infection risk value calculation unit 118. In this case, the infection risk value calculation unit 118 calculates the infection risk value taking the lip state into account.

[0082] The connection line setting unit 114 in this embodiment receives information on the infection risk value from the infection risk value calculation unit 118, and sets the appearance of the connection line according to the received infection risk value. More specifically, for example, the connection line setting unit 114 may set the color tone of the connection line according to the infection risk value.

[0083] Fig. 9 is a flowchart showing a risk display method according to the embodiment 4. The flowchart in Fig. 9 differs from the flowchart explained in Fig. 5 in the process between step S31 and step S14.

[0084] After step S31, the lip state detection section 119 detects the lip state from the image data (step S41). When the lip state detection section 119 detects the lip state, it supplies information on the detected lip state to the infection risk value calculation section 118.

[0085] Next, the infection risk value calculation unit 118 acquires information on the distance between people, time, face direction of the people, and lip state, and calculates an infection risk value from the acquired information (step S42). After calculating the infection risk value, the infection risk value calculation unit 118 supplies information on the calculated infection risk value to the connection line setting unit 114.

[0086] Next, the connection line setting unit 114 acquires information about the distance between people and the time it takes to cover that distance. Furthermore, the connection line setting unit 114 acquires information about the infection risk value. Then, the connection line setting unit 114 sets the appearance of the connection line based on this information (step S14). The subsequent processing is the same as in the above-mentioned flowchart, so a description thereof will be omitted here.

[0087] Fig. 10 is a diagram showing an example of an image displayed by the risk display device according to the fourth embodiment. Fig. 10 shows a risk image R31. In the risk image R31, each of the connection lines is colored. Specifically, the connection line L12 is red, the connection line L13 is yellow, and the connection line L14 is green. Here, for example, red has the highest infection risk value, green has the lowest infection risk value, and the infection risk value for yellow is lower than that for red and higher than that for green.

[0088] The fourth embodiment has been described above. The risk display device 20 according to this embodiment calculates an infection risk value and sets the appearance of the connection line according to the calculated infection risk value. This allows the risk display device 20 to grasp the infection risk value as well as the contact situation between the person related to the selected icon and other people. Therefore, according to this embodiment, it is possible to provide a risk display device etc. that can centrally display multiple infection risks that occur.

[0089] <Modification of the fourth embodiment> Next, a modified example of the embodiment 4 will be described. Fig. 11 is a block diagram of a risk display system 2 according to a modified example of the embodiment 4. The risk display system 2 shown in Fig. 11 differs from the above-described embodiment in that a thermal camera 400 is provided in the facility 900.

[0090] The thermal camera 400 generates thermal imaging data with an angle of view corresponding to the shooting range of the camera 300, and supplies the generated thermal imaging data to the risk display device 20. When the risk display device 20 obtains the thermal imaging data from the thermal camera 400, the measurement unit 113 measures the body surface temperature of the identified person. Then, the infection risk value calculation unit 118 calculates the infection risk value taking into account the body surface temperature. This allows the risk display device 20 to calculate the infection risk value in more detail. Therefore, according to this embodiment, it is possible to provide a risk display device etc. that can centrally display multiple infection risks.

[0091] <Example of hardware configuration> Below, a case will be described in which each functional configuration of the risk display device in the present disclosure is realized by a combination of hardware and software.

[0092] FIG. 14 is a block diagram illustrating a hardware configuration of a computer. The risk display device in the present disclosure can realize the above-mentioned functions by a computer 500 including the hardware configuration shown in the figure. The computer 500 may be a portable computer such as a smartphone or a tablet terminal, or a stationary computer such as a PC. The computer 500 may be a dedicated computer designed to realize each device, or may be a general-purpose computer. The computer 500 can realize a desired function by installing a specified application.

[0093] The computer 500 has a bus 502, a processor 504, a memory 506, a storage device 508, an input / output interface (I / F) 510, and a network interface (I / F) 512. The bus 502 is a data transmission path for the processor 504, the memory 506, the storage device 508, the input / output interface 510, and the network interface 512 to transmit and receive data to and from each other. However, the method of connecting the processor 504 and the like to each other is not limited to bus connection.

[0094] The processor 504 is one of various processors such as a CPU, a GPU, an FPGA, etc. The memory 506 is a main storage device realized using a RAM (Random Access Memory) or the like.

[0095] The storage device 508 is an auxiliary storage device realized using a hard disk, an SSD, a memory card, a ROM (Read Only Memory), etc. The storage device 508 stores a program for realizing a desired function. The processor 504 reads the program into the memory 506 and executes it to realize each functional component of each device.

[0096] The input / output interface 510 is an interface for connecting the computer 500 to an input / output device. For example, the input / output interface 510 is connected to an input device such as a keyboard and an output device such as a display device.

[0097] The network interface 512 is an interface for connecting the computer 500 to a network.

[0098] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit and scope of the present invention.

[0099] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) image data acquisition means for acquiring image data from a camera; An identification means for identifying a plurality of people from the image data; A measuring means for measuring the distance between the people; a connection line setting means for setting an appearance of the connection line corresponding to the distance; a person icon generating means for generating a person icon representing the person based on the image data; an image generating means for generating a risk image in which the plurality of person icons are connected to each other via the connection lines; and an output means for outputting risk image data relating to the risk image. Risk indicator. (Appendix 2) the connection line setting means sets a length of the connection line corresponding to the distance; 2. A risk indication device as described in appendix 1. (Appendix 3) The measuring means further measures a time corresponding to the distance; the connection line setting means sets an appearance of the connection line corresponding to the distance and the time. 3. A risk display device according to claim 1 or 2. (Appendix 4) the connection line setting means sets a thickness of the connection line corresponding to the time; 4. A risk indication device as described in appendix 3. (Appendix 5) the length of the connection line set by the connection line setting means corresponds to an average value of the distance between the two persons when the distance between the two persons is closer than a predetermined threshold value; 2. A risk indication device as described in appendix 2. (Appendix 6) the thickness of the connection line set by the connection line setting means corresponds to the cumulative value of the time when the distance between the two persons becomes closer than a predetermined threshold value; 6. A risk indication device as described in appendix 4. (Appendix 7) the image generating means selects one of the person icons as a selected icon and arranges the other person icons around the selected icon; 7. The risk display device according to any one of appendix 1 to 6. (Appendix 8) when the image generating means receives a process for selecting one of the person icons from the other person icons, the image generating means arranges the selected person icon as the selected icon. 8. A risk indication device as described in appendix 7. (Appendix 9) the measuring means measures a direction of a face of each of the two persons when the distance between the two persons becomes closer than a predetermined threshold value; the person icon generating means generates the person icon including the face of the person; the image generating means arranges the person icon based on the direction of the face; 9. A risk indication device according to claim 7 or 8. (Appendix 10) the image generating means arranges the positions of the other person icons to be arranged around the selection icon based on an angle relative to a direction of the face of the selection icon; 10. A risk indication device as described in appendix 9. (Appendix 11) the image generating means arranges the directions of the faces of the other person icons to be arranged around the selection icon based on an angle relative to the direction of the face of the selection icon; 11. A risk display device according to claim 9 or 10. (Appendix 12) An infection risk value calculation means for calculating an infection risk value based on at least the distance between the two persons, the connection line setting means sets an appearance of the connection line in accordance with the infection risk value. 12. The risk display device according to any one of claims 1 to 11. (Appendix 13) a lip state detection means for detecting a lip state of the person, the infection risk value calculation means calculates the infection risk value by further taking into account the lip condition. 13. A risk indication device according to claim 12. (Appendix 14) The image data acquisition means further acquires thermal image data from a thermal camera, the measuring means measures a body surface temperature of the person based on the thermal imaging data; the infection risk value calculation means calculates the infection risk value by further taking into account the body surface temperature. 14. A risk display device according to claim 12 or 13. (Appendix 15) the connection line setting means sets a color tone of the connection line in accordance with the infection risk value; 15. The risk display device according to any one of appendices 12 to 14. (Appendix 16) The computer Acquire image data from the camera, Identifying a plurality of persons from the image data; measuring the distances between said persons; Setting the appearance of the connection line corresponding to said distance; generating a person icon representing the person based on the image data; generating a risk image in which the plurality of person icons are connected to each other via the connection lines; outputting risk image data relating to the risk image; How to represent risk. (Appendix 17) Acquiring image data from the camera; identifying a plurality of people from the image data; measuring the distances between the people; setting an appearance of the connection line corresponding to the distance; generating a person icon representing the person based on the image data; A process of generating a risk image in which the plurality of person icons are connected to each other via the connection lines; A process of outputting risk image data relating to the risk image; A computer-implemented image processing method comprising: A non-transitory computer-readable medium on which a program is stored.

[0100] This application claims priority based on Japanese Patent Application No. 2020-212393, filed on December 22, 2020, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0101] 1. Risk Display System 2. Risk Display System 10 Risk display device 20 Risk display device 111 Image data acquisition unit 112 Specific section 113 Measuring section 114 Connection line setting section 115 Person Icon Generation Section 116 Image Generation Unit 117 Output section 118 Infection Risk Value Calculation Unit 119 Lip state detection unit 200 Display 300 Camera 400 Thermal Camera 500 Computers 900 facilities L12 connection line L13 connection line L14 connection line N1 Communications Network P1 1st person P2 2nd person P3 3rd person P4 4th person P11 1st Icon P21 2nd Icon P31 3rd Icon P41 4th Icon R11 Risk Image R21 Risk Image R22 Risk Image R31 Risk Image

Claims

1. image data acquisition means for acquiring image data from a camera; An identification means for identifying a plurality of people from the image data; a measuring means for measuring the distance between the persons and the direction of the faces of the persons when the distance between the two persons is closer than a predetermined threshold value; a connection line setting means for setting an appearance of the connection line corresponding to the distance; a person icon generating means for generating a person icon representing the person based on the image data, the person icon including the face of the person; an image generating means for generating a risk image in which the plurality of person icons are connected to each other via the connection lines; and an output means for outputting risk image data relating to the risk image, The image generating means selects one of the person icons as a selected icon, and arranges the other person icons around the selected icon based on the face direction. Risk indicator.

2. the connection line setting means sets a length of the connection line corresponding to the distance; The risk indication device according to claim 1 .

3. The measuring means further measures a time corresponding to the distance; the connection line setting means sets an appearance of the connection line corresponding to the distance and the time. The risk display device according to claim 1 or 2.

4. the connection line setting means sets a thickness of the connection line corresponding to the time; The risk indication device according to claim 3 .

5. the length of the connection line set by the connection line setting means corresponds to an average value of the distance between the two persons when the distance between the two persons is closer than a predetermined threshold value; The risk indication device according to claim 2 .

6. the thickness of the connection line set by the connection line setting means corresponds to the cumulative value of the time when the distance between the two persons becomes closer than a predetermined threshold value; The risk indication device according to claim 4.

7. when the image generating means receives a process for selecting one of the other person icons, the image generating means arranges the selected person icon as the selected icon. The risk indication device according to claim 1 .

8. The computer Acquire image data from the camera, Identifying a plurality of persons from the image data; measuring the distance between the persons and the direction of the faces of the persons when the distance between the two persons is closer than a predetermined threshold; Setting the appearance of the connection line corresponding to said distance; generating a person icon representing the person based on the image data, the person icon including the face of the person; generating a risk image in which the plurality of person icons are connected to each other via the connection lines; outputting risk image data relating to the risk image; In generating the risk image, one of the person icons is selected as a selected icon, and the other person icons are arranged around the selected icon based on the face direction. How to represent risk.

9. Acquiring image data from the camera; identifying a plurality of people from the image data; measuring the distance between the people and the direction of the people's faces when the distance between two people is closer than a predetermined threshold; setting an appearance of the connection line corresponding to the distance; generating a person icon representing the person based on the image data, the person icon including the face of the person; A process of generating a risk image in which the plurality of person icons are connected to each other via the connection lines; A process of outputting risk image data relating to the risk image; A method for image processing comprising the steps of: In the process of generating the risk image, one of the person icons is selected as a selected icon, and the other person icons are arranged around the selected icon based on the face direction. program.

Images