Information broadcasting system, information broadcasting method, and information broadcasting program

Abstract

To provide an information broadcasting system capable of broadcasting to attract the attention of a specific person among a plurality of people by making a minimum appeal to attract the attention of the specific person. [Solution] An information broadcasting system including an object recognition unit that recognizes an object based on an image captured by an imaging unit, an attribute recognition unit that recognizes attribute information of the recognized object, an information transmission target selection unit that selects a target to which an audio information broadcasting unit will transmit the audio information by broadcasting based on the recognized attribute information, a notification unit that notifies the selected target based on the attribute information of the target that the information is intended for the selected target, and an audio information setting unit that sets the audio information to be broadcast by the audio information broadcasting unit that broadcasts the audio information based on the attribute information of the target.

Description

[Technical Field]

[0001] The present invention relates to an information broadcasting system, an information broadcasting method, and an information broadcasting program. [Background technology]

[0002] There are known systems that recognize people and objects using images captured by surveillance cameras and issue various warnings based on the recognition results, such as by broadcasting. For example, there are systems that recognize people entering restricted areas and ask them to leave, and systems that recognize people running in swimming pools and warn them. There are also systems that recognize cars entering parking lots and provide information on available parking areas for each model of car.

[0003] The following prior art is disclosed in Patent Document 1: An obstacle sensor installed on the vehicle detects hazardous objects to the vehicle, and a driving condition sensor detects the driving condition of the vehicle. The system determines the level of urgency from the detected driving condition and information on the detected hazardous object, and outputs a warning sound in stereophonic format that omits information on the position or direction of the hazardous object depending on the level of urgency.

[0004] Patent Document 2 discloses the following prior art: A detection unit detects a target person with a predetermined attribute from people within a predetermined area, and provides guidance processing to the detected target person according to the attribute.

[0005] Patent Document 3 discloses the following prior art: An attribute discrimination means discriminates the age and sex of a person as attributes from a captured image, and outputs voice guidance information to assist the user in performing various processes by changing the diction according to the attributes. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-107148 [Patent Document 2] Japanese Patent Application Publication No. 2019-51568 [Patent Document 3] Japanese Patent Application Laid-Open No. 2012-185303 Summary of the Invention [Problem to be solved by the invention]

[0007] However, the above-mentioned prior art technologies have a problem in that they are unable to make a call that will attract the attention of a specific person among a plurality of people.

[0008] The present invention has been made to solve such problems, and aims to provide an information broadcasting system, an information broadcasting method, and an information broadcasting program that can make a broadcast that will attract the attention of a specific person among multiple people by making a minimum appeal to that person. [Means for solving the problem]

[0009] The above-mentioned problems of the present invention are solved by the following means.

[0010] (1) An information broadcasting system having an object recognition unit that recognizes an object based on an image captured by an imaging unit, an attribute recognition unit that recognizes attribute information of the recognized object, an information transmission target selection unit that selects a target to which an audio information broadcasting unit will transmit audio information by broadcast based on the recognized attribute information, a notification unit that notifies the selected target based on the attribute information of the target that the information is intended for the selected target, and an audio information setting unit that sets the audio information to be broadcast by the audio information broadcasting unit based on the attribute information of the target.

[0011] (2) The information broadcasting system described in (1) above, wherein the notification unit determines the content of the notification based on the recognition results of the multiple objects by the object recognition unit and the attribute recognition unit, using at least one of the attribute information that makes the object selected by the information transmission target selection unit least similar to other objects.

[0012] (3) The information broadcasting system described in (1) above, wherein the notification unit uses lighting, a projector, or a display to attract the attention of the target selected by the information transmission target selection unit, thereby notifying the target that the information is intended for the target.

[0013] (4) The information broadcasting system described in (1) above, wherein the notification unit changes the sound according to the attribute information of the target selected by the information transmission target selection unit to attract the attention of the target selected by the information transmission target selection unit, thereby notifying the target that the information is intended for the target.

[0014] (5) The information broadcasting system described in (1) above, wherein the notification unit notifies the target that the information is intended for the target by calling out to the target selected by the information transmission target selection unit using the audio broadcast by the audio information broadcasting unit, in accordance with the attribute information of the target selected by the information transmission target selection unit, thereby attracting the attention of the target.

[0015] (6) The information broadcasting system according to (1) above, wherein the notification unit determines notification content from notification elements registered in advance for each type of attribute information.

[0016] (7) The information broadcasting system according to (1) above, wherein the attribute information includes at least one of gender, age, and clothing.

[0017] (8) The information broadcasting system according to (1) above, wherein the attribute information is the type of vehicle.

[0018] (9) The information broadcasting system according to (1) above, wherein the attribute information is behavior.

[0019] (10) The information broadcasting system described in (1) above, wherein the audio information setting unit changes the broadcast order of the multiple pieces of audio information broadcast by the audio information broadcasting unit based on the attribute information of the target.

[0020] (11) The information broadcasting system described in (1) above, wherein the audio information setting unit switches the broadcast content of the audio information broadcast by the audio information broadcasting unit based on the attribute information of the target.

[0021] (12) The information broadcasting system according to (1) above, further comprising the imaging unit and the audio information broadcasting unit.

[0022] (13) A method executed by an information broadcasting system, comprising: a step (a) of recognizing an object based on an image captured by an imaging unit; a step (b) of recognizing attribute information of the recognized object; a step (c) of selecting a target to which audio information broadcasting unit will transmit audio information by broadcasting based on the recognized attribute information; a step (d) of announcing that the information is for the selected target based on the attribute information of the target; and a step (e) of setting the audio information to be broadcast by the audio information broadcasting unit based on the attribute information of the target.

[0023] (14) An information broadcasting program for causing a computer to execute a process comprising the steps of: (a) recognizing an object based on an image captured by an imaging unit; (b) recognizing attribute information of the recognized object; (c) selecting a target to which audio information broadcasting unit will transmit audio information by broadcasting based on the recognized attribute information; (d) announcing that the information is for the selected target based on the attribute information of the target; and (e) setting the audio information to be broadcast by the audio information broadcasting unit based on the attribute information of the target. [Effects of the Invention]

[0024] The system recognizes an object and its attribute information based on a captured image, selects a target to which audio information is to be transmitted by broadcast based on the attribute information, notifies the target based on the attribute information that the information is intended for the target, and sets the audio information to be broadcast based on the attribute information. This allows a broadcast that attracts the attention of a specific person among multiple people by making a minimum appeal to that person. [Brief explanation of the drawings]

[0025] Advantages and features provided by one or more embodiments of the present invention will be more fully understood from the following detailed description and the accompanying drawings, which are for purposes of illustration only and are not intended to be limiting. [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an information broadcasting system. [Figure 2] FIG. 2 is a block diagram showing a hardware configuration of a control device. [Figure 3] FIG. 2 is a block diagram showing the functions of a control unit of the control device. [Figure 4] 3 is a flowchart showing the operation of the information broadcasting system. [Figure 5] 10 is an explanatory diagram illustrating an example of the function of an audio information setting unit that changes the broadcast order of multiple pieces of audio information broadcast by an audio information broadcast unit based on attribute information of a target. FIG. [Figure 6] 10 is an explanatory diagram illustrating an example of the function of an audio information setting unit that changes the broadcast order of multiple pieces of audio information broadcast by an audio information broadcast unit based on attribute information of a target. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0026] Hereinafter, an information broadcasting system, an information broadcasting method, and an information broadcasting program according to embodiments of the present invention will be described with reference to the accompanying drawings. However, the scope of the present invention is not limited to the disclosed embodiments. In the description of the drawings, the same elements are denoted by the same reference numerals, and duplicated descriptions will be omitted. In addition, the dimensional proportions of the drawings are exaggerated for the convenience of explanation and may differ from the actual proportions.

[0027] (First embodiment) 1 is a diagram showing a schematic configuration of an information broadcasting system 1. The information broadcasting system 1 includes a control device 10, an imaging unit 20, and an audio information broadcasting unit 30. The control device 10, the imaging unit 20, and the audio information broadcasting unit 30 are connected to each other so that they can communicate with each other. The information broadcasting system 1 may be configured only by the control device 10. In this case, the information broadcasting system 1 is connected to the imaging unit 20 and the audio information broadcasting unit 30 so that they can communicate with each other.

[0028] The imaging unit 20 may be a camera that captures monochrome or color images. Video includes moving images and still images. A series of still images in time series constitutes a moving image. The imaging unit 20 is installed in a predetermined location and captures, for example, images of people.

[0029] The audio information broadcasting unit 30 broadcasts audio information. More specifically, the audio information broadcasting unit 30 broadcasts the audio information by sound. The audio information broadcasting unit 30 is configured by, for example, a speaker and an amplifier.

[0030] The control device 10 controls the imaging unit 20 and the audio information broadcasting unit 30 and performs various calculation processes. The control device 10 receives images captured by the imaging unit 20. The control device 10 outputs audio information to the audio information broadcasting unit 30 so that the audio information broadcasting unit 30 can broadcast audio.

[0031] Fig. 2 is a block diagram showing the hardware configuration of the control device 10. Fig. 3 is a block diagram showing the functions of the control unit 100 of the control device 10.

[0032] 2, the control unit 100, storage unit 200, display unit 300, input unit 400, and communication unit 500 of the control device 10 are interconnected via a bus 600. The control device 10 is configured by a computer. The control device 10 can be, for example, a server or a PC (Personal Computer).

[0033] The control unit 100 is configured by a CPU (Central Processing Unit) and, in accordance with a program, controls and performs calculation processing on each part of the information broadcasting system 1. The function of the control unit 100 will be described later.

[0034] The storage unit 200 may be configured with a RAM (Random Access Memory), a ROM (Read Only Memory), and a flash memory. The RAM temporarily stores programs and data as a working area for the control unit 100. The ROM stores various programs and data in advance. The flash memory stores various programs and data, including the operating system.

[0035] The display unit 300 is, for example, a liquid crystal display, and displays various types of information.

[0036] The input unit 400 is configured with, for example, a touch panel and various keys, and is used for various operations and inputs.

[0037] The communication unit 500 is an interface for communicating with external devices. For communication, a network interface conforming to standards such as Ethernet (registered trademark), SATA, PCI Express, USB, and IEEE1394 may be used. In addition, for communication, various local connection interfaces such as wireless communication interfaces such as Bluetooth (registered trademark) and IEEE802.11 may be used.

[0038] The functions of the control unit 100 will be described with reference to Fig. 3. By executing a program, the control unit 100 functions as an object recognition unit 110, an attribute recognition unit 120, an information transmission target selection unit 130, a notification unit 140, and an audio information setting unit 150. Furthermore, the control unit 100 functions as an audio information broadcast control unit 160.

[0039] The object recognition unit 110 recognizes an object based on an image captured by the imaging unit 20. The object recognition unit 110 can recognize an object based on an image using a known method. For example, the object recognition unit 110 can recognize an object based on an image using a trained model of a neural network. As the trained model of the neural network, for example, YOLO (You Only Look Once) is used. The object includes a person. Unless otherwise specified, the following description will be given taking the case where the object is a person as an example.

[0040] The object recognition unit 110 may recognize a person as a person rectangle, which is a rectangular range on an image that includes the person. More specifically, the object recognition unit 110 may recognize a person as the coordinates on an image of the vertices of the person rectangle. For ease of explanation, the following description will be given assuming that the object recognition unit 110 recognizes a person as a person rectangle.

[0041] The attribute recognition unit 120 recognizes the attribute information of the person recognized by the object recognition unit 110. The attribute recognition unit 120 can recognize the attribute information of the person based on an image using a known method. For example, the attribute recognition unit 120 can recognize the attribute information of the person based on a human rectangle using a trained model of a neural network. As the trained model of the neural network, for example, YOLO is used. Hereinafter, the attribute information of the person recognized by the attribute recognition unit 120 will also be simply referred to as "attribute information."

[0042] The attribute information may include at least one of gender, age, and clothing. The attribute information may include behavior. The attribute information may include the type of vehicle. In this embodiment, a case will be described in which the attribute information is clothing and behavior.

[0043] The information transmission target selection unit 130 selects a target to which the audio information broadcast unit 30 will transmit audio information through broadcasting, based on the attribute information recognized by the attribute recognition unit 120. In this embodiment, when the attribute recognition unit 120 recognizes that a person recognized by the object recognition unit 110 has performed a predetermined behavior as attribute information, the information transmission target selection unit 130 selects the person who performed the predetermined behavior as a target to which the audio information will be transmitted. The predetermined behavior broadly includes behaviors for which it is desirable to transmit audio information to the person who performed the predetermined behavior. The predetermined behavior may be stored in the storage unit 200 in advance. In the example shown in FIG. 1 , the predetermined behavior is the behavior of "entering outside the yellow line." When the attribute recognition unit 120 recognizes the predetermined behavior of "entering outside the yellow line" as attribute information, the information transmission target selection unit 130 selects the person who performed the behavior of "entering outside the yellow line" as a target to which the audio information will be transmitted. For example, the attribute recognition unit 120 can recognize the predetermined behavior of "entering the area outside the yellow line" as attribute information by recognizing that the area outside the yellow line, which is registered in advance as coordinates on the image, overlaps with the human rectangle. Hereinafter, the target to which audio information is transmitted, selected by the information transmission target selection unit 130, will also be simply referred to as the "target."

[0044] The target includes an object that can be identified with the target as a destination of the audio information broadcast, even if it is not strictly the target to which the audio information broadcast unit 30 transmits the audio information by broadcasting. For example, a vehicle carrying a person may be included in the target.

[0045] The notification unit 140 notifies the target selected by the information transmission target selection unit 130 that the information is intended for that target based on the attribute information. Specifically, the notification unit 140 notifies the target by broadcasting, via the audio information broadcast unit 30, that the information is intended for that target based on the attribute information. In the example shown in FIG. 1 , the notification unit 140 causes the audio information broadcast unit 30 to broadcast notification content including the target's attribute information, such as "the person in blue clothes." In this way, the notification unit 140 notifies the target that the information is intended for that target based on the target's attribute information. In this case, the notification unit 140 notifies the target that the information is intended for that target by calling out to the target using the audio broadcast by the audio information broadcast unit 30 in accordance with the target's attribute information to attract the target's attention.

[0046] Based on the recognition results of multiple people by the object recognition unit 110 and the attribute recognition unit 120, the notification unit 140 may determine the notification content using at least one attribute information of the target selected by the information transmission target selection unit 130 that is least similar to other people. In the example shown in FIG. 1 , the object recognition unit 110 recognizes three people, and attribute information of "blue clothes" is recognized for the target, and attribute information of "white clothes" is recognized for people other than the target. Therefore, the notification unit 140 determines the notification content "The person in blue clothes" using the attribute information of the target, "blue clothes," which is not similar to people other than the target. Also, for example, there may be two people recognized with attribute information of "blue clothes." In this case, if a relatively large number of other people do not recognize the attribute information of "blue clothes," the notification unit 140 may determine the notification content "The person in blue clothes" using the attribute information of "blue clothes," which is least similar to other people.

[0047] In addition, when the target can be distinguished from other people by two or more pieces of attribute information, the notification unit 140 may determine the notification content using the two or more pieces of attribute information. When the attribute information of the target is male and the attribute information of the other than the target is female, the notification unit 140 may determine the notification content as "the man over there."

[0048] The notification unit 140 may determine the notification content from notification elements pre-registered for each type of attribute information. Specifically, the registered notification elements do not include information about a person's appearance, such as gender or age. This prevents the information about the appearance from being notified to the target, even if the attribute recognition unit 120 recognizes information about the target's appearance, such as gender or age, as attribute information. This prevents the target from feeling uncomfortable when information about the target is notified. Possible registered notification elements include a person's belongings and actions. Specifically, for example, registered notification elements may include "holding an umbrella" and "running." The notification unit 140 may notify the target that the information is intended for the target by adding a word or phrase necessary to become a call to the registered notification element. For example, the notification element "holding an umbrella" may be added with a word or phrase necessary to become a call to become a call, thereby notifying the target that the information is intended for the target by using the word "someone holding an umbrella."

[0049] The notification unit 140 may notify the target that the information is relevant to the target by attracting the target's attention using lighting, a projector, or a display. For example, the notification unit 140 may notify the target that the information is relevant to the target by irradiating light toward the target or within the target's field of view using lighting or a projector. The notification unit 140 may notify the target that the information is relevant to the target by displaying an image of the target on the display. The notification unit 140 may notify the target that the information is relevant to the target by displaying an image captured by the imaging unit 20 on the display and identifiably pointing out the target in the image using an icon or the like.

[0050] The notification unit 140 may change the sound according to the attribute information of the target selected by the information transmission target selection unit 130 to attract the target's attention and thereby notify the target that the information is intended for that target. For example, when the audio information broadcast unit 30 broadcasts information intended for the target, the frequency or pitch of the audio to be broadcast may be changed according to the target's age, which is the attribute information. For example, if the target is a child, the frequency of the audio to be broadcast may be increased according to the audible range of children, or the audio to be broadcast may be a child's voice. Furthermore, if the target is a bicycle, the audio to be broadcast may be the sound of a bell. If the target is a car, the audio to be broadcast may be the sound of a horn.

[0051] The notification unit 140 may determine the notification content based on the attribute information in a rule-based manner using a table in which the correspondence between the attribute information and the notification content is registered.The notification unit 140 may also determine the notification content using a generation AI that generates appropriate notification content from the attribute information.

[0052] The audio information setting unit 150 sets the audio information to be broadcast by the audio information broadcasting unit 30 based on the attribute information. In the example shown in FIG. 1 , the audio information setting unit 150 sets the audio information "Please step back inside the yellow line" based on the target's attribute information, which is the behavior of "entering outside the yellow line." The audio information broadcasting unit 30 broadcasts the audio information set by the audio information setting unit 150 as audio, thereby broadcasting the audio information "Please step back inside the yellow line." As a result, following the call to the target "the person in blue clothes" notified by the notification unit 140, the audio information "Please step back inside the yellow line" set by the audio information setting unit 150 can be broadcast by the audio information broadcasting unit 30. The call to the target "the person in blue clothes" draws the target's attention to the broadcast by the audio information broadcasting unit 30 and allows the target to recognize that the audio information "Please step back inside the yellow line" is information intended for the target.

[0053] The voice information setting unit 150 may determine voice information from attribute information in a rule-based manner based on the attribute information, using a table in which the correspondence between attribute information and voice information is registered. The voice information setting unit 150 may also determine voice information using a generation AI that generates appropriate voice information from attribute information.

[0054] The audio information broadcast control unit 160 transmits the audio information set by the audio information setting unit 150 to the audio information broadcast unit 30 via the communication unit 500, and causes the audio information broadcast unit 30 to broadcast the audio information.

[0055] The operation of the information broadcasting system 1 will now be described.

[0056] 4 is a flowchart showing the operation of the information broadcasting system 1. This flowchart can be executed by the control unit 100 in accordance with a program.

[0057] The control unit 100 recognizes a person, which is an object, based on an image captured by the imaging unit 20 (S101).

[0058] The control unit 100 recognizes attribute information of the recognized person (S102).

[0059] The control unit 100 selects a target to which the voice information is to be transmitted based on the recognized attribute information (S103).

[0060] The control unit 100 notifies the user that the information is for the selected target based on the attribute information of the target (S104).

[0061] The control unit 100 sets the audio information to be broadcast by the audio information broadcasting unit 30 based on the attribute information of the target (S105).

[0062] The control unit 100 broadcasts the set audio information through the audio information broadcasting unit 30 (S106).

[0063] (Variation 1-1) When the attribute recognition unit 120 recognizes the predetermined behavior of "running" as attribute information, the information transmission target selection unit 130 selects a person who has performed the predetermined behavior of "running" as a target. The notification unit 140 determines the notification content to be "customer running," and the audio information broadcast unit 30 broadcasts the notification content by audio. The audio information setting unit 150 sets audio information to be "Please do not run at the poolside" based on the target's attribute information of "running." As a result, the audio information broadcast unit 30 can broadcast the audio message, "Customer running, please do not run at the poolside."

[0064] (Variation 1-2) The attribute information recognized by the attribute recognition unit 120 includes "age." The information transmission target selection unit 130 selects people under a predetermined age as targets. The notification unit 140 determines the notification content, "Customers under XX years old," and broadcasts the notification content by voice using the voice information broadcast unit 30. The voice information setting unit 150 sets the voice information, "We are having a toy sale on the top floor," based on the target's attribute information, "age." This allows the voice information broadcast unit 30 to broadcast the voice, "Customers under XX years old, we are having a toy sale on the top floor."

[0065] (Variation 1-3) When the attribute recognition unit 120 recognizes the predetermined behavior of "entering the store wearing a helmet" as attribute information, the information transmission target selection unit 130 selects a person who has performed the predetermined behavior of "entering the store wearing a helmet" as a target. The notification unit 140 determines the notification content of "a customer who entered the store wearing a helmet," and the audio information broadcast unit 30 broadcasts the notification content by audio. The audio information setting unit 150 sets audio information such as "please remove your helmet when entering the store" based on the target's attribute information of "entering the store wearing a helmet." As a result, the audio information broadcast unit 30 can broadcast an audio message saying, "a customer who entered the store wearing a helmet, please remove your helmet when entering the store." The attribute recognition unit 120 can recognize the behavior of "entering the store," included in the predetermined behavior of "entering the store wearing a helmet," based on the direction of movement of the center of gravity of the human rectangle over time.

[0066] (Second embodiment) The second embodiment will be described. This embodiment differs from the first embodiment in the following points. In this embodiment, the broadcast order of multiple pieces of audio information broadcast by the audio information broadcasting unit 30 is changed based on the attribute information of the target. In other respects, this embodiment is similar to the first embodiment, so redundant explanations will be omitted.

[0067] 5 and 6 are explanatory diagrams for explaining an example of the function of the audio information setting unit 150 that changes the broadcast order of a plurality of pieces of audio information broadcast by the audio information broadcasting unit 30 based on the attribute information of the target.

[0068] The attribute information of the target recognized by the attribute recognition unit 120 includes gender, and the audio information setting unit 150 changes the broadcast order of the multiple pieces of audio information broadcast by the audio information broadcasting unit 30 based on the gender of the target. As shown in FIG. 5, when the attribute information of the target is male, the audio information setting unit 150 broadcasts the multiple pieces of audio information "The men's restroom is on the left" and "The women's restroom is on the right" first among the multiple pieces of audio information broadcast by the audio information broadcasting unit 30. As shown in FIG. 6, when the attribute information of the target is female, the audio information setting unit 150 broadcasts the multiple pieces of audio information "The men's restroom is on the left" and "The women's restroom is on the right" first among the multiple pieces of audio information broadcast by the audio information broadcasting unit 30.

[0069] In this modified example, the "men's" part of the audio information to be broadcast, "The men's restroom is on the left," can be said to be a call to men. Therefore, the "men's" part may be notified by the notification unit 140.

[0070] By doing so, information of high value to the subject can be given priority in notification, and the effect of reducing missed notifications can be improved within a limited time.

[0071] (Variation 2-1) The attribute information of the target recognized by the attribute recognition unit 120 includes the type of vehicle, and the audio information setting unit 150 may change the broadcast order of the multiple pieces of audio information broadcast by the audio information broadcasting unit 30 based on the type of the target vehicle. For example, when the attribute information of the target is a bus, the audio information setting unit 150 broadcasts the multiple pieces of audio information "The bus parking lot is the first parking lot on the left" and "The car parking lot is the second parking lot on the right" broadcast by the audio information broadcasting unit 30 in such a way that the former comes first. When the attribute information of the target is a car, the audio information setting unit 150 broadcasts the multiple pieces of audio information "The bus parking lot is the first parking lot on the left" and "The car parking lot is the second parking lot on the right" broadcast by the audio information broadcasting unit 30 in such a way that the latter comes first.

[0072] (Variation 2-2) The attribute information of the target recognized by the attribute recognition unit 120 includes whether or not the target uses a wheelchair, and the audio information setting unit 150 may change the broadcast order of the multiple pieces of audio information broadcast by the audio information broadcast unit 30 based on whether or not the target uses a wheelchair. For example, when the attribute information of the target is "wheelchair user," the audio information setting unit 150 broadcasts the multiple pieces of audio information "The elevator is at the end after turning right" and "The escalator is at the end after turning left" by first broadcasting the former first. When the attribute information of the target is "wheelchair user not," the audio information setting unit 150 broadcasts the multiple pieces of audio information "The elevator is at the end after turning right" and "The escalator is at the end after turning left" by first broadcasting the latter first.

[0073] (Third embodiment) A third embodiment will be described. The present embodiment differs from the second embodiment in the following points. In the second embodiment, the broadcast order of multiple pieces of audio information broadcast by the audio information broadcasting unit 30 is changed based on the attribute information of the target. On the other hand, in this embodiment, the broadcast content of the audio information broadcast by the audio information broadcasting unit 30 is switched based on the attribute information of the target. In other respects, this embodiment is similar to the second embodiment, so redundant explanations will be omitted.

[0074] The attribute information of the target recognized by the attribute recognition unit 120 includes gender, and the audio information setting unit 150 switches the broadcast content of the audio information broadcast by the audio information broadcasting unit 30 based on the gender of the target. For example, if the target's attribute information is male, the audio information setting unit 150 broadcasts the content "The men's restroom is on the left," and if the attribute information is female, the broadcast content is "The women's restroom is on the left."

[0075] By doing so, it is possible to inform the subject of information that is of high value in a concise manner, and it is possible to improve the effect of reducing missed notifications within a limited time.

[0076] (Variation 3-1) The attribute information of the target recognized by the attribute recognition unit 120 includes the type of vehicle, and the audio information setting unit 150 may switch the content of the audio information broadcast by the audio information broadcasting unit 30 based on the type of the target vehicle. For example, if the attribute information of the target is a bus, the audio information setting unit 150 sets the content of the audio information broadcast by the audio information broadcasting unit 30 to "The bus parking lot is the first parking lot on the left." If the attribute information of the target is a car, the audio information setting unit 150 sets the content of the audio information broadcast by the audio information broadcasting unit 30 to "The car parking lot is the second parking lot on the right."

[0077] (Variation 3-2) The attribute information of the target recognized by the attribute recognition unit 120 may include whether or not the target uses a wheelchair, and the audio information setting unit 150 may switch the content of the audio information broadcast by the audio information broadcast unit 30 based on whether or not the target uses a wheelchair. For example, if the attribute information of the target is "wheelchair user", the audio information setting unit 150 sets the content of the audio information broadcast by the audio information broadcast unit 30 to "the elevator is just after you turn right". If the attribute information of the target is "wheelchair user not", the audio information setting unit 150 sets the content of the audio information broadcast by the audio information broadcast unit 30 to "the escalator is just after you turn right".

[0078] This embodiment has the following advantages.

[0079] The system recognizes an object and its attribute information based on a captured image, selects a target to which audio information is to be transmitted by broadcast based on the attribute information, notifies the target based on the attribute information that the information is intended for the target, and sets the audio information to be broadcast based on the attribute information. This allows a broadcast that attracts the attention of a specific person among multiple people by making a minimum appeal to that person.

[0080] Furthermore, based on the recognition results of multiple objects and their attribute information, the notification content is determined using at least one attribute information of the selected target that minimizes its similarity to other objects. This makes it easier to notify a specific person among multiple people of information that does not fall under personal information.

[0081] Additionally, by using lighting, a projector, or a display to attract the attention of a selected target, the information is notified to that target, allowing for flexible appeals to attract the attention of a specific person among multiple people depending on the situation and environment.

[0082] Furthermore, the sound is changed according to the attribute information of the selected target to attract the target's attention and notify the target that the information is directed at that target. This makes it possible to more effectively attract the attention of a specific person among multiple people.

[0083] Furthermore, depending on the attribute information of the selected target, the broadcast audio is used to call out to the target and attract their attention, thereby informing them that the information is intended for them. This makes it easier and more effective to attract the attention of a specific person among multiple people.

[0084] In addition, notification content is determined from notification elements pre-registered for each type of attribute information. This makes it possible to avoid notifications related to appearance and appropriately attract the attention of a specific person among multiple people.

[0085] Furthermore, the attribute information may include at least one of gender, age, and clothing, which makes it easier and more effective to attract the attention of a specific person among multiple people.

[0086] The attribute information also includes the type of vehicle, which allows for more flexible and effective targeting of a specific person among multiple people.

[0087] Additionally, behavior can be included in the attribute information, which allows for more flexible and effective targeting of a specific person among multiple people.

[0088] In addition, the broadcast order of multiple audio information items can be changed based on the attribute information, which allows information of high value to be given priority and improves the effectiveness of reducing missed notifications within a limited time frame.

[0089] In addition, the content of the audio information to be broadcast can be switched based on the attribute information, which allows for information of high value to be communicated to the target in a concise manner, and can improve the effectiveness of reducing missed notifications within a limited time frame.

[0090] The present invention is not limited to the above-described embodiments.

[0091] For example, in the embodiments, some or all of the processing executed by the program may be replaced with hardware such as a circuit.

[0092] While embodiments of the present invention have been described and illustrated in detail, the disclosed embodiments are made for purposes of illustration and example only, and not limitation, and the scope of the present invention should be construed by the language of the appended claims. [Explanation of symbols]

[0093] 1 Information broadcasting system, 100 control section, 110 Object recognition unit, 120 Attribute recognition unit, 130 Information Transmission Target Selection Unit, 140 Information Department, 150 audio information setting unit, 160 Audio information broadcast control unit, 200 storage section, 300 display, 400 input section, 500 Communications Department, 600 bus.

Claims

1. an object recognition unit that recognizes an object based on an image captured by the imaging unit; an attribute recognition unit that recognizes attribute information of the recognized object; an information transmission target selection unit that selects a target to which the audio information broadcasting unit will transmit audio information by broadcasting based on the recognized attribute information; a notification unit that notifies that the information is related to the selected target based on the attribute information of the target; an audio information setting unit that sets the audio information to be broadcast by the audio information broadcasting unit based on the attribute information of the target; An information broadcasting system having:

2. The information broadcasting system of claim 1, wherein the notification unit determines the content of the notification based on the recognition results of the plurality of objects by the object recognition unit and the attribute recognition unit, using at least one of the attribute information of the object selected by the information transmission target selection unit that is least similar to other objects.

3. The information broadcasting system according to claim 1 , wherein the notification unit notifies the target selected by the information transmission target selection unit that the information is intended for the target by attracting the target's attention using lighting, a projector, or a display.

4. The information broadcasting system of claim 1, wherein the notification unit changes the sound according to the attribute information of the target selected by the information transmission target selection unit to attract the attention of the target selected by the information transmission target selection unit, thereby notifying the target that the information is intended for the target.

5. The information broadcasting system of claim 1, wherein the notification unit notifies the target that the information is intended for the target by calling out to the target selected by the information transmission target selection unit using audio broadcast by the audio information broadcasting unit to attract the target's attention, depending on the attribute information of the target selected by the information transmission target selection unit.

6. The information broadcasting system according to claim 1 , wherein the notification unit determines notification contents from notification elements registered in advance for each type of attribute information.

7. The information broadcasting system according to claim 1 , wherein the attribute information includes at least one of gender, age, and clothing.

8. The information broadcasting system according to claim 1 , wherein the attribute information is a type of vehicle.

9. The information broadcasting system according to claim 1 , wherein the attribute information is behavior.

10. The information broadcasting system according to claim 1 , wherein the audio information setting unit changes a broadcast order of the plurality of pieces of audio information broadcast by the audio information broadcasting unit based on the attribute information of the target.

11. The information broadcasting system according to claim 1 , wherein the audio information setting unit switches the broadcast content of the audio information broadcast by the audio information broadcasting unit based on the attribute information of the target.

12. The information broadcasting system according to claim 1 , further comprising: said imaging unit; and said audio information broadcasting unit.

13. 1. A method performed by an information broadcasting system, comprising: a step (a) of recognizing an object based on an image captured by an imaging unit; (b) recognizing attribute information of the recognized object; (c) a step in which an audio information broadcasting unit selects a target to which audio information is to be transmitted by broadcasting based on the recognized attribute information; a step (d) of notifying the user that the information is for the selected target based on the attribute information of the target; (e) setting the audio information to be broadcast by the audio information broadcasting unit based on the attribute information of the target; An information broadcasting method comprising:

14. a step (a) of recognizing an object based on an image captured by an imaging unit; (b) recognizing attribute information of the recognized object; (c) a step in which an audio information broadcasting unit selects a target to which audio information is to be transmitted by broadcasting based on the recognized attribute information; a step (d) of notifying the user that the information is for the selected target based on the attribute information of the target; (e) setting the audio information to be broadcast by the audio information broadcasting unit based on the attribute information of the target; An information broadcasting program for causing a computer to execute a process having the above steps.

Images