Control device, information processing device, control method therefor, and program

JP2023093065A5Active Publication Date: 2024-11-11CANON KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2021208471
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2021-12-22
Publication Date
2024-11-11
Estimated Expiration
2041-12-22

AI Technical Summary

Technical Problem

In publish/subscribe communication systems, efficiently distributing information indicating a detection target is challenging due to the inability to accurately define and manage the relationship between publishers and subscribers, particularly in dynamic environments like parking lots where vehicle compositions change frequently.

Method used

A control device acts as a broker, managing topic settings and information distribution by receiving subscription requests from user devices and directing publishers to distribute relevant information to subscribers based on vehicle detection, using publish/subscribe type communication.

Benefits of technology

This approach enables efficient distribution of detection target information, reducing unnecessary processing loads and ensuring only relevant data is transmitted, enhancing system efficiency and user awareness of vehicle status.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

To provide a technology that can efficiently distribute information indicating that a detection target has been detected in a publish / subscribe type communication system.SOLUTION: A control device operates as a broker in a publish / subscribe type communication system. The control device accepts a subscribe request for a topic including identification information corresponding to a detection target from a user device that operates as a subscriber and transmits a delivery instruction for the topic to an information processing device capable of operating as a publisher that delivers a message on the topic when the detection target is detected.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a control device, an information processing device, and control methods and programs thereof.

Background Art

[0002] In publish / subscribe type communication, a publisher distributes messages with identification information called a topic added, and a subscriber registers with a broker to receive the topics of the distribution it wants to receive (Patent Document 3). This enables communication between the publisher and the subscriber without being aware of each other. Thereby, advantages such as system scalability and ease of implementation can be obtained.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, there are cases where a subscriber may want to obtain information indicating that a publisher has detected a predetermined detection target by distribution. In such cases, there is a problem that it is impossible to grasp the subscriber that distributes information from the publisher or the publisher that the subscriber wants to distribute information, and it is impossible to efficiently distribute information.

[0005] This invention has been made in view of the above-mentioned problems, and aims to provide a technology that can efficiently distribute information indicating that a target has been detected in a communication system that performs publish / subscribe type communication. [Means for solving the problem]

[0006] To solve the above problems, the control device according to the present invention is a control device that operates as a broker in a publish / subscribe type communication system, A receiving means that receives a subscription request for a topic containing identification information corresponding to the target to be detected from a user device acting as a subscriber, A transmission means that transmits a message distribution instruction for the topic to an information processing device capable of operating as a publisher that distributes messages on the topic when the detection target is detected, It is characterized by having the following features. [Effects of the Invention]

[0007] According to the present invention, a communication system that performs publish / subscribe type communication can provide a technology that can efficiently distribute information indicating that a target has been detected. [Brief explanation of the drawing]

[0008] [Figure 1] Configuration diagram of a mobile management system including a communication system according to this embodiment. [Figure 2] Block diagram showing an example configuration of a user device. [Figure 3] Block diagram showing an example of the control device configuration. [Figure 4] Block diagram showing an example of the detection device configuration. [Figure 5] A flowchart illustrating an example of the processing performed by the control unit upon receiving a registration request. [Figure 6] A flowchart illustrating an example of the processing performed by an information processing device upon receiving a distribution instruction. [Figure 7]Figure showing an example of an information table indicating the correspondence between topic names and vehicle identifiers [Figure 8] Flowchart showing an example of processing at the time of vehicle detection executed by an information processing device [Figure 9] Flowchart showing an example of processing at the time of receiving a registration cancellation request executed by a control device [Figure 10] Flowchart showing an example of processing at the time of receiving a distribution stop instruction executed by an information processing device [Figure 11] Sequence diagram showing an example of processing executed by a mobile body management system [Figure 12] Computer management system diagram including a communication system according to the second embodiment

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the present invention according to the claims, and not all combinations of the features described in the present embodiment are essential for the solution means of the present invention.

[0010] <First Embodiment> In recent years, a traffic system has been proposed that enables traffic information to be obtained using images and sensor information acquired by cameras and sensors installed near vehicle travel roads (Patent Document  2).

[0011] In addition, there is an automatic valet parking system that uses communication between infrastructure and vehicles to move vehicles without a driver and autonomously park in an empty parking space (Patent Document 3).

[0012] By introducing the above traffic system into the above automatic valet parking system, detecting the position of a vehicle in a parking lot with a camera or the like, and notifying the user of the vehicle of the position information of the vehicle, the user can grasp the state of the vehicle while parked and the state of the vehicle such as the parking position.

[0013] In this case, for example, it is necessary to share the configured content of the topic between a publisher such as a surveillance camera and a subscriber such as a vehicle owner's smartphone before communication. However, in an environment such as a parking lot where an unspecified number of vehicles come and go, it is impossible to grasp in advance which subscribers will participate in the system, and it is difficult to appropriately share the configured content of the topic in advance.

[0014] For example, a method of sharing in advance a topic for transmitting all vehicle positions recognized by a surveillance camera can be considered. However, in this case, since processing is performed for all recognized vehicles, the processing load on the surveillance camera side increases. In addition, there is a problem of poor efficiency because position information of vehicles that are not required by the smartphone side is also transmitted and received.

[0015] As described above, in an environment where the configuration of subscribers changes, there is a problem that no means is defined for appropriately determining the topic configuration and sharing it between the publisher and the subscriber.

[0016] In order to solve such problems, in the first embodiment, an example of a communication system that performs publish / subscribe type communication will be described using, as an example, a mobile body management system that is an automatic valet parking system for assisting the autonomous parking of the above-described vehicle.

[0017] In the present embodiment, the mobile body management system distributes information to a user device that operates as a subscriber about detecting a vehicle as a mobile body to be detected. A control device that operates as a broker supports automatic valet parking and instructs a publisher to distribute information about a vehicle that a subscriber desires to detect based on the processing described later. In addition, a surveillance camera, which is an example of an information processing device that operates as a publisher, detects information such as the position of a vehicle and distributes a message via publish / subscribe type communication. As a result, the user of the vehicle can easily grasp the vehicle situation by receiving the distributed information with a user device such as a smartphone.

[0018] (System Configuration) Figure 1 is a configuration diagram showing the communication system according to this embodiment. The communication system 101, which performs publish / subscribe type communication, is an automated valet parking system. The communication system 101 includes a control device 105 that operates as a broker, and surveillance cameras 103 and 104 that can operate as information processing devices that operate as publishers.

[0019] Furthermore, when an autonomously driving vehicle 102 joins the communication system 101, the communication system 101 transmits information to the vehicle 102 to support autonomous driving. In addition, a smartphone 108, which is owned by the user of the vehicle 102 and acts as a subscriber user device, indicates the status of the vehicle 102, such as its location information, via the communication system, indicating that the vehicle 102 is autonomously driving within the automated valet parking system 101.

[0020] Furthermore, multiple surveillance cameras 103 and 104 are installed in the parking lot where the communication system 101 is applied, and the control device 105 monitors the behavior of the autonomously driving vehicle 102 using the images captured by the surveillance cameras installed at various locations.

[0021] In this embodiment, the vehicle 102 automatically drives to a designated parking spot in the parking lot under the control of the control device 105 of the automatic valet parking system. Control messages related to automatic driving transmitted from the control device 105 to the vehicle 102 are delivered to the vehicle 102 wirelessly via the communication network 106 and base station 107. For example, the control message may be a movement instruction that includes location information indicating the destination of the vehicle 102, or a steering instruction that includes steering information such as turning right or left that the vehicle 102 should perform. The vehicle 102 also transmits its own status information to the control device 105 wirelessly via the base station 107.

[0022] Surveillance cameras 103 and 104 are installed in the parking lot to photograph traffic conditions within the parking lot. Furthermore, they are capable of analyzing moving vehicles from the captured image data through image processing and notifying other devices of the analysis results.

[0023] Furthermore, when the surveillance camera detects vehicle 102, it has the function of distributing information about vehicle 102 to the smartphone 108 owned by the owner of vehicle 102 via the communication network 106 and base station 107. In other words, the surveillance camera can operate as a publisher in the communication system 101, which performs publish / subscribe type communication.

[0024] The above distribution function is realized through publish / subscribe type message exchange via the control device 105. In other words, in this embodiment, the surveillance cameras 103 and 104 act as publishers, the control device 105 acts as a broker, and the smartphone 108 acts as a subscriber, and they exchange messages using topics.

[0025] In this embodiment, for example, after the vehicle 102 enters the automated valet parking system 101, the owner of the vehicle 102 may start using the distribution function by operating the smartphone 108. Alternatively, for example, when the vehicle 102 exits the automated valet parking system 101, the owner of the vehicle 102 may stop using the distribution function by operating the smartphone 108. In another example, based on location information acquired by the smartphone 108, the distribution function may be started by communicating with the control device 105 when the smartphone 108 or the vehicle 102 enters a predetermined location range. Alternatively, the communication system 101 may have a detection device that detects when the smartphone 108 joins the communication system 101 as a subscriber using a short-range wireless communication method such as an RFID tag. In this case, the smartphone 108 may start using the distribution function based on a predetermined action performed by the user, such as holding the smartphone 108 over the detection device.

[0026] Next, the configurations of the surveillance cameras 103, 104, the control device 105, and the smartphone 108 according to this embodiment will be described. Note that the configuration described below is merely an example, and at least a part of the described configuration may be replaced or omitted by other configurations that perform similar functions, and further configurations may be added to the described configuration. Furthermore, one block shown in the following description may be divided into multiple blocks, or multiple blocks may be integrated into one block. Similarly, at least some functions may be implemented by other devices, or one function may be implemented by multiple devices.

[0027] (Smartphone configuration) Figure 2 shows an example of the configuration of the smartphone 108 in this embodiment. The smartphone 108 includes a display unit 201, a storage unit 202, a message processing unit 203, a communication unit 204, and a control unit 205.

[0028] The display unit 201 is a display device that displays information to the user. In this embodiment, for example, it performs notification processing to display the location information of vehicle 102 received from a surveillance camera to the user. The storage unit 202 is a storage device that stores topic information and the like necessary for publish / subscribe type communication. The storage unit 202 stores various data such as programs executed by the control unit 205 and information related to vehicle 102.

[0029] The message processing unit 203 is a message processing unit that implements message communication in accordance with publish / subscribe type communication. In this embodiment, the message processing unit 203 implements the processing on the subscriber side.

[0030] The communication unit 204 is a communication unit that transmits messages generated by the message processing unit and messages generated by the control unit 206, etc., via public wireless communication through the base station 107. The communication unit 204 is also responsible for receiving messages, etc., from other devices via the base station 107.

[0031] The control unit 205 is a control unit that controls and manages various functions within the smartphone.

[0032] (Control device configuration) Figure 3 shows an example of the configuration of the control device 105 in this embodiment. The control device 105 comprises a broker unit 301, a storage unit 302, a communication unit 303, an automatic driving control unit 304, and a control unit 305.

[0033] The broker unit 301 mediates communication between a publish device and a subscribe device in a publish / subscribe type communication via the communication unit 303.

[0034] An example of the processing performed by the broker unit 301 is described below. When the broker unit 301 receives a subscribe registration request (subscribe request) sent from another device, it stores the device in the storage unit 302, associating it with the desired topic, such as its IP address and port number. Furthermore, when it receives a distribution request from another device, if it has received a subscribe registration request for the topic of the distribution request, it distributes the message to that device. In other words, the broker unit 301 functions as a receiving unit that accepts subscribe request messages and a forwarding unit that forwards messages from publishers.

[0035] The communication unit 303 is equipped with a wireless communication circuit and performs the sending and receiving of publish / subscribe type messages, such as receiving subscribe requests and sending publish requests, which are processed by the broker unit 301.

[0036] The automatic driving control unit 304 sends and receives control messages to control the automatic driving of a vehicle traveling within the parking lot. The control device 105 controls the automatic driving of vehicle 102 based on information acquired from surveillance cameras and the vehicle, and guides vehicle 102 by instructing it to a desired parking position within the parking lot.

[0037] The control unit 305 controls and manages each of the functions within the control device 105 described above. In one example, the control unit 305 includes a processor and memory.

[0038] (Surveillance camera configuration) Figure 4 shows an example of the configuration of surveillance cameras 103 and 104 in this embodiment. Surveillance cameras 103 and 104 each include a camera control unit 401, a storage unit 402, an image analysis unit 403, a message processing unit 404, a communication unit 405, and a control unit 406.

[0039] The camera control unit 401 performs general processing of camera functions such as video capture and acquires video data from imaging devices such as cameras. For example, the camera control unit 401 may control the magnification, such as zooming in or zooming out, or, if the surveillance cameras 103 and 104 are equipped with movable parts that can control the shooting range, it may control the shooting range.

[0040] The memory unit 402 stores information related to the camera function, location information of the camera device, and a correspondence table of vehicle identifiers and topic names included in the distribution instructions transmitted from the control device 105 (described later). It also stores various data used for the operation of the surveillance cameras 103 and 104, such as programs executed by the control unit 406.

[0041] The video analysis unit 403 analyzes the video acquired from the camera via the camera control unit 401. Specifically, the video analysis unit 403 has the function of detecting vehicles driving within the parking lot from the captured video and acquiring identification information for those vehicles. In one example, the vehicle identification information is the vehicle's registration number. Alternatively, the vehicle identification information may be the vehicle's make and model.

[0042] The message processing unit 404 executes message communication in accordance with the publish / subscribe type of communication. The message processing unit 404 implements the publisher-side processing and generates a message for distribution based on the analysis results from the video analysis unit 403. Details of this distribution process will be described later.

[0043] The communication unit 405 sends and receives messages and other data generated by the message processing unit 404 with other devices in the communication system 101. The control unit 406 controls and manages the various functions within the surveillance cameras 103 and 104 described above. In one example, the control unit 406 includes a processor and memory.

[0044] (Example of processing upon receiving a registration request) Figure 5 is a flowchart showing the registration request reception processing performed by the control device 105 according to this embodiment.

[0045] In this embodiment, the registration request reception processing is initiated by the control unit 305 when the control device 105 receives a registration request from the smartphone 108. Figure 5 shows that this is performed by the control unit 305 reading and executing a computer program stored in the storage unit 302.

[0046] In this embodiment, a registration request is sent from the subscriber (smartphone 108) to the broker (control device 105) for the purpose of requesting subscription registration for a specified topic. An unsubscription request can be sent, for example, using a SUBSCRIBE message of the MQTT (Message Queueing Telemetry Transport) protocol. An unsubscription request is also called a subscription termination request.

[0047] First, in step S501 (hereinafter simply referred to as S501; the same applies to other processing steps), the control unit 305 checks whether the topic name included in the registration request contains vehicle identification information. The content of the topic name checked in S501 may be such that, for example, the control unit 305 determines that it contains vehicle identification information if the registration request includes a topic that starts with "Carnum / ". The smartphone 108 may, for example, send a registration request specifying "Carnum / NEWYORK_ABC2345" as the topic. In this case, it is assumed that the registration request is a request to subscribe to a topic related to the vehicle whose vehicle identifier is "NEWYORK_ABC2345".

[0048] In this embodiment, it is assumed that the fact that topics beginning with "Carnum / " contain vehicle identification information is shared in advance within the communication system 101 of the subscriber, broker, and publisher.

[0049] If the topic does not contain vehicle identification information (No. in S501), the control unit 305 determines that it has received a normal registration request and performs the normal subscription registration process (S502). In other words, when the broker receives a registration request message from the publisher in which the topic does not contain vehicle identification information, it configures the routing to forward the message to the subscriber that sent the registration request.

[0050] Routing settings can be configured, for example, by registering the topic name included in the registration request and the subscriber information of the source of the registration request in a routing table that associates topics with the IP address and port number of the destination device.

[0051] This allows the broker, upon receiving a message containing a topic name from a publisher, to refer to its routing table and forward the message to the subscribers it has subscribed to.

[0052] Furthermore, if the topic included in the registration request is not a topic that has been shared between devices in advance, the broker may determine that it is an invalid registration request and not need to configure routing. In other words, if the topic included in the registration request is neither a topic registered by a publisher nor a topic that starts with "Carnum / " as described above, the broker may not need to configure routing for the registration request.

[0053] If the topic contains vehicle identification information (Yes in S501), the control unit 305 registers the subscriber that sent the registration request to subscribe to the topic with the topic name included in the registration request (S503). In other words, when the broker receives a message from the publisher that contains the topic name included in the registration request, it configures the routing to forward the message to the subscriber that sent the registration request.

[0054] Routing settings may be configured, for example, by registering the topic included in the registration request and the IP address of the subscriber that sent the registration request in the routing table of the storage unit 302, which associates topics with the IP addresses of the destination devices.

[0055] After registration, the control unit 305 sends a registration request response to the subscriber that sent the registration request (S504). In this embodiment, the registration request response is sent as an acknowledgment of the registration request from the subscriber. The registration request response may also be sent using, for example, the MQTT protocol's SUBACK message.

[0056] Next, the control unit 305 checks whether the topic included in the registration request has already been registered by another subscriber (S505). That is, the control unit 305 refers to the routing table described in S503 and checks whether the topic included in the registration request is associated with a subscriber other than the subscriber that sent the registration request.

[0057] If the topic has not been registered by any other subscriber (No in S505), the control unit 305 sends a distribution instruction to the surveillance cameras 103 and 104 instructing them to distribute the topic included in the registration request (S506).

[0058] The distribution instruction transmitted by S506 includes at least the topic of the information to be distributed. The distribution instruction may also be transmitted from the control device 105 to each surveillance camera installed in the parking lot via unicast communication, or it may be distributed to each surveillance camera via broadcast communication.

[0059] If the topic for which registration is requested has already been registered by another subscriber (Yes in S505), the control unit 305 determines that the distribution instruction for that topic has already been sent and terminates processing. Following S506, the control unit 305 waits for distribution instruction responses from publishers and terminates processing when it has received distribution instruction responses from all publishers (S507).

[0060] (Example of processing upon receiving a delivery instruction) Figure 6 is a flowchart showing the processing performed when a distribution instruction is received by surveillance cameras 103 and 104 in this embodiment.

[0061] In this embodiment, the processing upon receiving a distribution instruction is initiated by the control unit 406 when the surveillance cameras 103 and 104 receive a distribution instruction from the control device 105. Figure 6 shows that this is performed by the control unit 406 reading and executing a computer program stored in the storage unit 402.

[0062] After processing begins, the control unit 406 extracts vehicle identification information from the topic included in the distribution instruction and registers the topic and vehicle identification information in association with each other in the information table stored in the storage unit 402 (S601).

[0063] Figure 7 shows an example of an information table that associates vehicle identification information with topics. In the distribution process described later, surveillance cameras 103 and 104 refer to this information table to distribute information on topics corresponding to the detected vehicles. After registration, the control unit 406 sends a response to the distribution instruction to the control device 105 (S602).

[0064] The response sent in S602 may be sent when the registration process in S601 is successfully completed. Alternatively, the response may include the processing result.

[0065] (Processing upon vehicle detection) Figure 8 is a flowchart showing the vehicle detection process performed by the surveillance cameras 103 and 104 according to this embodiment.

[0066] In this embodiment, vehicle detection processing is initiated by the control unit 406 when the surveillance cameras 103 and 104 detect a vehicle from the captured images. Figure 8 shows that this is performed by the control unit 406 reading and executing a computer program stored in the storage unit 402.

[0067] First, the control unit 406 extracts the identification information of the detected vehicle from the captured image (S801). After extraction, the control unit 406 refers to the information table stored in the storage unit 402 and checks whether the extracted vehicle identifier is registered in the information table (S802).

[0068] If the vehicle is registered in the information table (Yes in S802), the control unit 406 publishes the location information of the detected vehicle in the topic corresponding to the extracted vehicle identifier and terminates the process (S803).

[0069] The vehicle location information distributed by S803 may be calculated from the captured image and then distributed. Alternatively, the location information of the detected camera may be distributed as vehicle location information. For camera location information, the camera location information measured in advance by GPS or the like may be stored in the memory unit S402. Or, the vehicle location may be in the form of text information that the user can recognize on the smartphone 108, such as "surveillance camera at point A on the second floor of the parking lot". Alternatively, S803 may distribute image data captured by the camera along with the location information.

[0070] (Processing upon receiving a cancellation request) Figure 9 is a flowchart showing the processing performed by the control device 105 according to this embodiment when a deregistration request is received.

[0071] In this embodiment, the processing upon receiving a deregistration request is initiated by the control unit 305 when the control device 105 receives a deregistration request from the smartphone 108. Figure 5 shows that this process is performed by the control unit 305 reading and executing a computer program stored in the storage unit 302.

[0072] In this embodiment, the unsubscription request is sent by the subscriber to the broker for the purpose of requesting the unsubscription of a currently registered topic. The unsubscription request may be sent, for example, using the UNSUBSCRIBE message of the MQTT protocol.

[0073] The control unit 305 cancels the subscription of the sender subscriber to the topic included in the unsubscribe request (S901). After cancellation, the control unit 305 sends an unsubscribe request response to the sender subscriber of the unsubscribe request (S902). In this embodiment, the unsubscribe request response is sent as an acknowledgment of the unsubscribe request from the subscriber. The unsubscribe request response may also be sent, for example, using the MQTT protocol's UNSUBACK message.

[0074] The control unit 305 checks whether all subscribers have been unsubscribed from the topic included in the unsubscribe request (S903). If all subscribers have been unsubscribed (Yes in S903), the control unit 305 sends an unsubscribe instruction to the publisher instructing them to stop distributing the topic included in the unsubscribe request and terminates the process (S904).

[0075] The unsubscribe instruction transmitted by S904 includes at least the topic to be unsubscribed. The unsubscribe instruction may also be transmitted from the control device 105 to each surveillance camera installed in the parking lot via unicast communication, or it may be distributed to each surveillance camera via broadcast communication.

[0076] (Example of processing upon receiving a delivery notification instruction) Figure 10 is a flowchart showing the processing performed when a distribution stop instruction is received by the surveillance cameras 103 and 104 according to this embodiment. In this embodiment, the processing when a distribution stop instruction is received is started by the control unit 406 when the surveillance cameras 103 and 104 receive a distribution stop instruction from the control device 105. Figure 6 shows that this is performed by the control unit 406 reading and executing a computer program stored in the storage unit 402.

[0077] The control unit 406 extracts vehicle identification information from the topic included in the distribution stop instruction and deletes the entry corresponding to the extracted vehicle identification information from the information table stored in the storage unit 402 (S1001). As a result, the distribution process described in S803 is no longer executed, and the distribution process for the specified vehicle identifier can be stopped.

[0078] After deletion, the control unit 406 sends a delivery stop instruction response to the broker and terminates the process (S1002). The delivery stop instruction response sent in S1002 may be sent when the deletion process in S1001 is successfully completed. Alternatively, the processing result may be included in the response.

[0079] (Example of communication system processing) Figure 11 shows the sequence of processing operations in this embodiment.

[0080] The smartphone 108 sends a request to the control device 105 to register for a topic that distributes information about the vehicle 102 (S1101).

[0081] In S1101, for example, if the vehicle identification information of vehicle 102 is "NEWYORK_ABC2345", a registration request is sent specifying "Carnum / NEWYORK_ABC2345" as the topic.

[0082] When the control device 105 receives a registration request, it executes the registration request reception processing shown in Figure 5 and registers the smartphone 108 to the topic included in the registration request (S1102, S503).

[0083] After registering to the topic, the control device 105 sends a registration request response to the smartphone 108 (S1103, S504).

[0084] The control device 105 confirms that the topic included in the registration request has not already been registered by another subscriber (No. in S505), and sends distribution instructions to the surveillance cameras 103 and 104 (S1104, S1107, S506). When surveillance cameras 103 and 104 receive a distribution instruction in S1104 and S1107, they execute the distribution instruction reception processing shown in Figure 6 and register the topic name and vehicle identification information in association with each other in the information table stored in the storage unit 402 (S1105, S1108, S601).

[0085] After registering the vehicle identification information, the surveillance cameras 103 and 104 transmit a response to the distribution instruction to the control device 105 (S1106, S1109, S602).

[0086] After sending a response, surveillance cameras 103 and 104 detect the target vehicle from the captured image. When a vehicle is detected from the captured image, the vehicle detection process shown in Figure 8 is executed (S1110).

[0087] Surveillance cameras 103 and 104 extract the vehicle identifier of the detected vehicle from the captured image (S802), and after confirming that it matches the information registered in the information table, they distribute the vehicle's location information (S1111, S803).

[0088] The control device 105 transfers the distributed information to the smartphone 108 (S1112). This allows the user of the smartphone 108 to check the location information of the vehicle 102.

[0089] When a user wishes to remove vehicle 102 from the parking lot, the user's smartphone 108 sends a request to the control device 105 to unsubscribe from the topic that distributes information about vehicle 102 (S1113). When the control device 105 receives the unsubscribe request, it executes the processing shown in Figure 9 and unsubscribes the smartphone 108 from the topic included in the registration request (S1114, S901). After unsubscribing, the control device 105 sends an unsubscribe request response to the smartphone 108 (S1115, S902).

[0090] The control device 105 confirms that all subscribers have been unregistered (Yes in S903) and sends a stop distribution instruction for the topic to the surveillance cameras 103 and 104 (S1116, S1119, S904). When the surveillance cameras 103 and 104 receive the stop distribution instruction, they execute the stop distribution instruction reception processing shown in Figure 10 and delete the entry corresponding to the vehicle identifier extracted from the stop distribution instruction from the information table (S1117, S1120, S1001). After deletion, the surveillance cameras 103 and 104 send a stop distribution instruction response to the broker (S1118, S1121, S1002).

[0091] As a result, publishers and subscribers can exchange messages that dynamically share topic content via a broker. This makes it possible to deliver only the vehicle location information that smartphone users need from surveillance cameras to smartphones via publish / subscribe type communication.

[0092] <Second Embodiment> In the first embodiment, an example was described in which the communication system of an automated valet parking system distributes location information about a vehicle via publish / subscribe type communication.

[0093] In the second embodiment, a process for notifying that a target has been detected via publish / subscribe type communication will be described, using a management system of an information processing device in a data center as an example. Note that the same configurations, functions, and processes as in the first embodiment will be referred to using the same reference numerals, and their descriptions will be omitted.

[0094] In the data center management system 1200, the operating computers 1202 and 1203 are managed via sensor nodes with communication capabilities. In Figure 12, the temperature sensors 1204 and 1205, and the device temperature sensors 1206 and 1207 correspond to the sensor nodes (hereinafter, they may be referred to as sensor nodes 1204 to 1207 without distinction). Here, the temperature sensors 1204 and 1205 are sensors that detect the temperature of the data center, and the device temperature sensors 1206 and 1207 are sensors that detect the temperature inside devices such as the storage devices and processors of computers 1202 and 1203, respectively. In this embodiment, sensor nodes 1204 to 1207 operate as publishers in a publish / subscribe type communication. Also, the smartphones 1208 and 1209 of users A and B operate as subscribers in a publish / subscribe type communication. In addition, the control device 1201 operates as a broker in a publish / subscribe type communication.

[0095] Let's consider two users, A and B, with different management objectives. User A's objective is to detect when the temperature inside the data center exceeds a predetermined temperature; for example, a user responsible for managing the air conditioning. User B's objective is to detect when the temperature of computers 1202 and 1203 exceeds a predetermined temperature; for example, a user responsible for equipment maintenance.

[0096] In this case, users A and B have different detection targets. In this embodiment, user A wishes to receive location information when the room temperature rises above 20 degrees, and user B wishes to receive device information when the device temperature rises above 80 degrees. In this case, smartphone 1208 may send a registration request to control device 1201 that includes "airtemp / more20" as a topic. This topic combines "airtemp," which indicates that the detection target is related to room temperature, and "more20," which indicates that the condition is 20 degrees or higher. On the other hand, smartphone 1209 may send a registration request to control device 1201 that includes "devtemp / more80" as a topic. This topic combines "devtemp," which indicates that the detection target is related to device temperature, and "more80," which indicates that the condition is 80 degrees or higher.

[0097] When the control device 1201 receives a registration request, if the topic contains "airtemp", it sends a distribution instruction to the temperature sensors 1204 and 1205. On the other hand, if the topic contains "devtemp", it sends a distribution instruction to the device temperature sensors 1206 and 1207. In other words, the control device 1201 may select an information processing device that can operate as a publisher to send a distribution instruction, depending on the topic of the received registration request. This helps to suppress an increase in the number of detection targets that information processing devices in the communication system must detect.

[0098] Furthermore, although the detection target was described as detecting a vehicle in the first embodiment, it may also be an event such as the ambient temperature or device temperature exceeding a predetermined value.

[0099] Furthermore, in the first embodiment, the information processing device that detects the target is a surveillance camera, and the detection of the target is described as being performed based on the image data. However, the target may be detected by another detection device such as a sensor.

[0100] <Other Embodiments> The present invention is not limited to the embodiment described above, and can be implemented in various modified forms and is applicable to various embodiments without departing from its essence. For example, a publisher may distribute information about a person by having a subscriber specify a topic name that includes information identifying the person as identification information.

[0101] In the first embodiment, surveillance cameras 103 and 104 were described as identifying vehicle 102 based on image recognition. In one example, data used for image recognition may be received from a smartphone 108 via a control device 105. In this case, vehicle identification information can be identified by comparing the similarity between the image received from the smartphone 108 and the image data acquired by surveillance cameras 103 and 104.

[0102] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0103] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of symbols]

[0104] 101 Communication system, 102 Vehicles, 103, 104 Surveillance cameras, 105 Control devices, 106 Communication network, 107 Base stations, 108 Smartphones

Claims

1. A control device that operates as a broker in a publish / subscribe communication system, comprising: A receiving means for receiving a subscription request for a topic including identification information of a detection target from a user device operating as a subscriber; a transmission means for transmitting a message delivery instruction for the topic to an information processing device that is operable as a publisher for delivering a message on the topic when the detection target is detected after receiving the subscribe request and that has not started a delivery process as the publisher; A control device comprising:

2. a receiving means for receiving the message of the topic from the information processing device; a transfer means for transferring the message received by the receiving means to the user device; The control device according to claim 1 , further comprising:

3. 3. The control device according to claim 1, further comprising a registration unit that, when the reception unit receives the subscribe request, registers the topic included in the subscribe request as a topic to be distributed.

4. The control device according to claim 3, characterized in that the registration means, when the acceptance means accepts a request to unsubscribe from the topic from the user device, unsubscribes the topic included in the subscribe request from the topic to be distributed.

5. The receiving means further receives a request to stop subscribing to the topic from the user device; The sending means further sends an instruction to stop distribution of messages on the topic to the information processing device.

5. The control device according to claim 1, wherein the control device is a control device for controlling a control unit.

6. 6. The control device according to claim 1, wherein the detection target is a moving object.

7. 7. The control device according to claim 6, wherein the moving object is a vehicle, and the identification information corresponds to a vehicle registration number of the vehicle.

8. 8. The control device according to claim 6, wherein the message includes at least one of location information of the information processing device, identification information of the information processing device, and location information of the mobile object.

9. the information processing device includes a camera for acquiring image data of the detected moving object, The control device according to claim 6 , wherein the message includes the image data of the moving object.

10. The apparatus further includes an acquisition means for acquiring image data of the moving object from the user device, The transmitting means further transmits the image data to the information processing device, The control device according to claim 9 , wherein the information processing device detects the moving object based on the image data.

11. the communication system is an automated valet parking system; 11. The control device according to claim 6, further comprising a movement instruction unit that transmits, to the moving body, information that specifies a destination of the moving body.

12. An information processing device capable of operating as a publisher in a publish / subscribe type communication system, the information processing device having hardware for externally obtaining information for detecting a detection target, the information processing device comprising: A detection means for detecting a detection target using the hardware; a distribution means for distributing a message on the topic corresponding to the detection target when an instruction for distributing a message on the topic including identification information corresponding to the detection target is received from a control device operating as a broker and the detection means detects the detection target; An information processing device comprising:

13. The distribution means further receives an instruction to stop distribution of the topic from the control device, The information processing device according to claim 12 , further comprising: a step of stopping distribution of messages on the topic in response to the received instruction to stop distribution.

14. the detection target is a moving object, the hardware is a camera; 14. The information processing apparatus according to claim 12, wherein the detection means obtains image data of the moving object using the camera, and detects the moving object based on the obtained image data.

15. 15. The information processing apparatus according to claim 14, wherein the distribution means distributes the message including at least a part of the acquired imaging data.

16. the moving object is a vehicle, The identification information includes a vehicle registration number of the vehicle; 16. The information processing apparatus according to claim 14, wherein the detection means identifies the vehicle registration number of the vehicle by image processing.

17. The detection means includes:

17. The information processing apparatus according to claim 14, wherein image data of the moving object is acquired from the control device, and the moving object is detected based on a comparison between the imaging data and the image data.

18. the communication system is an automated valet parking system; 18. The information processing device according to claim 14, wherein a plurality of the information processing devices are provided in a parking lot.

19. A control method for a control device that operates as a broker in a publish / subscribe communication system, comprising the steps of: receiving a subscription request for a topic including identification information corresponding to a detection target from a user device operating as a subscriber; After receiving the subscribe request, transmitting a delivery instruction for the topic to an information processing device that is operable as a publisher that delivers a message on the topic when the detection target is detected and that has not started a delivery process as the publisher; A control method comprising:

20. A method for controlling an information processing device capable of operating as a publisher in a publish / subscribe type communication system and having hardware for externally obtaining information for detecting a detection target, comprising: Detecting a detection target using the hardware; and When an instruction to deliver a message on a topic including identification information corresponding to the detection target is received from a control device operating as a broker, and when the detection target is detected, a message is delivered on the topic corresponding to the detection target; A control method comprising:

21. A program executed by a control device that operates as a broker in a publish / subscribe communication system, comprising: A receiving step of receiving a subscription request for a topic including identification information corresponding to a detection target from a user device operating as a subscriber; a transmission step of transmitting a delivery instruction for the topic to an information processing device that is operable as a publisher that delivers a message on the topic when the detection target is detected after receiving the subscribe request and that has not started a delivery process as the publisher; A program comprising:

22. A program for an information processing device that can operate as a publisher in a publish / subscribe type communication system and has hardware that externally obtains information for detecting a detection target, the program comprising: a detection step of detecting a detection target using the hardware; a delivery step of delivering a message on the topic corresponding to the detection target when an instruction to deliver a message on a topic including identification information corresponding to the detection target is received from a control device operating as a broker and the detection target is detected; A program comprising: