Display control device, display system, and display control method
By processing information about moving objects and generating display images through a display control device, the problem of contact between people and autonomous driving equipment within the facility is solved, thus improving safety.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-11-28
- Publication Date
- 2026-03-17
AI Technical Summary
Existing technologies have failed to effectively address the contact issues between people moving within facilities and autonomous mobile devices, and lack corresponding information provision mechanisms.
The display control device acquires and processes the position, speed, and direction information of moving objects within the facility, generates display images, and outputs them to the display output device, providing information to avoid contact.
It effectively provides information on contact avoidance between people moving within the facility and autonomous mobile devices, thus improving safety.
Smart Images

Figure CN114730185B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to a display control device and a display control method. Background Technology
[0002] Autonomous mobile devices, such as self-propelled robots, are becoming increasingly common in buildings such as office buildings, factories, warehouses, and public facilities such as train stations.
[0003] Within the facility, contact may occur between people moving within the facility and other moving bodies such as autonomous mobile devices or other people moving within the facility.
[0004] Previously, there were technologies for avoiding contact between vehicles traveling on a road and people walking on that road (see, for example, Patent Document 1).
[0005] Existing technical documents
[0006] Patent documents
[0007] Patent Document 1: Japanese Patent Application Publication No. 2015-201113 Summary of the Invention
[0008] The problem that the invention aims to solve
[0009] The prior art disclosed in Patent Document 1 is a technology for avoiding contact between a vehicle traveling on a road and a person walking on the road, but this technology does not take into account contact between a person moving within a facility and a moving body moving within the facility.
[0010] The object of the present invention is to provide a display control device that can provide information to a person moving within a facility to prevent contact between the person moving within the facility and other moving objects moving within the facility.
[0011] Methods for solving problems
[0012] The display control device of the present invention includes: a first moving body information acquisition unit that acquires first moving body information indicating the position, moving speed, and moving direction of a first moving body moving within a facility; a second moving body information acquisition unit that acquires second moving body information indicating the position, moving speed, and moving direction of a second moving body moving within a facility; an image acquisition unit that acquires image information representing a display image based on the first moving body information acquired by the first moving body information acquisition unit and the second moving body information acquired by the second moving body information acquisition unit, wherein the display image is an image that causes a display output device installed within the facility to display in a space visible to the first moving body or the second moving body within the facility; and an image output unit that outputs the image information acquired by the image acquisition unit.
[0013] Invention Effects
[0014] According to the present invention, it is possible to provide information to people moving within a facility to avoid contact between people moving within the facility and other moving objects moving within the facility. Attached Figure Description
[0015] [ Figure 1 ] Figure 1 This is a block diagram illustrating an example of the structure of the main parts of the display system of Embodiment 1, which uses the display control device of Embodiment 1.
[0016] [ Figure 2 ] Figure 2 This is a configuration diagram showing an example of the arrangement of the display output device in the display system of Embodiment 1 within the facility.
[0017] [ Figure 3 ] Figure 3 This is a block diagram illustrating an example of the structure of the main parts of the display control device according to Embodiment 1.
[0018] [ Figure 4A ] Figure 4A This is a diagram showing an example of image information acquired by the image output unit of the display control device according to Embodiment 1.
[0019] [ Figure 4B ] Figure 4B This is a diagram showing another example of image information acquired by the image output unit of the display control device according to Embodiment 1.
[0020] [ Figure 5 ] Figure 5 This is a diagram showing another example of image information acquired by the image output unit of the display control device according to Embodiment 1.
[0021] [ Figure 6 ] Figure 6 A and Figure 6 Figure B is an example of the hardware structure of the display control device according to Embodiment 1.
[0022] [ Figure 7 ] Figure 7 This is a flowchart illustrating an example of the processing of the display control device according to Embodiment 1.
[0023] [ Figure 8 ] Figure 8 This is a block diagram illustrating an example of the structure of the main parts of the display system of Embodiment 2, which uses the display control device of Embodiment 2.
[0024] [ Figure 9 ] Figure 9This is a block diagram showing an example of the structure of the main part of the display control device according to Embodiment 2.
[0025] [ Figure 10 ] Figure 10 A, Figure 10 B. Figure 10 C and Figure 10 Figure D is an example of image information acquired by the image output unit of the display control device of Embodiment 2 when the machine in the facility is an elevator.
[0026] [ Figure 11 ] Figure 11 This diagram illustrates an example of image information acquired by the image output unit of the display control device in Embodiment 2 when the machine inside the facility is an automatic door.
[0027] [ Figure 12 ] Figure 12 This is a flowchart illustrating an example of the processing of the display control device in Embodiment 2. Detailed Implementation
[0028] The embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
[0029] Implementation Method 1
[0030] Reference Figures 1 to 7 The display control device 100 of Embodiment 1 will be described.
[0031] Reference Figure 1 and Figure 2 The structure of the main parts of the display system 10 of Embodiment 1 of the display control device 100 of Embodiment 1 will be described.
[0032] Figure 1 This is a block diagram illustrating an example of the structure of the main parts of the display system 10 of Embodiment 1, which applies the display control device 100 of Embodiment 1.
[0033] The display system 10 includes a display output device 11, a sensor 12, a moving object detection device 13, a storage device 14, and a display control device 100.
[0034] The display system 10 includes a display output device 11, a sensor 12, a motion detection device 13, a storage device 14, and a display control device 100, which are connected via a network 19 capable of transmitting and receiving information.
[0035] Display output device 11 is a display device installed within a facility that displays images within the space of the facility. The space within the facility referred to here includes areas on the structures constituting the facility or spaces formed by the structures constituting the facility.
[0036] The display output device 11 is a projection-type display device such as a front projector. The display output device 11 is installed in the facility and projects a display image onto a predetermined area on a structure constituting the facility, displaying the image on the structure.
[0037] The display output device 11 may display images that are not limited to static images, but may also be dynamic images.
[0038] The display output device 11 displays the structure of the facility that constitutes the display image, such as the floor, walls, doors, or landing doors or landing control panels of the elevators located within the facility.
[0039] The display output device 11 is a display device installed within the facility that displays images in the space within the facility, and is not limited to a projection-type display device. For example, the display output device 11 may also be an LED (Light Emitting Diode) display or an organic EL (Electro-Luminescence) display disposed on the structure constituting the facility, or it may be an aerial display. An aerial display is a device that forms images in the air.
[0040] In Embodiment 1, as an example, it is assumed that a display output device 11 installed on the ceiling or wall of the facility projects an image toward the floor of the facility and displays the image on the floor.
[0041] Figure 2 This is a configuration diagram showing an example of the arrangement of the display output device 11 included in the display system 10 of Embodiment 1 within the facility. Specifically, Figure 2 This is a view of a portion of the floors within the facility from above.
[0042] exist Figure 2 In the diagram, four display output devices 11, namely 11-1, 11-2, 11-3, and 11-4, are shown as display output devices 11. However, the display output devices 11 are not limited to four display output devices 11-1, 11-2, 11-3, and 11-4. There can be one or more display output devices 11, or three or fewer, or even five or more.
[0043] Figure 2 The rectangles shown by the dashed lines are the display areas for the images corresponding to the four display output devices 11-1, 11-2, 11-3, and 11-4, respectively.
[0044] In addition, Figure 2 The image shows two mobile bodies, namely the first mobile body 1 and the second mobile body 2, which are both moving within the facility.
[0045] Figure 2 The number of mobile entities moving within the facility shown is 2. However, the number of mobile entities moving within the facility can be 2 or more, or even 3 or more.
[0046] Furthermore, regarding mobile bodies moving within the facility, multiple mobile bodies moving within the facility can also be treated as a single mobile body.
[0047] The first mobile body 1 and the second mobile body 2 are mobile bodies such as people moving within the facility or autonomous mobile devices such as self-propelled robots moving within the facility.
[0048] exist Figure 2 As an example, the following situation is shown: a first moving body 1 moving on the first path and a second moving body 2 moving on the second path perpendicular to the first path move toward each other toward the intersection of the first path and the second path.
[0049] The movement of people within a facility can be based on walking, running, or using a wheelchair, etc.
[0050] The movement of autonomous mobile devices within a facility is either driving based on the rotation of wheels or walking by moving their legs or other means.
[0051] Additionally, the person moving within the facility may include an autonomous mobile device that can recognize the display content of the display image displayed on the display output device 11 using known image recognition technology or the like, and can move in accordance with the recognized display content. When the person moving within the facility is this autonomous mobile device, the movement of the person moving within the facility as this autonomous mobile device is either driving movement based on the rotation of wheels or walking movement based on the movement of legs or the like.
[0052] Sensor 12 is a camera device such as a digital still camera, digital video camera, or surveillance camera. Sensor 12 is, for example, installed in... Figure 2 The positions shown are capable of capturing images of the first moving body 1 and the second moving body 2. Specifically, for example, sensor 12 is configured at... Figure 2 The ceiling at the intersection of the first and second paths shown. Sensor 12 transmits sensor information representing the captured image to the motion detection device 13 via network 19.
[0053] In addition, in Embodiment 1, it is assumed that there is one sensor 12, but there may be two or more sensors 12.
[0054] The motion detection device 13 detects the position of the first moving body 1 moving on the first path using known image analysis techniques based on sensor information sent by the sensor 12. Furthermore, based on multiple positions of the first moving body 1 detected by the motion detection device 13 at different times, the motion detection device 13 detects the moving speed and direction of the first moving body 1 using known image analysis techniques. Then, the motion detection device 13 generates first moving body information representing the detected position, moving speed, and moving direction of the first moving body 1, and outputs the generated first moving body information to the display control device 100.
[0055] Similarly, the motion detection device 13 detects the position of the second moving body 2 moving on the second path using known image analysis techniques based on sensor information sent by the sensor 12. Furthermore, based on multiple positions of the second moving body 2 detected by the motion detection device 13 at different times, the motion detection device 13 detects the moving speed and direction of the second moving body 2 using known image analysis techniques. Then, the motion detection device 13 generates second moving body information representing the detected position, moving speed, and moving direction of the second moving body 2, and outputs the generated second moving body information to the display control device 100.
[0056] The moving body detection device 13 can also detect the respective categories of the first moving body 1 and the second moving body 2, in addition to detecting their respective positions, moving speeds and moving directions.
[0057] The categories of the first mobile body 1 and the second mobile body 2 are, for example, autonomous mobile devices such as humans or self-propelled robots.
[0058] Furthermore, the category of "person" as one of the first moving body 1 and the second moving body 2 includes not only so-called humans, but also, for example, self-propelled robots, etc.: capable of moving in accordance with the recognized display content corresponding to the recognized display content, by recognizing the display content of the display image displayed on the display output device 11 through known image recognition technology, etc.
[0059] The mobile body detection device 13 may also detect only one of the categories of human or autonomous mobile device in the categories of the first mobile body 1 and the second mobile body 2. If the mobile body detection device 13 cannot detect a category, it may assume that it is another category of human or autonomous mobile device.
[0060] Specifically, for example, the motion detection device 13 detects the categories of the first motion 1 and the second motion 2 using image analysis technology based on sensor information sent by the sensor 12. The motion detection device 13, for example, includes information indicating the category of the detected first motion 1 in a first motion information set and outputs it to the display control device 100, and includes information indicating the category of the detected second motion 2 in a second motion information set and outputs it to the display control device 100.
[0061] Furthermore, the method of detecting the position, speed, and direction of movement of the first moving body 1 and the second moving body 2 based on sensor information using image analysis technology is well known, and therefore its description is omitted.
[0062] Furthermore, the method of detecting the categories of the first moving body 1 and the second moving body 2 based on sensor information using image analysis technology is well known, and therefore its description is omitted.
[0063] The motion detection device 13 may be installed in a designated location, such as a server room within the facility. The location for installing the motion detection device 13 is not limited to within the facility; it can be installed outside the facility as long as it can transmit and receive information with the sensor 12 and the display control device 100 via the network 19.
[0064] The moving object detection device 13 can detect the positions of the first moving object 1 and the second moving object 2 based on the sensor information sent from the sensor 12. The sensor 12 is not limited to a camera device. The sensor 12 can also be an infrared sensor, an ultrasonic sensor, a radar sensor, or a laser rangefinder, etc.
[0065] Furthermore, the method of detecting the positions of the first moving body 1 and the second moving body 2 based on sensor information output from infrared sensors, ultrasonic sensors, radar sensors, or laser rangefinders is well known, and therefore its description is omitted.
[0066] Furthermore, when the first mobile body 1 and the second mobile body 2 carry RFID (Radio Frequency Identifier) tags or devices that generate radio waves based on BLE (Bluetooth Low Energy) or other similar devices that can determine location, the sensor 12 can also receive radio waves emitted by the RFID tags or radio waves from beacons based on BLE, and output information representing the received radio waves as sensor information.
[0067] Furthermore, methods for detecting the positions of the first moving body 1 and the second moving body 2 based on information representing radio waves emitted by RFID tags or information representing radio waves from beacons such as BLE are well known, and therefore, the description is omitted.
[0068] The display control device 100 acquires the first moving body information and the second moving body information output by the moving body detection device 13, and outputs image information representing the display image corresponding to the first moving body information and the second moving body information.
[0069] The display control device 100 may be configured in a designated location, such as a server room within the facility. The location where the display control device 100 is configured is not limited to within the facility, as long as information can be obtained from the mobile body detection device 13 and the storage device 14 via the network 19. The display control device 100 may also be configured outside the facility.
[0070] Details of the display control device 100 will be described later.
[0071] Storage device 14 may include storage media such as SSD (Solid State Drive) or HDD (Hard Disk Drive). Storage device 14 reads information corresponding to a request from display control device 100 from the storage medium and outputs the read information to display control device 100.
[0072] Storage device 14 may be configured in a designated location, such as a server room within the facility. The location of storage device 14 is not limited to within the facility; it may be configured outside the facility as long as the display control device 100 can obtain information from storage device 14 via network 19.
[0073] Reference Figure 3 The structure of the main parts of the display control device 100 in Embodiment 1 will be described.
[0074] Figure 3 This is a block diagram showing an example of the structure of the main parts of the display control device 100 according to Embodiment 1.
[0075] The display control device 100 includes a first moving body information acquisition unit 110, a second moving body information acquisition unit 120, a contact prediction unit 130, a movement plan acquisition unit 140, a movement instruction unit 150, a facility configuration map acquisition unit 160, an image acquisition unit 170, and an image output unit 180.
[0076] The first moving body information acquisition unit 110 acquires first moving body information indicating the position, speed, and direction of movement of the first moving body 1 moving within the facility. Specifically, for example, the first moving body information acquisition unit 110 acquires the first moving body information generated and output by the moving body detection device 13 via the network 19.
[0077] The second mobile body information acquisition unit 120 acquires second mobile body information indicating the position, speed, and direction of movement of the second mobile body 2 moving within the facility. Specifically, for example, the second mobile body information acquisition unit 120 acquires the second mobile body information generated and output by the mobile body detection device 13 via the network 19.
[0078] In Embodiment 1, it is assumed that the motion detection device 13 operates as a device different from the display control device 100, but it is not limited to this. For example, the display control device 100 may also have the motion detection device 13 internally, and the display control device 100 may acquire the first motion information and the second motion information output by the motion detection device 13.
[0079] Furthermore, if the first mobile body 1 is an autonomous driving mobile device such as a self-propelled robot, the first mobile body information acquisition unit 110 may acquire, for example, first mobile body information output by the navigation system (not shown) of the first mobile body 1, which is an autonomous driving mobile device, indicating the position, speed and direction of movement of the first mobile body 1, without going through the mobile body detection device 13.
[0080] Similarly, when the second mobile body 2 is an autonomous driving mobile device such as a self-propelled robot, the second mobile body information acquisition unit 120 may acquire, for example, second mobile body information from the navigation system of the second mobile body 2, which is an autonomous driving mobile device, indicating the position, speed and direction of movement of the second mobile body 2, without going through the mobile body detection device 13.
[0081] For example, the first mobile body 1, which is an autonomous driving mobile device, has a wireless communication unit (not shown), through which the first mobile body 1 outputs first mobile body information. The first mobile body information output by the first mobile body 1 is acquired by the first mobile body information acquisition unit 110 via a wireless access point (not shown) connected to the network 19 and the network 19.
[0082] Similarly, the second mobile body 2, which is an autonomous driving mobile device, has a wireless communication unit, through which the second mobile body 2 outputs second mobile body information. The second mobile body information output by the second mobile body 2 is acquired by the second mobile body information acquisition unit 120 via a wireless access point connected to the network 19 and the network 19.
[0083] Furthermore, when the first mobile body 1 is an autonomous driving mobile device and the first mobile body 1 moves by obtaining control information output by a mobile control device (not shown) that controls the movement of the autonomous driving mobile device via the network 19, the first mobile body information acquisition unit 110 may also obtain first mobile body information indicating the position, movement speed and movement direction of the first mobile body 1 from the mobile control device without going through the mobile body detection device 13.
[0084] Similarly, when the second mobile body 2 is an autonomous driving mobile device and the second mobile body 2 moves by obtaining control information output by a mobile control device that controls the movement of the autonomous driving mobile device via network 19, the second mobile body information acquisition unit 120 may also obtain second mobile body information indicating the position, speed and direction of movement of the second mobile body 2 from the mobile control device without going through the mobile body detection device 13.
[0085] In addition, as described above, when the first mobile body information acquisition unit 110 acquires the first mobile body information without via the mobile body detection device 13, the first mobile body 1 or the mobile control device may also include information indicating that the category of the first mobile body 1 is an autonomous driving mobile device such as a self-propelled robot in the first mobile body information and output the first mobile body information.
[0086] Similarly, as described above, when the second mobile body information acquisition unit 120 acquires the second mobile body information without via the mobile body detection device 13, the second mobile body 2 or the mobile control device may also include information indicating that the category of the second mobile body 2 is an autonomous driving mobile device such as a self-propelled robot in the second mobile body information and output the second mobile body information.
[0087] The image acquisition unit 170 acquires image information representing the display image based on the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquisition unit 120, and causes the display output device 11 installed in the facility to display the display image in the space within the facility.
[0088] The image acquisition unit 170 reads the image information from the storage device 14, for example, thereby acquiring the image information.
[0089] For example, based on the first moving body information and the second moving body information, if the category of the first moving body 1 or the second moving body 2 is human, the image acquisition unit 170 acquires at least image information representing the display image, so that the display image is displayed in the visible space of the first moving body 1 or the second moving body 2, which is of the category of human.
[0090] With this configuration, the display control device 100 can provide information to either the first mobile body 1 or the second mobile body 2, which is a person moving within the facility, to prevent contact between the first mobile body 1 and the second mobile body 2 moving within the facility.
[0091] Furthermore, the image information acquired by the image acquisition unit 170 may be displayed as a dynamic image, not a static image.
[0092] Furthermore, the image information acquired by the image acquisition unit 170 is not limited to one; for example, it may be acquired by the display output device 11, such as... Figure 2 When multiple display output devices 11-1, 11-2, 11-3, and 11-4 are shown, the image acquisition unit 170 can also acquire image information corresponding to the multiple display output devices 11-1, 11-2, 11-3, and 11-4 respectively based on the first moving body information and the second moving body information.
[0093] Details of the image acquisition unit 170 will be described later.
[0094] The image output unit 180 outputs the image information acquired by the image acquisition unit 170.
[0095] Specifically, for example, the image output unit 180 outputs the image information acquired by the image acquisition unit 170 to the display output device 11 installed in the facility.
[0096] More specifically, for example, the image output unit 180 outputs the image information acquired by the image acquisition unit 170 as an image signal for the display output device 11 to output as a display image.
[0097] The display output device 11 receives image information output by the image output unit 180 and displays the image shown by the image information in the space within the facility.
[0098] The facility layout map acquisition unit 160 acquires facility layout map information showing the location of structures constituting the facility, such as passageways, walls, or machines, within the facility. For example, the facility layout map acquisition unit 160 reads the facility layout map information from the storage device 14 via the network 19, thereby acquiring the facility layout map information. The facility layout map acquisition unit 160 outputs the acquired facility layout map information to the image acquisition unit 170.
[0099] In addition, the facility configuration diagram acquisition unit 160 is not a necessary structure in the display control device 100.
[0100] When the display control device 100 has a facility configuration map acquisition unit 160, the image acquisition unit 170 can also acquire image information based on the facility configuration map information acquired by the facility configuration map acquisition unit 160, in addition to the first mobile body information acquired by the first mobile body information acquisition unit 110 and the second mobile body information acquired by the second mobile body information acquisition unit 120.
[0101] When the first mobile body 1 or the second mobile body 2 is an autonomously operated mobile device moving within the facility, the movement plan acquisition unit 140 acquires movement plan information representing the movement plan within the first mobile body 1 or the second mobile body 2, which is an autonomously operated mobile device. For example, the movement plan acquisition unit 140 reads the movement plan information from the storage device 14 via the network 19, thereby acquiring the movement plan information. The movement plan acquisition unit 140 may also acquire the movement plan information from the autonomously operated mobile device or the aforementioned movement control device via the network 19. The movement plan acquisition unit 140 outputs the acquired movement plan information to the image acquisition unit 170.
[0102] The first mobile body 1 or the second mobile body 2, as an autonomous driving mobile device, moves within the facility according to the predetermined mobile plan shown in the mobile plan information.
[0103] Furthermore, the mobile plan acquisition unit 140 is not a necessary component in the display control device 100.
[0104] When the display control device 100 has a movement plan acquisition unit 140, the image acquisition unit 170 can also acquire image information based on the movement plan information acquired by the movement plan acquisition unit 140, in addition to the first movement information acquired by the first movement information acquisition unit 110 and the second movement information acquired by the second movement information acquisition unit 120. The movement plan information acquired by the movement plan acquisition unit 140 is not limited to information representing the movement plan in the first movement 1 or the second movement 2, which are autonomous driving mobile devices, but can also be information representing the movement prediction result obtained by predicting the movement direction of the first movement 1 or the second movement 2.
[0105] The contact prediction unit 130 predicts whether the first moving body 1 and the second moving body 2 may come into contact based on the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquired by the second moving body information acquisition unit 120. The contact prediction unit 130 outputs the prediction result of whether the first moving body 1 and the second moving body 2 may come into contact to the image acquisition unit 170.
[0106] In addition, the contact prediction unit 130 is not a necessary structure in the display control device 100.
[0107] When the display control device 100 has a contact prediction unit 130, the image acquisition unit 170 can also acquire image information based on the prediction result predicted by the contact prediction unit 130, in addition to the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquired by the second moving body information acquisition unit 120.
[0108] Furthermore, when the display control device 100 has a facility configuration map acquisition unit 160, the contact prediction unit 130 can also predict whether the first mobile body 1 and the second mobile body 2 may come into contact, based on the first mobile body information acquired by the first mobile body information acquisition unit 110 and the second mobile body information acquired by the second mobile body information acquisition unit 120, and based on the facility configuration map information acquired by the facility configuration map acquisition unit 160.
[0109] Furthermore, when the first mobile body 1 or the second mobile body 2 is an autonomous driving mobile device moving within the facility and the display control device 100 has a movement plan acquisition unit 140, the contact prediction unit 130 can also predict whether the first mobile body 1 and the second mobile body 2 may come into contact based on the first mobile body information acquired by the first mobile body information acquisition unit 110 and the second mobile body information acquired by the second mobile body information acquisition unit 120, and also based on the movement plan information acquired by the movement plan acquisition unit 140.
[0110] When the first mobile body 1 or the second mobile body 2 is an autonomous driving mobile device moving within the facility, the movement instruction unit 150 outputs movement instruction information indicating a temporary stop or resumption of movement for the first mobile body 1 or the second mobile body 2, which is an autonomous driving mobile device.
[0111] Specifically, the motion instruction unit 150 outputs motion instruction information corresponding to the display image shown by the image information acquired by the image acquisition unit 170.
[0112] For example, the motion instruction unit 150 outputs motion instruction information to the autonomous driving mobile device or the aforementioned motion control device via the network 19.
[0113] Furthermore, the movement indicator 150 is not a necessary component in the display control device 100.
[0114] Reference Figure 4A , Figure 4B and Figure 5 The image information acquired by the image acquisition unit 170 of Embodiment 1 based on the first moving body information and the second moving body information will be described.
[0115] Below, as an example, we will assume that the first mobile body 1 is a person moving within the facility, and the second mobile body 2 is an autonomous mobile device such as a self-propelled robot moving within the facility or a person moving within the facility.
[0116] Figure 4A and Figure 4B This is a diagram showing an example of image information acquired by the image acquisition unit 170 of Embodiment 1 based on the first moving body information and the second moving body information.
[0117] More specifically, Figure 4A and Figure 4B This is a diagram showing the state of the displayed image as obtained by the image acquisition unit 170 through the display output device 11, and it is a diagram of a portion of the floors within the facility viewed from above.
[0118] Figure 4A and Figure 4B and Figure 2 The configuration diagram shown also illustrates the first path and the second path perpendicular to the first path. Furthermore, in... Figure 4A and Figure 4B In the diagram, four display output devices 11-1, 11-2, 11-3, and 11-4 are shown as display output devices 11. Furthermore, in... Figure 4A and Figure 4B The image shows a first moving body 1 moving in the first path and a second moving body 2 moving in the second path.
[0119] Figure 4A and Figure 4B The first moving body 1 shown is in Figure 4A and Figure 4B The arrow X shown indicates movement in the first path.
[0120] also, Figure 4A and Figure 4B The second moving body 2 shown is in Figure 4A and Figure 4B The direction of arrow Y shown indicates movement in the second path.
[0121] For example, the image acquisition unit 170 determines, based on the first moving body information and the second moving body information, whether the moving body that first invades the intersection of the first path and the second path is the first moving body 1 or the second moving body 2, and acquires image information indicating a display image that prompts movement for the moving body that first invades the intersection and prompts stop for the moving body that later invades the intersection.
[0122] The image acquisition unit 170 acquires, for example, image information indicating a display image that prompts a movement of a mobile body that subsequently enters the intersection after the mobile body that first entered the intersection has passed through the intersection, based on the first mobile body information and the second mobile body information.
[0123] Figure 4A The following state is shown: when the first moving body 1, which is a person moving within the facility, first enters the intersection, the image acquisition unit 170, for example, acquires image information that indicates a prompt for movement for the first moving body 1, which is a person moving within the facility, and an indication for the second moving body 2, which is a person moving within the facility, to stop.
[0124] also, Figure 4A The following state is shown: when a first moving body 1, which is a person moving within the facility, first enters the intersection, the image acquisition unit 170, for example, acquires image information indicating that the first moving body 1, which is a person moving within the facility, is moving and the second moving body 2, which is a person moving within the facility, prompts the first moving body 1 to move and prompts the second moving body 2 to stop.
[0125] With this configuration, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to prevent contact between the first mobile body 1, which is a person moving within the facility, and the second mobile body 2, which is moving within the facility.
[0126] Furthermore, by this configuration, the display control device 100 can provide information to the first mobile body 1 and the second mobile body 2, which are people moving within the facility, to prevent contact between the first mobile body 1 and the second mobile body 2, which are people moving within the facility.
[0127] Furthermore, the image acquisition unit 170 can also determine the image information to be acquired based on the first moving body information and the second moving body information, according to a preset movement rule, namely a priority path rule. The priority path rule, for example, sets a priority order for the movement of a moving body moving on the first path and the movement of a moving body moving on the second path. The image acquisition unit 170 may have information indicating the priority path rule in advance; furthermore, the image acquisition unit 170 can also acquire the information indicating the priority path rule from the storage device 14 via the network 19.
[0128] Specifically, for example, the image acquisition unit 170 acquires image information indicating a prompt to move for the mobile body moving on the higher priority path (either the first mobile body 1 moving on the first path or the second mobile body 2 moving on the second path), and a prompt to stop for the mobile body moving on the lower priority path, based on the first mobile body information, the second mobile body information, and a preset priority path rule. When the mobile body moving on the first path is prioritized over the mobile body moving on the second path, the image acquisition unit 170, for example, acquires image information indicating... Figure 4A The image information shown is for the displayed image.
[0129] The image acquisition unit 170, for example, acquires image information indicating that a mobile body moving on a high-priority path has passed the intersection of the first and second paths, and displays a moving image for a mobile body moving on a low-priority path, based on the first mobile body information, the second mobile body information, and a preset priority path rule.
[0130] With this configuration, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to prevent contact between the first mobile body 1, which is a person moving within the facility, and the second mobile body 2, which is moving within the facility.
[0131] Furthermore, by this configuration, the display control device 100 can provide information to the first mobile body 1 and the second mobile body 2, which are people moving within the facility, to prevent contact between the first mobile body 1 and the second mobile body 2, which are people moving within the facility.
[0132] Furthermore, when the second mobile body 2 is an autonomous mobile device moving within the facility, the image acquisition unit 170 can, based on the first mobile body information and the second mobile body information, also determine the image information to be acquired according to a preset movement rule, namely a priority movement rule. The priority movement rule, for example, sets a priority order for the movement of people moving within the facility and the movement of autonomous mobile devices moving within the facility. The image acquisition unit 170 may have information indicating the priority movement rule in advance; furthermore, the image acquisition unit 170 can also acquire the information indicating the priority movement rule from the storage device 14 via the network 19.
[0133] Specifically, for example, the image acquisition unit 170 acquires image information indicating that it prompts movement for a person moving within the facility or an autonomous mobile device moving within the facility with higher priority, and prompts stopping for another mobile device with lower priority, based on the first mobile body information, the second mobile body information, and a preset priority mobile body rule. When prioritizing movement for a person moving within the facility over an autonomous mobile device moving within the facility, the image acquisition unit 170, for example, acquires an image indicating... Figure 4A The image information shown is for the displayed image.
[0134] The image acquisition unit 170 acquires, for example, image information indicating that after a higher-priority mobile body passes through the intersection of the first and second paths, a movement is prompted for another mobile body with a lower priority, based on the first mobile body information, the second mobile body information, and a preset priority mobile body rule.
[0135] With this configuration, when a person moving within the facility and an autonomous mobile device moving within the facility coexist, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to prevent contact between the first mobile body 1, which is a person moving within the facility, and the second mobile body 2, which is moving within the facility.
[0136] The image acquisition unit 170 determines the image information to be acquired, for example, based on the first moving body information and the second moving body information. Specifically, for example, the image acquisition unit 170 calculates a first distance (the distance from the intersection of the first and second paths to the position of the first moving body 1 shown in the first moving body information) and a second distance (the distance from the intersection to the position of the second moving body 2 shown in the second moving body information), and determines the image information to be acquired based on these first and second distances. More specifically, for example, the image acquisition unit 170 calculates the first and second distances based on the first moving body information, the second moving body information, and the facility configuration map information acquired by the facility configuration map acquisition unit 160. For example, the image acquisition unit 170 acquires image information representing different display images, such as color, size, shape, or animation patterns in a dynamic image, when the first or second distance is longer than a predetermined distance, or when the first or second distance is shorter than a predetermined distance.
[0137] Furthermore, for example, the image acquisition unit 170 may determine the image information to be acquired based on the moving speed of the first moving body 1 as indicated by the first moving body information or the moving speed of the second moving body 2 as indicated by the second moving body information. More specifically, for example, the image acquisition unit 170 acquires image information representing different display images, such as color, size, shape, or animation patterns in a dynamic image, when the moving speed of the first moving body 1 or the moving speed of the second moving body 2 is slower than a predetermined moving speed, or when the moving speed of the first moving body 1 or the moving speed of the second moving body 2 is faster than a predetermined moving speed.
[0138] Furthermore, when the second mobile body 2 is an autonomous driving mobile device moving within the facility, the image acquisition unit 170 can also acquire image information based on the first mobile body information and the second mobile body information, as well as the mobile plan information representing the mobile plan of the autonomous driving mobile device acquired by the mobile plan acquisition unit 140.
[0139] Figure 4B The diagram illustrates the following situation: A second mobile body 2, an autonomous driving mobile device moving on a second path, turns right at the intersection of the first and second paths in the direction of the first mobile body 1, according to the movement plan shown in the movement plan information, and then moves on the first path after the right turn. In this case, for example... Figure 4B As shown, the image acquisition unit 170 considers the size, turning radius, or inner wheel difference of the second mobile body 2, which is an autonomous driving mobile device, and acquires image information representing a display image that prompts the first mobile body 1, which is a person moving within the facility, to retreat to an area in the first passage where the second mobile body 2 is not moving.
[0140] The image acquisition unit 170 acquires, for example, image information indicating that after the second mobile body 2, which is an autonomous driving mobile device, passes through the intersection of the first path and the second path, a display image is provided to the first mobile body 1, which is a person moving within the facility.
[0141] With this configuration, when a person moving within the facility and an autonomous mobile device moving within the facility coexist, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to prevent contact between the first mobile body 1, which is a person moving within the facility, and the second mobile body 2, which is moving within the facility.
[0142] Furthermore, the image acquisition unit 170 may also acquire image information representing the display image displayed by the display output device 11 installed in the facility in the space of the facility, based on the first moving body information and the second moving body information, and based on the prediction result of whether the first moving body 1 and the second moving body 2 may come into contact as predicted by the contact prediction unit 130.
[0143] Specifically, for example, if the contact prediction unit 130 predicts that the first moving body 1 and the second moving body 2 may come into contact, the image acquisition unit 170 acquires image information representing a display image shown in the space within the facility, based on the first moving body information and the second moving body information, as information to prevent contact between the first moving body 1 (a person moving within the facility) and the second moving body 2 (a person moving within the facility). Furthermore, if the contact prediction unit 130 predicts that the first moving body 1 and the second moving body 2 are unlikely to come into contact, and therefore there is no need to acquire image information representing a display image shown in the space within the facility, as information to prevent contact between the first moving body 1 and the second moving body 2. Additionally, in this case, the image acquisition unit 170 may also acquire specified image information to alert the first moving body 1 (a person moving within the facility) to the presence of an approaching second moving body 2.
[0144] With this configuration, the display control device 100, when predicting a possible contact between the first moving body 1 and the second moving body 2, can provide information to the first moving body 1 (a person moving within the facility) to prevent contact between the first moving body 1 and the second moving body 2. Furthermore, when predicting that contact between the first moving body 1 and the second moving body 2 is impossible, the display control device 100 can omit acquiring and outputting image information such as display images indicating a stop prompt for either the first moving body 1 or the second moving body 2.
[0145] Furthermore, when the image acquisition unit 170 acquires image information indicating that the second mobile body 2 is an autonomously operated mobile device moving within the facility and the image acquisition unit 170 has acquired image information that suggests the second mobile body 2 to stop for the first mobile body 1, which is a person moving within the facility, the movement instruction unit 150 can also output movement instruction information indicating that the movement of the autonomously operated mobile device 2 has temporarily stopped. Additionally, after the first mobile body 1, which is a person moving within the facility, passes the intersection of the first and second paths, the image acquisition unit 170 can also output movement instruction information indicating that the movement of the autonomously operated mobile device has resumed.
[0146] Figure 5 This is a diagram showing another example of image information acquired by the image acquisition unit 170 of Embodiment 1 based on the first moving body information and the second moving body information.
[0147] More specifically, Figure 5 This is a diagram showing the state of the displayed image, which is the image information obtained by the image acquisition unit 170 displayed through the display output device 11 in this state. It is a diagram of a portion of the floors within the facility viewed from above.
[0148] Figure 5 The first pathway is shown. Furthermore, in Figure 5 The image shows a first moving body 1 and a second moving body 2 moving on the first path.
[0149] Figure 5 The first moving body 1 shown is in Figure 5 The arrow X shown indicates movement in the first path.
[0150] also, Figure 5 The second moving body 2 shown is in Figure 5 The arrow Y indicates movement in the direction of the first path.
[0151] The image acquisition unit 170 can also acquire image information based on the first moving body information and the second moving body information, as well as according to preset movement rules, i.e., traffic rules. Traffic rules, for example, prioritize left-hand or right-hand traffic based on actual rules or customs for the movement of moving bodies. The image acquisition unit 170 may have information indicating traffic rules in advance, and the image acquisition unit 170 can also acquire information indicating traffic rules from the storage device 14 via the network 19.
[0152] Specifically, for example, the image acquisition unit 170 acquires image information representing a display image indicating that the first moving body 1 and the second moving body 2 are being moved to either the left or right side, based on the first moving body information, the second moving body information, and a preset passage rule. Figure 5 This is a diagram showing a display image indicating that the first moving body 1 and the second moving body 2 are moving to the left.
[0153] With this configuration, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to prevent contact between the first mobile body 1, which is a person moving within the facility, and the second mobile body 2, which is moving within the facility.
[0154] Furthermore, by this configuration, the display control device 100 can provide information to the first mobile body 1 and the second mobile body 2, which are people moving within the facility, to prevent contact between the first mobile body 1 and the second mobile body 2, which are people moving within the facility.
[0155] Furthermore, the display control device 100 can also send control information to cause the display output device 11 to display a display image and to cause the second mobile body 2, which is an autonomous driving mobile device, to move in accordance with the display image.
[0156] Reference Figure 6 A and Figure 6 B describes the hardware structure of the main parts of the display control device 100 in Embodiment 1.
[0157] Figure 6 A and Figure 6 Figure B is an example of the hardware structure of the display control device 100 according to Embodiment 1.
[0158] like Figure 6As shown in Figure A, the display control device 100 is composed of a computer, which has a processor 601 and a memory 602. The memory 602 stores programs for enabling the computer to function as a first mobile body information acquisition unit 110, a second mobile body information acquisition unit 120, a contact prediction unit 130, a movement plan acquisition unit 140, a movement instruction unit 150, a facility configuration map acquisition unit 160, an image acquisition unit 170, and an image output unit 180. The processor 601 reads and executes the programs stored in the memory 602, thereby implementing the functions of the first mobile body information acquisition unit 110, the second mobile body information acquisition unit 120, the contact prediction unit 130, the movement plan acquisition unit 140, the movement instruction unit 150, the facility configuration map acquisition unit 160, the image acquisition unit 170, and the image output unit 180.
[0159] In addition, such as Figure 6 As shown in B, the display control device 100 can also be configured by the processing circuit 603. In this case, the functions of the first moving body information acquisition unit 110, the second moving body information acquisition unit 120, the contact prediction unit 130, the movement plan acquisition unit 140, the movement instruction unit 150, the facility configuration map acquisition unit 160, the image acquisition unit 170, and the image output unit 180 can also be implemented by the processing circuit 603.
[0160] Furthermore, the display control device 100 may also be composed of a processor 601, a memory 602, and a processing circuit 603 (not shown). In this case, some of the functions of the first mobile body information acquisition unit 110, the second mobile body information acquisition unit 120, the contact prediction unit 130, the movement plan acquisition unit 140, the movement instruction unit 150, the facility configuration map acquisition unit 160, the image acquisition unit 170, and the image output unit 180 may be implemented by the processor 601 and the memory 602, while the remaining functions may be implemented by the processing circuit 603.
[0161] Processor 601 may be a CPU (Central Processing Unit), GPU (Graphics Processing Unit), microprocessor, microcontroller, or DSP (Digital Signal Processor).
[0162] The memory 602 may be a semiconductor memory or a disk. More specifically, the memory 602 may be a RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), SSD, or HDD.
[0163] The processing circuit 603 may use, for example, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), a SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration).
[0164] Reference Figure 7 The operation of the display control device 100 in Embodiment 1 will be explained.
[0165] Figure 7 This is a flowchart illustrating an example of the processing of the display control device 100 according to Embodiment 1. The display control device 100, for example, repeatedly executes the processing shown in the flowchart.
[0166] First, in step ST701, the facility configuration diagram acquisition unit 160 acquires facility configuration diagram information.
[0167] Next, in step ST702, the first moving body information acquisition unit 110 acquires the first moving body information.
[0168] Next, in step ST703, the second moving body information acquisition unit 120 acquires the second moving body information.
[0169] Next, in step ST704, the movement plan acquisition unit 140 acquires movement plan information representing the movement plan of the autonomous driving mobile device when the second moving body 2 is an autonomous driving mobile device moving within the facility.
[0170] Next, in step ST705, the contact prediction unit 130 predicts whether the first moving body 1 and the second moving body 2 may come into contact and outputs the prediction result.
[0171] Next, in step ST706, the image acquisition unit 170 acquires image information.
[0172] Next, in step ST707, the image output unit 180 outputs image information.
[0173] Next, in step ST708, the movement instruction unit 150 outputs movement instruction information indicating the movement instruction of the autonomous driving mobile device when the second moving body 2 is an autonomous driving mobile device moving within the facility.
[0174] After step ST708, the display control device 100 ends the processing of the flowchart. After ending the processing of the flowchart, the display control device 100 returns to step ST702 and repeatedly executes the processing of the flowchart.
[0175] In addition, if the display control device 100 does not have a facility configuration diagram acquisition unit 160, the processing of step ST701 is omitted.
[0176] Furthermore, if the display control device 100 does not have a movement plan acquisition unit 140, the processing of step ST704 is omitted.
[0177] Furthermore, if the display control device 100 does not have a contact prediction unit 130, the processing step ST705 is omitted.
[0178] Furthermore, if the display control device 100 does not have a movement indicator 150, the processing of step ST708 is omitted.
[0179] Furthermore, the order of processing steps ST701 to ST703 is arbitrary.
[0180] As described above, the display control device 100 of Embodiment 1 includes: a first moving body information acquisition unit 110, which acquires first moving body information indicating the position, moving speed, and moving direction of a first moving body 1 moving within the facility; a second moving body information acquisition unit 120, which acquires second moving body information indicating the position, moving speed, and moving direction of a second moving body 2 moving within the facility; an image acquisition unit 170, which acquires image information representing a display image based on the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquired by the second moving body information acquisition unit 120, and causes a display output device 11 installed within the facility to display the display image in the space within the facility; and an image output unit 180, which outputs the image information acquired by the image acquisition unit 170.
[0181] With this configuration, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to prevent contact between the first mobile body 1, which is a person moving within the facility, and the second mobile body 2, which is moving within the facility.
[0182] Furthermore, compared to roads where vehicles travel, pathways and other passageways within facilities where people or autonomous mobile devices move together have more blind spots due to the walls and other structures that make up the facilities. With this configuration, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to prevent contact between the first mobile body 1, which is a person moving within the facility, and a second mobile body 2, which is moving within the facility in a blind spot of the first mobile body 1.
[0183] Furthermore, in the prior art disclosed in Patent Document 1, pedestrians need to carry portable terminals. In contrast, in the display control device 100, by such a configuration, the first mobile body 1, as a person moving within the facility, does not need to carry a portable terminal. Even if the first mobile body 1 does not carry a portable terminal, the display control device 100 can still provide the first mobile body 1 with information to avoid contact between the first mobile body 1 and the second mobile body 2.
[0184] Furthermore, in the prior art disclosed in Patent Document 1, pedestrians need to shift their gaze from the direction of travel to the portable terminal to visually confirm the danger information displayed on the portable terminal. In contrast, in the display control device 100, by such a configuration, information for preventing contact between the first mobile body 1 and the second mobile body 2 is displayed in the visible space of the first mobile body 1 within the facility. Therefore, the time required for the person acting as the first mobile body 1 to confirm the information and take appropriate action can be shortened.
[0185] Furthermore, the display control device 100 of Embodiment 1 is configured such that, in the above-described structure, the image acquisition unit 170 acquires image information representing a display image based on the first moving body information and the second moving body information, when the category of the first moving body 1 or the second moving body 2 is a human, so that the display image is displayed in the visible space of the first moving body 1 or the second moving body 2, which is a human.
[0186] With this configuration, the display control device 100 can provide information to people moving within the facility to prevent contact between people moving within the facility and other moving objects moving within the facility.
[0187] Furthermore, the display control device 100 of Embodiment 1 is configured to include, based on the above-described structure, a facility configuration diagram acquisition unit 160, which acquires facility configuration diagram information indicating the configuration positions of the structures constituting the facility, and an image acquisition unit 170, based on the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquired by the second moving body information acquisition unit 120, also acquires image information based on the facility configuration diagram information acquired by the facility configuration diagram acquisition unit 160.
[0188] With this configuration, the display control device 100 can provide information to the first mobile body 1, which is a person moving within the facility, to avoid contact between the first mobile body 1 and the second mobile body 2 moving within the facility, depending on the configuration of the structures constituting the facility.
[0189] Furthermore, the display control device 100 of Embodiment 1 is configured to include a movement plan acquisition unit 140, which, when the first moving body 1 or the second moving body 2 is an autonomous driving mobile device moving within the facility according to a predetermined movement plan, acquires movement plan information representing the movement plan in the first moving body 1 or the second moving body 2, which is an autonomous driving mobile device. The image acquisition unit 170 acquires image information based on the movement plan information acquired by the movement plan acquisition unit 140, in addition to the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquired by the second moving body information acquisition unit 120.
[0190] With this configuration, the display control device 100 can provide information to people moving within the facility to avoid contact between people moving within the facility and the autonomous mobile devices moving within the facility, based on the movement plan of the autonomous mobile devices moving within the facility.
[0191] Furthermore, the display control device 100 of Embodiment 1 is configured to include a contact prediction unit 130 based on the above-described structure. The contact prediction unit 130 predicts the contact between the first moving body 1 and the second moving body 2 based on the first moving body information obtained by the first moving body information acquisition unit 110 and the second moving body information obtained by the second moving body information acquisition unit 120. The image acquisition unit 170 also acquires image information based on the prediction result predicted by the contact prediction unit 130, in addition to the first moving body information obtained by the first moving body information acquisition unit 110 and the second moving body information obtained by the second moving body information acquisition unit 120.
[0192] With this configuration, when a person moving within the facility may come into contact with an autonomous mobile device moving within the facility, the display control device 100 can provide the person moving within the facility with information to avoid such contact.
[0193] Furthermore, in the above-described structure, the display control device 100 of Embodiment 1 acquires image information based on a preset movement rule, in addition to the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquired by the second moving body information acquisition unit 120.
[0194] With this configuration, the display control device 100 can provide information to people moving within the facility to avoid contact between people moving within the facility and other moving objects within the facility, taking into account preset movement rules.
[0195] Implementation Method 2
[0196] Reference Figures 8-12 The display control device 100a of Embodiment 2 will be described.
[0197] Reference Figure 8 The structure of the main parts of the display system 10a of Embodiment 2 of the display control device 100a of Embodiment 2 will be described.
[0198] Figure 8 This is a block diagram illustrating an example of the structure of the main parts of the display system 10a of Embodiment 2, which applies the display control device 100a of Embodiment 2.
[0199] The display system 10a adds a facility machine 15 to the display system 10 of Embodiment 1, and changes the display control device 100 in the display system 10 of Embodiment 1 to the display control device 100a.
[0200] That is, the display system 10a includes a display output device 11, a sensor 12, a moving body detection device 13, a storage device 14, a facility machine 15, and a display control device 100a.
[0201] The display system 10a includes a display output device 11, a sensor 12, a moving object detection device 13, a storage device 14, an in-facility machine 15, and a display control device 100a, all of which are connected via a network 19 capable of transmitting and receiving information.
[0202] exist Figure 8 In the middle, to and Figure 1 Blocks that are identical to those shown are labeled with the same number and their descriptions are omitted.
[0203] The facility-based machine 15 is a machine installed within the facility, such as an elevator, automatic door, safety gate, or platform screen door, which is a machine used by people moving within the facility or by self-driving mobile devices such as self-propelled robots moving within the facility to enter or pass through.
[0204] Sensor 12 is installed in machine 15 within the facility. Sensor 12 outputs sensor information to machine 15 within the facility. Machine 15 within the facility receives the sensor information output by sensor 12 and outputs the sensor information to moving body detection device 13.
[0205] The machine 15 within the facility outputs machine status information, indicating the operational status of the machine installed within the facility, to the display control device 100a. For example, if the machine 15 within the facility is an elevator, the machine status information may indicate the position of the car within the hoistway, the operational status of the landing control panel, or the operational status of the car control panel. Furthermore, if the machine 15 within the facility is an automatic door, safety gate, or platform screen door, the machine status information may indicate the opening or closing status of the door or gate.
[0206] The display control device 100a acquires the first moving body information and the second moving body information output by the moving body detection device 13, as well as the machine status information output by the facility machine 15, and outputs image information representing the display image corresponding to the first moving body information and the second moving body information to the facility machine 15.
[0207] The machine 15 in the facility acquires the image information output by the display control device 100a and outputs the acquired image information to the display output device 11.
[0208] More specifically, for example, the machine 15 in the facility outputs image information obtained from the display control device 100a as an image signal for causing the display output device 11 to output as a display image.
[0209] Reference Figure 9 The structure of the main parts of the display control device 100a in Embodiment 2 will be described.
[0210] Figure 9 This is a block diagram showing an example of the structure of the main part of the display control device 100a according to Embodiment 2.
[0211] The display control device 100a adds a machine status acquisition unit 190 to the display control device 100 of Embodiment 1, and changes the image acquisition unit 170 and the image output unit 180 in the display control device 100 of Embodiment 1 to an image acquisition unit 170a and an image output unit 180a.
[0212] That is, the display control device 100a includes a first moving body information acquisition unit 110, a second moving body information acquisition unit 120, a contact prediction unit 130, a movement plan acquisition unit 140, a movement instruction unit 150, a facility configuration map acquisition unit 160, a machine status acquisition unit 190, an image acquisition unit 170a, and an image output unit 180a.
[0213] exist Figure 9 In the middle, to and Figure 3 Blocks that are identical to those shown are labeled with the same number and their descriptions are omitted.
[0214] The machine status acquisition unit 190 acquires the machine status information output by the machine 15 within the facility.
[0215] Based on the first moving body information obtained by the first moving body information acquisition unit 110 and the second moving body information obtained by the second moving body information acquisition unit 120, the image acquisition unit 170a also acquires image information based on the machine status information obtained by the machine status acquisition unit 190.
[0216] Similar to the image information acquired by the image acquisition unit 170 in Embodiment 1, the image information acquired by the image acquisition unit 170a is image information representing the display image displayed by the display output device 11 installed in the facility in the space within the facility.
[0217] The image output unit 180a outputs the image information acquired by the image acquisition unit 170a. More specifically, the image output unit 180a outputs the image information to the machine 15 within the facility.
[0218] In addition, the display control device 100a can also generate control information for causing the mobile body, which is an autonomous driving mobile device, to move in accordance with the display image shown by the image information output by the image output unit 180a, and send the control information to the mobile body.
[0219] Furthermore, the functions of the first moving body information acquisition unit 110, the second moving body information acquisition unit 120, the contact prediction unit 130, the movement plan acquisition unit 140, the movement instruction unit 150, the facility configuration map acquisition unit 160, the machine status acquisition unit 190, the image acquisition unit 170a, and the image output unit 180a in the display control device 100a of Embodiment 2 can be obtained by using the functions described in Embodiment 1. Figure 6 A and Figure 6 The processor 601 and memory 602 in the hardware structure shown in B are implemented as an example, or they can be implemented by the processing circuit 603.
[0220] Reference Figure 10 and Figure 11The image information acquired by the image acquisition unit 170a of Embodiment 2 based on the first moving body information, the second moving body information, and the machine status information will be described.
[0221] Figure 10 A, Figure 10 B. Figure 10 C and Figure 10 Figure D is an example of image information acquired by the image acquisition unit 170a of Embodiment 2 based on the first moving body information, the second moving body information, and the machine status information when the machine 15 in the facility is an elevator.
[0222] More specifically, Figure 10 A, Figure 10 B. Figure 10 C and Figure 10 D is a diagram showing the state of the displayed image information obtained by the image acquisition unit 170a of the display output device 11 when the machine 15 in the facility is an elevator. It is a diagram showing the direction of the elevator landing door when viewed from a certain floor in the facility.
[0223] Figure 10 A, Figure 10 B. Figure 10 C and Figure 10 D shows according to Figure 10 A, Figure 10 B. Figure 10 C Figure 10 The state of the displayed image is shown by the image information acquired by the image acquisition unit 170a in the order of D, displayed in a time sequence through the display output device 11.
[0224] Figure 10 A illustrates the state of two moving objects within a facility, waiting for an elevator car to arrive on a certain floor. Furthermore, Figure 10 A shows a mobile object (not shown) moving within the facility being carried into the car. Figure 10 In A's description, two mobile bodies waiting for the car to arrive on that floor are considered as one mobile body, referred to as the first mobile body 1, and one or more mobile bodies that enter the car are referred to as the second mobile body 2 (not shown).
[0225] Below, as an example, we will assume that at least one of the two mobile bodies, which is the first mobile body 1, is a person moving within the facility.
[0226] As an elevator, the internal machine 15 outputs machine status information, such as information indicating the operating status of the landing control panel, information indicating the operating status of the car control panel, and information indicating the car's current movement toward the floor, to the display and control device 100a. For example, in Figure 10In A, the information indicating the operating status of the landing control panel on that floor is the information used to stop the car on that floor, and the information indicating the operating status of the car control panel inside the car is the information used to stop the car on that floor.
[0227] The sensor 12 (not shown) installed in the car outputs sensor information to the moving body detection device 13. The moving body detection device 13 obtains the sensor information output by the sensor 12, generates second moving body information indicating the position of the second moving body 2, etc., and outputs the generated second moving body information to the display control device 100a.
[0228] The sensor 12 (not shown) installed on this floor outputs sensor information to the moving body detection device 13. The moving body detection device 13 obtains the sensor information output by the sensor 12, generates first moving body information indicating the position of the first moving body 1, and outputs the generated first moving body information to the display control device 100a.
[0229] The image acquisition unit 170a acquires, for example, image information indicating that the second mobile body 2 may get off the car for the first mobile body 1 and prompting the first mobile body 1 to stop, based on the first mobile body information acquisition unit 110, the second mobile body information acquisition unit 120, and the machine status information acquired by the machine status acquisition unit 190.
[0230] Figure 10 A shows a display output device 11 (not shown) located on the floor side of the elevator, displaying the status of the image shown in the image information.
[0231] With this configuration, the display control device 100a can provide information to people moving within the facility to prevent contact between people moving within the facility and other moving objects moving within the facility.
[0232] Figure 10 B shows that Figure 10 After the state shown in Figure A, the car arrives at that floor, and the landing door opens. Figure 10 In B's description, two mobile bodies waiting for the car to arrive on that floor are considered as one mobile body, referred to as the first mobile body 1, and one or more mobile bodies that enter the car are referred to as the second mobile body 2.
[0233] The elevator's internal machine 15 outputs information such as the state that the car is stopped at a floor and the landing door of that floor is open as machine status information to the display control device 100a.
[0234] The sensor 12 (not shown) installed in the car outputs sensor information to the moving body detection device 13. The moving body detection device 13 obtains the sensor information output by the sensor 12, generates second moving body information indicating the position of the second moving body 2, etc., and outputs the generated second moving body information to the display control device 100a.
[0235] The sensor 12 (not shown) installed on this floor outputs sensor information to the moving body detection device 13. The moving body detection device 13 obtains the sensor information output by the sensor 12, generates first moving body information indicating the position of the first moving body 1, and outputs the generated first moving body information to the display control device 100a.
[0236] The image acquisition unit 170a acquires, for example, image information indicating a prompt for the second mobile body 2 to get off the car and a prompt for the first mobile body 1 to stop, based on the first mobile body information acquisition unit 110, the second mobile body information acquisition unit 120, and the machine status information acquired by the machine status acquisition unit 190.
[0237] Figure 10 B shows the status of the display image shown by the image information displayed on the elevator, where the display output device 11 (not shown) located on the floor side is located.
[0238] With this configuration, the display control device 100a can provide information to people moving within the facility to prevent contact between people moving within the facility and other moving objects moving within the facility.
[0239] Figure 10 C shows that Figure 10 After state B, one or more movable bodies that have entered the elevator car completely descend from the elevator car, returning to the state before the two movable bodies that have been moving within the facility entered the elevator car. Figure 10 In the description of C, one of the two moving bodies that will be boarded in the car and moving within the facility is referred to as the first moving body 1, and the other is referred to as the second moving body 2.
[0240] Below, as an example, we will assume that the first mobile body 1 is a person moving within the facility, and the second mobile body 2 is an autonomous mobile device such as a self-propelled robot moving within the facility or a person moving within the facility.
[0241] The elevator's internal machine 15 outputs information such as the state that the car is stopped at a floor and the landing door of that floor is open as machine status information to the display control device 100a.
[0242] The sensor 12 (not shown) installed on this floor outputs sensor information to the moving body detection device 13. The moving body detection device 13 obtains the sensor information output by the sensor 12, generates first moving body information indicating the position of the first moving body 1 and second moving body information indicating the position of the second moving body 2, and outputs the generated first moving body information and second moving body information to the display control device 100a.
[0243] The image acquisition unit 170a acquires, for example, image information indicating a prompt to board the elevator car for the second mobile body 2 and a prompt to stop for the first mobile body 1, based on the first mobile body information acquisition unit 110, the second mobile body information acquisition unit 120, and the machine status information acquired by the machine status acquisition unit 190.
[0244] Figure 10 C shows the status of the displayed image shown by the image information, displayed on the elevator floor side by a display output device 11 (not shown).
[0245] With this configuration, the display control device 100a can provide information to people moving within the facility to prevent contact between people moving within the facility and other moving objects moving within the facility.
[0246] Figure 10 D shows that Figure 10 After the state shown in C, the second moving body 2 completes its entry into the car, which is the state before the first moving body 1 enters the car.
[0247] The elevator's internal machine 15 outputs information such as the state that the car is stopped at a floor and the landing door of that floor is open as machine status information to the display control device 100a.
[0248] The sensor 12 (not shown) installed in the car outputs sensor information to the moving body detection device 13. The moving body detection device 13 obtains the sensor information output by the sensor 12, generates first moving body information indicating the position of the first moving body 1, etc., and outputs the generated first moving body information to the display control device 100a.
[0249] The sensor 12 (not shown) installed on this floor outputs sensor information to the moving body detection device 13. The moving body detection device 13 obtains the sensor information output by the sensor 12, generates second moving body information indicating the position of the second moving body 2, etc., and outputs the generated second moving body information to the display control device 100a.
[0250] The image acquisition unit 170a acquires, for example, image information indicating a display image prompting the first mobile body 1 to board the elevator car, based on the first mobile body information acquisition unit 110, the second mobile body information acquisition unit 120, and the machine status information acquired by the machine status acquisition unit 190.
[0251] Figure 10 D shows the status of the display image shown by the image information displayed on the elevator, where the display output device 11 (not shown) located on the floor side is located.
[0252] With this configuration, the display control device 100a can provide information to people moving within the facility to prevent contact between people moving within the facility and other moving objects moving within the facility.
[0253] Figure 11 This is a diagram showing an example of image information acquired by the image acquisition unit 170a of Embodiment 2 based on the first moving body information, the second moving body information, and the machine status information when the machine 15 in the facility is an automatic door.
[0254] More specifically, Figure 11 This diagram shows the state of the displayed image when the machine 15 in the facility is an automatic door, and the image information acquired by the image acquisition unit 170a displayed by the display output device 11 is shown. It is a diagram of the direction of viewing the ground from the ceiling of a certain floor in the facility.
[0255] Figure 11 The first moving body 1 moving within the facility is shown facing towards... Figure 11 The arrow X shown indicates the direction of movement while passing through the automatic door, representing the state before passing through the automatic door. Furthermore, Figure 11 The second moving body 2, moving within the facility, is shown facing... Figure 11 The arrow Y indicates the state before passing through the automatic door, when the movement occurs in that direction.
[0256] Below, as an example, we will assume that the first mobile body 1 is a person moving within the facility, and the second mobile body 2 is an autonomous mobile device such as a self-propelled robot moving within the facility or a person moving within the facility.
[0257] The machine 15 inside the facility, which is an automatic door, outputs information such as the opening and closing status of the automatic door to the display control device 100a as machine status information.
[0258] Sensor 12 (not shown), installed in a structure such as a wall or ceiling near an automatic door, outputs sensor information to a motion detection device 13. The motion detection device 13 receives the sensor information output by sensor 12, generates first motion information indicating the position of a first motion body 1 and second motion information indicating the position of a second motion body 2, and outputs the generated first motion information and second motion information to a display control device 100a.
[0259] The image acquisition unit 170a acquires image information, such as a display image indicating a stop prompt for the first moving body 1 and a movement prompt for the second moving body 2, based on the first moving body information acquired by the first moving body information acquisition unit 110, the second moving body information acquired by the second moving body information acquisition unit 120, and the machine status information acquired by the machine status acquisition unit 190. The image information acquired by the image acquisition unit 170a can represent a display image indicating a stop prompt for the first moving body 1 and a movement prompt for the second moving body 2, or it can represent a display image indicating a stop prompt for the first moving body 1 and a movement prompt for the second moving body 2.
[0260] Figure 11 The display output device 11, located on a wall near the automatic door, shows a state of display images indicating that a first moving body 1, acting as a person moving within the facility, is prompted to stop, and that a second moving body 2, acting as an autonomous driving mobile device moving within the facility, is prompted to move.
[0261] With this configuration, the display control device 100a can provide information to people moving within the facility to prevent contact between people moving within the facility and other moving objects moving within the facility.
[0262] Reference Figure 11 The image information acquired by the image acquisition unit 170a is illustrated using the case where the machine 15 in the facility is an automatic door as an example. However, the same configuration can be used when the machine 15 in the facility is a safety gate or a platform door of a machine in a railway station facility.
[0263] In addition, the image acquisition unit 170a can also acquire image information based on the prediction results predicted by the contact prediction unit 130, the movement plan information acquired by the movement plan acquisition unit 140, the facility configuration map information acquired by the facility configuration map acquisition unit 160, or preset movement rules, based on the first movement information acquired by the first movement information acquisition unit 110, the second movement information acquired by the second movement information acquisition unit 120, and the machine status information acquired by the machine status acquisition unit 190.
[0264] The method by which the image acquisition unit 170a acquires image information based on the prediction results of the contact prediction unit 130, the movement plan information acquired by the movement plan acquisition unit 140, the facility configuration map information acquired by the facility configuration map acquisition unit 160, or the preset movement rules has been described in Embodiment 1, so the description is omitted.
[0265] Reference Figure 12 The operation of the display control device 100a in Embodiment 2 will be explained.
[0266] Figure 12 This is a flowchart illustrating an example of the processing of the display control device 100a according to Embodiment 2. The display control device 100a, for example, repeatedly executes the processing shown in the flowchart.
[0267] First, in step ST1201, the facility configuration diagram acquisition unit 160 acquires facility configuration diagram information.
[0268] Next, in step ST1202, the first moving body information acquisition unit 110 acquires the first moving body information.
[0269] Next, in step ST1203, the second moving body information acquisition unit 120 acquires the second moving body information.
[0270] Next, in step ST1204, the machine status acquisition unit 190 acquires machine status information.
[0271] Next, in step ST1205, the movement plan acquisition unit 140 acquires movement plan information representing the movement plan of the autonomous driving mobile device when the second moving body 2 is an autonomous driving mobile device moving within the facility.
[0272] Next, in step ST1206, the contact prediction unit 130 predicts whether the first moving body 1 and the second moving body 2 may come into contact and outputs the prediction result.
[0273] Next, in step ST1207, the image acquisition unit 170a acquires image information.
[0274] Next, in step ST1208, the image output unit 180a outputs image information.
[0275] Next, in step ST1209, the movement instruction unit 150 outputs movement instruction information indicating the movement instruction of the autonomous driving mobile device when the second moving body 2 is an autonomous driving mobile device moving within the facility.
[0276] After step ST1209, the display control device 100a ends the processing of the flowchart. After ending the processing of the flowchart, the display control device 100a returns to step ST1202 and repeatedly executes the processing of the flowchart.
[0277] In addition, if the display control device 100a does not have a facility configuration diagram acquisition unit 160, the processing of step ST1201 is omitted.
[0278] Furthermore, if the display control device 100a does not have a movement plan acquisition unit 140, the processing step ST1205 is omitted.
[0279] Furthermore, if the display control device 100a does not have a contact prediction unit 130, the processing step ST1206 is omitted.
[0280] Furthermore, if the display control device 100a does not have a movement indicator 150, the processing of step ST1209 is omitted.
[0281] Furthermore, the order of processing steps ST1201 to ST1204 is arbitrary.
[0282] As described above, the display control device 100a of Embodiment 2 includes: a first moving body information acquisition unit 110, which acquires first moving body information indicating the position, moving speed, and moving direction of a first moving body 1 moving within the facility; a second moving body information acquisition unit 120, which acquires second moving body information indicating the position, moving speed, and moving direction of a second moving body 2 moving within the facility; a machine state acquisition unit 190, which acquires machine state information indicating the operating state of a machine installed within the facility; an image acquisition unit 170a, which, based on the first moving body information acquired by the first moving body information acquisition unit 110 and the second moving body information acquired by the second moving body information acquisition unit 120, also acquires image information indicating a display image based on the machine state information acquired by the machine state acquisition unit 190, and causes a display output device 11 installed within the facility to display the display image in the space within the facility; and an image output unit 180, which outputs the image information acquired by the image acquisition unit 170a.
[0283] With this configuration, the display control device 100a can provide information to people moving within the facility in accordance with the machine's operating state, to prevent contact between people moving within the facility and moving objects moving within the facility.
[0284] Furthermore, the display control devices 100, 100a and the display systems 10, 10a can also be applied to facilities such as parking lots for vehicles such as cars. When the facility is a parking lot, the autonomous driving mobile device can also be a vehicle. Additionally, when the facility is a parking lot, the machine installed in the facility can be a vehicle locking device such as a gate at the entrance or exit of the parking lot or a locking plate that restricts the movement of stopped vehicles.
[0285] Furthermore, within the scope of the invention, the various embodiments can be freely combined, or any structural elements of the various embodiments can be modified, or any structural elements of the various embodiments can be omitted.
[0286] Industrial availability
[0287] The display control device of the present invention can be applied to display systems that display images within a facility.
[0288] Label Explanation
[0289] 1: First moving body; 2: Second moving body; 10, 10a: Display system; 11, 11-1, 11-2, 11-3, 11-4: Display output device; 12: Sensor; 13: Moving body detection device; 14: Storage device; 15: Machine within the facility; 19: Network; 100, 100a: Display control device; 110: First moving body information acquisition unit; 120: Second moving body information acquisition unit; 130: Contact prediction unit; 140: Movement plan acquisition unit; 150: Movement instruction unit; 160: Facility configuration map acquisition unit; 170, 170a: Image acquisition unit; 180, 180a: Image output unit; 190: Machine status acquisition unit; 601: Processor; 602: Memory; 603: Processing circuit.
Claims
1. A display control device characterized by comprising: The display control device has: a first mobile body information acquisition section that acquires first mobile body information indicating a position, a moving speed, and a moving direction of a first mobile body moving within a facility; a second mobile body information acquisition section that acquires second mobile body information indicating a position, a moving speed, and a moving direction of a second mobile body moving within the facility; an image acquisition section that acquires image information indicating a display image, based on the first mobile body information acquired by the first mobile body information acquisition section and the second mobile body information acquired by the second mobile body information acquisition section, the display image being an image that causes a display output device provided within the facility to display in a space visible to the first mobile body or the second mobile body within the facility; and an image output section that outputs the image information acquired by the image acquisition section; wherein the first mobile body or the second mobile body is an automatically driven mobile device that moves within the facility according to a predetermined movement plan; the display control device further has a movement plan acquisition section that acquires movement plan information indicating the movement plan in the first mobile body or the second mobile body that is the automatically driven mobile device, via a network, in a case where the first mobile body or the second mobile body is the automatically driven mobile device; the image acquisition section acquires the image information based on the first mobile body information acquired by the first mobile body information acquisition section and the second mobile body information acquired by the second mobile body information acquisition section, and further based on the movement plan information acquired by the movement plan acquisition section.
2. The display control device according to claim 1, wherein the image acquisition section acquires the image information indicating the display image to be displayed in a space visible to the first mobile body or the second mobile body of which the category is a person, based on the first mobile body information and the second mobile body information, in a case where the category of the first mobile body or the second mobile body is a person.
3. The display control device according to claim 1, wherein the display control device has a machine state acquisition section that acquires machine state information indicating an operation state of a machine provided within the facility, the image acquisition section acquires the image information based on the first mobile body information acquired by the first mobile body information acquisition section and the second mobile body information acquired by the second mobile body information acquisition section, and further based on the machine state information acquired by the machine state acquisition section.
4. The display control device according to claim 1, wherein the display control device has a facility configuration map acquisition section that acquires facility configuration map information indicating a configuration position of a structure constituting the facility, the image acquisition section acquires the image information based on the first mobile body information acquired by the first mobile body information acquisition section and the second mobile body information acquired by the second mobile body information acquisition section, and further based on the facility configuration map information acquired by the facility configuration map acquisition section.
5. The display control device according to claim 1, wherein the display control device has a contact prediction section that predicts contact of the first mobile body with the second mobile body based on the first mobile body information acquired by the first mobile body information acquisition section and the second mobile body information acquired by the second mobile body information acquisition section, the image acquisition section acquires the image information based on the first mobile body information acquired by the first mobile body information acquisition section and the second mobile body information acquired by the second mobile body information acquisition section, and further based on a prediction result predicted by the contact prediction section.
6. The display control device according to claim 1, wherein the image acquisition section acquires the image information based on the first mobile body information acquired by the first mobile body information acquisition section and the second mobile body information acquired by the second mobile body information acquisition section, and further based on a predetermined movement rule.
7. The display control device according to claim 1, wherein the display control device has a movement instruction section that outputs movement instruction information indicating a movement instruction for the first mobile body or the second mobile body that is an automated driving mobile device moving within the facility according to a predetermined movement plan, the movement instruction section outputs the movement instruction information corresponding to the display image shown by the image information acquired by the image acquisition section. The display system has: a display output device provided within a facility and displaying a display image shown by acquired image information in a space within the facility that is visible to a first mobile body moving within the facility or a second mobile body moving within the facility; and a display control device that acquires the image information based on first mobile body information and second mobile body information, and outputs the acquired image information to the display output device, wherein the first mobile body information indicates a position, a movement speed, and a movement direction of the first mobile body, the first mobile body information being generated based on sensor information output by a sensor provided within the facility, the second mobile body information indicates a position, a movement speed, and a movement direction of the second mobile body, the second mobile body information being generated based on the sensor information output by the sensor provided within the facility; 8. A display system characterized by, wherein the first mobile body or the second mobile body is an automated driving mobile device moving within the facility according to a predetermined movement plan; the display control device acquires movement plan information indicating the movement plan in the first mobile body or the second mobile body that is the automated driving mobile device, via a network, in a case where the first mobile body or the second mobile body is the automated driving mobile device, and acquires the image information based on the first mobile body information and the second mobile body information, and further based on the movement plan information. The display control method has: 9. A display control method characterized by comprising: The first mobile body information acquisition step, a first mobile body information acquisition unit acquires first mobile body information indicating a position, a moving speed, and a moving direction of a first mobile body moving within a facility; The second mobile body information acquisition step, a second mobile body information acquisition unit acquires second mobile body information indicating a position, a moving speed, and a moving direction of a second mobile body moving within the facility; The image acquisition step, an image acquisition unit acquires image information indicating a display image, based on the first mobile body information acquired by the first mobile body information acquisition unit and the second mobile body information acquired by the second mobile body information acquisition unit, wherein the display image is an image that causes a display output device provided within the facility to display in a space within the facility that is visible to the first mobile body or the second mobile body; and The image output step, an image output unit outputs the image information acquired by the image acquisition unit; The first mobile body or the second mobile body is an automated driving mobile device that moves within the facility according to a predetermined movement plan; The display control method further has: The movement plan acquisition step, a movement plan acquisition unit acquires movement plan information indicating the movement plan in the first mobile body or the second mobile body that is the automated driving mobile device, via a network, in a case where the first mobile body or the second mobile body is the automated driving mobile device; and The image acquisition unit acquires the image information based on the first mobile body information acquired by the first mobile body information acquisition unit and the second mobile body information acquired by the second mobile body information acquisition unit, and also based on the movement plan information acquired by the movement plan acquisition unit.
Citation Information
Patent Citations
Pedestrian-driver information sharing system
JP2015201113A
Display control system and recording medium
CN103888719A
Elevator control device and autonomous moving body control device
CN109789990A
Navigation method, navigation system, moving body, and navigation program
WO2019163412A1