Aerial display and guidance system, aerial display and guidance device, aerial display and guidance method, and aerial display and guidance program

Abstract

In methods that display images showing airflow on a screen, or on the floor, walls, or ceiling, it is unlikely that passengers in the elevator will pay much attention to the displayed images, especially when the elevator is crowded. [Solution] The aerial display guidance system comprises an observation device installed in the elevator car, a control device for controlling the elevator, a person detection unit that detects people inside the elevator car based on observation information observed by the observation device, a video setting unit that sets an image based on operation information acquired from the control device when a person is detected, and a display device that displays the image in the air inside the elevator car.

Description

Technical Field

[0001] The present disclosure relates to an in-air display guidance system, an in-air display guidance device, an in-air display guidance method, and an in-air display guidance program.

Background Art

[0002] In the information providing system of Patent Document 1, a recommended position calculation unit acquires ventilation equipment information indicating the state of ventilation equipment in a passenger car and outputs recommended position information of a passenger. A presentation information generation unit generates recommended position presentation information indicating the recommended position of a passenger in a passenger car using the output recommended position information. A presentation information output unit outputs the recommended position presentation information to a presentation device. The presentation device displays an image showing the recommended position and air flow on a display, or on the floor, wall, or ceiling, based on the recommended position presentation information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the display of Patent Document 1, especially when the car is crowded, it is not very expectable that the passengers in the car will direct their line of sight to the displayed image.

[0005] The present disclosure has been made to solve the above problems. An object is to provide an in-air display guidance that displays at a position where the line of sight of a passenger in a car naturally turns.

Means for Solving the Problems

[0006] The aerial display guidance system disclosed herein includes an observation device installed in an elevator car, a control device for controlling the elevator, a person detection unit that detects a person inside the elevator car based on observation information observed by the observation device, and a video setting unit that sets an image based on operating information acquired from the control device when a person is detected. A display position setting unit identifies the gaze of a person detected by a person detection unit and sets the position of the image to be displayed in the air based on the gaze. It includes a display device that displays images in the air inside a room. Furthermore, the aerial display guidance system of this disclosure includes an observation device installed in the elevator car, a control device for controlling the elevator, a person detection unit that detects a person inside the elevator car based on observation information observed by the observation device, a video setting unit that sets an image based on driving information acquired from the control device when a person is detected, and a display device that displays the image in the air inside the room. The image is an onomatopoeia of the sounds inside the room and is further equipped with a sound collection device, the image is set based on the sound acquired from the sound collection device.

[0007] The aerial display guidance device of this disclosure includes: a person detection unit that detects a person inside the elevator car from observation information observed by an observation device installed in the elevator car; an image setting unit that, when a person is detected, sets an image to be displayed in the air inside the car based on operation information obtained from a control device that controls the elevator; and a display position setting unit that identifies the person's line of sight and sets the position of the image to be displayed in the air based on the line of sight.

[0008] The aerial display guidance method disclosed herein includes a person detection step, which involves detecting a person inside the elevator car from observation information observed by an observation device installed in the elevator car, A display position setting step is performed when a person is detected, by identifying the person's line of sight and setting the position of the image to be displayed in the air based on the line of sight. The system includes a video setting step, which sets the video based on operating information obtained from a control device that controls the elevator when a person is detected, and a display step, which displays the video in the air inside the room.

[0009] The aerial display guidance program disclosed herein includes a person detection step that detects a person inside the elevator car from observation information observed by an observation device installed in the elevator car, A display position setting step is performed when a person is detected, by identifying the person's line of sight and setting the position of the image to be displayed in the air based on the line of sight. When a person is detected, the system causes the computer to perform a video setting step, which sets the image to be displayed in the air inside the room based on the operating information obtained from the control device that controls the elevator. [Effects of the Invention]

[0010] This disclosure is expected to allow many passengers inside the elevator car to notice the display showing the situation inside the car and understand what is happening. [Brief explanation of the drawing]

[0011] [Figure 1] It is a configuration diagram of the aerial display guidance system in Embodiment 1. [Figure 2] It is a diagram showing a basket to which the aerial display guidance system is applied. [Figure 3] It is a configuration diagram showing the configuration of the display device. [Figure 4] It is a configuration diagram showing the configuration of the display position setting unit. [Figure 5] It is a configuration diagram showing the configuration of the display video setting unit. [Figure 6] It is an example of the video stored in the video memory unit. [Figure 7] It is an operation flowchart of the aerial display guidance system in Embodiment 1. [Figure 8] It is a configuration diagram of the aerial display guidance system in which the display device is installed in the aerial display guidance device. [Figure 9] It is a diagram showing an example of the hardware resources of the aerial display guidance device. [Figure 10] It is a diagram showing another example of the hardware resources of the aerial display guidance device. [Figure 11] It is a configuration diagram of the aerial display guidance system in Embodiment 2. [Figure 12] It is an operation flowchart of the aerial display guidance system in Embodiment 2.

Mode for Carrying Out the Invention

[0012] The embodiments for carrying out the present disclosure will be described with reference to the accompanying drawings. In each figure, the same or corresponding parts are denoted by the same reference numerals, and redundant descriptions are appropriately simplified or omitted.

[0013] Embodiment 1. FIG. 1 is a configuration diagram of the aerial display guidance system in Embodiment 1. This aerial display guidance system is applied to the elevator car. FIG. 2 is an example of a car to which the aerial display guidance system is applied.

[0014] In Fig. 1, the in-air display guidance system 1 includes an observation device 2, an in-air display guidance device 10, a display device 20, and an elevator control device 30. The observation device 2 and the display device 20 are provided in the car 100. The in-air display guidance device 10 may be provided in the car 100 or in other locations. The elevator control device 30 is provided in the machine room of the elevator.

[0015] The observation device 2 and the in-air display guidance device 10, the in-air display guidance device 10 and the display device 20, and the in-air display guidance device 10 and the elevator control device 30 are connected so that information can be transmitted and received. Note that a plurality of the observation devices 2 and the display devices 20 connected to the in-air display guidance device 10 may be provided in separate cars 100.

[0016] As shown in Fig. 2, the car 100 is provided with a car door 101. The car door 101 can be opened and closed when arriving at the landing. An observation device 2 is provided at the upper part of the left side wall of the car 100. The observation device 2 is a photographing device such as a camera that reflects the situation inside the car 100. The observation information observed and output by the observation device 2 is in the form of video.

[0017] Note that the observation device 2 may be, for example, an infrared sensor, a distance sensor for measuring the distance to a person, a human presence sensor for detecting the presence of a person, an ultrasonic sensor, or other sensors as long as it can identify the position of a person. In that case, the observation information observed and output by the observation device 2 is sensor data. Also, the observation device 2 may be an AI camera. In that case, the observation information is human information.

[0018] Above the ceiling of the car 100, an air-conditioning and ventilation device 102 for the car is installed. The cold air, warm air, or ventilation air generated by the air-conditioning and ventilation device 102 for the car is blown into the interior of the car 100 from the air outlet 103 provided on the ceiling surface of the car 100. Further, a display device 20 is provided on the wall above the car door 101 of the car 100.

[0019] Figure 3 is a side view of the display device 20 as it is installed on the wall of the elevator car 100. The main body of the display device 20 is embedded in the upper wall of the elevator car door 101. The display device 20 includes an image source 20a, a beam splitter 20b, a retroreflective element 20c, and a movable part 20d.

[0020] The image source 20a is positioned inside the wall. The image source 20a is a device that emits visible light images that form the basis of the aerial image 20e. Here, the image source 20a is a display panel that displays a two-dimensional image. However, the image source 20a may also be a volumetric display that displays a three-dimensional image, for example.

[0021] The beam splitter 20b is an optical element that transmits a portion of the incident light and reflects the other portion. The beam splitter 20b is, for example, a half-mirror. In this case, the beam splitter 20b has a planar shape. The beam splitter 20b is positioned so as to be flush with the interior wall surface of the elevator car 100.

[0022] The retroreflective element 20c is positioned above the image source 20a and inside the wall. The retroreflective element 20c is an optical element that reflects light incident from the incident direction in a reflection direction parallel to the incident direction and opposite to the incident direction.

[0023] Light from the image source 20a is reflected by the beam splitter 20b. The light reflected by the beam splitter 20b is incident on the retroreflective element 20c. The retroreflective element 20c reflects the incident light in the opposite direction. The light reflected by the retroreflective element 20c is incident on the beam splitter 20b. After being reflected by the retroreflective element 20c, the light that is transmitted without being reflected by the beam splitter 20b converges in the display range 104 in the interior space of the elevator car 100 adjacent to the display device 20, forming a real image of the aerial image 20e. In this way, the display device 20 displays the aerial image 20e to the passengers 200. Note that the display range 104 in which the aerial image 20e can be displayed is symmetrical with respect to the image source 20a, with respect to the beam splitter 20b as the plane of symmetry. Therefore, when the passengers 200 inside the elevator car 100 look diagonally upwards, the aerial image 20e comes into their field of vision.

[0024] The image source 20a and retroreflective element 20c are fixed to the movable part 20d. The beam splitter 20b is fixed so as to be flush with the wall surface. When this movable part 20d rotates, the positions of the image source 20a and retroreflective element 20c change, and the position and tilt of the aerial image 20e change.

[0025] The aerial display guidance device 10 includes a person detection unit 11, a display position setting unit 12, and a display image setting unit 13.

[0026] The video captured by the observation device 2 is transmitted to the aerial display and guidance device 10. The person detection unit 11 analyzes the video sent from the observation device 2 and detects people inside the elevator car 100, i.e., passengers 200.

[0027] The display position setting unit 12 sets the position in which the aerial image 20e is displayed in the air by the display device 20. As shown in the configuration diagram of the display position setting unit 12 in Figure 4, the display position setting unit 12 includes a visibility range confirmation unit 12a and a display position changing unit 12b.

[0028] In the display device 20, the movable part 20d rotates so that the image is displayed in the air at the position set by the display position setting unit 12, and the positions of the image source 20a and the retroreflective element 20c change.

[0029] The display image setting unit 13 sets the image emitted from the image source 20a. As shown in the configuration diagram of the display image setting unit 13 in Figure 5, the display image setting unit 13 includes an operating status sensing unit 13a, an image selection unit 13b, and an image storage unit 13c.

[0030] The operation status monitoring unit 13a acquires operation information from the elevator control device 30 and grasps the current operation status. The video selection unit 13b selects the most suitable video from the video stored in the video storage unit 13c based on the operation status.

[0031] Specifically, the video memory unit 13c stores onomatopoeic images and images based on the driving conditions. The images stored in the video memory unit 13c may be still images or moving images (animations), and may be black and white or in color. In the case of moving images, the colors may change. Furthermore, moving images may include features such as scaling up or down or rotation.

[0032] Figure 6 shows an example of an image stored in the image memory unit 13c. In Figure 6, image 13d1 represents the sound when the car door 101 is opening and closing. Image 13d2 represents the sound while the train is in motion. These sound-related images are created in advance, for example, by acquiring and analyzing the sounds of the car door opening and closing, and then creating onomatopoeia that matches those sounds.

[0033] Video 13d3 shows ventilation being performed inside the elevator car 100 by the elevator car air conditioning and ventilation system 102. This video gives the impression that air is circulating inside the elevator car 100. Video 13d3 is a video in which an arrow rotates according to the speed of the airflow. For example, in video 13d3, the airflow speed is calculated from the fan rotation speed of the elevator car air conditioning and ventilation system 102, and the arrow rotates in sync with this. Alternatively, a video like video 13d6 could be used to show ventilation. This video gives the impression that air is flowing inside the elevator car 100 by creating the illusion of waves.

[0034] Video 13d4 shows that air conditioning is being provided inside the elevator car 100 by the elevator car air conditioning and ventilation system 102. Video 13d4 displays the video from video 13d3 alongside the word "Hieee" (meaning "cool" or "ice") indicating that air conditioning is being provided. From the diagram showing the airflow and the word "Hieee", passengers 200 can imagine that air conditioning is being provided. Alternatively, the diagram showing the airflow and the word "Hieee" may be switched at regular intervals and displayed separately.

[0035] Video 13d5 shows that heating is being provided inside the elevator car 100 by the elevator car air conditioning and ventilation system 102. Video 13d5 displays the video from video 13d3 alongside the word "Hot," indicating heating. From the diagram showing the airflow and the word "Hot," passengers 200 can imagine that the elevator is being heated. Alternatively, the diagram showing the airflow and the word "Hot" may be switched at regular intervals and displayed separately.

[0036] Next, an example of the operation of the aerial display guidance system 1 will be explained based on the operation flowchart in Figure 7. The aerial display guidance device 10 acquires video from the observation device 2 (step S01). The person detection unit 11 receives the video and detects passengers 200 in the video (step S02: person detection step).

[0037] In step S02, if a passenger 200 is detected, the visibility range confirmation unit 12a determines whether the current display position of the aerial image 20e is within the passenger 200's visible range (step S03). The display device 20 is normally in a fixed state. The fixed state is, for example, a state in which the distance between the edge of the image source 20a and the beam splitter 20b is the same as the distance between the edge of the retroreflective element 20c and the beam splitter 20b. In this state, as shown in Figure 3, the display surface of the aerial image 20e is directly in front of the passenger 200 when they look diagonally upward. However, depending on the passenger 200's height or whether they are in a wheelchair, the aerial image 20e may be difficult to see from this position.

[0038] Therefore, in step S03, the visibility range confirmation unit 12a analyzes the video acquired from the observation device 2 to identify the standing position and eye position of the passenger 200, and determines the line of sight from the angle of the face, etc. Then, the visibility range confirmation unit 12a defines a certain range centered on the line of sight as the visible range. In this case, the visible range is the space in front of the passenger 200. Then, the visibility range confirmation unit 12a compares this visible range with the display position in the standard state and makes a determination.

[0039] If it is determined in step S03 that the display position is not within the visible range, the display position changing unit 12b rotates the movable part 20d to change the display position so that the display position matches the visible range (step S04).

[0040] In the display position setting steps S03 and S04, after the display position is set, the display video setting unit 13 sets the video to be displayed. First, the operation status understanding unit 13a determines whether the car door 101 is currently in the process of opening or closing based on the operation information acquired from the elevator control device 30 (step S05).

[0041] If it is determined in step S05 that the cage door 101 is in the process of opening or closing, the display video setting unit 13 sets the door opening / closing sound video (step S06). Specifically, the video selection unit 13b retrieves video 13d1 from the video storage unit 13c.

[0042] If, in step S05, it is determined that the car door 101 is not currently opening or closing, the operation status monitoring unit 13a determines, based on the operation information, whether the car 100 is currently moving and whether shaking is occurring (step S07). Even when moving, little noise is generated when the movement is stable. However, if the car 100 is shaking, noise is generated. Therefore, the operation status monitoring unit 13a determines, based on the speed information from the operation information and the acceleration information from the accelerometer installed in the car 100, whether the speed and acceleration are not exceeding a predetermined range.

[0043] In step S07, if the car 100 detects that shaking has occurred while it is in motion, the display video setting unit 13 sets the video of the driving sound (step S08). Specifically, the video selection unit 13b retrieves the video 13d2 from the video storage unit 13c.

[0044] If, in step S07, it is determined that no shaking occurs during travel, the operation status monitoring unit 13a determines, based on the operation information, whether the car air conditioning and ventilation system 102 is currently operating (step S09). The operation of the car air conditioning and ventilation system 102 includes ventilation, cooling, and heating.

[0045] If the car air conditioning and ventilation system 102 is determined to be operating in step S09, the display image setting unit 13 sets an image corresponding to the operation (step S10). Specifically, the image selection unit 13b retrieves image 13d3 from the image storage unit 13c if the car air conditioning and ventilation system 102 is in ventilation operation. The image selection unit 13b retrieves image 13d4 from the image storage unit 13c if the car air conditioning and ventilation system 102 is in cooling operation. The image selection unit 13b retrieves image 13d5 from the image storage unit 13c if the car air conditioning and ventilation system 102 is in heating operation.

[0046] After the video is set in the video setting steps S06, S08, and S10, these videos are sent to the display device 20. In the display device 20, the video source 20a emits the set video and displays the aerial video 20e in the air (step S11: display step).

[0047] In this way, passenger 200 can visually grasp the current status of the elevator car 100. Furthermore, since the information is displayed in an aerial position high inside the elevator car 100, in a space where passenger 200's gaze naturally falls, passenger 200 can see it even if it is crowded. In addition, the display position can be changed according to the height of passenger 200, reducing the chances of them missing the information.

[0048] Furthermore, indicating that the interior of car 100 is being ventilated, or that it is being air-conditioned or heated, is expected to provide a sense of comfort to the passengers 200.

[0049] Furthermore, by displaying onomatopoeia for sounds, people with hearing impairments can also understand the sound situation.

[0050] Note that the display device 20 may differ from the configuration shown in Figure 3, as long as it displays aerial images in a space separate from the main device within the building. For example, the display device 20 may be an aerial touch display or the like.

[0051] Furthermore, if multiple passengers 200 are separated from each other and inside the car 100, the system may analyze the display position that can be naturally seen by all passengers 200 from their standing positions and line of sight, and display the image in the air. Alternatively, the display image setting unit 13 may generate a composite image by placing individual images, for example, image 13d1 and image 13d3 side by side, and display it in the air.

[0052] Furthermore, the display image setting unit 13 may be configured to generate images independently based on the operating conditions.

[0053] Furthermore, the display image setting unit 13 may display aerial images of numbers based on the destination floor or the next stopping floor information in the driving information, or based on the speed information in the driving information. In addition to this, the display image setting unit 13 may set aerial images as needed based on the driving information.

[0054] Furthermore, the aerial display and guidance device 10 may also include a display device 20. Figure 8 is a diagram of the configuration of the aerial display and guidance system 1 in that case. In this case, the aerial display and guidance devices 10 will be installed in each of the elevator cars 100.

[0055] Figure 9 shows an example of the hardware resources of the aerial display and guidance device 10. The aerial display and guidance device 10 is a computer having a processor 10a, memory 10b, and a transmitting / receiving circuit 10c as hardware resources. Note that there may be multiple processors 10a, memory 10b, and transmitting / receiving circuits 10c.

[0056] The processor 10a is also called a CPU (Central Processing Unit), central processing unit, arithmetic unit, microprocessor, or DSP. The memory 10b may be a semiconductor memory, magnetic disk, flexible disk, optical disk, compact disk, minidisc, or DVD. Possible semiconductor memories include RAM, ROM, flash memory, EPROM, and EEPROM.

[0057] Figure 10 shows another example of the hardware resources of the aerial display and guidance device 10. In the example in Figure 10, the aerial display and guidance device 10 has a processing circuit that includes a processor 10a, memory 10b, a transmit / receive circuit 10c, and dedicated hardware 10d. Some of the functions of the aerial display and guidance device 10 are realized by the dedicated hardware 10d. Alternatively, all of the functions of the aerial display and guidance device 10 may be realized by the dedicated hardware 10d. The dedicated hardware 10d can be a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0058] Embodiment 2. In Embodiment 2, a sound collection device is installed in the car 100, and the in-movement video 13d2 shown in Figure 6 is displayed based on the sound input from the sound collection device. Figure 11 is a configuration diagram of the aerial display guidance system of Embodiment 2. In Figure 11, the same reference numerals are used for components that are the same as or corresponding to components in Figure 1, and their descriptions are omitted or simplified.

[0059] In Figure 11, a sound collection device 40 is installed in the elevator car 100, which receives sound from inside the car. The display image setting unit 13 then acquires sound information from inside the elevator car 100 from the sound collection device 40.

[0060] Figure 12 is an operation flowchart showing an example of the operation of the aerial display guidance system 1 in Embodiment 2. In Figure 12, the same reference numerals are used for the same steps as in Figure 7, and the explanations are omitted or simplified.

[0061] In Figure 12, if it is determined in step S05 that the car door 101 is not currently being opened or closed, the operating status monitoring unit 13a determines, based on the operating information, whether the car 100 is currently in motion and whether the sound from the sound collection device 40 is greater than the threshold (step S17).

[0062] Then, in step S17, if the vehicle is in motion and the sound level is higher than the threshold, in step S08, the display video setting unit 13 sets the driving sound video.

[0063] In this way, by providing a sound collection device 40 and displaying images based on the input sound, it is possible to maintain consistency between the sounds heard by the passengers 200 and the aerial images 20e.

[0064] Furthermore, by installing the sound collection device 40, it becomes possible to display the aerial image 20e in the air based on sounds other than those produced by the vehicle's movement.

[0065] Alternatively, the functions of the sound collection device 40 may be incorporated into the observation device 2, so that both video and sound are observed by the observation device 2.

[0066] Although preferred embodiments have been described in detail above, the invention is not limited to these embodiments, and various modifications and substitutions can be made to the embodiments described above without departing from the scope of disclosure.

[0067] Furthermore, when referring to the number, quantity, amount, range, etc., of each element in the embodiments, the apparatus of this disclosure is not limited to the referred number unless specifically stated or clearly defined in principle. Also, the structures, etc., described in these embodiments are not necessarily essential unless specifically stated or clearly defined in principle. [Explanation of Symbols]

[0068] 1. Aerial display and guidance system, 2. Observation equipment, 10 Aerial display and guidance device, 10a Processor, 10b Memory, 10c transmit / receive circuit, 10d dedicated hardware, 11 Person detection unit, 12 Display position setting unit, 12a Visibility range confirmation unit, 12b Display position change section, 13 Display image setting unit, 13a Operating status monitoring unit, 13b Image selection unit, 13c Video memory unit, 20 Display device, 20a Video source, 20b Beam splitter, 20c Retroreflective element, 20d moving parts, 20e aerial images, 30 Elevator control device, 40 Sound collection device, 100 cage, 101 cage door, 102 air conditioning and ventilation system for cage, 103 air outlet, 104 display range, 200 passengers

Claims

1. An observation device installed in the elevator car, A control device for controlling the elevator, A person detection unit detects a person inside the cage based on the observation information observed by the observation device, When the aforementioned person is detected, the video setting unit sets the video based on the driving information acquired from the control device, A display position setting unit identifies the gaze of the person detected by the person detection unit and sets the position of the image to be displayed in the air based on the gaze, A display device that displays the aforementioned image in the air within the room, An aerial display and guidance system having

2. The aerial display and guidance system according to claim 1, wherein the aforementioned image is a video showing airflow.

3. The aerial display guidance system according to claim 1, wherein the image is an onomatopoeia of the sounds in the room.

4. An observation device installed in the elevator car, A control device for controlling the elevator, A person detection unit detects a person inside the cage based on the observation information observed by the observation device, When the aforementioned person is detected, the video setting unit sets the video based on the driving information acquired from the control device, The system includes a display device that displays the aforementioned image in the air within the room, The aforementioned video is an onomatopoeia of the sounds in the aforementioned room. An aerial display guidance system further comprising a sound collection device, wherein the image is set based on the sound acquired from the sound collection device.

5. A person detection unit detects people inside the elevator car from observation information observed by an observation device installed in the elevator car, When the aforementioned person is detected, the video setting unit sets an image to be displayed in the air inside the room based on the operation information obtained from the control device that controls the elevator, A display position setting unit that identifies the person's line of sight and sets the position of the image to be displayed in the air based on the line of sight, An aerial display and guidance device having the following features.

6. A person detection step in which a person inside the elevator car is detected from observation information observed by an observation device installed in the elevator car, When the person is detected, the display position setting step involves identifying the person's line of sight and setting the position of the image to be displayed in the air based on the line of sight. When the person is detected, a video setting step is performed to set the video based on the operation information obtained from the control device that controls the elevator, A display step of displaying the aforementioned image in the air inside the room, A method for providing guidance using aerial displays with thumbnails.

7. On the computer, A person detection step in which a person inside the elevator car is detected from observation information observed by an observation device installed in the elevator car, When the person is detected, the display position setting step involves identifying the person's line of sight and setting the position of the image to be displayed in the air based on the line of sight. When the person is detected, a video setting step is taken to set the video to be displayed in the air inside the room based on the operation information obtained from the control device that controls the elevator, An aerial display guidance program that enables the execution of an aerial display.

Images