Display system

Abstract

To provide an image display device, a display system, a screen and a remote image projection method that can be used with good visibility both day and night, and perform guidance and instruction work while moving the device so as not to obstruct traffic lines of pedestrians, etc.SOLUTION: The image display device includes: a base part; a support pole erected on the base part; a screen installed from the support pole toward the base part; a projection device installed on the base part and projecting images onto the screen from diagonally below; and a reflective material provided on a surface of the screen and performing specific angle reflection that reflects only incident light from diagonally downward in a horizontal direction.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to ,table the shown system Mu .

Background Art

[0002] Conventionally, there has been disclosed a technology that can perform very stereotypical operations, such as a humanoid robot shaped like a traffic controller for traffic guidance at a construction site or the like, and waving a signaling flag under the operation of a remote operator.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] According to the conventional technology, it can be applied to very stereotypical guidance operations such as forward / stop guidance for automobiles on the lane and lane changes. However, for example, in order to give appropriate guidance instructions to automobiles entering and leaving from a building construction site facing the road, pedestrians on the sidewalk, and general vehicles on the road, there is a great lack of flexibility.

[0005] Also, it may be considered to perform guidance work remotely by displaying an image of the remote operator captured by a camera on a display, but there is a problem that the display is often difficult to see under outdoor sunlight conditions. Furthermore, with a fixed display, there is a problem that it is impossible to perform guidance work while moving the device so as not to obstruct the line of sight of pedestrians and the like.

[0006] The present invention has been made in view of the above, and The remote guide, positioned in a control room away from the location where the image display device is installed, performs guidance actions for pedestrians, construction vehicles, etc., as seen on the on-site situation image projected onto VR goggles. The pedestrians or drivers of the construction vehicles can see the guidance actions of the remote guide projected onto the image display device, thereby enabling remote traffic control. it can Table the shown system Mu The purpose is to provide. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems and achieve the objectives, the present invention provides: A display system comprising: an image display device; a control server communicated with the image display device; VR goggles worn by a remote guide, communicated with the control server, detect the orientation of the remote guide's head and transmit it to the control server, and display images output from the control server; and a plurality of second imaging devices communicated with the control server and transmit captured images of the remote guide taken from different directions to the control server, wherein the image display device is movable. A base section, a support column erected on the base section, and a component installed from the support column toward the base section, Display image The screen and, The image transmitted from the control server is displayed on the screen. Project Multiple projectors, a first imaging device that captures images of the surrounding local conditions and transmits them to the control server, Equipped with The control server is characterized in that, based on the orientation of the remote guide's head detected by the VR goggles, it outputs a portion of the on-site situation image captured and transmitted by the first imaging device to the VR goggles, and based on the orientation of the remote guide's head while performing guidance instruction duties while viewing a portion of the on-site situation image displayed on the VR goggles, it transmits a portion or all of the captured image captured by the second imaging device to the image display device. [Effects of the Invention]

[0008] According to the present invention, the device can be used with good visibility both day and night, and guidance and instruction work can be performed while moving the device so as not to obstruct the movement of pedestrians, etc. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a diagram showing the schematic configuration of the display system according to the first embodiment. [Figure 2] Figure 2 is a block diagram showing the configuration of the display system. [Figure 3] Figure 3 is a block diagram showing the hardware configuration of the control server. [Figure 4] Figure 4 shows an example configuration of a mobile display. [Figure 5] Figure 5 shows the portable display with the screen retracted. [Figure 6] Figure 6 is a schematic diagram showing an example of a retroreflective material. [Figure 7] Figure 7 is a schematic diagram illustrating another example of retroreflective material. [Figure 8] Figure 8 shows an example of projecting a text message onto a screen. [Figure 9] Figure 9 shows another example configuration of a mobile display. [Figure 10]FIG. 10 is a diagram showing a schematic configuration of a display system according to the second embodiment.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of an image display device, a display system, a screen, and a remote image projection method will be described in detail with reference to the accompanying drawings.

[0011] (First Embodiment) Here, FIG. 1 is a diagram showing a schematic configuration of a display system 1 according to the first embodiment, and FIG. 2 is a block diagram showing the configuration of the display system 1. As shown in FIG. 1, the display system 1 includes a mobile display 10 which is an image display device, VR goggles 20 worn by a remote operator 3 in a control room 2 (an example of a second location) where the remote operator 3 exists, a plurality of video cameras 30 used in the control room 2, and a control server 40 which is an external device that processes the imaging images of the plurality of video cameras 30.

[0012] As shown in FIG. 2, the mobile display 10, the VR goggles 20, and the plurality of video cameras 30 are communicably connected to the control server 40. Wireless communication is used for the communication between the control server 40 and the VR goggles 20 and the plurality of video cameras 30, and the control server 40 can be installed at an arbitrary position as long as it is within the range where wireless communication with the VR goggles 20 and the plurality of video cameras 30 is possible. Also, for the communication between the control server 40 and the mobile display 10, communication via a network 50 such as the Internet is used.

[0013] As shown in FIG. 1, the remote instructor 3 in the control room 2 wears VR goggles 20, which is a local situation display device that projects an image (hereinafter referred to as "local situation image") captured by imaging the surroundings of the location where the mobile display 10 is installed (an example of the first location). When the VR goggles 20 are worn by the remote instructor 3 and activated, the control server 40 projects the local situation image in a predetermined direction as an initial state onto the VR goggles 20. Thereafter, the VR goggles 20 detect the orientation of the head of the remote instructor 3 wearing them and transmit it to the control server 40. The control server 40 changes the range of the local situation image projected onto the VR goggles 20 based on the received orientation of the head of the remote instructor 3. Thereby, the remote instructor 3 can obtain a virtual reality feeling as if he / she is at the location where the mobile display 10 is installed. Note that instead of the VR goggles 20, the wall surface of the control room 2 may be used as a local situation display device for projecting the local situation image.

[0014] The mobile display 10, the details of which will be described later, projects an image X of the remote instructor 3 captured by a video camera 30, which is one of a plurality of imaging devices in the control room 2, to perform, for example, guidance instruction services such as forward / stop guidance and lane change guidance for vehicles on a motor vehicle lane, or guidance instruction services for motor vehicles entering and leaving from a building construction site facing a road and pedestrians on a sidewalk. In the present embodiment, it is assumed that the mobile display 10 is installed near the vehicle entrance / exit of the construction site where a construction vehicle crosses in the east-west direction on a sidewalk running in the north-south direction.

[0015] As shown in FIG. 1, the control room 2 is provided with a plurality of video cameras 30 that image the remote instructor 3 who performs guidance instruction services while viewing the image projected onto the VR goggles 20 located within the control room 2.

[0016] Multiple video cameras 30 can capture the appearance of the remote guide 3 from all horizontal directions in real time. In the example shown in Figure 1, four video cameras 30 are installed in the control room 2, capturing images of the remote guide 3 from four directions. In this embodiment, the video cameras 30 are positioned so that when the remote guide 3 is facing one of the four video cameras 30, the front, back, and both left and right sides of the remote guide 3 are captured, respectively. Each video camera 30 outputs the image it has captured to the control server 40.

[0017] Next, the control server 40 will be described. Figure 3 is a block diagram showing the hardware configuration of the control server 40. As shown in Figure 3, the control server 40 includes a wireless communication unit 41, a display unit 42, an operation unit 43, a microphone 44, a storage unit 45, a control unit 46, and a communication unit 47.

[0018] The wireless communication unit 41 is a communication interface unit for wireless communication between the VR goggles 20 and multiple video cameras 30 using well-known technologies such as low-power communication, wireless LAN, or LTE (Long Term Evolution) communication.

[0019] The communication unit 47 is a communication interface unit for communicating with the mobile display 10 using communication via a network 50 such as the Internet.

[0020] The display unit 42 is composed of a display device such as an LCD panel and is used for display output to the remote guide 3. The operation unit 43 is composed of an operation device such as a keyboard and is used to receive operations from the remote guide 3. Alternatively, the display unit 42 and the operation unit 43 may be integrated using a touch panel display or the like. The microphone 44 is an audio input device used for voice input from the operator.

[0021] The storage unit 45 is a storage device consisting of a hard disk drive or non-volatile memory, etc.

[0022] The control unit 46 is a control unit that performs overall control of the control server 40. The control unit 46 is equipped with a control device such as a CPU (Central Processing Unit) and a storage device such as ROM (Read Only Memory) and RAM (Random Access Memory), and has a hardware configuration that uses a normal computer.

[0023] The control unit 46 processes the images captured from four directions by the four video cameras 30 and converts them into a format that can be projected onto the mobile display 10. The control unit 46 performs image processing such as removing distortion of the scale of the captured images. The control unit 46 also recognizes whether each of the images of the remote guide 3 captured by the four video cameras 30 is capturing the front of the remote guide 3, and transmits only the images of the remote guide 3 captured by the video camera 30 that is recognized as capturing the front to the mobile display 10.

[0024] Next, the configuration of the mobile display 10 will be described.

[0025] Figure 4 shows an example configuration of the mobile display 10. As shown in Figure 4, the mobile display 10 comprises a base 11, a plurality of projectors 12, a support column 13, and a screen 14.

[0026] The base section 11 is equipped with multiple wheels. The base section 11 is a disc-shaped trolley that can be moved by rotating its multiple wheels.

[0027] The support column 13 is erected vertically in the center of the base portion 11. The support column 13 is slidable and extendable.

[0028] The screen 14 is a conical shape (skirt shape) installed from the top of the support column 13 toward the circumference of the base portion 11. The screen 14 is equipped with a retroreflective material 15 on its surface. However, as will be described in detail later, as shown in Figure 4, the retroreflective material 15 does not simply reflect light, but performs specific-angle reflection, reflecting only incident light from an oblique downward direction in the horizontal direction. On the other hand, the retroreflective material 15 performs simple retroreflection of ambient light and direct sunlight.

[0029] As shown in Figure 4, the screen 14 is formed in a conical shape (skirt shape), and is composed of multiple sections that are horizontally sliced ​​at equal intervals in the vertical direction of the cone shape and then connected together.

[0030] Here, Figure 5 shows the mobile display 10 when the screen 14 is stored. As shown in Figure 5, the screen 14 is constructed by connecting multiple sections that have been horizontally sliced ​​at equal intervals in the vertical direction from the side shape of a cone, and is therefore foldable in accordance with the sliding extension and retraction of the support column 13. The shape of the screen 14 may also be based on the side shape of another cone, such as a polygonal pyramid, instead of a cone. Furthermore, the screen 14 may be attached to multiple rings that gradually increase in size from the bottom, like a fishing basket.

[0031] Multiple projectors 12 are installed on the circumference of the disc-shaped base 11. For example, if there are four video cameras 30 used in the control room 2, four projectors 12 are installed. The multiple projectors 12 are installed at regular intervals from the circumference of the disc-shaped base 11, oriented inward and upward, so that images of the remote guide 3 captured from four directions by the four video cameras 30 can be projected onto the screen 14 using the projector 12 in the direction corresponding to each imaging direction. In this embodiment, the four projectors 12 are installed on the circumference of the base 11 at equal intervals from each other, and the mobile display 10 is installed so that the projection direction of the projectors 12 matches the north-south sidewalk and the east-west vehicle entry and exit directions.

[0032] Furthermore, the mobile display 10 is equipped with a multi-directional speaker 16, a 360-degree camera 17, and a communication unit 18 on the upper part of the support column 13.

[0033] The communication unit 18 is a communication interface unit for communicating between the mobile display 10 and the control server 40 using communication via a network 50 such as the Internet.

[0034] The multi-directional speaker 16 outputs voice or electronic sound from the remote guide 3 in the control room 2, which is input via the microphone 44.

[0035] The 360-degree camera 17 is a local situation imaging device that captures local situation images, which are images of the area around the installation location of the mobile display 10, and transmits them to the control server 40 via the communication unit 18. The control server 40 projects the local situation images of the installation location of the mobile display 10 onto VR goggles 20, which are display devices worn by the remote guide 3 in the control room 2. Alternatively, the control server 40 may project the local situation images of the installation location of the mobile display 10 onto display devices that form the wall surface of the control room 2 and are installed around the remote guide 3, instead of using VR goggles 20.

[0036] When the remote guide 3 faces one of the four video cameras 30 in the control room 2, puts on the VR goggles 20, and activates them, the control server 40 projects the image of the local situation captured by the 360-degree camera 17 in a predetermined direction onto the VR goggles 20 as the initial state, and associates the video camera 30 that the remote guide 3 is facing with one of the four projectors 12 of the mobile display 10 that is installed in the imaging direction of that predetermined range.

[0037] In this embodiment, the control server 40 initially projects the area of ​​the local situation image that shows the road to the north onto the VR goggles 20, and associates the video camera 30 facing the goggles with the projector 12 located to the north on the mobile display 10. Similarly, the video camera 30 on the back of the remote guide 3 is associated with the projector 12 located to the south, the video camera 30 on the left side is associated with the projector 12 located to the west, and the video camera 30 on the right side is associated with the projector 12 located to the east.

[0038] The control unit 46 of the control server 40 recognizes that the image captured by the video camera 30 facing it is capturing the front view of the remote guide 3, and transmits only this image to the mobile display 10. As a result, only the projector 12 positioned north of the corresponding mobile display 10 projects the image onto the screen 14. Consequently, only pedestrians located on the north side of the sidewalk can see the front view of the remote guide 3 projected onto the mobile display 10.

[0039] Here, when the aforementioned remote guide 3, wearing the VR goggles 20, turns to face the video camera 30 on the right side, the eastern range of the on-site situation image is projected onto the VR goggles 20. Following a similar process, the projector 12 positioned to the east of the mobile display 10 projects the frontal image of the remote guide 3 onto the screen 14, while the other projectors 12 do not project the image of the remote guide 3. As a result, only the drivers of construction vehicles approaching from the east can see the frontal image of the remote guide 3.

[0040] Furthermore, when the remote guide 3, wearing the VR goggles 20, turns to face the video camera 30 on the right side, the VR goggles 20 will project the southward range of the on-site situation image. Following a similar process, the projector 12 positioned south of the mobile display 10 will project the frontal image of the remote guide 3 onto the screen 14, while the other projectors 12 will not project the image of the remote guide 3. As a result, only pedestrians located on the south side of the sidewalk will be able to see the frontal image of the remote guide 3.

[0041] Furthermore, when the remote guide 3, wearing the VR goggles 20, turns to face the video camera 30 on the right side, the westward range of the on-site situation image is projected onto the VR goggles 20. Following a similar process, the projector 12 positioned to the west of the mobile display 10 projects the frontal image of the remote guide 3 onto the screen 14, while the other projectors 12 do not project the image of the remote guide 3. As a result, only the drivers of construction vehicles approaching from the west can see the frontal image of the remote guide 3.

[0042] Through the processing described above, the direction in which the VR goggles 20 worn by the remote guide 3 project the on-site situation image matches the direction in which the projector 12 projects the front view of the remote guide 3. As a result, the remote guide 3, while positioned in the control room 3 away from where the mobile display 10 is installed, can perform guidance actions for pedestrians, construction vehicles, etc., that appear in the on-site situation image projected onto the VR goggles 20. The pedestrians or drivers of the construction vehicles can then see the guidance actions of the remote guide 3 projected onto the mobile display 10, enabling remote traffic control.

[0043] Next, we will describe in detail the retroreflective material 15 provided on the surface of the screen 14.

[0044] Here, Figure 6 is a schematic diagram showing an example of the retroreflective material 15. Figure 6(a) shows the retroreflective material 15 according to this embodiment, and Figure 6(b) shows a conventional retroreflective material 115.

[0045] As shown in Figure 6(a), the retroreflective material 15 is constructed by inserting a spherical transmissive body 15b, which is a lens, into a spherical reflector 15a that is arranged in a series on the surface of the screen 14. The spherical transmissive body 15b of the retroreflective material 15 shown in Figure 6(a) is not a perfect sphere like the spherical transmissive body 115b inserted into the spherical reflector 115a of the conventional retroreflective material 115 shown in Figure 6(b).

[0046] As shown in Figure 6(a), the spherical transmissive body 15b of the retroreflective material 15 has a spherical lower half, and only the upper left (the position where incident light from the projector 12 is projected) is a plane composed of straight lines at a specific angle. By configuring the spherical transmissive body 15b of the retroreflective material 15 in this way, it is possible to perform specific-angle reflection, which reflects only the incident light from the projector 12 projected from the diagonally downward direction horizontally, rather than simple retroreflection.

[0047] Here, Figure 7 is a schematic diagram showing another example of the retroreflective material 15. Figure 7(a) shows the retroreflective material 15 according to this embodiment, and Figure 7(b) shows a conventional retroreflective material 115.

[0048] As shown in Figure 7(a), the retroreflective material 15 is composed of sawtooth-shaped reflective mirror surfaces 15c arranged in a series on the surface of the screen 14. The reflective mirror surfaces 15c of the retroreflective material 15 shown in Figure 7(a) are not corner mirrors (mutually orthogonal box-shaped mirror surfaces) 115c, as in the conventional retroreflective material 115 shown in Figure 7(b).

[0049] As shown in Figure 7(a), the sawtooth-shaped reflective mirror surface 15c of the retroreflective material 15 includes a first mirror surface perpendicular to the bisector between the direction from diagonally downward (the direction from which the incident light from the projector 12 is irradiated) and the horizontal direction, and a second mirror surface perpendicular to the first mirror surface. By configuring the retroreflective material 15 in this way, it is possible to perform specific-angle reflection that reflects only the incident light from diagonally downward irradiated from the projector 12 in the horizontal direction, rather than simple retroreflection.

[0050] As described above, according to this embodiment, the properties of the retroreflective material 15 provided on the surface of the screen 14 enable highly visible remote video guidance even under strong direct sunlight, allowing for use with good visibility both day and night, and enabling responses to sudden or unusual events. Furthermore, it becomes possible to perform guidance instruction work while moving the device without obstructing the flow of pedestrians, etc. Moreover, according to this embodiment, the travel time of the remote guide 3 to the site is eliminated, allowing them to work from any location and concentrate on guidance instruction work in a comfortable indoor environment.

[0051] In this embodiment, an image X is projected onto the screen 14 using multiple projectors 12. However, this is not the only option, and a projection device that performs finer granularity control or projection mapping according to the shape of the screen 14 by scanning the light beam may also be used.

[0052] Furthermore, in this embodiment, the control unit 46 of the control server 40 transmits images of the remote guide 3 captured from four directions by the four video cameras 30 to the mobile display 10. However, it is not limited to this, and necessary text messages may also be transmitted to the mobile display 10 and projected onto the screen 14. Here, Figure 8 shows an example in which a text message M is projected onto the screen 14.

[0053] Furthermore, in this embodiment, the control unit 46 of the control server 40 transmits images of the remote guide 3 captured from four directions by the four video cameras 30 to the mobile display 10. However, the system is not limited to this, and the remote guide 3 in the control room 2 may wear a data suit to digitize the movements of the remote guide 3, and this digitization device may be used as the imaging device, which can then be transmitted to the mobile display 10 to project image X. Alternatively, the imaging device that digitizes the movements of the remote guide 3 may also create an avatar image by moving an animated character or the like in conjunction with the digitized movements of the remote guide 3, and transmit this avatar image to the mobile display 10. In this case, it can also be used as a promotional tool for characters or merchandise.

[0054] In this embodiment, the screen 14 is constructed by connecting multiple sections that have been horizontally sliced ​​at equal intervals in the vertical direction from a cone shape, but it is not limited to this configuration. Figure 9 shows another example of the configuration of the mobile display 10. As shown in Figure 9, the screen 14 may be made of fabric so that it can be folded in accordance with the sliding extension and retraction of the support column 13.

[0055] (Second Embodiment) Next, a second embodiment will be described.

[0056] The second embodiment differs from the first embodiment in that multiple remote guides perform the guidance and instruction tasks. In the following description of the second embodiment, the parts that are the same as those in the first embodiment will be omitted, and the parts that differ from the first embodiment will be described.

[0057] Figure 10 shows a schematic configuration of the display system 1 according to the second embodiment. In the example of the display system 1 shown in Figure 10, different remote guides 3A to 3C are stationed in multiple control rooms 2A to 2C.

[0058] In this case, the mobile display 10 shall have projectors 12A to 12C, each projecting images XA to XC for each control room 2A to 2C, installed on the circumference of a disc-shaped base 11.

[0059] Each control server 40 in control rooms 2A to 2C transmits to the mobile display 10 an image taken from the front of the remote guide 3, for example, from the images captured from four directions by the four video cameras 30.

[0060] Thus, according to this embodiment, a single mobile display 10 enables multiple remote guides 3A to 3C to provide guidance instructions in multiple directions.

[0061] While the embodiments described above are preferred examples of the present invention, they are not limiting, and various modifications are possible without departing from the spirit of the invention. [Explanation of Symbols]

[0062] 1 Display System 10 Image display device 11 Base section 12 Projection device 13 Support pillar 14 screens 15 Reflective material 15a Spherical reflector 15b Spherical transparent body 15c Serrated reflective mirror surface 17. On-site situation imaging device 18 Communications Department 20 Local Situation Display Device 30 Imaging device 40 External equipment

Claims

[Claim 1] An image display device, A control server that is communicated with the aforementioned image display device, A VR goggle worn by a remote guide, which is connected to the control server, detects the orientation of the remote guide's head and transmits it to the control server, and displays an image output from the control server. Multiple second imaging devices are connected to the control server and transmit images of the remote guide taken from different directions to the control server. A display system comprising, The aforementioned image display device is A base portion that makes the image display device movable, A support column erected on the base portion, A screen for displaying an image is installed from the support column toward the base portion, Multiple projectors that project images transmitted from the control server onto the screen, A first imaging device that captures images of the surrounding local conditions and transmits them to the control server, Equipped with, The control server, Based on the orientation of the remote guide's head detected by the VR goggles, a portion of the on-site situation image captured and transmitted by the first imaging device is output to the VR goggles, and based on the orientation of the remote guide's head while performing guidance instruction duties while viewing a portion of the on-site situation image displayed on the VR goggles, a portion or all of the captured image captured by the second imaging device is transmitted to the image display device. A display system characterized by the following features.

Images