Information processing apparatus and method

Abstract

The present technology pertains to an information processing device and method that make it possible to efficiently monitor a plurality of moving objects. The information processing apparatus includes a plurality of small screens arranged in a matrix, and controls to: associate different moving objects with small screens in respective rows of a first display screen for monitoring the plurality of moving objects, respectively; displaying, on small screens in a first column of the first display screen, traveling direction images obtained by capturing an image of a traveling direction of the moving object, respectively; displaying, on small screens in a second column adjacent to the left side of the small screens in the first column of the first display screen, left-side images obtained by capturing left-side images with respect to a traveling direction of the moving object, respectively; and displaying, on small screens in a second column adjacent to the small screens in the first column on the right side of the first display screen, right-side images obtained by capturing right-side images with respect to the traveling direction of the moving object, respectively. This technology can be applied to a remote monitoring system.

Description

Technical Field

[0001] The present technology relates to an information processing apparatus and method, and more particularly, to an information processing apparatus and method capable of efficiently monitoring a plurality of moving objects. Background Art

[0002] There is a need for a system that enables an operator to efficiently monitor a plurality of moving objects.

[0003] For example, Patent Document 1 discloses a system for remotely monitoring a plurality of moving objects.

[0004] Citation List

[0005] Patent Document

[0006] Patent Document 1: International Publication No. 2021 / 199230 Summary of the Invention

[0007] Problems to be Solved by the Invention

[0008] However, Patent Document 1 does not describe a technique designed from the viewpoint of the amount of line-of-sight movement.

[0009] The present technology has been made in view of such a situation and enables efficient monitoring of a plurality of moving objects.

[0010] Solution to the Problem

[0011] An information processing apparatus according to an aspect of the present technology includes a display control unit that controls the display of a first display screen including a plurality of small screens arranged in a matrix and used for monitoring a plurality of moving objects. The display control unit is configured to perform control to: cause different moving objects to correspond to the small screens in each row of the first display screen; display, on the small screens in the first column of the first display screen, traveling direction images obtained by imaging the traveling directions of the respective moving objects; display, on the small screens in the second column adjacent to the left of the small screens in the first column of the first display screen, left side images obtained by imaging the left sides relative to the traveling directions of the respective moving objects; and display, on the small screens in the third column adjacent to the right of the small screens in the first column of the first display screen, right side images obtained by imaging the right sides relative to the traveling directions of the respective moving objects.

[0012] In one aspect of the present technology, the display of a first display screen is controlled. The first display screen includes a plurality of small screens arranged in a matrix and is used for monitoring a plurality of moving objects. Further, control is executed such that different moving objects correspond to the small screens in each row of the first display screen, and the traveling direction images obtained by imaging the traveling directions of the corresponding moving objects are respectively displayed on the small screens in the first column of the first display screen, the left-side images obtained by imaging the left side with respect to the traveling directions of the corresponding moving objects are respectively displayed on the small screens in the second column adjacent to the left side of the small screens in the first column of the first display screen, and the right-side images obtained by imaging the right side with respect to the traveling directions of the corresponding moving objects are respectively displayed on the small screens in the third column adjacent to the right side of the small screens in the first column of the first display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a diagram illustrating a configuration example of a remote monitoring system according to an embodiment of the present technology.

[0014] Figure 2 is a diagram illustrating a configuration example of the appearance of a truck.

[0015] Figure 3 is a top view of the truck observed from above.

[0016] Figure 4 is a block diagram illustrating a configuration example of the truck and the monitoring device.

[0017] Figure 5 is a diagram illustrating a configuration example of the display screen.

[0018] Figure 6 is a diagram illustrating a display example of the left display screen.

[0019] Figure 7 is a diagram illustrating a display example of a part of the left display screen.

[0020] Figure 8 is a diagram illustrating a display example of the right display screen.

[0021] Figure 9 is a diagram illustrating another configuration example of the display screen.

[0022] Figure 10 is a block diagram illustrating a configuration example of a computer. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0023] Hereinafter, the manner for implementing the present technology will be described. The description will be given in the following order.

[0024] 1. System Configuration and Device Configuration

[0025] 2. Display Screen Example

[0026] 3. Others

[0027] <1. System Configuration and Device Configuration>

[0028] <Configuration of Remote Monitoring System>

[0029] Figure 1 is a diagram illustrating a configuration example of a remote monitoring system according to an embodiment of the present technology.

[0030] Figure 1 The remote monitoring system 1 of < > includes trucks 11-1 to 11-3 and a monitoring device 12 that monitors the trucks 11-1 to 11-3. The trucks 11-1 to 11-3 and the monitoring device 12 are connected by wireless communication. Note that, when it is not necessary to distinguish between the trucks 11-1 to 11-3, they are simply referred to as truck 11.

[0031] The truck 11 is a vehicle that can move through autonomous driving, remote operation of the monitoring device 12, etc. Personnel can enter the truck 11. The truck 11 can also be driven by an occupant.

[0032] The truck 11 includes multiple sensors in its outer shell and includes multiple sensors for imaging the surroundings and interior of the truck 11. The truck 11 transmits the images captured by the multiple sensors to the monitoring device 12 via wireless communication.

[0033] The monitoring device 12 receives the images transmitted from the truck 11 and controls the display of the display screen containing the received multiple images. By viewing the display screen displayed on the monitoring device 12, the monitoring personnel can monitor multiple trucks 11 simultaneously. The monitoring device 12 remotely operates the truck 11 in response to the operation of the monitoring personnel.

[0034] Note that Figure 1 the number of trucks 11 and monitoring devices 12 in < > is an example and is not limited. For example, the number of trucks monitored by the monitoring device 12 can be 1, 2, 4, or more.

[0035] <Appearance of the Truck>

[0036] Figure 2 is a diagram illustrating a configuration example of the appearance of the truck 11.

[0037] In Figure 2 it illustrates the appearance of the truck 11 when observed obliquely from the left side.

[0038] The truck 11 includes a motorized electric vehicle such as an electric truck. Note that the truck 11 according to this embodiment is not limited to an electric vehicle.

[0039] The body of the truck 11 has a substantially rectangular parallelepiped shape. The vehicle exterior display unit 21F, the vehicle exterior display unit 21R (not shown), the vehicle exterior display unit 21L, and the vehicle exterior display unit 21B (not shown) are respectively provided on the front surface, the left side surface, the right side surface, and the rear surface of the truck 11. For example, the vehicle exterior display units 21F to 21B include thin display devices such as a liquid crystal display (LCD) or an organic electroluminescence (EL) panel.

[0040] As Figure 2 Illustrated in, the entrance for people to enter and exit is provided at a position near the rear side of the left side surface of the body. There is no door at the entrance. A similar entrance is also provided on the right side surface of the body.

[0041] Sensors 22F, 22L, 22R (not shown), and 22B (not shown), each including an image sensor or the like, are provided on the upper portions of the front surface, the left side surface, the right side surface, and the rear surface of the truck 11. Images of the front side, the left side, the right side, and the rear side of the truck 11 are respectively captured by the sensors 22F to 22B.

[0042] Note that sensors 22FB and 22BB (not shown) are respectively provided at the lower portions of the front surface and the rear surface of the truck 11. The sensors 22FB and 22BB capture images of the front and rear lower foot portions (the areas near the wheels) of the truck 11 that are blind spots when viewed from the sensors 22F and 22B. In addition, a sensor 22I (not shown) that captures an image of the inside of the truck 11 (vehicle interior image) in addition to the outside is provided in front of the inside of the truck 11.

[0043] For example, the truck 11 having such an exterior structure is used in a situation where people are carried and travel at a relatively low speed on a circular route provided in a park, a theme park, or the like. The passengers can enjoy the presentation provided by the truck 11 while viewing the surrounding scenery.

[0044] <Viewing Angle of the Sensor>

[0045] Figure 3 is a top view of the truck 11 observed from above.

[0046] In Figure 3 Illustrated in, the periphery of the body of the truck 11 and the viewing angles of each sensor 22 are shown.

[0047] For ease of explanation, as Figure 3 Illustrated in, the periphery of the body of the truck 11 is divided into the front side, the left front side, the right front side, the left side, the right side, the rear side, the left rear side, and the right rear side of the body.

[0048] Specifically, the front side and the left front side, and the rear side and the left rear side are divided by a left side line (not shown) indicating the position of the left end of the vehicle body. The front side and the right front side, and the rear side and the right rear side are divided by a right side line (not shown) indicating the position of the right end of the vehicle body.

[0049] The left front side and the left side, and the right front side and the right side are divided by a front line (not shown) indicating the position of the front end of the vehicle body. The left rear side and the left side, and the right rear side and the right side are divided by a rear line (not shown) indicating the position of the rear end of the vehicle body.

[0050] Here, the line LF includes the line before the intersection of the front line and the left side line and the line to the left of the intersection of the left side line and the front line.

[0051] The line LB includes the line after the intersection of the rear line and the left side line and the line to the left of the intersection of the left side line and the rear line.

[0052] The line RF includes the line before the intersection of the front line and the right side line and the line to the right of the intersection of the right side line and the front line.

[0053] The line RB includes the line before the intersection of the rear line and the right side line and the line to the right of the intersection of the front line and the right side line.

[0054] These lines LF to RB are auxiliary lines in the left and right images of the display screen displayed on the monitoring device 12, but the details will be described later.

[0055] Note that, for safety reasons, the position indicated by the front line can actually be a position offset by a predetermined length in front of the front end of the vehicle body. The position indicated by the left side line can be a position offset by a predetermined length to the left from the left end of the vehicle body. The position indicated by the rear line can be a position offset by a predetermined length to the rear from the rear end of the vehicle body. The position indicated by the right side line can be a position offset by a predetermined length to the right from the right end of the vehicle body.

[0056] The viewing angles of the sensors 22F and 22B are approximately 120 degrees indicated by the arcs of the left and right dotted lines. For example, general imaging lenses are used for the sensors 22F and 22B. Note that the type of lens used for the sensors 22F and 22B is not limited.

[0057] The sensor 22F captures images of the front side, the left front side, and the right front side. The sensor 22B captures images of the rear side, the left rear side, and the right rear side.

[0058] The viewing angles of the sensors 22L and 22R are approximately 180 degrees indicated by the arcs of the upper and lower dotted lines. For example, wide-angle fish-eye lenses are used for the sensors 22L and 22R. Note that the type of lens used for the sensors 22L and 22R is not limited.

[0059] The sensor 22L captures images of the left front side, the left side, and the left rear side. The sensor 22R captures images of the right front side, the right side, and the right rear side. Note that when the truck 11 turns left or right, the images captured by the sensor 22L and the sensor 22R also include the front side and the rear side.

[0060] <Configuration of the truck and the monitoring device>

[0061] Figure 4 is a block diagram illustrating an example of the configuration of the truck 11 and the monitoring device 12.

[0062] In Figure 4 , components corresponding to the above components are denoted by the same reference numerals. Redundant descriptions will be appropriately omitted.

[0063] As Figure 4 illustrated in

[0064] Note that the vehicle exterior display unit 21 corresponds to the vehicle exterior display units 21F to 21B, and the sensor 22 corresponds to the sensors 22F to 22B.

[0065] The vehicle control unit 31 controls the operation of each unit based on a predetermined program or control information from the monitoring device 12 supplied via the communication unit 34.

[0066] The image processing unit 32 performs predetermined image processing on the image data supplied from the sensor 22, and outputs the image data to the communication unit 34.

[0067] The display control unit 33 displays contents and the like on the vehicle exterior display unit 21 under the control of the vehicle control unit 31.

[0068] The communication unit 34 sends the image data supplied from the image processing unit 32 to the monitoring device 12. The communication unit 34 receives the control information sent from the monitoring device 12, and outputs the control information to the vehicle control unit 31.

[0069] Note that although not illustrated, the truck 11 also includes a power source such as an electric motor, wheels, a transmission that transmits the power generated by the power source to the wheels, and a driving unit related to the movement of the truck 11 such as a braking mechanism.

[0070] In addition, as Figure 4 illustrated in

[0071] The communication unit 41 receives the image data transmitted from the freight vehicle 11 and outputs the image data to the display control unit 43. The communication unit 41 transmits the control information supplied from the remote operation unit 42 to the freight vehicle 11.

[0072] The remote operation unit 42 generates control information according to the operations of the monitoring personnel on the keyboard, the control panel (control screen) displayed on the screen, etc., and outputs the control information to the communication unit 41.

[0073] Using the image data supplied from the communication unit 41, the display control unit 43 generates two types of (left and right) display screen data based on the size of the image, the area and aspect ratio of the display units 44-1 and 44-2, etc., so as to further reduce the amount of movement of the monitoring personnel's line of sight. The display control unit 43 respectively controls the display of the display screens corresponding to the two types of generated display screen data on the display units 44-1 and 44-2.

[0074] The display units 44-1 and 44-2 include an LCD, an organic EL panel, etc. The display units 44-1 and 44-2 display the display screens corresponding to the display screen data supplied from the display control unit 43. When it is not necessary to distinguish between the display units 44-1 and 44-2, they are simply referred to as the display unit 44. Note that the number of the display units 44 is not limited to two.

[0075] <2. Display Screen Example>

[0076] <Configuration of the Display Screen>

[0077] Figure 5 It is a diagram illustrating an example of the configuration of the display screen.

[0078] In Figure 5 the display screen 100 includes small screens W1 to W18 arranged in a 3-row × 6-column matrix for displaying the images captured by the multiple freight vehicles 11.

[0079] Note that on the display screen 100, the names of the freight vehicles corresponding to each row are displayed on the left side of the small screens W1 to W18. On the upper part of the small screens W1 to W18, the names of the directions, locations, panels, etc. that appear in the images corresponding to the respective columns are displayed.

[0080] The first row from the top is the row corresponding to the freight vehicle 11-1. In the first row, the small screens W1 to W3 and the small screens W10 to W12 on which the images captured by the freight vehicle 11-1 are respectively displayed are arranged from the left side.

[0081] The second row from the top is the row corresponding to the truck 11-2. In the second row, the small screens W4 to W6 and the small screens W13 to W15 on which the images captured by the truck 11-2 are respectively displayed are arranged from the left.

[0082] The third row from the top is the row corresponding to the truck 11-3. In the third row, the small screens W7 to W9 and the small screens W16 to W18 on which the images captured by the truck 11-3 are respectively displayed are arranged from the left.

[0083] In addition, the first column from the left is the column corresponding to the left side (left) of each truck 11. In the first column, the small screens W1, the small screen W4, and the small screen W7 on which the left images Le1 to Le3 captured by the sensor 22L of the truck 11 are respectively displayed are arranged from the top.

[0084] The second column from the left is the column corresponding to the front side (front) of each truck 11. In the second column, the small screens W2, the small screen W5, and the small screen W8 on which the left front images Fr1 to Fr3 captured by the sensor 22F of the truck 11 are respectively displayed are arranged from the top.

[0085] The third column from the left is the column corresponding to the right side (right) of each truck 11. In the third column, the small screens W3, the small screen W6, and the small screen W9 on which the right images Ri1 to Ri3 captured by the sensor 22R of the truck 11 are respectively displayed are arranged from the top.

[0086] The fourth column from the left is the column corresponding to the rear side (rear) of each truck 11. In the fourth column, the small screens W10, the small screen W13, and the small screen W16 on which the rear images Re1 to Re3 captured by the sensor 22B of the truck 11 are respectively displayed are arranged from the top.

[0087] Note that the rear images Re1 to Re3 can be displayed in a horizontally reversed manner. Examples of the left-right reversal method include the method of left-right reversal during output in the sensor 22B, the method of left-right reversal during display control, etc., and any method can be used.

[0088] The fifth column from the left is the column corresponding to the interior (inside) of each truck 11. In the fifth column, the small screens W11, the small screen W14, and the small screen W17 on which the interior images In1 to In3 captured by the sensor 22I of the truck 11 are respectively displayed are arranged from the top.

[0089] The sixth column from the left is the column corresponding to the control panel for controlling the actions of each truck 11. In the sixth column, the small screens W12, the small screen W15, and the small screen W18 on which the control panel images Co1 to Cο3 of each truck 11 are respectively displayed are arranged from the top.

[0090] Note that the display screen 100 is divided into a left display screen 100L displayed on the display unit 44-1 and a right display screen 100R displayed on the display unit 44-2. The left display screen 100L includes small screens W1 to W9 arranged in 3 rows and 3 columns. The right display screen 100R includes small screens W10 to W18 arranged in 3 rows and 3 columns.

[0091] While monitoring the left display screen 100L and the right display screen 100R, the monitoring personnel check whether there is any abnormality around or inside the truck 11, and control the desired actions of the truck 11 by operating a keyboard or the like provided in the monitoring device 12 when necessary.

[0092] Note that the small screens W1 to W9 included in the left display screen 100L may be included in the right display screen 100R. Similarly, the small screens W10 to W18 included in the right display screen 100R may be included in the left display screen 100L.

[0093] <Display example of the left display screen>

[0094] Figure 6 It is a diagram showing a display example of the left display screen 100L.

[0095] Figure 6 An example is illustrated in which the trucks 11-1 and 11-2 are working and the truck 11-3 has stopped. Therefore, among the small screens W1 to W9 in the left display screen 100L, each image is displayed on each of the small screens W1 to W6 in the first and second rows corresponding to the trucks 11-1 and 11-2. Note that when the truck 11-3 is working, each image is also displayed on the small screens W7 to W9 in the third row corresponding to the truck 11-3.

[0096] In the left display screen 100L, the second column corresponding to the front side (front part) of the traveling direction of each truck 11 is substantially at the center. In the left display screen 100L, the first column corresponding to the left side (left) of the traveling direction of each truck 11 is on the left of the second column. In the left display screen 100L, the third column corresponding to the right side (right) of the traveling direction of each truck 11 is on the right of the second column.

[0097] On the small screens W1 and W4 in the first column, the lines LF and LB described above Figure 3 are superimposed and displayed on the left images Le1 and Le2 captured by the sensors 22L of each of the trucks 11-1 and 11-2.

[0098] The left images Le1 and Le2 respectively includeFigure 3 the front area corresponding to the front side in Figure 3 the left front area corresponding to the left front side in Figure 3 the left area corresponding to the left side in Figure 3 the rear area corresponding to the rear side in and Figure 3 the image of the left rear area corresponding to the left rear side in

[0099] Line LF is supplementarily displayed in the left images Le1 and Le2 to clearly show the front area, the left front area, and the left area. Line LB is supplementarily displayed in the left images Le1 and Le2 to clearly show the rear area, the left rear area, and the left area. For example, in the left image Le1, when there is an obstacle in the front area in front of the front side that appears in the traveling direction, the monitoring personnel can determine that there is a risk of collision if the truck 11 travels as it is.

[0100] In the small screens W2 and W5 in the second column, the line LD indicating the traveling direction and the distance from the body of the truck 11 are superimposed and displayed on the front images Fr1 and Fr2 captured by the sensors 22F of the trucks 11-1 and 11-2.

[0101] On the small screens W3 and W6 in the third column, the line RF and the line LB are respectively superimposed and displayed on the right images Ri1 and Ri2 captured by the sensors 22R of the trucks 11-1 and 11-2.

[0102] Each of the right images Ri1 and Ri2 includes Figure 3 the front area corresponding to the front side in Figure 3 the right front area corresponding to the right front side in Figure 3 the right area corresponding to the right side in Figure 3 the rear area corresponding to the rear side in and Figure 3 the right rear area corresponding to the right rear side in

[0103] The line RF is supplementarily displayed in the right images Ri1 and Ri2 to clearly show the front area, the right front area, and the right area. The line RB is supplementarily displayed in the right images Ri1 and Ri2 to clearly show the rear area, the right rear area, and the right area.

[0104] As described above, in the left display screen 100L, as indicated by the dotted ellipse, images capturing the traveling directions of the respective trucks 11 (the front regions and left front regions of the front-side images Fr1 to Fr3 and left-side images Le1 to Le3, and the front regions and right front regions of the right-side images Ri1 to Ri3) are arranged to be substantially centered. That is, since the images capturing the traveling directions, which are part of what is frequently viewed during general surveillance, are gathered at substantially the center of the left display screen 100L, the amount of movement of the surveillance personnel's line of sight can be further reduced. Therefore, security can be further enhanced.

[0105] <Display example of a part of the left display screen>

[0106] Note that, for example, when the shift lever (gear position) of the truck 11 is set to reverse and the traveling direction becomes the rear side of the truck 11, the second column set at the center on the left display screen 100L can correspond to the rear side, as Figure 7 illustrated.

[0107] Figure 7 is a diagram illustrating a display example of a part of the left display screen 100L.

[0108] Figure 7 Illustrates the following example: For example, when the shift lever of the truck 11 is set to reverse and the traveling direction becomes the rear side of the truck 11, the second column set at substantially the center on the left display screen 100L corresponds to the rear side.

[0109] Note that in Figure 7 for ease of explanation, only the small screens W1 to W3 in the first row of the left display screen 100L are illustrated, but the other rows are similar.

[0110] In this case, on the small screen W2 in the second column, a rear-side image Re1 of the truck 11-1 captured by the sensor 22B and behind in the traveling direction is displayed.

[0111] At this time, the display of the small screen W1 in the first column can be changed so that the right-side image Ri1 in Figure 6 displayed on the left side in the traveling direction (backward) is shown.

[0112] Similarly, the display of the small screen W3 in the third column can be changed so that the left-side image Le1 in Figure 6 displayed on the right side in the traveling direction (backward) is shown.

[0113] As described above, even when the traveling direction becomes the rear side of the freight car 11, the images capturing the traveling direction of the freight car 11 (the rear side image Re1, the right rear area of the right side image Ril, and the left rear area of the left side image Le1) are arranged to be located substantially at the center. That is, in addition, in Figure 7 this case, since the images in the traveling direction, which are part of what is frequently viewed during general surveillance, are gathered substantially at the center of the left display screen 100L, the amount of movement of the surveillance personnel's line of sight can be further reduced. Therefore, the security can be further enhanced.

[0114] <Display example of the right display screen>

[0115] Figure 8 is a diagram illustrating a display example of the right display screen 100R.

[0116] Similar to Figure 6 this, Figure 8 illustrates an example in which the freight cars 11-1 and 11-2 are operating and the freight car 11-3 is stopped. Therefore, among the small screens W10 to W18 in the right display screen 100R, each image is displayed on each of the small screens W10 to W15 in the first and second rows corresponding to the freight cars 11-1 and 11-2. Note that when the freight car 11-3 is operating, each image is also displayed on the small screens W16 to W18 in the third row corresponding to the freight car 11-3.

[0117] In the right display screen 100R, the fourth column corresponding to the rear side (rear part) is located closest to the left side of the left display screen 100L, on which the left side image, the front side image, and the right side image are displayed. In the right display screen 100R, the fifth column corresponding to the interior (inside) of the vehicle is located substantially at the center. In the right display screen 100R, the sixth column corresponding to the control panel is located on the right side.

[0118] Traveling information of each freight car such as the shift position, speed, and remaining battery power is displayed in a superimposed manner on the rear side images Re1 and Re captured by the sensors 22B of the freight cars 11-1 and 11-2 and displayed on the small screens W10 and W13 in the fourth column. Note that this traveling information can also be superimposed and displayed on other small screens by setting.

[0119] Note that the driving control such as shifting gears, braking (stopping), and starting of each freight car 11 is performed by the administrator's operation of the respective shortcut keys on the keyboard.

[0120] The function information of each truck 11 indicating the on / off of the guidance mode, the on / off of the remote driving, and the on / off of the obstacle detection is superimposed and displayed on the in-vehicle images In1 and In2 shown in the small screens W11 and W14 in the fifth column captured by the sensors 22I of the trucks 11-1 and 11-2. Note that this function information can also be superimposed and displayed on other small screens by setting.

[0121] The guidance mode is a mode in which the truck 11 operates autonomously under the guidance of radio frequency (RF) tags embedded in the travel path. Remote driving is a function for setting whether the truck 11 operates under the control of the monitoring device 12. For example, obstacle detection is a function for detecting whether there are obstacles in the travel direction by sensors provided in the front lower part of the vehicle body.

[0122] The setting information for controlling each truck 11, such as a switching button for video connection, a switching button for audio connection (headphone), a switching button for audio connection (microphone), a camera display switch button, a button for giving way, a warning button, and a power button, is displayed on the control panel images Co1 and Co2 of the trucks 11-1 and 11-2 shown in the small screens W12 and W15 in the sixth column.

[0123] The switching button for video connection is a switching button for receiving the image data captured by the respective sensors 22 of each truck 11 and setting whether to display the image corresponding to the received image data on the display unit 44.

[0124] The switching button for voice connection (headphone) is a switching button for receiving the voice data collected by a microphone (not shown) installed in each truck 11 and setting whether to output the voice corresponding to the received voice data to the speaker (not shown) of the monitoring device 12.

[0125] The switching button for voice connection (microphone) is a switching button for setting whether to use the microphone (not shown) installed in the monitoring device 12 to collect voice and send the voice data to each truck 11.

[0126] Note that a forced disconnection button for forcibly disconnecting the above-mentioned respective connections is provided on the right side of each switching button.

[0127] The camera display switching button is a button for switching between the front main camera and the front blind spot camera. When the front main camera is selected, the front side images of the sensor 22F of the truck 11 are respectively displayed on each of the small screens W2, W5, and W8 in the left display screen 100L. When the front blind spot camera is selected, the front underfoot images imaged by the sensor 22FB of each truck 11 are displayed on each of the small screens W2, W5, and W8 in the left display screen 100L.

[0128] Note that, in the case where the shift lever of the truck 11 is switched from parking to driving, the front main camera can be switched to the front blind spot camera, and the front underfoot images of the sensor 22FB of each truck 11 can be displayed on each of the small screens W2, W5, and W8 in the left display screen 100L. At this time, for example, the monitoring personnel select the front main camera, and the truck 11 is controlled to start driving when the front side images of the sensor 22F of each truck 11 are displayed on each of the small screens W2, W5, and W8 in the left display screen 100L. In this way, the safety of remote operation can be enhanced.

[0129] On the right side of the camera display switching button, a front blind spot camera restart button for restarting the sensor 22FB is also provided.

[0130] Note that, for example, as described above with reference to Figure 7 In the case where the shift lever of the truck 11 is set to the reverse gear and the traveling direction is the rear side of the truck 11, when the front main camera is selected, the rear side image of the sensor 22B can be displayed on the small screen W2 in the left display screen 100L. In addition, in this case, when the front blind spot camera is selected, the rear underfoot image of the sensor 22BB is displayed on the small screen W2 in the left display screen 100L.

[0131] The button for giving way is a button for giving way to the trucks 11 behind during driving. By pressing the button for giving way, the monitoring device 12 causes the truck 11 to slowly stop on the road shoulder while outputting an image or sound indicating giving way. By pressing the warning button, the monitoring device 12 causes the truck 11 to output an image or sound for warning of surrounding dangers. By pressing the power button, the monitoring device 12 turns on and off the power of the truck 11.

[0132] <Another configuration example of the display screen>

[0133] Figure 9 is a diagram illustrating a configuration example of the display screen.

[0134] In Figure 9In this case, the display screen 151 includes small screens W51 to W56 arranged in a 2-row × 3-column matrix for displaying images captured by a freight truck 11-1.

[0135] In the first row from the top, from the left, there are arranged a small screen W51 on which an interior image In1 of the vehicle captured by the sensor 22I is displayed, a small screen W52 on which a rear-side image Re1 captured by the sensor 22B is displayed, and a small screen W53 on which a control panel image C01 is displayed.

[0136] In the second row, from the left, there are arranged a small screen W54 on which a left-side image Le1 captured by the sensor 22L is displayed, a small screen W55 on which a front-side image Fr1 captured by the sensor 22F is displayed, and a small screen W56 on which a right-side image Ri1 captured by the sensor 22R is displayed.

[0137] As described above, on the display screen 151, as indicated by the dotted ellipse, the images in the traveling direction of the freight truck 11-1 (the front regions and the left-front region of the front-side image Fr1 and the left-side image Le1, and the front regions and the right-front region of the right-side image Ri1) are arranged to be substantially at the center. That is, since the images in the traveling direction, which are part of what is often viewed during general surveillance, are concentrated at substantially the center of the lower half of the display screen 151, the amount of eye movement can be further reduced. Therefore, security can be further enhanced.

[0138] For example, the display screen 151 including small screens for displaying images captured by the freight truck 11-1 can be displayed on the display unit 41-1, and the display screen 151 including small screens for displaying images captured by the freight truck 11-2 can be displayed on the display unit 41-2.

[0139] Therefore, while efficiently viewing the images captured by multiple freight trucks 11, it is possible to monitor whether there is any abnormality around or inside the freight trucks 11, and it is possible to control the desired actions of the freight trucks 11, etc. by operating the keyboard provided in the monitoring device 12 when necessary.

[0140] It should be noted that the configuration of the small screens can be interchanged between the first row and the second row of the display screen 151.

[0141] It should be noted that in the above description, a freight truck (vehicle) is described as an example of a moving body, but the present technology can be applied not only to vehicles but also to other moving objects. For example, the moving object can be a flying object such as a drone or a ship. In addition, the moving body can be an industrial machine or an industrial robot.

[0142] <3. Others>

[0143] <Effects of the present technology>

[0144] As described above, in the present technology, the display of the first display screen is controlled. The first display screen includes a plurality of small screens arranged in a matrix and is used to monitor a plurality of moving bodies. In addition, control is executed such that different moving bodies correspond to the small screens in each row of the first display screen, and the traveling direction images obtained by imaging the traveling directions of the corresponding moving bodies are respectively displayed on the small screens in the first column of the first display screen, the left side images obtained by imaging the left side with respect to the traveling directions of the corresponding moving bodies are respectively displayed on the small screens in the second column adjacent to the left side of the small screens in the first column of the first display screen, and the right side images obtained by imaging the right side with respect to the traveling directions of the corresponding moving bodies are respectively displayed on the small screens in the third column adjacent to the right side of the small screens in the first column of the first display screen.

[0145] Therefore, a plurality of moving bodies can be monitored efficiently.

[0146] <Example of computer configuration>

[0147] The above series of processing steps can be executed by hardware or by software. When the series of processing steps are executed by software, the program included in the software is installed from a program recording medium onto a computer, a general-purpose personal computer, etc. installed in dedicated hardware.

[0148] Figure 10 It is a block diagram showing a configuration example of the hardware of a computer that executes the above series of processing by a program.

[0149] The central processing unit (CPU) 301, read-only memory (ROM) 302, and random access memory (RAM) 303 are connected to each other via a bus 304.

[0150] In addition, an input / output interface 305 is connected to the bus 304. An input unit 306 including a keyboard, a mouse, etc. and an output unit 307 including a display, a speaker, etc. are connected to the input / output interface 305. In addition, a storage unit 308 including a hard disk, a non-volatile memory, etc., a communication unit 309 including a network interface, etc., and a drive 310 for driving a removable medium 311 are connected to the input / output interface 305.

[0151] In the computer configured as described above, for example, the program stored in the storage unit 308 is loaded into the RAM 303 by the CPU 301 via the input / output interface 305 and the bus 304, and the program is executed to perform the above series of processing steps.

[0152] For example, a program to be executed by the CPU 301 is set by being recorded on a removable medium 311, or is set via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting, and is installed on the storage unit 308.

[0153] Note that a program executed by a computer can be a program that executes processing in a time series in the order described in this specification, or can be a program that executes processing in parallel or at a necessary time such as a call time.

[0154] Note that in this specification, a system means an assembly of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are located in the same housing. Therefore, both a plurality of devices accommodated in separate housings and connected to each other via a network and a device in which a plurality of modules are accommodated in one housing are systems.

[0155] In addition, the effects described in this specification are merely examples and not limitations, and there may be other effects.

[0156] Embodiments of the present technology are not limited to the above embodiments, and various modifications can be made without departing from the scope of the present technology.

[0157] For example, the present technology can be configured as cloud computing in which one function is shared by a plurality of devices via a network and is processed in cooperation.

[0158] In addition, each step described in the above flowchart can be implemented by one device or by a plurality of devices in a shared manner.

[0159] In addition, in the case where a step includes a plurality of processing segments, the plurality of processing segments included in this step can be executed by one device, or can be executed by a plurality of devices in a shared manner.

[0160] <Combined example of configurations>

[0161] The present technology can also be configured as follows.

[0162] (1) An information processing device, comprising:

[0163] A display control unit that controls the display of a first display screen including a plurality of small screens arranged in a matrix and for monitoring a plurality of moving bodies, where

[0164] The display control unit is configured to perform control to:

[0165] Cause different moving bodies to correspond to the small screens in each row of the first display screen;

[0166] On the small screens in the first column of the first display screen, forward direction images obtained by imaging the forward directions of respective moving bodies are respectively displayed;

[0167] On the small screens in the second column of the first display screen, which is adjacent to the left side of the small screens in the first column, left side images obtained by imaging the left sides relative to the forward directions of respective moving bodies are respectively displayed; and

[0168] On the small screens in the third column of the first display screen, which is adjacent to the right side of the small screens in the first column, right side images obtained by imaging the right sides relative to the forward directions of respective moving bodies are respectively displayed.

[0169] (2) The information processing apparatus according to (1), wherein

[0170] When the forward direction of the moving body is forward, the forward direction image is a front side image obtained by imaging the front side of the moving body.

[0171] (3) The information processing apparatus according to (2), wherein

[0172] The display control unit controls to, when the forward direction of the moving body changes to backward, switch the forward direction image displayed on the small screen in the first column of the first display screen from the front side image to a rear side image obtained by imaging the rear side of the moving body and display it.

[0173] (4) The information processing apparatus according to (3), wherein

[0174] When the forward direction of the moving body changes to backward, the display control unit switches the small screens in the second column and the third column of the first display screen from the case where the forward direction of the moving body is forward.

[0175] (5) The information processing apparatus according to any one of (1) to (4), wherein

[0176] The moving body is a vehicle, and

[0177] The display control unit controls to, when the shift lever of the vehicle switches from park to drive, display a front foot image of the feet in the forward direction imaged on the small screen in the first column of the first display screen.

[0178] (6) The information processing apparatus according to any one of (1) to (5), wherein

[0179] The display control unit performs control to superimpose and display auxiliary lines indicating at least one of the traveling direction or the tilting traveling direction of the moving body on the left image and the right image.

[0180] (7) The information processing apparatus according to any one of (1) to (6), wherein

[0181] The display control unit arranges the small screens in the first column of the first display screen substantially at the center of the first display screen.

[0182] (8) The information processing apparatus according to any one of (1) to (7), wherein

[0183] The display control unit further controls the display of a second display screen for monitoring a plurality of moving bodies, the second display screen including a plurality of small screens arranged in a matrix, and

[0184] The display control unit is configured to perform control to:

[0185] Cause different moving bodies to respectively correspond to the small screens in each row of the second display screen;

[0186] On the small screens in the first column of the second display screen, respectively display moving body internal images obtained by imaging the interiors of the respective moving bodies;

[0187] On the small screens in the second column of the second display screen, respectively display reverse images obtained by imaging the reverse directions of the traveling directions of the respective moving bodies; and

[0188] On the small screens in the third column of the second display screen, respectively display control screens for remotely operating the respective moving bodies.

[0189] (9) The information processing apparatus according to any one of (1) to (8), wherein

[0190] The moving body is a vehicle.

[0191] (10) An information processing method, the information processing method causing an information processing apparatus including a display control unit to perform control to perform the following steps, the display control unit including a plurality of small screens arranged in a matrix and controlling the display of a first display screen for monitoring a plurality of moving bodies:

[0192] Cause different moving bodies to respectively correspond to the small screens in each row of the first display screen;

[0193] On the small screens in the first column of the first display screen, respectively display traveling direction images obtained by imaging the traveling directions of the respective moving bodies;

[0194] On the small screens in the second column adjacent to the left side of the small screens in the first column of the first display screen, left-side images obtained by imaging the left side with respect to the traveling direction of each moving body are respectively displayed; and

[0195] On the small screens in the third column adjacent to the right side of the small screens in the first column of the first display screen, right-side images obtained by imaging the right side with respect to the traveling direction of each moving body are respectively displayed.

[0196] List of reference signs

[0197] 1 Remote monitoring system

[0198] 11, 11-1 to 11-3 Trucks

[0199] 12 Monitoring device

[0200] 21 Vehicle external display unit

[0201] 22 Sensor

[0202] 31 Vehicle control unit

[0203] 32 Image processing unit

[0204] 33 Display control unit

[0205] 34 Communication unit 34

[0206] 41 Communication unit

[0207] 42 Remote operation unit

[0208] 43 Display control unit

[0209] 44 Display unit

[0210] 100 Display screen

[0211] 151 Display screen

Claims

1. An information processing device, comprising: a display control unit that controls the display of a first display screen including a plurality of small screens arranged in a matrix and for monitoring a plurality of moving bodies, wherein, the display control unit is configured to perform control to: associate different moving bodies with the small screens in each row of the first display screen respectively; on the small screens in the first column of the first display screen, respectively display traveling direction images obtained by imaging the traveling directions of the respective moving bodies; on the small screens in the second column adjacent to the left side of the small screens in the first column of the first display screen, respectively display left side images obtained by imaging the left sides relative to the traveling directions of the respective moving bodies; and on the small screens in the third column adjacent to the right side of the small screens in the first column of the first display screen, respectively display right side images obtained by imaging the right sides relative to the traveling directions of the respective moving bodies.

2. The information processing device according to claim 1, wherein, when the traveling direction of the moving body is forward, the traveling direction image is a front side image obtained by imaging the front side of the moving body.

3. The information processing device according to claim 2, wherein, the display control unit performs control to, when the traveling direction of the moving body changes to backward, switch the traveling direction image displayed on the small screens in the first column of the first display screen from the front side image to a rear side image obtained by imaging the rear side of the moving body and display it.

4. The information processing device according to claim 3, wherein, when the traveling direction of the moving body changes to backward, the display control unit switches the small screens in the second column and the small screens in the third column of the first display screen from the case where the traveling direction of the moving body is forward.

5. The information processing device according to claim 1, wherein, the moving body is a vehicle, and the display control unit performs control to, when the shift lever of the vehicle switches from parking to driving, display a front foot image of the feet in the traveling direction imaged on the small screens in the first column of the first display screen.

6. The information processing device according to claim 1, wherein, the display control unit performs control to superimpose and display auxiliary lines indicating at least one of the traveling direction or the inclined traveling direction of the moving body on the left side image and the right side image.

7. The information processing device according to claim 1, wherein, the display control unit arranges the small screens in the first column of the first display screen at substantially the center of the first display screen.

8. The information processing device according to claim 1, wherein, the display control unit also controls the display of a second display screen for monitoring a plurality of moving bodies, the second display screen including a plurality of small screens arranged in a matrix, and the display control unit is configured to perform control to: Associate different moving bodies with the small pictures in each row of the second display screen; On the small pictures in the first column of the second display screen, respectively display the in-moving-body images obtained by imaging the interiors of the respective moving bodies; On the small pictures in the second column of the second display screen, respectively display the reverse images obtained by imaging the reverse directions of the traveling directions of the respective moving bodies; and On the small pictures in the third column of the second display screen, respectively display the control screens for remotely operating the respective moving bodies.

9. The information processing apparatus according to claim 1, wherein the moving body is a vehicle.

10. An information processing method, the information processing method causing an information processing apparatus including a display control unit to execute control to perform the following steps, the display control unit including a plurality of small pictures arranged in a matrix and controlling the display of a first display screen for monitoring a plurality of moving bodies: Associate different moving bodies with the small pictures in each row of the first display screen; On the small pictures in the first column of the first display screen, respectively display the traveling direction images obtained by imaging the traveling directions of the respective moving bodies; On the small pictures in the second column of the first display screen adjacent to the left side of the small pictures in the first column, respectively display the left side images obtained by imaging the left sides with respect to the traveling directions of the respective moving bodies; and On the small pictures in the third column of the first display screen adjacent to the right side of the small pictures in the first column, respectively display the right side images obtained by imaging the right sides with respect to the traveling directions of the respective moving bodies.

Images