Remote support system

Abstract

To enable a remote support person to easily grasp auxiliary information from auxiliary displaying.SOLUTION: A remote support system includes a mobile body and a remote support terminal. The remote support terminal is operated by a remote supporter for remote support of the mobile body. The remote support terminal includes a display device for displaying a support image to be transmitted from the mobile body for the remote support. The display device displays the support image and also auxiliary displaying obtained by combining a first indicator with a second indicator. The first indicator is displayed with a continuous position change corresponding to a lapsed time from the start of the remote support. The second indicator indicates a communication time required for communication between the mobile body and the remote support terminal by an interval with respect to a position of the first indicator, so as to be displayed with a non-continuous position change with updating at timing when the remote support terminal receives the support image.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a remote support system for a moving body.

Background Art

[0002] Patent Document 1 discloses a remote control system for a moving body. The control device of the remote control system includes a monitor that displays an image from the moving body. The monitor displays the delay time of the image together with the image.

[0003] Also, Patent Document 2 discloses a video transmission system for remote control that displays the video delay time numerically or as a level. Patent Document 3 discloses a remote operation system that displays communication delay, for example, in a graph.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0005] In a remote support system for a moving body, it is useful for a remote supporter to display auxiliary information such as the delay time and frame rate of an image (support image) from the moving body as an "auxiliary display" together with the support image on a display device. On the other hand, if such an auxiliary display is complex, the work load of the remote supporter increases. This leads to a requirement for high skills in remote support of a moving body.

[0006] This disclosure is made in view of the above-mentioned issues and aims to provide a remote support system that enables remote supporters to easily grasp supplementary information from auxiliary displays. [Means for solving the problem]

[0007] The remote support system relating to this disclosure comprises a mobile unit and a remote support terminal. The remote support terminal is operated by a remote supporter for the remote support of the mobile unit. The remote support terminal includes a display device that displays support images transmitted from the mobile unit for remote support. The display device displays an auxiliary display combining a first indicator and a second indicator along with the support image. The first indicator is displayed with a continuous change in position corresponding to the elapsed time since the start of remote support. The second indicator indicates the communication time required for communication between the mobile unit and the remote support terminal as an interval relative to the position of the first indicator, and is displayed with a discontinuous change in position as it is updated when the remote support terminal receives the support image. [Effects of the Invention]

[0008] According to the supplementary information provided in this disclosure, remote support providers will be able to intuitively and easily grasp supplementary information for remote support from a single display. [Brief explanation of the drawing]

[0009] [Figure 1] This diagram schematically shows an example of the configuration of a remote support system according to an embodiment. [Figure 2] This is a diagram illustrating the auxiliary indicator AD_1 according to the first example of the embodiment. [Figure 3] This figure shows three auxiliary displays AD_1 that illustrate how the delay time Td changes each time a support image SI is received. [Figure 4] These figures show other examples of the auxiliary indicator AD_1 according to the embodiment. [Figure 5] This is a diagram illustrating the auxiliary indicator AD_2 according to a second example of the embodiment. [Figure 6] This is a diagram illustrating the auxiliary indicator AD_3 according to a third example of the embodiment. [Figure 7] This is a diagram illustrating the auxiliary indicator AD_4 according to the fourth example of the embodiment. [Modes for carrying out the invention]

[0010] Embodiments of this disclosure will be described with reference to the attached drawings.

[0011] 1. Configuration of the remote support system Figure 1 is a schematic diagram showing an example of the configuration of a remote support system 1 according to an embodiment. The remote support system 1 is a system for a remote operator to provide remote support to a mobile object (for example, remote operation, remote monitoring, remote instruction, or remote driving). The remote support system 1 includes an autonomous vehicle (or simply a vehicle) 10 which is the target of remote support, and a remote support terminal 30 operated by the remote support operator.

[0012] Vehicle 10 is an example of a “mobile body” as described herein. The mobile body may not be an autonomous vehicle, but a vehicle driven by a driver. As another example, the mobile body may be a robot such as a logistics robot or a work robot, or a flying object such as an airplane or a drone.

[0013] Vehicle 10 includes a camera 12, a communication device 14, a GNSS (Global Navigation Satellite System) receiver 16, and a control device 18. The camera 12 photographs the area around vehicle 10 and acquires an image showing the surrounding conditions. This image is viewed by a remote supporter using a remote support terminal 30, and for convenience of explanation, it is referred to as "support image SI". In the example of vehicle 10, the support image SI includes, for example, a forward image of vehicle 10. The communication device 14 communicates with the outside of vehicle 10 via a communication network. Specifically, the communication device 14 communicates with, for example, the remote support terminal 30. The GNSS receiver 16 is used to acquire the position and orientation of vehicle 10.

[0014] The control device 18 is a computer that controls the vehicle 10. The control device 18 includes one or more processors 20 (hereinafter simply referred to as the processor 20) and one or more storage devices 22 (hereinafter simply referred to as the storage device 22). The processor 20 executes various processes related to the control of the vehicle 10. The storage device 22 stores various information necessary for the processes by the processor 20. The control program 24 is a computer program for controlling the vehicle 10. The functions of the vehicle 10 are realized by the cooperation of the processor 20 that executes the control program 24 and the storage device 22. The control program 24 is stored in the storage device 22. Alternatively, the control program 24 may be recorded on a computer-readable recording medium.

[0015] The remote support terminal 30 includes a communication device 32, a display device 34, and a control device 36. The communication device 32 communicates with the vehicle 10 via a communication network. The display device 34 presents various information to the remote supporter by displaying the various information. The various information includes an image for the remote support of the vehicle 10, that is, the above-described support image SI. In FIG. 1, a front image of the vehicle 10 is shown as an example of the support image SI displayed on the display device 34.

[0016] The control device 36 controls the remote support terminal 30. The control device 36 includes one or more processors 38 (hereinafter simply referred to as the processor 38) and one or more storage devices 40 (hereinafter simply referred to as the storage device 40). The processor 38 executes various processes related to remote support including display control of the image on the display device 34. The storage device 40 stores various information necessary for the processes by the processor 38. The control program 42 is a computer program for controlling the remote support terminal 30. The functions of the remote support terminal 30 are realized by the cooperation of the processor 38 that executes the control program 42 and the storage device 40. The control program 42 is stored in the storage device 40. Alternatively, the control program 42 may be recorded on a computer-readable recording medium.

[0017] In the remote support system 1, the vehicle 10 (communication device 14) transmits the support image SI to the remote support terminal 30. The remote support terminal 30 (communication device 32) receives the support image SI from the vehicle 10. The remote support terminal 30 presents the received support image SI to the remote supporter. The presentation of the support image SI includes displaying the support image SI on the display device 34. The remote supporter views the presented support image SI, grasps the situation around the vehicle 10, and remotely supports the operation of the vehicle 10. More specifically, the remote support by the remote supporter is, for example, remote operation, remote monitoring, remote instruction, or remote driving. Information indicating an instruction or an operation amount by the remote supporter is transmitted from the remote support terminal 30 to the vehicle 10. The vehicle 10 operates according to the instruction or operation by the remote supporter. Note that the transmission of the support image SI from the vehicle 10 (mobile body) for remote support may be performed using, for example, streaming video distribution.

[0018] 2. Auxiliary Display Communication between a mobile body such as the vehicle 10 and the remote support terminal may become unstable due to the influence of noise or traffic. When the communication becomes unstable when displaying the support image SI acquired by the mobile body on the display device, the transmission of the support image SI from the mobile body may be delayed, or the frame rate (frame / sec) of the support image SI may become unstable. It is difficult for the remote supporter to perceive such a delay or change in the frame rate. In this regard, it is useful for the remote supporter to display auxiliary information such as the delay time Td of the support image SI and the frame rate on the display device together with the support image SI. On the other hand, if the auxiliary display indicating the auxiliary information is complex, the work load of the remote supporter increases. Specifically, it is considered not easy for the remote supporter to interpret or respond to the display of a plurality of auxiliary information while performing remote support.

[0019] Therefore, in the present embodiment, in order to provide the remote supporter with an "auxiliary display AD" that allows the remote supporter to easily grasp the auxiliary information, the display device 34 displays an auxiliary display AD that combines a first indicator and a second indicator together with the support image SI.

[0020] The process for displaying the auxiliary display AD on the display device 34 can be carried out as follows: For example, the processor 38 of the remote support terminal 30 generates the auxiliary display AD, and the generated auxiliary display AD is combined with the support image SI and displayed on the display device 34. Alternatively, this process may be performed, for example, through cooperation between the processor 38 and the processor 20 of the vehicle 10.

[0021] 2-1. First example (clock type) Figures 2(A) to 2(D) are diagrams illustrating the auxiliary indicator AD_1 according to the first example of the embodiment. The auxiliary indicator AD_1 includes the first indicator I1_1 and the second indicator I2_1 together with the circumference C. The first indicator I1_1 and the second indicator I2_1 are second hands that rotate around the center of the circumference C. Note that the arrows in Figures 2(A) to 2(D) show a straight line L, elapsed time Te, and delay time Td (angle interval Ga), but these are for illustrative purposes only and are not included in the auxiliary indicator AD_1.

[0022] The auxiliary display AD_1 represents a clock in which the first indicator I1_1 completes one rotation in a predetermined unit time T0 (e.g., 3 seconds). The straight line L indicates the rotational position of the first indicator I1_1 at the start time of remote assistance. The first indicator I1_1 is displayed with a continuous change in position corresponding to the elapsed time Te from the start of remote assistance.

[0023] More specifically, as shown in Figure 2(A), the first indicator I1_1 is a second hand that rotates within the circumference C as the elapsed time Te progresses and is displayed continuously. That is, the position of the first indicator I1_1 changes continuously with the passage of time. As long as remote assistance is ongoing, the first indicator I1_1 continues to rotate. The rotation direction of the first indicator I1_1 is clockwise, but it may also be counterclockwise. Note that the second indicator I2_1 is not shown in Figure 2(A).

[0024] As shown in Figure 2(B), the second indicator I2_1 shows the delay time Td relative to the first indicator I1_1 by an interval G. The delay time Td corresponds to the communication time required to transmit the support image SI from the vehicle 10 to the remote support terminal 30. More specifically, the second indicator I2_1 is displayed within the circumference C so as to show the delay time Td by an angular interval Ga (relative angle) with the first indicator I1_1, which corresponds to an example of interval G. In other words, the second indicator I2_1 is a second hand that shows a time that is delayed by Td relative to the first indicator I1_1.

[0025] The second indicator I2_1 is displayed with discontinuous positional changes as it is updated at the timing TM when the remote support terminal 30 receives the support image SI. Specifically, Figure 2(C) shows an example of multiple second indicators I2_1a to I2_1e whose positions are updated each time the reception timing TM arrives. In this example, the positions of the second indicators I2_1 are updated in ascending order of the alphabetical subscripts attached to them. Thus, unlike the first indicator I1_1, which changes continuously over time, the second indicator I2_1 is displayed with discontinuous positional changes. Note that the first indicator I1_1 is not shown in Figure 2(C).

[0026] In addition, the second indicator I2_1 may be updated to display only the most recent one with each arrival of a reception timing TM. Alternatively, as shown in Figure 2(C), the second indicator I2_1 may be updated to display one or more previously updated second indicators I2_1 (e.g., I2_1a to I2_1d) along with the most recent one (e.g., I2_1e). The display of multiple second indicators I2_1 may be shown with varying intensity, with newer ones appearing more intensely. In this example, the display of a second indicator I2_1 will fade with each arrival of a reception timing TM and eventually disappear.

[0027] Figure 2(D) shows the second indicator I2_1, which is displayed when a certain reception timing TM arrives, together with the first indicator I1_1 at the same reception timing TM.

[0028] The delay time Td is determined, for example, as follows: The control device 18 of vehicle 10 measures time A when vehicle 10 transmits the support image SI. Meanwhile, the control device 36 of remote support terminal 30 measures time B when the support image SI transmitted from vehicle 10 is received by remote support terminal 30. In the example where processor 38 generates auxiliary display AD, processor 38 determines (calculates) the delay time Td from the difference between time A and time B obtained from vehicle 10. In addition, in the remote support system 1, the computers (control devices) that measure time A and B are different. For this reason, it is desirable that control device 18 and control device 36 are time-synchronized. If time synchronization is not performed or cannot be performed, the time difference necessary for time synchronization may be obtained in advance. The delay time Td may then be modified according to that time difference.

[0029] <Effects> As shown in Figures 2(B) and 2(D), the second indicator I2_1 is displayed at a position corresponding to a time point a delay time Td earlier than the first indicator I1_1. Therefore, a remote support worker viewing the auxiliary display AD_1 can easily determine the delay time Td from the angular interval Ga between the first indicator I1_1 and the second indicator I2_1. In addition, for example, Figure 3 shows three auxiliary displays AD_1 that illustrate how the delay time Td changes each time a support image SI is received. A remote support worker viewing the three sequentially changing auxiliary displays AD_1 shown in Figure 3 can constantly grasp the delay time Td from the change in angular interval Ga while performing remote support.

[0030] Furthermore, according to the auxiliary display AD_1, by displaying discontinuous drawings of multiple second indicators I2_1 whose positions are updated each time a reception timing TM arrives, as exemplified in Figure 2(C), on the display device 34, the remote supporter can easily grasp the frame rate of the support image SI. More specifically, for example, a remote supporter who sees the display of multiple second indicators I2_1 shown in Figure 2(C) can easily grasp that the frame rate is unstable due to the variation in the angular interval Ga. Also, for example, a remote supporter who sees multiple second indicators I2_1 displayed with nearly uniform angular intervals Ga can easily grasp that the frame rate is stable. In addition, according to the auxiliary display AD_1, the remote supporter can easily distinguish between images where sticking is occurring (moving images) and images that are unchanged or have little change (for example, images in a windless state, images without other vehicles, or images when vehicle 10 is stopped).

[0031] As described above, with the auxiliary display AD_1, remote supporters can intuitively and easily grasp auxiliary information such as delay time Td and frame rate from a single display using a combination of the first and second indicators I1_1 and I2_2.

[0032] <Variation> An example was described above where the unit time T0 of the auxiliary display AD_1 is 3 seconds. However, the unit time T0 can be arbitrarily set according to the maximum expected communication delay under the operating environment of the remote support system 1, and may be, for example, 10 seconds or 1 minute.

[0033] Furthermore, the unit time T0 is not limited to a predetermined fixed value, but may be changed during the execution of remote support. Specifically, the unit time T0 may be changed, for example, according to the location information and past communication speed history of the vehicle 10. For example, if the vehicle 10 is driving in an urban area with good communication conditions, the unit time T0 may be set to be short. On the other hand, if the vehicle 10 is driving in a suburban area with poor communication conditions, the unit time T0 may be set to be long. This allows the auxiliary display AD_1 to be displayed appropriately according to the usage environment. Alternatively, the unit time T0 may be set, for example, according to the lowest value of the vehicle 10's communication speed in a predetermined past period (e.g., 10 minutes).

[0034] Figures 4(A) and 4(B) show other examples of the auxiliary display AD_1 according to the embodiment. If the delay time Td is longer than a predetermined threshold, the auxiliary display AD_1 may be colored with a warning color to warn the remote supporter. Specifically, this coloring may be done by displaying the circumference C in any warning color such as red, as shown in Figure 4(A). Alternatively, the coloring may be done by displaying the area inside the circumference C in any warning color such as red, as shown in Figure 4(A). In addition, when this coloring is applied, the circumference C may be displayed thicker, as shown in Figure 4(A), compared to when the delay time Td is below the threshold.

[0035] Furthermore, in order to make the angular interval Ga in the auxiliary display AD_1 easier to understand, the fan-shaped area representing the angular interval Ga in the auxiliary display AD_1 may be colored with any conspicuous color, such as red, as shown in Figure 4(B). This coloring may only be performed when the angular interval Ga is above a predetermined threshold.

[0036] Furthermore, the above coloring does not necessarily have to be done in a single color. That is, the coloring may be done, for example, by changing the color of the entire sector-shaped area from blue to red depending on the size of the angular interval Ga. Alternatively, the coloring may be done using a gradient display, for example, by gradually changing the color of the sector-shaped area along the circumference from blue to red. According to these examples, an auxiliary display AD_1 can be realized that more clearly communicates the change in angular interval Ga (i.e., delay time Td) from a no-problem state to a state requiring a warning to the remote supporter.

[0037] On the other hand, to avoid the auxiliary display AD_1 becoming a nuisance to the remote supporter, the second indicator I2_1 may be hidden when the angular interval Ga is below a predetermined threshold (i.e., when the delay time Td is at an acceptable value). Even when only the first indicator I1_1 is displayed in this way, the remote supporter can determine whether or not the image is stuck based on the operation of the first indicator I1_1.

[0038] 2-2. Second example (bar type) Figures 5(A) and 5(B) are diagrams illustrating the auxiliary display AD_2 according to the second example of the embodiment, respectively. Instead of the clock-type auxiliary display AD_1, the "auxiliary display AD" may be a bar-type auxiliary display AD_2. The differences between the auxiliary display AD_1 and the auxiliary display AD_2 will be explained below.

[0039] First, the example shown in Figure 5(A) will be explained. The auxiliary display AD_2 includes the first indicator I1_2 and the second indicator I2_2, along with the outer perimeter P1 of a horizontally elongated rectangle (box). The first indicator I1_2 and the second indicator I2_2 are bars that are displayed to divide the area within the outer perimeter P1 in the vertical direction D1.

[0040] The first indicator I1_2 is displayed continuously, moving linearly along the left-right direction D2 as the elapsed time Te progresses. With respect to the movement of the first indicator I1_2, the length of the left-right direction D2 of the rectangle with the outer perimeter P1 corresponds to a unit time T0 (for example, 3 seconds). As an example, the first indicator I1_2 moves from left to right on the page. After the first indicator I1_2 reaches the right end of the outer perimeter P1, the first indicator I1_2 jumps to the left end of the outer perimeter P1 and repeatedly moves to the right.

[0041] The second indicator I2_2 is displayed to show a delay time Td by distance Gd. This distance Gd is the distance between the first indicator I1_2 and the second indicator I2_2 in the left-right direction D2, and corresponds to an example of the interval G described above. More specifically, in order to show a time that is Td earlier than the first indicator I1_2, the second indicator I2_2 is displayed to the left of the first indicator I1_2 by a distance Gd. Additionally, similar to the example of the auxiliary display AD_1, in order to make the interval G easier to grasp, the area representing the distance Gd in the auxiliary display AD_2 may be colored with a conspicuous color such as red, as shown in Figure 5(A).

[0042] Contrary to the example shown in Figure 5(A), the first indicator I1_2 may be displayed to move from right to left. Alternatively, the first indicator I1_2 may be displayed to move from left to right, for example, then reflect off the right edge and move to the left, and then reflect off the left edge and move to the right, and so on.

[0043] Furthermore, as shown in Figure 5(B), the auxiliary indicator AD_2 may include the first indicator I1_2 and the second indicator I2_2, along with the outer perimeter P2 of the vertical rectangle (box). The way in which the first indicator I1_2 and the second indicator I2_2 are displayed in this example is basically the same as in the example shown in Figure 5(A). In addition, the first indicator I1_2 may be displayed so that it progresses from the bottom to the top of the page in Figure 5(B), or it may be displayed so that it progresses from the top to the bottom.

[0044] The aforementioned auxiliary display AD_2 also allows remote support providers to intuitively and easily grasp auxiliary information such as latency Td and frame rate from a single display.

[0045] 2-3. Third example (concentric circles) Figure 6 is a diagram illustrating an auxiliary display AD_3 according to a third example of the embodiment. Instead of the clock-shaped auxiliary display AD_1, the "auxiliary display AD" may be a concentric circle-shaped auxiliary display AD_3. The differences between the auxiliary display AD_1 and the auxiliary display AD_3 will be explained below.

[0046] The auxiliary display AD_3 includes a circumference C along with a first indicator I1_3 and a second indicator I2_3. The first indicator I1_3 is a circle that is continuously displayed within the circumference C, its size changing concentrically as the elapsed time Te progresses. In the example of the auxiliary display AD_3, the radius of the circle with circumference C corresponds to the unit time T0 (e.g., 3 seconds). The first indicator I1_3 expands from the center P0 of the circle with circumference C. After the first indicator I1_3 reaches the position of circumference C, it may jump to P0 and repeatedly expand. Alternatively, the first indicator I1_3 may be displayed so that it reflects at the position of circumference C, moves to the center P0, and then reflects again at the center P0 and expands repeatedly.

[0047] The second indicator I2_3 is concentric with the first indicator I1_3 and is a circle displayed to indicate a delay time Td by a radial distance Gr with respect to the first indicator I1_3, which corresponds to an example of the interval G described above. In other words, to indicate a time that is Td earlier than the first indicator I1_3, the second indicator I2_3 is displayed as a circle that is radially smaller than the first indicator I1_3 by a radial distance Gr. Additionally, similar to the example of the auxiliary display AD_1, in order to make the radial distance Gr easier to grasp, the area representing the radial distance Gr in the auxiliary display AD_3 may be colored with a conspicuous color such as red, as shown in Figure 6. Note that the arrow and center P0 indicating the radial distance Gr in Figure 6 are for illustrative purposes only and are not included in the auxiliary display AD_3.

[0048] The aforementioned auxiliary display AD_3 also allows remote support providers to intuitively and easily grasp auxiliary information such as latency Td and frame rate from a single display.

[0049] 2-4. Fourth example (ring-shaped) Figure 7 is a diagram illustrating the auxiliary display AD_4 according to the fourth example of the embodiment. Instead of the clock-shaped auxiliary display AD_1, the "auxiliary display AD" may be a ring-shaped auxiliary display AD_4. The differences between the auxiliary display AD_1 and the auxiliary display AD_4 will be explained below.

[0050] Auxiliary display AD_4 includes a first indicator I1_4 and a second indicator I2_4 along with a circular area AR. The first indicator I1_4 is a bar that is continuously displayed in area AR, rotating as the elapsed time Te progresses. Similar to auxiliary display AD_1, the second indicator I2_4 is a bar displayed in area AR to indicate the delay time Td by the angular interval Ga (relative angle) with the first indicator I1_4, which corresponds to an example of interval G. Additionally, similar to the example of auxiliary display AD_1, in order to make the angular interval Ga easier to grasp, the area representing the angular interval Ga in auxiliary display AD_4 may be colored with a conspicuous color such as red, as shown in Figure 7. Note that in Figure 7, the arrow indicating the angular interval Ga is for illustrative purposes only and is not included in auxiliary display AD_4.

[0051] The aforementioned auxiliary display AD_4 also allows remote supporters to intuitively and easily grasp auxiliary information such as delay time Td and frame rate from a single display. Additionally, in the example of the bar-type auxiliary display AD_2 (see Figure 5(A)), there is a problem that immediately after the first indicator I1_2 reaches the right end of the outer perimeter P1 and jumps to the left end of the outer perimeter P1, the first indicator I1_2 is displayed to the left of the second indicator I2_2. With the auxiliary display AD_4, the first and second indicators I1_4 and I2_4 are displayed within the annular area AR, thus resolving this problem.

[0052] 3. Other examples of communication time In the example of the auxiliary displays AD_1 to AD_4 described above, the "communication time required for communication between the mobile device and the remote support terminal" in this disclosure was the delay time Td, which corresponds to the communication time required for the transmission of the support image SI from the vehicle 10 (mobile device). However, the "communication time" in this disclosure is not limited to such "image display delay time".

[0053] Specifically, the "communication time" relating to this disclosure is not necessarily limited to "one-way communication time (delay time)," but may also be "the communication time required for sending and receiving information for one round trip between the mobile device and the remote support terminal." One-way delay time is sufficient to determine how many seconds ago the image displayed was. On the other hand, to determine not only the time it takes for the remote supporter to see the support image SI transmitted from the mobile device, but also how many seconds later the input from the remote supporter who saw the support image SI reaches the mobile device, the aforementioned "one-round-trip communication time" may be better.

[0054] Furthermore, the measurement of "one-way communication time" or "one-way communication time" does not necessarily have to be performed using the communication time required to transmit the support image SI itself. That is, the measurement may be performed using the transmission of small packets, such as a few kilobytes. In addition, the source in the measurement of "one-way communication time" is not limited to the mobile body, but may also be a remote support terminal. That is, the communication time required to transmit information from the remote support terminal to the mobile body, and from the mobile body to the remote support terminal, may be measured. Moreover, by using small packets, it becomes possible to continuously measure "communication time," which is difficult to achieve with the use of support image SI. And the ability to continuously measure "communication time" can lead to easier setting of an appropriate unit time T0. [Explanation of Symbols]

[0055] 1 Remote support system, 10 Autonomous driving vehicles (mobile devices), 12 Cameras, 14, 32 Communication devices, 18, 36 Control devices, 20, 38 Processors, 30 Remote support terminals

Claims

1. A remote support system comprising a mobile unit and a remote support terminal operated by a remote supporter for the remote support of the mobile unit, The remote support terminal includes a display device that displays support images transmitted from the mobile device for the purpose of remote support, The display device displays an auxiliary display combining the first indicator and the second indicator along with the support image. The first indicator is displayed with a continuous change in position corresponding to the elapsed time since the start of the remote assistance, The second indicator shows the communication time required for communication between the mobile body and the remote support terminal as an interval relative to the position of the first indicator, and is displayed with discontinuous positional changes as it is updated when the remote support terminal receives the support image. A remote support system characterized by the following features.

2. The first indicator is a second hand that rotates and is displayed continuously as the elapsed time progresses, The second indicator is a second hand that displays the communication time by an angular interval with the first indicator corresponding to the interval. The remote support system according to feature 1.

3. The first indicator is a bar that is continuously displayed while moving linearly in a predetermined direction as the elapsed time progresses. The aforementioned interval is the distance between the first indicator and the second indicator in the predetermined direction. The second indicator is a bar that is displayed to indicate the communication time based on the distance. The remote support system according to feature 1.

4. The first indicator is a circle that is continuously displayed while its size changes concentrically as the elapsed time progresses. The second indicator is a circle that is concentric with the first indicator and is displayed such that the communication time is indicated by the radial distance from the first indicator corresponding to the interval. The remote support system according to feature 1.

5. The first indicator is a bar that is continuously displayed while rotating within a circular area as the elapsed time progresses, The second indicator is a bar displayed within the annular area so as to indicate the communication time by an angular interval with the first indicator corresponding to the interval. The remote support system according to feature 1.

Images