Management method, mobile body, and information processing device

Abstract

A management method according to the present disclosure includes determining a communication volume between a management device and a mobile body in accordance with a task type of remote management of the mobile body. The management device can be connected to the mobile body. The management method includes transmitting a communication volume indication to the mobile body. The communication volume indication includes a request to perform communication using the determined communication volume.

Description

Management method, mobile object, and information processing device

[0001] The present disclosure relates to a management method, a mobile object, and an information processing device.

[0002] A management device connected to a mobile object via a communication line can remotely manage the mobile object by communicating with the mobile object. In remote management, it is desirable that the amount of communication between the management device and the mobile object be appropriate.

[0003] International Publication No. 2020 / 090285 International Publication No. 2019 / 208266

[0004] A mobile object may be able to communicate with the outside world via a communication line. When a mobile object can communicate with the outside world via a communication line, the convenience of the mobile object is improved. For example, a management system can be constructed to collect and manage sensor information about the surrounding environment of the mobile object via a communication line to a management device, thereby enabling the management system to remotely manage the status of the mobile object.

[0005] On the other hand, if the amount of communication between the mobile device and the management device via a communication line for remote management is excessive, communication delays may occur, making it difficult to perform efficient remote management.

[0006] The present disclosure provides a management method, a mobile object, and an information processing device that can optimize the amount of communication between a management device and a mobile object.

[0007] A management method according to the present disclosure includes determining a communication volume between a management device and a mobile device according to a task type of remote management of the mobile device. The management device is connectable to the mobile device. The management method includes transmitting a communication volume instruction to the mobile device. The communication volume instruction includes a request to perform communication at the determined communication volume.

[0008] 1 is a diagram showing a schematic configuration of a management system according to a first embodiment. FIG. 2 is a diagram showing determination of image resolution according to the number of monitored devices according to the first embodiment. FIG. 3 is a diagram showing determination of image resolution according to the screen layout according to the first embodiment. A sequence diagram showing a management method according to the first embodiment. A sequence diagram showing a management method according to a modified example of the first embodiment. FIG. 4 is a diagram showing a schematic configuration of a management system according to a second embodiment. FIG. 5 is a diagram showing the functional configuration of a mobile object according to the second embodiment. FIG. 6 is a diagram showing the hardware configuration of a mobile object according to the second embodiment. FIG. 7 is a diagram showing the functional configuration of a server according to the second embodiment. FIG. 8 is a diagram showing the hardware configuration of a server according to the second embodiment. FIG. 9 is a diagram showing the functional configuration of a management terminal according to the second embodiment. FIG. 10 is a diagram showing the data structure of a correspondence table according to the second embodiment. FIG. 11 is a diagram showing the data structure of a correspondence table according to the second embodiment. FIG. 12 is a diagram showing the hardware configuration of a management terminal according to the second embodiment. A sequence diagram showing a management method according to the second embodiment. A flowchart showing the process of determining communication volume according to the second embodiment. A sequence diagram showing a management method according to a first modified example of the second embodiment. A sequence diagram showing a management method according to a second modified example of the second embodiment. A diagram showing the operation of a monitoring screen according to a second modified example of the second embodiment. A sequence diagram showing a management method according to a third modified example of the second embodiment.

[0009] Hereinafter, an embodiment of a management method according to the present disclosure will be described with reference to the drawings.

[0010] (First embodiment) The management method according to the first embodiment is used for remote management of mobile objects in a management system in which the mobile objects and a management device are connected via a communication line, and is devised to optimize the amount of communication between the management device and the mobile objects.

[0011] The management method according to the first embodiment may be executed by a management system 1 as shown in Fig. 1. Fig. 1 is a diagram showing a schematic configuration of the management system 1.

[0012] The management system 1 may be configured to be capable of remotely managing a plurality of mobile objects. The management system 1 has a plurality of mobile objects 2_1 to 2_n, a communication line 6, and a management device 3. n is an arbitrary integer equal to or greater than 2. The plurality of mobile objects 2_1 to 2_n are communicatively connected to the management device 3 via the communication line 6.

[0013] Each moving body 2 may be any vehicle having a communication function. The moving body 2 may be capable of being boarded by a driver. The moving body 2 may be capable of autonomous travel with a driver on board, or may be capable of autonomous travel without a driver. The moving body 2 may be capable of travel under remote control with a driver on board, or may be capable of travel under remote control without a driver. The moving body 2 is, for example, an automobile, a motorcycle, a motor tricycle, a bicycle, a kick scooter, or a mobility scooter.

[0014] The communication line 6 includes at least a wireless communication line on the mobile object 2 side, and may further include a wired communication line between the wireless communication line and the management device 3. The wireless communication line includes a communication line using a radio access technology (RAT: Radio Access Technology) such as LTE (Long Term Evolution), NR (New Radio), Wi-Fi, Bluetooth (registered trademark), etc. The wired communication line includes the Internet, a telephone switching network, etc.

[0015] In the management system 1, the management device 3 may be managed by the manufacturer of the mobile object 2. The management device 3 is capable of remotely managing the status of the mobile object 2. The management device 3 monitors the status of the mobile object 2 and controls its operation.

[0016] Each moving object 2 has a sensor 21. The sensor 21 is capable of sensing the environment surrounding the moving object 2 and acquiring the sensing results as sensor information. The moving object 2 holds moving object information related to its attributes (e.g., ID, etc.). The sensor 21 may be, for example, an imaging sensor and may be capable of acquiring an image of the surroundings of the moving object 2 as image information. The sensor 21 may be, for example, a battery remaining capacity sensor and may be capable of acquiring the remaining battery capacity of the moving object 2 as moving object status information. The sensor 21 may be, for example, a temperature sensor and may be capable of acquiring the temperature of the moving object 2 as moving object status information. The sensor 21 may be, for example, a speed sensor and may be capable of acquiring the speed of the moving object 2 as moving object status information. The sensor 21 may be, for example, an acceleration sensor and may be capable of acquiring the acceleration of the moving object 2 as moving object status information. The sensor 21 may be, for example, a distance measurement sensor and may be capable of acquiring the distance to objects surrounding the moving object 2 as environmental sensor information. The sensor 21 may be, for example, a position sensor that can receive a GPS (Global Positioning System) signal from a GPS satellite and acquire the position of the mobile object 2 based on the GPS signal as position information. Upon acquiring the sensor information, the mobile object 2 generates transmission information including the sensor information and mobile object information and transmits the transmission information to the management device 3 via the communication line 6. The sensor information includes image information, mobile object status information, environmental sensor information, and position information.

[0017] The management device 3 has a display 30, and is capable of executing various tasks for remote management of the mobile object 2 via a monitoring screen 31 on the display 30. The monitoring screen 31 is a display area on the display 30. Tasks that can be executed by the management device 3 include tasks related to monitoring the status of the mobile object 2 and tasks related to operational control of the mobile object 2. Task types that can be executed by the management device 3 may include at least one of "monitoring with images," "monitoring without images," "gazing," and "control." Of these, "monitoring with images," "monitoring without images," and "gazing" are tasks related to monitoring the status of the mobile object 2, and "control" is a task related to operational control of the mobile object 2.

[0018] The state of the moving body 2 to be monitored includes the position of the moving body 2, the attitude of the moving body 2, the stress that the moving body 2 receives from the road surface, the running state of the moving body 2, the running speed of the moving body 2, the running direction of the moving body 2, the presence or absence of objects around the moving body 2, the distance to objects around the moving body 2, the direction of objects around the moving body 2, the possibility of collision of the moving body 2, the communication status of the moving body 2, and weather information near the position of the moving body 2.

[0019] "Monitoring with images" includes monitoring the state of the moving object 2 using images acquired by a sensor 21 (for example, an imaging sensor) of the moving object 2.

[0020] "Monitoring without images" includes monitoring the state of the moving object 2 using non-image information acquired by a sensor 21 (e.g., a distance measurement sensor) of the moving object 2. Alternatively, "monitoring without images" includes monitoring the state of the moving object 2 in an emergency using abstracted information about the state of the moving object 2 and the situation around the moving object 2.

[0021] "Gazing" includes gazing at one moving body 2 among the multiple moving bodies 2_1 to 2_n and monitoring the state of the moving body 2 using an image acquired by a sensor 21 (e.g., an imaging sensor) of the moving body 2. Alternatively, when one moving body 2 has multiple sensors 21, "gazing" includes gazing at one sensor 21 among the multiple sensors 21 and monitoring the state of the moving body 2 using an image acquired by that sensor 21 (e.g., an imaging sensor).

[0022] The operations of the moving body 2 to be controlled include starting up the moving body 2, shutting down the moving body 2, stopping the moving body 2, parking the moving body 2, starting to move the moving body 2, turning the moving body 2, decelerating the moving body 2, accelerating the moving body 2, moving backwards the moving body 2, outputting a warning display from the moving body 2, outputting a warning audio from the moving body 2, etc.

[0023] "Steering" includes controlling the movement of the moving body 2 using images acquired by a sensor 21 (e.g., an imaging sensor) of the moving body 2.

[0024] For example, the management device 3 may determine the communication volume between the management device 3 and the mobile body 2 according to the task type of remote management of the mobile body 2. The communication volume includes the communication volume of information transmitted from the mobile body 2 to the management device 3 and the communication volume of information transmitted from the management device 3 to the mobile body 2.

[0025] The management device 3 may determine the resolution of image data to be transmitted from the mobile object 2 to the management device 3 depending on the type of task for managing the mobile object 2 .

[0026] This makes it possible to suppress the amount of information transmitted from the mobile unit 2 to the management device 3 via the communication line 6 to an appropriate amount according to the type of task for managing the mobile unit 2, thereby reducing the traffic on the communication line 6 between the management device 3 and the mobile unit 2. In other words, it is possible to optimize the amount of communication between the management device 3 and the mobile unit 2, thereby suppressing communication delays between the management device 3 and the mobile unit 2.

[0027] The management device 3 may predetermine the display size of the image on the monitoring screen 31 for each task type of management of the mobile object 2. The management device 3 may predetermine the display sizes of the image to be displayed on the monitoring screen 31 when performing "monitoring with image", "monitoring without image", "gazing", and "operation" as W1×H1, W2×H2, W3×H3, and W4×H4, respectively. W1, W2, W3, and W4 respectively indicate the number of horizontal pixels on the screen. H1, H2, H3, and H4 respectively indicate the number of vertical pixels on the screen. The size relationships between these display sizes may satisfy the following formulas 1 and 2. W2=0<W1=W4<W3...Formula 1 H2=0

[0028] ​The data size of image data transmitted from the mobile object 2 to the management device 3 may be determined according to the display size of the image to be displayed on the monitoring screen 31. For example, if the resolutions of the image data transmitted from the mobile object 2 to the management device 3 are W1×H1, W2×H2, W3×H3, and W4×H4, respectively, the display sizes of the image to be displayed on the monitoring screen 31 can also be W1×H1, W2×H2, W3×H3, and W4×H4, respectively. Alternatively, if the image data transmitted from the mobile object 2 to the management device 3 are images cropped from original images acquired by the sensor 21 with sizes of W1×H1, W2×H2, W3×H3, and W4×H4, respectively, the display sizes of the image to be displayed on the monitoring screen 31 can also be W1×H1, W2×H2, W3×H3, and W4×H4, respectively.

[0029] When the task type for managing the mobile object 2 is "monitoring with images," the management device 3 determines the display size of the image on the monitoring screen 31 to be W1×H1. The management device 3 determines the resolution of the image data to be transmitted from the mobile object 2 to the management device 3 to be W1×H1 in accordance with the display size W1×H1. The management device 3 transmits a communication volume instruction to the mobile object 2, including a request to set the image data resolution to W1×H1. The management device 3 waits without monitoring the mobile object 2 until it receives appropriate transmission information in accordance with the communication volume instruction. When the sensor 21 is an imaging sensor, the mobile object 2 captures an image of the surrounding environment with the sensor 21 at a resolution of W1×H1 in accordance with the communication volume instruction, and transmits transmission information including the captured image to the management device 3 via the communication line 6. Alternatively, the mobile object 2 captures an image of the surrounding environment with the sensor 21 in accordance with the communication volume instruction, cuts out a partial image having a size of W1×H1 from the acquired image, and transmits transmission information including the partial image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information, displays an image with a display size of W1×H1 according to the transmission information on the monitoring screen 31, and can monitor the mobile object 2. That is, since the remote management task type is "monitoring with image," the communication volume of the transmission information can be suppressed to a volume according to the resolution W1×H1 or the size W1×H1, and the mobile object 2 can be appropriately monitored.

[0030] When the task type for managing the mobile object 2 is "gazing," the management device 3 determines the display size of the image on the monitoring screen 31 to be W3×H3. The management device 3 determines the resolution of image data to be transmitted from the mobile object 2 to the management device 3 to be W3×H3 in accordance with the display size W3×H3. The management device 3 transmits a communication volume instruction to the mobile object 2, including a request to set the resolution of the image data to W3×H3. When the sensor 21 is an imaging sensor, the mobile object 2 captures an image of the surrounding environment with the sensor 21 at a resolution of W3×H3 in accordance with the communication volume instruction, and transmits transmission information including the captured image to the management device 3 via the communication line 6. Alternatively, the mobile object 2 captures an image of the surrounding environment with the sensor 21 in accordance with the communication volume instruction, cuts out a partial image having a size of W3×H3 from the acquired image, and transmits transmission information including the partial image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information, displays an image with a display size of W3×H3 according to the transmission information on the monitoring screen 31, and can monitor the mobile object 2. That is, since the remote management task type is "watching," the communication volume of the transmission information can be suppressed to a volume according to the resolution W3×H3 or the size W3×H3, and the mobile object 2 can be appropriately monitored.

[0031] When the task type for managing the moving object 2 is "control," the management device 3 determines the display size of the image on the monitoring screen 31 to be W4×H4. The management device 3 determines the resolution of the image data to be transmitted from the moving object 2 to the management device 3 to be W4×H4 in accordance with the display size W4×H4. The management device 3 transmits a communication volume instruction to the moving object 2, including a request to set the resolution of the image data to W4×H4. When the sensor 21 is an imaging sensor, the moving object 2 captures an image of the surrounding environment with the sensor 21 at a resolution of W4×H4 in accordance with the communication volume instruction, and transmits transmission information including the captured image to the management device 3 via the communication line 6. Alternatively, the moving object 2 captures an image of the surrounding environment with the sensor 21 in accordance with the communication volume instruction, cuts out a partial image having a size of W4×H4 from the acquired image, and transmits transmission information including the partial image to the management device 3 via the communication line 6. As a result, the management device 3 can receive the transmission information, display an image with a display size of W4×H4 according to the transmission information on the monitoring screen 31, and monitor the moving object 2. In other words, since the task type of the remote management is "control," the communication volume of the transmission information can be suppressed to a communication volume according to the resolution W4×H4 or the size W4×H4, and the moving object 2 can be appropriately monitored.

[0032] Alternatively, the management device 3 may determine the number of mobile objects 2 to be monitored by the management device 3 according to the task type of management of the mobile objects 2, and may determine the resolution of image data to be transmitted from the mobile objects 2 to the management device 3 according to the determined number of mobile objects to be monitored. The management device 3 may determine the number of mobile objects to be monitored by the management device and the driving specifications of the mobile objects 2 from the service content, and may determine the resolution of image data to be transmitted from the mobile objects 2 to the management device 3 according to the determined number of mobile objects to be monitored and the driving specifications.

[0033] This makes it possible to suppress the amount of information transmitted from the mobile units 2 to the management device 3 via the communication line 6 to an appropriate amount according to the number of monitored mobile units 2, thereby reducing the traffic on the communication line 6 between the management device 3 and the mobile units 2. In other words, the amount of communication between the management device 3 and the mobile units 2 can be optimized, and communication delays between the management device 3 and the mobile units 2 can be suppressed.

[0034] The management device 3 may determine in advance, for each number of monitored vehicles, the display size of the image on the monitoring screen 31. The resolution of the image data transmitted from the mobile object 2 to the management device 3 may be determined in accordance with the display size of the image to be displayed on the monitoring screen 31.

[0035] When the task type for managing the moving objects 2 is "monitoring with images," the management device 3 determines the number of moving objects 2 to be monitored to be k, where k is an integer between 2 and n. In response to the number of moving objects 2 to be monitored being k, the management device 3 determines the display size of the image on the monitoring screen 31 to be W11×H11. In response to the display size W11×H11, the management device 3 determines the resolution of the image data transmitted from the moving objects 2 to the management device 3 to be W11×H11.

[0036] For example, when the task type for managing the mobile object 2 is "monitoring with images," the management device 3 may determine the number of mobile objects to be monitored to two, mobile object 2_1 and mobile object 2_2, as shown in FIG. 2( a). FIG. 2 is a diagram illustrating the determination of image resolution according to the number of mobile objects to be monitored. In response to the number of mobile objects being monitored being two, the management device 3 determines the display size of images IM1 and IM2 of each mobile object 2_1 and 2_2 to be 9 pixels x 2 pixels, as shown in FIG. 2( b). In response to the display size of 9 pixels x 2 pixels, the management device 3 determines the resolution of image data IM1a and IM2a transmitted from the mobile object 2 to the management device 3 to be 9 pixels x 2 pixels. FIG. 2 is a diagram illustrating the adjustment of image resolution according to the number of mobile objects to be monitored.

[0037] 1 transmits a communication volume instruction to the mobile object 2, including a request to set the resolution of image data to W11×H11. If the sensor 21 is an imaging sensor, the mobile object 2 captures an image of the surrounding environment with the sensor 21 in response to the communication volume instruction, acquires an image with a resolution of W11×H11, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information, displays an image with a display size of W11×H11 according to the transmission information on the monitoring screen 31, and can monitor the mobile object 2.

[0038] 2(a) and 2(b), in accordance with a communication volume instruction, each of the moving bodies 2_1 and 2_2 captures an image of the surrounding environment using the sensor 21 to obtain an image with a resolution of 9 pixels x 2 pixels, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information and displays images IM1 and IM2 with a display size of 9 pixels x 2 pixels according to the transmission information on the monitoring screen 31, thereby enabling monitoring of the moving bodies 2_1 and 2_2.

[0039] That is, since the remote management task type is "monitoring with images," the amount of communication of transmitted information can be suppressed to the amount of communication corresponding to the resolution W11 x H11, and monitoring of the mobile body 2 can be performed appropriately.

[0040] When the task type for managing the moving objects 2 is "monitoring," the management device 3 determines the number of moving objects 2 to be monitored to be 1. In response to the number of moving objects 2 being monitored being 1, the management device 3 determines the display size of the image on the monitoring screen 31 to be W13×H13. In response to the display size W13×H13, the management device 3 determines the resolution of the image data transmitted from the moving object 2 to the management device 3 to be W13×H13.

[0041] For example, when the task type for managing the moving object 2 is "monitoring," the management device 3 determines that the moving object 2_1 should be "monitored," and determines the number of moving objects to be monitored to be one, that is, the moving object 2_1, as shown in FIG. 2(c). In response to the number of moving objects being monitored being one, the management device 3 determines the display size of the image IM3 of the moving object 2_1 to be 9 pixels x 5 pixels, as shown in FIG. 2(d). In response to the display size of 9 pixels x 5 pixels, the management device 3 determines the resolution of the image data IM3a transmitted from the moving object 2_1 to the management device 3 to be 9 pixels x 5 pixels.

[0042] 1 transmits a communication volume instruction to the mobile object 2, including a request to set the resolution of image data to W13×H13. If the sensor 21 is an imaging sensor, the mobile object 2 captures an image of the surrounding environment with the sensor 21 in response to the communication volume instruction, acquires an image with a resolution of W13×H13, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information and displays an image with a display size of W13×H13 according to the transmission information on the monitoring screen 31, thereby enabling monitoring of the mobile object 2.

[0043] 2(c) and 2(d), in response to a communication volume instruction, the moving object 2_1 captures an image of the surrounding environment using the sensor 21, acquires an image with a resolution of 9 pixels x 5 pixels, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information and displays an image IM3 with a display size of 9 pixels x 5 pixels according to the transmission information on the monitoring screen 31, thereby enabling monitoring of the moving object 2_1.

[0044] That is, since the remote management task type is "watching", the amount of communication of the transmitted information can be suppressed to the amount of communication corresponding to the resolution W13×H13, and the mobile object 2 can be monitored appropriately.

[0045] Alternatively, the management device 3 may determine the layout of the monitoring screen 31 of the management device 3 according to the task type of management of the mobile body 2, and determine the resolution of the image data transmitted from the mobile body 2 to the management device 3 according to the determined layout of the monitoring screen 31.

[0046] This makes it possible to suppress the amount of information transmitted from the mobile unit 2 to the management device 3 via the communication line 6 to an appropriate amount according to the layout of the monitoring screen 31, thereby reducing the traffic on the communication line 6 between the management device 3 and the mobile unit 2. In other words, it is possible to optimize the amount of communication between the management device 3 and the mobile unit 2, thereby suppressing communication delays between the management device 3 and the mobile unit 2.

[0047] The management device 3 may determine in advance the display size of the image on the monitoring screen 31 for each layout of the monitoring screen 31. The resolution of the image data transmitted from the mobile object 2 to the management device 3 may be determined in accordance with the layout of the image to be displayed on the monitoring screen 31.

[0048] When the mobile object 2 has m sensors 21 and the task type for managing the mobile object 2 is "monitoring with images," the management device 3 determines a layout of the monitoring screen 31 in which m images are arranged, in accordance with the fact that m images can be acquired by the mobile object 2. m is an integer greater than or equal to 2. The management device 3 may determine the display size of each of the m images to be equal to W21×H21. The management device 3 determines the resolution of image data transmitted from the mobile object 2 to the management device 3 to be W21×H21 in accordance with the display size W21×H21.

[0049] 1 transmits a communication volume instruction to the mobile object 2, including a request to set the resolution of each of the m pieces of image data to W21×H21. If the sensor 21 is an imaging sensor, the mobile object 2 captures images of the surrounding environment using the sensor 21 in accordance with the communication volume instruction, acquires images with a resolution of W21×H21, and transmits transmission information including the images to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information and displays m images, each having a display size of W21×H21 according to the transmission information, side by side on the monitoring screen 31, thereby enabling monitoring of the mobile object 2.

[0050] Alternatively, when determining a layout in which m images are arranged, the management device 3 may determine the display size of the main image among the m images to be relatively large (W22×H22) and the display size of the sub-images to be relatively small (W23×H23). The management device 3 determines the resolution of image data to be transmitted from the mobile object 2 to the management device 3 to be W22×H22 for the main image in accordance with the display size (W22×H22). The management device 3 determines the resolution of image data to be transmitted from the mobile object 2 to the management device 3 to be W23×H23 for the sub-images in accordance with the display size (W23×H23).

[0051] For example, when the mobile object 2_1 has four sensors 21 and the task type for managing the mobile object 2 is "monitoring with images," the management device 3 can acquire four images IM4a to IM7a from the mobile object 2, as shown in FIG. 3( a). Accordingly, the management device 3 may determine a layout for the monitoring screen 31 in which four images IM4 to IM7 are arranged, as shown in FIG. 3( b). FIG. 3 is a diagram illustrating how image resolutions are determined according to the screen layout. Of the four images IM4 to IM7, the management device 3 may determine the display size of the main image IM5 to be a relatively large 4 pixels x 4 pixels, and the display sizes of the sub-images IM4, IM6, and IM7 to be relatively small 2 pixels x 2 pixels. The main image IM5 may be an image of the front of the mobile object 2_1, and the sub-images IM4, IM6, and IM7 may be images of the left, right, and rear of the mobile object 2_1, respectively. Accordingly, on the monitoring screen 31, sub-images IM4 and IM6 may be arranged on the left and right of the main image IM5, and sub-image IM7 may be arranged above or below the main image IM5. For the main image IM5, the management device 3 determines the resolution of the image data to be transmitted from the mobile object 2_1 to the management device 3 to be 4 pixels x 4 pixels in accordance with the display size of 4 pixels x 4 pixels. For the sub-images IM4, IM6, and IM7, the management device 3 determines the resolution of the image data to be transmitted from the mobile object 2_1 to the management device 3 to be 2 pixels x 2 pixels in accordance with the display size of 2 pixels x 2 pixels.

[0052] 1 transmits a communication volume instruction to the mobile object 2, the communication volume instruction including a request to set the resolution of the main image data to W22×H22 and the resolution of the sub-image data to W23×H23. In response to the communication volume instruction, the mobile object 2 captures an image of the surrounding environment using the main sensor 21 to obtain an image with a resolution of W22×H22, captures an image of the surrounding environment using the sub-sensor 21 to obtain an image with a resolution of W23×H23, and transmits transmission information including the main image and the sub-image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information and displays the main image having a display size of W22×H22 and the sub-image having a display size of W23×H23 side by side on the monitoring screen 31 according to the transmission information, thereby enabling monitoring of the mobile object 2.

[0053] 3( a) and 3(b), in response to a communication volume instruction, the moving object 2_1 captures an image of the surrounding environment using the main sensor 21 and acquires an image IM5a with a resolution of 4 pixels by 4 pixels, captures an image of the surrounding environment using the sub-sensor 21 and acquires images IM4a, IM6a, and IM7a with a resolution of 2 pixels by 2 pixels, and transmits transmission information including the main image IM5a and the sub-images IM4a, IM6a, and IM7a to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information and displays the image IM5 with a display size of 4 pixels by 4 pixels and the images IM4, IM6, and IM7 with a display size of 2 pixels by 2 pixels side by side on the monitoring screen 31 according to the transmission information, thereby enabling monitoring of the moving object 2_1.

[0054] In other words, depending on whether the remote management task type is "monitoring with images," the amount of communication for the transmitted information can be reduced to a level corresponding to the resolution W22 x H22 or W23 x H23, allowing for appropriate monitoring of the mobile body 2.

[0055] When the mobile object 2 has m sensors 21 and the task type for managing the mobile object 2 is "monitoring," the management device 3 determines that attention should be paid to the image of one sensor 21 out of the m sensors 21, and accordingly determines a layout in which one image is arranged as the layout of the monitoring screen 31. The management device 3 determines the display size of that one image to be W24×H24. In accordance with the display size W24×H24, the management device 3 determines the resolution of image data transmitted from the mobile object 2 to the management device 3 to be W24×H24.

[0056] For example, when the mobile object 2_1 has four sensors 21 and the task type for managing the mobile object 2 is "gazing," the management device 3 determines that attention should be paid to an image IM3a of one sensor 21, as shown in FIG. 3C, and accordingly determines a layout of the monitoring screen 31 in which one image IM3 is arranged, as shown in FIG. 3D. The management device 3 determines the display size of that one image to be 9 pixels x 5 pixels. In accordance with the display size of 9 pixels x 5 pixels, the management device 3 determines the resolution of the image data transmitted from the mobile object 2 to the management device 3 to be 9 pixels x 5 pixels.

[0057] 1 transmits a communication volume instruction to the mobile object 2, including a request to set the resolution of image data to W24×H24. If the sensor 21 is an imaging sensor, the mobile object 2 captures an image of the surrounding environment using the sensor 21 in response to the communication volume instruction, acquires an image with a resolution of W24×H24, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information and displays an image with a display size of W24×H24 according to the transmission information on the monitoring screen 31, thereby enabling monitoring of the mobile object 2.

[0058] 3(c) and 3(d), in response to a communication volume instruction, the mobile object 2_1 captures an image of the surrounding environment using the sensor 21, acquires an image with a resolution of 9 pixels x 5 pixels, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information, displays an image with a display size of 9 pixels x 5 pixels according to the transmission information on the monitoring screen 31, and can monitor the mobile object 2_1.

[0059] That is, since the remote management task type is "watching", the amount of communication of transmitted information can be suppressed to the amount of communication corresponding to the resolution W24 x H24, and the mobile object 2 can be monitored appropriately.

[0060] Alternatively, the management device 3 may determine the amount of communication from the management device 3 to the mobile object 2 according to the task type of remote management of the mobile object 2. The management device 3 may determine the transfer rate of the synchronization signal transmitted from the management device 3 to the mobile object 2 according to the task type of management of the mobile object 2.

[0061] This makes it possible to suppress the amount of information transmitted from the management device 3 to the mobile body 2 via the communication line 6 to an appropriate amount according to the type of task for managing the mobile body 2, thereby reducing the traffic on the communication line 6 between the management device 3 and the mobile body 2. In other words, it is possible to optimize the amount of communication between the management device 3 and the mobile body 2, thereby suppressing communication delays between the management device 3 and the mobile body 2.

[0062] The management device 3 may predetermine the transfer rate of the synchronization signal for each task type of management of the mobile object 2. The management device 3 may predetermine the transfer rates of the synchronization signal to be transmitted to the mobile object 2 when performing "monitoring with image", "monitoring without image", "gazing" and "operation" as B1, B2, B3 and B4, respectively. The magnitude relationship between these transfer rates may satisfy the following formula 3: B1<B2=B4<B3... formula 3

[0063] The bandwidth used for the synchronization signal during transmission over the communication line 6 can be determined according to the transfer rate of the synchronization signal. If the transfer rates of the synchronization signal are B1, B2, B3, and B4, the bandwidth used for the synchronization signal during transmission over the communication line 6 can also be B1, B2, B3, and B4, respectively.

[0064] When the task type of management of the mobile object 2 is "monitoring with images," the management device 3 determines the transfer rate of the synchronization signal to be B1. The management device 3 generates a synchronization signal in accordance with the transfer rate B1 of the synchronization signal and transmits it to the mobile object 2 at the transfer rate B1. When the sensor 21 is an imaging sensor, the mobile object 2 captures an image of the surrounding environment with the sensor 21 at a timing in accordance with the synchronization signal, acquires the image, and transmits transmission information including the image to the management device 3 via the communication line 6. This allows the management device 3 to receive the transmission information, display an image in accordance with the transmission information on the monitoring screen 31, and monitor the mobile object 2. In other words, when the task type of remote management is "monitoring with images," the communication volume of the transmission information can be suppressed to a communication volume in accordance with the transfer rate B1 of the synchronization signal, and the mobile object 2 can be appropriately monitored.

[0065] When the task type of management of the mobile unit 2 is "monitoring without images," the management device 3 determines the transfer rate of the synchronization signal to be B2. The management device 3 generates a synchronization signal in accordance with the transfer rate B2 of the synchronization signal and transmits it to the mobile unit 2 at the transfer rate B2. In the case of "monitoring without images," monitoring is performed using non-image information (e.g., distance measurement information), making it easier to increase the temporal resolution. Taking this into consideration, the transfer rate B2 can be set higher than the transfer rate B1. When the sensor 21 is an imaging sensor, the mobile unit 2 captures images of the surrounding environment using the sensor 21 at a timing corresponding to the synchronization signal, acquires the images, and transmits transmission information including the images to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information, displays an image corresponding to the transmission information on the monitoring screen 31, and monitors the mobile unit 2. In other words, when the task type of remote management is "monitoring with images," the communication volume of the transmission information can be suppressed to a volume corresponding to the transfer rate B2 of the synchronization signal, thereby enabling appropriate monitoring of the mobile unit 2.

[0066] When the task type for managing the moving object 2 is "gazing," the management device 3 determines the transfer rate of the synchronization signal to be B3. The management device 3 generates a synchronization signal in accordance with the transfer rate B3 of the synchronization signal and transmits it to the moving object 2 at the transfer rate B3. In the case of "gazing," monitoring is performed by narrowing down the moving object 2 and / or the sensor 21 to be monitored, making it easier to increase the temporal resolution. Furthermore, "gazing" may require monitoring with increased temporal precision. In consideration of this, the transfer rate B3 may be greater than the transfer rate B1 and may also be greater than the transfer rate B2. When the sensor 21 is an imaging sensor, the moving object 2 captures an image of the surrounding environment using the sensor 21 at a timing corresponding to the synchronization signal, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information, displays an image corresponding to the transmission information on the monitoring screen 31, and monitors the moving object 2. That is, since the remote management task type is "monitoring," the amount of communication of the transmitted information can be suppressed to the amount of communication corresponding to the transfer rate B3 of the synchronization signal, and the mobile body 2 can be appropriately monitored.

[0067] When the task type of management of the moving object 2 is "control," the management device 3 determines the transfer rate of the synchronization signal to be B4. The management device 3 generates a synchronization signal in accordance with the transfer rate B4 of the synchronization signal and transmits it to the moving object 2 at the transfer rate B4. In the case of "control," control with increased temporal precision may be required. Taking this into consideration, the transfer rate B4 may be greater than the transfer rate B1. When the sensor 21 is an imaging sensor, the moving object 2 captures an image of the surrounding environment using the sensor 21 at a timing in accordance with the synchronization signal, and transmits transmission information including the image to the management device 3 via the communication line 6. As a result, the management device 3 receives the transmission information, displays an image in accordance with the transmission information on the monitoring screen 31, and monitors the moving object 2. In other words, when the task type of remote management is "control," the communication volume of the transmission information can be suppressed to a communication volume in accordance with the transfer rate B4 of the synchronization signal, allowing appropriate monitoring of the moving object 2.

[0068] 2 and 3 for the sake of simplicity, the monitoring screen 31 may display input objects (e.g., buttons, check boxes, drop-down menus, text boxes, etc.) that can receive operation instructions from a user as a graphical user interface. Furthermore, when the task type for managing the mobile object 2 is switched, the input objects may be inactivated (e.g., grayed out) or hidden until an image corresponding to the task type is displayed on the monitoring screen 31, and the input objects may be activated or displayed after the image corresponding to the task type is displayed on the monitoring screen 31.

[0069] Next, a management method executed by the management system 1 will be described with reference to Fig. 4. Fig. 4 is a sequence diagram showing the management method. Fig. 4 illustrates an example of processing between one mobile object 2 and a management device 3, but the processing between other mobile objects 2 and management devices 3 is similar.

[0070] In the management system 1, the management device 3 determines the communication volume between the management device 3 and the mobile device 2 according to the task type of management of the mobile device 2 (S1). The management device 3 may determine the communication volume of information to be transmitted from the mobile device 2 to the management device 3 according to the task type of management of the mobile device 2, for example, may determine the resolution of image data to be transmitted from the mobile device 2 to the management device 3. The management device 3 may determine the communication volume of information to be transmitted from the management device 3 to the mobile device 2 according to the task type of management of the mobile device 2, for example, may determine the transfer rate of a synchronization signal to be transmitted from the management device 3 to the mobile device 2. The management device 3 generates a communication volume instruction including a request to communicate at the communication volume determined in S1 and transmits it to the mobile device 2 (S2).

[0071] When the mobile object 2 receives the communication volume instruction from the management device 3 via the communication line 6 (S3), it executes control in accordance with the communication volume instruction (S20). In S20, the processes of S21 to S24 are performed. In parallel with this, after S2, the management device 3 executes remote management of the mobile object 2 (S10). In S10, the processes of S11 to S14 and the process of S15 are performed in parallel.

[0072] For example, when remote management of the mobile unit 2 (S10) is started, the management device 3 generates a synchronization signal and transmits it to the mobile unit 2 at the transfer rate determined in S1 (S11). At the same time, the management device 3 starts up the monitoring screen 31 and starts display control of the monitoring screen 31 (S15).

[0073] When the mobile object 2 receives a synchronization signal from the management device 3 via the communication line 6 (S21), the mobile object 2 captures an image of the surrounding environment with the sensor 21 and acquires an image with a resolution according to the communication volume instruction. The mobile object 2 generates transmission information including image data according to the acquired image and transmits it to the management device 3 (S22).

[0074] When the management device 3 receives the transmission information from the mobile unit 2 via the communication line 6 (S12), it displays an image corresponding to the image data included in the transmission information on the monitoring screen 31 (S15). At this time, the image can be displayed on the monitoring screen 31 at a resolution corresponding to the communication volume instruction.

[0075] When a predetermined period has elapsed since S11, the management device 3 generates a synchronization signal and transmits it to the mobile unit 2 at the transfer rate determined in S1 (S13).

[0076] When the mobile object 2 receives a synchronization signal from the management device 3 via the communication line 6 (S23), the mobile object 2 captures an image of the surrounding environment with the sensor 21 and acquires an image with a resolution according to the communication volume instruction. The mobile object 2 generates transmission information including image data according to the acquired image and transmits it to the management device 3 (S24).

[0077] When the management device 3 receives the transmission information from the mobile unit 2 via the communication line 6 (S14), it displays an image corresponding to the image data included in the transmission information on the monitoring screen 31 (S15). At this time, the image can be displayed on the monitoring screen 31 at a resolution corresponding to the communication volume instruction.

[0078] Although not shown, after S24, the mobile object 2 may repeat the same processes as S21 to S24. After S14, the management device 3 may repeat the same processes as S11 to S14 while continuing S15.

[0079] Furthermore, the management device 3 may return the process to S1 and perform the processes from S1 onward every time the task type is changed.

[0080] As described above, in the first embodiment, the management system 1 determines the communication volume between the management device 3 and the mobile device 2 according to the task type of remote management of the mobile device 2, and transmits a communication volume instruction including a request to communicate at the determined communication volume to the mobile device 2. This makes it possible to suppress the communication volume of information transmitted from the mobile device 2 to the management device 3 via the communication line 6 to an appropriate communication volume according to the task type of management of the mobile device 2. Furthermore, the management device 3 can suppress the communication volume of information transmitted from the management device 3 to the mobile device 2 via the communication line 6 to an appropriate communication volume according to the task type of management of the mobile device 2. As a result, it is possible to reduce traffic on the communication line 6 between the management device 3 and the mobile device 2. In other words, the communication volume between the management device 3 and the mobile device 2 can be optimized and communication delays between the management device 3 and the mobile device 2 can be suppressed, thereby enabling efficient remote management of the mobile device 2.

[0081] The monitoring screen 31 of the management terminal 5 may display sensor information in addition to the image IM, and the display layout of the sensor information may be changed depending on the task type.

[0082] For example, if the remote management task type is "control," the management device 3 may display a point cloud indicating the ranging point cloud of the ranging sensor on the monitoring screen 31, superimposed on an image IM3 similar to that shown in Figure 3 (d).

[0083] Alternatively, if the remote management task type is "gazing," the management device 3 displays an image IM3 similar to that shown in Figure 3 (d) on the monitoring screen 31, but does not need to display a point cloud indicating the ranging point cloud of the ranging sensor.

[0084] Alternatively, when determining the communication volume in S1 of FIG. 4, the management device 3 may determine the communication volume taking into consideration the driving environment conditions of the mobile object 2. For example, the communication environment may vary depending on whether the driving environment is static (such as an indoor / outdoor communication environment) or dynamic (such as an environment with many people due to an event). For this reason, the management device 3 may fine-tune the communication volume taking into consideration the driving environment conditions of the mobile object 2. This makes it possible to suppress the communication volume between the management device 3 and the mobile object 2 to a level that corresponds to the driving environment conditions of the mobile object 2 in addition to the type of task for managing the mobile object 2.

[0085] As a modification of the first embodiment, in the management method executed by the management system 1, the processing from S1 onward may be started in response to a change in the traveling state of the mobile object 2 as a trigger, as shown in Fig. 5. Fig. 5 is a sequence diagram showing the management method according to the modification of the first embodiment.

[0086] In the management system 1, the mobile object 2 detects the traveling state of the mobile object 2. The traveling state of the mobile object 2 includes starting of the mobile object 2, stopping of the mobile object 2, accelerating of the mobile object 2, decelerating of the mobile object 2, turning of the mobile object 2, reversing of the mobile object 2, stopping of the mobile object 2, parking of the mobile object 2, etc. The mobile object 2 may periodically detect the traveling state of the mobile object 2 by using a signal from the sensor 21. Alternatively, the mobile object 2 may detect the traveling state of the mobile object 2 in response to the occurrence of an event by using a signal from an event-driven sensor 21 such as an event camera. The mobile object 2 transmits information about the traveling state to the management device 3 via the communication line 6 (S71).

[0087] When the management device 3 receives the driving state information from the mobile object 2 via the communication line 6 (S81), the management device 3 may determine whether a change in the driving state of the mobile object 2 has occurred by comparing the driving state information with the driving state information previously received from the mobile object 2. Alternatively, the management device 3 may determine whether a change in the driving state of the mobile object 2 has occurred by looking at the content of the driving state information corresponding to the occurrence of an event (for example, a signal level).

[0088] The management device 3 waits until a change occurs in the traveling state of the mobile object 2. When a change occurs in the traveling state of the mobile object 2, the management device 3 determines the amount of communication between the management device 3 and the mobile object 2 according to the task type of management of the mobile object 2 (S1).

[0089] For example, the management device 3 may identify the traffic volume around the mobile object 2 based on the information on the traveling state. The traffic volume around the mobile object 2 may be the average number of objects around the mobile object 2, or the average speed of objects moving around the mobile object 2 per unit time. When the management device 3 determines that the identified traffic volume is greater than a predetermined volume, if the task type for managing the mobile object 2 is a task type with images, such as "monitoring with images," "operation," or "watching," the management device 3 reduces the number of monitored vehicles and increases the image resolution. This makes it possible to improve the quality of monitoring in response to an increase in traffic volume around the mobile object 2 while suppressing an increase in communication volume.

[0090] Alternatively, when the management device 3 determines that the identified traffic volume has decreased below a predetermined volume, if the task type for managing the mobile object 2 is a task type with images, such as "monitoring with images," "operation," or "watching," the management device 3 reduces the image resolution. This reduces the quality of monitoring in response to the decrease in traffic volume around the mobile object 2, thereby saving communication traffic.

[0091] Alternatively, when the management device 3 detects a suspicious person around the mobile object 2 according to the information on the traveling state, if the task type for managing the mobile object 2 is a task type with images, such as "monitoring with images," "driving," or "watching," the management device 3 reduces the number of monitoring units and increases the image resolution. This makes it possible to improve the quality of monitoring in response to the detection of a suspicious person around the mobile object 2 while suppressing an increase in communication traffic.

[0092] Alternatively, the management device 3 may identify the weather around the mobile object 2 based on the information on the traveling state. The weather around the mobile object 2 includes clear skies, sunny skies, cloudy skies, rainy skies, snowy skies, etc. When the identified weather changes from inclement (e.g., cloudy skies, rainy skies, snowy skies, etc.) to good (e.g., clear skies, sunny skies, etc.), the management device 3 lowers the image resolution if the task type for managing the mobile object 2 is a task type with images, such as "monitoring with images," "operating," or "watching." This reduces the quality of monitoring and saves communication traffic when the weather around the mobile object 2 is good and visibility is easy to ensure.

[0093] Alternatively, in response to a change in the specified weather from bad to good, if the task type for managing the mobile units 2 is a task type with images, such as "monitoring with images," "control," or "watching," the management device 3 reduces the number of units to be monitored and increases the image resolution. This makes it possible to improve the quality of monitoring in response to poor weather around the mobile units 2 and difficulty in ensuring visibility, while suppressing an increase in communication traffic.

[0094] Alternatively, the management device 3 may identify the content of the service being operated by the mobile object 2 based on the information on the traveling state. The content of the service may include security monitoring, advertisement presentation, etc. In response to a change in the identified service content from one requiring less monitoring (e.g., advertisement presentation) to one requiring more monitoring (e.g., security monitoring), the management device 3 reduces the number of monitored mobile objects and increases the image resolution if the task type for managing the mobile object 2 is a task type requiring more monitoring, such as "monitoring with images," "operation," or "watching." This makes it possible to improve the quality of monitoring in response to the content of the service requiring more monitoring, while suppressing an increase in communication traffic.

[0095] Alternatively, in response to a change in the content of the identified service from one requiring less monitoring to one requiring more monitoring, the management device 3 lowers the image resolution if the task type for managing the mobile object 2 is a task type requiring images, such as "monitoring with images," "control," or "watching." This reduces the quality of monitoring in response to the content of the service requiring less monitoring, thereby saving communication traffic.

[0096] After this, the same processing as in FIG. 4 is carried out.

[0097] Second Embodiment Next, a management system 101 according to a second embodiment will be described, focusing on the differences from the first embodiment.

[0098] In the second embodiment, a configuration including a server and a plurality of management terminals will be exemplified as an implementation form of the management device in the management system 101.

[0099] The management system 101 may be configured as shown in Fig. 6. Fig. 6 is a diagram showing a schematic configuration of the management system 101 according to the second embodiment.

[0100] In the management system 101, the management device 3 includes a server 4 and a plurality of management terminals 5_1 to 5_p, where p is an arbitrary integer of 2 or greater.

[0101] A plurality of mobile objects 2_1 to 2_n are communicatively connected to a server 4 via a communication line 6. The server 4 is communicatively connected to a plurality of management terminals 5_1 to 5_p via a communication line .

[0102] The communication line 6 may be the same as the communication line 6 in the first embodiment. The communication line 7 includes a wireless communication line and / or a wired communication line. The wireless communication line includes a communication line using a radio access technology (RAT: Radio Access Technology) such as LTE (Long Term Evolution), NR (New Radio), Wi-Fi, Bluetooth (registered trademark), etc. The wired communication line includes the Internet, a LAN (Local Area Network), a telephone switching network, etc.

[0103] In the management system 101, the server 4 and each management terminal 5 may be managed by the manufacturer of the mobile object 2. Each management terminal 5 can remotely manage the status of the mobile object 2 via the communication line 7, the server 4, and the communication line 6. Each management terminal 5 monitors the status and controls the operation of the mobile object 2.

[0104] The mobile object 2 may be functionally configured as shown in Fig. 7. Fig. 7 is a diagram showing the functional configuration of the mobile object 2.

[0105] In addition to a plurality of sensors 21_1 to 21_m, the mobile object 2 is equipped with an information processing device 20. The information processing device 20 has a sensor information acquisition unit 22, a mobile object / sensor information processing unit 23, a mobile object information acquisition unit 24, a transmission information extraction unit 25, a transmission information amount storage unit 26, and a communication unit 27.

[0106] The sensor information acquisition unit 22 is connected between the multiple sensors 21_1 to 21_m, the mobile body / sensor information processing unit 23, and the transmission information extraction unit 25. The mobile body information acquisition unit 24 is connected between the mobile body / sensor information processing unit 23 and the transmission information extraction unit 25. The transmission information extraction unit 25 is connected between the sensor information acquisition unit 22, the mobile body / sensor information processing unit 23, the mobile body information acquisition unit 24, the transmission information amount storage unit 26, and the communication unit 27. The transmission information amount storage unit 26 is connected between the transmission information extraction unit 25 and the communication unit 27. The communication unit 27 is connected between the transmission information extraction unit 25, the transmission information amount storage unit 26, and the server 4.

[0107] When the communication unit 27 receives a synchronization signal from the server 4 via the communication line 6, the synchronization signal is supplied to each sensor 21 via the transmission information extraction unit 25 and the sensor information acquisition unit 22. In response to this, each sensor 21 can perform a sensing operation.

[0108] When the communication unit 27 receives a communication volume instruction from the server 4 via the communication line 6, the communication volume instruction is supplied to the mobile object / sensor information processing unit 23 via the transmission information volume storage unit 26. The mobile object / sensor information processing unit 23 receives sensing results from the sensor 21 via the sensor information acquisition unit 22. The mobile object / sensor information processing unit 23 may adjust the information volume of the sensing results in accordance with the communication volume instruction. The mobile object / sensor information processing unit 23 may adjust the information volume of the sensing results in accordance with the communication volume instruction, as well as the communication status of the mobile object 2 and / or information about the surroundings of the mobile object 2. The information about the surroundings of the mobile object 2 includes information such as heavy traffic volume and the need for increased sensor information for safe remote control when there is a high traffic risk, such as crossing an intersection. If the sensing result is an image, the mobile object / sensor information processing unit 23 may adjust the resolution of the sensing result (image) in accordance with the resolution of the image included in the communication volume instruction. Furthermore, if the sensing result is an image, the mobile object / sensor information processing unit 23 may perform image recognition processing on the image using a trained model. The mobile body / sensor information processing unit 23 may include the result of the image recognition process as tag information in the sensing result.

[0109] The mobile body information acquisition unit 24 acquires mobile body information (for example, a mobile body ID, etc.) and supplies the mobile body information to the mobile body / sensor information processing unit 23 and the transmission information extraction unit 25, respectively.

[0110] The mobile body / sensor information processing unit 23 receives the mobile body information from the mobile body information acquisition unit 24. The mobile body / sensor information processing unit 23 performs predetermined processing on the mobile body information and supplies the processed mobile body information to the transmission information extraction unit 25.

[0111] The transmission information extraction unit 25 receives the sensing results from the sensor information acquisition unit 22, the processed sensing results from the mobile body / sensor information processing unit 23, the mobile body information from the mobile body information acquisition unit 24, and the processed mobile body information from the mobile body / sensor information processing unit 23. The transmission information extraction unit 25 generates transmission information. The transmission information includes the sensing results and / or the processed sensing results and the mobile body information and / or the processed mobile body information. The transmission information extraction unit 25 may specify the amount of information in the transmission information and store it in the transmission information amount storage unit 26. The transmission information extraction unit 25 supplies the transmission information to the communication unit 27. In response, the transmission information is transmitted to the server 4 via the communication line 6.

[0112] The mobile object 2 may have a hardware configuration as shown in Fig. 8. Fig. 8 is a diagram showing the hardware configuration of the mobile object 2.

[0113] The mobile object 2 is equipped with a plurality of sensors 21_1 to 21_m as well as an information processing device 20. The plurality of sensors 21_1 to 21_m and the information processing device 20 can be communicably connected to each other via a communication path. The communication path may be a wired communication path such as a serial cable.

[0114] The information processing device 20 includes a control unit 2a, an operation unit 2b, a display unit 2c, an audio output unit 2d, a communication interface (I / F) 2e, a sensor interface (I / F) 2b, and a storage unit 2f. The sensor interface (I / F) 2b, the control unit 2a, the operation unit 2b, the display unit 2c, the audio output unit 2d, the communication interface 2e, and the storage unit 2f can be connected to each other via a bus so as to be able to communicate with each other.

[0115] The control unit 2a comprehensively controls each unit of the mobile object 2. The control unit 2a may be an ECU (Electronic Control Unit). A plurality of sensors 21_1 to 21_m are connected to the sensor interface (I / F) 2b via a communication path. The operation unit 2b accepts operation instructions from a user. If the mobile object 2 is a vehicle, the operation unit 2b may include a steering wheel, an accelerator, a brake, etc. The operation unit 2b may further include buttons, keys, a touch panel, etc. The display unit 2c outputs predetermined information to the user by display. The display unit 2c includes a display 30 such as an LCD. The audio output unit 2d outputs predetermined information to the user by voice. The audio output unit 2d may be a speaker. The communication interface 2e is communicatively connected to the server 4 via a communication line 6. The communication interface 2e may include a receiving circuit that receives information from the server 4 and a transmitting circuit that transmits information to the server 4. The storage unit 2f is capable of storing information and may be a non-volatile storage medium such as a hard disk.

[0116] For example, when a communication amount instruction including a request to communicate at a communication amount determined according to the remote management task type is received via the communication interface 2e, the control unit 2a may control communication with the management device 3 (server 4) at a communication amount according to the communication amount instruction. The communication amount according to the communication amount instruction includes an image resolution according to the communication amount instruction. The control unit 2a may control the sensor 21 so that the number of pixels of the acquired image is the number of pixels according to the communication amount instruction, thereby causing the mobile object 2 to acquire an image with a resolution according to the communication amount instruction. Alternatively, the control unit 2a may control the sensor 21 so that the number of pixels of image data generated from the image acquired by the sensor 21 is the number of pixels according to the communication amount instruction, thereby causing the mobile object 2 to acquire an image with a resolution according to the communication amount instruction.

[0117] In the configuration shown in FIG. 7 , the transmission information amount storage unit 26 is realized by the storage unit 2f. The communication unit 27 is realized by the communication interface 2e. The sensor information acquisition unit 22 is realized by the sensor interface 2g. Each unit (mobile body / sensor information processing unit 23, mobile body information acquisition unit 24, and transmission information extraction unit 25) excluding the sensor 21, the transmission information amount storage unit 26, and the communication unit 27 may be realized by software within the control unit 2a. For example, the control unit 2a may be a system including a processor, a nonvolatile memory, and a volatile memory. The nonvolatile memory stores a program. The processor may read and start the program from the nonvolatile memory in response to a trigger such as power-on of the mobile body 2, and may load modules corresponding to each unit into the volatile memory either collectively at the time of compilation or sequentially as processing progresses. This allows the processor to operate according to the program. Alternatively, each unit may be realized by hardware as a circuit configured within the control unit 2a. Alternatively, some of the units may be realized by software and the rest by hardware.

[0118] The server 4 may be functionally configured as shown in Fig. 9. Fig. 9 is a diagram showing the functional configuration of the server 4.

[0119] The server 4 includes a communication unit 41 , an image processing unit 42 , a communication volume instruction generating unit 43 , a transmission information evaluation threshold storage unit 44 , a driving mode information acquiring unit 45 , a remote mode information evaluation threshold storage unit 46 , and a communication unit 47 .

[0120] The communication unit 41 is connected between the mobile object 2, the image processing unit 42, and the communication volume instruction generation unit 43. The image processing unit 42 is connected between the communication unit 41 and the communication unit 47. The communication volume instruction generation unit 43 is connected between the communication unit 41, the operation mode information acquisition unit 45, the transmission information evaluation threshold storage unit 44, and the remote mode information evaluation threshold storage unit 46. The operation mode information acquisition unit 45 is connected between the communication volume instruction generation unit 43 and the communication unit 47. The communication unit 47 is connected between the image processing unit 42, the operation mode information acquisition unit 45, and the management terminal 5.

[0121] When the operation mode information acquisition unit 45 receives a task request from the management device 5 via the communication line 7 and the communication unit 47, it identifies the type of remote management task to be executed by the management terminal 5 in response to the task request, generates task information indicating the task type, and supplies it to the communication amount instruction generation unit 43. The communication amount instruction generation unit 43 determines the communication amount between the server 4 and the mobile object 2 in response to the task information. The communication amount instruction generation unit 43 generates a communication amount instruction while referring to the information stored in the transmission information evaluation threshold storage unit 44 and the information stored in the remote mode information evaluation threshold storage unit 46. The communication amount instruction generation unit 43 may generate a communication amount instruction including a request to communicate at the determined communication amount. The communication amount instruction generation unit 43 transmits the communication amount instruction to the mobile object 2 via the communication unit 41 and the communication line 6.

[0122] After the communication volume instruction is transmitted, the communication volume instruction generation unit 43 periodically generates a synchronization signal. The communication volume instruction generation unit 43 transmits the synchronization signal to the mobile object 2 via the communication unit 41 and the communication line 6, and also transmits the synchronization signal to the management terminal 5 via the operation mode information acquisition unit 45, the communication unit 47, and the communication line 7.

[0123] When the communication volume instruction generating unit 43 receives transmission information from the mobile object 2 via the communication line 6 and the communication unit 41 , it transfers the transmission information to the management terminal 5 via the operation mode information acquiring unit 45 , the communication unit 47 and the communication line 7 .

[0124] The server 4 may have a hardware configuration as shown in Fig. 10. Fig. 10 is a diagram showing the hardware configuration of the server 4.

[0125] The server 4 includes a communication interface (I / F) 4 a, a control unit 4 b, a storage unit 4 c, and a communication interface (I / F) 4 d. The communication interface 4 a, the control unit 4 b, the storage unit 4 c, and the communication interface 4 d can be communicably connected to each other via a bus.

[0126] The communication interface 4a is communicatively connected to the mobile object 2 via a communication line 6. The communication interface 4a may include a receiving circuit that receives information from the mobile object 2 and a transmitting circuit that transmits information to the mobile object 2. The control unit 4b performs overall control of each unit of the server 4. The control unit 4b may be a CPU (Central Processing Unit). The memory unit 4c is capable of storing information. The memory unit 4c may be a non-volatile memory medium such as a hard disk. The communication interface 4d is communicatively connected to the management terminal 5 via a communication line 7. The communication interface 4d may include a receiving circuit that receives information from the management terminal 5 and a transmitting circuit that transmits information to the management terminal 5.

[0127] In the configuration shown in FIG. 9 , the communication unit 41 is implemented by the communication interface 4a. The transmission information evaluation threshold storage unit 44 and the remote behavior information evaluation threshold storage unit 46 are implemented by the storage unit 4c. The communication unit 47 is implemented by the communication interface 4d. Each unit (image processing unit 42, communication volume instruction generating unit 43, and operation mode information acquiring unit 45) other than the communication unit 41, the transmission information evaluation threshold storage unit 44, the remote behavior information evaluation threshold storage unit 46, and the communication unit 47 may be implemented as software within the control unit 4b. For example, the control unit 4b may be a system including a processor, a nonvolatile memory, and a volatile memory. The nonvolatile memory stores a program. The processor may read and start the program from the nonvolatile memory in response to a trigger such as power-on of the server 4, and may load modules corresponding to each unit into the volatile memory collectively at the time of compilation or sequentially as processing progresses. This allows the processor to operate according to the program. Alternatively, each unit may be implemented as hardware as a circuit configured within the control unit 4b. Alternatively, some of the components may be implemented in software and the rest in hardware.

[0128] The management terminal 5 may be functionally configured as shown in Fig. 11. Fig. 11 is a diagram showing the functional configuration of the management terminal 5.

[0129] The management terminal 5 has a communication unit 51, a task information notification unit 52, a mobile object information notification unit 53, a storage unit 54, a communication control unit 55, a display control unit 56, and a display unit 57. The storage unit 54 stores task candidate information 54a, assigned mobile object information 54b, and a correspondence table 54c. The display unit 57 has a monitoring screen 31.

[0130] The communication unit 51 is connected between the server 4 and the task information notification unit 52, the mobile object information notification unit 53, the communication control unit 55, and the display control unit 56. The task information notification unit 52 is connected between the communication unit 51 and the memory unit 54. The mobile object information notification unit 53 is connected between the communication unit 51 and the memory unit 54. The memory unit 54 is connected between the task information notification unit 52, the mobile object information notification unit 53, the communication control unit 55, and the display control unit 56. The communication control unit 55 is connected between the communication unit 51 and the memory unit 54. The display control unit 56 is connected between the communication unit 51, the memory unit 54, and the display unit 57.

[0131] In response to an instruction from an operator, the task information notification unit 52 identifies a remote management task type that can be executed by the management terminal 5. The task types that can be executed by the management device 3 may include at least one of "monitoring with images," "monitoring without images," "gazing," and "control." The task information notification unit 52 generates task candidate information 54a that indicates the remote management task types that can be executed by the management terminal 5 and stores the information in the storage unit 54.

[0132] In response to an instruction from an operator, the mobile object information notification unit 53 identifies a mobile object 2 from among the multiple mobile objects 2_1 to 2_n that will be remotely managed by the management terminal 5. The mobile object information notification unit 53 generates assigned mobile object information 54b including identification information of the mobile object 2 that will be remotely managed by the management terminal 5, and stores the assigned mobile object information 54b in the storage unit 54.

[0133] In response to an instruction from an operator, the task information notification unit 52 may generate a correspondence table 54c in which task types and parameters are associated with each other for a plurality of task types. The correspondence table 54c may associate task types with display sizes for a plurality of task types. The correspondence table 54c may associate task types with the number of monitored devices and display sizes for a plurality of task types. The correspondence table 54c may associate task types with layout patterns and display sizes for a plurality of task types. The correspondence table 54c may associate task types with synchronization signal transfer rates for a plurality of task types.

[0134] In response to an instruction from the operator, the display control unit 56 may access the storage unit 54 to refer to the task candidate information 54a and display, on the monitoring screen 31 on the display 30 of the display unit 57, a screen prompting registration of the correspondence table 54c for each of the multiple task types indicated in the task candidate information 54a. The monitoring screen 31 is a display area for monitoring on the display 30. When registration information for the correspondence table 54c is input in response to an instruction from the operator, the task information notification unit 52 may add the registration information to update the correspondence table 54c and store the updated correspondence table 54c in the storage unit 54. As a result, the updated correspondence table 54c is registered in the management terminal 5.

[0135] For example, a correspondence table 54c as shown in Fig. 12 and Fig. 13 may be registered in the management terminal 5. Fig. 12 and Fig. 13 are diagrams each showing the data structure of the correspondence table 54c. Fig. 12(a) shows the correspondence table 54c for "monitoring with images". Fig. 12(b) shows the correspondence table 54c for "piloting". Fig. 13(a) shows the correspondence table 54c for "monitoring without images". Fig. 13(b) shows the correspondence table 54c for "gazing".

[0136] 12(a) to 13(b) each show an example of a correspondence table 54c in which task types, the number of monitored devices, layout patterns, display sizes, and synchronization signal transfer rates are associated with each other for a plurality of task types.

[0137] 12(a), it can be seen that for "monitoring with images," when the number of monitored devices is "1," the main image (image "2") is displayed in the center of the monitoring screen 31 with sub-images (images "1," "3," and "4") arranged to the left, right, and top in a layout pattern, and the transfer rate of the synchronization signal is set to TR1. It can be seen that the display sizes are as follows: image "1" is number of pixels P1 x number of pixels P1, image "2" is number of pixels P2 x number of pixels P3, image "3" is number of pixels P1 x number of pixels P1, and image "4" is number of pixels P4 x number of pixels P4.

[0138] For "monitoring with images," when the number of monitored devices is "2," two image groups are arranged vertically on the monitoring screen 31, and within each image group, the main image (image "2") is displayed in the center with sub-images (images "1," "3," and "4") arranged to the left, right, and above, in a layout pattern, and it can be seen that the transfer rate of the synchronization signal is TR1 / 2. It can be seen that the display size is as follows: image "1" is P1 / 2 pixels x P1 / 2 pixels, image "2" is P2 / 2 pixels x P3 / 2 pixels, image "3" is P1 / 2 pixels x P1 / 2 pixels, and image "4" is P4 / 2 pixels x P4 / 2 pixels.

[0139] 12(b), it can be seen that for "control," when the number of monitored units is "1," the main image (image "2") is displayed in the center on the monitoring screen 31 in a layout pattern with sub-images (images "1," "3," and "4") arranged to the left, right, and top, and that the transfer rate of the synchronization signal is 2×TR1. It can be seen that the display size for image "1" is number of pixels P1×number of pixels P1, for image "2" is number of pixels (2×P2)×number of pixels (2×P3), for image "3" is number of pixels P1×number of pixels P1, and for image "4" is number of pixels P4×number of pixels P4.

[0140] With regard to "control," when the number of monitored units is "2," two image groups are arranged vertically within the monitoring screen 31, and within each image group, the main image (image "2") is displayed in the center with sub-images (images "1," "3," and "4") arranged to the left, right, and above in a layout pattern, and it can be seen that the transfer rate of the synchronization signal is TR1. It can be seen that the display size is as follows: image "1" is P1 / 2 x P1 / 2 pixels, image "2" is P2 x P3 pixels, image "3" is P1 / 2 x P1 / 2 pixels, and image "4" is P4 / 2 x P4 / 2 pixels.

[0141] 13A, it can be seen that for "monitoring without images," when the number of monitored devices is "1," the transfer rate of the synchronization signal is set to 2 x TR1. Since there is no image, the columns for layout pattern and display size are blank.

[0142] Regarding "monitoring without images," it can be seen that when the number of monitoring devices is "2," the transfer rate of the synchronization signal is set to TR1.

[0143] 13(b), it can be seen that for "gazing," when the number of monitored devices is "1," the image (image "1") is displayed in a layout pattern aligned in the center of the monitoring screen 31, and the transfer rate of the synchronization signal is set to 4 x TR1. It can also be seen that the display size of image "1" is set to the number of pixels (4 x P2) x the number of pixels (4 x P3).

[0144] For "gazing," when the number of monitored devices is "2," two image groups are arranged vertically on the monitoring screen 31, and within each image group, an image (image "1") is displayed in a layout pattern arranged in the center, and it can be seen that the transfer rate of the synchronization signal is 2 x TR1. It can be seen that the display size of image "1" is the number of pixels (2 x P2) x the number of pixels (2 x P3).

[0145] In response to an instruction from an operator, the display control unit 56 shown in FIG. 11 may access the storage unit 54 to refer to task candidate information 54a and display a screen on the monitoring screen 31 of the display unit 57 that prompts the user to select one of the multiple task types indicated in the task candidate information 54a. Upon receiving an instruction from the operator to select a task type, the task information notification unit 52 accesses the storage unit 54 to refer to the correspondence table 54c and extracts information corresponding to the task type in response to the selection instruction (see FIGS. 12 and 13 ). The task information notification unit 52 accesses the storage unit 54 to acquire assigned mobile object information 54b. The task information notification unit 52 generates a task request that includes information identifying the management terminal 5, the task type, information corresponding to the task type, and the assigned mobile object information 54b, and transmits the generated task request to the server 4 via the communication unit 51 and the communication line 7.

[0146] When the communication unit 51 receives a communication volume instruction from the server 4 via the communication line 7, the communication volume instruction is supplied to the communication control unit 55. The communication control unit 55 may adjust the communication volume of the communication unit 51 in accordance with the communication volume instruction.

[0147] When the communication unit 51 receives a synchronization signal from the server 4 via the communication line 7, the synchronization signal is supplied to the display control unit 56. In response to this, the display control unit 56 can update the image on the monitoring screen 31 of the display unit 57 at a timing according to the synchronization signal.

[0148] When the communication unit 51 receives transmission information from the server 4 via the communication line 7, the transmission information is supplied to the display control unit 56. In response to this, the display control unit 56 can display an image corresponding to the image data included in the transmission information on the monitoring screen 31 of the display unit 57.

[0149] The management terminal 5 may have a hardware configuration as shown in Fig. 14. Fig. 14 is a diagram showing the hardware configuration of the management terminal 5.

[0150] The management terminal 5 has a communication interface (I / F) 5a, a control unit 5b, an input unit 5c, a display unit 5d, an audio output unit 5e, and a memory unit 5f. The communication interface 5a, the control unit 5b, the input unit 5c, the display unit 5d, the audio output unit 5e, and the memory unit 5f can be connected to each other via a bus so that they can communicate with each other.

[0151] The communication interface 5a is communicatively connected to the server 4 via the communication line 7. The communication interface 5a may include a receiving circuit that receives information from the server 4 and a transmitting circuit that transmits information to the server 4. The control unit 5b performs overall control of each unit of the management terminal 5. The control unit 5b may be a CPU. The input unit 5c accepts instructions from a user. The input unit 5c may include buttons, keys, a touch panel, a mouse, a touchpad, a voice input device, etc. The display unit 5d displays and outputs predetermined information to the user. The display unit 5d includes a display 30 such as an LCD. The display 30 includes a monitoring screen 31. The monitoring screen 31 is a display area on the display 30 for monitoring. The audio output unit 5e outputs predetermined information to the user by voice. The audio output unit 5e may be a speaker. The memory unit 5f is capable of storing information. The memory unit 5f may be a non-volatile storage medium such as a hard disk.

[0152] In the configuration shown in FIG. 11 , the communication unit 51 is implemented by the communication interface 5a. The display unit 57 is implemented by the display unit 5d. The storage unit 54 is implemented by the storage unit 5f. Each unit (task information notification unit 52, mobile object information notification unit 53, communication control unit 55, display control unit 56) excluding the communication unit 51, the display unit 57, and the storage unit 54 may be implemented as software within the control unit 5b. For example, the control unit 5b may be a system including a processor, a nonvolatile memory, and a volatile memory. The nonvolatile memory stores a program. The processor may read and start the program from the nonvolatile memory in response to a trigger such as power-on of the management terminal 5, and may load modules corresponding to each unit into the volatile memory either collectively at the time of compilation or sequentially as processing progresses. This allows the processor to operate according to the program. Alternatively, each unit may be implemented as hardware, as a circuit configured within the control unit 5b. Alternatively, some of the units may be implemented as software and the rest may be implemented as hardware.

[0153] Next, a management method executed by the management system 101 will be described with reference to Fig. 15. Fig. 15 is a sequence diagram showing the management method. Fig. 15 illustrates an example of processing between one mobile object 2, a server 4, and one management terminal 5, but the same applies to processing between other mobile objects 2, servers 4, and other management terminals 5.

[0154] In the management system 101, the management terminal 5 generates a task request in response to an instruction from an operator and transmits it to the server 4 (S51). The task request includes information for identifying the management terminal 5, a task type, information corresponding to the task type (see FIGS. 12 and 13), and assigned mobile object information 54b.

[0155] When the server 4 receives a task request from the management terminal 5 via the communication line 7 (S41), it determines the amount of communication between the management device 3 and the mobile object 2 according to the task type included in the task request (S1a). In S1a, steps S61 to S69 shown in Fig. 16 may be performed. Fig. 16 is a flowchart showing the communication amount determination process.

[0156] The server 4 extracts information for identifying the management terminal 5 and information on the task type from the task request, thereby obtaining information on the task type requested by the operator of the management terminal 5 (S61).

[0157] The server 4 determines whether the task type acquired in S61 is a task with an image (S62). If the task type is "monitoring without an image," the server 4 can determine that the task type is not a task with an image (No in S62). If the task type is any of "monitoring with an image," "gazing," and "operation," the server 4 can determine that the task type is a task with an image (Yes in S62).

[0158] If the task type is not a task with an image (No in S62), the server 4 ends the process.

[0159] If the task type is a task with an image (Yes in S62), the server 4 extracts information for identifying the management terminal 5 and the assigned mobile object information 54b from the task request. The server 4 extracts the identification information (ID) of the mobile object 2 from the assigned mobile object information 54b. As a result, the server 4 obtains the identification information (ID) of the mobile object 2 assigned to the operator of the management terminal 5 (S63).

[0160] The server 4 acquires information on the number of moving objects 2 whose images should be displayed on the monitoring screen 31 according to the identification information (ID) of the moving objects 2 acquired in S63 (S64). The server 4 may acquire information on the number of moving objects 2 whose images should be displayed by counting the number of pieces of identification information (ID) of the moving objects 2.

[0161] The server 4 extracts information corresponding to the task type from the task request. From the extracted information, the server 4 extracts information corresponding to the number of vehicles acquired in S64. As a result, the server 4 acquires display size information corresponding to the task type acquired in S61 and the number of vehicles acquired in S64 (S65).

[0162] The server 4 determines the resolution of the image of the moving object 2 to be displayed on the monitoring screen 31 of the management terminal 5 according to the display size obtained in S65, and generates resolution information including the determined resolution (S66).

[0163] The server 4 compares the resolution of the image most recently uploaded from the mobile object 2 with the resolution indicated in the resolution information.

[0164] If the resolution of the image uploaded from the mobile object 2 is greater than the resolution indicated in the resolution information (Yes in S67), the server 4 changes the resolution setting value of the image of the mobile object 2 to the resolution value indicated in the resolution information (S68).

[0165] If the resolution of the image uploaded from the mobile object 2 is equal to or lower than the resolution indicated by the resolution information (No in S67), the server 4 leaves the resolution setting value of the image of the mobile object 2 as it is.

[0166] The server 4 determines other parameters related to communication (for example, the transfer rate of the synchronization signal), and determines the communication volume including the resolution setting value and other parameters (S69).

[0167] Returning to FIG. 15, the server 4 generates a communication volume instruction including a request to perform communication at the communication volume determined in S1a, and transmits it to each of the mobile unit 2 and the management terminal 5 (S2a).

[0168] When the mobile unit 2 receives a communication volume instruction from the server 4 via the communication line 6 (S3), it executes control in accordance with the communication volume instruction (S20). In S20, the processes of S21 to S24 are performed. In parallel with this, the management terminal 5 receives a communication volume instruction from the server 4 via the communication line 7 (S52). After S2a and S52, the server 4 and the management terminal 5 cooperate to remotely manage the mobile unit 2 (S10a). In S10a, the processes of S11a to S14a in the server 4 and the process of S15a in the management terminal 5 are performed in parallel.

[0169] For example, when remote management of the mobile unit 2 (S10a) is started, the server 4 generates a synchronization signal and transmits it to the mobile unit 2 and the management terminal 5 at the transfer rate determined in S1a (S11a). At the same time, the management terminal 5 starts up the monitoring screen 31 on the display 30 and starts display control of the monitoring screen 31 (S15a). The monitoring screen 31 is a display area on the display 30.

[0170] When the mobile object 2 receives a synchronization signal from the server 4 via the communication line 6 (S21), it captures an image of the surrounding environment with the sensor 21 and acquires an image with a resolution according to the communication volume instruction. The mobile object 2 generates transmission information including image data according to the acquired image and transmits it to the server 4 (S22). In parallel with this, the management terminal 5 receives a synchronization signal from the server 4 via the communication line 7.

[0171] When the server 4 receives transmission information from the mobile unit 2 via the communication line 6, it transfers the transmission information to the management terminal 5 via the communication line 7 (S12a). The management terminal 5 displays an image corresponding to the image data included in the transmission information on the monitoring screen 31 (S15a). At this time, the image may be displayed on the monitoring screen 31 at a resolution corresponding to the communication volume instruction received in S52. The management terminal 5 may update and display the image on the monitoring screen 31 at a timing corresponding to the synchronization signal.

[0172] When a predetermined period has elapsed since S11a, the server 4 generates a synchronization signal and transmits it to the mobile unit 2 and the management terminal 5 at the transfer rate determined in S1a (S13a).

[0173] When the mobile object 2 receives a synchronization signal from the management device 3 via the communication line 6 (S23), it captures an image of the surrounding environment with the sensor 21 and acquires an image with a resolution according to the communication volume instruction. The mobile object 2 generates transmission information including image data according to the acquired image and transmits it to the management device 3 (S24). In parallel with this, the management terminal 5 receives a synchronization signal from the server 4 via the communication line 7.

[0174] When the server 4 receives transmission information from the mobile unit 2 via the communication line 6, it transfers the transmission information to the management terminal 5 via the communication line 7 (S14a). The management terminal 5 displays an image corresponding to the image data included in the transmission information on the monitoring screen 31 (S15a). At this time, the image may be displayed on the monitoring screen 31 at a resolution corresponding to the communication volume instruction received in S52. The management terminal 5 may update and display the image on the monitoring screen 31 at a timing corresponding to the synchronization signal.

[0175] Although not shown, after S24, the mobile unit 2 may repeat the same processes as S21 to S24. After S14a, the management terminal 5 may continue with S15a while the server 4 may repeat the same processes as S11a to S14a.

[0176] Furthermore, each time a new task request is sent from the management terminal 5 (S51) and received by the server 4 (S41), the management system 101 may perform the processes from S1a onwards.

[0177] As described above, in the second embodiment, the management system 101 determines the communication volume between the server 4 and the mobile body 2 according to the task type of remote management of the mobile body 2, and transmits a communication volume instruction including a request to communicate at the determined communication volume to the mobile body 2. This makes it possible to suppress the communication volume of information transmitted from the mobile body 2 to the server 4 via the communication line 6 to an appropriate communication volume according to the task type of management of the mobile body 2. Furthermore, the server 4 can suppress the communication volume of information transmitted from the server 4 to the mobile body 2 via the communication line 6 to an appropriate communication volume according to the task type of management of the mobile body 2. As a result, it is possible to reduce the traffic on the communication line 6 between the server 4 and the mobile body 2. In other words, it is possible to optimize the communication volume between the server 4 and the mobile body 2, and suppress communication delays between the server 4 and the mobile body 2.

[0178] In addition, in the management terminal 5 of the management system 101, the operator may manually select the mobile object 2 to be monitored from among the multiple mobile objects 2_1 to 2_n. For example, immediately before S51 of FIG. 15 , the management terminal 5 may display a screen on the monitoring screen 31 prompting the operator to select the mobile object 2 to be monitored from among the multiple mobile objects 2_1 to 2_n. When the management terminal 5 receives the selection of the mobile object 2 to be monitored from the operator, it generates assigned mobile object information 54b for the received mobile object 2, including identification information of the mobile object 2 to be remotely managed by the management terminal 5, and stores the information in the storage unit 54. In S51 of FIG. 15 , the management terminal 5 may, in response to an instruction from the operator, generate a task request for each mobile object 2 included in the assigned mobile object information 54b and transmit it to the server 4. This allows the operator to manually select the mobile object 2 to be monitored and generate a task request.

[0179] Alternatively, the management terminal 5 of the management system 101 may automatically select a mobile object 2 to be monitored from among the multiple mobile objects 2_1 to 2_n under control of the management system 101. For example, immediately before S51 in FIG. 15 , the management terminal 5, under control of the management system 101, determines a task type for monitoring to be performed by the management terminal 5 and identifies a mobile object 2 corresponding to the determined task type from among the multiple mobile objects 2_1 to 2_n. At this time, the management terminal 5 may display the identified mobile object 2 as a monitoring target on the monitoring screen 31. For the identified mobile object 2, the management terminal 5 generates assigned mobile object information 54b including identification information of the mobile object 2 for which the management terminal 5 is responsible for remote management, and stores the information in the storage unit 54. In S51 in FIG. 15 , the management terminal 5 may, in response to an instruction from an operator, generate a task request for each mobile object 2 included in the assigned mobile object information 54b and transmit the task request to the server 4. As a result, the mobile object 2 to be monitored can be determined and a task request can be generated under control of the management system 101 in the management terminal 5.

[0180] Alternatively, the server 4 of the management system 101 may automatically select the mobile object 2 to be monitored by the management terminal 5 from among the multiple mobile objects 2_1 to 2_n under the control of the management system 101.

[0181] 15 , the server 4, under the control of the management system 101, acquires information on the driving environment conditions from each of the plurality of moving bodies 2_1 to 2_n. The server 4 may identify a moving body 2 that is in relatively high need of monitoring among the plurality of moving bodies 2_1 to 2_n, according to the information on the driving environment conditions of each moving body 2. The server 4 may identify a moving body 2 with a high volume of traffic or a high number of people in the vicinity as a moving body 2 that is in relatively high need of monitoring, according to the information on the driving environment conditions of each moving body 2.

[0182] Alternatively, the server 4 may manage the monitoring history of each of the multiple moving objects 2_1 to 2_n under the control of the management system 101. The server 4 may identify a moving object 2 that is in relatively high need of monitoring among the multiple moving objects 2_1 to 2_n, according to the monitoring history of each moving object 2. The server 4 may identify a moving object 2 with a relatively high rate of remote "control" intervention as a moving object 2 that is in relatively high need of monitoring, according to the monitoring history of each moving object 2.

[0183] The server 4 may notify the management terminal 5 of a moving object 2 identified as having a relatively high need for monitoring as a moving object 2 to be monitored. The management terminal 5 may display the notified moving object 2 as a monitoring object on the monitoring screen 31. When the management terminal 5 is notified of the mobile object 2 to be monitored, it generates assigned mobile object information 54b for the notified mobile object 2, including identification information of the mobile object 2 for which the management terminal 5 is responsible for remote management, and stores the information in the storage unit 54. In S51 of FIG. 15 , the management terminal 5 may, in response to an instruction from an operator, generate a task request for each moving object 2 included in the assigned mobile object information 54b and transmit it to the server 4. This makes it possible to determine the mobile object 2 to be monitored and generate a task request in accordance with control by the management system 101 in the server 4.

[0184] Furthermore, in the management terminal 5 of the management system 101, an operator may manually select a mobile object 2 for which monitoring should be terminated from among one or more mobile objects 2 being monitored. For example, in the management system 101, the mobile object 2 executes control in response to a communication volume instruction (S20 of FIG. 15 ) in the same manner as in the second embodiment, and the server 4 and the management terminal 5 cooperate to execute remote management of the mobile object 2 (S10a of FIG. 15 ) in the same manner as in the second embodiment. The management terminal 5 may display a screen on the monitoring screen 31 prompting the operator to select a mobile object 2 for which monitoring should be terminated from among one or more mobile objects 2 being monitored. Upon receiving the selection of a mobile object 2 for which monitoring should be terminated from the operator, the management terminal 5 may delete the identification information of the mobile object 2 from the assigned mobile object information 54b, and may generate and transmit to the server 4 a termination request including information identifying the management terminal 5 and information identifying the mobile object 2 for which monitoring should be terminated. Upon receiving the termination request, the server 4 cooperates with the management terminal 5 to terminate the remote management of the mobile object 2 (S10a of FIG. 15 ). At the same time, the server 4 transmits a termination request to the corresponding mobile object 2 in accordance with the information included in the termination request that identifies the mobile object 2 whose monitoring should be terminated. Upon receiving the termination request, the mobile object 2 terminates the control according to the communication volume instruction (S20 in FIG. 15 ) in accordance with the termination request. This allows the mobile object 2 whose monitoring should be terminated to be determined in accordance with the operator's manual selection, and monitoring to be terminated.

[0185] Alternatively, the management terminal 5 of the management system 101 may automatically select a mobile object 2 for which monitoring should be terminated from among one or more mobile objects 2 being monitored, under the control of the management system 101. For example, in the management system 101, the mobile object 2 executes control in response to a communication volume instruction (S20 in FIG. 15 ) in the same manner as in the second embodiment, and the server 4 and the management terminal 5 cooperate to execute remote management of the mobile object 2 (S10a in FIG. 15 ) in the same manner as in the second embodiment. Under the control of the management system 101, the management terminal 5 determines a task type to be completed from among the task types being performed by the management terminal 5, and identifies a mobile object 2 corresponding to the determined task type from among the multiple mobile objects 2_1 to 2_n. At this time, the management terminal 5 may display the identified mobile object 2 on the monitoring screen 31 as a target for which monitoring should be terminated. The management terminal 5 may delete the identification information of the identified mobile object 2 from the assigned mobile object information 54b, and may generate and transmit to the server 4 a termination request including information identifying the management terminal 5 and information identifying the mobile object 2 whose monitoring should be terminated. Upon receiving the termination request, the server 4 cooperates with the management terminal 5 to terminate the remote management of the mobile object 2 (S10a in FIG. 15 ). At the same time, the server 4 transmits a termination request to the corresponding mobile object 2 in accordance with the information identifying the mobile object 2 whose monitoring should be terminated, which is included in the termination request. Upon receiving the termination request, the mobile object 2 terminates control in accordance with the communication volume instruction (S20 in FIG. 15 ) in accordance with the termination request. As a result, the mobile object 2 whose monitoring should be terminated can be determined and monitoring can be terminated in accordance with control by the management system 101 in the management terminal 5.

[0186] Alternatively, in the server 4 of the management system 101, a mobile object 2 for which monitoring should be terminated by the management terminal 5 may be automatically selected from one or more mobile objects 2 being monitored under the control of the management system 101.

[0187] For example, in the management system 101, the mobile body 2 executes control in accordance with the communication volume instruction (S20 in FIG. 15) in the same manner as in the second embodiment, and the server 4 and the management terminal 5 cooperate to execute remote management of the mobile body 2 (S10a in FIG. 15) in the same manner as in the second embodiment.

[0188] For example, the server 4 acquires information on the driving environment conditions from each of the plurality of moving bodies 2_1 to 2_n under the control of the management system 101. The server 4 may identify a moving body 2 that has a relatively low need for monitoring among the plurality of moving bodies 2_1 to 2_n, according to the information on the driving environment conditions of each moving body 2. The server 4 may identify a moving body 2 with a low traffic volume or a low number of people around as a moving body 2 that has a relatively low need for monitoring, according to the information on the driving environment conditions of each moving body 2.

[0189] Alternatively, the server 4 may manage the monitoring history of each of the multiple moving objects 2_1 to 2_n under the control of the management system 101. The server 4 may identify a moving object 2 that is relatively less in need of monitoring among the multiple moving objects 2_1 to 2_n, according to the monitoring history of each moving object 2. The server 4 may identify a moving object 2 that has a relatively low rate of intervention of remote "control" and a moving object 2 that is relatively less in need of monitoring, according to the monitoring history of each moving object 2.

[0190] The server 4 may notify the management terminal 5 of a mobile object 2 identified as having a relatively low need for monitoring as a mobile object 2 to be monitored. The management terminal 5 may display the notified mobile object 2 on the monitoring screen 31 as a monitoring termination target. The management terminal 5 may delete the identification information of the notified mobile object 2 from the assigned mobile object information 54b, and may generate and transmit to the server 4 a termination request including information identifying the management terminal 5 and information identifying the mobile object 2 whose monitoring should be terminated. Upon receiving the termination request, the server 4 cooperates with the management terminal 5 to terminate the remote management of the mobile object 2 (S10a in FIG. 15 ). At the same time, the server 4 transmits a termination request to the corresponding mobile object 2 in accordance with the information identifying the mobile object 2 whose monitoring should be terminated, which is included in the termination request. Upon receiving the termination request, the mobile object 2 terminates control according to the communication volume instruction (S20 in FIG. 15 ) in response to the termination request. As a result, the mobile object 2 for which monitoring should be terminated can be determined according to the control by the management system 101 in the management terminal 5, and the monitoring can be terminated.

[0191] Alternatively, when the server 4 of the management system 101 completes a task or is no longer subject to the task, the server 4 may generate a communication volume instruction including an instruction to change the content of the transmission information to be transmitted from the mobile body 2 to the server 4, depending on at least one of the task type, the traveling area of ​​the mobile body 2, and the content of the operation service provided by the mobile body 2, included in the task request received in S41, and send the instruction to the mobile body 2 and / or the management terminal 5.

[0192] For example, if the task type included in the task request received in S41 is "control," the server 4 may generate and transmit to the mobile body 2 a communication volume instruction that further includes a request to send transmission information including image information, mobile body status information, environmental sensor information, and location information.

[0193] Alternatively, if the task type included in the task request received in S41 is "gazing," the server 4 may generate and send to the mobile body 2 a communication volume instruction that further includes a request to send transmission information including image information, mobile body status information, and location information.

[0194] Alternatively, if the task type included in the task request received in S41 is "monitoring without images" and the area in which the mobile object 2 is traveling is an area with a good communication environment, the server 4 may generate a communication volume instruction that further includes a request to transmit transmission information including mobile object status information, location information, and travel-related information, and transmit this to the mobile object 2. The travel-related information includes information on factors that affect travel-related ability (e.g., obstacle information, construction information, event information, etc.), and can be used as reference information when other mobile objects 2 are traveling.

[0195] Alternatively, if the task type included in the task request received in S41 is "monitoring without images" and the area in which the mobile body 2 is traveling is an area with a poor communication environment, the server 4 may generate a communication volume instruction that further includes a request to send transmission information including mobile body status information and location information, and send it to the mobile body 2.

[0196] Alternatively, if the task type included in the task request received in S41 indicates a transition from "monitoring with image" to "monitoring without image," the server 4 may generate and transmit to the management terminal 5 a communication amount instruction further including a request for display control when an image is hidden. The server 4 may also generate and transmit to the management terminal 5 a communication amount instruction further including a request for display control to prevent the location of images of other moving objects from moving when an image is hidden. The server 4 may also generate and transmit to the management terminal 5 a communication amount instruction further including a request for display control to display a message "Delete in X seconds" before hiding the image when an image is automatically hidden. The server 4 may also generate and transmit to the management terminal 5 a communication amount instruction further including a request for display control to automatically detect that it is okay to hide the image, display a message to that effect, and then display a screen prompting manual operation to hide the image when an image is manually hidden.

[0197] Alternatively, as a first modified example of the second embodiment, in a management method executed by the management system 101, tasks may be predicted and the communication volume may be determined according to the task type of the predicted task, as shown in Fig. 17. Fig. 17 is a sequence diagram showing a management method according to the first modified example of the second embodiment. Although Fig. 17 illustrates processing between one mobile object 2, a server 4, and one management terminal 5, the same applies to processing between other mobile objects 2, servers 4, and other management terminals 5.

[0198] In the management system 101, the server 4 predicts a task (S91). The server 4 may accumulate a past remote task history in advance and predict a task based on the past remote task history. The server 4 may acquire travel information from the mobile object 2 in advance and predict a task based on the travel information. The travel information may include at least one of information about the position of the mobile object 2, map information, and information about the surrounding environment of the mobile object 2. The server 4 may predict a task based on the past remote task history and the travel information.

[0199] When a task is predicted, the server 4 identifies the task type of the predicted task. The server 4 determines the communication volume between the management device 3 and the mobile object 2 according to the task type of the predicted task (S1b). In S1b, the same processes as S61 to S69 shown in FIG. 16 may be performed.

[0200] The server 4 generates a communication volume instruction including a request to perform communication at the communication volume determined in S1b, and transmits the instruction to each of the mobile unit 2 and the management terminal 5 (S2b).

[0201] When the mobile unit 2 receives the communication volume instruction from the server 4 via the communication line 6 (S3b), it prepares for control in accordance with the communication volume instruction (S20b). In S20b, the processing of S22b is performed. In parallel with this, the management terminal 5 receives the communication volume instruction from the server 4 via the communication line 7 (S52b). After S2b and S52b, the server 4 and the management terminal 5 cooperate to prepare for remote management of the mobile unit 2 (S10b). In S10b, the processing of S12b to S13b in the server 4 and the processing of S15b in the management terminal 5 are performed in parallel.

[0202] For example, in response to the communication volume instruction received in S3b, the mobile object 2 captures an image of the surrounding environment with the sensor 21 and acquires an image with a resolution according to the communication volume instruction. The mobile object 2 generates transmission information including image data according to the acquired image and transmits it to the server 4 (S22b).

[0203] When the server 4 receives the transmission information from the mobile unit 2 via the communication line 6, the server 4 stores the transmission information (S12b). In response to storing the transmission information, the server 4 generates a preparation instruction to instruct preparation for monitoring and transmits the preparation instruction to the management terminal 5 (S13b).

[0204] When the management terminal 5 receives the preparation instruction from the server 4 via the communication line 6 (S15b), it starts up the monitoring screen 31 in response to the preparation instruction, and makes it possible to start display control of the monitoring screen 31.

[0205] In response to an instruction from an operator, the management terminal 5 generates a task request and transmits it to the server 4 (S51). The task request includes information for identifying the management terminal 5, a task type, information corresponding to the task type (see FIGS. 12 and 13), and assigned mobile object information 54b.

[0206] When the server 4 receives a task request from the management terminal 5 via the communication line 7 (S41), the server 4 and the management terminal 5 cooperate to remotely manage the mobile object 2 (S10c). In S10c, the processes of S12c to S14a on the server 4 and the process of S15c on the management terminal 5 are carried out in parallel. In response, the mobile object 2 executes control according to the communication volume instruction (S20c). In S20c, the processes of S23 to S24 are carried out.

[0207] For example, when remote management of the mobile unit 2 (S10c) is initiated, the server 4 transfers the transmission information it holds to the management terminal 5 via the communication line 7 (S12c). The management terminal 5 is ready to start display control of the monitoring screen 31, and when it receives the transmission information from the server 4, it immediately displays an image corresponding to the image data included in the transmission information on the monitoring screen 31 (S15c). The image can be displayed on the monitoring screen 31 at a resolution corresponding to the communication volume instruction received in S52b.

[0208] When a predetermined period has elapsed since S12c, the server 4 generates a synchronization signal and transmits it to the mobile unit 2 and the management terminal 5 at the transfer rate determined in S1b (S13a).

[0209] After this, the mobile object 2 may repeat the same processes as S23 to S24 in Fig. 15. While S15c continues in the management terminal 5, the server 4 may repeat the same processes as S13a to S14a in Fig. 15.

[0210] In this way, in the management system 101, tasks are predicted, the communication volume is determined according to the task type of the predicted task, and data transmission from the vehicle is started in advance according to the communication volume, so that when a task is selected on the management terminal 5 and a task request is sent from the management terminal 5 to the server 4, remote management (S10c) can be started immediately and an image of the mobile object 2 can be displayed on the monitoring screen of the management terminal 5. This makes it possible to make remote management of the mobile object 2 more efficient.

[0211] Alternatively, as a second modified example of the second embodiment, in the management method executed by the management system 101, the processing from S1d onward may be started in response to a special gaze request from the mobile object 2 as a trigger, as shown in Fig. 18. Fig. 18 is a sequence diagram showing the management method according to the second modified example of the second embodiment. Fig. 18 illustrates an example of processing between one mobile object 2, a server 4, and one management terminal 5, but the same applies to processing between other mobile objects 2, a server 4, and other management terminals 5.

[0212] In the management system 101, the mobile body 2 executes control in accordance with the communication volume instruction (S20 in FIG. 15) in the same manner as in the second embodiment, and the server 4 and the management terminal 5 cooperate to execute remote management of the mobile body 2 (S10a in FIG. 15) in the same manner as in the second embodiment.

[0213] For example, if the mobile object 2_1 has four sensors 21 and the task type for managing the mobile object 2 is "monitoring with images," the management terminal 3 may display four images IM4 to IM7 as shown in Fig. 19(a) on the monitoring screen 31. Fig. 19(a) illustrates a monitoring screen 31 in which sub-images IM4 and IM6 are arranged on the left and right of the main image IM5, and the sub-image IM7 is arranged above or below the main image IM5. The management terminal 3 may display the main image IM5 at a resolution of 4 pixels by 4 pixels, and the sub-images IM4, IM6, and IM7 at a resolution of 2 pixels by 2 pixels.

[0214] In response to detecting a monitoring target to be monitored in its surroundings, the mobile body 2 suspends the control according to the communication volume instruction (S20 in FIG. 15 ), generates a special monitoring request, and transmits it to the server 4 (S101). The special monitoring request includes a request to monitor the monitoring target to be monitored in an enlarged display image. The monitoring target to be monitored may include traffic lights, signs, traffic control flags, etc. present in the surroundings of the mobile body 2. The monitoring target to be monitored may also include moving objects such as people and cars present in the surroundings of the mobile body 2. The magnification of the enlarged display image may be a magnification that enlarges the image to a range that does not create blind spots.

[0215] When the server 4 receives a special gaze request from the mobile unit 2 via the communication line 6 (S111), it suspends the remote management of the mobile unit 2 (S10a in FIG. 15 ) and changes the communication volume between the management device 3 and the mobile unit 2 in response to the special gaze request (S1c). The server 4 determines the resolution of the enlarged display image of the monitoring target to be monitored, and changes the resolution of the original image to lower it in response to adding the enlarged display image of the determined resolution. The server 4 may then correct the increase in total communication volume before and after the change so that it is within an acceptable range. The server 4 generates a communication volume instruction including a request to add an enlarged display image of the determined resolution and a request to change the resolution of the original image, and transmits the instruction to the mobile unit 2 and the management terminal 5, respectively (S2d).

[0216] For example, when the moving object 2_1 generates a special attention request to the server 4, indicating that attention should be paid to a monitoring target corresponding to region RG in image IM5 shown in FIG. 19( a), the server 4 may determine to add an enlarged display image IM8 as shown in FIG. 19( b) as an enlarged display image of region RG. The display size of region RG may be 1 pixel by 2 pixels. The server 4 may determine the display size of enlarged display image IM8 to be 2 pixels by 4 pixels, which is larger than the display size of region RG. In response to this, the server 4 may reduce the display size of main image IM5 from 4 pixels by 4 pixels to 2 pixels by 4 pixels, and reduce the display sizes of sub-images IM4, IM6, and IM7 from 2 pixels by 2 pixels to 1 pixel by 2 pixels, as shown in FIGS. 19( a) and 19(b). As a result, the total resolution before the change is 4 pixels x 4 pixels + 2 pixels x 2 pixels x 3 = 28 pixels, and the total resolution after the change is 2 pixels x 4 pixels + 2 pixels x 4 pixels + 1 pixel x 2 pixels x 3 = 22 pixels. The server 4 can set the increase in resolution before and after the change to 22 pixels - 28 pixels = -6 pixels, which is within the allowable range. The server 4 may generate and transmit to the mobile object 2 and the management terminal 5, respectively, communication volume instructions that include a request to add the enlarged display image IM8 and a request to lower the resolution of the original images IM5 to IM7.

[0217] When the mobile unit 2 receives the communication volume instruction from the server 4 via the communication line 6 (S3d), it resumes control in accordance with the communication volume instruction (S20d). In S20d, the processes of S21d to S24d are performed. In parallel with this, the management terminal 5 receives the communication volume instruction from the server 4 via the communication line 7 (S52d). After S2a and S52d, the server 4 and the management terminal 5 cooperate to resume remote management of the mobile unit 2 (S10d). In S10d, the processes of S11d to S14d in the server 4 and the process of S15d in the management terminal 5 are performed in parallel.

[0218] For example, when the remote management of the mobile unit 2 (S10d) is resumed, the server 4 generates a synchronization signal and transmits it to the mobile unit 2 and the management terminal 5 at the transfer rate changed in S1d (S11d). At the same time, the management terminal 5 resumes display control of the monitoring screen 31 (S15d).

[0219] When the mobile object 2 receives a synchronization signal from the server 4 via the communication line 6 (S21d), it captures an image of the surrounding environment with the sensor 21 and acquires an image with a resolution according to the communication volume instruction and an enlarged display image. The mobile object 2 generates transmission information including image data according to the acquired image and enlarged display image data according to the enlarged display image, and transmits this to the server 4 (S22d). In parallel with this, the management terminal 5 receives a synchronization signal from the server 4 via the communication line 7.

[0220] When the server 4 receives the transmission information from the mobile unit 2 via the communication line 6, it transfers the transmission information to the management terminal 5 via the communication line 7 (S12d). The management terminal 5 displays on the monitoring screen 31 an image corresponding to the image data included in the transmission information and an enlarged display image corresponding to the enlarged display image data (S15d). At this time, the image and the enlarged display image may each be displayed on the monitoring screen 31 at a resolution corresponding to the communication volume instruction received in S52d. The management terminal 5 may update and display the image and the enlarged display image on the monitoring screen 31 at a timing corresponding to the synchronization signal.

[0221] For example, the management terminal 3 may display four images IM4 to IM7 and an enlarged display image IM8 on the monitoring screen 31 as shown in FIG. 19( b). FIG. 19( b) illustrates a monitoring screen 31 in which sub-images IM4 and IM6 are arranged to the left and right of a main image IM5, sub-image IM7 is arranged above or below the main image IM5, a frame RG indicating the enlarged portion is superimposed on the main image IM5, and enlarged display image IM8 is displayed around the four images IM4 to IM7 in a form associated with the frame RG. The management terminal 3 may display the main image IM5 at a resolution of 2 pixels by 4 pixels, the sub-images IM4, IM6, and IM7 at a resolution of 1 pixel by 2 pixels, and the enlarged display image IM8 at a resolution of 2 pixels by 4 pixels.

[0222] When a predetermined period has elapsed since S11d, the server 4 generates a synchronization signal and transmits it to the mobile unit 2 and the management terminal 5 at the transfer rate changed in S1d (S13d).

[0223] When the mobile object 2 receives a synchronization signal from the management device 3 via the communication line 6 (S23d), it captures an image of the surrounding environment with the sensor 21 and acquires an image with a resolution corresponding to the communication volume instruction and an enlarged display image. The mobile object 2 generates transmission information including image data corresponding to the acquired image and enlarged display image data corresponding to the enlarged display image, and transmits this to the server 4 (S24d). In parallel with this, the management terminal 5 receives a synchronization signal from the server 4 via the communication line 7.

[0224] When the server 4 receives the transmission information from the mobile unit 2 via the communication line 6, it transfers the transmission information to the management terminal 5 via the communication line 7 (S14d). The management terminal 5 displays on the monitoring screen 31 an image corresponding to the image data included in the transmission information and an enlarged display image corresponding to the enlarged display image data (S15a). At this time, the image and the enlarged display image may each be displayed on the monitoring screen 31 at a resolution corresponding to the communication volume instruction received in S52d. The management terminal 5 may update and display the image and the enlarged display image on the monitoring screen 31 at a timing corresponding to the synchronization signal.

[0225] Although not shown, after S24d, the same processes as S21d to S24d may be repeated in the mobile unit 2. After S14d, the same processes as S11d to S14d may be repeated in the server 4 while S15d continues in the management terminal 5.

[0226] In response to detecting that it is no longer necessary to watch the monitoring target, the mobile object 2 generates a cancellation request and transmits it to the server 4 (S102). The cancellation request includes a request to cancel the monitoring in response to the special watching request.

[0227] When the server 4 receives the cancellation request from the mobile body 2 via the communication line 6 (S112), the processes of S1a, S2a, S3, and S52 shown in Figure 15 are performed again in response to the cancellation request, and control according to the communication volume instruction (S20 in Figure 15) and remote management of the mobile body 2 (S10a in Figure 15) are respectively executed again.

[0228] For example, as shown in Fig. 19(c), the management terminal 3 may stop displaying the enlarged image IM8 on the monitoring screen 31 and display the four images IM4 to IM7 at their original resolution. Fig. 19(c) illustrates a monitoring screen 31 in which sub-images IM4 and IM6 are arranged on the left and right of the main image IM5, and sub-image IM7 is arranged above or below the main image IM5. The management terminal 3 may display the main image IM5 at a resolution of 4 pixels by 4 pixels, and the sub-images IM4, IM6, and IM7 at a resolution of 2 pixels by 2 pixels.

[0229] In this way, in the management system 101, the communication volume between the server 4 and the mobile body 2 is changed in response to a special attention request from the mobile body 2, and a communication volume instruction including a request to communicate at the changed communication volume is sent to the mobile body 2. This allows the communication volume of information transmitted from the mobile body 2 to the server 4 via the communication line 6 to be suppressed to an appropriate communication volume in response to the special attention request. In addition, the server 4 can suppress the communication volume of information transmitted from the server 4 to the mobile body 2 via the communication line 6 to an appropriate communication volume in response to the special attention request.

[0230] Alternatively, as a third modified example of the second embodiment, in a management method executed by the management system 101, the processing from S1d onwards may be started in response to an expansion request from the management terminal 5 as a trigger, as shown in Fig. 20. Fig. 20 is a sequence diagram showing a management method according to a second modified example of the second embodiment. Fig. 20 illustrates an example of processing between one mobile object 2, a server 4 and one management terminal 5, but the same applies to processing between other mobile objects 2, servers 4 and other management terminals 5.

[0231] In the management system 101, the mobile body 2 executes control in accordance with the communication volume instruction (S20 in FIG. 15) in the same manner as in the second embodiment, and the server 4 and the management terminal 5 cooperate to execute remote management of the mobile body 2 (S10a in FIG. 15) in the same manner as in the second embodiment.

[0232] For example, if the mobile object 2_1 has four sensors 21 and the task type for managing the mobile object 2 is "monitoring with images," the management terminal 3 may display four images IM4 to IM7 as shown in Fig. 19(a) on the monitoring screen 31. Fig. 19(a) illustrates a monitoring screen 31 in which sub-images IM4 and IM6 are arranged on the left and right of the main image IM5, and the sub-image IM7 is arranged above or below the main image IM5. The management terminal 3 may display the main image IM5 at a resolution of 4 pixels by 4 pixels, and the sub-images IM4, IM6, and IM7 at a resolution of 2 pixels by 2 pixels.

[0233] In response to an enlargement instruction from the operator, the management terminal 5 generates an enlargement request and transmits it to the server 4 (S121). The enlargement instruction includes an operation by the operator to instruct enlargement of a part of the image. The enlargement request includes a request to enlarge a part of the image displayed on the monitoring screen 31.

[0234] When the server 4 receives the enlargement request from the management terminal 5 via the communication line 7 (S131), it suspends the remote management of the mobile object 2 (S10a in FIG. 15 ) and changes the communication volume between the management device 3 and the mobile object 2 in response to the enlargement request (S1d). The server 4 determines the resolution of the enlarged display image and, in response to adding the enlarged display image of the determined resolution, lowers the resolution of the original image. As a result, the server 4 may correct the increase in total communication volume before and after the change so that it is within an acceptable range. The server 4 generates a communication volume instruction including a request to add an enlarged display image of the determined resolution and a request to change the resolution of the original image, and transmits the instruction to the mobile object 2 and the management terminal 5, respectively (S2d).

[0235] For example, when the management terminal 3 generates an enlargement request in response to an operator's enlargement instruction for region RG in image IM5 shown in FIG. 19( a) and transmits it to the server 4, the server 4 may determine to add an enlarged display image IM8 as shown in FIG. 19( b) as an enlarged display image of region RG. If the monitoring screen 31 is a touch panel, the enlargement instruction may be a touch operation on region RG on the monitoring screen 31. The display size of region RG may be 1 pixel x 2 pixels. The server 4 may determine the display size of enlarged display image IM8 to be 2 pixels x 4 pixels, which is larger than the display size of region RG. In response to this, the server 4 may reduce the display size of main image IM5 from 4 pixels x 4 pixels to 2 pixels x 4 pixels, and reduce the display sizes of sub-images IM4, IM6, and IM7 from 2 pixels x 2 pixels to 1 pixel x 2 pixels, as shown in FIGS. 19( a) and 19(b). As a result, the total resolution before the change is 4 pixels x 4 pixels + 2 pixels x 2 pixels x 3 = 28 pixels, and the total resolution after the change is 2 pixels x 4 pixels + 2 pixels x 4 pixels + 1 pixel x 2 pixels x 3 = 22 pixels. The server 4 can set the increase in resolution before and after the change to 22 pixels - 28 pixels = -6 pixels, which is within the allowable range. The server 4 may generate and transmit to the mobile object 2 and the management terminal 5, respectively, communication volume instructions that include a request to add the enlarged display image IM8 and a request to lower the resolution of the original images IM5 to IM7.

[0236] When the mobile unit 2 receives the communication volume instruction from the server 4 via the communication line 6 (S3d), it resumes control in accordance with the communication volume instruction (S20d). In S20d, the processes of S21d to S24d are performed. In parallel with this, the management terminal 5 receives the communication volume instruction from the server 4 via the communication line 7 (S52d). After S2a and S52d, the server 4 and the management terminal 5 cooperate to resume remote management of the mobile unit 2 (S10d). In S10d, the processes of S11d to S14d in the server 4 and the process of S15d in the management terminal 5 are performed in parallel.

[0237] For example, the management terminal 3 may display four images IM4 to IM7 and an enlarged display image IM8 on the monitoring screen 31 as shown in FIG. 19( b). FIG. 19( b) illustrates a monitoring screen 31 in which sub-images IM4 and IM6 are arranged to the left and right of a main image IM5, sub-image IM7 is arranged above or below the main image IM5, a frame RG indicating the enlarged portion is superimposed on the main image IM5, and enlarged display image IM8 is displayed around the four images IM4 to IM7 in a form associated with the frame RG. The management terminal 3 may display the main image IM5 at a resolution of 2 pixels by 4 pixels, the sub-images IM4, IM6, and IM7 at a resolution of 1 pixel by 2 pixels, and the enlarged display image IM8 at a resolution of 2 pixels by 4 pixels.

[0238] In response to the cancellation instruction from the operator, the management terminal 5 generates a cancellation request and transmits it to the server 4 (S122). The cancellation instruction includes an operation by the operator to cancel the enlargement of a portion of the image. The cancellation request includes a request to cancel the enlarged display of a portion of the image on the monitoring screen 31.

[0239] When the server 4 receives the cancellation request from the management terminal 5 via the communication line 6 (S132), the processes of S1a, S2a, S3, and S52 shown in Figure 15 are performed again in response to the cancellation request, and control according to the communication volume instruction (S20 in Figure 15) and remote management of the mobile body 2 (S10a in Figure 15) are respectively executed again.

[0240] For example, when the management terminal 3 generates a cancellation request in response to an operator's cancellation instruction for an enlarged image and transmits it to the server 4, the server 4 may decide to cancel the enlarged image IM8 as shown in FIG. 19( b). If the monitoring screen 31 is a touch panel, the cancellation instruction may be a touch operation on the enlarged image IM8 on the monitoring screen 31. In response, the management terminal 3 may stop displaying the enlarged image IM8 on the monitoring screen 31 and display the four images IM4 to IM7 at their original resolution, as shown in FIG. 19( c). FIG. 19( c) illustrates a monitoring screen 31 in which sub-images IM4 and IM6 are arranged to the left and right of the main image IM5, and sub-image IM7 is arranged above or below the main image IM5. The management terminal 3 may display the main image IM5 at a resolution of 4 pixels by 4 pixels, and the sub-images IM4, IM6, and IM7 at a resolution of 2 pixels by 2 pixels.

[0241] In this way, in the management system 101, the communication volume between the server 4 and the mobile body 2 is changed in response to an expansion request from the management terminal 5, and a communication volume instruction including a request to communicate at the changed communication volume is sent to the mobile body 2. This makes it possible to suppress the communication volume of information transmitted from the mobile body 2 to the server 4 via the communication line 6 to an appropriate communication volume in response to the expansion request. Furthermore, the server 4 can suppress the communication volume of information transmitted from the server 4 to the mobile body 2 via the communication line 6 to an appropriate communication volume in response to the expansion request.

[0242] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention described in the claims and their equivalents.

[0243] 1, 101 Management system 2, 2_1 to 2_n Mobile object 3 Management device 4 Server 5, 5_1 to 5_p Management terminal 6, 7 Communication line 21, 21_1 to 21_m Sensor 31 Monitoring screen

Claims

1. A management method comprising: determining a communication volume between a management device capable of communicating with a mobile body and the mobile body in accordance with a task type of remote management of the mobile body; and transmitting a communication volume instruction to the mobile body including a request to communicate at the determined communication volume.

2. The management method according to claim 1, wherein said determining the communication amount includes determining the communication amount of information to be transmitted from said mobile object to said management device in accordance with a task type of management of said mobile object.

3. The management method according to claim 1, wherein said determining the communication amount includes determining the communication amount of information to be transmitted from said management device to said mobile object according to a task type of management of said mobile object.

4. The management method according to claim 2, wherein said determining the communication volume includes determining a resolution of image data transmitted from said mobile object to said management device in accordance with a task type of said mobile object management.

5. The management method of claim 2, wherein determining the communication volume includes: determining the number of mobile objects to be monitored in the management device according to a task type for managing the mobile objects; and determining a resolution of image data transmitted from the mobile objects to the management device according to the determined number of mobile objects to be monitored.

6. The management method of claim 2, wherein determining the communication volume includes: determining a layout of a monitoring screen of the management device according to a task type of management of the mobile body; and determining a resolution of image data transmitted from the mobile body to the management device according to the determined layout of the monitoring screen.

7. The management method according to claim 3, wherein said determining the communication volume includes determining a transfer rate of a synchronization signal transmitted from said management device to said mobile object in accordance with a task type of management of said mobile object.

8. The management method according to claim 1, wherein the task type includes at least one of monitoring with image, monitoring without image, gaze, and steering.

9. A mobile object comprising: a sensor; a communication interface connectable to a management device; and a controller capable of controlling the sensor and the communication interface, wherein when a communication volume instruction including a request to communicate at a communication volume determined according to a remote management task type is received at the communication interface, the controller controls the mobile object to communicate with the management device at a communication volume according to the communication volume instruction.

10. The mobile body according to claim 9, wherein the controller processes the captured image so that the data size of the captured image becomes a data size according to the communication volume instruction.

11. The mobile body according to claim 9, wherein the controller controls the data size of image data generated from an image acquired by the sensor so that the data size corresponds to the communication volume instruction.

12. An information processing device mounted on a mobile body, comprising: a communication interface connectable to a management device; and a controller capable of controlling a sensor and the communication interface, wherein when a communication volume instruction including a request to communicate at a communication volume determined according to a remote management task type is received by the communication interface, the controller controls communication with the management device at a communication volume according to the communication volume instruction.

13. The information processing device according to claim 12, wherein said controller processes the image to be acquired so that the data size of the image to be acquired becomes a data size according to said communication amount instruction.

14. The information processing device according to claim 12, wherein the controller controls the data size of image data generated from an image acquired by the sensor so that the data size corresponds to the communication volume instruction.