Mobile terminal system
The mobile system on moving bodies limits image uploads to pre-defined areas, addressing communication cost issues by reducing unnecessary data transmission.
Patent Information
- Application Number
- JP2023084197
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-22
- Publication Date
- 2024-12-04
- Estimated Expiration
- 2043-05-22
AI Technical Summary
The continuous uploading of images taken by cameras mounted on moving objects to a management system leads to increased communication costs.
A mobile system mounted on a moving body that compares its current location with pre-designated upload target areas and prohibits image uploads when outside these areas, reducing unnecessary data transmission.
This approach reduces communication costs by preventing the upload of images outside designated areas, thereby minimizing data sent and conserving communication resources.
Smart Images

Figure 2024167840000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a technology for uploading images taken by a camera mounted on a moving object. [Background technology]
[0002] Patent Document 1 discloses a distribution system including an in-vehicle device and a management server. The in-vehicle device transmits captured camera images to the management server at a predetermined interval. The management server selects a vehicle near the front of the traffic jam as a candidate vehicle and notifies the following receiving vehicle of the network address of the candidate vehicle. The receiving vehicle communicates with the candidate vehicle as a distribution source vehicle and receives camera images from the distribution source vehicle. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2020-123075 A Summary of the Invention [Problem to be solved by the invention]
[0004] Consider the use of images captured by cameras mounted on mobile objects. The images are uploaded to a management system and used for, for example, surveillance. However, if all images captured by cameras mounted on mobile objects are uploaded to the management system, communication costs will increase.
[0005] One object of the present disclosure is to provide a technology capable of reducing communication costs when images captured by a camera mounted on a moving object are used. [Means for solving the problem]
[0006] One aspect of the present disclosure relates to a mobile system mounted on a mobile body. The mobile system is one or more processors; one or more storage devices for storing upload specification information indicating at least a pre-specified upload target area; Equipped with. The one or more processors acquire information on the current position of the moving object and images captured by a camera mounted on the moving object. The one or more processors communicate with a management system external to the vehicle that utilizes the images. The one or more processors compare the current location of the mobile entity with the upload target area. If the current location of the mobile unit is outside the upload target area, the one or more processors prohibit uploading of images to the management system. Effect of the Invention
[0007] According to the present disclosure, when a moving object is outside the upload target area, image uploading to the management system is prohibited. Image uploading is not performed all the time, and unnecessary image uploading is not performed, so the amount of data transmission is reduced, and communication costs are reduced. [Brief description of the drawings]
[0008] [Figure 1] 1 is a conceptual diagram for explaining an overview of an in-vehicle system mounted on a vehicle according to an embodiment; [Diagram 2] 1 is a block diagram showing a configuration example of an in-vehicle system according to an embodiment; [Diagram 3] 13 is a flowchart showing a first example of an image upload process according to the embodiment. [Figure 4] 13 is a flowchart showing a second example of an image upload process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] 1. Overview Consider a moving body. Examples of a moving body include a vehicle, a robot, a flying object, and the like. A vehicle may be an autonomous vehicle or a vehicle driven by a driver. Examples of a robot include a logistics robot, and the like. Examples of a flying object include an airplane, a drone, and the like. As an example, in the following description, a case where the moving object is a vehicle will be considered. To generalize, in the following description, "vehicle" will be read as "moving object", and "in-vehicle system" will be read as "moving object system".
[0010] 1 is a conceptual diagram for explaining an overview of an in-vehicle system 10 mounted on a vehicle 1 according to the present embodiment. The in-vehicle system 10 has a function of acquiring a current position of the vehicle 1. The in-vehicle system 10 also acquires an image captured by a camera mounted on the vehicle 1. The in-vehicle system 10 may control the vehicle 1 based on the image. For example, the in-vehicle system 10 may control automatic driving of the vehicle 1 based on the image.
[0011] Images captured by a camera mounted on the vehicle 1 may be used for purposes other than controlling the vehicle 1. For example, the images may be used for monitoring the city. Monitoring includes detection of abnormalities (e.g., accidents, troubles, crimes, suspicious people, sick people, etc.). As another example, the images may be used for detection of targets (e.g., people, events) present in the city. In any case, anomalies and targets can be detected from the images by using a machine learning model.
[0012] The images acquired in the vehicle 1 are used by a management system 100 external to the vehicle 1. Therefore, the in-vehicle system 10 communicates with the management system 100 and uploads (transmits) the acquired images to the management system 100 as necessary. However, if all images acquired in the vehicle 1 are unconditionally uploaded to the management system 100, communication costs will increase.
[0013] Therefore, in this embodiment, the management system 100 specifies in advance the area for which images are desired. The area specified in advance by the management system 100 is hereinafter referred to as the "upload target area TA." The upload target area TA can also be said to be an area that the management system 100 monitors or detects targets. The management system 100 distributes information indicating at least the upload target area TA to one or more vehicles 1. Before each vehicle 1 enters the upload target area TA, the in-vehicle system 10 of each vehicle 1 receives in advance the information distributed from the management system 100.
[0014] While the vehicle 1 is in operation, the in-vehicle system 10 acquires the current location of the vehicle 1 and compares the current location of the vehicle 1 with the upload target area TA in real time. If the current location of the vehicle 1 is outside the upload target area TA, the in-vehicle system 10 prohibits uploading of images to the management system 100. In this case, images are not uploaded from the in-vehicle system 10 to the management system 100.
[0015] On the other hand, if the current location of the vehicle 1 is within the upload target area TA, the in-vehicle system 10 permits uploading of images to the management system 100. In this case, the in-vehicle system 10 uploads images to the management system 100 in real time. The in-vehicle system 10 may upload information on the current location of the vehicle 1 together with the images to the management system 100. The images uploaded to the management system 100 become available for use by the management system 100.
[0016] As described above, according to this embodiment, when the vehicle 1 is outside the upload target area TA, uploading of images to the management system 100 is prohibited. Image uploading is not performed all the time, and unnecessary images are not uploaded, so the amount of data transmission is reduced, and communication costs are reduced.
[0017] Furthermore, according to this embodiment, when the vehicle 1 is within the upload target area TA, images captured in the upload target area TA are uploaded in real time to the management system 100. Based on the images uploaded from the vehicle 1, the management system 100 can monitor the upload target area TA in real time and detect targets in the upload target area TA in real time.
[0018] As a modified example, the management system 100 may further specify in advance a time period for which images are desired. The time period specified in advance by the management system 100 is hereinafter referred to as the "upload target time period TH". It can also be said that the upload target time period TH is a time period for which the management system 100 performs monitoring or target detection. The management system 100 distributes information indicating the upload target area TA and the upload target time period TH to one or more vehicles 1. While the vehicle 1 is in operation, the in-vehicle system 10 compares the current time with the upload target time period TH. If the current time is outside the upload target time period TH, the in-vehicle system 10 prohibits uploading images to the management system 100. In this case, images are not uploaded from the in-vehicle system 10 to the management system 100. Only when the current location of the vehicle 1 is within the upload target area TA and the current time is within the upload target time period TH, the in-vehicle system 10 uploads images to the management system 100 in real time. The in-vehicle system 10 may upload information on the current location of the vehicle 1 to the management system 100 together with the images. According to this modification, the amount of data transmission is further reduced, and communication costs are further reduced.
[0019] The in-vehicle system 10 according to this embodiment will be described in more detail below.
[0020] 2. Example of in-vehicle system configuration 2 is a block diagram showing an example of the configuration of an in-vehicle system 10 according to this embodiment. The in-vehicle system 10 includes a sensor group 20, a communication device 30, a driving device 40, and a control device 50.
[0021] The sensor group 20 includes a camera 21, a position sensor 22, etc. The camera 21 recognizes the surrounding situation of the vehicle 1. The position sensor 22 detects the position and orientation of the vehicle 1. For example, the position sensor 22 includes a Global Navigation Satellite System (GNSS). The sensor group 20 may include recognition sensors other than the camera 21 (e.g., LIDAR). The sensor group 20 may include vehicle state sensors such as a speed sensor, an acceleration sensor, a yaw rate sensor, a steering angle sensor, etc.
[0022] The communication device 30 communicates with the outside via a communication network. For example, the communication device 30 communicates with the management system 100. Examples of the communication method include mobile communication such as 5G and wireless LAN.
[0023] The traveling device 40 includes a steering device, a drive device, and a braking device. The steering device steers the wheels. For example, the steering device includes an electric power steering (EPS) device. The drive device is a power source that generates a driving force. Examples of the drive device include an engine, an electric motor, and an in-wheel motor. The braking device generates a braking force.
[0024] The control device 50 is a computer that controls the vehicle 1. The control device 50 includes one or more processors 60 (hereinafter simply referred to as processor 60) and one or more storage devices 70 (hereinafter simply referred to as storage devices 70). The processor 60 executes various processes. For example, the processor 60 includes a CPU (Central Processing Unit). The storage device 70 stores various information. Examples of the storage device 70 include a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), and the like.
[0025] The vehicle control program 80 is a computer program for controlling the vehicle 1. The functions of the control device 50 are realized by cooperation between the processor 60, which executes the vehicle control program 80, and the storage device 70. The vehicle control program 80 is stored in the storage device 70. Alternatively, the vehicle control program 80 may be recorded in a computer-readable recording medium.
[0026] The control device 50 acquires driving environment information 90 that indicates the driving environment of the vehicle 1. The driving environment information 90 is stored in the storage device 70.
[0027] The driving environment information 90 includes an image 91 captured by the camera 21. The driving environment information 90 may include object information related to an object recognized by a recognition sensor. Examples of objects around the vehicle 1 include pedestrians, other vehicles, white lines, landmarks, traffic lights, etc. The object information indicates the relative position and relative speed of the object with respect to the vehicle 1.
[0028] The driving environment information 90 further includes position information 92 indicating the current position of the vehicle 1. The control device 50 acquires the position information 92 from a detection result by the position sensor 22. In addition, the control device 50 may acquire highly accurate position information 92 by a well-known self-position estimation process (Localization) using object information and map information.
[0029] The driving environment information 90 further includes vehicle state information detected by vehicle state sensors.
[0030] The control device 50 also executes vehicle driving control for controlling the driving of the vehicle 1. The vehicle driving control includes steering control, acceleration control, and deceleration control. The control device 50 executes the vehicle driving control by controlling the driving devices 40 (steering device, driving device, braking device).
[0031] Furthermore, the control device 50 performs automatic driving control to control automatic driving of the vehicle 1. Here, automatic driving means that at least a part of steering, acceleration, and deceleration of the vehicle 1 is performed automatically independent of the driver's operation. As an example, automatic driving of level 3 or higher may be performed. The control device 50 generates a driving plan for the vehicle 1 based on the driving environment information 90. Examples of the driving plan include maintaining the current driving lane, changing lanes, turning right or left, avoiding collisions with objects, and the like. Furthermore, the control device 50 generates a target trajectory for realizing the driving plan. The target trajectory includes a target position and a target speed of the vehicle 1. Then, the control device 50 performs vehicle driving control so that the vehicle 1 follows the target trajectory.
[0032] Furthermore, the control device 50 communicates with the management system 100 via the communication device 30, and receives upload designation information SPE delivered from the management system 100. The upload designation information SPE indicates at least an upload target area TA designated in advance by the management system 100. The upload designation information SPE may indicate an upload target area TA and an upload target time zone TH designated in advance by the management system 100. Typically, before the vehicle 1 enters the upload target area TA, the control device 50 receives the upload designation information SPE delivered from the management system 100 in advance. The control device 50 stores the received upload designation information SPE in the storage device 70.
[0033] Based on the upload specification information SPE, the control device 50 executes an "image upload process" for uploading the image 91 to the management system 100. Hereinafter, several examples of the image upload process according to the present embodiment will be described.
[0034] 3. Image upload process 3-1. First Example 3 is a flowchart showing a first example of an image upload process. In step S10, the control device 50 acquires an image 91 and position information 92. In the following step S20, the control device 50 compares the current position of the vehicle 1 indicated by the position information 92 with the upload target area TA indicated by the upload specification information SPE.
[0035] If the current location of the vehicle 1 is outside the upload target area TA (step S20; No), the process proceeds to step S40. In step S40, the control device 50 prohibits uploading of the image 91 to the management system 100. In this case, the image 91 is not transmitted to the management system 100. After that, the process returns to step S10.
[0036] On the other hand, if the current location of the vehicle 1 is within the upload target area TA (step S20; Yes), the process proceeds to step S50. In step S50, the control device 50 permits uploading of the image 91 to the management system 100. Then, in step S60, the control device 50 uploads the image 91 to the management system 100. The control device 50 may upload the position information 92 together with the image 91 to the management system 100. After that, the process returns to step S10.
[0037] 3-2. Second Example 4 is a flowchart showing a second example of the image upload process. Compared to the first example, step S30 is added. If the current position of the vehicle 1 is within the upload target area TA (step S20; Yes), the process proceeds to step S30.
[0038] In step S30, the control device 50 acquires information on the current time and compares the current time with the upload target time zone TH indicated by the upload specification information SPE. If the current time is outside the upload target time zone TH (step S30; No), the process proceeds to step S40. On the other hand, if the current time is within the upload target time zone TH (step S30; Yes), the process proceeds to step S50. The rest is the same as in the first example described above. [Explanation of symbols]
[0039] 1 vehicle 10 In-vehicle systems 21 Camera 91 images 92 Location information 100 Management Systems SPE Upload Specifications TA upload area
Claims
1. A mobile body system mounted on a mobile body, one or more processors; one or more storage devices for storing upload specification information indicating at least a pre-specified upload target area; Equipped with The one or more processors: Acquire information on the current location of the moving object and an image captured by a camera mounted on the moving object; communicating with a management system outside the mobile body that utilizes the images; Comparing the current location of the mobile object with the upload target area; If the current location of the moving object is outside the upload target area, the image is prohibited from being uploaded to the management system. It is configured as follows: Mobile systems.
2. 2. The mobile system of claim 1, If the current location of the moving object is within the upload target area, the one or more processors upload the image to the management system in real time. Mobile systems.
3. 2. The mobile system of claim 1, The upload specification information further indicates a pre-specified upload target time period, The one or more processors further include: Compare the current time with the upload target time zone; prohibiting uploading of the image to the management system if the current time is outside the upload target time zone; When the current location of the moving object is within the upload target area and the current time is within the upload target time period, the image is uploaded to the management system in real time. It is configured as follows: Mobile systems.
4. 2. The mobile system of claim 1, The upload specification information is delivered by the management system; Before the moving object enters the upload target area, the one or more processors receive the upload specification information distributed from the management system in advance, and store the received upload specification information in the one or more storage devices. Mobile systems.
5. A mobile system according to any one of claims 1 to 4, The upload target area is an area that the management system monitors or detects targets in, In the management system, the upload target area is monitored or a target in the upload target area is detected based on the image uploaded from the mobile object. Mobile systems.
Citation Information
Patent Citations
Communication device
JP2020046726A
Communication apparatus and communication method
JP2021103437A
Data structure, information transmission device, control method, program, and storage medium
JP2022093704A
Positional information transmitting program, information terminal, and positional information transmitting system
US20220282984A1
Delivery system and delivery method
JP2020123075A
