Communication control device
By equipping the mobile device with image acquisition, empty area detection, and orbit information acquisition mechanisms, and combining them with machine learning models, the communication status can be predicted with high accuracy, thus solving the problem of low communication efficiency in communication between the mobile device and the satellite, and realizing the efficient utilization of non-terrestrial communication networks and high-speed data transmission.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- TOYOTA JIDOSHA KK
- Filing Date
- 2025-09-29
- Publication Date
- 2026-04-17
AI Technical Summary
In existing technologies, the prediction of communication status between mobile bodies and satellites has not achieved high accuracy, especially in non-terrestrial network communication, which fails to effectively utilize the potential of non-terrestrial communication networks, resulting in low communication efficiency.
By incorporating image acquisition mechanisms, empty area detection mechanisms, orbit information acquisition mechanisms, and decision-making mechanisms, and combining machine learning models, the communication status between the moving body and the satellite can be predicted with high accuracy, the optimal communication path can be selected, and terrestrial or non-terrestrial communication networks can be utilized.
It enables high-precision prediction of communication status between mobile entities and satellites, improves the utilization efficiency of non-terrestrial communication networks, ensures high-speed and high-capacity data transmission, and enhances user experience.
Smart Images
Figure CN121887259A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the technical field of a communication control device. Background Technology
[0002] As such an apparatus, for example, the following apparatus has been proposed: determining whether a satellite associated with a satellite signal received by a satellite antenna is in a line-of-sight (LOS) state that is directly visible from the satellite antenna or a non-line-of-sight (NLOS) state that is directly invisible, and performing correction processing on the satellite signal associated with a satellite in an NLOS state (see Patent No. 6546658). Summary of the Invention
[0003] For example, when a mobile vehicle is communicating with at least one of satellite communication and non-terrestrial network (NTN) communication, it is necessary to predict the communication status between the mobile vehicle and satellites, etc. Furthermore, the prediction of the communication status can utilize a learning-completed model generated through machine learning. In the technology described in patent No. 6546658, satellite signals related to the Global Navigation Satellite System (GNSS) are corrected, but the prediction of the communication status is not performed.
[0004] This invention provides a communication control device capable of accurately predicting the communication status between a mobile object and a satellite, etc.
[0005] One aspect of the present invention relates to a communication control device for a mobile body equipped with a communication device capable of utilizing both terrestrial and non-terrestrial communication networks.
[0006] The communication control device includes:
[0007] An image acquisition mechanism acquires images generated by photographing the area around the moving object;
[0008] The detection agency detects empty regions in the image that are equivalent to empty spaces;
[0009] The orbital information acquisition mechanism acquires orbital information related to the satellites constituting the non-terrestrial communication network; and
[0010] The determining mechanism, based on the empty area and the track information, determines whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network.
[0011] Another aspect of the present invention relates to a communication control device for a mobile body equipped with a communication device capable of utilizing both terrestrial and non-terrestrial communication networks.
[0012] The communication control device includes:
[0013] An image acquisition mechanism acquires images generated by photographing the area around the moving object;
[0014] An orbital information acquisition mechanism acquires orbital information related to the satellites constituting the non-terrestrial communication network;
[0015] The prediction agency, based on the orbital information, predicts the future position of the satellite; and
[0016] The determining mechanism, based on the image and the future position of the satellite, determines whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network. Attached Figure Description
[0017] Hereinafter, with reference to the accompanying drawings, the features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described, in which the same reference numerals denote the same elements, and wherein:
[0018] Figure 1 This is a block diagram illustrating the configuration of the communication control device involved in the implementation method.
[0019] Figure 2 It is a diagram used to illustrate the status of a satellite.
[0020] Figure 3 This is a flowchart illustrating the operation of the communication control device involved in the implementation method. Detailed Implementation
[0021] refer to Figures 1 to 3 The implementation methods involved in the communication control device will be described. Figure 1 In this vehicle, a communication control device 100 is mounted on vehicle 1. Vehicle 1 includes a communication device 11, a communication device 12, and a camera 13. Communication device 11 is a communication device that utilizes a non-terrestrial communication network. Communication device 12 can be a communication device that utilizes a terrestrial communication network. That is, communication device 12 is a communication device that utilizes a different communication network than communication device 11. In addition, vehicle 1 can be a connected car. Furthermore, the terrestrial communication network can include at least one of cellular mobile lines and Wi-Fi (registered trademark) lines. Camera 13 is capable of photographing the surroundings of vehicle 1. Camera 13 is particularly mounted on vehicle 1 in a manner capable of photographing the zenith. For example, camera 13 can be a hemispherical 360-degree camera.
[0022] The communication control device 100 includes a position information acquisition unit 110, an image processing unit 120, a satellite orbit information acquisition unit 130, a LOS prediction unit 140, and a communication control unit 150. Additionally, the communication control device 100 may include a camera 13 as part of it. The position information acquisition unit 110 acquires position information representing the position and motion information of the vehicle 1 at each moment. For example, the information may include latitude, longitude, altitude, speed, and direction. The time may be, for example, satellite time such as Global Positioning System (GPS) time, or the time of the area where the vehicle 1 is traveling.
[0023] The image processing unit 120 acquires camera images generated by the camera 13 capturing images of the area around the vehicle 1. For example, if the camera 13 is a hemispherical 360-degree camera, the image processing unit 120 can perform prescribed distortion correction processing on the camera images. In this case, the image processing unit 120 can convert the camera images, which are circular images, into celestial coordinates. Alternatively, the image processing unit 120 can perform prescribed normalization processing on the camera images, which are circular images. Then, the image processing unit 120 can convert the normalized camera images into horizontal coordinates.
[0024] The image processing unit 120 detects empty regions in the camera image that correspond to empty areas. Furthermore, various existing methods can be applied in the processing for detecting empty regions. For example, empty regions can be detected based on color information associated with the camera image. For instance, if a camera image is input, a learned model can be used to detect empty regions, which is used to extract empty regions included in the camera image. Additionally, the image processing unit 120 can determine that vehicle 1 is traveling inside a tunnel based on its position. In this case, the image processing unit 120 can determine that there are no empty regions by considering the zenith as the top surface of the tunnel. The image processing unit 120 generates empty information representing empty regions.
[0025] The satellite orbit information acquisition unit 130 acquires orbit information of a base station (e.g., at least one of a satellite and an aircraft) that is the connection target of the communication device 11. Alternatively, the satellite orbit information acquisition unit 130 can acquire orbit information from a server on a network or from a storage device (not shown) included in the communication control device 100. Based on the orbit information, the satellite orbit information acquisition unit 130 calculates the current position of the base station and its future orbit and orientation. The satellite orbit information acquisition unit 130 generates satellite information representing the current position of the base station and its future orbit and orientation.
[0026] The LOS prediction unit 140 acquires position information acquired by the position information acquisition unit 110, spatial information generated by the image processing unit 120, and satellite information generated by the satellite orbit information acquisition unit 130. Based on the position information, spatial information, and satellite information, the LOS prediction unit 140 predicts the current utilization potential of the non-terrestrial communication network and the future utilization potential of the non-terrestrial communication network.
[0027] Furthermore, the location information acquisition unit 110 can repeatedly acquire location information at a predetermined period. The image processing unit 120 can repeatedly generate space information at a predetermined period. The satellite orbit information acquisition unit 130 can repeatedly generate satellite information at a predetermined period. The LOS prediction unit 140 can periodically acquire location information, space information, and satellite information. Therefore, the LOS prediction unit 140 can repeatedly predict the current utilization potential of the non-terrestrial communication network and the future utilization potential of the non-terrestrial communication network.
[0028] Here, for reference Figure 2 The status of base stations constituting non-terrestrial communication networks is explained. Figure 2 The image Img shown corresponds to an example of the camera image described above. In image Img, the shaded area corresponds to structures existing around vehicle 1. In image Img, the area outside the shaded area corresponds to an empty area. Within the area included in image Img, satellites S1, S2, S3, and S4, which serve as base stations, are located. When a satellite is located in the empty area of image Img, it is directly visible from the antenna of communication device 11. On the other hand, when a satellite is located in the shaded area of image Img, it is not directly visible from the antenna of communication device 11. Therefore, a satellite located in the empty area of image Img can be called a LOS satellite. A satellite located in the shaded area of image Img can be called an NLOS satellite. A LOS satellite can be called a "satellite with LOS". An NLOS satellite can be called a "satellite without LOS".
[0029] The positions of satellites S1, S2, S3, and S4 (and the position of vehicle 1) change over time. Therefore, even current LOS satellites could potentially become future NLOS satellites. Figure 2 The arrows shown represent an example of the orbits of each satellite. That is, the position of each satellite changes along the arrow. The starting side of the arrow represents the current position of the satellite, and the ending side represents the future position of the satellite.
[0030] Satellite S1 is currently located in an empty area of image Img. Satellite S1 will be located in an empty area of image Img in the future. That is, satellite S1 is currently and will be a LOS satellite. In this embodiment, this satellite state is referred to as "active". Satellite S2 is currently located in an empty area of image Img. Satellite S2 will be located in a shaded area of image Img in the future. That is, satellite S2 is currently a LOS satellite, but will become an NLOS satellite in the future. In this embodiment, this satellite state is referred to as "fading". Satellite S3 is currently located in a shaded area of image Img. Satellite S3 will be located in an empty area of image Img in the future. That is, satellite S3 is currently an NLOS satellite, but will become a LOS satellite in the future. In this embodiment, this satellite state is referred to as "appearing". Satellite S4 is currently located in a shaded area of image Img. Satellite S4 will be located in a shaded area of image Img in the future. That is, satellite S4 is currently and will be an NLOS satellite in the future. In this embodiment, this satellite state is referred to as "hidden".
[0031] Furthermore, the LOS prediction unit 140 can determine the positions (i.e., coordinates) of each satellite S1, S2, S3, and S4 in the coordinate system involved in the camera image based on the position information and satellite information. The LOS prediction unit 140 can determine whether each satellite is located in an empty region of the image Img based on the determined positions of each satellite S1, S2, S3, and S4 and the spatial information.
[0032] refer to Figure 3 The flowchart illustrates the operation of the LOS prediction unit 140. Figure 3 In the process, the LOS prediction unit 140 calculates the positions and orbits of satellites that are currently LOS satellites and satellites that will become LOS satellites in the future based on position information, airspace information, and satellite information (S101). Next, the LOS prediction unit 140 determines whether there is more than one active satellite (S102).
[0033] In the processing of S102, if it is determined that there is more than one active satellite (S102: Yes), the LOS prediction unit 140 determines to prioritize non-terrestrial communication networks (S105). On the other hand, in the processing of S102, if it is determined that there is no more than one active satellite (S102: No), the LOS prediction unit 140 determines whether all satellites are in decline or emerging (S103).
[0034] In the processing of S103, if it is determined that all satellites are either in decay or emerging (S103: Yes), the LOS prediction unit 140 determines to prioritize non-terrestrial communication networks (S105). On the other hand, in the processing of S103, if it is determined that all satellites are neither in decay nor emerging (in other words, all satellites are hidden) (S103: No), the LOS prediction unit 140 determines to prioritize terrestrial communication networks (S104).
[0035] Then, the LOS prediction unit 140 determines whether the quality of the prioritized communication network is the same as or better than that of the terrestrial communication network (S106). In the process of S106, if it is determined that the quality of the prioritized communication network is the same as or better than that of the terrestrial communication network (S106: Yes), the LOS prediction unit 140 determines to utilize the prioritized communication network (S108). On the other hand, in the process of S106, if it is determined that the quality of the prioritized communication network is not the same as or better than that of the terrestrial communication network (S106: No), the LOS prediction unit 140 determines to utilize the terrestrial communication network (S107).
[0036] Then, the LOS prediction unit 140 sends information indicating the communication network to be utilized to the communication control unit 150 (S109). This information indicating the communication network to be utilized can also be referred to as a communication line utilization strategy. The communication control unit 150 selects either the communication device 11 or 12 based on the information indicating the communication network to be utilized. If a non-terrestrial communication network is selected as the communication network to be utilized, the communication control unit 150 can set the orientation and radiation pattern of the antenna of the communication device 11.
[0037] Technical effect
[0038] The communication control device 100 compares an empty area in a camera image with the current and future positions of base stations based on orbital information of base stations constituting a non-terrestrial communication network (e.g., at least one of a satellite and an aircraft). Therefore, the communication control device 100 can accurately estimate the current and future communication status between the vehicle 1 and the base station. That is, according to the communication control device 100, the communication status between the vehicle 1 and satellites, etc., can be predicted with high accuracy.
[0039] Compared to terrestrial communication networks, non-terrestrial communication networks enable high-speed and low-latency communication. Therefore, compared to terrestrial communication networks, non-terrestrial communication networks can transmit large amounts of data at high speeds. According to the communication control device 100, by appropriately utilizing the non-terrestrial communication network capable of high-speed, high-capacity communication, efficient data transmission can be achieved compared to using only the non-terrestrial communication network. Therefore, even in environments prone to repeated connection / disconnection, the utilization efficiency of the non-terrestrial communication network can be improved without degrading the user experience.
[0040] The invention described below is an example of the embodiments and variations described above.
[0041] One aspect of the invention relates to a communication control device for a mobile body equipped with communication devices capable of utilizing both terrestrial and non-terrestrial communication networks. The communication control device comprises: an image acquisition mechanism for acquiring an image generated by photographing the area around the mobile body; a detection mechanism for detecting empty regions in the image; an orbital information acquisition mechanism for acquiring orbital information related to satellites constituting the non-terrestrial communication network; and a determination mechanism for determining, based on the empty regions and the orbital information, whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network.
[0042] In the above embodiments, the "image processing unit 120" functions as an example of both an "image acquisition mechanism" and a "detection mechanism." The "satellite orbit information acquisition unit 130" functions as an example of an "orbit information acquisition mechanism." The "LOS prediction unit 140" functions as an example of a "determination mechanism."
[0043] In one example of this communication control device, the communication control device may include a prediction mechanism that predicts the future position of the satellite based on the orbital information. The determination mechanism can then determine, based on the empty area and the future position of the satellite, whether to conduct communication via the terrestrial communication network or via a non-terrestrial communication network. In the above embodiment, the "satellite orbital information acquisition unit 130" functions as an example of the "prediction mechanism."
[0044] Another aspect of the invention relates to a communication control device for a mobile body equipped with communication devices capable of utilizing both terrestrial and non-terrestrial communication networks. The communication control device comprises: an image acquisition mechanism for acquiring images generated by photographing the surroundings of the mobile body; an orbital information acquisition mechanism for acquiring orbital information related to satellites constituting the non-terrestrial communication network; a prediction mechanism for predicting the future position of the satellites based on the orbital information; and a determination mechanism for determining, based on the images and the future position of the satellites, whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network.
[0045] In one example of this communication control device, the device may include a detection mechanism that detects empty regions in the image. The determination mechanism can then determine, based on the empty regions and the future position of the satellite, whether to initiate communication via the terrestrial communication network or via a non-terrestrial communication network.
[0046] This invention is not limited to the embodiments described above. Appropriate modifications can be made without departing from the spirit or spirit of the invention as read from the claims and the entire specification, and the communication control device accompanying such modifications is also included within the scope of this invention.
Claims
1. A communication control device, which is a communication control device for a mobile body equipped with communication devices capable of utilizing terrestrial and non-terrestrial communication networks, characterized in that, have: An image acquisition mechanism that acquires images generated by photographing the area around the moving object; The detection agency detects empty regions in the image that are equivalent to empty spaces; An orbital information acquisition mechanism acquires orbital information related to the satellites constituting the non-terrestrial communication network; and The determining mechanism determines, based on the empty area and the track information, whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network.
2. The communication control device according to claim 1, characterized in that, have: A prediction agency, based on the orbital information, predicts the future position of the satellite. The determining mechanism determines, based on the empty area and the future position of the satellite, whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network.
3. A communication control device, which is a communication control device for a mobile body equipped with communication devices capable of utilizing terrestrial and non-terrestrial communication networks, characterized in that, have: An image acquisition mechanism that acquires images generated by photographing the area around the moving object; An orbital information acquisition mechanism acquires orbital information related to the satellites constituting the non-terrestrial communication network; A prediction agency that predicts the future position of the satellite based on the orbital information; and The determining mechanism, based on the image and the future position of the satellite, determines whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network.
4. The communication control device according to claim 3, characterized in that, have: The detection agency detects empty regions in the image that are equivalent to empty spaces. The determining mechanism determines, based on the empty area and the future position of the satellite, whether to conduct communication via the terrestrial communication network or via the non-terrestrial communication network.