A user terminal, an information processing method, and an information processing system
By receiving and displaying the identification information of the mobile platform, the user terminal automatically switches the image transmission channel to receive images, solving the problem of complicated image selection operations for users and realizing an intelligent image viewing experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SZ DJI TECH CO LTD
- Filing Date
- 2021-03-02
- Publication Date
- 2026-04-21
AI Technical Summary
In existing technologies, users cannot easily and quickly choose to view images captured by multiple mobile platforms according to their personal wishes. The operation is difficult and requires manually changing the image transmission channel frequency and verbally informing the user.
The user terminal receives broadcast signals sent by the mobile platform and displays the platform identification information. After the user selects the target platform, the terminal automatically switches to the corresponding image transmission channel to receive the image, reducing manual operation and frequency notification steps.
It improves the intelligence of user terminals, reduces the difficulty of operation, and allows users to conveniently and quickly view images of interest.
Smart Images

Figure CN116547925B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of information processing technology, and in particular to information processing methods, user terminals, and information processing systems applied to user terminals. Background Technology
[0002] Currently, users can receive and view images captured by mobile platforms through user terminals such as video glasses. When multiple mobile platforms are simultaneously capturing images, if a user wants to view images from a specific target platform, the traditional approach is to use a fixed frequency for the image transmission channel of each platform. This frequency cannot be arbitrarily changed. The user must be verbally informed of the frequency of each platform's transmission channel. After learning the frequency of the target platform's transmission channel, the user manually operates their terminal to receive and display the image transmitted from that platform. Furthermore, if one or more mobile platforms are powered off and on again, or if the transmission channel frequency is changed, the user must be verbally notified again. This approach is not intelligent, is cumbersome, and prevents users from conveniently and quickly selecting which mobile platform's images they are interested in. Summary of the Invention
[0003] To address the aforementioned deficiencies in the prior art, embodiments of this application provide a user terminal, an information processing method, and an information processing system.
[0004] One embodiment of this application provides a user terminal, including a display device and at least one processor, the at least one processor being configured to perform the following steps:
[0005] Receive broadcast signals transmitted by at least one mobile platform from a broadcast channel, wherein the broadcast signals include identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform for transmitting images;
[0006] The display device is controlled to display the identification information of the at least one movable platform to assist the user in selecting a target movable platform from the at least one movable platform;
[0007] Detect the user's first mobile platform selection operation, and select a target mobile platform from the at least one mobile platform based on the detected operation;
[0008] The image transmitted by the target mobile platform is received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images;
[0009] Control the display device to display the received image.
[0010] Another embodiment of this application provides an information processing method for a user terminal, the user terminal including a display device, the method comprising:
[0011] Receive broadcast signals transmitted by at least one mobile platform from a broadcast channel, wherein the broadcast signals include identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform for transmitting images;
[0012] The display device is controlled to display the identification information of the at least one movable platform to assist the user in selecting a target movable platform from the at least one movable platform;
[0013] Detect the user's first mobile platform selection operation, and select a target mobile platform from the at least one mobile platform based on the detected operation;
[0014] The image transmitted by the target mobile platform is received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images;
[0015] Control the display device to display the received image.
[0016] Another embodiment of this application provides an information processing system, the system including at least one user terminal and at least one mobile platform, the system including a display device and at least one first processor, for performing the following steps:
[0017] In response to a broadcast signal received from the at least one mobile platform from a broadcast channel, wherein the broadcast signal includes identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform for transmitting images;
[0018] The display device is controlled to display the identification information of the at least one movable platform to assist the user in selecting a target movable platform from the at least one movable platform;
[0019] Detect the user's first mobile platform selection operation, and select a target mobile platform from the at least one mobile platform based on the detected operation;
[0020] The image transmitted by the target mobile platform is received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images;
[0021] Control the display device to display the received image;
[0022] The movable platform includes a camera and at least one second processor for performing the following methods:
[0023] The broadcast signal is transmitted from the broadcast channel;
[0024] The images captured by the imaging device are transmitted from the image transmission channel.
[0025] This application provides a user terminal, information processing method, and information processing system. The user terminal receives a broadcast signal from at least one mobile platform, displaying its identification information and the frequency of its image transmission channel. The user selects the desired mobile platform by selecting its identification information. The user terminal then accesses the selected platform's image transmission channel at its designated frequency and receives images captured by that platform. This eliminates the need to verbally inform the user of the mobile platform's image transmission channel frequency; the user simply selects the target mobile platform on their terminal, which then receives the images transmitted by that platform. This improves the system's intelligence, reduces operational complexity, and allows users to conveniently and quickly view images captured by the mobile platforms they wish to see. Attached Figure Description
[0026] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0027] Figure 1 This is a schematic diagram of the user terminal structure of this application;
[0028] Figure 2 This is a schematic diagram of the structure of the mobile platform of this application;
[0029] Figure 3 This is a schematic diagram of the broadcast channel for transmitting broadcast information and the image transmission channel for transmitting image information on the mobile platform of this application;
[0030] Figure 4 This is a schematic diagram of the structure of the mobile platform paired with the user terminal in this application;
[0031] Figure 5 This is a flowchart of the information processing method for this application;
[0032] Figure 6 This is a schematic diagram of the information processing system of this application. Detailed Implementation
[0033] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0034] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.
[0035] In existing technologies, users can receive and view images captured by mobile platforms through user terminals such as video glasses. When multiple mobile platforms are simultaneously capturing images, if a user wants to view an image from a specific mobile platform, the traditional approach is to use a fixed frequency for the image transmission channel of each platform. This frequency cannot be arbitrarily changed. The user must be verbally informed of the frequency of each platform's transmission channel. After learning the frequency of the target platform's transmission channel, the user manually operates their terminal to receive and display the image transmitted from the target platform. Furthermore, if one or more mobile platforms are powered off and on again, or if the transmission channel frequency is changed, the user must be verbally notified again. This approach is not intelligent, is cumbersome, and prevents users from conveniently and quickly selecting which mobile platform's images they are interested in.
[0036] To address the specific technical problems mentioned above, this application provides a user terminal, an information processing method, and an information processing system. This allows users to simply select a target mobile platform they are interested in on their user terminal, and the user terminal will automatically receive images captured by the target mobile platform. This eliminates the need to verbally inform the user of the frequency of the image transmission channel used by the mobile platform for image transmission, thus improving the system's intelligence and reducing the difficulty of user operation. Consequently, users can conveniently and quickly view images captured by mobile platforms of interest.
[0037] See Figure 1 , Figure 1This is a schematic diagram of the structure of a user terminal according to an embodiment of this application. It should be noted that the user terminal 100 in this embodiment can refer to various mobile terminal devices with display devices, such as mobile phones, PDAs, remote controls, VR glasses, FPV glasses, etc.
[0038] User terminal 100 includes: at least one processor 101 and a display device 103.
[0039] The display device 103 is used to display information in a broadcast signal received from a broadcast channel and an image received from an image transmission channel. At least one processor 101 is used to receive broadcast signals from the broadcast channel and image signals from the image transmission channel, and to control the display device 103 to display broadcast information in the broadcast signals received from the broadcast channel and images received from the image transmission channel.
[0040] See Figure 2 , Figure 2 This is a schematic diagram of the structure of an embodiment of the mobile platform of this application. It should be noted that the mobile platform 200 in this embodiment can refer to various platforms that can move automatically or under controlled conditions through their own power system, such as: drones, vehicles, unmanned vehicles, ground robots, unmanned boats, etc. The mobile platform can also be a portable platform or electronic device that can change position when carried by a moving third party, such as: consumer electronic products (including gimbals, mobile terminals, mobile phones, etc.), industrial and agricultural electronic products (such as remote controls), etc.
[0041] The mobile platform 200 includes at least one processor 201 and a camera 203.
[0042] The imaging device 203 is used to capture images, and at least one processor 201 is used to control the mobile platform 200 to perform the following steps: sending a broadcast signal from a broadcast channel and transmitting the images captured by the imaging device 203 from an image transmission channel.
[0043] See Figure 3 , Figure 3 This is a schematic diagram of the broadcast channel used for transmitting broadcast information and the image transmission channel used for transmitting image information in the mobile platform 200 of this application. Figure 3 As shown, broadcast signals occupy a fixed frequency in the frequency domain and cannot be changed, while image transmission channels can occupy multiple frequencies.
[0044] In some embodiments, the image transmission channel can switch the image transmission frequency according to the current frequency occupancy. For example, if the mobile platform 200 uses a certain frequency (2.4GHz) to transmit images, and it finds that the current frequency has a large amount of data, it can automatically select another frequency (5GHz) with a smaller amount of data to transmit images, thereby avoiding data congestion and improving the anti-interference capability of the mobile platform 200.
[0045] Combination Figures 1-3 In this embodiment, at least one processor 101 of the user terminal 100 is configured to perform the following steps: receiving a broadcast signal transmitted by at least one mobile platform 200 from a broadcast channel, wherein the broadcast signal includes identification information of the mobile platform 200 and the frequency of the image transmission channel used by the mobile platform 200 for transmitting images. A control display device 103 displays the identification information of at least one mobile platform 200 to assist the user in selecting a target mobile platform from the at least one mobile platform 200; detecting a first mobile platform selection operation by the user, and selecting a target mobile platform from the at least one mobile platform 200 based on the detected first mobile platform selection operation; receiving an image transmitted by the target mobile platform from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images; and displaying the received image on the control display device 103.
[0046] In some embodiments, the first movable platform selection operation may be a selection operation performed by the user based on the identification information of the movable platform displayed on the display device 103 (e.g., tap selection, box selection, voice selection, gesture selection, etc.).
[0047] In some embodiments, receiving a broadcast signal transmitted by a mobile platform 200 from a broadcast channel includes: detecting a user's image display selection operation; and receiving at least one broadcast signal transmitted by a mobile platform 200 from the broadcast channel in response to the detected image display selection operation.
[0048] In some embodiments, the image display selection operation can be performed by the user clicking an icon on the GUI of the display terminal or clicking on a touch screen, or by clicking a button on the user terminal 100.
[0049] The identification information is used to characterize the features of the mobile platform 200 (e.g., the name of the mobile platform). The user terminal 100 displays the identification information on the display device to assist the user in selecting a target identification information from the identification information and using the mobile platform 200 corresponding to the target identification information as the target platform.
[0050] In some embodiments, the frequency of the image transmission channel of each of the at least one mobile platform 200 is different from the frequency of the broadcast channel. (See attached...) Figure 3 As shown, the broadcast channel occupies a fixed frequency across the entire frequency domain, and its frequency differs from that of the image transmission channel. In contrast, the image transmission channel can have multiple different frequencies, and its frequency is variable.
[0051] In some embodiments, detecting a user's first mobile platform selection operation and selecting a target mobile platform from at least one mobile platform 200 based on the detected operation includes: detecting the user's first mobile platform selection operation, determining target identification information from the identification information of at least one mobile platform 200 based on the detected operation, and identifying the mobile platform corresponding to the target identification information as the target mobile platform.
[0052] In some embodiments, the identification information includes at least one of the following: the location of the mobile platform 200, the user's identity information of the mobile platform 200, and the device name of the mobile platform 200. On the one hand, a user can select a mobile platform located at a specific location to watch by using the location of the mobile platform 200 (e.g., GPS positioning); on the other hand, a user can select a mobile platform operated by that user to watch by using the user's identity information of the mobile platform 200 (e.g., user's name, ID, ID card number, etc.); furthermore, a user can also directly select the mobile platform they wish to watch by using the name of the mobile platform (e.g., mobile platform's ID, SN code, MAC address, etc.).
[0053] In some embodiments, at least one processor 101 is further configured to: when the image transmitted by the determined target mobile platform is abnormal, re-determine a target mobile platform from at least one mobile platform 200; the abnormal image transmission signal may be that the user terminal is unable to obtain an image from the target mobile platform, or the user terminal is unable to decode the image obtained from the target mobile platform, etc.; at this time, the user terminal 100 may re-select a target platform from the remaining mobile platforms, and receive the image information captured by the target platform in the image transmission channel that sends image information on the target platform.
[0054] In some embodiments, at least one processor 101 is further configured to: receive images transmitted by the target mobile platform from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the redefined target mobile platform for transmitting images; and control a display device to display the received images.
[0055] In some embodiments, at least one processor 101 is further configured to: when the image transmitted by the determined target mobile platform is abnormal, re-determine a target mobile platform from at least one mobile platform 200, including: when the image transmitted by the determined target mobile platform is abnormal, outputting a prompt message to prompt the user to perform a second mobile platform selection operation, based on which the user can re-select the mobile platform they wish to view; and re-determining a target mobile platform from at least one mobile platform 200 based on the detected second mobile platform selection operation of the user.
[0056] In some embodiments, the identification information of the mobile platform may also include the location information of the mobile platform.
[0057] In some embodiments, at least one processor 101 is further configured to: when the image transmitted by the determined target mobile platform is abnormal, select the mobile platform closest to the user terminal 100 as the target mobile platform based on the location information of the mobile platform 200.
[0058] In some embodiments, the identification information of the mobile platform may also include the signal-to-noise ratio of the mobile platform.
[0059] In some embodiments, at least one processor 101 is further configured to: when the image transmitted by the determined target mobile platform is abnormal, select the mobile platform with the highest signal-to-noise ratio as the target mobile platform based on the signal-to-noise ratio of the mobile platform 200.
[0060] In some embodiments, the identification information of the mobile platform may also include the signal strength of the mobile platform.
[0061] In some embodiments, at least one processor 101 is further configured to: when the image transmitted by the determined target mobile platform is abnormal, select the mobile platform with the highest signal strength as the target mobile platform based on the signal-to-noise ratio of the mobile platform 200.
[0062] In some embodiments, receiving an image from a mobile platform 400 paired with a user terminal 100 and controlling the display device to display the received image includes switching the image displayed by the display device from the image received by the mobile platform 400 paired with the user terminal 100 to the image transmitted by the target mobile platform.
[0063] See Figure 4 , Figure 4 This is a schematic diagram of a mobile platform 400 paired with a user terminal 100.
[0064] In some embodiments, at least one processor 201 is further configured to receive images from a mobile platform 400 paired with the user terminal 100. It should be noted that the user terminal (e.g., FPV glasses, remote control, etc.) is typically paired with a mobile platform 400 for user operation. The mobile platform 400 can refer to various platforms capable of moving automatically or under controlled conditions via their own power system, such as drones, vehicles, unmanned vehicles, ground robots, unmanned boats, etc. A mobile platform can also be a portable platform or electronic device capable of changing position when carried by a mobile third party, such as consumer electronics (including gimbal cameras, mobile terminals, mobile phones, PDAs, etc.). Normally, the user terminal 100 is used to display images taken by the mobile platform 400 paired with it. When the user terminal 100 receives a mobile platform selection operation from the user, it determines the target mobile platform, automatically accesses the image transmission channel of the target mobile platform, acquires the images taken by the target mobile platform, and controls its own display device 103 to switch from displaying images taken by the mobile platform 400 paired with the user terminal 100 to displaying images taken by the target mobile platform.
[0065] In some embodiments, the mobile platform 400 includes at least one processor 401 and a camera device 403.
[0066] The imaging device 403 is used to capture images, and at least one processor 401 is used to control the imaging device to capture images and to transmit the images captured by the imaging device 403.
[0067] In some embodiments, the mobile platform 400 paired with the user terminal 100 is different from at least one mobile platform 200.
[0068] In some embodiments, at least one processor 101 is further configured to: receive an image from a mobile platform 400 paired with the user terminal 100 when an image transmitted by a determined target mobile platform is abnormal.
[0069] For example, when the user terminal 100 cannot receive an image from the image transmission channel of the target mobile platform, or when the user terminal 100 cannot properly decode the image received from the image transmission channel of the target mobile platform, the user terminal 100 will receive the image captured by the shooting device of the mobile platform 400 from the image transmission channel of the mobile platform 400 paired with the user terminal.
[0070] In some embodiments, at least one processor 101 is further configured to: control a display device to display an image received from the mobile platform 200 paired with the user terminal 100 when no broadcast signal is received from the mobile platform 200 on the broadcast channel.
[0071] In some embodiments, at least one processor 101 is further configured to: control the display device to display an image received from the mobile platform 400 paired with the user terminal 100 when no user's first mobile platform selection operation is detected within a preset time period (e.g., 10 seconds) after the display of identification information.
[0072] In some embodiments, displaying identification information of at least one movable platform 200 on a display device includes: saving the received identification information of at least one movable platform 200 in a list and displaying the list on the display device.
[0073] In some embodiments, the broadcast signal includes an identifier of a mobile platform; the user terminal 100 selects a mobile platform 200 corresponding to the selected identifier from at least one mobile platform 200 as the target mobile platform based on the identifier selected by the user.
[0074] In some embodiments, the identification information further includes geographic location information to indicate the geographic location of at least one mobile platform 200; when the user terminal 100 receives a broadcast signal sent by at least one mobile platform 200, the identification information of the mobile platform 200 is stored in a list and the list is displayed on the display device of the user terminal.
[0075] In some embodiments, the broadcast signal includes the frequency of an image transmission channel through which at least one mobile platform 200 transmits image transmission signals; at least one processor 101 is further configured to: the user terminal 100 receive images transmitted by the target mobile platform from the image transmission channel through which the target mobile platform transmits image transmission signals, according to the frequency of the image transmission channel.
[0076] In some embodiments, the frequency of the broadcast channel is fixed. This allows the user terminal 100 to always know the frequency of the broadcast channel used by the mobile platform 200 to transmit broadcast signals, and to receive the broadcast signals transmitted by the mobile platform 200 from the broadcast channel based on the frequency of the broadcast channel.
[0077] In some embodiments, the frequency of the image transmission channel can be fixed or variable.
[0078] See Figure 5 , Figure 5 This is a flowchart of an embodiment of the information processing method applied to a user terminal in this application.
[0079] S501: Receive a broadcast signal transmitted by at least one mobile platform from a broadcast channel, wherein the broadcast signal includes identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform to transmit images.
[0080] For example, at least one processor 201 of a mobile platform 200 (e.g., a drone, vehicle, unmanned vehicle, ground robot, unmanned boat, etc. with a camera) is configured to send identification information of the mobile platform 200 and transmit images captured by a shooting device 203 (e.g., a gimbal camera, etc.) via an image transmission channel; and broadcast a signal of the frequency of the image transmission channel used by the mobile platform 200 to transmit the images; at least one processor 101 of a user terminal 100 (e.g., VR glasses) is configured to receive the broadcast signal sent by at least one mobile platform 200 from the broadcast channel.
[0081] S503: The control display device 103 displays identification information of at least one movable platform 200 to assist the user in selecting a target movable platform from at least one movable platform 200.
[0082] For example, user terminal 100 displays identification information on display device 103 of user terminal 100 (e.g., LCD display, LED display, touch screen, etc.); user can select a mobile platform 200 from at least one mobile platform 200 by selecting the identification information (e.g., by clicking on the screen).
[0083] S505: Detect the user's first mobile platform selection operation, and select a target mobile platform from at least one mobile platform 200 based on the detected first mobile platform selection operation.
[0084] S507: Receive images transmitted by the target mobile platform from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images.
[0085] S509: Display the received image on the display device 103.
[0086] For example, the target mobile platform receives an image captured by a shooting device from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used for image transmission in the broadcast signal sent by the target mobile platform, and displays the image on the display device 103.
[0087] In some embodiments, the first mobile platform selection operation may be a selection operation performed by the user based on the identification information of the mobile platform displayed on the display device 103 (e.g., tapping, boxing, voice selection, gesture selection, etc.), and the user selects the mobile platform they wish to watch based on this operation.
[0088] In some embodiments, receiving a broadcast signal transmitted by a mobile platform 200 from a broadcast channel includes: detecting a user's image display selection operation; and receiving at least one broadcast signal transmitted by a mobile platform 200 from the broadcast channel in response to the detected image display selection operation.
[0089] In some embodiments, the image display selection operation can be performed by the user clicking an icon on the GUI of the display terminal or clicking on a touch screen, or by clicking a button on the user terminal 100.
[0090] In some embodiments, the frequency of the image transmission channel of each of the at least one mobile platform 200 is different from the frequency of the broadcast channel. (See attached...) Figure 3 As shown, the broadcast channel occupies a fixed frequency across the entire frequency domain, and its frequency differs from that of the image transmission channel. In contrast, the image transmission channel can have multiple different frequencies, and its frequency is variable.
[0091] In some embodiments, the identification information includes at least one of the following: the location of the mobile platform 200, the user identification information of the mobile platform 200, and the device name of the mobile platform 200.
[0092] In some embodiments, the method further includes: when the image transmitted by the determined target mobile platform is abnormal, re-determining a target mobile platform from at least one mobile platform 200; the abnormal image transmission signal may be that the target mobile platform no longer transmits the image it has captured from the image transmission channel, at which time the user terminal 100 may re-select a target platform from the remaining mobile platforms and receive the image information captured by the target platform in the image transmission channel of the target platform that transmits image information.
[0093] In some embodiments, the method further includes: receiving images transmitted by the target mobile platform from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the redefined target mobile platform for transmitting images; and controlling the display device to display the received images.
[0094] In some embodiments, when the image transmitted by the determined target mobile platform is abnormal, a new target mobile platform is determined from at least one mobile platform 200, including: when the image transmitted by the determined target mobile platform is abnormal, outputting a prompt message to prompt the user to perform a second mobile platform selection operation; and, based on the detected second mobile platform selection operation of the user, re-determining a target mobile platform from at least one mobile platform 200.
[0095] In some embodiments, the identification information of the mobile platform may also include the location information of the mobile platform.
[0096] In some embodiments, the method further includes: when the image transmitted by the determined target mobile platform is abnormal, selecting the mobile platform closest to the user terminal 100 as the target mobile platform based on the location information of the mobile platform 200.
[0097] In some embodiments, the identification information of the mobile platform may also include the signal-to-noise ratio of the mobile platform.
[0098] In some embodiments, the method further includes: when the image transmitted by the determined target mobile platform is abnormal, selecting the mobile platform with the highest signal-to-noise ratio as the target mobile platform based on the signal-to-noise ratio of the mobile platform 200.
[0099] In some embodiments, the identification information of the mobile platform may also include the signal strength of the mobile platform.
[0100] In some embodiments, the method further includes: when the image transmitted by the determined target mobile platform is abnormal, selecting the mobile platform with the highest signal strength as the target mobile platform based on the signal-to-noise ratio of the mobile platform 200.
[0101] In some embodiments, the method further includes: receiving an image from a mobile platform 400 paired with the user terminal 100; controlling the display device to display the received image, including: switching the image displayed by the display device from the image received by the mobile platform 400 paired with the user terminal 100 to the image transmitted by the target mobile platform.
[0102] In some embodiments, the method further includes: receiving an image from a mobile platform 400 paired with the user terminal 100 when the image transmitted by the target mobile platform is abnormal. For example, when the user terminal 100 cannot receive an image from the image transmission channel of the target mobile platform, the user terminal 100 will receive an image captured by the imaging device of the mobile platform 400 from the image transmission channel of the mobile platform 400 paired with the user terminal.
[0103] In some embodiments, the method further includes: when no broadcast signal is received from the mobile platform 200 on the broadcast channel, controlling the display device to display an image received from the mobile platform 200 paired with the user terminal 100.
[0104] In some embodiments, the method further includes: if no user's first mobile platform selection operation is detected within a preset time period (e.g., 10 seconds) after the display of identification information, controlling the display device to display an image received from the mobile platform 400 paired with the user terminal 100.
[0105] In some embodiments, displaying identification information of at least one movable platform 200 on a display device includes: saving the received identification information of at least one movable platform 200 in a list and displaying the list on the display device.
[0106] In some embodiments, the broadcast signal includes an identifier of a mobile platform; the user terminal 100 selects a mobile platform 200 corresponding to the selected identifier from at least one mobile platform 200 as the target mobile platform based on the identifier selected by the user.
[0107] In some embodiments, the identification information further includes geographic location information to indicate the geographic location of at least one mobile platform 200; when the user terminal receives a broadcast signal sent by at least one mobile platform 200, the identification information and geographic location information of the mobile platform 200 are saved in a list and the list is displayed on the display device of the user terminal.
[0108] In some embodiments, the broadcast signal includes the frequency of an image transmission channel through which at least one mobile platform 200 transmits image transmission signals; the user terminal 100 receives images transmitted by the target mobile platform from the image transmission channel through which the target mobile platform transmits image transmission signals, according to the frequency of the image transmission channel.
[0109] In some embodiments, the frequency of the broadcast channel is fixed.
[0110] In some embodiments, the frequency of the image transmission channel can be fixed or variable.
[0111] See Figure 6 , Figure 6 This is a schematic diagram of the information processing system of this application. The system 600 includes X mobile platforms 601, 602, 603...60X, and N user terminals 701, 702, 703...70N.
[0112] It should be noted that the user terminals 701-70N in this embodiment can refer to various mobile terminal devices with display devices, such as mobile phones, PDAs, remote controls, VR glasses, FPV glasses, etc.
[0113] Each user terminal 701-70N includes at least one first processor and a display device.
[0114] Each mobile platform 601-60X includes at least one second processor and a shooting device.
[0115] The display device is used to display information from broadcast signals received from the broadcast channel and images received from the image transmission channel. At least one processor of the user terminal 701-70N is used to receive broadcast signals from the broadcast channel and image signals from the image transmission channel, and to control the display device of the user terminal 701-70N to display information from broadcast signals received from the broadcast channel and images received from the image transmission channel.
[0116] The mobile platforms 601-60X in this embodiment can refer to various platforms that can move automatically or under controlled conditions through their own power system, such as drones, vehicles, unmanned vehicles, ground robots, unmanned boats, etc. A mobile platform can also be a portable platform or electronic device that can change position when carried by a moving third party, such as consumer electronics (including gimbals, mobile terminals, mobile phones, etc.) and industrial / agricultural electronic products (e.g., remote controls), etc.
[0117] Each mobile platform 601-60X includes: at least one processor and a camera.
[0118] The imaging device of the mobile platform 601-60X is used to capture images, and at least one processor of the mobile platform 601-60X is used to control the mobile platform 601-60X to perform the following steps: sending a broadcast signal from a broadcast channel and transmitting the images captured by the imaging device from an image transmission channel.
[0119] Combination Figure 3 , Figure 6 In this embodiment, system 600 includes at least one user terminal 701-70N and at least one mobile platform 601-60X. At least one second processor of at least one mobile platform 601-60X (e.g., a drone, vehicle, unmanned vehicle, ground robot, unmanned boat, etc. with a camera) is configured to send identification information of the mobile platform 601-60X and transmit images captured by a camera (e.g., a gimbal camera, etc.) via an image transmission channel; (e.g., the mobile platform's ID, owner's name, MAC address, etc.) and a broadcast signal of the frequency of the image transmission channel used by the mobile platform 601-60X for image transmission; at least one first processor of user terminal 701 (e.g., VR glasses) is configured to receive signals from the broadcast channel from at least one mobile platform 601-70N. The broadcast signal is transmitted by 60X, and the identification information is displayed on the display device (e.g., LCD screen, LED screen, touch screen, etc.) of the user terminal 701; the user selects a mobile platform (e.g., 603) from at least one mobile platform 601-60X by selecting the identification information; based on the detected mobile platform selection operation of the user, the selected mobile platform 603 is taken as the target mobile platform; then, according to the frequency of the image transmission channel used for image transmission in the broadcast signal transmitted by the target mobile platform, the image captured by the shooting device transmitted by the target mobile platform is received from the image transmission channel of the target mobile platform, and the image is displayed on the display device.
[0120] In some embodiments, X is equal to N.
[0121] In some embodiments, X is not equal to N.
[0122] In some embodiments, the first mobile platform selection operation may be a selection operation performed by the user based on the identification information of the mobile platform 200 displayed on the display terminal (e.g., tap selection, box selection, voice selection, gesture selection, etc.).
[0123] In some embodiments, at least one first processor is further configured to: receive a broadcast signal transmitted by the mobile platform 601-60X from the broadcast channel, including: detecting a user's image display selection operation; and in response to the detected image display selection operation, receiving at least one broadcast signal transmitted by the mobile platform 601-60X from the broadcast channel.
[0124] In some embodiments, the image display selection operation can be performed by the user clicking an icon on the GUI of the display terminal or clicking on a touch screen, or by clicking a button on the user terminal 701.
[0125] In some embodiments, the frequency of the image transmission channel of each of at least one mobile platform 601-60X is different from the frequency of the broadcast channel. (See attached...) Figure 3 As shown, the broadcast channel occupies a fixed frequency across the entire frequency domain, and its frequency differs from that of the image transmission channel. In contrast, the image transmission channel can have multiple different frequencies, and its frequency is variable.
[0126] In some embodiments, the identification information includes at least one of the following: the location of the mobile platform 601-60X, the user identification information of the mobile platform 601-60X, and the device name of the mobile platform 601-60X.
[0127] In some embodiments, at least one first processor is further configured to: when the image transmitted by the determined target mobile platform is abnormal, re-determine a target mobile platform from at least one mobile platform 601-60X; the abnormal image transmission signal may be that the target mobile platform no longer transmits the images it has captured from the image transmission channel, at which time the user terminal 701 may re-select a target platform from the remaining mobile platforms and receive the image information captured by the target platform in the image transmission channel of the target platform that transmits image information.
[0128] In some embodiments, at least one first processor is further configured to: receive images transmitted by the target mobile platform from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the redefined target mobile platform for transmitting images; and control the display device to display the received images.
[0129] In some embodiments, when the image transmitted by the determined target mobile platform is abnormal, a new target mobile platform is determined from at least one mobile platform 601-60X, including: when the image transmitted by the determined target mobile platform is abnormal, outputting a prompt message to prompt the user to perform a second mobile platform selection operation; and, based on the detected second mobile platform selection operation of the user, re-determining a target mobile platform from at least one mobile platform 601-60X.
[0130] In some embodiments, the identification information of the mobile platform may also include the location information of the mobile platform.
[0131] In some embodiments, at least one first processor is further configured to: when the image transmitted by the determined target mobile platform is abnormal, select the mobile platform closest to the user terminal 701 as the target mobile platform based on the location information of the mobile platforms 601-60X.
[0132] In some embodiments, the identification information of the mobile platform may also include the signal-to-noise ratio of the mobile platform.
[0133] In some embodiments, at least one first processor is further configured to: when the image transmitted by the determined target mobile platform is abnormal, select the mobile platform with the highest signal-to-noise ratio as the target mobile platform based on the signal-to-noise ratio of the mobile platforms 601-60X.
[0134] In some embodiments, the identification information of the mobile platform may also include the signal strength of the mobile platform.
[0135] In some embodiments, at least one first processor is further configured to: when the image transmitted by the determined target mobile platform is abnormal, select the mobile platform with the highest signal strength as the target mobile platform based on the signal-to-noise ratio of the mobile platforms 601-60X.
[0136] In some embodiments, at least one first processor is further configured to: receive an image from a mobile platform 601 paired with a user terminal 701; and control the display device to display the received image, including: switching the image displayed by the display device from the image received by the mobile platform 601 paired with the user terminal 701 to the image transmitted by the target mobile platform 602.
[0137] In some embodiments, each user terminal 701-70N is paired with one of the mobile platforms 601-60M.
[0138] In some embodiments, each of the user terminals 701-70N is paired with one of the mobile platforms 601-60X.
[0139] In some embodiments, when an image transmitted by a determined target mobile platform is abnormal, an image is received from a mobile platform 601 paired with the user terminal 701. For example, when the user terminal 701 cannot receive an image from the image transmission channel of the target mobile platform, the user terminal 701 will receive an image captured by the imaging device of the mobile platform 601 from the image transmission channel of the mobile platform 601 paired with the user terminal.
[0140] In some embodiments, at least one first processor is further configured to: control a display device to display an image received from the mobile platform 601 paired with the user terminal 701 when no broadcast signal is received from the mobile platform 602 on the broadcast channel.
[0141] In some embodiments, at least one first processor is further configured to: control the display device to display an image received from the mobile platform 601 paired with the user terminal when no user's first mobile platform selection operation is detected within a preset time period (e.g., 10 seconds) after the display of identification information.
[0142] In some embodiments, displaying identification information of at least one movable platform on a display device includes: saving the received identification information of at least one movable platform 601-60X in a list and displaying the list on the display device.
[0143] In some embodiments, the broadcast signal includes an identifier of a mobile platform; the user terminal 701 selects a mobile platform 602 corresponding to the selected identifier from at least one mobile platform 601-60X as the target mobile platform based on the identifier selected by the user.
[0144] In some embodiments, the identification information further includes geographic location information to indicate the geographic location of at least one mobile platform 601-60X; when the user terminal receives a broadcast signal sent by at least one mobile platform 601-60X, the identification information and geographic location information of the mobile platform 601-60X are saved in a list and the list is displayed on the display device of the user terminal.
[0145] In some embodiments, the broadcast signal includes the frequency of an image transmission channel through which at least one mobile platform 601-60X transmits image transmission signals; the user terminal 701 receives images transmitted by the target mobile platform from the image transmission channel through which the target mobile platform transmits image transmission signals, according to the frequency of the image transmission channel.
[0146] In some embodiments, the frequency of the broadcast channel is fixed.
[0147] In some embodiments, the frequency of the image transmission channel can be fixed or variable.
[0148] This application also provides a computer-readable medium storing computer instructions for performing the following methods:
[0149] S101: Receive a broadcast signal from at least one mobile platform via a broadcast channel, wherein the broadcast signal includes identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform for transmitting images. For example, at least one processor 201 of the mobile platform 200 (e.g., a drone, vehicle, unmanned vehicle, ground robot, unmanned boat, etc. with a camera) is configured to transmit a broadcast signal containing identification information of the mobile platform 200 and transmitting images captured by a shooting device 203 (e.g., a gimbal camera, etc.) via the image transmission channel; (e.g., the mobile platform's ID, owner's name, MAC address, etc.) and the frequency of the image transmission channel used by the mobile platform 200 for transmitting images; at least one processor 101 of the user terminal 100 (e.g., VR glasses) is configured to receive the broadcast signal from at least one mobile platform 200 via the broadcast channel.
[0150] S103: The control display device 103 displays identification information of at least one movable platform 200 to assist the user in selecting a target movable platform from at least one movable platform 200. For example, the user terminal 100 displays the identification information on the display device 103 of the user terminal 100 (e.g., LCD display, LED display, touch screen, etc.); the user can select a movable platform 200 from at least one movable platform 200 by selecting the identification information (e.g., by tapping on the screen).
[0151] S105: Detect the user's first mobile platform selection operation, and select a target mobile platform from at least one mobile platform 200 based on the detected first mobile platform selection operation.
[0152] S107: Receive images transmitted by the target mobile platform from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images.
[0153] S109: Display the received image on the display device 103. For example: Receive an image captured by the imaging device transmitted by the target mobile platform from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used for image transmission in the broadcast signal sent by the target mobile platform, and display the image on the display device 103.
[0154] It should be understood that the terminology used in this application specification is for the purpose of describing particular embodiments only and is not intended to limit the application.
[0155] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and such modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A user terminal, comprising a display device and at least one first processor, the at least one first processor being configured to perform the following steps: Receive broadcast signals transmitted by at least one mobile platform from the broadcast channel, wherein, The broadcast signal includes the identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform to transmit images. The frequency of the image transmission channel of the mobile platform changes automatically. The display device is controlled to display the identification information of the at least one movable platform to assist the user in selecting a target movable platform from the at least one movable platform; Detect the user's first mobile platform selection operation, and determine the target mobile platform from the at least one mobile platform based on the detected operation; The image transmitted by the target mobile platform is received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images; Control the display device to display the received image.
2. The user terminal according to claim 1, characterized in that, When the first processor receives a broadcast signal from at least one mobile platform via a broadcast channel, it is specifically configured to: Detect the user's image display selection action; In response to the detected image display selection operation, a broadcast signal transmitted by at least one mobile platform is received from the broadcast channel.
3. The user terminal according to claim 1, characterized in that, The frequency of the image transmission channel of each of the at least one mobile platform is different from the frequency of the broadcast channel.
4. The user terminal according to claim 1, characterized in that, The identification information includes at least one of the following: the location of the mobile platform, the user identification information of the mobile platform, and the device name of the mobile platform.
5. The user terminal according to claim 1, characterized in that, When the at least one first processor detects a user's first mobile platform selection operation and selects a target mobile platform from the at least one mobile platform based on the detected operation, it is specifically configured to: The system detects a user's first mobile platform selection operation, determines target identification information from the identification information of the at least one mobile platform based on the detected operation, and identifies the mobile platform corresponding to the target identification information as the target mobile platform.
6. The user terminal according to claim 1, characterized in that, The at least one first processor is further configured to: When the image transmitted by the determined target mobile platform is abnormal, a new target mobile platform is determined from at least one mobile platform; Images transmitted by the target mobile platform are received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the newly determined target mobile platform for image transmission; Control the display device to display the received image.
7. The user terminal according to claim 6, characterized in that, When the image transmitted by the determined target mobile platform is abnormal, the at least one first processor, when re-determining a target mobile platform from the at least one mobile platform, is specifically used for: When the image transmitted by the determined target mobile platform is abnormal, a prompt message is sent to prompt the user to select a second mobile platform. Based on the detected second mobile platform selection operation of the user, a target mobile platform is re-determined from the at least one mobile platform.
8. The user terminal according to claim 1, characterized in that, The at least one first processor is further configured to: Receive images from a mobile platform paired with the user terminal; When the at least one first processor controls the display device to display the received image, it is specifically used for: The image displayed on the display device is switched from the image received by the mobile platform paired with the user terminal to the image transmitted by the target mobile platform.
9. The user terminal according to claim 8, characterized in that, The at least one first processor is further configured to: When the image transmitted by the determined target mobile platform is abnormal, an image is received from the mobile platform paired with the user terminal, and the image displayed on the display device is switched from the image transmitted by the target mobile platform to the image received by the mobile platform paired with the user terminal.
10. The user terminal according to claim 8, characterized in that, The at least one first processor is further configured to: When no broadcast signal is received from the mobile platform on the broadcast channel, the control display device displays the image received from the mobile platform paired with the user terminal.
11. The user terminal according to claim 8, characterized in that, The at least one first processor is further configured to: If no first mobile platform selection operation by the user is detected within a preset time period after the identification information is displayed, the control display device displays the image received from the mobile platform paired with the user terminal.
12. The user terminal according to claim 1, characterized in that, When the at least one first processor displays the identification information of the at least one movable platform on the display device, it is specifically used for: The received identification information of at least one mobile platform is stored in a list, and the list is displayed on the display device.
13. The user terminal according to claim 1, characterized in that, The frequency of the broadcast channel is fixed.
14. An information processing method applied to a user terminal, the user terminal including a display device, the method comprising: Receive broadcast signals from at least one mobile platform via a broadcast channel, wherein the broadcast signals include identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform for transmitting images, and the frequency of the image transmission channel of the mobile platform is automatically changed. The display device is controlled to display the identification information of the at least one movable platform to assist the user in selecting a target movable platform from the at least one movable platform; Detect the user's first mobile platform selection operation, and determine the target mobile platform from the at least one mobile platform based on the detected operation; The image transmitted by the target mobile platform is received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images; Control the display device to display the received image.
15. The method according to claim 14, characterized in that, Receiving a broadcast signal transmitted by at least one mobile platform from the broadcast channel includes: Detect the user's image display selection action; In response to the detected image display selection operation, a broadcast signal transmitted by at least one mobile platform is received from the broadcast channel.
16. The method according to claim 14, characterized in that, The frequency of the image transmission channel of each of the at least one mobile platform is different from the frequency of the broadcast channel.
17. The method according to claim 14, characterized in that, The identification information includes at least one of the following: the location of the mobile platform, the user identification information of the mobile platform, and the device name of the mobile platform.
18. The method according to claim 14, characterized in that, The detection of a user's first mobile platform selection operation, and the selection of a target mobile platform from the at least one mobile platform based on the detected operation, includes: The system detects a user's first mobile platform selection operation, determines target identification information from the identification information of the at least one mobile platform based on the detected operation, and identifies the mobile platform corresponding to the target identification information as the target mobile platform.
19. The method according to claim 14, characterized in that, The method further includes: When the image transmitted by the determined target mobile platform is abnormal, a new target mobile platform is determined from at least one mobile platform; Images transmitted by the target mobile platform are received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the newly determined target mobile platform for image transmission; Control the display device to display the received image.
20. The method according to claim 19, characterized in that, When the image transmitted by the determined target mobile platform is abnormal, re-determining a target mobile platform from at least one mobile platform includes: When the image transmitted by the determined target mobile platform is abnormal, a prompt message is output to prompt the user to select a second mobile platform. Based on the detected second mobile platform selection operation of the user, a target mobile platform is re-determined from the at least one mobile platform.
21. The method according to claim 14, characterized in that, The method further includes: receiving an image from a mobile platform paired with the user terminal; The control of the display device to display the received image includes: The image displayed on the display device is switched from the image received by the mobile platform paired with the user terminal to the image transmitted by the target mobile platform.
22. The method according to claim 21, characterized in that, The method further includes: When the image transmitted by the determined target mobile platform is abnormal, an image is received from the mobile platform paired with the user terminal, and the image displayed on the display device is switched from the image transmitted by the target mobile platform to the image received by the mobile platform paired with the user terminal.
23. The method according to claim 21, characterized in that, The method further includes: When no broadcast signal is received from the mobile platform on the broadcast channel, the control display device displays the image received from the mobile platform paired with the user terminal.
24. The method according to claim 21, characterized in that, The method further includes: If no first mobile platform selection operation by the user is detected within a preset time period after the identification information is displayed, the control display device displays the image received from the mobile platform paired with the user terminal.
25. The method according to claim 14, characterized in that, The display device displays identification information of the at least one movable platform, including: The identification information of the at least one mobile platform received is stored in a list, and the list is displayed on the display device.
26. The method according to claim 14, characterized in that, The frequency of the broadcast channel is fixed.
27. An information processing system, the system comprising at least one user terminal and at least one mobile platform. The user terminal includes a display device and at least one first processor, configured to perform the following steps: In response to a broadcast signal received from the broadcast channel from the at least one mobile platform transmitted by the mobile platform, wherein, The broadcast signal includes the identification information of the mobile platform and the frequency of the image transmission channel used by the mobile platform to transmit images. The frequency of the image transmission channel of the mobile platform changes automatically. The display device is controlled to display the identification information of the at least one movable platform to assist the user in selecting a target movable platform from the at least one movable platform; Detect the user's first mobile platform selection operation, and determine the target mobile platform from the at least one mobile platform based on the detected operation; The image transmitted by the target mobile platform is received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the target mobile platform for transmitting images; Control the display device to display the received image; The movable platform includes a camera and at least one second processor for performing the following steps: The broadcast signal is transmitted from the broadcast channel; The images captured by the imaging device are transmitted from the image transmission channel.
28. The system according to claim 27, characterized in that, When the at least one first processor receives a broadcast signal transmitted by at least one mobile platform from the broadcast channel, it is specifically used for: Detect the user's image display selection action; In response to the detected image display selection operation, a broadcast signal transmitted by at least one mobile platform is received from the broadcast channel.
29. The system according to claim 27, characterized in that, The frequency of the image transmission channel of each of the at least one mobile platform is different from the frequency of the broadcast channel.
30. The system according to claim 27, characterized in that, The identification information includes at least one of the following: the location of the mobile platform, the user identification information of the mobile platform, and the device name of the mobile platform.
31. The system according to claim 27, characterized in that, When the at least one first processor detects a user's first mobile platform selection operation and selects a target mobile platform from the at least one mobile platform based on the detected operation, it is specifically configured to: The system detects a user's first mobile platform selection operation, determines target identification information from the identification information of the at least one mobile platform based on the detected operation, and identifies the mobile platform corresponding to the target identification information as the target mobile platform.
32. The system according to claim 27, characterized in that, The at least one first processor is further configured to: When the image transmitted by the determined target mobile platform is abnormal, a new target mobile platform is determined from at least one mobile platform; Images transmitted by the target mobile platform are received from the image transmission channel of the target mobile platform according to the frequency of the image transmission channel used by the newly determined target mobile platform for image transmission; Control the display device to display the received image.
33. The system according to claim 27, characterized in that, When the image transmitted by the determined target mobile platform is abnormal, the at least one first processor re-determines a target mobile platform from the at least one mobile platform, specifically for: When the image transmitted by the determined target mobile platform is abnormal, a prompt message is output to prompt the user to select a second mobile platform. Based on the detected second mobile platform selection operation of the user, a target mobile platform is re-determined from the at least one mobile platform.
34. The system according to claim 27, characterized in that, The at least one first processor is further configured to: Receive images from a mobile platform paired with the user terminal; When the at least one first processor controls the display device to display the received image, it is specifically used for: The image displayed on the display device is switched from the image received by the mobile platform paired with the user terminal to the image transmitted by the target mobile platform.
35. The system according to claim 34, characterized in that, The at least one first processor is further configured to: When the image transmitted by the determined target mobile platform is abnormal, an image is received from the mobile platform paired with the user terminal, and the image displayed on the display device is switched from the image transmitted by the target mobile platform to the image received by the mobile platform paired with the user terminal.
36. The system according to claim 34, characterized in that, The at least one first processor is further configured to: When no broadcast signal is received from the mobile platform on the broadcast channel, the control display device displays the image received from the mobile platform paired with the user terminal.
37. The system according to claim 34, characterized in that, The at least one first processor is further configured to: If no first mobile platform selection operation by the user is detected within a preset time period after the identification information is displayed, the control display device displays the image received from the mobile platform paired with the user terminal.
38. The system according to claim 27, characterized in that, The at least one first processor displays the identification information of the at least one movable platform on the display device, specifically for: The received identification information of at least one mobile platform is stored in a list, and the list is displayed on the display device.
39. The system according to claim 27, characterized in that, The frequency of the broadcast channel is fixed.
Citation Information
Patent Citations
A control terminal control method and a control terminal
CN108700886A
Trajectory determination method, device and equipment for movable platform and storage medium
CN112198541A