Image processing method, device, intelligent terminal and computer-readable storage medium

Abstract

The present invention discloses an image processing method, device, intelligent terminal, and computer-readable storage medium. The image processing method comprises: acquiring image data and flight data from an aircraft in real time; performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image; and outputting the visually enhanced image to a target object. Compared to prior art methods that directly transmit images captured by an aircraft to a user, the present invention performs visual enhancement processing on the image data before transmitting it to the user. This improves the visual effects and entertainment value of the image, provides the user with an immersive visual experience, and enhances the user experience.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to an image processing method, device, intelligent terminal and computer-readable storage medium. Background Art

[0002] With the rapid development of science and technology, people's interest in entertainment devices and their demand for entertainment experiences are gradually increasing. Drones, as entertainment devices that can provide users with aerial images, are also gaining increasing attention. As aircraft, drones can fly freely in the air under user control, reaching altitudes of several thousand meters. During flight, they capture and transmit high-altitude images to users, allowing them to enjoy these images.

[0003] In existing technology, aerial photography is typically performed using drones and other flying devices to obtain high-altitude images and transmit them to users. However, the problem with existing technology is that when images captured by flying devices are directly transmitted to users, the visual effects are mediocre and the entertainment value is low. This fails to provide users with an immersive visual experience, hindering the user experience.

[0004] Therefore, the existing technology still needs to be improved and developed. Summary of the Invention

[0005] The main purpose of the present invention is to provide an image processing method, device, intelligent terminal and computer-readable storage medium, aiming to solve the problem in the prior art that when aerial photography is performed using flying equipment such as drones, the images taken by the flying equipment are directly transmitted to the user, resulting in mediocre visual effects and low entertainment value, which cannot provide the user with an immersive visual experience and is not conducive to improving the user experience.

[0006] In order to achieve the above object, the present invention provides an image processing method in a first aspect, wherein the method comprises:

[0007] Acquire image data and flight data of flight equipment in real time;

[0008] Performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image;

[0009] The visually enhanced image is output to the target object.

[0010] Optionally, the real-time acquisition of image data and flight data of the flight equipment includes:

[0011] Acquiring real-time high-definition images of a real scene transmitted by the aerial device as image data, wherein the real-scene high-definition images are images captured by a binocular stereo camera of the aerial device and have a resolution greater than or equal to a preset resolution;

[0012] Acquire the flight data of the above-mentioned flying device in real time, wherein the above-mentioned flight data includes the flight speed, flight angle and geographical location information of the above-mentioned flying device.

[0013] Optionally, performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image includes:

[0014] Obtaining a target perspective, wherein the target perspective is a first-person perspective or a third-person perspective;

[0015] When the target perspective is a first-person perspective, the image data is superimposed on a preset virtual cockpit image, and flight parameters in the superimposed virtual cockpit image are controlled based on the flight data to obtain a visually enhanced image.

[0016] Optionally, performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image further includes:

[0017] When the target perspective is a third-person perspective, an appearance image of the flying device is acquired, and the image data and the appearance image are superimposed to obtain a visually enhanced image.

[0018] Optionally, after performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image, the method further includes:

[0019] Obtain the superposition coordinates of the target superposition object and the above target superposition object;

[0020] The target superimposed object is superimposed on the visually enhanced image based on the superimposed coordinates.

[0021] Optionally, the above-mentioned flying device is a drone, and before the above-mentioned real-time acquisition of image data and flight data of the flying device, the above-mentioned method further includes:

[0022] Obtain flight operation instructions of the target object;

[0023] The flight action of the UAV is controlled based on the flight operation instructions.

[0024] Optionally, outputting the visually enhanced image to the target object includes:

[0025] The visually enhanced image is output to the target object via a VR device.

[0026] A second aspect of the present invention provides an image processing device, wherein the device comprises:

[0027] Data acquisition module, used to acquire image data and flight data of flight equipment in real time;

[0028] An image processing module, configured to perform visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image;

[0029] The output module is used to output the visually enhanced image to the target object.

[0030] A third aspect of the present invention provides an intelligent terminal, comprising a memory, a processor, and an image processing program stored in the memory and executable on the processor, wherein the image processing program, when executed by the processor, implements any one of the steps of the image processing method.

[0031] A fourth aspect of the present invention provides a computer-readable storage medium, on which an image processing program is stored. When the image processing program is executed by a processor, the image processing program implements the steps of any one of the above-mentioned image processing methods.

[0032] As can be seen from the above, the present invention acquires image data and flight data from the aircraft in real time; visually enhances the image data based on the flight data to produce a visually enhanced image; and outputs the visually enhanced image to the target object. Compared to prior art solutions that directly transmit images captured by the aircraft to the user, the present invention performs visual enhancement processing on the image data before transmitting it to the user. This improves the visual quality and entertainment value of the images, providing users with an immersive visual experience and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0034] Figure 1 is a flowchart of an image processing method provided by an embodiment of the present invention;

[0035] Figure 2 This is an embodiment of the present invention Figure 1 Specific flow diagram of step S100;

[0036] Figure 3 This is an embodiment of the present invention Figure 1 Specific flow diagram of step S200;

[0037] Figure 4 This is an embodiment of the present invention Figure 1 Specific flow diagram of step S200;

[0038] Figure 5 This is a schematic diagram of image processing based on a drone provided by an embodiment of the present invention;

[0039] Figure 6 This is a schematic diagram of an image processing flow provided by an embodiment of the present invention;

[0040] Figure 7 is a structural diagram of an image processing device provided by an embodiment of the present invention;

[0041] Figure 8 This is a block diagram of the internal structure principle of a smart terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0042] In the following description, specific details such as particular system structures and techniques are provided for purposes of illustration, not limitation, to facilitate a thorough understanding of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

[0043] It will be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0044] It should also be understood that the terms used in the present specification are only for the purpose of describing particular embodiments and are not intended to limit the present invention. As used in the present specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0045] It should be further understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0046] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0047] The following is a clear and complete description of the technical solutions in the embodiments of the present invention, in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0048] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0049] With the rapid development of science and technology, people's interest in entertainment devices and their demand for entertainment experiences are gradually increasing. Drones, as entertainment devices that can provide users with aerial images, are also gaining increasing attention. As an aircraft, drones can fly freely in the air under user control, reaching altitudes of several thousand meters and distances of tens of kilometers. During flight, they capture and transmit aerial images to the user, allowing them to enjoy these views. Specifically, these images can be recorded on the drone's storage device or transmitted via wireless communication or wireless networks to a ground-based screen for display, allowing users to observe the images captured during flight or control the drone in real time.

[0050] Existing technology typically uses drones and other aerial devices to capture high-altitude images and transmit them directly to users. This fails to fully utilize the image information provided by drones and fails to further utilize drone flight for entertainment or gaming-level applications. The problem with existing technology is that when images captured by drones are directly transmitted to users, the visual effects are mediocre and lack entertainment value. This fails to provide users with an immersive visual experience, hindering the user experience.

[0051] To address the challenges of the prior art, the present invention provides an image processing method. In an embodiment of the present invention, image data and flight data from an aircraft are acquired in real time; visual enhancement processing is performed on the image data based on the flight data to obtain a visually enhanced image; and the visually enhanced image is output to a target object. Compared to prior art methods that directly transmit images captured by an aircraft to a user, the present invention performs visual enhancement processing on the image data before transmitting it to the user. This improves the visual quality and entertainment value of the image, providing the user with an immersive visual experience and enhancing the user experience.

[0052] Exemplary Methods

[0053] like Figure 1 As shown, an embodiment of the present invention provides an image processing method. Specifically, the method includes the following steps:

[0054] Step S100: Acquire image data and flight data of the flight equipment in real time.

[0055] The aerial device is equipped with at least one camera for capturing and obtaining image data. The image data may be pictures or videos captured by the aerial device via the camera, without limitation. The flight data includes motion parameters of the aerial device during flight, such as flight speed.

[0056] Step S200 , performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image.

[0057] Specifically, the image data is visually enhanced using augmented reality (AR) technology. For example, other objects are virtually superimposed on the original image or video, along with flight parameters of the aircraft, to produce a corresponding visually enhanced image. The resulting visually enhanced image combines virtual and real elements, resulting in richer content and greater visual appeal. Alternatively, real-time visual enhancement processing can be performed on the image data using a ground-based computer.

[0058] Step S300: output the visually enhanced image to the target object.

[0059] The target object is a user who obtains the corresponding high-altitude image through a flying device. Outputting the corresponding visual enhancement image to the target image can enable the user to obtain a better image viewing experience, obtain better visual effects, and enhance entertainment.

[0060] As can be seen from the foregoing, the image processing method provided by the embodiments of the present invention acquires image data and flight data from an aircraft in real time; performs visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image; and outputs the visually enhanced image to a target object. Compared to prior art methods that directly transmit images captured by an aircraft to a user, the present invention performs visual enhancement processing on the image data before transmitting it to the user. This improves the visual quality and entertainment value of the images, provides users with an immersive visual experience, and enhances the user experience.

[0061] Specifically, in this embodiment, Figure 2 As shown, the above step S100 includes:

[0062] Step S101 , obtaining in real time a real-scene high-definition image transmitted by the above-mentioned flying device as image data, wherein the above-mentioned real-scene high-definition image is a picture taken by the binocular stereo camera of the above-mentioned flying device with a resolution greater than or equal to a preset resolution.

[0063] Step S102: Acquire the flight data of the above-mentioned flying device in real time, wherein the above-mentioned flight data includes the flight speed, flight angle and geographical location information of the above-mentioned flying device.

[0064] In this embodiment, the aforementioned flying device is equipped with a high-resolution binocular stereo camera for capturing high-definition, three-dimensional images of the flight landscape. Specifically, this high-resolution binocular stereo camera can capture images with a resolution greater than a preset resolution. The preset resolution is a pre-set resolution that can be set and adjusted based on actual needs. For example, in this embodiment, it can be set to 3840x2160, corresponding to a refresh rate of 60Hz.

[0065] The distance between the two eyes of the binocular stereo camera can be adjusted according to the depth of the landscape. For example, it can be automatically adjusted by an eye distance adjustment program set in the flight device, or it can be adjusted according to an adjustment instruction sent by the user. No specific limitation is made here. In one application scenario, the flight device is relatively far away from the surrounding buildings during flight, with a distance of tens to hundreds of meters. The eye distance can be adjusted to 160mm. When objects that need to be photographed appear near the flight device, such as clouds and other landscapes or other flight devices, the eye distance of the binocular stereo camera needs to be reduced, for example, adjusted to 60mm, the distance between the human eyes. In this way, the eye distance is adjusted according to the objects to be photographed to ensure the stereoscopic visual effect of the captured image. At the same time, it is convenient to calculate the superimposed coordinates of the corresponding objects when visually enhancing the image, so that the superimposed virtual and real flight landscape can be realistic and have a sense of presence, thereby enhancing the visual experience.

[0066] The above-mentioned flight data includes various parameters during the flight of the above-mentioned flight equipment, such as the flight speed of the flight equipment, flight angle (including horizontal angle and vertical angle), geographic location information, acceleration, altitude, etc., and may also include other parameters. The specific required flight parameters can be set and adjusted according to actual needs, and no specific limitations are made here.

[0067] Optionally, real-time high-definition images and flight data transmitted by the above-mentioned flight equipment can be obtained based on a wireless communication network, for example, by transmitting real-time high-definition images and flight data through 5G mobile communication technology.

[0068] Specifically, in this embodiment, Figure 3 As shown, the above step S200 includes:

[0069] Step S201: Acquire a target perspective, wherein the target perspective is a first-person perspective or a third-person perspective.

[0070] Step S202 : When the target perspective is a first-person perspective, the image data is superimposed on a preset virtual cockpit image, and flight parameters in the superimposed virtual cockpit image are controlled based on the flight data to obtain a visually enhanced image.

[0071] The target perspective is the user's desired viewing angle. In this embodiment, it can be a first-person perspective or a third-person perspective. The first-person perspective simulates the user's perspective within the flight cabin, while the third-person perspective simulates the user's perspective outside the aircraft, able to see the aircraft. The target perspective can be pre-set or selected by the user, or adjusted in real time based on actual needs, without specific limitations.

[0072] Specifically, when the user selects a first-person perspective as the target perspective, a preset virtual cockpit image is obtained and superimposed with the aforementioned image data. Simultaneously, flight parameters in the superimposed virtual cockpit image are controlled based on the flight data of the aircraft during actual flight, resulting in a visually enhanced image. Specifically, the preset cockpit image is a pre-set virtual cockpit image that can be configured and adjusted based on user needs. For example, the color, style, and corresponding parameter display method of the virtual cockpit can be adjusted, though these are not specifically limited herein. The virtual cockpit includes a corresponding virtual instrument panel for displaying corresponding flight parameters, such as a flight map and a flight level. The specific parameter values in the virtual instrument panel can be set based on the aforementioned flight data, providing the user with an immersive visual experience. Specifically, a three-dimensional flight landscape is displayed outside the windshield of the virtual cockpit, simulating a scene where the user is viewing the scenery outside the aircraft through the cockpit.

[0073] Specifically, in this embodiment, Figure 4 As shown, the above step S200 also includes:

[0074] Step S203 : When the target perspective is a third-person perspective, an appearance image of the flying device is obtained, and the image data and the appearance image are superimposed to obtain a visually enhanced image.

[0075] The aforementioned aircraft appearance image can be a pre-recorded real-life image of the corresponding aircraft, or it can be another simulated appearance image based on user needs. For example, if the actual aircraft is a common quadcopter drone, the corresponding appearance image can be the real-life image of the quadcopter, or it can be configured to resemble the appearance of an Apache fighter jet based on user needs, providing a better visual experience for the user.

[0076] Optionally, in this embodiment, after the above step S200, the above method further includes: obtaining a target superposition object and superposition coordinates of the above target superposition object; and superimposing the above target superposition object into the above visual enhancement image based on the above superposition coordinates.

[0077] The target overlay object is a virtual object or virtual landscape to be overlaid, such as a rainbow, a flying bird, a flying dinosaur, or other flying equipment. Other virtual objects or virtual landscapes may also be included, and are not specifically limited here. Optionally, the specific target overlay object can be determined based on user needs. In one application scenario, a viewing mode can be pre-set, such as combat mode or landscape mode, with different target overlay objects assigned to different viewing modes. This allows the user to select the viewing mode selected. The target overlay object is then obtained based on the viewing mode. The position coordinates of the target overlay object in the visually enhanced image are calculated based on the target overlay object's size, attributes (e.g., height), and other parameters. These coordinates are then used as overlay coordinates, and the corresponding target overlay object is overlaid at the corresponding coordinates. For example, when the user selects combat mode, a pre-set fighter jet is overlaid. When the user selects landscape mode, a pre-set rainbow, flying bird, or the like are overlaid. The overlay image corresponding to the target overlay object can be a dynamic image. In this way, objects with both visual and entertainment value are overlaid in the visually enhanced image based on their three-dimensional positions, enhancing the user's visual experience.

[0078] Optionally, other aircraft can also be superimposed on the visually enhanced image. For example, multiple aircraft with the same function in the same airspace can be superimposed on their corresponding positions, and the image of the real aircraft at the corresponding position can be replaced by position calculation, so that different aircraft appearances can be virtually displayed according to user needs. For example, if the current aircraft captures another aircraft B with the same function at position A, the virtual appearance of the above-mentioned aircraft B can be obtained according to user needs and superimposed on the visually enhanced image corresponding to the current aircraft, replacing the real appearance of the aircraft B captured at position A, so that the user sees the virtual appearance of the aircraft B at position A in the visually enhanced image. In this way, different users can display the processed virtual appearance of the aircraft in the visually enhanced images provided by different aircraft. A simulated air combat game combining virtual and real can be played based on the above-mentioned aircraft, making the game process more exciting and improving the entertainment effect.

[0079] Optionally, for objects superimposed onto the ground, such as buildings, mountains, and bridges, the overlay angle and size ratio can be adjusted in real time based on real-time changes in flight position and direction, enhancing the user experience. Furthermore, some pre-set objects in the visually enhanced image can be annotated with text and images in real time. For example, iconic buildings and landscapes can be annotated with names and brief descriptions in real time, providing users with a better viewing experience.

[0080] Optionally, the above-mentioned flying device is a drone. Before the above-mentioned step S100, the above-mentioned method further includes: obtaining a flight operation instruction of the target object; and controlling the flight action of the above-mentioned drone based on the above-mentioned flight operation instruction.

[0081] The aforementioned flight control instructions are instructions issued by a target object for controlling the aforementioned drone. In this embodiment, the target object (i.e., the user) can issue flight control instructions on the ground, which are then transmitted to the corresponding drone via wireless communication or other transmission methods, thereby controlling the drone's flight maneuvers. Alternatively, the user can issue the corresponding flight control instructions using a simulated flight joystick or an intelligent device such as a computer, which is not specifically limited here.

[0082] Optionally, the above step S300 includes: outputting the above visually enhanced image to the target object through a VR device.

[0083] Specifically, the corresponding visually enhanced image is output based on virtual reality (VR) technology. The VR device may be VR glasses or a VR helmet. Optionally, the visually enhanced image may be displayed using a naked-eye 3D screen or other type of 3D display, which is not specifically limited herein.

[0084] In this embodiment, the above image processing method is further described based on a specific application scenario. Figure 5 is a schematic diagram of image processing based on a drone provided by an embodiment of the present invention. Figure 6 This is a schematic diagram of an image processing process provided by an embodiment of the present invention. The above-mentioned drone is provided with a binocular stereo camera for capturing and obtaining real-scene video. Figure 5 and Figure 6 As shown, in this application scenario, the real-life video and flight parameter data are transmitted to a computer via wireless transmission or storage media for caching. Simultaneously, the computer obtains the required overlay images and performs overlay processing using corresponding processing software to generate a visually enhanced image. Specifically, a cockpit instrument model and models from a library of virtual overlay object models are obtained. The real-time flight instrument parameters in the virtual cockpit are filled in, and the 3D position coordinates of the objects to be virtually overlaid are calculated. The overlaid objects are then added to the real-life video in real time and rendered in real-time. A VR video is then generated based on the rendered video and output. For example, a corresponding video can be output to a VR headset using virtual reality technology. This video, after computer processing, includes cockpit overlay information, with clouds, sunlight, wind and rain, virtual buildings on the ground, and other third-party aircraft superimposed in real-time in a 3D environment. Switching between first-person and third-person perspectives allows users to experience enhanced entertainment, gaming, and excitement during drone flight. Optionally, the position coordinates of the overlaid objects can be adjusted in real time based on the drone's flight position, providing users with a better visual experience.

[0085] Exemplary devices

[0086] like Figure 7 As shown in , corresponding to the above-mentioned image processing method, an embodiment of the present invention further provides an image processing device, and the above-mentioned image processing device includes:

[0087] The data acquisition module 410 is used to acquire image data and flight data of the flight equipment in real time.

[0088] The aerial device is equipped with at least one camera for capturing and obtaining image data. The image data may be pictures or videos captured by the aerial device via the camera, without limitation. The flight data includes motion parameters of the aerial device during flight, such as flight speed.

[0089] The image processing module 420 is configured to perform visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image.

[0090] Specifically, the image data is visually enhanced using augmented reality technology. For example, other objects are virtually superimposed on the original image or video, along with the flight parameters of the aircraft, to produce a corresponding visually enhanced image. The resulting visually enhanced image combines virtual and real elements, resulting in richer content and greater visual appeal. Optionally, real-time visual enhancement processing can be performed on the image data using a ground-based computer.

[0091] The output module 430 is configured to output the visually enhanced image to a target object.

[0092] The target object is a user who obtains the corresponding high-altitude image through a flying device. Outputting the corresponding visual enhancement image to the target image can enable the user to obtain a better image viewing experience, obtain better visual effects, and enhance entertainment.

[0093] As can be seen from the foregoing, the image processing device provided in the embodiments of the present invention acquires image data and flight data of an aircraft in real time via data acquisition module 410; performs visual enhancement processing on the image data based on the flight data via image processing module 420 to obtain a visually enhanced image; and outputs the visually enhanced image to a target object via output module 430. Compared to prior art solutions that directly transmit images captured by an aircraft to a user, the present invention performs visual enhancement processing on the image data before transmitting it to the user. This improves the visual quality and entertainment value of the images, provides users with an immersive visual experience, and enhances the user experience.

[0094] Optionally, in this embodiment, the data acquisition module 410 is specifically used to: acquire in real time the real-scene high-definition image transmitted by the flight device as image data, wherein the real-scene high-definition image is a picture with a resolution greater than or equal to a preset resolution taken by the binocular stereo camera of the flight device; and acquire in real time the flight data of the flight device, wherein the flight data includes the flight speed, flight angle and geographic location information of the flight device.

[0095] In this embodiment, the aforementioned flying device is equipped with a high-resolution binocular stereo camera for capturing high-definition, three-dimensional images of the flight landscape. Specifically, this high-resolution binocular stereo camera can capture images with a resolution greater than a preset resolution. The preset resolution is a pre-set resolution that can be set and adjusted based on actual needs. For example, in this embodiment, it can be set to 3840x2160, corresponding to a refresh rate of 60Hz.

[0096] The distance between the two eyes of the binocular stereo camera can be adjusted according to the depth of the landscape. For example, it can be automatically adjusted by an eye distance adjustment program set in the flight device, or it can be adjusted according to an adjustment instruction sent by the user. No specific limitation is made here. In one application scenario, the flight device is relatively far away from the surrounding buildings during flight, with a distance of tens to hundreds of meters. The eye distance can be adjusted to 160mm. When objects that need to be photographed appear near the flight device, such as clouds and other landscapes or other flight devices, the eye distance of the binocular stereo camera needs to be reduced, for example, adjusted to 60mm, the distance between the human eyes. In this way, the eye distance is adjusted according to the objects to be photographed to ensure the stereoscopic visual effect of the captured image. At the same time, it is convenient to calculate the superimposed coordinates of the corresponding objects when visually enhancing the image, so that the superimposed virtual and real flight landscape can be realistic and have a sense of presence, thereby enhancing the visual experience.

[0097] The above-mentioned flight data includes various parameters during the flight of the above-mentioned flight equipment, such as the flight speed of the flight equipment, flight angle (including horizontal angle and vertical angle), geographic location information, acceleration, altitude, etc., and may also include other parameters. The specific required flight parameters can be set and adjusted according to actual needs, and no specific limitations are made here.

[0098] Optionally, real-time high-definition images and flight data transmitted by the above-mentioned flight equipment can be obtained based on a wireless communication network, for example, by transmitting real-time high-definition images and flight data through 5G mobile communication technology.

[0099] Optionally, in this embodiment, the above-mentioned image processing module 420 is specifically used to: obtain a target perspective, wherein the above-mentioned target perspective is a first-person perspective or a third-person perspective; when the above-mentioned target perspective is a first-person perspective, superimposing the above-mentioned image data and a preset virtual flight cockpit image, and controlling the flight parameters in the superimposed virtual flight cockpit image based on the above-mentioned flight data to obtain a visually enhanced image.

[0100] The target perspective is the user's desired viewing angle. In this embodiment, it can be a first-person perspective or a third-person perspective. The first-person perspective simulates the user's perspective within the flight cabin, while the third-person perspective simulates the user's perspective outside the aircraft, able to see the aircraft. The target perspective can be pre-set or selected by the user, or adjusted in real time based on actual needs, without specific limitations.

[0101] Specifically, when the user selects a first-person perspective as the target perspective, a preset virtual cockpit image is obtained and superimposed with the aforementioned image data. Simultaneously, flight parameters in the superimposed virtual cockpit image are controlled based on the flight data of the aircraft during actual flight, resulting in a visually enhanced image. Specifically, the preset cockpit image is a pre-set virtual cockpit image that can be configured and adjusted based on user needs. For example, the color, style, and corresponding parameter display method of the virtual cockpit can be adjusted, though these are not specifically limited herein. The virtual cockpit includes a corresponding virtual instrument panel for displaying corresponding flight parameters, such as a flight map and a flight level. The specific parameter values in the virtual instrument panel can be set based on the aforementioned flight data, providing the user with an immersive visual experience. Specifically, a three-dimensional flight landscape is displayed outside the windshield of the virtual cockpit, simulating a scene where the user is viewing the scenery outside the aircraft through the cockpit.

[0102] Optionally, in this embodiment, the image processing module 420 is further specifically used to: when the target perspective is a third-person perspective, obtain an appearance image of the flight equipment, superimpose the image data and the appearance image, and obtain a visually enhanced image.

[0103] The aforementioned aircraft appearance image can be a pre-recorded real-life image of the corresponding aircraft, or it can be another simulated appearance image based on user needs. For example, if the actual aircraft is a common quadcopter drone, the corresponding appearance image can be the real-life image of the quadcopter, or it can be configured to resemble the appearance of an Apache fighter jet based on user needs, providing a better visual experience for the user.

[0104] Optionally, in this embodiment, the image processing device is further used to: obtain a target superposition object and superposition coordinates of the target superposition object; and superimpose the target superposition object into the visually enhanced image based on the superposition coordinates.

[0105] The target overlay object is a virtual object or virtual landscape to be overlaid, such as a rainbow, a flying bird, a flying dinosaur, or other flying equipment. Other virtual objects or virtual landscapes may also be included, and are not specifically limited here. Optionally, the specific target overlay object can be determined based on user needs. In one application scenario, a viewing mode can be pre-set, such as combat mode or landscape mode, with different target overlay objects assigned to different viewing modes. This allows the user to select the viewing mode selected. The target overlay object is then obtained based on the viewing mode. The position coordinates of the target overlay object in the visually enhanced image are calculated based on the target overlay object's size, attributes (e.g., height), and other parameters. These coordinates are then used as overlay coordinates, and the corresponding target overlay object is overlaid at the corresponding coordinates. For example, when the user selects combat mode, a pre-set fighter jet is overlaid. When the user selects landscape mode, a pre-set rainbow, flying bird, or the like are overlaid. The overlay image corresponding to the target overlay object can be a dynamic image. In this way, objects with both visual and entertainment value are overlaid in the visually enhanced image based on their three-dimensional positions, enhancing the user's visual experience.

[0106] Optionally, other aircraft can also be superimposed on the visually enhanced image. For example, multiple aircraft with the same function in the same airspace can be superimposed on their corresponding positions, and the image of the real aircraft at the corresponding position can be replaced by position calculation, so that different aircraft appearances can be virtually displayed according to user needs. For example, if the current aircraft captures another aircraft B with the same function at position A, the virtual appearance of the above-mentioned aircraft B can be obtained according to user needs and superimposed on the visually enhanced image corresponding to the current aircraft, replacing the real appearance of the aircraft B captured at position A, so that the user sees the virtual appearance of the aircraft B at position A in the visually enhanced image. In this way, different users can display the processed virtual appearance of the aircraft in the visually enhanced images provided by different aircraft. A simulated air combat game combining virtual and real can be played based on the above-mentioned aircraft, making the game process more exciting and improving the entertainment effect.

[0107] Optionally, for objects superimposed onto the ground, such as buildings, mountains, and bridges, the overlay angle and size ratio can be adjusted in real time based on real-time changes in flight position and direction, enhancing the user experience. Furthermore, some pre-set objects in the visually enhanced image can be annotated with text and images in real time. For example, iconic buildings and landscapes can be annotated with names and brief descriptions in real time, providing users with a better viewing experience.

[0108] Optionally, the above-mentioned flying equipment is a drone, and the above-mentioned image processing device is further used to: obtain flight operation instructions of the target object; and control the flight action of the above-mentioned drone based on the above-mentioned flight operation instructions.

[0109] The aforementioned flight control instructions are instructions issued by a target object for controlling the aforementioned drone. In this embodiment, the target object (i.e., the user) can issue flight control instructions on the ground, which are then transmitted to the corresponding drone via wireless communication or other transmission methods, thereby controlling the drone's flight maneuvers. Alternatively, the user can issue the corresponding flight control instructions using a simulated flight joystick or an intelligent device such as a computer, which is not specifically limited here.

[0110] Optionally, the output module 430 is specifically used to output the visually enhanced image to the target object via a VR device.

[0111] Specifically, the corresponding visually enhanced image is output based on virtual reality technology. The VR device may be VR glasses or a VR helmet. Optionally, the visually enhanced image may be displayed on a naked-eye 3D screen or other type of 3D display, which is not specifically limited here.

[0112] Based on the above embodiment, the present invention also provides an intelligent terminal, whose principle block diagram can be shown as follows: Figure 8 As shown. The above-mentioned intelligent terminal includes a processor, a memory, a network interface and a display screen connected via a system bus. The processor of the intelligent terminal is used to provide computing and control capabilities. The memory of the intelligent terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and an image processing program. The internal memory provides an environment for the operation of the operating system and the image processing program in the non-volatile storage medium. The network interface of the intelligent terminal is used to communicate with an external terminal via a network connection. When the image processing program is executed by the processor, the steps of any one of the above-mentioned image processing methods are implemented. The display screen of the intelligent terminal can be a liquid crystal display or an electronic ink display.

[0113] Those skilled in the art will understand that Figure 8 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the solution of the present invention and does not constitute a limitation on the smart terminal to which the solution of the present invention is applied. The specific smart terminal may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0114] In one embodiment, a smart terminal is provided. The smart terminal includes a memory, a processor, and an image processing program stored in the memory and executable on the processor. When executed by the processor, the image processing program performs the following operation instructions:

[0115] Acquire image data and flight data of flight equipment in real time;

[0116] Performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image;

[0117] The visually enhanced image is output to the target object.

[0118] An embodiment of the present invention further provides a computer-readable storage medium, on which an image processing program is stored. When the image processing program is executed by a processor, the steps of any image processing method provided by the embodiment of the present invention are implemented.

[0119] It should be understood that the sequence numbers of the steps in the above embodiments do not imply a specific order of execution; the order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0120] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the functional units and modules is used as an example for illustration. In actual applications, the functional distribution can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention. The specific working process of the units and modules in the system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0121] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0122] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0123] In the embodiments provided by the present invention, it should be understood that the disclosed apparatus / terminal device and method can be implemented in other ways. For example, the apparatus / terminal device embodiments described above are merely illustrative. For example, the division of the modules or units described above is merely a logical functional division. In actual implementation, other division methods may be used. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not implemented.

[0124] If the above-mentioned integrated modules / units are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction.

[0125] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. However, these modifications or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the scope of protection of the present invention.

Claims

1. An image processing method, characterized in that: The method comprises: Acquire image data and flight data of a flying device in real time; wherein the flying device is a drone; performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image; Outputting the visually enhanced image to a target object; the target object is a user who obtains the corresponding high-altitude image through the flying device; The performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image includes: Acquire a target perspective, wherein the target perspective is a first-person perspective or a third-person perspective, wherein the first-person perspective simulates the perspective of a user in the flight cockpit, and the third-person perspective simulates the perspective of a user outside the aircraft and can see the aircraft; When the target perspective is a first-person perspective, superimposing the image data with a preset virtual cockpit image, and controlling flight parameters in the superimposed virtual cockpit image based on the flight data to obtain a visually enhanced image; When the target perspective is a third-person perspective, obtaining an appearance image of the flying device, and superimposing the image data and the appearance image to obtain a visually enhanced image; Furthermore, after performing visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image, the method further includes: Obtaining a target superposition object and superposition coordinates of the target superposition object; The target overlay object is overlaid into the vision-enhanced image based on the overlay coordinates.

2. The image processing method according to claim 1, wherein: The real-time acquisition of image data and flight data of the flight equipment includes: Acquire, in real time, a real-scene high-definition image transmitted by the aerial device as image data, wherein the real-scene high-definition image is an image captured by a binocular stereo camera of the aerial device and has a resolution greater than or equal to a preset resolution; The flight data of the flying device is acquired in real time, wherein the flight data includes the flight speed, flight angle and geographic location information of the flying device.

3. The image processing method according to claim 1, wherein: The flying device is a drone. Before acquiring image data and flight data of the flying device in real time, the method further includes: Obtain flight operation instructions of the target object; The flight action of the UAV is controlled based on the flight operation instruction.

4. The image processing method according to claim 1, wherein: Outputting the visually enhanced image to the target object includes: The visually enhanced image is output to the target object through a VR device.

5. An image processing device, characterized in that: The device comprises: A data acquisition module, configured to acquire image data and flight data of an aerial device in real time; wherein the aerial device is a drone; an image processing module, configured to perform visual enhancement processing on the image data based on the flight data to obtain a visually enhanced image; an output module, configured to output the visually enhanced image to a target object; the target object being a user who obtains the corresponding high-altitude image through the flight device; The image processing module is specifically configured to: Acquire a target perspective, wherein the target perspective is a first-person perspective or a third-person perspective, wherein the first-person perspective simulates the perspective of a user in the flight cockpit, and the third-person perspective simulates the perspective of a user outside the aircraft and can see the aircraft; When the target perspective is a first-person perspective, superimposing the image data with a preset virtual cockpit image, and controlling flight parameters in the superimposed virtual cockpit image based on the flight data to obtain a visually enhanced image; When the target perspective is a third-person perspective, obtaining an appearance image of the flying device, and superimposing the image data and the appearance image to obtain a visually enhanced image; Furthermore, the image processing device is further configured to: Obtaining a target superposition object and superposition coordinates of the target superposition object; The target overlay object is overlaid into the vision-enhanced image based on the overlay coordinates.

6. An intelligent terminal, characterized in that: The intelligent terminal includes a memory, a processor, and an image processing program stored in the memory and executable on the processor. When the image processing program is executed by the processor, the steps of the image processing method according to any one of claims 1 to 4 are implemented.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores an image processing program, which, when executed by a processor, implements the steps of the image processing method according to any one of claims 1 to 4.

Images