Method, device and manned aircraft for sharing audio and video of a flying car

Abstract

The application provides a flying car audio and video sharing method and device and manned aircraft, and relates to the field of manned aircrafts. The cabin processing unit can respond to a video call starting instruction, thereby performing video call with ground equipment, so that the user in the manned aircraft can share the aerial view with the user using the ground equipment, and the aerial view is not limited by the cabin view, and the sharing process does not affect driving. Meanwhile, in the process of video call, the cabin processing unit collects a first audio stream and sends it to the ground equipment for playing, so that the user using the ground equipment can hear the voice of the user in the manned aircraft.

Description

Technical Field

[0001] This invention relates to the field of manned aircraft, and more specifically, to a method and apparatus for sharing audio and video in a flying car, as well as a manned aircraft. Background Technology

[0002] With the advancement of technology and the rapid development of the low-altitude economy, manned aircraft are gradually becoming a new mode of travel and exercise. Sharing flight experiences is of great significance to flight enthusiasts, as it not only enhances the dissemination of flight culture but also provides valuable data support for flight safety. Currently, when piloting or riding in manned aircraft, flight enthusiasts typically use their mobile phones or cameras to take flight images and then share them with others. This not only interferes with piloting but also results in poor visibility of the flight images. Summary of the Invention

[0003] The purpose of this invention is to provide a method, device, and manned aircraft for sharing audio and video in flying cars, so as to improve the problems existing in the prior art.

[0004] The embodiments of the present invention can be implemented as follows:

[0005] In a first aspect, the present invention provides a method for sharing audio and video in a flying car, applied to a cockpit processing unit of a manned aircraft, wherein the manned aircraft further includes a cockpit display screen communicatively connected to the cockpit processing unit; the cockpit processing unit is communicatively connected to ground equipment and an image acquisition unit mounted on the manned aircraft; the method includes:

[0006] In response to a video call initiation command, the system receives the aerial video stream captured by the image acquisition unit and controls the cockpit display screen to switch to the video call interface; the video call interface is used to display the aerial video stream.

[0007] A first audio stream is acquired, and the first audio stream and the aerial video stream are pushed to the ground device, so that the ground device plays the first audio stream and controls its own device display screen to jump to the video call interface.

[0008] Secondly, the present invention provides a method for sharing audio and video on a flying car, applied to an aerial photography sharing system. The aerial photography sharing system includes a manned aircraft and ground equipment. The manned aircraft includes a cockpit processing unit and a cockpit display screen communicatively connected to the cockpit processing unit. The cockpit processing unit is communicatively connected to the ground equipment and an image acquisition unit mounted on the manned aircraft. The method includes:

[0009] The cockpit processing unit or the ground equipment responds to the video call initiation command to receive the aerial video stream acquired by the image acquisition unit and control the cockpit display screen to jump to the video call interface; the video call interface is used to display the aerial video stream.

[0010] The cockpit processing unit acquires the first audio stream and pushes the first audio stream and the aerial video stream to the ground equipment;

[0011] The ground equipment plays the first audio stream and controls its own device display screen to jump to the video call interface.

[0012] Thirdly, the present invention provides an aerial photography sharing device applied to the cockpit processing unit of a manned aircraft, wherein the manned aircraft further includes a cockpit display screen communicatively connected to the cockpit processing unit; the cockpit processing unit is communicatively connected to ground equipment and an image acquisition unit mounted on the manned aircraft; comprising:

[0013] The video call module is used to respond to a video call initiation command, receive the aerial video stream acquired by the image acquisition unit, and control the cockpit display screen to jump to the video call interface; the video call interface is used to display the aerial video stream.

[0014] An audio push module is used to acquire a first audio stream and push the first audio stream and the aerial video stream to the ground device, so that the ground device plays the first audio stream and controls its own device display screen to jump to the video call interface.

[0015] Fourthly, the present invention provides a manned aircraft, including a cockpit processing unit, the cockpit processing unit being used to implement the flying car audio and video sharing method described in the first aspect above.

[0016] Compared with existing technologies, embodiments of the present invention provide a method, apparatus, and manned aircraft for sharing audio and video in flying cars. The manned aircraft includes a cockpit processing unit and a cockpit display screen communicatively connected to the cockpit processing unit. The cockpit processing unit is also communicatively connected to ground equipment and an image acquisition unit mounted on the manned aircraft. In this method, the cockpit processing unit: in response to a video call initiation command, receives an aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to jump to a video call interface; the video call interface is used to display the aerial video stream; acquires a first audio stream and pushes the first audio stream and the aerial video stream to the ground equipment, so that the ground equipment plays the first audio stream and controls its own device display screen to jump to the video call interface. The present invention enables video calls between the cockpit processing unit and the ground equipment, allowing users in the manned aircraft to share aerial views with users using the ground equipment, and the aerial view is not limited by the cockpit view, and the sharing process does not affect driving. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is one of the flowcharts illustrating a method for sharing audio and video from a flying car, as provided in an embodiment of the present invention.

[0019] Figure 2 This is an example diagram of a video call interface displayed on a cockpit screen provided in an embodiment of the present invention.

[0020] Figure 3 This is an example diagram of a video call interface displayed on a device screen provided in an embodiment of the present invention.

[0021] Figure 4 This is an example diagram of a connection waiting interface provided in an embodiment of the present invention.

[0022] Figure 5 This is another example diagram of the video call interface displayed on the cockpit display screen provided in an embodiment of the present invention.

[0023] Figure 6 This is a schematic diagram illustrating the storage of an image or video according to an embodiment of the present invention.

[0024] Figure 7 This is a second flowchart illustrating a method for sharing audio and video data in a flying car, as provided in an embodiment of the present invention.

[0025] Figure 8 This is a schematic diagram of the structure of an aerial photography sharing device provided in an embodiment of the present invention. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0027] Therefore, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the invention without inventive effort are within the scope of protection of the invention.

[0028] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0029] Furthermore, the terms "first" and "second" are used only to distinguish descriptions and should not be interpreted as indicating or implying relative importance.

[0030] It should be noted that, where there is no conflict, the features in the embodiments of the present invention can be combined with each other.

[0031] The application scenarios of this invention will be introduced first.

[0032] This invention relates to an aerial photography sharing system, which includes a manned aircraft and ground equipment connected in communication. The manned aircraft includes a cockpit processing unit and a cockpit display screen connected in communication with the cockpit processing unit, and the cockpit processing unit is connected in communication with an image acquisition unit mounted on the manned aircraft.

[0033] In this system, the manned aircraft can be a type of manned aircraft, and the ground equipment can be user terminals such as mobile phones, tablets, personal laptops, personal computers, etc. Alternatively, the aerial photography sharing system can be a modular flying car, where the manned aircraft is the flying body of the modular flying car, and the ground equipment is the land vehicle body of the modular flying car. This land vehicle body can completely house the flying body inside the vehicle for ground driving.

[0034] The cockpit processing unit can be an integrated circuit chip with signal processing capabilities. For example, the cockpit processing unit can be a general-purpose processor, including: CPU (Central Processing Unit), NP (Network Processor), SoC (System on Chip), etc.; it can also be: DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0035] The cockpit display screen can be a touch screen. The image acquisition unit onboard the manned aircraft can include at least one of the following lenses: high-definition lens, wide-angle fixed-focus lens, telephoto lens, and panoramic lens (such as a fisheye lens).

[0036] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating a method for sharing audio and video in a flying car, provided by an embodiment of the present invention. The method is applied to the cockpit processing unit of a manned aircraft and includes the following steps S103 to S104.

[0037] S103, in response to the video call initiation command, receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to jump to the video call interface.

[0038] In this embodiment, the video call interface displayed on the cockpit screen may include a playback box and a floating call control window. The playback box is used to display the aerial video stream, and the call control window may include a call timer, an audio button, and a hang-up button.

[0039] S104. Obtain the first audio stream and push the first audio stream and the aerial video stream to the ground equipment, so that the ground equipment plays the first audio stream and controls its own device display screen to jump to the video call interface.

[0040] In this embodiment, while the cockpit display screen switches to the video call interface, the cockpit processing unit acquires a first audio stream via an aviation headset or microphone and pushes the first audio stream and the aerial video stream to the ground equipment. Upon receiving the aerial video stream, the ground equipment can control its own display screen to switch to the video call interface and play the first audio stream. The video call interface displayed on the device screen may also include a playback box and a floating call control window.

[0041] It should be noted that, due to the different screen sizes, the video call interface displayed on the cockpit screen is different in size from the video call interface displayed on the device screen, and their layouts may also be different.

[0042] For example, see Figure 2 , Figure 2 This is an example diagram of a video call interface displayed on a cockpit screen according to an embodiment of the present invention. Figure 2 This includes a side control bar and a top status bar. The control bar can be a fixed display area for aerial photography applications, used to implement some control logic, while the status bar can be a fixed display area for aerial photography applications, used to display some status information of the manned aircraft. Please see [link to relevant documentation]. Figure 3 , Figure 3 This is an example diagram of a video call interface displayed on a device screen provided in an embodiment of the present invention. Figure 3 It only includes the playback box and the call control window.

[0043] Figure 2 , Figure 3 The example shown is for illustrative purposes only and is not intended to be limiting.

[0044] The flying car audio and video sharing method provided in this invention allows the cockpit processing unit to respond to a video call initiation command and initiate a video call with ground equipment. During the video call, the cockpit processing unit transmits the aerial video stream to the ground equipment in real time, enabling the ground equipment to display the video stream on the video call interface. This allows users in the manned aircraft to share aerial views with users on the ground equipment, and the aerial view is not limited by the cockpit's field of vision, nor does the sharing process affect driving. Simultaneously, during the video call, the cockpit processing unit collects a first audio stream and sends it to the ground equipment for playback, allowing users on the ground equipment to hear the voices of users in the manned aircraft.

[0045] Optionally, when an aerial photography application is installed on the cockpit processing unit, the user needs to launch the aerial photography application to share audio and video. Therefore, the method may further include:

[0046] S101, In response to the aerial photography start command, launch the aerial photography application and display the connection interface of the aerial photography application on the cockpit display screen.

[0047] In one optional scenario, the cockpit display screen's desktop may include an application icon for a drone application, and the drone launch command may be generated when the user clicks on the drone application icon on the cockpit display screen's desktop.

[0048] In another alternative scenario, the cockpit processing unit integrates a microphone and a speaker. Alternatively, the manned aircraft may include an aviation headset that can be worn by the user and communicates with the cockpit processing unit screen. The aerial photography start command may be generated by the cockpit processing unit based on the start control voice sensed by the aviation headset or microphone. This start control voice is used to instruct the user to open the aerial photography application. For example, the start control voice may be "Please start the aerial photography application." This example is merely illustrative and is not intended to limit the scope of the application.

[0049] S102. In response to the connection command, request to establish a connection with the image acquisition unit, and after the connection is successful, control the cockpit display screen to jump to the connection success interface.

[0050] In this embodiment, the command may be generated by the cockpit processing unit when it senses a user's click on the connection button in the connection interface. Alternatively, the connection command may be generated by the cockpit processing unit based on connection control voice sensed by the aviation headset or microphone device. This connection control voice is used to instruct the establishment of a connection with the image acquisition unit. For example, the user control voice could be "connect to the aerial camera." This example is merely illustrative and not intended to limit the scope. Establishing a connection between the cockpit processing unit and the image acquisition unit requires a certain amount of time. In response to the connection command, the cockpit processing unit may send a connection request to the image acquisition unit, controlling the cockpit display to jump from the connection interface to the connection waiting interface. Furthermore, both the connection waiting interface and the connection success interface can include the control bar and status bar that are always displayed by the aerial photography application.

[0051] For example, Figure 4 This is an example diagram of a connection waiting interface; when the image acquisition unit receives a connection request, it can reply with a connection response message to the cockpit processing unit. If the cockpit processing unit receives the connection response message, it means that the connection is successful. Figure 4 The examples shown are for illustrative purposes only, and the model of the image acquisition unit and the images are not limited here.

[0052] Optionally, the method can also enable users in the manned aircraft to hear the voices of users using ground equipment. Furthermore, if the ground equipment is equipped with a camera, it can also share images with the manned aircraft. In other words, the method may further include:

[0053] S105. Receive the second audio stream and ground video stream sent by the ground equipment, and play the second audio stream and display the ground video stream in the video call interface of the cockpit display screen.

[0054] In this embodiment, as the device's display screen switches to the video call interface, the ground equipment begins acquiring a second audio stream and a ground video stream via its onboard camera. These two streams are then pushed to the cockpit processing unit in real time. Thus, by exchanging audio and video streams in real time, voice communication and visual interaction between the manned aircraft and the ground equipment are achieved.

[0055] Optionally, in the video call interface displayed on the cockpit display screen, there can be two display areas of the same size to display the aerial video stream and the ground video stream respectively, or the ground video stream can be displayed in a larger area, while the aerial video stream can be displayed in a draggable local window.

[0056] In an optional scenario, the video call can be initiated by the cockpit processing unit. Therefore, the process in step S103 above, which responds to the video call initiation command, receives the aerial video stream acquired by the image acquisition unit, and controls the cockpit display screen to jump to the video call interface, may include the following sub-steps S103a to S103c.

[0057] S103a: When it is sensed that the user clicks the video button in the control bar of the connection success interface displayed on the cockpit display screen, or when the user's video call control voice is detected, the cockpit display screen is controlled to jump to the call waiting interface, and a video call request is sent to the ground equipment, so that the ground equipment displays the call request interface based on the video call request.

[0058] Optional, compared to Figure 4 The successful connection screen is... Figure 4 The "Connecting" status changes to "Connection Successful," the connection progress bar is fully extended, and the cancel button is changed to a disconnect button. This way, when the cockpit processing unit detects that the user has clicked the video button in the status bar of the connection success screen, it will control the cockpit display to jump to the call waiting screen and send a video call request to the ground equipment.

[0059] In this embodiment, when the ground equipment senses that the user clicks the accept button on the call request interface or detects the user's voice control for accepting the call, it sends an accept notification to the cockpit processing unit, and then its own equipment display screen jumps to the video call interface.

[0060] S103b: When receiving an acceptance notification from the ground equipment, a collection command is sent to the image acquisition unit so that the image acquisition unit can start collecting aerial video streams based on the collection command.

[0061] In this embodiment, the video call initiation command is the acceptance notification sent by the ground equipment.

[0062] S103c receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display to switch from the call waiting interface to the video call interface.

[0063] In this embodiment, when the cockpit processing unit receives the aerial video stream, it can control the cockpit display screen to switch from the call waiting interface to the video call interface.

[0064] In another optional scenario, the video call can be initiated by ground equipment. Therefore, the process in step S103 above, which responds to the video call initiation command, receives the aerial video stream acquired by the image acquisition unit, and controls the cockpit display screen to jump to the video call interface, may include the following sub-steps S103A to S103C.

[0065] S105A: When a video call request is received from ground equipment, the call request interface is displayed on the cockpit display screen based on the video call request.

[0066] In this embodiment, when the ground equipment is a split-type flying car, it can support users to initiate video calls with the flying vehicle through the equipment display screen of the ground vehicle (i.e., the vehicle-mounted display screen of the ground vehicle).

[0067] Optionally, the ground equipment can be equipped with an aerial photography sharing application, which enables video calls with the cockpit processing unit. Therefore, the ground equipment can respond to the application launch command, start the aerial photography sharing application, and display the main sharing interface on its screen. When the device detects that the user clicks the video button on the main sharing interface or detects the user's video call control voice, the device screen will switch to the call waiting interface and send a video call request to the cockpit processing unit.

[0068] The shared application launch command can be generated when the ground equipment senses the user's click on the application icon of the aerial photography sharing application on the cockpit display screen, or it can be generated when the ground equipment senses the user's launch control voice. This launch control voice is used to instruct the user to open the aerial photography sharing application. For example, the launch control voice can be "Open the aerial photography sharing application". This example is only for illustration and is not limited here.

[0069] S105B: When it is sensed that the user clicks the accept button in the call request interface or when the user's call acceptance control voice is detected, an acceptance notification is sent to the ground equipment and an acquisition command is sent to the image acquisition unit so that the image acquisition unit can start acquiring aerial video streams based on the acquisition command.

[0070] The S105C receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display to switch from the call request interface to the video call interface.

[0071] In this embodiment, when the ground equipment receives the acceptance notification, it will control the device display screen to jump to the video call interface.

[0072] In optional implementations, the video call interface displayed on the cockpit display and the device display may include parameter setting buttons to support users in setting shooting parameters for the image acquisition unit. The specific parameter setting scenarios are divided into the following two types.

[0073] In the first parameter setting scenario, when a user inside a manned aircraft sets parameters via a cockpit display screen, the method may further include steps S106 to S107.

[0074] S106. When the system detects that the user has clicked the parameter setting button in the video call interface displayed on the cockpit display, the system controls the cockpit display to jump to the parameter adjustment interface.

[0075] S107. Obtain the first parameter update data set by the user in the parameter adjustment interface displayed on the cockpit display screen, and send the first parameter update data to the image acquisition unit so that the image acquisition unit updates the shooting parameters based on the first parameter update data.

[0076] In this embodiment, when the cockpit display screen is currently displaying a video call interface, the cockpit processing unit controls the cockpit display screen to jump from the video call interface to the parameter adjustment interface when it senses that the user clicks the parameter setting button in the video call interface displayed on the cockpit display screen. In the parameter adjustment interface, the parameters that the user can set include, but are not limited to: image resolution, image format, white balance, video frame rate, sensitivity, exposure compensation, and focus mode.

[0077] After the user completes the parameter settings in the parameter adjustment interface, they can click the save button in the parameter adjustment interface. The cockpit processing unit will then obtain the first parameter update data set by the user and send it to the image acquisition unit. The image acquisition unit can then update the shooting parameters based on the first parameter update data and continue to acquire aerial video streams.

[0078] In the second parameter setting scenario, when a user on the ground sets parameters through the device's display screen, the method may also include step S108.

[0079] S108. Receive the user-set second parameter update data sent by the ground equipment, and send the second parameter update data to the image acquisition unit so that the image acquisition unit updates the shooting parameters based on the second parameter update data.

[0080] In this embodiment, when the ground equipment detects that the user clicks the parameter setting button on the video call interface displayed on the device screen, it controls the device screen to jump to the parameter adjustment interface. After the user completes the parameter settings in the parameter adjustment interface, they can click the save button in the parameter adjustment interface. The ground equipment can then obtain the updated second parameter data set by the user and provide it to the cockpit processing unit to send to the image acquisition unit. The image acquisition unit can then update the shooting parameters based on the updated second parameter data and continue to acquire the aerial video stream.

[0081] In an optional implementation, while a video call is being conducted between the cockpit processing unit and the ground equipment, the cockpit processing unit can also take photos or record videos, and / or the ground equipment can also take photos or record videos. At the start of a video call, the aerial photography mode highlighted on both the cockpit display and the equipment display screen is set to shooting mode by default.

[0082] When a user needs to take high-definition images via the cockpit display screen, the method may further include the following step S109 after step S105 above.

[0083] S109. When it is sensed that the user clicks the shooting button in the video call interface displayed on the cockpit display, the current playback frame is selected from the aerial video stream as the shooting image; and the shooting image is stored locally, and / or uploaded to the cloud server for storage.

[0084] In this embodiment, the cockpit processing unit can store the captured images locally and / or upload the captured images to a cloud server for storage.

[0085] Optional, combined Figure 5 , Figure 5 This is another example diagram of the video call interface displayed on the cockpit screen provided in an embodiment of the present invention. Besides the default shooting mode, the aerial photography mode of the image acquisition unit can also be a recording mode or a panoramic video mode. Therefore, the user can switch modes to record video or capture panoramic images. Thus, after step S105, the method may further include the following steps S110 to S118.

[0086] S110. When it is sensed that the user clicks or slides to select any of the multiple mode buttons included in the video call interface displayed on the cockpit screen, the target mode selected by the user is determined.

[0087] In this embodiment, the target mode selected by the user can be either recording mode or panoramic video mode. If the target mode selected by the user is recording mode, the next step S111 is executed after step S110. If the target mode selected by the user is panoramic video mode, the next step S115 is executed after step S110.

[0088] S111. If the target mode is recording mode, switch the aerial photography mode highlighted in the video call interface displayed on the cockpit display to recording mode, and send a switching recording command to the ground equipment so that the ground equipment controls the aerial photography mode highlighted in the video call interface displayed on the device display to switch to recording mode based on the switching recording command.

[0089] In this embodiment, combined with Figure 5 The default shooting mode is highlighted (i.e., the word "Photo" is displayed in yellow). However, when the user clicks or swipes to select the word "Video", the recording mode is highlighted (i.e., the word "Video" is displayed in yellow).

[0090] S112. When it is sensed that the user clicks the record button in the video call interface displayed on the cockpit display, a video recording window is displayed in the video call interface, and the current playback frame is selected from the aerial video stream as the first frame to be recorded. Then, the aerial video stream is cached frame by frame starting from the first frame to be recorded.

[0091] Combination Figure 5 When the cockpit processing unit detects that the user has clicked the record button, a video recording window (including the recording duration) will be displayed on the video call interface. At the same time, the current playback frame will be selected from the aerial video stream as the first frame to be recorded, and then the aerial video stream will be cached frame by frame starting from the first frame.

[0092] S113. In response to the user's recording end operation, stop displaying the video recording window and stop image buffering, and output the recorded video based on the first frame of the buffered image to the last frame of the buffered image.

[0093] In this embodiment, the user's action to end recording is the user's click on the recording stop button. The cockpit processing unit can output the recorded video in MP4 format based on the cached first frame to the last frame of the recorded image.

[0094] S114. Store the recorded video locally, and / or upload the recorded video to a cloud server for storage.

[0095] S115. If the target mode is panoramic video mode, control the image acquisition unit to acquire panoramic video stream and play the panoramic video stream through the video call interface displayed on the cockpit display screen. At the same time, switch the aerial photography mode highlighted in the video call interface displayed on the cockpit display screen to panoramic video mode, and send the panoramic switching command and panoramic video stream to the ground equipment.

[0096] In this embodiment, when the ground equipment receives the panoramic switching command and the panoramic video stream, it will play the panoramic video stream through the video call interface displayed on the device screen based on the panoramic switching command, and switch the aerial photography mode highlighted in the video call interface displayed on the device screen to the panoramic video mode.

[0097] S116. When it is sensed that the user clicks the record button in the video call interface displayed on the cockpit display, a panoramic recording window is displayed in the video call interface, and the current playback frame is selected from the panoramic video stream as the first panoramic image. Then, the panoramic video stream is cached frame by frame starting from the first panoramic image.

[0098] S117. In response to the user's recording end operation, stop displaying the panoramic recording window and stop image buffering, and output panoramic video based on the first frame panoramic image to the last frame panoramic image in the buffer;

[0099] S118. Store the panoramic video locally and / or upload the panoramic video to a cloud server for storage.

[0100] In this embodiment, the process of recording panoramic video is similar to the process of recording video in steps S112 to S114 above, and will not be described in detail here.

[0101] In one alternative implementation, when the cockpit processing unit senses the user's shooting operation, it can send a shooting command to the image acquisition unit. The camera module of the image acquisition unit then saves the latest captured aerial video frame to its own camera memory card based on the shooting command.

[0102] Alternatively, when the cockpit processing unit senses the user's recording operation (video recording or panoramic video recording), it can send a recording command to the image acquisition unit. The camera module of the image acquisition unit buffers the acquired video stream frame by frame, starting from the latest acquired video frame (aerial video frame or panoramic video frame). Then, when the cockpit processing unit senses the user's end recording operation, it sends a recording end command to the image acquisition unit. The camera module of the image acquisition unit stops buffering the images and outputs the video based on all buffered video frames, saving it to the camera memory card.

[0103] In the case where the manned aircraft and ground equipment are respectively the flying body and land-based body of a split-type flying car, please refer to Figure 6 , Figure 6 This is a schematic diagram illustrating the storage of an image or video according to an embodiment of the present invention.

[0104] Based on the above content, and in combination with Figure 6 As can be seen, the image or video storage scheme in this invention is as follows.

[0105] Option 1: Local storage can include the following three types:

[0106] (1) The cockpit processing unit of the aircraft stores the captured images, recorded videos, panoramic videos, etc. in the local storage area A;

[0107] (2) The land vehicle stores the captured images, recorded videos, panoramic videos, etc. in local storage area B. When the user terminal (such as mobile phone) connects to the land vehicle via Bluetooth, the data in storage area B can be exported to storage area C.

[0108] (3) The image acquisition unit stores captured images, recorded videos, panoramic videos, etc., on the local camera memory card; the cockpit processing unit of the flying body can export the images and videos in the camera memory card to the local storage area A; the land-based body can also export the images and videos in the camera memory card to the local storage area B.

[0109] Option 2: Cloud storage:

[0110] (1) Both the cockpit processing unit of the flying vehicle and the land vehicle upload the captured images, recorded videos, panoramic videos, etc. to the cloud server for cloud storage; the land vehicle and the user terminal can access the cloud to download images or videos.

[0111] The above content introduces the audio and video sharing method for flying cars from the perspective of the cockpit processing unit. Next, from the perspective of the overall aerial photography sharing system, another method for sharing audio and video in flying cars will be introduced. Its implementation logic and principles are similar to the above-mentioned method applied to the cockpit processing unit, and will not be elaborated upon here.

[0112] Please see Figure 7 , Figure 7 This is a second flowchart illustrating a method for sharing audio and video data from a flying car, provided as an embodiment of the present invention. This method is applied to an aerial photography sharing system and includes the following steps S204–S207:

[0113] S204. The cockpit processing unit or ground equipment responds to the video call initiation command so that the cockpit processing unit receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to jump to the video call interface.

[0114] The video call interface is used to display the aerial video stream;

[0115] S205, The cockpit processing unit acquires the first audio stream and pushes the first audio stream and the aerial video stream to the ground equipment;

[0116] S206. The ground equipment plays the first audio stream and controls its own equipment display screen to jump to the video call interface.

[0117] The flying car audio and video sharing method provided in this invention enables the cockpit processing unit to conduct video calls with ground equipment. During the video call, the cockpit processing unit transmits the aerial video stream to the ground equipment in real time, allowing the ground equipment to display the aerial video stream on the video call interface. This enables users in the manned aircraft to share aerial views with users using the ground equipment, and the aerial view is not limited by the cockpit's field of vision, nor does the sharing process affect driving. Simultaneously, during the video call, the cockpit processing unit collects a first audio stream and sends it to the ground equipment for playback, allowing users using the ground equipment to hear the voices of users in the manned aircraft.

[0118] Optionally, the method can also enable users in the manned aircraft to hear the voices of users using ground equipment. Furthermore, if the ground equipment is equipped with a camera, it can also share images with the manned aircraft. In other words, the method may further include:

[0119] S207a: The ground equipment acquires a second audio stream and a ground video stream through its onboard camera. The ground video stream is displayed on the video call interface of the equipment screen, and the second audio stream and the ground video stream are sent to the cockpit processing unit at the same time.

[0120] S207b, The cockpit processing unit plays the second audio stream and displays the ground video stream in the video call interface of the cockpit display screen.

[0121] In this embodiment, while the device display screen switches to the video call interface, the ground equipment can begin acquiring a second audio stream and a ground video stream via its onboard camera. The ground video stream can then be displayed on the device's video call interface, and the second audio stream and ground video stream are pushed to the cockpit processing unit in real time. Thus, by exchanging audio and video streams in real time, voice communication and visual interaction between the manned aircraft and the ground equipment are achieved.

[0122] Optionally, in the video call interface displayed on the device screen, there can be two display areas of the same size to display the aerial video stream and the ground video stream respectively, or the aerial video stream can be displayed in a larger area, while the ground video stream can be displayed in a draggable local window.

[0123] Optionally, when an aerial photography application is installed on the cockpit processing unit, the user needs to launch the aerial photography application to share audio and video. Therefore, the method may further include:

[0124] S201, The cockpit processing unit responds to the aerial photography start command, starts the aerial photography application, and displays the connection interface of the aerial photography application on the cockpit display screen;

[0125] S202, The cockpit processing unit responds to the connection command and requests the image acquisition unit to establish a connection;

[0126] S203. After successful connection, the cockpit processing unit controls the cockpit display screen to jump to the connection success interface.

[0127] In an alternative scenario, the video call may be initiated by the cockpit processing unit, so step S204 may include the following sub-steps S204a to S204d.

[0128] S204a. When the cockpit processing unit detects that the user has clicked the video button in the control bar of the connection success interface displayed on the cockpit display screen, or when it detects the user's video call control voice, it controls the cockpit display screen to jump to the call waiting interface and sends a video call request to the ground equipment.

[0129] S204b: Based on a video call request, the ground equipment controls the device display to jump to the call request interface;

[0130] S204c: When the ground equipment senses that the user clicks the accept button on the call request interface or when it detects the user's call acceptance control voice, it sends an acceptance notification to the cockpit processing unit; the video call initiation command is the acceptance notification sent by the ground equipment.

[0131] Upon receiving the acceptance notification, the S204d cockpit processing unit sends an acquisition command to the image acquisition unit, enabling the image acquisition unit to begin acquiring aerial video streams based on the acquisition command.

[0132] S204c: The cockpit processing unit receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display to switch from the call waiting interface to the video call interface.

[0133] In another alternative scenario, the video call can be initiated by a ground device, so step S204 above may include the following sub-steps S204A to S204D.

[0134] S204A: The ground equipment responds to the shared application launch command, starts the aerial photography sharing application, and displays the main sharing interface on the equipment display screen.

[0135] When the S204B ground equipment detects that a user clicks the video button on the main sharing interface or detects the user's video call control voice, the control equipment display jumps to the call waiting interface and sends a video call request to the cockpit processing unit.

[0136] Based on the video call request, the S204C cockpit processing unit controls the cockpit display to jump to the call request interface. When it detects that the user clicks the accept button on the call request interface or when it detects the user's voice control for accepting the call, it sends an acceptance notification to the ground equipment and sends an acquisition command to the image acquisition unit so that the image acquisition unit can start acquiring aerial video streams based on the acquisition command.

[0137] The S204D cockpit processing unit receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to switch from the call waiting interface to the video call interface.

[0138] In optional implementations, the video call interface displayed on the cockpit display and the device display may include parameter setting buttons to support users in setting shooting parameters for the image acquisition unit. The specific parameter setting scenarios are divided into the following two types.

[0139] In the first parameter setting scenario, when a user inside a manned aircraft sets parameters via a cockpit display screen, the method may further include the following steps S208 to S210 after step S206.

[0140] S208. When the cockpit processing unit detects that the user clicks the parameter setting button in the video call interface displayed on the cockpit display, it controls the cockpit display to jump to the parameter adjustment interface.

[0141] S209, The cockpit processing unit acquires the update data of the first parameter set by the user in the parameter adjustment interface displayed on the cockpit display screen.

[0142] S210, the cockpit processing unit sends the first parameter update data to the image acquisition unit so that the image acquisition unit updates the shooting parameters based on the first parameter update data.

[0143] In the second parameter setting scenario, when a user on the ground sets parameters through the device's display screen, the method may further include steps S211 to S213 after step S206.

[0144] S211. When the ground equipment senses that the user clicks the parameter setting button in the video call interface displayed on the equipment screen, it controls the equipment screen to jump to the parameter adjustment interface.

[0145] S212. The ground equipment acquires the updated data of the second parameter set by the user in the parameter adjustment interface displayed on the equipment screen, and sends the updated data of the second parameter to the cockpit processing unit.

[0146] S213, the cockpit processing unit sends the second parameter update data to the image acquisition unit so that the image acquisition unit can update the shooting parameters based on the second parameter update data.

[0147] In an optional implementation, while a video call is being conducted between the cockpit processing unit and the ground equipment, the cockpit processing unit can also take photos or record videos, and / or the ground equipment can also take photos or record videos. At the start of a video call, the aerial photography mode highlighted on both the cockpit display and the equipment display screen is set to shooting mode by default.

[0148] When a user needs to take high-definition images via the cockpit display screen, the method may further include the following step S214 after step S206 above.

[0149] S214. When the cockpit processing unit senses that the user has clicked the shooting button on the video call interface displayed on the cockpit screen, it selects the current playback frame from the aerial video stream as the shooting image, stores the shooting image locally, and / or uploads the shooting image to the cloud server for storage.

[0150] When a user needs to capture high-definition images through the device's display screen, the method may further include the following step S215 after step S206 above.

[0151] S215. When the ground equipment senses that the user clicks the shooting button in the video call interface displayed on the equipment screen, it selects the current playback frame from the aerial video stream as the shooting image, stores the shooting image locally, and / or uploads the shooting image to the cloud server for storage.

[0152] In addition to the default shooting mode, the image acquisition unit can also be configured for aerial photography, recording, and panoramic video modes. Therefore, users can switch modes to record video or capture panoramic images.

[0153] When a user initiates a mode switch via the cockpit display screen, the method may further include the following steps S216 to S220:

[0154] S216. When the cockpit processing unit senses that the user clicks or slides to select any one of the multiple mode buttons included in the video call interface displayed on the cockpit display screen, it determines the target mode selected by the user.

[0155] S217. If the target mode is recording mode, the cockpit processing unit switches the aerial photography mode highlighted in the video call interface displayed on the cockpit screen to recording mode, and sends a switching recording command to the ground equipment.

[0156] S218. Ground equipment controls the aerial photography mode highlighted in the video call interface displayed on the equipment screen to switch to recording mode based on the switching recording command.

[0157] S219. If the target mode is panoramic video mode, the cockpit processing unit controls the image acquisition unit to acquire panoramic video stream and plays the panoramic video stream through the video call interface displayed on the cockpit display screen. At the same time, the aerial photography mode highlighted in the video call interface displayed on the cockpit display screen is switched to panoramic video mode, and a panoramic switching command and panoramic video stream are sent to the ground equipment.

[0158] Based on the panoramic switching command, the S220 ground equipment plays a panoramic video stream through the video call interface displayed on the equipment screen, and switches the aerial photography mode highlighted in the video call interface displayed on the equipment screen to the panoramic video mode.

[0159] When a user initiates a mode switch via the device display, the method may further include the following steps S221 to S226:

[0160] S221. When the ground equipment senses that the user clicks or slides to select any one of the multiple mode buttons included in the video call interface displayed on the device screen, it determines the target mode selected by the user.

[0161] S222. If the target mode is recording mode, the ground equipment will switch the aerial photography mode highlighted in the video call interface displayed on the equipment screen to recording mode, and send a switching recording command to the cockpit processing unit.

[0162] S223, The cockpit processing unit controls the aerial photography mode highlighted in the video call interface displayed on the cockpit screen to switch to recording mode based on the switching recording command;

[0163] S224. If the target mode is panoramic video mode, the ground equipment sends a switch panoramic command to the cockpit processing unit.

[0164] S225, the cockpit processing unit controls the image acquisition unit to acquire a panoramic video stream based on the panoramic switching command, and the cockpit processing unit plays the panoramic video stream through the video call interface displayed on the cockpit display screen. At the same time, it switches the aerial photography mode highlighted in the video call interface displayed on the cockpit display screen to the panoramic video mode, and sends the panoramic video stream to the ground equipment.

[0165] S226. The ground equipment switches the aerial photography mode highlighted in the video call interface displayed on the equipment screen to the panoramic video mode, and transmits a portion of the panoramic video stream through the video call interface.

[0166] In an optional implementation, if the aerial photography mode highlighted in the video call interface displayed on the cockpit screen is the recording mode, and the user records high-definition video through the cockpit screen, the method may further include the following steps S227 to S229:

[0167] S227. When the cockpit processing unit senses that the user clicks the record button in the video call interface displayed on the cockpit screen, it displays a video recording window in the video call interface, selects the current playback frame from the aerial video stream as the first frame to be recorded, and then performs image buffering on the aerial video stream frame by frame starting from the first frame to be recorded.

[0168] S228, the cockpit processing unit responds to the user's recording end operation by stopping the display of the video recording window and stopping the image buffer, and outputs the recorded video based on the first frame of the buffered image to the last frame of the recorded image;

[0169] S229, the cockpit processing unit will store the recorded video locally and / or upload the recorded video to a cloud server for storage.

[0170] In an optional implementation, if the aerial photography mode highlighted in the video call interface displayed on the device screen is the recording mode, and the user performs high-definition video recording through the device screen, the method may further include the following steps S230 to S229:

[0171] S230: When the ground equipment senses that the user clicks the record button in the video call interface displayed on the equipment screen, it displays a video recording window in the video call interface, selects the current playback frame from the aerial video stream as the first frame to be recorded, and then performs image buffering on the aerial video stream frame by frame starting from the first frame to be recorded.

[0172] S231. In response to the user's recording end operation, the ground equipment stops displaying the video recording window and stops image buffering, and outputs the recorded video based on the first frame of the buffered image to the last frame of the recorded image.

[0173] S232. The ground equipment will store the recorded video locally and / or upload the recorded images to a cloud server for storage.

[0174] In an optional implementation, if the aerial photography mode highlighted in the video call interface displayed on the cockpit screen is panoramic video mode, and the user records panoramic video through the cockpit screen, the method may further include the following steps S233 to S235:

[0175] S233. When the cockpit processing unit senses that the user clicks the record button in the video call interface displayed on the cockpit display, it displays a panoramic recording window in the video call interface, selects the current playback frame from the panoramic video stream as the first panoramic image, and then performs image buffering on the panoramic video stream frame by frame starting from the first panoramic image.

[0176] S234, the cockpit processing unit responds to the user's recording end operation by stopping the display of the panoramic recording window and stopping the image buffer, and outputs panoramic video based on the first frame of the buffered panoramic image to the last frame of the panoramic image;

[0177] S235, the cockpit processing unit stores the panoramic video locally and / or uploads the panoramic video to a cloud server for storage.

[0178] In an optional implementation, if the aerial photography mode highlighted in the video call interface displayed on the device screen is panoramic video mode, and the user records panoramic video through the device screen, the method may further include the following steps S236 to S238:

[0179] S236. When the ground equipment senses that the user clicks the record button in the video call interface displayed on the equipment screen, it displays a panoramic recording window in the video call interface, selects the current playback frame from the panoramic video stream as the first panoramic image, and then performs image caching on the panoramic video stream frame by frame starting from the first panoramic image.

[0180] S237. In response to the user's recording end operation, the ground equipment stops displaying the panoramic recording window and stops image buffering, and outputs panoramic video based on the first frame of the buffered panoramic image to the last frame of the panoramic image.

[0181] S238. The ground equipment stores the panoramic video locally and / or uploads the panoramic video to a cloud server for storage.

[0182] In an optional implementation, during a video call, the video call interface displayed on the cockpit display and the device display may include multiple field-of-view adjustment buttons (such as up, down, left, and right buttons) to support user control of the lens rotation of the image acquisition unit, thereby adjusting the field of view. Specific lens rotation control scenarios are divided into the following two types.

[0183] In the first scenario of camera rotation control, when a user inside the manned aircraft controls the camera rotation via the cockpit display screen, after step S206 above, the method may further include the following steps S241 to S242:

[0184] S241. When the cockpit processing unit senses that the user clicks or double-clicks any field of view adjustment button in the video call interface displayed on the cockpit display, it obtains the adjustment direction and adjustment angle.

[0185] S242, The cockpit processing unit sends the adjustment direction and adjustment angle to the image acquisition unit so that the image acquisition unit can control the lens rotation based on the adjustment direction and adjustment angle.

[0186] In the second scenario of lens rotation control, when a user inside the ground device controls the lens rotation via the device's display screen, after step S206 above, the method may further include the following steps S243 to S243:

[0187] S243. When the ground equipment senses that the user clicks or double-clicks any view adjustment button in the video call interface displayed on the equipment screen, it obtains the adjustment direction and adjustment angle, and sends the adjustment direction and adjustment angle to the cockpit processing unit.

[0188] S244, the cockpit processing unit sends the adjustment direction and adjustment angle to the image acquisition unit so that the image acquisition unit can control the lens rotation based on the adjustment direction and adjustment angle.

[0189] In this embodiment, the lens that controls the rotation is the lens that captures the video stream.

[0190] Optionally, a single click of the field of view adjustment button corresponds to a preset rotation angle (e.g., 10° or 15°). In other words, the number of clicks determines the adjustment angle. For example, if the preset rotation angle is 10°, and the user double-clicks the up button on the video call interface displayed on the cockpit screen, the cockpit processing unit can determine that the adjustment direction is upward (e.g., upward corresponds to the forward direction of the manned aircraft) and the adjustment angle is 20°. This example is merely illustration and is not intended to be limiting.

[0191] During a video call, the camera can be rotated while recording video or panoramic video.

[0192] It should be noted that the execution order of each step in the above method embodiments is not limited to the step numbers shown, and the execution order of each step shall be subject to the actual application.

[0193] Please see Figure 8 , Figure 8A schematic diagram of the aerial photography sharing device provided in an embodiment of the present invention is shown. The aerial photography sharing device 200 is applied to the cockpit processing unit of a manned aircraft. The manned aircraft also includes a cockpit display screen communicatively connected to the cockpit processing unit; the cockpit processing unit is communicatively connected to ground equipment and an image acquisition unit mounted on the manned aircraft. The aerial photography sharing device 200 includes a video call module 220 and an audio push module 230.

[0194] The video call module 220 is used to receive the aerial video stream acquired by the image acquisition unit in response to the video call start command, and control the cockpit display screen to jump to the video call interface; the video call interface is used to display the aerial video stream.

[0195] The audio push module 230 is used to acquire the first audio stream and push the first audio stream and the aerial video stream to the ground equipment, so that the ground equipment plays the first audio stream and controls its own device display screen to jump to the video call interface.

[0196] The video call module 220 is used to implement the above steps S103 and its sub-steps.

[0197] Optionally, the aerial photography sharing device 200 may further include a startup connection module 210, a parameter setting module 250, a shooting module 260, a switching module 270, and a recording module 280. The startup connection module 210 is used to implement the above steps S101 to S102; the parameter setting module 250 is used to implement the above steps S106 to S108 and their sub-steps; the shooting module 260 is used to implement the above step S109; the switching module 270 is used to implement the above steps S110 to S111 and the above step S115; and the recording module 280 is used to implement the above steps S112 to S114 and the above steps S116 to S118.

[0198] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the aerial photography sharing device 200 described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0199] This invention also provides a manned aircraft, which includes a cockpit processing unit for implementing the above-described flying car audio and video sharing method.

[0200] In summary, this invention provides a method, apparatus, and manned aircraft for sharing audio and video in a flying car. The manned aircraft includes a cockpit processing unit and a cockpit display screen communicatively connected to the cockpit processing unit. The cockpit processing unit is also communicatively connected to ground equipment and an image acquisition unit mounted on the manned aircraft. In this method, the cockpit processing unit: responds to a video call initiation command, receives an aerial video stream acquired by the image acquisition unit, and controls the cockpit display screen to switch to a video call interface; the video call interface is used to display the aerial video stream; acquires a first audio stream, and pushes the first audio stream and the aerial video stream to the ground equipment, so that the ground equipment plays the first audio stream and controls its own device display screen to switch to the video call interface. This invention enables video calls between the cockpit processing unit and ground equipment, allowing users in the manned aircraft to share aerial views with users using ground equipment. Furthermore, the aerial view is not limited by the cockpit's field of vision, and the sharing process does not affect driving.

[0201] The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for sharing audio and video from a flying car, characterized in that, A cockpit processing unit for a manned aircraft, the manned aircraft further comprising a cockpit display screen communicatively connected to the cockpit processing unit; the cockpit processing unit communicatively connected to ground equipment and an image acquisition unit mounted on the manned aircraft; the method includes: In response to a video call initiation command, the system receives the aerial video stream captured by the image acquisition unit and controls the cockpit display screen to switch to the video call interface; the video call interface is used to display the aerial video stream. A first audio stream is acquired, and the first audio stream and the aerial video stream are pushed to the ground device, so that the ground device plays the first audio stream and controls its own device display screen to jump to the video call interface.

2. The method according to claim 1, characterized in that, The step of responding to a video call initiation command, receiving the aerial video stream acquired by the image acquisition unit, and controlling the cockpit display screen to switch to the video call interface includes: When the cockpit display screen detects that the user has clicked the video button in the control bar of the connection success interface displayed on the cockpit display screen, or when the user's video call control voice is detected, the cockpit display screen is controlled to jump to the call waiting interface and a video call request is sent to the ground equipment, so that the ground equipment displays a call request interface based on the video call request. When the ground equipment receives the acceptance notification, a collection command is sent to the image acquisition unit so that the image acquisition unit can start collecting aerial video streams based on the collection command; the video call initiation command is the acceptance notification. Receive the aerial video stream acquired by the image acquisition unit, and control the cockpit display screen to switch from the call waiting interface to the video call interface; Alternatively, the step of receiving the aerial video stream acquired by the image acquisition unit and controlling the cockpit display screen to switch to the video call interface in response to the video call initiation command includes: When a video call request is received from the ground equipment, a call request interface is displayed on the cockpit display screen based on the video call request. When the system detects that a user has clicked the accept button in the call request interface or when it detects the user's call acceptance control voice, it sends an acceptance notification to the ground equipment and sends an acquisition command to the image acquisition unit, so that the image acquisition unit can start acquiring aerial video streams based on the acquisition command. The system receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to switch from the call request interface to the video call interface.

3. The method according to claim 1, characterized in that, The method further includes: When the system detects that a user has clicked the parameter setting button on the video call interface displayed on the cockpit screen, it controls the cockpit screen to jump to the parameter adjustment interface. The system acquires the first parameter update data set by the user in the parameter adjustment interface displayed on the cockpit screen, and sends the first parameter update data to the image acquisition unit so that the image acquisition unit updates the shooting parameters based on the first parameter update data. And / or, The system receives user-set second parameter update data sent by the ground equipment and sends the second parameter update data to the image acquisition unit so that the image acquisition unit updates the shooting parameters based on the second parameter update data. The second parameter update data is obtained by the ground equipment after it controls the device display screen to jump to the parameter adjustment interface when it senses that the user clicks the parameter setting button in the video call interface displayed on the device display screen.

4. The method according to claim 1, characterized in that, The aerial photography mode highlighted in the video call interface is the default shooting mode, and the method further includes: When the system detects that a user has clicked the camera button on the video call interface displayed on the cockpit screen, it selects the current frame from the aerial video stream as the captured image; and stores the captured image locally and / or uploads the captured image to a cloud server for storage. Alternatively, the method may further include: When it is sensed that the user clicks or swipes to select any one of the multiple mode buttons included in the video call interface displayed on the cockpit screen, the target mode selected by the user is determined; If the target mode is recording mode, then the aerial photography mode highlighted in the video call interface displayed on the cockpit display screen is switched to the recording mode, and a switching recording command is sent to the ground equipment, so that the ground equipment controls the aerial photography mode highlighted in the video call interface displayed on the device display screen to switch to the recording mode based on the switching recording command; When the system detects that the user clicks the record button in the video call interface displayed on the cockpit screen, a video recording window is displayed in the video call interface. The system then selects the current playback frame from the aerial video stream as the first frame to be recorded and starts caching the aerial video stream frame by frame from the first frame to record the image. In response to the user's recording end operation, the video recording window is stopped and the image buffering is stopped. The recorded video is then output based on the first frame of the buffered image up to the last frame. The recorded video is stored locally, and / or uploaded to a cloud server for storage; If the target mode is panoramic video mode, then the image acquisition unit is controlled to acquire a panoramic video stream and play the panoramic video stream through the video call interface displayed on the cockpit display screen. At the same time, the aerial photography mode highlighted in the video call interface displayed on the cockpit display screen is switched to the panoramic video mode, and a panoramic switching command and the panoramic video stream are sent to the ground equipment, so that the ground equipment plays the panoramic video stream through the video call interface displayed on the equipment display screen based on the panoramic switching command, and switches the aerial photography mode highlighted in the video call interface displayed on the equipment display screen to the panoramic video mode. When the system detects that the user clicks the record button in the video call interface displayed on the cockpit screen, a panoramic recording window is displayed in the video call interface. The system then selects the current playback frame from the panoramic video stream as the first panoramic image and starts caching the panoramic video stream frame by frame from the first panoramic image. In response to the user's recording end operation, the panoramic recording window is stopped and image caching is stopped, and a panoramic video is output based on the cached first frame panoramic image to the last frame panoramic image; The panoramic video may be stored locally, and / or uploaded to a cloud server for storage.

5. A method for sharing audio and video from a flying car, characterized in that, The method is applied to an aerial photography sharing system, which includes a manned aircraft and ground equipment. The manned aircraft includes a cockpit processing unit and a cockpit display screen communicatively connected to the cockpit processing unit. The cockpit processing unit is communicatively connected to the ground equipment and an image acquisition unit mounted on the manned aircraft. The cockpit processing unit or the ground equipment responds to the video call initiation command to receive the aerial video stream acquired by the image acquisition unit and control the cockpit display screen to jump to the video call interface; the video call interface is used to display the aerial video stream. The cockpit processing unit acquires the first audio stream and pushes the first audio stream and the aerial video stream to the ground equipment; The ground equipment plays the first audio stream and controls its own device display screen to jump to the video call interface.

6. The method according to claim 5, characterized in that, The cockpit processing unit or the ground equipment responds to the video call initiation command so that the cockpit processing unit receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to jump to the video call interface; The steps for displaying the aerial video stream on the video call interface include: When the cockpit processing unit detects that the user clicks the video button in the control bar of the connection success interface displayed on the cockpit display screen, or when it detects the user's video call control voice, it controls the cockpit display screen to jump to the call waiting interface and sends a video call request to the ground equipment. Based on the video call request, the ground equipment controls the device display screen to jump to the call request interface; When the ground equipment senses that the user clicks the accept button on the call request interface or detects the user's call acceptance control voice, it sends an acceptance notification to the cockpit processing unit; the video call initiation command is the acceptance notification. Upon receiving the acceptance notification, the cockpit processing unit sends an acquisition command to the image acquisition unit, so that the image acquisition unit begins to acquire aerial video streams based on the acquisition command. The cockpit processing unit receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to switch from the call waiting interface to the video call interface. Alternatively, the cockpit processing unit or the ground equipment responds to a video call initiation command to cause the cockpit processing unit to receive the aerial video stream acquired by the image acquisition unit and control the cockpit display screen to switch to the video call interface; the step of the video call interface displaying the aerial video stream includes: The ground equipment responds to the shared application launch command, launches the aerial photography sharing application, and displays the main sharing interface on the equipment's display screen. When the ground equipment senses that the user clicks the video button on the shared main interface or when it detects the user's video call control voice, it controls the device's display screen to jump to the call waiting interface and sends a video call request to the cockpit processing unit. Based on the video call request, the cockpit processing unit controls the cockpit display screen to jump to the call request interface. When it senses that the user clicks the accept button in the call request interface or when it detects the user's call acceptance control voice, it sends an acceptance notification to the ground equipment and sends an acquisition command to the image acquisition unit so that the image acquisition unit starts acquiring aerial video stream based on the acquisition command. The cockpit processing unit receives the aerial video stream acquired by the image acquisition unit and controls the cockpit display screen to switch from the call waiting interface to the video call interface.

7. The method according to claim 5, characterized in that, The method further includes: When the cockpit processing unit detects that the user clicks the parameter setting button in the video call interface displayed on the cockpit screen, it controls the cockpit screen to jump to the parameter adjustment interface. The cockpit processing unit acquires the updated data of the first parameter set by the user in the parameter adjustment interface displayed on the cockpit screen; The cockpit processing unit sends the first parameter update data to the image acquisition unit, so that the image acquisition unit updates the shooting parameters based on the first parameter update data. And / or, When the ground equipment detects that the user clicks the parameter setting button in the video call interface displayed on the device's screen, it controls the device's screen to jump to the parameter adjustment interface. The ground equipment acquires the updated data of the second parameter set by the user in the parameter adjustment interface displayed on the equipment screen, and sends the updated data of the second parameter to the cockpit processing unit; The cockpit processing unit sends the second parameter update data to the image acquisition unit, so that the image acquisition unit updates the shooting parameters based on the second parameter update data.

8. The method according to claim 5, characterized in that, The method further includes: When the cockpit processing unit senses that the user clicks or double-clicks any field of view adjustment button in the video call interface displayed on the cockpit screen, it obtains the adjustment direction and adjustment angle. The cockpit processing unit sends the adjustment direction and the adjustment angle to the image acquisition unit, so that the image acquisition unit controls the lens rotation based on the adjustment direction and the adjustment angle; And / or, When the ground equipment senses that the user clicks or double-clicks any field of view adjustment button on the video call interface displayed on the device's screen, it obtains the adjustment direction and adjustment angle, and sends the adjustment direction and adjustment angle to the cockpit processing unit. The cockpit processing unit sends the adjustment direction and the adjustment angle to the image acquisition unit, so that the image acquisition unit controls the lens rotation based on the adjustment direction and the adjustment angle.

9. The method according to claim 5, characterized in that, The aerial photography mode highlighted in the video call interface is the default shooting mode, and the method further includes: When the cockpit processing unit senses that the user has clicked the shooting button in the video call interface displayed on the cockpit screen, it selects the current playback frame from the aerial video stream as the shooting image, stores the shooting image locally, and / or uploads the shooting image to the cloud server for storage. When the ground equipment senses that the user has clicked the capture button on the video call interface displayed on the device's screen, it selects the current playback frame from the aerial video stream as the captured image, stores the captured image locally, and / or uploads the captured image to a cloud server for storage.

10. The method according to claim 5, characterized in that, The aerial photography mode highlighted in the video call interface is the default shooting mode, and the method further includes: When the cockpit processing unit senses that the user clicks or slides to select any one of the multiple mode buttons included in the video call interface displayed on the cockpit screen, it determines the target mode selected by the user. If the target mode is recording mode, the cockpit processing unit switches the aerial photography mode highlighted in the video call interface displayed on the cockpit screen to the recording mode, and sends a switching recording command to the ground equipment. Based on the switching recording command, the ground equipment controls the aerial photography mode highlighted in the video call interface displayed on the device's screen to switch to the recording mode; If the target mode is panoramic video mode, the cockpit processing unit controls the image acquisition unit to acquire panoramic video stream and plays the panoramic video stream through the video call interface displayed on the cockpit display screen. At the same time, the aerial photography mode highlighted in the video call interface displayed on the cockpit display screen is switched to the panoramic video mode, and a panoramic switching command and the panoramic video stream are sent to the ground equipment. Based on the panorama switching command, the ground equipment plays the panoramic video stream through the video call interface displayed on the device's screen, and switches the aerial photography mode highlighted in the video call interface displayed on the device's screen to the panoramic video mode; Alternatively, the method may further include: When the ground equipment senses that the user clicks or slides to select any one of the multiple mode buttons included in the video call interface displayed on the device's screen, it determines the target mode selected by the user. If the target mode is recording mode, the ground equipment will switch the aerial photography mode highlighted in the video call interface displayed on the device's screen to the recording mode, and send a switching recording command to the cockpit processing unit; The cockpit processing unit controls the aerial photography mode highlighted in the video call interface displayed on the cockpit screen to switch to the recording mode based on the switching recording command. If the target mode is panoramic video mode, the ground equipment sends a panoramic switching command to the cockpit processing unit; Based on the panoramic switching command, the cockpit processing unit controls the image acquisition unit to acquire a panoramic video stream, and the cockpit processing unit plays the panoramic video stream through the video call interface displayed on the cockpit display screen. At the same time, the aerial photography mode highlighted in the video call interface displayed on the cockpit display screen is switched to the panoramic video mode, and the panoramic video stream is sent to the ground equipment. The ground equipment switches the aerial photography mode highlighted in the video call interface displayed on the equipment screen to the panoramic video mode, and streams the panoramic video stream through the video call interface.

11. The method according to claim 10, characterized in that, When the aerial photography mode highlighted in the video call interface displayed on the cockpit screen is the recording mode, the method further includes: When the cockpit processing unit detects that the user clicks the record button in the video call interface displayed on the cockpit screen, it displays a video recording window in the video call interface, selects the current playback frame from the aerial video stream as the first frame to be recorded, and then performs image caching on the aerial video stream frame by frame starting from the first frame to be recorded. In response to the user's recording end operation, the cockpit processing unit stops displaying the video recording window and stops image caching, and outputs the recorded video based on the first frame of the cached image to the last frame of the recorded image. The cockpit processing unit stores the recorded video locally and / or uploads the recorded video to a cloud server for storage. Alternatively, if the aerial photography mode highlighted in the video call interface displayed on the device screen is the recording mode, the method further includes: When the ground equipment senses that the user clicks the record button in the video call interface displayed on the device's screen, it displays a video recording window in the video call interface, selects the current playback frame from the aerial video stream as the first frame to be recorded, and then performs image caching on the aerial video stream frame by frame starting from the first frame to be recorded. In response to the user's recording end operation, the ground equipment stops displaying the video recording window and stops image caching, and outputs the recorded video based on the first frame of the cached image to the last frame of the recorded image; The ground equipment stores the recorded video locally and / or uploads the recorded images to a cloud server for storage. Alternatively, if the aerial photography mode highlighted in the video call interface displayed on the cockpit screen is the panoramic video mode, the method further includes: When the cockpit processing unit detects that the user clicks the record button in the video call interface displayed on the cockpit screen, it displays a panoramic recording window in the video call interface, selects the current playback frame from the panoramic video stream as the first panoramic image, and then performs image caching on the panoramic video stream frame by frame starting from the first panoramic image. In response to the user's recording end operation, the cockpit processing unit stops displaying the panoramic recording window and stops image caching, and outputs panoramic video based on the cached first frame panoramic image to the last frame panoramic image; The cockpit processing unit stores the panoramic video locally and / or uploads the panoramic video to a cloud server for storage. Alternatively, if the aerial photography mode highlighted in the video call interface displayed on the device screen is the panoramic video mode, the method further includes: When the ground equipment senses that the user clicks the record button in the video call interface displayed on the device's screen, it displays a panoramic recording window in the video call interface, selects the current playback frame from the panoramic video stream as the first panoramic image, and then performs image caching on the panoramic video stream frame by frame starting from the first panoramic image. In response to the user's recording end operation, the ground equipment stops displaying the panoramic recording window and stops image caching, and outputs panoramic video based on the cached first frame panoramic image to the last frame panoramic image; The ground equipment stores the panoramic video locally and / or uploads the panoramic video to a cloud server for storage.

12. A drone sharing device, characterized in that, A cockpit processing unit for use in a manned aircraft, the manned aircraft further including a cockpit display screen communicatively connected to the cockpit processing unit; the cockpit processing unit is communicatively connected to ground equipment and an image acquisition unit mounted on the manned aircraft; including: The video call module is used to respond to a video call initiation command, receive the aerial video stream acquired by the image acquisition unit, and control the cockpit display screen to jump to the video call interface; the video call interface is used to display the aerial video stream. An audio push module is used to acquire a first audio stream and push the first audio stream and the aerial video stream to the ground device, so that the ground device plays the first audio stream and controls its own device display screen to jump to the video call interface.

13. A manned aircraft, characterized in that, It includes a cockpit processing unit, which is used to implement the flying car audio and video sharing method according to any one of claims 1-4.

Images