Image acquisition method and communication device

By sending wireless frame synchronization information in a multi-node distributed camera system, the problem of multi-node image acquisition time synchronization is solved, ensuring that each node acquires images at the same time, thus achieving high-precision image synchronization and video frame alignment.

CN121644965APending Publication Date: 2026-03-10HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-31
Publication Date
2026-03-10

AI Technical Summary

Technical Problem

In a multi-node distributed camera scenario, how can we ensure the time synchronization of image acquisition among multiple nodes?

Method used

By sending synchronization information corresponding to the wireless frame, the acquisition time of each node is determined, enabling multiple camera modules to acquire images at the same time and obtain images through the timing of the wireless frame, thus ensuring time synchronization.

Benefits of technology

It improves the synchronization accuracy of image acquisition between multiple nodes, reduces the complexity and cost of subsequent image alignment processing, and enhances the alignment effect and smoothness of video frames.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121644965A_ABST
    Figure CN121644965A_ABST
Patent Text Reader

Abstract

The invention relates to the field of wireless communication technologies and videos, in particular to an image acquisition method and a communication device. The method comprises the following steps: a first node sends synchronization information corresponding to a first wireless frame; the first node acquires a plurality of first images, the plurality of first images are acquired by a plurality of camera modules based on a first moment of a first wireless frame, and the first moment of the first wireless frame is determined by the synchronization information. The time synchronization of the first images acquired by the plurality of camera modules can be ensured. The method can be applied to an LTE / 5G system, and supports a 3GPP standard protocol; the technical scheme provided by the embodiment of the invention can also be applied to a satellite flash system and supports a satellite flash standard protocol.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to an image acquisition method and a communication device. Background Technology

[0002] As video applications expand into increasingly diverse fields and scopes, the demand for multi-node distributed cameras is also growing, such as in 3D video capture, multi-camera live streaming, and in-vehicle 360° surround view systems. In multi-node distributed camera scenarios, multiple nodes need to simultaneously acquire images. Therefore, ensuring time synchronization of image acquisition among multiple nodes is a critical problem that needs to be solved. Summary of the Invention

[0003] This application provides an image acquisition method and communication device that can ensure time synchronization of image acquisition among multiple nodes.

[0004] Firstly, embodiments of this application provide an image acquisition method, which can be applied to a first node. This method can be executed by the first node, or by components of the first node (such as chips or circuits), without limitation. The method includes:

[0005] Send synchronization information corresponding to the first wireless frame; acquire multiple first images, which are collected by multiple camera modules based on the first moment of the first wireless frame, and the first moment of the first wireless frame is determined by the synchronization information.

[0006] In this embodiment, the synchronization information corresponding to the first wireless frame is used to indicate the time corresponding to the first wireless frame (such as start time, end time, first time, etc.). Multiple camera modules can be respectively included in multiple nodes, which may or may not include the first node. Multiple nodes can respectively acquire the first image based on the first time of the first wireless frame, that is, multiple nodes acquire the first image at the same time, thereby ensuring time synchronization of the first images acquired by the multiple nodes.

[0007] In conjunction with the first aspect, in one possible implementation, the method further includes:

[0008] Multiple second images are acquired, which are respectively captured by multiple camera modules based on the second moment of the second wireless frame; wherein, multiple first images and multiple second images are used to generate a first video, and the first wireless frame and the second wireless frame are spaced N wireless frames apart, where N is determined by the frame rate of the first video and N is a positive integer.

[0009] In this embodiment, multiple first images can correspond to one video frame of the first video, and multiple second images can correspond to another video frame of the first video. The second time of the second wireless frame can be determined by the synchronization information corresponding to the second wireless frame. In this implementation, each video frame of the first video is acquired based on the time of the corresponding wireless frame. Image acquisition based on the time of the wireless frame can avoid the clock offset between the local clocks of multiple nodes causing asynchronous image acquisition, improve synchronization accuracy, and achieve frame-by-frame alignment of video frames acquired by multiple nodes, ensuring that each video frame acquired by multiple nodes remains synchronized.

[0010] In conjunction with the first aspect, in one possible implementation, the method further includes:

[0011] Multiple second images are acquired, which are respectively captured by multiple camera modules based on the second moment of the second wireless frame; wherein, the first wireless frame and the second wireless frame are separated by N wireless frames, where N is determined by a preset duration and N is a positive integer.

[0012] In this embodiment, the preset duration can be N wireless frame lengths or N wireless frame intervals. The wireless frame interval is the time interval between the start times of two adjacent wireless frames, or the frame interval between the end times of two adjacent wireless frames. The plurality of first images and the plurality of second images can be used to generate a first video. For example, the plurality of first images correspond to one video frame of the first video, and the plurality of second images correspond to another video frame of the first video. In this implementation, after each time interval corresponding to the preset duration, the plurality of camera modules acquire images based on the time of the corresponding wireless frame, ensuring time synchronization of the images acquired by the multiple cameras.

[0013] In conjunction with the first aspect, in one possible implementation, the method further includes:

[0014] Multiple third images are acquired, which are collected by multiple camera modules based on a local clock. Multiple first images, multiple second images, and multiple third images are used to generate a first video. The time interval between the acquisition time of the multiple third images and the first moment of the first wireless frame is determined by the frame rate of the first video.

[0015] In this embodiment, the first moment can be understood as the reference starting point for video frame acquisition within a first time period. Within the first time period, the second node can periodically acquire video frames based on its local clock. The duration of this first time period is a preset duration. After the first time period, the reference starting point for video frame acquisition within the second time period is adjusted based on the synchronization signal of the wireless frame. That is, the second moment is used as the reference starting point for video frame acquisition within the second time period, and video frames are periodically acquired within the second time period based on the local clock. Within the first time period, the local clock deviation between multiple nodes is small, and the time deviation of video frame acquisition by multiple nodes based on their local clocks is small. Therefore, video frames can be acquired based on the local clock within this first time period. The acquisition time of video frames is corrected based on the synchronization information of the wireless frame every preset duration, eliminating the need to frequently acquire corresponding video frames based on the wireless frame, reducing the complexity of video frame acquisition, and ensuring time synchronization between the video frames acquired by multiple nodes.

[0016] In conjunction with the first aspect, in one possible implementation, the preset duration is longer than the video frame interval corresponding to the first video, and the video frame interval is determined by the frame rate of the first video.

[0017] In this embodiment, the video frame interval refers to the time interval between two adjacent video frames of the first video. The preset duration is longer than the video frame, eliminating the need for frequent acquisition of corresponding video frames based on wireless frames, thus reducing the complexity of video frame acquisition.

[0018] In conjunction with the first aspect, in one possible implementation, the first moment is the end moment or the start moment of the first radio frame.

[0019] In conjunction with the first aspect, in one possible implementation, multiple camera modules are respectively contained in multiple second nodes to acquire multiple first images, including:

[0020] The system receives multiple first images from multiple second nodes. That is, the multiple first images acquired by the first node all originate from these multiple second nodes.

[0021] In conjunction with the first aspect, in one possible implementation, the multiple camera modules include a camera module corresponding to a first node and at least one camera module corresponding to a second node; acquiring multiple first images includes:

[0022] A first image is acquired based on the camera module corresponding to the first node; at least one first image is received from at least one second node; the multiple images acquired by the first node include a first image acquired by the camera module corresponding to the first node and at least one first image from at least one second node.

[0023] In conjunction with the first aspect, in one possible implementation, the method further includes:

[0024] A first video is generated based on multiple first images.

[0025] Secondly, embodiments of this application provide an image acquisition method applied to a second node. This method can be executed by a first node, or by components of the first node (such as chips or circuits), without limitation. The method includes:

[0026] Receive synchronization information corresponding to the first wireless frame; acquire the first image based on the first moment of the first wireless frame, wherein the first moment of the first wireless frame is determined by the synchronization information; and send the first image to the first node.

[0027] In conjunction with the second aspect, in one possible implementation, the method further includes:

[0028] The second image is acquired based on the second moment of the second wireless frame; the first image and the second image are used to synthesize the first video, with N wireless frames between the first wireless frame and the second wireless frame, where N is determined by the frame rate of the first video and N is a positive integer; the second image is sent to the first node.

[0029] In conjunction with the second aspect, in one possible implementation, the method further includes: acquiring a second image based on a second moment of the second wireless frame; an interval of N wireless frames between the first wireless frame and the second wireless frame, wherein N is determined by a preset duration and N is a positive integer; and sending the second image to the first node.

[0030] In conjunction with the second aspect, in one possible implementation, before acquiring the second image based on the second location of the second wireless frame, the method further includes:

[0031] The third image is acquired based on the local clock. The first image, the second image, and the third image are used to generate the first video. The time interval between the acquisition time of the third image and the first moment of the first wireless frame is determined by the frame rate of the first video.

[0032] The third image is sent to the first node.

[0033] In conjunction with the second aspect, in one possible implementation, the preset duration is greater than the video frame interval corresponding to the first video, and the video frame interval is determined by the frame rate of the first video.

[0034] In conjunction with the second aspect, in one possible implementation, the first moment is the end moment or the start moment of the first wireless frame.

[0035] Thirdly, embodiments of this application provide a communication device for executing the method in any one of the first aspects or any possible implementations thereof. The communication device includes a module having the function of executing the method in any one of the first aspects or any possible implementations thereof.

[0036] For example, the communication device includes a processing module and a transceiver module. The transceiver module is used to send synchronization information corresponding to the first wireless frame. The processing module is used to acquire multiple first images, which are respectively captured by multiple camera modules based on the first moment of the first wireless frame, and the first moment of the first wireless frame is determined by the synchronization information.

[0037] In one possible implementation, the processing module is further configured to acquire multiple second images, which are captured by multiple camera modules based on the second moment of the second wireless frame; wherein the multiple first images and multiple second images are used to generate a first video, and the first wireless frame and the second wireless frame are spaced N wireless frames apart, where N is determined by the frame rate of the first video and N is a positive integer.

[0038] In one possible implementation, the processing module is further configured to acquire multiple second images, which are respectively captured by multiple camera modules based on the second moment of the second wireless frame; wherein, the first wireless frame and the second wireless frame are spaced N wireless frames apart, where N is determined by a preset duration and N is a positive integer.

[0039] In one possible implementation, the processing module is further configured to acquire multiple third images, which are acquired by multiple camera modules based on a local clock; the multiple first images, multiple second images, and multiple third images are used to generate a first video, and the time interval between the acquisition time of the multiple third images and the first moment of the first wireless frame is determined by the frame rate of the first video.

[0040] In one possible implementation, the preset duration is longer than the video frame interval corresponding to the first video, and the video frame interval is determined by the frame rate of the first video.

[0041] In one possible implementation, the first moment is the end or start moment of the first radio frame.

[0042] In one possible implementation, multiple camera modules are respectively included in multiple second nodes, and the processing module is specifically used to receive multiple first images from the multiple second nodes through the transceiver module.

[0043] In one possible implementation, the multiple camera modules include a camera module corresponding to a first node and a camera module corresponding to at least one second node; the processing module is specifically used to acquire a first image based on the camera module corresponding to the first node, and to receive at least one first image from at least one second node; the multiple images acquired by the first node include a first image acquired by the camera module corresponding to the first node and at least one first image from at least one second node.

[0044] In one possible implementation, the processing module is also used to generate a first video based on multiple first images.

[0045] Fourthly, embodiments of this application provide a communication device for executing the method in any of the aspects of the second aspect or any possible implementation thereof. The communication device includes a module having the capability to execute the method in any of the aspects of the second aspect or any possible implementation thereof.

[0046] For example, the communication device includes a processing module and a transceiver module. The transceiver module is used to receive synchronization information corresponding to a first wireless frame; the processing module is used to acquire a first image based on a first moment of the first wireless frame, wherein the first moment of the first wireless frame is determined by the synchronization information; the transceiver module is also used to send the first image to a first node.

[0047] In one possible implementation, the processing module is further configured to acquire a second image based on a second moment of the second wireless frame; the first image and the second image are used to synthesize a first video, with N wireless frames between the first wireless frame and the second wireless frame, where N is determined by the frame rate of the first video and N is a positive integer; the transceiver module is further configured to send the second image to the first node.

[0048] In one possible implementation, the processing module is further configured to acquire a second image based on a second moment of the second wireless frame; the first wireless frame and the second wireless frame are spaced N wireless frames apart, where N is determined by a preset duration and is a positive integer; the transceiver module is further configured to send the second image to the first node.

[0049] In one possible implementation, the processing module is further configured to acquire a third image based on a local clock, the first image, the second image, and the third image are used to generate a first video, and the time interval between the acquisition time of the third image and the first moment of the first wireless frame is determined by the frame rate of the first video; the transceiver module is further configured to send the third image to the first node.

[0050] In one possible implementation, the preset duration is greater than the video frame interval corresponding to the first video, and the video frame interval is determined by the frame rate of the first video.

[0051] In one possible implementation, the first moment is the end moment or the start moment of the first wireless frame.

[0052] Fifthly, embodiments of this application provide a communication device including a processor for executing the methods shown in any one of the first to second aspects or any possible implementations thereof. The processor executes a program stored in a memory, and when the program is executed, the methods shown in any one of the first to second aspects or any possible implementations thereof are executed.

[0053] In one possible implementation, the memory is located outside the aforementioned communication device.

[0054] In one possible implementation, the memory is located within the aforementioned communication device.

[0055] In this embodiment, the processor and memory can also be integrated into a single device, that is, the processor and memory can be integrated together. For example, the communication device can be a chip.

[0056] In one possible implementation, the communication device further includes a transceiver for receiving or sending information.

[0057] In a sixth aspect, embodiments of this application provide a communication device including a logic circuit and an interface, wherein the logic circuit and the interface are coupled; the interface is used for inputting and / or outputting information, and the logic circuit is used for performing the method as described in any one of the first to second aspects or any possible implementation thereof.

[0058] In a seventh aspect, embodiments of this application provide a computer-readable storage medium for storing a computer program that, when run on a computer, causes the methods shown in any of the first to second aspects or any possible implementation thereof to be executed.

[0059] Eighthly, embodiments of this application provide a computer program product that, when run on a computer, causes the methods shown in any of the first to second aspects or any possible implementations described above to be executed. Attached Figure Description

[0060] Figure 1 This application provides a schematic diagram of the structure of a communication system according to an embodiment of the present application.

[0061] Figure 2 A schematic diagram illustrating wireless frame synchronization provided in an embodiment of this application;

[0062] Figure 3A A schematic diagram of the structure of a communication system for multi-node synchronous shooting provided in an embodiment of this application;

[0063] Figure 3B A schematic diagram of a communication system for simultaneous dual-node shooting provided in an embodiment of this application;

[0064] Figure 4 A schematic flowchart illustrating an image acquisition method provided in an embodiment of this application;

[0065] Figure 5 A flowchart illustrating another image acquisition method provided in an embodiment of this application;

[0066] Figure 6 An example of an image acquisition scenario provided in this application embodiment;

[0067] Figure 7 Another example of an image acquisition scenario provided in this application embodiment;

[0068] Figure 8 This is a schematic diagram of the structure of a communication device provided in an embodiment of this application;

[0069] Figure 9 This is a schematic diagram of another communication device provided in an embodiment of this application;

[0070] Figure 10 This is a schematic diagram of another communication device provided in an embodiment of this application. Detailed Implementation

[0071] The terms "first" and "second," etc., used in the specification, claims, and drawings of this application are only used to distinguish different objects and not to limit the order, sequence, priority, or importance of multiple objects. In the embodiments of this application, "multiple" refers to two or more. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or devices. Additionally, the character " / ," unless otherwise specified, generally indicates that the preceding and following objects are in an "or" relationship.

[0072] The term "embodiment" as used herein means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0073] It should be understood that in this application, "at least one (item)" means one or more, "more than one" means two or more, "at least two (items)" means two or three or more, and "and / or" is used to describe the relationship between related objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0074] The technical solutions in the embodiments of this application will be described below with reference to the accompanying drawings. The technical solutions in the embodiments of this application can be applied to various communication systems, such as Universal Mobile Telecommunications System (UMTS), Wireless Local Area Network (WLAN), Wireless Fidelity (Wi-Fi) systems, 4th generation (4G) mobile communication systems such as Long Term Evolution (LTE) systems, 5th generation (5G) mobile communication systems such as New Radio (NR) systems, and future evolutionary communication systems such as 6th generation (6G) mobile communication systems.

[0075] This application will present various aspects, embodiments, or features relating to systems that may include multiple devices, components, modules, etc. It should be understood and appreciated that individual systems may include additional devices, components, modules, etc., and / or may not include all the devices, components, modules, etc. discussed in conjunction with the accompanying drawings. Furthermore, combinations of these approaches are also possible.

[0076] Furthermore, in the embodiments of this application, words such as "exemplarily" and "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as an "example" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the term "example" is intended to present concepts in a concrete manner. In the embodiments of this application, "of," "corresponding, relevant," and "corresponding" may sometimes be used interchangeably, and it should be noted that their intended meanings are consistent unless their distinction is emphasized.

[0077] The communication systems and service scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of network architecture and the emergence of new service scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0078] The method provided in this application can be applied to various communication systems, such as Internet of Things (IoT) systems, narrowband Internet of Things (NB-IoT) systems, long-term evolution (LTE) systems, short-range wireless communication network systems such as SparkLink communication network systems (including SparkLink Basic (SLB) and SparkLink LowEnergy (SLE) versions), Bluetooth Low Energy (BLE), 5th-generation (5G) communication systems, and new communication systems emerging in future communication developments (such as 6G). SLB and SLE comply with the SparkLink technology standards published by the SparkLink Consortium.

[0079] The technical solutions provided in this application can also be applied to machine-type communication (MTC), long-term evolution-machine (LTE-M) technology, device-to-device (D2D) networks, machine-to-machine (M2M) networks, Internet of Things (IoT) networks, or other networks. Among these, IoT networks may include, for example, vehicle-to-everything (V2X) networks. The communication methods in V2X systems are collectively referred to as vehicle-to-everything (V2X), where X can represent anything. For example, V2X may include vehicle-to-vehicle (V2V) communication, vehicle-to-infrastructure (V2I) communication, vehicle-to-pedestrian (V2P) communication, or vehicle-to-network (V2N) communication, etc.

[0080] In the aforementioned communication systems, devices with communication capabilities can be called nodes or communication nodes. For example, a node can include independent devices such as handheld terminals, vehicles, in-vehicle equipment, network-side equipment, user equipment, access terminals, user units, user stations, mobile stations, mobile stations, remote stations, remote terminals, wireless communication equipment, user agents, or user devices. It can also be a component (such as a chip or integrated circuit) contained within an independent device. A node can be any possible intelligent terminal device (such as a mobile phone), intelligent transportation equipment (such as vehicles, drones, etc.), intelligent manufacturing equipment, smart home devices (such as large screens, speakers, etc.), etc.

[0081] The nodes in this application embodiment can be applied to a variety of application scenarios, such as the following: mobile internet (MI), industrial control, self-driving, transportation safety, internet of things (IoT), smart city, or smart home, etc.

[0082] In certain application scenarios or network types, devices with similar communication capabilities may not be called nodes, and this application does not impose any restrictions on this.

[0083] In the communication system provided in this application embodiment, nodes can communicate with each other through D2D technology, M2M technology, or V2X technology.

[0084] The communication system provided in this application embodiment can, as follows: Figure 1 As shown, the communication system may include at least one master node and at least one slave node. The descriptions of the master node and slave node are as follows:

[0085] For example, a master node can be a master device, specifically a next-generation node B (gNB), a next-generation evolved node B (ng-eNB), a node in a short-range wireless communication network system (e.g., a master node, management node, or G node in a StarFlash communication network system), or an access network device in future 6G communication. The master device can be any device with wireless transceiver capabilities. This master device can be an access node, wireless relay node, or wireless backhaul node in a wireless local area network (WiFi) system. This master device can be a wireless controller in a cloud radio access network (CRAN) scenario. This master device can be a wearable device or a vehicle-mounted device. This master device can also be a small cell, a transmission reception point (TRP) (or a transmission point), etc.

[0086] For example, a slave node can be a terminal device, which may also be called a user equipment (UE), terminal, etc. A terminal device is a device with wireless transceiver capabilities that can be deployed on land, including indoors or outdoors, handheld, wearable, or vehicle-mounted; it can also be deployed on water, such as on ships; and it can be deployed in the air, such as on airplanes, balloons, or satellites. Terminal devices can be mobile phones, tablets, computers with wireless transceiver capabilities, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical care, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, and so on. It is understood that the terminal device can also be a node in a short-range wireless communication network system (e.g., a slave node, terminal node, or T node in a StarFlash communication network system), a terminal device in a future 6G network, or a terminal device in a future evolved PLMN, etc.

[0087] It is understood that the terminal device shown in this application may include not only vehicles (such as complete vehicles) in the Internet of Vehicles, but also in-vehicle equipment or in-vehicle terminals in the Internet of Vehicles. This application does not limit the specific form of the terminal device when it is applied to the Internet of Vehicles.

[0088] Optionally, the communication links between the aforementioned communication devices can include various types of connection media, including wired links (such as fiber optics), wireless links, or a combination of wired and wireless links. For example, they can be short-range wireless connection technologies including SparkLink, 802.11b / g, Bluetooth, Zigbee, radio frequency identification (RFID), ultra-wideband (UWB) technology, or short-range wireless communication systems (such as vehicle-mounted short-range wireless communication systems).

[0089] For example, the communication system illustrated in this application can be a synchronous communication system. In this system, each node communicates with the others according to predetermined time or frequency resources to meet the requirements of different types of services. Nodes can synchronize with each other using synchronization signals of wireless frames (such as synchronization training sequences) to achieve alignment of the positions of wireless frames transmitted over the air interface. Figure 2 As shown, Node 1 and Node 2 have a time-aligned understanding of the radio frames (radio frames #0 to #N) transmitted over the air interface. The synchronization signal for this radio frame can be periodically sent by the master node. Taking the StarSignal SLB system as an example, the SLB system can cyclically send the synchronization signal over the air interface in superframes. For example, the synchronization signal can be carried in one or more orthogonal frequency division multiplexing (OFDM) symbols of the superframe. A superframe can include multiple radio frames, and the synchronization signal can indicate the time (e.g., start time or end time) corresponding to the multiple radio frames in the superframe.

[0090] It is understood that in the embodiments of this application, the position and time of the wireless frame can be used interchangeably. For example, the start time of the wireless frame can also be called the start position of the wireless frame, and the end time of the wireless frame can also be called the end position of the wireless frame.

[0091] The aforementioned communication system can be applied to scenarios where multiple cameras simultaneously acquire images. For example, it can be used in 3D video shooting, multi-camera live video streaming, and in-vehicle 360-degree surround view. In scenarios where multiple cameras simultaneously acquire images, the communication system includes a second node (such as a master node or slave node) that includes image acquisition functionality and a first node (such as a master node or slave node) that can receive image information acquired by each second node.

[0092] like Figure 3A As shown, in a scenario where multiple cameras simultaneously acquire data, the communication system may include at least one first node ( Figure 3A Taking a first node as an example, and at least one second node. Each of the at least one second node may include a wireless communication module and a camera module, wherein the wireless communication module is used to acquire synchronization information of wireless frames, and the camera module is used to capture images. The first node may include a wireless communication module for receiving images captured by at least one second node.

[0093] For example, the first node may also include a camera module. Figure 3BAs shown, in a scenario with simultaneous dual-camera data acquisition, both the first node and the second node can include a camera module and a wireless communication module. After acquiring images through the camera module, the second node sends the acquired images to the first node through the wireless communication module. The first node acquires images through its camera module and receives images from the second node through its wireless communication module, and performs processing such as stitching or synchronous display of the images acquired by the first node and the images from the second node.

[0094] It is understood that the aforementioned wireless communication module refers to a module or unit with transceiver functions. This wireless communication module may also be called a communication module, communication interface, transceiver module, etc., or other names may be used. This application embodiment does not impose any restrictions on this. The aforementioned camera module refers to a module or unit with video recording or photo taking functions. In this application embodiment, the module or unit with video recording or photo taking functions may also have other names, and this application embodiment does not impose any restrictions on the names of the modules or units with video recording or photo taking functions.

[0095] Please see Figure 4 , Figure 4 This is a flowchart illustrating an image acquisition method provided in an embodiment of this application. The method can be applied to a first node and a second node; specific details regarding the first and second nodes can be found in the preceding descriptions and will not be repeated here. Figure 4 As shown, the method includes, but is not limited to, the following steps.

[0096] 401. The first node sends the synchronization information corresponding to the first wireless frame, and the second node receives the synchronization information corresponding to the first wireless frame.

[0097] For example, the synchronization information includes a synchronization training sequence (or synchronization sequence), and the second node can learn the time corresponding to the first wireless frame (such as the end time or the start time) based on the synchronization training sequence, thereby realizing frame synchronization between the first node and the second node.

[0098] For example, the first node broadcasts the synchronization information corresponding to the first radio frame. This synchronization information can also be the synchronization information corresponding to the superframe containing the first radio frame. The superframe includes multiple radio frames, and the synchronization information indicates the time corresponding to these multiple radio frames. For example, the superframe may include 48 radio frames, and the synchronization information indicates the time corresponding to these 48 radio frames.

[0099] For example, the first node includes a wireless communication module, which can send synchronization information. The second node may also include a wireless communication module, which can receive the synchronization information.

[0100] For example, in the case of multiple second nodes in a wireless communication system, the multiple second nodes receive the synchronization information of the wireless frame, and the multiple second nodes determine the position of the wireless frame based on the synchronization information of the wireless frame, thereby realizing frame synchronization between the first node and the multiple second nodes.

[0101] 402, The first node acquires multiple first images, which are collected by multiple camera modules based on the first moment of the first wireless frame.

[0102] The plurality of first images includes the first image acquired by the second node based on the first moment of the first wireless frame. That is, the second node acquires the first image based on the first moment of the first wireless frame and sends the first image to the first node, and correspondingly, the first node receives the first image from the second node.

[0103] For example, the second node may include a wireless communication module and a camera module. At a first moment of the first wireless frame, the wireless communication module outputs a pulse signal, which triggers the camera module to acquire a first image. For instance, the wireless communication module may output this pulse signal via a hardware pin. The camera module inputs the pulse signal and performs exposure based on the pulse signal to obtain the first image.

[0104] For example, the first image can be transmitted between the first node and the second node via wireless frames.

[0105] As an example, the multiple camera modules may be contained in multiple second nodes, and the first node receives multiple first images from the multiple second nodes respectively. Any one of the multiple first images is acquired by the corresponding second node based on the first moment of the first wireless frame.

[0106] As another example, the plurality of camera modules may be included in a first node and at least one second node. The first node acquires a first image based on the camera module corresponding to the first node and the first moment of the first wireless frame, and receives at least one first image from at least one second node respectively. The plurality of first images include the first image and at least one first image.

[0107] For example, the first node can also be called the master node or the aggregation node.

[0108] For example, the first moment of the first radio frame can also be described as the first position of the first radio frame, and the first moment of the first radio frame is indicated by the synchronization information corresponding to the first radio frame. The first moment can be any moment of the first radio frame. For example, the first moment can be the start moment or the end moment of the first radio frame, or the first moment can be the start moment or the end moment of a subframe or time slot in the first radio frame, or the first moment can be the start moment or the end moment of an OFDM symbol in the first radio frame.

[0109] For example, the aforementioned multiple first images are acquired by multiple camera modules capturing the same scene or background or corresponding objects at a first moment of a first wireless frame. The multiple first images are images of the scene, background, or object from different perspectives.

[0110] For example, after acquiring the multiple first images, the first node can process the multiple first images. For instance, the first node can display the multiple first images separately, allowing them to be displayed synchronously. Alternatively, the first node can stitch the multiple first images together to obtain multi-node captured images. Or, the first node can generate a first video based on the multiple first images; this first video can also be called a multi-node captured video or a multi-channel captured video.

[0111] In this embodiment, the synchronization information corresponding to the first wireless frame enables multiple camera modules to simultaneously acquire the corresponding first image. This improves the synchronization accuracy of image acquisition among the multiple camera modules to the same level as the frame synchronization of the wireless frame, thereby ensuring time alignment among the multiple first images. This reduces the complexity and cost of subsequent time alignment processing of the multiple first images. Furthermore, reusing the synchronization information corresponding to the first wireless frame does not incur additional incremental overhead.

[0112] In 3D video shooting scenarios, the first node can stitch together multiple first images and synthesize them into a scene video with depth-of-field effects. The synchronization of these multiple first images enhances the overall video quality. In in-vehicle 360-degree surround view scenarios, the first node can stitch together multiple first images according to a preset method and display the stitched image. The time alignment of the acquisition of multiple first images avoids fragmentation in the stitched image, resulting in better display quality and reducing the complexity of stitching multiple first images. In multi-camera live video streaming scenarios, the first node can synchronously display multiple first images, ensuring smooth transitions between multiple viewpoints.

[0113] Please see Figure 5 , Figure 5 This is a schematic flowchart illustrating another image acquisition method provided in an embodiment of this application. Figure 5 As shown, the method includes, but is not limited to, the following steps.

[0114] 501, the first node sends the synchronization information corresponding to the first wireless frame, and correspondingly, the second node receives the synchronization information corresponding to the first wireless frame.

[0115] Understandably, the specific implementation method for step 501 can be found in [reference needed]. Figure 4 The specific implementation of step 401 will not be detailed here.

[0116] 502, the second node acquires the first image based on the first moment of the first wireless frame.

[0117] Understandably, for a detailed explanation of the first moment of the first wireless frame, please refer to the relevant description above, which will not be elaborated here.

[0118] For example, the second node includes a camera module. At a first moment of the first wireless frame, the second node can trigger the camera module to acquire a first image. For instance, the second node includes a wireless communication module and a camera module. The wireless communication module receives synchronization information, determines the first moment of the first wireless frame based on the synchronization information, and outputs a pulse signal at the first moment of the first wireless frame. This pulse signal triggers the camera to expose, thereby acquiring the first image. The camera module exposes after receiving the pulse signal, thus acquiring the first image.

[0119] 503, the second node sends the first image, and correspondingly, the first node receives the first image.

[0120] For example, after the camera module of the second node acquires the first image, it can output the first image to the wireless communication module, which then sends the first image to the first node.

[0121] For example, in a wireless communication system including multiple second nodes, the first node receives multiple first images sent by the multiple second nodes, and the multiple first images are respectively acquired by the corresponding second node based on the first moment of the first wireless frame.

[0122] For example, the first node may include a camera module, which may also acquire a first image through its camera module at the first moment of the first wireless frame.

[0123] Optionally, Figure 5 The method shown also includes steps 504 and 505.

[0124] 504, The second node acquires the second image based on the second time step of the second wireless frame.

[0125] For example, when the second radio frame and the first radio frame belong to the same superframe, the synchronization information transmitted on the superframe indicates the time corresponding to the first radio frame and the time corresponding to the second radio frame. Therefore, the second time of the second radio frame is determined by the synchronization information of the first radio frame, that is, the second node can determine the second time of the second radio frame based on the synchronization information of the first radio frame. When the second radio frame and the first radio frame belong to different superframes, the second node also needs to receive the synchronization signal corresponding to the second radio frame and determine the second time of the second radio frame based on the synchronization information corresponding to the second radio frame.

[0126] The second time can be any time within the second radio frame. For example, the second time can be the start or end time of the second radio frame, or the second time can be the start or end time of a subframe or time slot within the second radio frame, or the second time can be the start or end time of an OFDM symbol within the second radio frame.

[0127] For example, the time interval between the second time and the first time is an integer multiple of the radio frame length, such as N radio frames between the first and second times, where N is a positive integer. Alternatively, the relative time of the second time within the second radio frame is the same as the relative time of the first time within the first radio frame. For example, the first time may be the start time of the first radio frame, and the second time may be the start time of the second radio frame. Another example is that the first time may be the end time of the first radio frame, and the second time may be the end time of the second radio frame. Yet another example is that the first time may be the start or end time of the i-th OFDM symbol in the first radio frame, and the second time may be the start or end time of the i-th OFDM symbol in the second radio frame, where i is a positive integer.

[0128] Optionally, the time interval between the first time and the second time may not be an integer multiple of the radio frame length. That is, the relative time of the first time in the first radio frame and the relative time of the second time in the second radio frame may be different. For example, the first time may be the start or end time of the i-th OFDM symbol in the first radio frame, and the second time may be the start or end time of the i±j-th OFDM symbol in the second radio frame, where i and j are positive integers.

[0129] In one possible implementation, the first image and the second image are used to synthesize a first video, with an interval of N wireless frames between the first and second wireless frames, where N is determined by the frame rate of the first video and is a positive integer. Alternatively, N can be determined by the video frame interval of the first video; for example, N can be determined by the ratio of the video frame interval of the first video to the frame length of the wireless frames.

[0130] For example, the first image and the second image are two video frames in the first video, such as two adjacent video frames in the first video.

[0131] For example, N can be determined by the frame rate of the first video and the frame length of the wireless frame.

[0132] As an example, N can be represented as Here, FPS represents the frame rate of the first video, measured in frames per second (f / s). f This indicates the length of the wireless frame, in seconds. This is for rounding down. In this example, the first time point relative to the first radio frame can be earlier than the second time point relative to the second radio frame. For example, the first time point can be the start time of the i-th OFDM symbol in the first radio frame, and the second time point can be the start time of the (i+j)-th OFDM symbol in the second radio frame, where i and j are positive integers.

[0133] As another example, N can be represented as FPS represents the frame rate of the first video, measured in frames per second. f This indicates the length of the wireless frame, in seconds. This indicates rounding up. In this example, the first time point relative to the first radio frame can be later than the second time point relative to the second radio frame. For example, the first time point can be the start time of the i-th OFDM symbol in the first radio frame, and the second time point can be the start time of the ij-th OFDM symbol in the second radio frame, where i and j are positive integers.

[0134] For example, the second node includes a wireless communication module and a camera module. The second node can receive synchronization information of wireless frames through the wireless communication module. This synchronization information includes synchronization information corresponding to the first wireless frame and synchronization information corresponding to the second wireless frame. The wireless communication module can determine the time corresponding to multiple wireless frames transmitted over the air interface based on the synchronization information of the wireless frames, and output a pulse signal at the first time of the first wireless frame. This pulse signal is used to trigger the camera module to acquire the first image. The wireless communication module can also count wireless frames or wireless frame intervals using a counter. For example, the counter increments by 1 after each wireless frame or wireless frame interval. The wireless frame interval refers to the time difference between the start times of two adjacent wireless frames. When the value of the counter is N, a pulse signal is output to trigger the camera module to acquire the second image, and the counter is cleared, or the value of the counter is set to 0 and counting starts again.

[0135] For example, such as Figure 6As shown, at the end of wireless frame 0, the wireless communication module outputs a pulse signal, triggering the camera module to acquire the first image. A counter begins counting, incrementing by 1 after each wireless frame interval. When the counter value reaches N, i.e., at the end of wireless frame #N-1, the wireless communication module outputs a pulse signal, triggering the camera module to acquire the second image. The time difference between acquiring the first and second images can also be called the video frame interval. After outputting the pulse signal, the wireless communication module resets the count value to 0 and restarts counting.

[0136] In this implementation, the synchronization information of the wireless frame is used to obtain each video frame of the first video. Each video frame of the first video is obtained by the synchronization information of the wireless frame. Image acquisition based on the synchronization information of the wireless frame can avoid the clock offset between the local clocks of multiple nodes, which would cause the image acquisition to be out of sync, thus improving the synchronization accuracy. It also enables frame-by-frame alignment of video frames acquired by multiple nodes, ensuring that each video frame acquired by multiple nodes remains synchronized.

[0137] In another possible implementation, the first and second wireless frames are spaced N wireless frames apart, where N is determined by a preset duration and is a positive integer.

[0138] For example, the first image and the second image are used to synthesize a first video, the preset duration of which is greater than the video frame interval corresponding to the first video. The video frame interval refers to the time interval between two adjacent video frames in the first video, and the video frame interval corresponding to the first video is determined by the frame rate of the first video. For example, the frame rate of the first video is 60 frames per second, and the video frame interval is 16.66 ms.

[0139] For example, the preset duration can be an integer multiple of the video frame interval, or the preset duration can be an integer multiple of the wireless frame length. For example, the preset duration can be 1 second.

[0140] For example, the preset duration can be set by the first node or by the second node. When the communication system includes multiple second nodes, the preset duration used by these multiple second nodes is the same.

[0141] For example, the preset duration can be determined based on the relative time offset between the local times of multiple second nodes. For instance, the larger the relative time offset, the shorter the preset duration. When the relative time offset is larger, the local clock deviation between multiple second nodes is larger, and the preset duration is shorter, which allows for more frequent calibration of the image acquisition time of each second node based on the synchronization information based on the wireless frame, thereby ensuring the synchronization accuracy of the image acquisition by each node.

[0142] For example, the preset duration can be determined by the synchronization accuracy requirements of each node acquiring images. For instance, the higher the synchronization requirement, the shorter the preset duration, which allows for more frequent calibration of the image acquisition time of each second node based on synchronization information based on wireless frames, thereby ensuring the synchronization accuracy of the images acquired by each node.

[0143] For example, before acquiring the second image, the second node can acquire the third image based on its local clock and send the third image to the first node, which then receives the third image. That is, within the time interval between acquiring the first image and acquiring the second image, the second node can acquire the third image based on its local clock. The first, second, and third images can be used to generate a first video, and the time interval between acquiring the third image and acquiring the first image is determined by the frame rate of the first video. Alternatively, the second node acquires the third image based on its local clock and the frame rate (or frame interval) of the first video.

[0144] For example, a first node can acquire multiple third images, which are respectively captured by multiple camera modules based on a local clock. For instance, the multiple camera modules include a camera module of the first node and a camera module of at least one second node. The first node can acquire a third image through its camera modules and receive at least one third image from at least one second node. Alternatively, the multiple camera modules can include camera modules of multiple second nodes, allowing the first node to receive multiple third images from the multiple second nodes.

[0145] In this implementation, the first moment can be understood as the reference starting point for video frame acquisition within a first time period. Within this first time period, the second node can periodically acquire video frames based on its local clock. The duration of this first time period is a preset duration. After the first time period, the reference starting point for video frame acquisition within the second time period is adjusted based on the synchronization signal of the wireless frames. That is, the second moment is used as the reference starting point for video frame acquisition within the second time period, and video frames are periodically acquired within the second time period based on the local clock.

[0146] For example, the second node can receive synchronization information of wireless frames through a wireless communication module. This synchronization information includes synchronization information of the first wireless frame and synchronization information of the second wireless frame. The wireless communication module can output a pulse signal to the camera module at a first moment of the first wireless frame to trigger the camera module to acquire the first image. After receiving the pulse signal, the camera module acquires the first image and periodically acquires video frames according to the frame rate of the first video. After outputting the pulse signal, the wireless communication module can count the wireless frames based on a counter. The counter increments by 1 after each wireless frame length or wireless frame interval. When the counter reaches N, the wireless frame module outputs a pulse signal again to trigger the camera module to acquire the second image.

[0147] For example, such as Figure 7 As shown, the preset duration is 1 second, and the pulse signal can also be called a pulse per second (PPS). The wireless communication module of the second node can output PPS0 at the beginning of wireless frame #1 to trigger the camera module to acquire the first image (i.e., video frame 0). After the camera module receives PPS0, it exposes and acquires the first image. Within a 1-second time interval, the wireless communication module counts the wireless frames using a counter, and the camera module periodically acquires video frames (video frames 1 to M-1) based on its local clock. After a 1-second time interval, the counter value is N, and the wireless communication module outputs PPS1 to trigger the camera module to acquire the second image (i.e., video frame M). The camera module acquires video frame M based on this PPS1.

[0148] In this implementation, the local clock deviations among multiple nodes are small within a preset time interval, resulting in minimal deviations in video frame acquisition time. Therefore, video frames can be acquired based on the local clock within this time interval. The video frame acquisition time is corrected every preset time interval based on the synchronization information of the wireless frames. This eliminates the need for the wireless communication module to frequently output pulse signals to the camera module, reducing the complexity of video frame acquisition while ensuring time synchronization between video frames acquired by multiple nodes.

[0149] 505, the second node sends the second image, and correspondingly, the first node receives the second image.

[0150] For example, the first node can acquire multiple second images, which are respectively captured by multiple camera modules at a second moment based on a second wireless frame. For instance, the multiple cameras are camera modules of multiple second nodes, and the first node receives multiple second images from the multiple second nodes respectively. Alternatively, the multiple cameras are camera modules of the first node and at least one camera module of a second node, and the first node can acquire second images based on its camera modules and receive at least one second image from at least one second node.

[0151] For example, the first image and the second image can be transmitted in the same wireless frame, meaning the second node can send both images simultaneously. After acquiring the first image, the second node saves it. After acquiring the second image, it sends both the first and second images back to the first node.

[0152] For example, a first node can generate a first video based on a first image and a second image obtained by a second node, meaning that each video frame in the first video is obtained by a second node. For instance, for S second nodes, a first node can generate S first videos based on S first images and S second images, and these S first videos correspond one-to-one with the S second nodes.

[0153] For example, the first node can generate a first video based on multiple first images and multiple second images, wherein the multiple first images can be combined to form a video frame of the first video, and the multiple second images can be combined to form another video frame of the first video. This first video can also be referred to as a multi-channel video.

[0154] For example, for S second nodes, a first node can generate K first videos based on S first images and S second images, where K and S are positive integers, and K is less than S. For instance, one of the K first videos can be generated from the first and second images obtained by one or more of the S nodes.

[0155] In this embodiment, multiple nodes can acquire images based on the synchronization information of wireless frames, and there is a synchronization timing relationship between the images acquired by each node and the wireless frames. For example, there are N wireless frames between the first image and the second image acquired by each node.

[0156] In this embodiment of the application, multiple nodes can acquire images (such as the first image and the second image) at the same time based on the same wireless frame, which can improve the synchronization accuracy of image acquisition between multiple nodes to the same level as the frame synchronization of the wireless frame, thereby ensuring the time alignment between multiple first images.

[0157] The following describes the communication device provided in the embodiments of this application.

[0158] This application divides the communication device into functional modules according to the above-described method embodiments. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware or as software functional modules. It should be noted that the module division in this application is illustrative and represents only one logical functional division; other division methods may be used in actual implementation. The following will combine... Figures 8 to 10 The communication device of the embodiments of this application is described in detail.

[0159] Figure 8 This is a schematic diagram of the structure of a communication device provided in an embodiment of this application, such as... Figure 8 As shown, the communication device includes a processing module 801 and a transceiver module 802. The transceiver module 802 can implement corresponding communication functions, and the processing module 801 is used to implement corresponding processing functions. The transceiver module 802 can also be referred to as an interface, communication interface, or communication module, etc.

[0160] In some embodiments of this application, the communication device can be used to perform the actions performed by the first node in the above method embodiments. In this case, the communication device can be the first node itself or a chip or functional module configurable in the first node. The transceiver module 802 is used to perform the transceiver-related operations of the first node in the above method embodiments, and the processing module 801 is used to perform the processing-related operations of the first node in the above method embodiments.

[0161] For example, the transceiver module 802 is used to send synchronization information corresponding to the first wireless frame; the processing module 801 is used to acquire multiple first frames.

[0162] Optionally, the processing module 801 is also used to acquire multiple second images.

[0163] Optionally, the processing module 801 is also used to acquire multiple third images.

[0164] Optionally, the processing module 801 is also used to generate a first video based on multiple first images.

[0165] Optionally, the communication device further includes a camera module 803 and a processing module 801, specifically used to acquire a first image based on the camera module 803 and to receive at least one first image through the transceiver module 802.

[0166] Optionally, the processing module 801 is specifically used to receive multiple first images respectively through the transceiver module 802.

[0167] It is understood that the specific implementation of multiple first images, first wireless frames, synchronization information corresponding to the first wireless frames, multiple second images, multiple third images, etc. can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.

[0168] Reuse Figure 8 In other embodiments of this application, the communication device can be used to perform the actions performed by the second node in the above method embodiments. In this case, the communication device can be the second node itself or a chip or functional module configurable in the second node. The transceiver module 802 is used to perform the transceiver-related operations of the second node in the above method embodiments, and the processing module 801 is used to perform the processing-related operations of the second node in the above method embodiments.

[0169] For example, the transceiver module 802 is used to receive synchronization information corresponding to the first wireless frame; the processing module 801 is used to acquire the first image based on the first moment of the first wireless frame; and the transceiver module 802 is also used to send the first image.

[0170] Optionally, the processing module 801 is further configured to acquire the second image based on the second moment of the second wireless frame; the transceiver module 802 is further configured to transmit the second image.

[0171] Optionally, the processing module 801 is also used to acquire a third image based on a local clock; the transceiver module 802 is also used to send the third image.

[0172] Optionally, the communication device further includes a camera module 803 and a processing module 801, specifically used to acquire a first image through the camera module 803 based on a first moment of the first wireless frame.

[0173] It is understood that the specific implementation of the first image, second image, third image, first wireless frame, second wireless frame, first moment, second moment, etc. can be referred to the relevant description in the above method embodiment, and will not be detailed here.

[0174] For example, transceiver module 802 may include radio frequency module, antenna module, etc. For example, transceiver module 802 may include pin module, etc.

[0175] Optionally, in the above embodiments, the communication device may further include a storage module, which can be used to store instructions and / or data. The processing module 801 can read the instructions and / or data from the storage module to enable the communication device to implement the aforementioned method embodiments. For example, the storage module can store the radio frequency signal transmission strategy, etc., as shown above.

[0176] For details regarding the specific explanations of each term, noun, or step in the above embodiments, please refer to the descriptions in the above method embodiments; they will not be detailed here.

[0177] The specific descriptions of the transceiver module and processing module shown in the above embodiments are merely examples. For the specific functions or execution steps of the transceiver module and processing module, please refer to the above method embodiments, which will not be described in detail here.

[0178] The communication device according to the embodiments of this application has been described above. The following describes the possible product forms of the communication device. Any device possessing the above-described... Figure 8 Any form of the communication device described herein falls within the protection scope of the embodiments of this application. The following description is merely illustrative and does not limit the product form of the communication device in the embodiments of this application to this.

[0179] In one possible implementation, Figure 8 In the communication device shown, the processing module 801 can be one or more processors, and the transceiver module 802 can be a transceiver, or the transceiver module 802 can also be a transmitting module and a receiving module. The transmitting module can be a transmitter, and the receiving module can be a receiver. The transmitting module and the receiving module are integrated into one device, such as a transceiver. In the embodiments of this application, the processor and the transceiver can be coupled, etc., and the connection method between the processor and the transceiver is not limited in the embodiments of this application. In the process of executing the above method, the process of sending information in the above method can be the process of the processor outputting the above information. When outputting the above information, the processor outputs the above information to the transceiver so that the transceiver can transmit it. After the above information is output by the processor, it may need to undergo other processing before reaching the transceiver. Similarly, the process of receiving information in the above method can be the process of the processor receiving the input above information. When the processor receives the input information, the transceiver receives the above information and inputs it into the processor. Furthermore, after the transceiver receives the above information, the above information may need to undergo other processing before being input into the processor.

[0180] like Figure 9 As shown, the communication device 90 includes one or more processors 920 and transceivers 910.

[0181] In some embodiments of this application, the communication device can be used to execute the steps, methods, or functions performed by the first node described above, such as the processor 920 being used to execute... Figure 8 The transceiver 910 can be used to perform the functions or steps implemented by the processing module 801 shown. Figure 8 The functions or steps implemented by the transceiver module 802 shown.

[0182] For example, transceiver 910 is used to send synchronization information corresponding to the first wireless frame; processor 920 is used to acquire multiple first images.

[0183] Optionally, the processor 920 is also used to acquire multiple second images.

[0184] Optionally, the processor 920 is also used to acquire multiple third images.

[0185] Optionally, the processor 920 is also used to generate a first video based on a plurality of first images.

[0186] Optionally, the communication device 90 further includes a camera 930 and a processor 920, specifically used to acquire a first image based on the camera 930 and to receive at least one first image through a transceiver 910.

[0187] Optionally, the processor 920 is specifically configured to receive multiple first images via the transceiver 910.

[0188] It is understood that the specific implementation of multiple first images, first wireless frames, synchronization information corresponding to the first wireless frames, multiple second images, multiple third images, etc. can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.

[0189] In other embodiments of this application, the communication device is used to execute the steps, methods, or functions performed by the second node described above, such as the processor 920 being used to execute... Figure 8 The transceiver 910 can be used to perform the functions or steps implemented by the processing module 801 shown. Figure 8 The functions or steps implemented by the transceiver module 802 shown.

[0190] For example, transceiver 910 is used to receive synchronization information corresponding to the first wireless frame; processor 920 is used to acquire the first image based on the first moment of the first wireless frame; transceiver 910 is also used to transmit the first image.

[0191] Optionally, the processor 920 is also configured to acquire a second image based on a second moment of a second wireless frame; the transceiver 910 is also configured to transmit the second image.

[0192] Optionally, the processor 920 is also used to acquire a third image based on a local clock; the transceiver 910 is also used to transmit the third image.

[0193] Optionally, the communication device also includes a camera 930 and a processor 920, specifically used to acquire a first image through the camera 930 based on a first moment of the first wireless frame.

[0194] It is understood that the specific implementation of the first image, second image, third image, first wireless frame, second wireless frame, first moment, second moment, etc. can be referred to the relevant description in the above method embodiment, and will not be detailed here.

[0195] exist Figure 9 In various implementations of the communication apparatus shown, the transceiver may include a receiver for performing a receiving function (or operation) and a transmitter for performing a transmitting function (or operation). The transceiver is also used to communicate with other devices / appliances via a transmission medium.

[0196] Optionally, the communication device 90 may further include one or more memories 940 for storing program instructions and / or data. The memory 940 is coupled to the processor 920. The coupling in this embodiment is an indirect coupling or communication connection between communication devices, units, or modules, and can be electrical, mechanical, or other forms, used for information exchange between the communication devices, units, or modules. The processor 920 may operate in conjunction with the memory 940. The processor 920 may execute the program instructions stored in the memory 940. Optionally, at least one of the above-mentioned memories may be included in the processor.

[0197] This application embodiment does not limit the specific connection medium between the transceiver 910, processor 920, camera 930, and memory 940. This application embodiment... Figure 9 The memory 940, processor 920, camera 930, and transceiver 910 are connected via a bus 950. Figure 9 The connections between other components are shown in bold and are for illustrative purposes only, not as limiting information. The bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, Figure 9 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0198] In the embodiments of this application, the processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., and can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules within the processor.

[0199] In this application embodiment, the memory may include, but is not limited to, non-volatile memory such as hard disk drive (HDD) or solid-state drive (SSD), random access memory (RAM), erasable programmable read-only memory (EPROM), read-only memory (ROM), or compact disc read-only memory (CD-ROM), etc. Memory is any storage medium capable of carrying or storing program code in the form of instructions or data structures, and capable of being read and / or written by a computer (such as the communication device shown in this application), but is not limited to this. The memory in this application embodiment may also be a circuit or any other device capable of implementing storage functions, used to store program instructions and / or data.

[0200] The processor 920 is primarily used for processing communication protocols and data, controlling the entire communication device, executing software programs, and processing software program data. The memory 940 is primarily used for storing software programs and data. The transceiver 910 may include control circuitry and an antenna. The control circuitry is primarily used for converting baseband signals to radio frequency signals and processing radio frequency signals. The antenna is primarily used for transmitting and receiving radio frequency signals in the form of electromagnetic waves. Input / output devices, such as touchscreens, displays, and keyboards, are primarily used for receiving user input data and outputting data to the user.

[0201] When the communication device is powered on, the processor 920 can read the software program in the memory 940, interpret and execute the instructions of the software program, and process the data of the software program. When data needs to be transmitted wirelessly, the processor 920 performs baseband processing on the data to be transmitted and outputs the baseband signal to the radio frequency (RF) circuit. The RF circuit processes the baseband signal and transmits the RF signal outward in the form of electromagnetic waves through the antenna. When data is sent to the communication device, the RF circuit receives the RF signal through the antenna, converts the RF signal into a baseband signal, and outputs the baseband signal to the processor 920. The processor 920 converts the baseband signal into data and processes the data.

[0202] In another implementation, the radio frequency circuitry and antenna can be set up independently of the processor performing baseband processing. For example, in a distributed scenario, the radio frequency circuitry and antenna can be arranged remotely, independent of the communication device.

[0203] The communication device shown in the embodiments of this application may also have a higher... Figure 9This application does not limit the use of other components or other related elements. The methods performed by the processor and transceiver shown above are merely examples; the specific steps performed by the processor and transceiver can be found in the methods described above.

[0204] In another possible implementation, Figure 8 In the communication device shown, the processing module 801 can be one or more logic circuits, and the transceiver module 802 can be an input / output interface, or a communication interface, or an interface circuit, or an interface, etc. Alternatively, the transceiver module 802 can also be a transmitting module and a receiving module; the transmitting module can be an output interface, and the receiving module can be an input interface, integrated into one module, such as an input / output interface. Figure 10 As shown, Figure 10 The communication device shown includes logic circuit 1001 and interface 1002. That is, the processing module 801 can be implemented using logic circuit 1001, and the transceiver module 802 can be implemented using interface 1002. The logic circuit 1001 can be a chip, processing circuit, integrated circuit, or system-on-chip (SoC) chip, etc., and the interface 1002 can be a communication interface, input / output interface, pins, etc. For example, Figure 10 Taking the aforementioned communication device as an example, the chip includes a logic circuit 1001 and an interface 1002.

[0205] In this embodiment, the logic circuit and the interface can also be coupled to each other. The specific connection method between the logic circuit and the interface is not limited in this embodiment. For example, the logic circuit 1001 can be used to perform... Figure 8 The processing module 801 shown implements the functions or steps, and the interface 1002 can be used to execute such functions or steps. Figure 8 The functions or steps implemented by the transceiver module 802 shown.

[0206] As an example, the communication device is used to perform the steps, methods, or functions executed by the first node described above. Interface 1002 is used to output synchronization information corresponding to the first wireless frame; logic circuit 1001 is used to acquire multiple first images. Optionally, logic circuit 1001 is also used to acquire multiple second images. Optionally, logic circuit 1001 is also used to acquire multiple third images.

[0207] As another example, the communication device is used to perform the steps, methods, or functions performed by the second node described above. Interface 1002 is used to input synchronization information corresponding to the first wireless frame; logic circuit 1001 is used to acquire a first image based on a first moment of the first wireless frame; interface 1002 is also used to output the first image. Optionally, logic circuit 1001 is also used to acquire a second image; interface 1002 is also used to output the second image. Optionally, logic circuit 1001 is also used to acquire a third image; interface 1002 is also used to output the third image.

[0208] It is understood that the specific implementation of the first image, second image, third image, first wireless frame, second wireless frame, first moment, second moment, etc. can be referred to the relevant description in the above method embodiment, and will not be detailed here.

[0209] The communication device shown in the embodiments of this application can implement the method provided in the embodiments of this application in hardware form, or it can implement the method provided in the embodiments of this application in software form, etc., and the embodiments of this application do not limit it in this way.

[0210] Furthermore, embodiments of this application also provide a communication system, which includes a first node and a second node, the first node and the second node being able to perform the methods in any of the foregoing embodiments.

[0211] This application also provides a computer program for implementing the operations and / or processes performed by various communication devices in the methods provided in this application.

[0212] This application also provides a computer-readable storage medium storing computer code that, when executed on a computer, causes the computer to perform the operations and / or processes performed by various communication devices in the methods provided in this application.

[0213] This application also provides a computer program product, which includes computer code or a computer program that, when run on a computer, causes the operations and / or processes performed by various communication devices in the method provided in this application to be executed.

[0214] In the embodiments provided in this application, it should be understood that the disclosed systems, communication devices, and methods can be implemented in other ways. For example, the communication device embodiments described above are merely illustrative. For instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, communication devices, or modules, or it may be an electrical, mechanical, or other form of connection.

[0215] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the technical effects of the solutions provided in the embodiments of this application.

[0216] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0217] If the integrated module is implemented as a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned readable storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0218] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An image acquisition method, characterized in that, The method applied to a first node comprises: sending synchronization information corresponding to a first radio frame; acquiring a plurality of first images, which are respectively captured by a plurality of camera modules based on a first time point of the first radio frame, the first time point being determined by the synchronization information.

2. The method of claim 1, wherein, The method further comprises: acquiring a plurality of second images, which are respectively captured by the plurality of camera modules based on a second time point of a second radio frame; wherein the plurality of first images and the plurality of second images are used to generate a first video, the first radio frame and the second radio frame are separated by N radio frames, the N being determined by a frame rate of the first video, the N being a positive integer.

3. The method of claim 1, wherein, The method further comprises: acquiring a plurality of second images, which are respectively captured by the plurality of camera modules based on a second time point of a second radio frame; wherein the first radio frame and the second radio frame are separated by N radio frames, the N being determined by a preset time length, the N being a positive integer.

4. The method of claim 3, wherein, The method further comprises: acquiring a plurality of third images, which are respectively captured by the plurality of camera modules based on a local clock; the plurality of first images, the plurality of second images and the plurality of third images are used to generate a first video, a time interval between an acquisition time of the plurality of third images and the first time point of the first radio frame being determined by the frame rate of the first video.

5. The method of claim 4, wherein, The preset time length is greater than a video frame interval corresponding to the first video, the video frame interval being determined by the frame rate of the first video.

6. The method according to any one of claims 1 to 5, characterized in that, The first time point is an ending time point or a starting time point of the first radio frame.

7. The method according to any one of claims 1 to 6, characterized in that, The plurality of camera modules are respectively included in a plurality of second nodes, and the acquiring of the plurality of first images comprises: receiving the plurality of first images from the plurality of second nodes respectively.

8. The method according to any one of claims 1 to 6, characterized in that, The plurality of camera modules comprise a camera module corresponding to the first node and camera modules respectively corresponding to at least one second node; The acquiring of the plurality of first images comprises: acquiring one first image based on the camera module corresponding to the first node; receiving at least one first image from the at least one second node respectively; the plurality of images comprise the one first image and the at least one first image.

9. The method according to any one of claims 1 to 8, characterized in that, The method further comprises: generating a first video based on the plurality of first images.

10. An image acquisition method characterized in that, The method applied to a second node comprises: receiving synchronization information corresponding to a first radio frame; acquiring a first image based on a first time point of the first radio frame, the first time point being determined by the synchronization information; sending the first image to a first node.

11. The method of claim 10, wherein, The method further comprises: acquiring a second image according to a second time point of a second radio frame; the first image and the second image are used to synthesize a first video, the first radio frame and the second radio frame are separated by N radio frames, the N being determined by a frame rate of the first video, the N being a positive integer; sending the second image to the first node.

12. The method of claim 10, wherein, The method further comprises: acquire a second image based on a second time of a second radio frame; the first radio frame and the second radio frame are separated by N radio frames, the N is determined by a preset time length, and the N is a positive integer; send the second image to the first node.

13. The method of claim 12, wherein, Before the second image is acquired based on the second position of the second radio frame, the method further comprises: acquire a third image based on a local clock, the first image, the second image, and the third image are used to generate a first video, and a time interval between an acquisition time of the third image and the first time of the first radio frame is determined by a frame rate of the first video; send the third image to the first node.

14. The method of claim 13, wherein, The preset time length is greater than a video frame interval corresponding to the first video, and the video frame interval is determined by the frame rate of the first video.

15. The method according to any one of claims 10 to 14, characterized in that, The first time is an ending time or a starting time of the first radio frame.

16. A communications device, characterized by A module for executing the method of any one of claims 1-15.

17. A communications device, characterized by A processor for executing the method of any one of claims 1-15.

18. A communications device, characterized by A logic circuit and an interface are coupled; The interface is used to input and / or output information, and the logic circuit is used to execute the method of any one of claims 1-15.

19. A computer-readable storage medium, characterized in that, A computer readable storage medium is used to store a computer program, and the computer program is executed to execute the method of any one of claims 1-15.

20. A computer program product, characterised in that, The computer program product is executed to execute the method of any one of claims 1-15.