A processing method and collection device
By simultaneously acquiring and receiving different types of media data through the first acquisition device and performing data fusion processing, the problem that a single acquisition device cannot adapt to multiple scenarios in the existing technology is solved, and high-quality media data processing in multiple scenarios is realized.
Patent Information
- Application Number
- CN202211354427.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-01
- Publication Date
- 2025-10-28
- Estimated Expiration
- 2042-11-01
AI Technical Summary
Existing processing equipment typically only has one acquisition device of the same type, which makes it impossible to acquire high-quality media data in different scenarios and limits its applicable scenarios.
The first acquisition device simultaneously collects and receives different types of media data, and the data is fused and processed by the processing device to generate third media data to meet the needs of multiple scenarios.
It enables the acquisition and processing of high-quality media data in different scenarios, expands the applicable scenarios of the processing equipment, and meets the output needs of multiple scenarios.
Smart Images

Figure CN115695711B_ABST
Abstract
Description
Technical Field
[0001] This application relates primarily to the field of electronic technology, and more specifically to a processing method and acquisition device. Background Art
[0002] Currently, processing devices on the market, such as mobile phones and laptops, can typically be configured with different types of acquisition devices to collect corresponding types of media data, in order to meet users' needs for processing devices.
[0003] In practical applications, processing devices typically only have one acquisition device of the same type, and this acquisition device is usually configured with appropriate performance parameters for a specific scenario (such as a close-range scenario or a long-range scenario) to meet the media data acquisition requirements of that scenario. This results in the inability to acquire high-quality media data in other types of scenarios, reducing the applicable scenarios of the processing device. Summary of the Invention
[0004] To address the aforementioned technical problems, this application provides the following technical solutions:
[0005] On the one hand, this application proposes a processing method, including:
[0006] The first acquisition device acquires the first media data;
[0007] The first acquisition device receives the second media data;
[0008] The first acquisition device processes the first media data and the second media data to obtain the third media data;
[0009] The first acquisition device transmits the third media data to the processing device.
[0010] Optionally, the first acquisition device acquires first media data, and the first acquisition device receives second media data, including:
[0011] The first acquisition device continuously acquires data from the first media.
[0012] The first acquisition device is connected to the second acquisition device and continuously receives the second media data continuously acquired by the second acquisition device.
[0013] Optionally, the first acquisition device acquires first media data, and the first acquisition device receives second media data, including:
[0014] The first acquisition device continuously acquires data from the first media.
[0015] When the second acquisition device is connected to the processing device, the first acquisition device continuously receives the second media data continuously acquired by the second acquisition device through the processing device.
[0016] Optionally, the first acquisition device processes the first media data and the second media data, including:
[0017] The first acquisition device processes the first media data and the second media data according to the output mode; wherein, the output mode can characterize the output relationship between the first media data and the second media data.
[0018] Optionally, the first acquisition device, in processing the first media data and the second media data, further includes:
[0019] When the first acquisition device is connected to the second acquisition device, a first state of the mode switching component of the first acquisition device is obtained; wherein, the mode switching component can be switched to different states, and the different states correspond to different output modes for the media data acquired by the first acquisition device and the second acquisition device respectively.
[0020] Determine the output mode corresponding to the first state.
[0021] Optionally, the first acquisition device, in processing the first media data and the second media data, further includes:
[0022] When the second acquisition device is connected to the processing device, the first acquisition device receives an acquisition device selection instruction; wherein, the acquisition device selection instruction is generated by the processor of the processing device based on the selection and use operation of the virtual acquisition device; the virtual acquisition device is obtained by the processor executing a virtual driver to virtualize the first acquisition device and the second acquisition device;
[0023] Determine the output mode corresponding to the acquisition device selection command.
[0024] Optionally, the first acquisition device transmits the third media data to the processing device, including:
[0025] When the second acquisition device is connected to a processing device that integrates the first acquisition device, the first acquisition device transmits the third media data to the processor of the processing device, and the processor executes a virtual drive to send the third media data to at least one output component of the processing device; the output component is determined based on the respective data types of the first media data and the second media data.
[0026] Furthermore, this application also proposes a data acquisition device, comprising:
[0027] The data acquisition device is used to acquire data from the first media.
[0028] The first interface is used to receive the second media data;
[0029] A processing device is used to connect the acquisition device and the first interface, process the first media data and the second media data, obtain the third media data, and transmit the third media data to the processing device.
[0030] Optionally, the first interface is connected to a second data acquisition device; the data acquisition device further includes:
[0031] The second interface is used to connect the processing device and the processing equipment, receive the third media data transmitted by the processing device, and transmit the third media data to the processor of the processing equipment.
[0032] Optionally, the acquisition device is integrated into the processing device, and the processing device is connected to the second acquisition device, wherein the first interface is a bidirectional communication interface that supports bidirectional data transmission;
[0033] The first interface is also used to receive the third media data transmitted by the processing device and to transmit the third media data to the processor of the processing device.
[0034] Therefore, this application provides a processing method and a data acquisition device. The first data acquisition device can acquire first media data and can also receive second media data. After processing the first media data and the second media data to obtain third media data, the first data acquisition device can transmit the third media data to the processing device. Attached Figure Description
[0035] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.
[0036] Figure 1 A schematic diagram of an optional example of a data acquisition device applicable to the processing method proposed in this application;
[0037] Figure 2 A schematic diagram of another optional example of a data acquisition device suitable for the processing method proposed in this application;
[0038] Figure 3A schematic diagram of the system structure of an optional application environment for the data acquisition device of the processing method proposed in this application;
[0039] Figure 4 A schematic diagram of another optional example of a data acquisition device suitable for the processing method proposed in this application;
[0040] Figure 5 A schematic diagram of another optional example of a data acquisition device suitable for the processing method proposed in this application;
[0041] Figure 6 A schematic diagram of the system structure of another optional application environment for the data acquisition device of the processing method proposed in this application;
[0042] Figure 7 A schematic diagram of another optional example of a data acquisition device suitable for the processing method proposed in this application;
[0043] Figure 8 A schematic diagram of the system structure of another optional application environment for the data acquisition device of the processing method proposed in this application;
[0044] Figure 9 A schematic diagram of the system structure of another optional application environment for the data acquisition device of the processing method proposed in this application;
[0045] Figure 10 A flowchart illustrating an optional example of the processing method proposed in this application;
[0046] Figure 11 A flowchart illustrating yet another optional example of the processing method proposed in this application;
[0047] Figure 12 This is a flowchart illustrating another optional example of the processing method proposed in this application. Detailed Implementation
[0048] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0049] Reference Figure 1This is a schematic diagram of an optional example of a data acquisition device applicable to the processing method proposed in this application. This data acquisition device can be referred to as the first data acquisition device 100. In this embodiment, the first data acquisition device 100 can be a different type of peripheral device without an operating system, such as a data acquisition device independent of the processing device or a data acquisition device integrated into the processing device, etc., which can be determined according to the actual scenario requirements. Based on this, as... Figure 1 As shown, the first acquisition device 100 may include: an acquisition unit 110, a first interface 120, and a processing unit 130, wherein:
[0050] The acquisition device 110 can be used to acquire first media data, which may include at least one type of optical data (such as image data) and / or audio data. For different types of first media data, the acquisition device 110 of the corresponding type (i.e., having the corresponding type of media data acquisition function) can be used to acquire the data. Therefore, the first acquisition device may include at least one acquisition device 110, such as an image acquisition device such as a camera or image scanner for acquiring image data, and / or an audio acquisition device such as a microphone for acquiring audio data. The type and number of acquisition devices 110 can be determined according to the needs of the scenario.
[0051] The first interface 120 can be used to receive second media data, which can be media data of the same type or different type as the first media data. The data type of the media data can be determined according to the needs of the scenario. This application does not limit the data type of the two media data.
[0052] In addition, if Figure 2 As shown, the aforementioned second media data can originate from the second acquisition device 200, meaning the second acquisition device 200 sends the acquired second media data to the first acquisition device 100. Alternatively, the second media data can also originate from a network device, such as a data source server or a communication server used to forward media data sent by the data source device. In this case, the first interface 120 has network communication capabilities, receiving the second media data sent by the network device. Therefore, in different scenarios, the second media data can originate from different types of devices. To receive the second media data sent by the device, the first acquisition device 100 can be configured with a corresponding type of first interface 120. This application does not limit the interface type of the first interface 120 or the communication methods it supports.
[0053] The processing device 130 can be used to connect the acquisition device 110 and the first interface 120. After receiving the corresponding first media data and second media data, it can process the first media data and second media data to obtain third media data, and then transmit the third media data to the processing device 300. The data type of the third media data can be determined based on the data types of the first media data and second media data. In conjunction with the description of the corresponding part above, the third media data may include optical data such as image data and / or audio data.
[0054] In this application embodiment, the processing device 130 may include a processor, application-specific integrated circuit (ASIC), digital signal processor (DSP), application-specific integrated circuit (ASIC), off-the-shelf programmable gate array (FPGA), or other programmable logic device control chip in a camera or microphone, etc., to realize the processing function of multi-channel media data. This application does not limit the composition structure and chip type of the processing device 130, and can determine it according to the actual control requirements.
[0055] Optionally, in order to implement the processing method steps on the processing device 130 side, the processing device 130 may further include a memory for storing a program that implements the processing method proposed in this application. In this way, the processor described above can load and execute the program to implement the processing method proposed in this application.
[0056] In summary, the first acquisition device 100 not only has media data acquisition capabilities, but also, to meet the needs of multi-scenario output, can simultaneously acquire first media data in one scenario and second media data in another scenario. This allows the first acquisition device 100 to obtain media data from different scenarios simultaneously. In this way, the processing device 130 can process the media data from different scenarios to obtain third media data representing multiple scenarios, reducing the data processing capability requirements of the processing device and enabling it to connect to more types of processing devices to meet their data processing needs.
[0057] For example, in order to meet the output requirements of multiple screens and multiple scenes, the first media data and the second media data obtained by the first acquisition device 100 can be image data from different perspectives, such as one channel being image data from a close-up perspective and the other channel being image data from a long-distance perspective. These two channels of image data are sent to the processing device 130, which can perform fusion processing on the two channels of image data to obtain one channel of image data with a preset output mode (such as picture-in-picture mode), and then send it to the processing device 300, which outputs the three media data, or sends it to other devices to output the third media data, etc.
[0058] It should be noted that in application scenarios such as video conferencing, the aforementioned media data may also include audio data. The processing device 130 can process image data and audio data of the same type from different perspectives to obtain video data from multiple scenes. The processing implementation process of multi-channel media data is not described in detail in this application. The audio data constituting the video data may come from the first media data and / or the second media data, depending on the situation.
[0059] Based on the above description of the composition structure and application scenarios of the acquisition device, in some embodiments, if the first acquisition device 100 is an independent device and the second media data comes from the second acquisition device 200, the first interface 120 of the first acquisition device 100 can be directly connected to the second acquisition device 200. Therefore, the first interface 120 may include a wired interface (such as a USB interface) that supports wired communication connection and / or a wireless interface (such as a wireless radio frequency interface, a WIFI communication interface, etc.) that supports wireless communication connection. For different communication connection methods, the first acquisition device 100 can be configured with different types of first interfaces 120. This application does not limit the interface type and number of the first interface 120, and can determine them according to the scenario requirements.
[0060] Based on this, in a scenario where the first acquisition device 100 and the second acquisition device 200 are connected by wired communication, such as Figure 3 As shown, the first interface 120 can be a Type-C interface. A user can connect a second acquisition device 200 with a Type-C plug to this Type-C interface, forming a communication channel between the first acquisition device 100 and the second acquisition device 200. This allows the second acquisition device 200 to transmit the acquired second media data to the first interface 120 through this communication channel. It should be noted that, in cases such as... Figure 3 In the scenario shown, the first interface 120 may also include other types of USB interfaces or other types of wired interfaces, so that the first acquisition device 100 can support multiple types of expansion interfaces and connect to the second acquisition device 200 with the corresponding interface type. This application will not provide detailed examples of each type.
[0061] Optionally, in the scenario where the first acquisition device 100 and the second acquisition device 200 are connected wirelessly, as analyzed above, at least one first interface 120 has a corresponding type of wireless communication capability, and the second acquisition device 200 is configured with a corresponding type of wireless communication interface to realize a wireless communication connection with the corresponding type of wireless interface (i.e., the first interface 120), thereby forming a communication channel between the first acquisition device 100 and the second acquisition device 200, so that the second acquisition device 200 can transmit the acquired second media data to the first interface 120 through the communication channel.
[0062] Based on the structure and application scenario of the first acquisition device 100 described above, and assuming that the first interface 120 is a unidirectional communication interface (i.e., an interface that supports unidirectional data transmission), such as Figure 4 As shown, the first acquisition device 100 may further include: a second interface 140 for connecting the processing device 130 and the processing device 300, receiving third media data transmitted by the processing device 130, and transmitting the third media data to the processor of the processing device 300.
[0063] Optionally, the second interface 140 may be similar in type to the first interface 120 described above, and may also include an interface that supports wired communication connection and / or an interface that supports wireless communication connection. This application does not limit the interface type (including the communication methods it supports) and number of the second interface 140 configured in the first acquisition device 100.
[0064] Specifically, both the first interface 120 and the second interface 140, which support wireless or wired communication connections, can be unidirectional communication interfaces. This ensures that the communication channel formed between the second acquisition device 200, the first acquisition device 100, and the processing device 300 connected through the first interface 120 and the second interface 140 supports a unidirectional communication mode. That is, the second acquisition device 200 can transmit the acquired second media data to the first acquisition device 100 through the first interface 120, but the first media data acquired by the first acquisition device 100 cannot be transmitted to the second acquisition device 200 through the first interface 120. Similarly, the first media data acquired by the first acquisition device 100 (in the scenario where no other device is connected to the first interface 120) or the processed third media data can be transmitted to the processing device through the second interface 140; the processing device cannot transmit data to the first acquisition device 100 through the second interface 140.
[0065] For example, taking the second interface 140 as a contact-type interface as an example, as follows: Figure 3 As shown, the second interface 140 can be a magnetically attached pin connector, such as an 11pogo pin. In this way, when it is necessary to acquire and output media data for multiple scenarios, the first acquisition device 100 can be magnetically attached to the first housing of the processing device 300 (such as the A-side housing of a laptop, which can be determined according to the product type of the processing device 300), and the second acquisition device 200 can be connected to the first interface 120. This allows the first acquisition device 100 and the second acquisition device 200 to acquire media data in different scenarios. At the same time, the second acquisition device 200 will synchronously send the acquired second media data to the first acquisition device 100 for processing. The processing process can be referred to the description of the corresponding part of the above embodiment.
[0066] It should be noted that the implementation process of other communication connection methods between the first acquisition device 100 and the processing device 300, namely other types of second interfaces 140, is similar in the application of outputting multi-scene media data, and will not be described in detail here.
[0067] In some other embodiments proposed in this application, reference is made to Figure 5 The diagram shown illustrates another optional application environment for the first acquisition device proposed in this application. The first acquisition device 100 and the second acquisition device 200 can be connected to the processing device 300, as shown below. Figure 6 As shown, the second media data collected by the second acquisition device 200 can be sent to the processing device 300, which then sends the second media data to the first interface 120. In this case, as... Figure 5 As shown, the first interface 120 can connect to the processing device 300 (which can be referenced but is not limited to). Figure 3 (The connection method between the second interface 140 and the processing device 300 shown) receives the second media data forwarded by the processing device 300 from the second acquisition device 200.
[0068] In conjunction with the above description of the interface types and application scenarios of the first and second interfaces, the first interface 120 may include at least one wired interface and / or at least one wireless interface, so that the first acquisition device 100 can support communication connections with various types of processing devices 300. Regarding the communication connection methods between the first acquisition device 100, the second acquisition device 200, and the processing device 300, these include, but are not limited to, […]. Figure 6 The communication method shown can also be used to establish a communication connection between the second acquisition device 200 and the processing device 300 via wireless communication; however, this application will not provide detailed examples. Optionally, in... Figure 5 In the illustrated embodiment, the first interface 120 can be a bidirectional communication interface that supports bidirectional data transmission. In this way, the processing device 130 of the first acquisition device 100 can send the obtained third media data to the first interface 120, and the first interface 120 can transmit the third media data to the processor of the connected processing device 300. That is, the processor of the processing device 300 can transmit the second media data to the first acquisition device 100 through the first interface 120, and the first acquisition device 100 can also transmit the third media data to the processor of the processing device 300 through the first interface 120, so as to meet the multi-scene media data output requirements of the processing device 300. Regarding the acquisition process of the third media data, please refer to the description of the corresponding part of the above embodiment.
[0069] Optional, in Figure 5In the illustrated embodiment, if the first interface 120 is a unidirectional communication interface that supports one-way data transmission, such as HDMI (High Definition Multimedia Interface) for one-way transmission of image data, the processor of the processing device 300 can transmit image data acquired by the second acquisition device 200 via HDMI, but cannot transmit image data to the second acquisition device 200 via HDMI. Therefore, in this embodiment, the first interface 120 can only be used to receive second media data forwarded by the processing device 300 from the second acquisition device 200, and cannot transmit media data in the reverse direction. To meet the needs of multi-scenario media data processing, the first acquisition device 100 can also be configured with a third interface (such as any type of unidirectional communication interface) that supports one-way data transmission, for connecting to the processing device 300, receiving third media data output by the processing device 130, and transmitting the third media data to the processor of the connected processing device 300.
[0070] In practical applications, the aforementioned third interface can be a unidirectional communication interface supporting wireless and / or wired communication connections. As analyzed above, through the first and third interfaces, the communication channels formed between the first acquisition device 100, the second acquisition device 200, and the processing device 300 operate in a unidirectional communication mode, achieving unidirectional transmission of the corresponding media data. This application does not limit the construction process of each communication channel or the method for ensuring unidirectional transmission of media data. For example, the operating mode of the corresponding communication channel can be determined by configuring the first and second interfaces, or even the data transmission protocols followed by each interface traversed by the communication channel.
[0071] Therefore, when the first acquisition device 100 is an independent acquisition device, it can acquire corresponding types of first media data, such as image data and / or audio data, through at least one acquisition device 110. At the same time, it can also receive second media data from the second acquisition device 200 through the first interface 120, so that the first acquisition device 100 can simultaneously obtain multiple media data in different scenarios. Then, the processing device 130 processes these multiple media data to obtain one media data that can represent the media data in multiple scenarios, and sends this media data to the processing device 300 for output, thereby meeting the output requirements of multi-scenario media data.
[0072] In some other embodiments proposed in this application, reference is made to Figure 7The diagram shown illustrates a system structure suitable for another optional application environment of the first acquisition device proposed in this application. The first acquisition device 100 can also be integrated into the processing device 300. In order to meet the output requirements of media data in multiple scenarios, the processing device 300 can be connected to the second acquisition device 200. The first interface 120 of the first acquisition device 100 can be a bidirectional communication interface that supports bidirectional data transmission. In this case, in conjunction with the description of the corresponding part of the above embodiment, the first interface 120 can not only receive the second media data collected by the second acquisition device 200 forwarded by the processing device 300, but also, after the processing device 130 processes the two media data, obtains a third media data, which can be sent to the first interface 120. After receiving the third media data transmitted by the processing device 130, the first interface 120 can transmit a third media data to the processor of the processing device 300.
[0073] Regarding the communication method between the second acquisition device 200 and the processing device 300, as well as the interface type and number of the first interface 120, please refer to the description of the corresponding part of the above embodiments, such as the interface corresponding to at least one wireless or wired communication method. For application scenarios of different communication methods and their combinations, the implementation process of the first acquisition device 100 obtaining two media data in different scenarios, processing the two media data, and outputting the obtained third media data can be referred to the description of the corresponding part of the context embodiments, and will not be described in detail here.
[0074] For example, the following description uses a second acquisition device 200 (which may include, but is not limited to, a standalone camera or a mobile phone with media data acquisition capabilities as shown in the figures) connected wirelessly to a processing device 300 (which may include, but is not limited to, a laptop, monitor, or video conferencing device as shown in the figures). Figure 8 As shown, the first acquisition device can be the built-in camera of the processing device 300. Since the built-in camera usually includes a camera module, it can acquire image data from a certain perspective at the same time. If it is necessary to acquire image data from different perspectives at the same time, the processing device 300 can connect to the second acquisition device 200 through wired or wireless communication, use the image acquisition function of the second acquisition device 200 to simultaneously acquire image data from another perspective, and then send it to the first interface 120 of the first acquisition device 100 through the processing device 300.
[0075] As can be seen, the second acquisition device 200 is essentially an extension of the first acquisition device 100, expanding the image acquisition function. In scenarios such as video conferencing, online teaching, or multi-view product introductions, the processing device 300 needs to simultaneously output images from different perspectives. In this way, the first acquisition device 100 and the second acquisition device 200 can be controlled to acquire media data from one perspective respectively. Then, the first acquisition device 100, according to the processing method described in the context, obtains a third media data containing multi-view media data, which is equivalent to directly acquiring multi-view media data and meeting the output requirements of multiple screens and multiple scenarios.
[0076] It should be noted that in embodiments where the first acquisition device 100 is integrated into the processing device 300, the integration and installation position of the first acquisition device 100 within the processing device 300 can be determined based on factors such as the product type and body structure of the processing device 300, including but not limited to... Figure 8 The installation location is shown.
[0077] Regarding the composition structure of the first acquisition device 100 described in the above optional embodiments, and its connection relationship with the second acquisition device 200 and the processing device 300 in different scenarios, when the second media data comes from the second acquisition device 200, the second media data can be media data such as image data and / or audio data acquired by the second acquisition device 200; in some other embodiments, the second media data can also be the media data stored by the second acquisition device 200 this time, which can come from other local devices or be downloaded from the network side. Then, according to the methods described in the above embodiments, it is directly or indirectly sent to the first interface 120 to meet the output requirements of media data in multiple scenarios. The implementation process is not described in detail in this application.
[0078] In some other embodiments proposed in this application, the aforementioned second media data may also be obtained by the first acquisition device 100 from the network side via a wireless or wired communication network, see reference. Figure 9 The system structure diagram shown is applicable to another optional application environment of the first acquisition device proposed in this application. In conjunction with the description of the corresponding part of the above embodiment, the second media data can be sent from the data source server on the network side to the first interface 120 of the first acquisition device 100, or the communication server can receive the second media data sent by the communication device (equivalent to the second acquisition device 200) that is connected to the processing device 300 and send the second media data to the first acquisition device 100. Regarding the functional implementation process of each component in the first acquisition device 100 during this process, please refer to the description of the corresponding part in the context. The embodiments of this application will not be described in detail here.
[0079] Optionally, the aforementioned second media data can also be obtained by the processing device 300 from the network side and forwarded to the first interface 120 of the first acquisition device 100. The process by which the processing device 300 obtains the second media data from the network side can be referred to the description in the corresponding section of the above embodiments. Furthermore, in this case, the implementation process of how the first acquisition device 100 sends the obtained third media data to the processor of the processing device 300 can be referred to the description in the context embodiments; this application embodiment will not elaborate on it here.
[0080] In cases where the processing device 300 has image display and / or audio playback functions, i.e., the processing device 300 itself outputs third media data, after the processor of the processing device 300 receives the third media data sent by the first interface 120, the second interface 140, or the third interface, it can execute the corresponding driver (i.e., the driver program) to send the third media data to the display and / or speaker and other output components of the processing device 300, and output media data of the corresponding type. The implementation process is not described in detail in this application.
[0081] Of course, if the third media data is output by other output devices connected to the processing device 300, then, as described above, after the processor of the processing device 300 receives the third media data, it can transmit the third media data to the corresponding output device through the communication path formed between the processing device 300 and the corresponding output device, and the output device can output the third media data, etc. This application does not limit the output method of the third media data, and it can be determined according to the needs of the scenario.
[0082] For the first acquisition device 100 and its system structure in the application environment described in the above embodiments, after the processing device 130 obtains two media data, it can process the two media data according to the output mode that can characterize the output relationship between the two media data (such as the picture-in-picture mode, the side-by-side output mode of the screen above or below or side to side, etc. described in the above embodiments) to obtain the third media data with the output relationship.
[0083] Optionally, to enable switching control between different output modes of multi-channel media data, a mode switching component 150 can be configured in the first acquisition device 100, such as... Figure 3 The mode toggle switch shown is not limited to this type of mode switching component 150; it can also be a touch-sensitive structure or a voice-controlled structure, etc., depending on the product type of the first acquisition device 100 and the supported communication control methods. This application only uses this type of toggle switch as an example. Figure 3 The example shown is a mode toggle switch. The control process of other mode switching components 150 is similar in the processing method proposed in this application, and will not be described in detail here.
[0084] Reference Figure 3 The first acquisition device 100 shown can be controlled by the user to switch the mode switching component 150 to different states, such as switching the mode toggle switch to the off state, the on state, or the disabled state (corresponding to...). Figure 3 In the middle, the toggle component in the middle of the mode switch (such as...) Figure 3 (The middle circle) can be toggled to the right, left, or middle state, etc. Since different states of the mode switching component 150 correspond to different output modes of multiple media data, such as the output modes between the media data collected or generated by the first acquisition device 100 and the second acquisition device 200 or network-side devices (such as the aforementioned data source server or communication devices connected to the communication server), the mode switching component 150 can be controlled to switch to the first state according to the actual output requirements. Thus, according to the correspondence between different states and different output modes, the output mode corresponding to the first state can be determined, so that the processing device 130 can process the continuously received first media data and second media data according to the output mode to obtain third media data with corresponding output relationships.
[0085] It should be understood that, depending on the output mode determined by the method described above, the processing device 130 processes the first media data and the second media data with the same content differently. For example, the two image data are integrated and processed according to the corresponding output relationship. The processing implementation process will not be described in detail in this application.
[0086] Optionally, when the mode switching component 150 is disabled, it cannot be used to adjust the output relationship of the multi-channel media data. In this case, the multi-channel media data can be processed according to the default output mode. Therefore, after the processing device 130 obtains the multi-channel media data, it can directly process it according to the default output mode. If the user needs to adjust the output mode, the mode switching component 150 can be adjusted to the corresponding state according to the above method.
[0087] In some other embodiments proposed in this application, when the second acquisition device 200 or the aforementioned network-side device is connected to the processing device 300, the user can perform an output mode selection operation on the processing device 300 and send the resulting acquisition device selection instruction to the first acquisition device, so that the first acquisition device can determine the corresponding output mode according to the content of the acquisition device selection instruction, so as to realize the processing of multiple media data.
[0088] Optionally, when the first acquisition device 100 is integrated into the processing device 300 and the second acquisition device 200 is connected to the processing device 300, the processor of the processing device 300 can execute a virtual driver (i.e., a virtual driver program) to virtualize the first acquisition device 100 and the second acquisition device 200, thereby obtaining a virtual acquisition device (such as a virtual camera). This virtual acquisition device then has the ability to acquire media data from different scenes, such as simultaneously acquiring image data from different perspectives. In this way, when the processing device 300 needs to acquire media data while running an application, it can output selection prompts for the first acquisition device, the second acquisition device, or the virtual acquisition device, such as an acquisition device selection interface, so that the user can select the enabled acquisition device according to actual needs, i.e., select the output mode for the acquired media data.
[0089] For example, when the processing device 300 is connected to the second acquisition device 200 in the manner described above, if the processing device 300 needs to output the second media data acquired by the connected second acquisition device 200, it can directly select the second acquisition device 200 according to the selection prompt information and perform the corresponding acquisition device selection and use operation. The processor of the processing device 300 can receive the second media data acquired by the second acquisition device 200, execute the corresponding driver (such as Inbox driver, etc., to realize the connection between the underlying hardware and the upper layer application; the working principle of the driver is not described in detail in this application), and send the second media data to the corresponding type of output component, such as pushing the received video stream to the upper layer application (such as video software or conferencing software running on the processing device 300), and sending it as application content to the display.
[0090] In some embodiments, if the processing device 300 needs to output the first media data collected by the built-in first acquisition device 100, it does not need to connect the second acquisition device 200. According to the acquisition device selection operation method described above, the first acquisition device 100 is selected to collect media data. The first acquisition device 100 directly sends the collected first media data to the processor, and the processor executes the corresponding driver (such as Inbox driver) to send the first media data to the corresponding type of output component. The implementation process is not described in detail. In some other embodiments, to meet the needs of multi-scenario media data output, according to the selection prompt information described above, the user can choose to use a virtual acquisition device. The processing device 300 responds to the selection operation of the virtual acquisition device and sends the generated acquisition device selection instruction to the first acquisition device 100, so that the first acquisition device 100 can determine the output mode corresponding to the acquisition device selection instruction. Accordingly, it processes the multi-channel media data (i.e., the media data acquired by the first acquisition device 100 and the second acquisition device 200 respectively) acquired by the virtual acquisition device, and sends the obtained third media data to the processor of the processing device 300. Then, the processor executes the corresponding virtual driver and sends the received third media data to at least one output component of the processing device 300 (such as a display and / or speaker determined according to the respective data types of the first media data and the second media data), and the output component outputs the third media data of the corresponding type.
[0091] Optionally, when the first acquisition device 100 is integrated into the processing device 300 and the second acquisition device 200 is connected to the processing device 300, a correspondence between different applications and different output modes can be pre-built. In this way, after the processing device 300 detects a trigger event that starts the acquisition device (such as when a user starts a video call application using the processing device 300), it can detect the application type of the running application, determine the output mode corresponding to the running application according to the correspondence, and send the mode indication information for the output mode to the first acquisition device 100. This allows the processing device 130 of the first acquisition device 100 to directly process the acquired media data according to the output mode. The implementation process is not described in detail in this application.
[0092] It should be noted that the output mode used by the processing device 130 of the first acquisition device 100 to process the acquired multi-channel media data can be the default output mode, or it can be determined according to, but not limited to, the method described above. This application does not limit the method for obtaining the output mode. Furthermore, in the application scenario described above, if the user chooses to use the second acquisition device 200 connected to the processing device 300 to acquire media data, without starting the first acquisition device 100, the processing device 300 can continuously receive the second media data continuously acquired by the second acquisition device 200 and output the second media data through the corresponding type of output component.
[0093] Optionally, when the processing device 300 is connected to the first acquisition device 100 and the second acquisition device 200, the first acquisition device 100 and the second acquisition device 200 can also directly send the media data they have acquired to the processing device 300, and the processor of the processing device 300 processes the two media data and outputs the obtained third media data. The implementation process is not described in detail in this application.
[0094] Regarding the composition of the first acquisition device 100 described above, the second acquisition device 200 and the processing device 300 connected to it are both terminals with operating systems. Taking a laptop computer as an example, the mode switching component 150 of the first acquisition device 100 can also be used as a priority switch for the media data output priority between the first interface 120 connected to the second acquisition device 200 and the second interface 140 connected to the processing device 300. By adjusting its state, the first interface or the second interface can be controlled as the first priority output interface, so that the device connected to the first priority output interface can be used as the master device for outputting third media data.
[0095] Optionally, when the priority toggle switch is in the open state, the output priority of the second interface can be set as the first priority; when the priority toggle switch is in the closed state, the connection time of the first interface 120 and the second interface 140 of the first acquisition device 100 to the respective connected devices can be detected, and the interface with the later connection time can be set as the first priority output interface, but it is not limited to this configuration implementation method.
[0096] In this scenario, when the second interface (e.g., Pogo Pin) is designated as the first priority output interface, the first acquisition device can detect whether the second interface is connected to the processing device 300. If not connected, the first media data acquired by the first acquisition device 100 can be directly sent to the first interface (e.g., Type-C interface) 120, which then transmits the first media data to the connected laptop. In this case, the first acquisition device 100 can be used as an extension device for the laptop. If the processing device 300 is connected, regardless of whether the first interface 120 is connected to a laptop, the first acquisition device 100 will send the acquired or processed media data to the second interface 140, which then transmits the media data to the processing device 300.
[0097] It should be noted that the structure of the data acquisition device shown in the above figures does not constitute a limitation on the first data acquisition device in the embodiments of this application. In practical applications, the first data acquisition device may include more or fewer components than those shown in the figures, or a combination of certain components, which will not be listed here. In addition, the system structure of the application environment of the first data acquisition device may include more or fewer devices than those shown in the figures, which will not be described in detail here either.
[0098] Based on the composition and structure of the first acquisition device 100 described in the above embodiments, as well as the system architecture and working process of the first acquisition device 100 in different application environments, the processing method proposed in this application will be described below from the perspective of the first acquisition device 100, but it is not limited to the embodiments of the processing methods described below.
[0099] Reference Figure 10 The above is a flowchart illustrating an optional example of the processing method proposed in this application. This method can be executed by a first acquisition device, which can be a different type of peripheral device without an operating system, such as a standalone camera or a built-in camera integrated into a processing device. As described in the above embodiments, the first acquisition device can be connected to a second acquisition device, or the first acquisition device can be connected to the second acquisition device via a processing device integrated within it, or the processing device can be connected to both the first and second acquisition devices to meet the multi-scenario output needs of multimedia data (such as different images and / or audio). Based on this, as... Figure 10 The processing method implemented on the first acquisition device side may include, but is not limited to, the following steps:
[0100] Step S101: The first acquisition device acquires the first media data;
[0101] Step S102: The first acquisition device receives the second media data;
[0102] Based on the above description of the application scenarios of the first acquisition device, in order to meet the output requirements of multiple screens and multiple scenarios, the first acquisition device can not only acquire the first media data, but also receive the second media data. The second media data can be acquired by the second acquisition device and sent to the first acquisition device, or it can be obtained by the network side device described above and sent to the first acquisition device. This application does not restrict the source of the second media data.
[0103] Each of the aforementioned first and second media data streams can include optical data such as image data, and can also include audio data, etc. The data types of the first and second media data can be the same (e.g., both can include optical or audio data) or different. Different data types of the first and second media data include completely different data types, such as the first media data including optical data and the second media data including audio data; or different types of optical data (e.g., color and depth). Of course, the data types of these two media data streams can also not be completely identical, but there can be media data with the same data type, such as the first media data including optical data and the second media data including both optical and media data. However, this is not limited to the examples in this application. This application does not restrict the data types of the multiple media data streams; they can be determined based on the actual output requirements of the application scenario.
[0104] It should be noted that, in the examples of the first and second media data mentioned above, although both contain the same type of optical data, the content of the two optical data streams often differs. For example, one stream might be image data acquired from a close-up viewpoint, while the other might be image data acquired from a long-distance viewpoint. Similarly, the audio data contained in the two media data streams may differ in audio signal content and / or signal strength. This application does not detail the actual acquisition process for optical and audio data with different content.
[0105] Step S103: The first acquisition device processes the first media data and the second media data to obtain the third media data;
[0106] Step S104: The first acquisition device transmits third media data to the processing device.
[0107] Based on the above description of the first and second media data, when processing these two media data streams, if they are of the same type, such as optical or audio data, the processing unit of the first acquisition device can directly integrate them to obtain third media data that meets the required output mode. Figure 3As shown, screen 1 and screen 2 correspond to these two media data streams (such as image data). After integrating and processing these two continuously acquired image data streams, such as merging a frame image from different image data streams with related content, we can obtain... Figure 3 The third-media data in the picture-in-picture mode shown is sent to the processing device, which then outputs data such as... Figure 3 The picture-in-picture mode shown is a single frame. The method of integrating two image data streams includes, but is not limited to, the integration method corresponding to this picture-in-picture mode, and may vary depending on the situation.
[0108] Optionally, in scenarios where both the first and second media data are audio data, the two audio data can be processed according to the audio output requirements. For example, the two audio data containing different audio content can be merged into one audio data, or the two audio data containing the same audio content but with different audio signal strengths can be compared and processed. Based on the comparison results, noise reduction and content supplementation can be performed to obtain a high-quality audio signal with complete content and strong signal strength. This application does not limit the processing method of the two audio data.
[0109] For example, in a scenario where a dialogue video segment is dubbed, the first and second acquisition devices mentioned above are different audio acquisition devices. Each voice actor can use different audio acquisition devices to record audio. That is, the two audio acquisition devices acquire audio from different voice actors, obtaining audio data corresponding to different dialogue contents. Then, the processing device can sort and fuse the audio data of different voice actors according to the dialogue output mode to obtain the complete dubbed audio data of the dialogue video segment, and send it to the processing device. The processing device can then fuse the image content of the dialogue video segment with the received audio data to obtain new video data. It should be noted that the processing implementation process for other types of application scenarios where both the first and second media data are audio data is similar, and this application will not provide detailed examples for each.
[0110] Optionally, in scenarios where both the first and second media data contain optical and audio data, the processing methods for optical and audio data described above can be combined to process the same type of media data. Then, the resulting optical and audio data can be integrated. For example, the audio data content can be matched with the optical data content to ensure that the optical and audio data content of the same output frame matches. For instance, for any frame in the optical data, consecutive audio frames explaining the content of that frame can be associated with that frame to obtain a video data stream. This allows the associated consecutive audio frames to be played synchronously when the third media data (i.e., the video data) is output. The implementation process of integrating matching image and audio data to obtain a video data stream is not detailed here.
[0111] In some other embodiments, if the first media data and the second media data are different types of media data, such as one channel of media data being optical data and the other channel of media data being audio data, content matching can be performed according to the method described above to obtain one channel of video data and then output it; if the two channels of media data are different types of optical data, taking image data as an example, such as one channel of optical data being image color data and the other channel of optical data being image depth data, the two channels of optical data are merged to obtain a third media data having the image color data and image depth data. The implementation process will not be described in detail in this application.
[0112] It should be noted that the implementation process of step S103 includes, but is not limited to, the implementation methods listed above. When the first media data and the second media data contain other data types or combinations, the processing method described in the above embodiments can be referred to for implementation. This application will not provide detailed examples of each one.
[0113] In summary, to meet the output requirements of multiple scenarios, the first acquisition device can acquire first media data and receive second media data. By processing the first and second media data, a third media data that can represent the content of multiple scenarios can be obtained. The first acquisition device can then transmit the third media data to the processing device, thereby enabling the processing device or its connected output device to output third media data containing the content of multiple scenarios, such as multi-view images (a single frame of an image contains clear images from both close-up and distant perspectives, i.e., a single frame of an image can simultaneously display the details of an object and distant objects) and / or audio, greatly expanding the applicability of the processing method.
[0114] Reference Figure 11 This is a flowchart illustrating another optional example of the processing method proposed in this application. This embodiment can describe an optional refined implementation of the processing method proposed above, such as... Figure 11As shown, the method may include:
[0115] Step S111: The first acquisition device continuously acquires the first media data;
[0116] Step S112: The first acquisition device continuously receives the second media data continuously acquired by the second acquisition device;
[0117] In practical applications, since media data is usually continuously output, both the first acquisition device and the second acquisition device can continuously acquire the corresponding media data. The second acquisition device continuously sends the continuously acquired second media data to the first acquisition device. It can be understood that the implementation process of the first acquisition device continuously receiving the second media data may be different depending on the application environment described above. It may include, but is not limited to, the implementation methods for continuously receiving the second media data listed below.
[0118] When the first acquisition device is connected to the second acquisition device, refer to Figures 2-4 In any of the application scenarios shown, the first acquisition device can continuously acquire first media data and continuously receive second media data continuously acquired by the second acquisition device. The transmission process of the second media data can be explained in conjunction with the device embodiments described above. Figures 2-4 The description content is fixed, and the embodiments of this application will not be described in detail here.
[0119] If the first and second acquisition devices are respectively connected to the processing device, such as Figure 5-Figure 8 In any of the application scenarios shown, the first acquisition device can continuously acquire the first media data while simultaneously receiving the second media data continuously acquired by the second acquisition device through the processing device. The process by which the second acquisition device transmits the acquired second media data to the first acquisition device in real time can be referred to the description in the corresponding part of the above device embodiment.
[0120] Optional, such as Figure 9 As shown, if the first acquisition device is connected to a processing device, and the processing device is connected to a network-side device such as a data source device or a communication device, the first acquisition device can continuously acquire first media data and continuously receive second media data continuously acquired and sent by the network-side device. It is evident that the implementation process of the first acquisition device continuously receiving second media data varies depending on the source of the second media data, including but not limited to the application scenarios described in the embodiments of this application.
[0121] Step S113: The first acquisition device processes the first media data and the second media data according to the output mode to obtain the third media data;
[0122] The output mode characterizes the output relationship between the first media data and the second media data, i.e., the output relationship between the multiple media data obtained by the first acquisition device. Based on the descriptions of the data types contained in the first and second media data in the above embodiments, different output modes can be used when the data types of the first and second media data are the same or different. Furthermore, for the same type of data contained in both the first and second media data, there can be a corresponding output mode. Thus, when processing two channels of media data of this type, processing can be directly performed according to this output mode. If multiple output modes are available, the output mode used for processing the two channels of media data can be determined according to, but not limited to, the selection method described above. The implementation process of step S113 is not detailed in this application.
[0123] For example, as shown in the system architecture diagram of the application environment described above, if the two media data include image data, the above output mode may include picture-in-picture mode, side-by-side display mode, top-bottom display mode, or custom multi-screen display mode, etc. This application does not limit the output mode type and configuration method of multi-channel image data.
[0124] Optionally, when the two media data are image data and audio data, the corresponding output mode can be a content-related image data and audio data synchronous output mode; if both media data are audio data, such as in a dialogue scenario, the corresponding output mode can be a dialogue output mode. In this way, each audio data of a speech can be sorted and merged according to the audio data content of different speakers to obtain one audio data, but it is not limited to the above-mentioned output modes listed in this embodiment.
[0125] Step S114: The first acquisition device transmits third media data to the processing device.
[0126] It is understood that, given different connection relationships between the first acquisition device and the processing device, the implementation methods for the first acquisition device to transmit third media data to the processing device may differ. For example, the corresponding communication paths may differ, and the implementation process can be referred to the description of the corresponding part of the above embodiment. The embodiments of this application will not be described in detail here.
[0127] Reference Figure 12 This is a flowchart illustrating another optional example of the processing method proposed in this application. This embodiment can describe another optional refined implementation of the processing method proposed above, such as... Figure 12 As shown, the method may include:
[0128] Step S121: The first acquisition device continuously acquires the first media data;
[0129] Step S122: The first acquisition device connects to the second acquisition device and continuously receives the second media data continuously acquired by the second acquisition device;
[0130] Step S123: The first acquisition device obtains the first state of the mode switching component;
[0131] Step S124: The first acquisition device determines the output mode corresponding to the first state;
[0132] In practical applications of this application, if the first acquisition device is configured with a default output mode, after obtaining multiple media data, it can be processed directly according to the output mode; if the first acquisition device supports multiple output modes for multiple media data, the output mode for the media data acquired by the first acquisition device and the second acquisition device can be determined first, and then the process can proceed to step S125.
[0133] In some embodiments, refer to Figure 3 The diagram shows a system architecture of an optional application environment for the first acquisition device. The first acquisition device may be configured with a mode switching component, which can be switched to different states. These different states may correspond to different output modes for the media data acquired by the first and second acquisition devices, respectively. The switching process of the different states of the mode switching component can be referred to the description in the corresponding section of the above embodiments.
[0134] Based on this, users can control the mode switching component to be in the corresponding first state according to actual output requirements. In this way, the first acquisition device can detect the state of the mode switching component in real time. If the mode switching component is found to be in the first state, the output mode corresponding to the first state can be determined according to the pre-configured correspondence between different states of the mode switching component and different output modes. This application does not limit the method for detecting the state of the mode switching component.
[0135] In step S125, the first acquisition device processes the first media data and the second media data according to the output mode to obtain the third media data;
[0136] In step S126, the first acquisition device transmits third media data to the processing device, and the processing device outputs the third media data.
[0137] The implementation process of steps S125 and S126 can be referred to the description of the corresponding parts of the above embodiments, and will not be described in detail here. Therefore, in order to obtain multi-view images, such as... Figure 3As shown, the first acquisition device can use a regular camera, while the second acquisition device can be a camera with a macro lens or a telephoto lens. The appropriate second acquisition device can be selected and connected to the first interface of the first acquisition device according to the image output requirements of the close-up or long-distance scene.
[0138] Afterwards, the first acquisition device can execute the processing method described above. That is, after detecting that the second acquisition device is connected to the first interface, the first acquisition device will receive two images. It can configure the received image (i.e., the image formed by the image data from the second acquisition device) as the main image and configure the image formed by the media data acquired by the first acquisition device itself as the secondary image. The main and secondary images are then merged to form a picture-in-picture mode, such as... Figure 3 As shown, the processing device then outputs one image obtained from the fusion process, but it is not limited to this multi-channel image data processing method.
[0139] It should be understood that when the second acquisition device is not connected to the first acquisition device, the first acquisition device can send the acquired first media data to the processing device for output. At this time, the processing device outputs this video stream. When the first interface is detected to be connected to the second acquisition device, the processing method described above can be executed. The implementation process will not be described in detail in this embodiment.
[0140] In addition, the third media data received by the processing device can be output by its own corresponding type of output component to meet the multi-view output requirements of social software such as video conferencing; alternatively, the processing device can also send the received third media data to other connected output devices via wireless or wired communication to output the third media data. The implementation process is not described in detail in this application.
[0141] In some other embodiments of this application, when the second acquisition device is connected to a processing device (i.e., a terminal running an operating system, such as a laptop computer), in order to determine the output mode for the media data acquired by the first acquisition device and the second acquisition device respectively, the first acquisition device may also receive an acquisition device selection instruction, determine the output mode corresponding to the acquisition device selection instruction, and then execute step S125 and its subsequent processing steps according to the method described above.
[0142] Among them, combined Figure 5-Figure 8 The system architecture of the application environment of the first acquisition device shown above, regardless of whether the first acquisition device is integrated into the processing device, the above acquisition device selection instruction can be generated by the processor of the processing device based on the selection and use operation of the virtual acquisition device; the virtual acquisition device is obtained by the processor executing a virtual driver to virtualize the first acquisition device and the second acquisition device. The method of obtaining the virtual acquisition device is not described in detail in this application.
[0143] Based on this, after the first acquisition device obtains the third media data, it can transmit the third media data to the processor of the processing device. The processor then executes a virtual driver to send the received third media data to at least one output component of the processing device to output the third media data. The output component is determined according to the respective data types of the first and second media data, such as a display and / or an audio player. The implementation method of how the processor of the processing device controls the corresponding display to output an image containing the image data and / or the audio player to play the audio containing the audio data after obtaining the media data containing image data and / or audio data is not described in detail.
[0144] In some other embodiments proposed in this application, such as Figure 9 The system structure of the application environment of the first acquisition device shown allows the first acquisition device to continuously acquire first media data while continuously receiving second media data continuously sent by the data source server. The two media data are processed in accordance with, but not limited to, the processing method described above. After obtaining the third media data, the third media data can be sent to the output of the processing device via wireless or wired communication. At the same time, the third media data can also be sent to the output of other communication devices in the virtual room created by the access processing device via the communication server, so as to realize multi-party media data interaction.
[0145] It should be noted that, in cases such as Figure 9 In the application environment shown, the first acquisition device can also obtain complete second media data from the network side and then start the acquisition device to collect the first media data. During the continuous acquisition of the first media data, the processing device can process at least one frame of the first media data and at least one frame of the second media data associated with its content, and transmit the processed third media data to the processing device.
[0146] For example, if there is a need to add background music to a product display image, the second media data can be the selected audio file used as background music, and the first media data can include the captured image data of the product, but is not limited to the content of the two media data streams described in this embodiment. Thus, in this example, according to the processing method described above, the processing device or its connected output device plays background music while outputting the product display image. The processing methods for other application scenarios are similar to those in this example, and will not be described in detail here.
[0147] This application also proposes a computer-readable storage medium storing a computer program thereon, which is loaded and executed by a processor to implement the processing method described above. The implementation process can be referred to the description of the various method embodiments above, and will not be described in detail here.
[0148] Finally, it should be noted that, regarding the above embodiments, unless the context explicitly indicates an exception, the words "a," "an," "an," and / or "the" do not specifically refer to the singular and may also include the plural. Generally speaking, the terms "comprising" and "including" only indicate the inclusion of explicitly identified steps and elements, and these steps and elements do not constitute an exclusive list; the method or apparatus may also include other steps or elements. An element defined by the phrase "comprising an..." does not exclude the presence of other identical elements in the process, method, product, or apparatus that includes the element.
[0149] In the description of the embodiments of this application, unless otherwise stated, " / " means "or", for example, A / B can mean A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more.
[0150] The terms used in this application, such as "first" and "second," are for descriptive purposes only, used to distinguish one operation, device, or apparatus from another, and do not necessarily require or imply any such actual relationship or order between these devices, operations, or apparatuses. Furthermore, they should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first" or "second" may explicitly or implicitly include one or more of that feature.
[0151] Furthermore, the various embodiments in this specification are described in a progressive or parallel manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the data acquisition devices and processing methods disclosed in the embodiments, the corresponding descriptions can be found together.
[0152] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A processing method, comprising: The first acquisition device continuously acquires data from the first media. When the second acquisition device is connected to the processing device, the first acquisition device continuously receives the second media data continuously acquired by the second acquisition device through the processing device. The first acquisition device processes the first media data and the second media data to obtain the third media data; The first acquisition device transmits the third media data to the processing device.
2. A processing method, comprising: The first acquisition device acquires the first media data; The first acquisition device receives the second media data; When the second acquisition device is connected to the processing device, the first acquisition device receives an acquisition device selection instruction; wherein, the acquisition device selection instruction is generated by the processor of the processing device based on the selection and use operation of the virtual acquisition device; the virtual acquisition device is obtained by the processor executing a virtual driver to virtualize the first acquisition device and the second acquisition device; Determine the output mode corresponding to the acquisition device selection command; The first acquisition device processes the first media data and the second media data according to the output mode to obtain the third media data; wherein, the output mode can characterize the output relationship between the first media data and the second media data; The first acquisition device transmits the third media data to the processing device.
3. The method according to claim 2, wherein the first acquisition device processes the first media data and the second media data, further comprising: When the first acquisition device is connected to the second acquisition device, a first state of the mode switching component of the first acquisition device is obtained; wherein, the mode switching component can be switched to different states, and the different states correspond to different output modes for the media data acquired by the first acquisition device and the second acquisition device respectively; Determine the output mode corresponding to the first state.
4. A processing method, comprising: The first acquisition device acquires the first media data; The first acquisition device receives the second media data; The first acquisition device processes the first media data and the second media data to obtain the third media data; When the second acquisition device is connected to a processing device that integrates the first acquisition device, the first acquisition device transmits the third media data to the processor of the processing device, and the processor executes a virtual drive to send the third media data to at least one output component of the processing device; the output component is determined based on the respective data types of the first media data and the second media data.
5. A data acquisition device, comprising: The data acquisition device is used to acquire data from the first media. The first interface is used to receive the second media data; A processing device is used to connect the acquisition device and the first interface, process the first media data and the second media data, obtain the third media data, and transmit the third media data to the processing device. Wherein, the first interface is connected to the second acquisition device; the acquisition device further includes: a second interface, used to connect the processing device and the processing device, receive the third media data transmitted by the processing device, and transmit the third media data to the processor of the processing device; or, The acquisition device is integrated into the processing device, and the processing device is connected to the second acquisition device. The first interface is a bidirectional communication interface that supports bidirectional data transmission. The first interface is also used to receive the third media data transmitted by the processing device and to transmit the third media data to the processor of the processing device.
Citation Information
Patent Citations
Video live broadcast method and video live broadcast device
CN113194325A
Video live broadcast method and video live broadcast device
CN113315987A