Processing method and apparatus
By synchronizing configuration information and updating processing parameters in a multimedia console or conference room system, the unreliability problem caused by the single control terminal is solved, and flexible control of multiple control terminals and system reliability are achieved.
Patent Information
- Application Number
- CN202211527837.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-30
- Publication Date
- 2025-12-19
- Estimated Expiration
- 2042-11-30
AI Technical Summary
Existing multimedia consoles or conference room systems typically use a single, proprietary connection for their control terminals, making it difficult to quickly find a replacement control in case of human error or malfunction, thus rendering the system unreliable.
By synchronizing configuration information after the first electronic device establishes a target connection with at least one second electronic device, and updating multimedia data processing parameters based on the input operations of the second electronic device, flexible control of multiple control terminals can be achieved.
It enables flexible control from multiple control terminals, ensuring that the system can recover quickly in the event of human error or failure, thereby improving the system's reliability and flexibility.
Smart Images

Figure CN115941703B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] Embodiments of the present application relate to the field of information technology, and relate to but are not limited to a processing method and device. BACKGROUND
[0002] For a multimedia console or conference room system, a control terminal (console) is needed to control a media processing host to make real-time switching of input and output. However, the control terminal is usually single, and a private connection is usually used. If human error or control terminal failure occurs, a substitute control terminal cannot be quickly found. SUMMARY
[0003] Therefore, embodiments of the present application provide a processing method and device.
[0004] The technical solution of the embodiments of the present application is as follows:
[0005] In a first aspect, the embodiments of the present application provide a processing method, which comprises:
[0006] After a target connection is established between a first electronic device and at least one second electronic device, configuration information of the first electronic device is synchronized to the second electronic device, wherein the configuration information comprises multimedia data obtained by the first electronic device and information for processing the multimedia data;
[0007] If a target input operation is obtained through the second electronic device, a processing parameter for processing the multimedia data is updated based on the target input operation;
[0008] A multimedia data processing result based on the updated processing parameter is output.
[0009] In a second aspect, the embodiments of the present application provide a processing device, which comprises:
[0010] A synchronization unit is configured to synchronize configuration information of a first electronic device to at least one second electronic device after a target connection is established between the first electronic device and the second electronic device, wherein the configuration information comprises multimedia data obtained by the first electronic device and information for processing the multimedia data;
[0011] An updating unit is configured to update a processing parameter for processing the multimedia data based on a target input operation if the target input operation is obtained through the second electronic device;
[0012] An output unit is configured to output a multimedia data processing result based on the updated processing parameter. BRIEF DESCRIPTION OF DRAWINGS
[0013] Figure 1 An implementation flowchart of the processing method of the embodiment of the present application Figure One
[0014] Figure 2 An implementation flowchart of the processing method of the embodiment of the present application Figure Two ;
[0015] Figure 3A An implementation flowchart of the processing method of the embodiment of the present application
[0016] Figure 3B An implementation flowchart of the processing method of the embodiment of the present application Figure One ;
[0017] Figure 3C An implementation flowchart of the processing method of the embodiment of the present application Figure Two ;
[0018] Figure 4 An implementation flowchart of the processing method of the embodiment of the present application Figure One ;
[0019] Figure 5 An implementation flowchart of the processing method of the embodiment of the present application Figure Two ;
[0020] Figure 6 An implementation flowchart of the processing method of the embodiment of the present application
[0021] Figure 7 An implementation flowchart of the processing method of the embodiment of the present application DETAILED DESCRIPTION
[0022] The technical solutions of the present application will be further described in detail below in combination with the drawings and embodiments. Obviously, the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.
[0023] In the following description, "some embodiments" are described, which describe a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subset of all possible embodiments, and can be combined with each other without conflict.
[0024] In the following description, the suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of the description of the present application, and have no specific meaning. Therefore, "module", "component", or "unit" can be used interchangeably.
[0025] It should be noted that the terms "first, second, and third" used in the embodiments of this application are merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, and third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.
[0026] Based on this, this application provides a processing method. The function implemented by this method can be achieved by the processor in the first electronic device calling program code. Of course, the program code can be stored in the storage medium of the first electronic device. Figure 1 This is a schematic diagram illustrating the implementation flow of the processing method in the embodiments of this application. Figure One ,like Figure 1 As shown, the method includes:
[0027] Step S101: After the first electronic device establishes a target connection with at least one second electronic device, the current configuration information of the first electronic device is synchronized to the second electronic device. The configuration information includes multimedia data obtained by the first electronic device and information on processing the multimedia data.
[0028] Here, the electronic device can be any type of device with information processing capabilities, such as a navigator, smartphone, tablet computer, wearable device, laptop computer, all-in-one computer and desktop computer, standalone server, server cluster, etc.
[0029] The first electronic device is capable of acquiring multimedia data, such as video streams captured by a camera or video sources captured by a video capture card, or video stream data acquired or sent from other devices through at least one video streaming application. The first electronic device stores configuration information, which includes the multimedia data and information for processing the multimedia data. For example, the multimedia data included in the configuration information can be related information about the multimedia data or the multimedia data itself. The information for processing the multimedia data can include information on processing the content of the multimedia data, such as information related to image cutout, background blurring, and face tracking of the video stream. The information for processing the multimedia data can also include information on the fusion method of the multimedia data, such as information on fusion of multiple video streams (fusion size, number of fused streams), etc. The information for processing the multimedia data also includes information on how to display, show, or edit the multimedia data, such as how to present or edit the video stream on the display interface, how to share the multimedia data with other devices, and the configuration of the amount of shared data, etc.
[0030] It should be noted that the embodiments of the present application do not limit the content included in the configuration information, the configuration information can include multimedia data, and information for processing the multimedia data, and can also include other information.
[0031] In the embodiments of the present application, the first electronic device can be a host in a multimedia data processing system (such as a multimedia control system or a conference room system), and the second electronic device can be a control terminal in the multimedia data processing system.
[0032] In step S102, if a target input operation is obtained through the second electronic device, a processing parameter for processing the multimedia data is updated based on the target input operation.
[0033] In the embodiments of the present application, the first electronic device can synchronize the current configuration information to the second electronic device, so that the second electronic device can generate a corresponding UI (User Interface, user interface) interface based on the multimedia data in the configuration information and the information for processing the multimedia data for a user operating the second electronic device. Further, the second electronic device can obtain a corresponding target input operation in response to the user's operation on the UI interface. The second electronic device can send the target input operation to the first electronic device, and the first electronic device updates the processing parameter for processing the multimedia data based on the target input operation. For example, the processing parameter can be a specific matting parameter for matting a video stream. For another example, the processing parameter can be a specific fusion parameter for fusing multiple video streams.
[0034] In step S103, a multimedia data processing result based on the updated processing parameter is output.
[0035] In the embodiments of the present application, when the first electronic device obtains the updated processing parameter, the first electronic device can process the multimedia data based on the updated processing parameter to obtain a processing result of the multimedia data. For example, the updated processing parameter is a specific fusion parameter, and then two video streams can be fused into a video stream of a preset size according to the specific fusion parameter to obtain a multimedia data processing result. Further, the multimedia data processing result can be output to other target devices or target components of itself.
[0036] Here, through the method in steps S101 to S103, a multimedia data processing scheme with multiple control terminals for control can be provided, and the scheme is simple and easy to implement.
[0037] Based on the foregoing embodiments, the embodiments of the present application further provide a processing method, the method is applied to a first electronic device, Figure 2Fig. 1 shows a flowchart of an embodiment of a method for processing Figure Two As shown in Figure 2 The method comprises the following steps:
[0038] In step S201, after accessing a target network, a target program is run, and a target service interface is initialized, the target service interface being an interface for providing a target service in the target program to the second electronic device;
[0039] Here, the target network can be a local area network set by the first electronic device or other devices, or a wide area network, and the embodiments of the present application do not limit this.
[0040] In the embodiments of the present application, the first electronic device is installed with a target program, and the target program can provide a target service through the target service interface. For example, information related to multimedia data can be synchronized to the second electronic device through the target service interface. For another example, an input operation from at least one second electronic device can be obtained through the target service interface. For another example, the obtained target input operation can also be analyzed through the target service interface.
[0041] In step S202, after the at least one second electronic device accesses the target network, authentication information from the second electronic device is received;
[0042] In the embodiments of the present application, after the first electronic device and the at least one second electronic device both access the target network, the first electronic device receives authentication information from the second electronic device, so as to establish a target connection with the second electronic device if the authentication is passed.
[0043] For example, after the first electronic device and the second electronic device are both connected to the same local area network, the second electronic device sends an identity authentication request to the first electronic device; the first electronic device verifies the identity authentication request, or verifies conference account information, link information, etc.; if the verification is passed, a target connection is established with the second electronic device, so as to synchronize the current configuration information to the second electronic device.
[0044] In step S203, if the second electronic device passes the authentication, a target connection is established with the second electronic device;
[0045] In step S204, after the first electronic device and the at least one second electronic device establish the target connection, the current configuration information of the first electronic device is synchronized to the second electronic device, the configuration information including multimedia data obtained by the first electronic device and information for processing the multimedia data;
[0046] Step S205, if a target input operation is obtained through the second electronic device, updating a processing parameter for processing the multimedia data based on the target input operation;
[0047] Step S206, outputting a multimedia data processing result obtained based on the updated processing parameter.
[0048] Here, through the above steps S201 to S206, a multimedia data processing scheme controlled by multiple control terminals can be provided, and the scheme is simple and easy to implement, and safe and reliable.
[0049] Based on the foregoing embodiments, the embodiments of the present application further provide a processing method, which is applied to a first electronic device, and the method comprises:
[0050] Step S211, after accessing a target network, running a target program, initializing a target service interface, the target service interface being an interface for providing a target service in the target program to the second electronic device;
[0051] Step S212, after the at least one second electronic device accesses the target network, receiving verification information from the second electronic device;
[0052] Step S213, in a case where the second electronic device passes the verification, establishing the target connection with the second electronic device;
[0053] Step S214, after accessing the target network, initializing a target configuration file based on the target program, to process obtained multimedia data based on the target configuration file;
[0054] Here, the target configuration file can be initialized by the target program, so that the obtained multimedia data can be processed based on the initialized target configuration file. The multimedia data includes but is not limited to various forms such as graphics, images, sounds, texts and animations.
[0055] Step S215, after establishing the target connection, synchronizing information related to the multimedia data to the second electronic device through the target service interface, to output a configuration interface capable of operating the target configuration file in a target display area of the second electronic device; wherein the configuration information includes multimedia data obtained by the first electronic device and information for processing the multimedia data;
[0056] In the embodiments of the present application, after the first electronic device synchronizes the information related to the multimedia data to the second electronic device, the second electronic device outputs a configuration interface capable of operating the target profile in a target display area of the second electronic device, so that the configuration personnel of the control end can perform a configuration operation based on the configuration interface, and the configuration operation is a target input operation.
[0057] In step S216, if the target input operation is obtained through the second electronic device, the processing parameter for processing the multimedia data is updated based on the target input operation.
[0058] In step S217, a multimedia data processing result based on the updated processing parameter is output.
[0059] In some embodiments, the target input operation obtained through the second electronic device can be implemented in the following manner:
[0060] Firstly, if the second electronic device is unique, the input operation from the second electronic device obtained through the target service interface is determined as the target input operation.
[0061] Here, the second electronic device being unique can mean that at the current time, only one second electronic device is connected to the first electronic device and obtains the input operation through the second electronic device. The second electronic device being unique can also mean that at the current time, multiple second electronic devices are connected to the first electronic device, but at the current time, the first electronic device only obtains the input operation through a certain second electronic device (i.e., the configuration personnel of other second electronic devices have no input operation).
[0062] Secondly, if the second electronic devices are not unique, the input operation from multiple second electronic devices obtained through the target service interface and meeting a corresponding condition is determined as the target input operation.
[0063] For example, the input operation meeting the corresponding condition can be that the operation time of the input operation meets a preset time, or the identifier of the second electronic device to which the input operation belongs meets a preset identifier. In this way, a multimedia data processing scheme for multiple control ends (second electronic devices) to perform control can be provided, and the multiple control ends can simultaneously issue control instructions, and the host end (first electronic device) always responds to the instructions meeting the corresponding condition and updates in real time.
[0064] In some embodiments, the input operation from multiple second electronic devices obtained through the target service interface and meeting the corresponding condition can be determined as the target input operation in the following at least one manner:
[0065] The first method is to obtain time information of each input operation, and determine the input operation meeting the corresponding time condition as the target input operation.
[0066] For example, each input operation can be time-stamped, and the input operation with the latest time stamp is determined as the target input operation.
[0067] The second method is to obtain identification information of each second electronic device, and determine the input operation of the second electronic device matching the target identification information as the target input operation.
[0068] For example, the second electronic devices can be classified, different types of second electronic devices have different control permission levels, and the input operation of the second electronic device meeting the preset level is determined as the target input operation. The identification information is used to represent different control permission levels. For another example, the second electronic devices can be classified according to geographical locations, and the input operation of the second electronic device meeting the preset location is determined as the target input operation. The identification information is used to represent different geographical locations. Of course, the identification information can also be used to represent other information, and the embodiments of the present application do not limit the identification information.
[0069] The third method is to obtain usage object information of each second electronic device, and determine the input operation from the target usage object as the target input operation.
[0070] Here, the target input operation can be determined according to the usage object information of the second electronic device. For example, the username and password need to be input during use, so that the usage object information of the second electronic device can be obtained. The usage object information of the second electronic device can also be determined according to the video image captured by the camera on the second electronic device.
[0071] The fourth method is to obtain input content of each input operation, and determine the input operation inputting the target content as the target input operation.
[0072] Here, the input operation inputting the content meeting the target content can be determined as the target input operation, such as the configuration item of the pre-set image fusion mode and the video stream interception area. When the input operation is for such a configuration item, it can be directly used as the target operation.
[0073] In the embodiments of the present application, multiple second electronic devices can simultaneously issue control instructions, and the first electronic device always responds to the instructions meeting the corresponding conditions, and is updated in real time. In this way, the joining or disconnection of the second electronic devices does not affect other ends, and the system can still run when all the second electronic devices are offline.
[0074] Based on the foregoing embodiments, the embodiments of the present application further provide a processing method, which is applied to a first electronic device,Figure 3A Figure 3 is a flowchart illustrating a method for processing according to an embodiment of the present application. As shown in Figure 3, the method comprises the following steps. Figure 3A
[0075] Step S301, after accessing a target network, running a target program, initializing a target service interface, the target service interface being an interface for providing a target service in the target program to the second electronic device;
[0076] Step S302, after the at least one second electronic device accesses the target network, receiving authentication information from the second electronic device;
[0077] Step S303, if the second electronic device is authenticated, establishing the target connection with the second electronic device;
[0078] Step S304, after the first electronic device establishes the target connection with the at least one second electronic device, synchronizing current configuration information of the first electronic device to the second electronic device, the configuration information including multimedia data obtained by the first electronic device and information for processing the multimedia data;
[0079] Step S305, if a target input operation is obtained through the second electronic device, analyzing the target input operation through the target service to obtain a target modification parameter, updating a corresponding processing parameter for processing the multimedia data based on the target modification parameter, and processing the multimedia data by using the updated processing parameter;
[0080] Here, the processing parameter can include a fusion layout, a video stream interception region, a video stream switching, and the like, which are parameters that can be operated on a UI interface. Further, the multimedia data can be processed by using the updated processing parameter.
[0081] Step S306, outputting a multimedia data processing result obtained based on the updated processing parameter.
[0082] Based on the foregoing embodiment, the present embodiment further provides a processing method, which is applied to a first electronic device, and the method comprises the following steps.
[0083] Step S311, after accessing a target network, running a target program, initializing a target service interface, the target service interface being an interface for providing a target service in the target program to the second electronic device;
[0084] Step S312, after the at least one second electronic device accesses the target network, receiving authentication information from the second electronic device;
[0085] Step S313: If the second electronic device passes the verification, establish the target connection with the second electronic device;
[0086] Step S314: After the first electronic device establishes a target connection with at least one second electronic device, the current configuration information of the first electronic device is synchronized to the second electronic device. The configuration information includes multimedia data obtained by the first electronic device and information on processing the multimedia data.
[0087] Step S315: If a target input operation is obtained through the second electronic device, the target input operation is parsed through the target service to obtain target modification parameters. If the processing parameter item corresponding to the target modification parameters allows modification, the corresponding processing parameter item is updated based on the target modification parameters, so as to process the multimedia data using the updated processing parameters.
[0088] Here, processing parameters can include UI-operable parameters such as blending layout, video stream capture area, and video stream switching. Furthermore, it's possible to customize one or more of these parameters to prevent modification in certain scenarios, while allowing modification of the others. If the processing parameter corresponding to the target modification parameter is modifiable, then the corresponding processing parameter item can be updated using that target modification parameter, thereby processing the multimedia data using the updated processing parameter item.
[0089] Step S316: Output the multimedia data processing results based on the updated processing parameters.
[0090] In some embodiments, the processing method further includes at least one of the following:
[0091] The first method involves updating the target configuration file based on the target modification parameters corresponding to the target input operation.
[0092] For example, Figure 3B This is a schematic diagram of the UI interface of an embodiment of this application. Figure One ,like Figure 3B As shown, the target input operation is to determine the video stream capture area. For example, the video stream can be captured by a "whiteboard camera," and the video stream capture area can be determined by manually "selecting" the area. Therefore, the target modification parameters corresponding to this target input operation are parameters related to the video stream capture area, and the target configuration file can be updated based on these parameters.
[0093] The second method involves updating the target configuration file based on the target modification parameters if the target input operation corresponds to a target modification parameter item.
[0094] For example, Figure 3C Fig. 1 shows a UI interface of an embodiment of the present application Figure Two As shown in Fig. 1, the target input operation corresponds to a target modification parameter, and the target processing parameter item is a "video" item, a "content" item or an "extended screen" item. Figure 3C The target modification parameter can be a related parameter of "output screen setting".
[0095] Thirdly, if the target input operation has target permission, the target configuration file is updated based on the target modification parameter corresponding to the target input operation.
[0096] For example, as shown in Fig. 1, the target input operation has modification permission for the "video" item or the "content" item, but has no modification permission for the "extended screen" item. Figure 3C
[0097] Based on the foregoing embodiments, an embodiment of the present application further provides a processing method, which is applied to a first electronic device, and the method comprises the following steps:
[0098] In step S321, after the first electronic device establishes a target connection with at least one second electronic device, the current configuration information of the first electronic device is synchronized to the second electronic device, wherein the configuration information comprises multimedia data obtained by the first electronic device and information for processing the multimedia data.
[0099] In step S322, if a target input operation is obtained through the second electronic device, a processing parameter for processing the multimedia data is updated based on the target input operation.
[0100] In step S323, target multimedia data obtained by processing the multimedia data based on the updated processing parameter is output to the at least one second electronic device.
[0101] For example, the target multimedia data obtained by processing the multimedia data based on the updated processing parameter can be output to the at least one second electronic device, so as to achieve the purpose of synchronizing the current configuration information or the purpose of preview.
[0102] Based on the foregoing embodiments, an embodiment of the present application further provides a processing method, which is applied to a first electronic device, and the method comprises the following steps:
[0103] In step S331, after the first electronic device establishes a target connection with at least one second electronic device, the current configuration information of the first electronic device is synchronized to the second electronic device, wherein the configuration information comprises multimedia data obtained by the first electronic device and information for processing the multimedia data.
[0104] Step S332, if a target input operation is obtained through the second electronic device, updating a processing parameter for processing the multimedia data based on the target input operation;
[0105] Step S333, outputting target multimedia data obtained by processing the multimedia data based on the updated processing parameter to a target application.
[0106] Here, the target application can be a system application or a third-party application. The target application can be located on the first electronic device or on a client.
[0107] In some embodiments, the target multimedia data obtained by processing the multimedia data based on the updated processing parameter can also be output to a target client.
[0108] Based on the foregoing embodiments, the embodiments of the present application further provide a processing method, which is applied to a first electronic device, and the method comprises:
[0109] Step S341, after a target connection is established between the first electronic device and at least one second electronic device, synchronizing current configuration information of the first electronic device to the second electronic device, the configuration information comprising multimedia data obtained by the first electronic device and information for processing the multimedia data;
[0110] Step S342, if a target input operation is obtained through the second electronic device, updating a processing parameter for processing the multimedia data based on the target input operation;
[0111] Step S343, outputting target multimedia data obtained by processing the multimedia data based on the updated processing parameter to a corresponding output component of the first electronic device.
[0112] Here, the output component includes but is not limited to a display screen of the first electronic device and a loudspeaker of the first electronic device.
[0113] In some embodiments, the target connection with the at least one second electronic device can be established by at least one of the following:
[0114] Firstly, if it is determined that the at least one second electronic device accesses a network accessed by the first electronic device, it is determined that the target connection is established with the at least one second electronic device;
[0115] For example, if it is determined that a certain second electronic device accesses a local area network accessed by the first electronic device, it is determined that the target connection is established with the second electronic device.
[0116] Secondly, if it is determined that the at least one second electronic device accesses the corresponding network through a specified network node, the target connection is established with the at least one second electronic device, and the specified network node is a network node set by the first electronic device.
[0117] Here, the network node refers to a computer or other device connected to a network with an independent address and a data transmission or reception function. The network node can be a workstation, a client, a network user or a personal computer, and can also be a server, a printer and other network-connected devices.
[0118] Based on the foregoing embodiments, the embodiments of the application further provide a processing method and a multimedia data processing system. The multimedia data processing system can be compatible with multiple control terminals (i.e., second electronic devices) for simultaneous control. The media processing host (i.e., the first electronic device) can simultaneously receive and respond to commands of the multiple control terminals. The control terminals can be quickly connected to the host terminal in multiple ways.
[0119] The multimedia data processing system can be used for a PC (Personal Computer)-based director system and a multimedia control system in typical multi-camera live broadcast, large-scale multi-camera conference, activity and other scenarios. Taking an intelligent multi-channel video conference control system (smart conference system) as an example, the system mainly consists of a host terminal (must) and a plurality of control terminals. The two are negotiated through a configuration file stored in the host terminal, wherein:
[0120] Host terminal: including a media processing unit and a controlled server. The host terminal can run on a high-performance PC. The media processing unit directly receives all video streams from the data end (for example, in the meeting room), decodes, AI (Artificial Intelligence) processes, fuses, encodes and outputs the video streams. The controlled server interacts with the control terminal to determine the specific processing method, fusion mode and the like, and maintains the configuration file.
[0121] Control terminal: used in cooperation with the host terminal. After joining the network where the host terminal is located, the control terminal connects the controlled server running on the host terminal, reads the state of the host terminal and responds to user operations to issue corresponding configuration file modification commands to the controlled server.
[0122] Configuration file: composed of a file header, input and output device information and video information, stored and maintained by the host terminal.
[0123] That is, Figure 4 The composition structure of the multimedia data processing system of the embodiments of the application is shown in Figure One For example, Figure 4As shown, the multimedia data processing system comprises a host end 41 and a control end 42. The host end 41 comprises a controlled server 411 and a media processing unit 412, and further stores a configuration file 413. Each control end 42 comprises a configuration interactor 421, and further has a UI interface 422.
[0124] The controlled server 411 of the host end 41 can synchronize the current configuration file 413 of the host end 41 to the configuration interactor 421 of the control end 42, and the configuration interactor 421 can generate the UI interface 422 based on the synchronized configuration file 413, so that the user of the control end 42 can make input operations on the UI interface 422. Further, a modified configuration file can be obtained according to the input operations. The media processing unit 412 of the host end 41 receives at least one input video stream, processes the at least one input video stream according to the modified configuration file, obtains at least one output video stream, and outputs the at least one output video stream. The processing of the at least one input video stream can include processing of the content of the video stream, such as AI cutout, background blurring, face tracking, etc. The processing of the at least one input video stream can also include fusion of multiple video streams, such as fusion of multiple video streams into a video stream of a preset size or several video streams. That is, the number of video streams in the at least one input video stream is greater than or equal to the number of video streams in the at least one output video stream.
[0125] It should be noted that the specific processing content of the at least one input video stream by the embodiment of the present application is not limited.
[0126] The working process of the multimedia data processing system is as follows:
[0127] 1) The host end is connected to the local area network, started, and the controlled server and the configuration file are initialized. The media processing unit starts to check whether the configuration file is modified every certain period of time.
[0128] 2) The control end is connected to the local area network where the host end is located, establishes a connection with the host, and sends an identity authentication request to the controlled server.
[0129] 3) The controlled server authenticates the identity of the control end. After passing the authentication, the controlled server sends the current state of the configuration file to the control end.
[0130] 4) The control end receives the current state of the configuration file sent by the host end, makes a response on the user interface, and waits for user operations. After the user makes certain operations, the user clicks the "apply" button of the control end. The control end packs all the modifications and sends them to the controlled server.
[0131] 5), the controlled server receives the modification request, updates in the configuration file after parsing, and gives the current timestamp of the configuration file;
[0132] 6), the media processing unit checks the configuration file every certain period of time, and responds to the configuration corresponding to the latest timestamp.
[0133] Here, the controlled server can receive several modification requests from the control terminal at the same time and modify the configuration file according to the order to ensure that the configuration file always reflects the latest user request; At the same time, the media processing unit can also ensure the response to the latest configuration information by judging the timestamp.
[0134] The advantages after adopting the scheme are:
[0135] ①Adopting the flexible joining mode of multiple control terminals can realize simultaneous control of multiple people, real-time substitution, and high reliability;
[0136] ②Multiple control terminals can simultaneously issue control instructions, and the host terminal always responds to the latest instructions and updates in real time;
[0137] ③The joining and disconnection of the control terminal do not affect other terminals, and the system can still run in the case of complete control terminal disconnection.
[0138] Based on the foregoing embodiment, the embodiment of the application provides a multimedia data processing system, Figure 5 The composition structure of the multimedia data processing system of the embodiment of the application is shown in Figure Two As shown in Figure 5 The multimedia data processing system 500 includes a first electronic device 501 and at least one second electronic device 502, wherein:
[0139] The first electronic device 501 is configured to synchronize the current configuration information of the first electronic device 501 to the second electronic device 502 after establishing a target connection with the second electronic device 502, wherein the configuration information includes multimedia data obtained by the first electronic device 501 and information for processing the multimedia data; If a target input operation is obtained through the second electronic device 502, update the processing parameters for processing the multimedia data based on the target input operation; Output the multimedia data processing result obtained based on the updated processing parameters;
[0140] The second electronic device 502 is configured to present a configuration interface based on the synchronized configuration information to trigger the target input operation.
[0141] In some embodiments, the first electronic device at least includes a controlled server and a media processing unit. The controlled server interacts with at least one second electronic device to realize transmission (receiving or sending) of a control stream, and the control stream includes current configuration information of the first electronic device. The media processing unit interacts with a camera or a client or at least one second electronic device to realize transmission (receiving or sending) of a video stream. The first electronic device can obtain a video stream captured by the camera and send the video stream processed based on the configuration information to the client.
[0142] Based on the foregoing embodiments, the embodiments of the present application provide a processing device, which includes included units, included modules of the units, and included components of the modules, and can be implemented by a processor in the first electronic device. Of course, the device can also be implemented by a specific logic circuit. In the implementation process, the processor can be a CPU (Central Processing Unit), an MPU (Microprocessor Unit), a DSP (Digital Signal Processing), or an FPGA (Field Programmable Gate Array), etc.
[0143] Figure 6 The constituent structure of the processing device of the embodiments of the present application is shown in FIG. 6. Figure 6 As shown in FIG. 6, the device 600 includes:
[0144] A synchronization unit 601 is configured to synchronize current configuration information of the first electronic device to at least one second electronic device after the first electronic device and the second electronic device establish a target connection, and the configuration information includes multimedia data obtained by the first electronic device and information for processing the multimedia data.
[0145] An updating unit 602 is configured to update a processing parameter for processing the multimedia data based on a target input operation if the target input operation is obtained by the second electronic device.
[0146] An output unit 603 is configured to output a multimedia data processing result obtained based on the updated processing parameter.
[0147] In some embodiments, the device further includes:
[0148] An initialization unit is configured to run a target program and initialize a target service interface after accessing a target network, and the target service interface is an interface for providing a target service in the target program to the second electronic device.
[0149] an information receiving unit, configured to receive verification information from the second electronic device after the at least one second electronic device accesses the target network;
[0150] a connection establishing unit, configured to establish the target connection with the second electronic device if the second electronic device passes the verification.
[0151] In some embodiments, the synchronizing unit 601 comprises:
[0152] an initializing module, configured to initialize a target configuration file based on the target program after accessing the target network, so as to process the obtained multimedia data based on the target configuration file;
[0153] a synchronizing module, configured to synchronize information related to the multimedia data to the second electronic device through the target service interface after establishing the target connection, so as to output a configuration interface capable of operating the target configuration file in a target display area of the second electronic device.
[0154] In some embodiments, the updating unit 602 comprises one of the following:
[0155] a first determining module, configured to determine an input operation from the second electronic device obtained through the target service interface as the target input operation if the second electronic device is unique;
[0156] a second determining module, configured to determine an input operation meeting a corresponding condition from input operations from multiple second electronic devices obtained through the target service interface as the target input operation if the second electronic devices are not unique.
[0157] In some embodiments, the second determining module comprises at least one of the following:
[0158] a first determining component, configured to obtain time information of each input operation, and determine an input operation meeting a corresponding time condition as the target input operation;
[0159] a second determining component, configured to obtain identification information of each second electronic device, and determine an input operation obtained by a second electronic device matching target identification information as the target input operation;
[0160] a third determining component, configured to obtain use object information of each second electronic device, and determine an input operation from a target use object as the target input operation;
[0161] A fourth determining component is configured to obtain input content of each input operation, and determine an input operation of input target content as the target input operation.
[0162] In some embodiments, the updating unit 602 comprises at least one of:
[0163] A first updating module is configured to parse the target input operation by the target service to obtain a target modification parameter, update a corresponding processing parameter for processing the multimedia data based on the target modification parameter, and process the multimedia data by using the updated processing parameter.
[0164] A second updating module is configured to parse the target input operation by the target service to obtain a target modification parameter, and if a processing parameter item corresponding to the target modification parameter is allowed to be modified, update the corresponding processing parameter item based on the target modification parameter, and process the multimedia data by using the updated processing parameter.
[0165] In some embodiments, the apparatus further comprises at least one of:
[0166] An updating subunit is configured to update the target configuration file based on a target modification parameter corresponding to the target input operation.
[0167] The updating subunit is further configured to, if the target modification parameter corresponding to the target input operation is used to modify a target processing parameter item, update the target configuration file based on the target modification parameter.
[0168] The updating subunit is further configured to, if the target input operation has a target permission, update the target configuration file based on a target modification parameter corresponding to the target input operation.
[0169] In some embodiments, the output unit 603 comprises at least one of:
[0170] A first output module is configured to output target multimedia data obtained by processing the multimedia data based on the updated processing parameter to the at least one second electronic device.
[0171] A second output module is configured to output target multimedia data obtained by processing the multimedia data based on the updated processing parameter to a target application.
[0172] A third output module is configured to output target multimedia data obtained by processing the multimedia data based on the updated processing parameter to a corresponding output component of the first electronic device.
[0173] In some embodiments, the apparatus further comprises at least one of:
[0174] determining unit, configured to determine to establish the target connection with the at least one second electronic device if it is determined that the at least one second electronic device accesses a network accessed by the first electronic device;
[0175] The determining unit is further configured to determine to establish the target connection with the at least one second electronic device if it is determined that the at least one second electronic device accesses a corresponding network through a specified network node, the specified network node being a network node set by the first electronic device.
[0176] The above apparatus embodiment is similar to the description of the above method embodiment, and has similar beneficial effects to the method embodiment. For technical details not disclosed in the apparatus embodiment of the present application, please refer to the description of the method embodiment of the present application.
[0177] It should be noted that, in the embodiments of the present application, if the above-mentioned processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, and includes a plurality of instructions for causing an electronic device (which can be a personal computer, a server, etc.) to execute all or part of the methods described in the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a ROM (Read Only Memory), a magnetic disk or an optical disk, and various media that can store program codes. Therefore, the embodiments of the present application are not limited to any specific hardware and software combination.
[0178] Correspondingly, the embodiments of the present application provide an electronic device, including a memory and a processor, the memory stores a computer program capable of running on the processor, and the processor implements the steps of the processing method provided in the above embodiments when executing the program.
[0179] Correspondingly, the embodiments of the present application provide a readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps of the above processing method.
[0180] It should be noted that: the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects to the method embodiments. For technical details not disclosed in the storage medium and device embodiments of the present application, please refer to the description of the method embodiments of the present application.
[0181] It should be noted that, Figure 7A hardware entity schematic diagram of an electronic device of an embodiment of the present application is shown in Figure 7 The hardware entity of the electronic device 700 includes a processor 701, a communication interface 702 and a memory 703, wherein
[0182] The processor 701 generally controls the overall operation of the electronic device 700.
[0183] The communication interface 702 can enable the electronic device 700 to communicate with other electronic devices or servers or platforms through a network.
[0184] The memory 703 is configured to store instructions and applications executable by the processor 701, and can also cache data to be processed by the processor 701 and modules in the electronic device 700 (for example, image data, audio data, voice communication data and video communication data), which can be implemented by FLASH (Flash Memory) or RAM (Random Access Memory).
[0185] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the various components shown or discussed can be through some interface, indirect coupling or communication connection between devices or units, which can be electrical, mechanical or other forms.
[0186] The units described above as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or distributed on multiple network units; part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.
[0187] In addition, each function unit in each embodiment of the present application can be integrated in one processing module, or each unit can be separately as one unit, or two or more units can be integrated in one unit; the integrated unit can be realized in the form of hardware or in the form of hardware plus software function unit. Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction related hardware, and the above-mentioned program can be stored in a computer readable storage medium, and the program executes the steps including the above-mentioned method embodiments when executed; and the above-mentioned storage medium includes mobile storage device, ROM, RAM, magnetic disc or optical disc and various storage program codes.
[0188] The methods disclosed in the several method embodiments provided by the present application can be combined arbitrarily without conflict to obtain new method embodiments.
[0189] The features disclosed in the several product embodiments provided by the present application can be combined arbitrarily without conflict to obtain new product embodiments.
[0190] The features disclosed in the several method or device embodiments provided by the present application can be combined arbitrarily without conflict to obtain new method embodiments or device embodiments.
[0191] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited to this, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A processing method comprising: synchronizing current configuration information of a first electronic device to at least one second electronic device after the first electronic device establishes a target connection with the second electronic device, the configuration information comprising multimedia data obtained by the first electronic device and information for processing the multimedia data; updating a processing parameter for processing the multimedia data based on a target input operation obtained by the second electronic device if the target input operation is obtained by the second electronic device; the target input operation being a configuration operation for the information for processing the multimedia data; outputting a multimedia data processing result based on the updated processing parameter.
2. The method of claim 1, wherein the establishing a target connection with at least one second electronic device comprises: running a target program, initializing a target service interface after accessing a target network, the target service interface being an interface for providing a target service in the target program to the second electronic device; receiving authentication information from the second electronic device after the at least one second electronic device accesses the target network; establishing the target connection with the second electronic device if the second electronic device passes authentication.
3. The method of claim 2, wherein the synchronizing current configuration information of the first electronic device to the second electronic device comprises: initializing a target configuration file based on the target program after accessing the target network, to process the obtained multimedia data based on the target configuration file; synchronizing information related to the multimedia data to the second electronic device through the target service interface after establishing the target connection, to output a configuration interface capable of operating the target configuration file in a target display area of the second electronic device.
4. The method of claim 3, wherein the obtaining a target input operation by the second electronic device comprises one of: if the second electronic device is unique, determining an input operation obtained by the second electronic device through the target service interface as the target input operation; if the second electronic device is not unique, determining an input operation meeting a corresponding condition from input operations obtained by multiple second electronic devices through the target service interface as the target input operation.
5. The method of claim 4, wherein the determining an input operation meeting a corresponding condition from input operations obtained by multiple second electronic devices through the target service interface as the target input operation comprises at least one of: obtaining time information of each of the input operations, and determining an input operation meeting a corresponding time condition as the target input operation; obtaining identification information of each of the second electronic devices, and determining an input operation obtained by a second electronic device matching target identification information as the target input operation; obtaining usage object information of each of the second electronic devices, and determining an input operation from a target usage object as the target input operation. obtaining input content of each of the input operations, and determining an input operation of target input content as the target input operation.
6. The method of claim 2, wherein the updating of the processing parameter for processing the multimedia data based on the target input operation comprises at least one of the following: analyzing the target input operation by the target service to obtain a target modification parameter, and updating a corresponding processing parameter for processing the multimedia data based on the target modification parameter, so as to process the multimedia data by using the updated processing parameter; analyzing the target input operation by the target service to obtain a target modification parameter, and updating a corresponding processing parameter for processing the multimedia data based on the target modification parameter, if the corresponding processing parameter item is allowed to be modified, so as to process the multimedia data by using the updated processing parameter.
7. The method of claim 3, further comprising at least one of the following: updating the target configuration file based on the target modification parameter corresponding to the target input operation; updating the target configuration file based on the target modification parameter, if the target modification parameter corresponding to the target input operation is used to modify a target processing parameter item; updating the target configuration file based on the target modification parameter corresponding to the target input operation, if the target input operation has a target permission.
8. The method of claim 1, wherein the outputting of the multimedia data processing result based on the updated processing parameter comprises at least one of the following: outputting target multimedia data obtained by processing the multimedia data based on the updated processing parameter to the at least one second electronic device; outputting target multimedia data obtained by processing the multimedia data based on the updated processing parameter to a target application; outputting target multimedia data obtained by processing the multimedia data based on the updated processing parameter to a corresponding output component of the first electronic device.
9. The method of any one of claims 1, 3-8, wherein the establishing of the target connection with the at least one second electronic device comprises at least one of the following: determining to establish the target connection with the at least one second electronic device, if it is determined that the at least one second electronic device accesses a network accessed by the first electronic device; determining to establish the target connection with the at least one second electronic device, if it is determined that the at least one second electronic device accesses a corresponding network through a specified network node, wherein the specified network node is a network node set by the first electronic device.
10. A processing apparatus, comprising: a synchronization unit configured to synchronize current configuration information of a first electronic device to at least one second electronic device after the first electronic device establishes a target connection with the at least one second electronic device, wherein the configuration information comprises multimedia data obtained by the first electronic device and information for processing the multimedia data; an updating unit configured to update a processing parameter for processing the multimedia data based on a target input operation obtained by the second electronic device. The target input operation is a configuration operation for processing information of the multimedia data; The output unit is configured to output a multimedia data processing result based on the updated processing parameters.
Citation Information
Patent Citations
Control method and system and electronic equipment
CN106254911A
Method for sharing data in local area network and electronic device
CN111066306A
Information processing method and related device
CN112383803A