A shared camera control method, system, conference terminal and readable medium

Abstract

The present invention relates to the field of camera management, and in particular to a shared camera control method, system, conference terminal and readable medium. A shared camera control method, applied to a conference terminal, comprises: in response to a predetermined working state, turning on a virtual camera; determining a target shared camera in one or more mobile terminals based on the virtual camera, and building a data transmission channel with the target shared camera; obtaining the video stream data transmitted by the target shared camera through the virtual camera for use as shooting data. When a predetermined working state occurs during use of the conference terminal, the virtual camera will be used to build a data transmission channel with the target shared camera, so that the shooting task can be completed through the target shared camera, automatically, with low manual participation, greatly improving the efficiency of camera use, and improving user experience.

Description

Technical Field

[0001] The present invention relates to the field of camera management, and in particular to a shared camera control method, system, conference terminal and readable medium. Background Art

[0002] With the development of society and the advancement of technology, large conference screens are becoming increasingly important in business meetings, especially for remote meetings. However, it is not uncommon for cameras to fail to work (for example, due to damage), making it impossible to conduct the meeting normally. Summary of the Invention

[0003] In view of the above-mentioned shortcomings of the existing technology, the purpose of the present invention is to provide a shared camera control method, system, conference terminal and readable medium. Based on the situation mentioned in the background technology, a shared camera is developed. You only need to connect to the corresponding shared camera to use the camera function in the conference terminal, thereby improving the utilization rate of the equipment.

[0004] In order to achieve the above object, the present invention adopts the following technical solutions:

[0005] In one aspect, the present invention provides a shared camera control method, applied to a conference terminal, comprising:

[0006] In response to a predetermined working state, opening a virtual camera;

[0007] Determining a target shared camera in one or more mobile terminals based on the virtual camera, and establishing a data transmission channel with the target shared camera;

[0008] The video stream data transmitted by the target shared camera is obtained through the virtual camera and used as shooting data.

[0009] Furthermore, the process of building a data transmission channel includes:

[0010] Obtain the device information of the target shared camera through mDNS;

[0011] The data transmission channel is established between the target shared camera based on the RTSP protocol.

[0012] Furthermore, before obtaining the device information of the target shared camera through mDNS, the method further includes:

[0013] One or more mobile terminals are connected to the mDNS server; and the conference terminal obtains the device information of the target shared camera through the mDNS server.

[0014] Furthermore, after the data transmission channel is successfully established, the method further includes:

[0015] Sending request data to the target shared camera; so that the target shared camera opens the camera permission to the conference terminal based on the request data.

[0016] Furthermore, the operations for obtaining the target shared camera include:

[0017] Broadcasting the first information externally; causing one or more mobile terminals to feedback handshake data after receiving the first information; the handshake data including image data captured by the mobile terminal through the local camera;

[0018] Comparing the clarity of all received image data;

[0019] The mobile terminal corresponding to the image data with the highest definition is selected as the target shared camera.

[0020] Furthermore, obtaining the video stream data transmitted by the target shared camera and using it as shooting data specifically includes:

[0021] Receiving coded data sent by the target shared camera; the coded data is obtained by encoding the video stream data by the target shared camera;

[0022] The encoded data is transcoded to obtain the video stream data.

[0023] Furthermore, the predetermined working state includes a first working state indicating that the quality of the captured image is lower than a predetermined value, a second working state indicating that the physical camera cannot work, and a third working state indicating that a camera adjustment instruction has been received;

[0024] Receiving a camera adjustment instruction specifically includes:

[0025] Respond to the handshake command sent by the target shared camera and obtain the device information of the corresponding target shared camera through the mDNS server;

[0026] Receive an adjustment instruction sent by the target shared camera, and perform a camera replacement operation according to the adjustment instruction.

[0027] In another aspect, the present invention provides a shared camera control system, comprising:

[0028] A response module, configured to open a virtual camera in response to a predetermined working state;

[0029] a channel construction module, configured to determine a target shared camera in one or more mobile terminals based on the virtual camera, and to construct a data transmission channel with the target shared camera;

[0030] The data transmission module is used to obtain the video stream data transmitted by the target shared camera through the virtual camera and use it as shooting data.

[0031] In another aspect, the present invention provides a conference terminal, comprising:

[0032] a memory storing a computer program;

[0033] A processor implements any of the shared camera control methods when executing the computer program.

[0034] On the other hand, the present invention provides a computer-readable medium, characterized in that it stores a computer program, and when the computer program is executed by a processor, it implements any of the shared camera control methods described above.

[0035] Compared with the prior art, the shared camera control method, system, conference terminal, and readable medium provided by the present invention have the following beneficial effects:

[0036] Using the shared camera control method provided by the present invention, when a conference terminal enters a predetermined working state during use, a virtual camera will be used to build a data transmission channel with the target shared camera. In this way, the shooting task can be completed through the target shared camera automatically with low manual participation, which greatly improves the efficiency of camera use and enhances the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 This is a flow chart of the shared camera control method provided by the present invention.

[0038] Figure 2 This is a structural block diagram of the shared camera control system provided by the present invention.

[0039] Figure 3 This is a network structure diagram of the shared camera control system provided by the present invention. DETAILED DESCRIPTION

[0040] In order to make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0041] Those skilled in the art will understand that the foregoing general description and the following detailed description are exemplary and illustrative of specific embodiments of the present invention and are not intended to limit the present invention.

[0042] As used herein, the terms "comprises," "comprising," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps may include not only those steps but may also include other steps not expressly listed or inherent to such process or method. Similarly, a reference to one or more devices or subsystems, elements or structures or components preceded by "comprising ... a" does not, without further limitations, preclude the presence of other devices or other subsystems or other elements or other structures or other components or other devices or other subsystems or other elements or other structures or other components. Throughout this specification, appearances of the phrases "in one embodiment," "in another embodiment," and similar language may, but do not necessarily, all refer to the same embodiment.

[0043] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0044] See also Figure 1 and Figure 3 The present invention provides a shared camera control method, which is applied to a conference terminal. The conference terminal includes basic functional modules for conference work, including a display screen, a speaker, a processing module, and a camera. The shared camera control method provided by the present invention is mainly used when the camera of the conference terminal fails, and specifically includes:

[0045] S1. In response to a predetermined working state, open the virtual camera; specifically, the predetermined working state generally refers to a situation where the camera fails, so that once the camera fails, the virtual camera can be automatically opened to connect to the device end that can share the camera.

[0046] Furthermore, as a preferred solution, in this embodiment, the predetermined working state includes a first working state indicating that the quality of the captured image is lower than a predetermined value, a second working state indicating that the physical camera cannot work, and a third working state indicating that a camera adjustment instruction has been received; that is, when the above three states occur, it means that the camera of the current conference terminal is in an abnormal state and needs to use a shared camera to work.

[0047] Receiving a camera adjustment instruction specifically includes:

[0048] Respond to the handshake command sent by the target shared camera and obtain the device information of the corresponding target shared camera through the mDNS server;

[0049] Receive the adjustment instruction sent by the target shared camera, and execute the camera replacement operation according to the adjustment instruction. Furthermore, the target shared camera sends instructions in two ways: one-key triggering (i.e., there is a function button in the target shared camera, which, once pressed, triggers the handshake instruction, so that the conference terminals within the predetermined range can receive the handshake instruction) and proximity triggering (i.e., by bringing the predetermined position of the target shared camera close to the predetermined position of the conference terminal, a handshake interaction can be achieved, and the handshake instruction is transmitted to the conference terminal), so as to achieve fast and automatic adjustment of the camera.

[0050] S2. Determine a target shared camera in one or more mobile terminals based on the virtual camera, and establish a data transmission channel with the target shared camera; that is, in this embodiment, the target shared camera is a target device selected from multiple mobile terminals, and the mobile terminals include smart devices such as mobile phones and tablets, and can also be dedicated shared cameras.

[0051] Furthermore, as a preferred solution, in this embodiment, the process of establishing the data transmission channel includes:

[0052] Obtain the device information of the target shared camera through mDNS;

[0053] The data transmission channel is constructed between the target shared camera and the RTSP protocol. In this embodiment, the overall system is deployed based on a C / S structure. Based on the same network, the target shared camera can provide a connection port based on the conference large screen platform and publish the mDNS service to the outside world, so that other platform (Windows, Mac, Linux) clients can discover the shared camera device of the published mDNS. The mDNS service published by the target shared camera server contains the following information: host IP address, mac address, and device version number information. The conference terminal discovers the target shared camera device through mDNS (network discovery service), and then queries the information carried by the device through mDNS, initiates a network connection, and supports the use of TCP / UDP based on the RTSP protocol (see attached figure). UDP is used by default to transmit data.

[0054] S3. Obtaining the video stream data transmitted by the target shared camera through the virtual camera for use as shooting data.

[0055] Furthermore, as a preferred solution, in this embodiment, obtaining the video stream data transmitted by the target shared camera and using it as shooting data specifically includes:

[0056] Receiving coded data sent by the target shared camera; the coded data is obtained by encoding the video stream data by the target shared camera;

[0057] The encoded data is transcoded to obtain the video stream data. When the data transmission channel constructed is negotiated using the RTSP protocol, data transmission can be carried out. The server encodes the original data (NV12, NV21, etc.) of the camera into YUV420 and sends it back to the conference terminal. The client decodes the YUV420 data, converts it into NV12 data format and provides it to the virtual camera (Softcam) for screen display. The virtual camera can be used for any software that requires a camera (such as Tencent Conference). The virtual camera connected based on the MDSN discovery service generates encoding using original data (NV12 / NV21) to YUV420, and decoding uses YUV420 to NV12, which is conducive to data transmission.

[0058] Using the shared camera control method provided by the present invention, when a conference terminal enters a predetermined working state during use, a virtual camera will be used to build a data transmission channel with the target shared camera. In this way, the shooting task can be completed through the target shared camera automatically with low manual participation, which greatly improves the efficiency of camera use and enhances the user experience.

[0059] Furthermore, as a preferred solution, in this embodiment, before obtaining the device information of the target shared camera through mDNS, the following steps are further included:

[0060] Connect one or more mobile devices to an mDNS server; the conference terminal uses the mDNS server to obtain the device information of the target shared camera. This means that by pre-connecting multiple mobile devices to the mDNS server, the corresponding device information can be quickly obtained. The conference terminal can then use the server to transmit data to and from the mobile devices and quickly change the shared camera to record video.

[0061] Furthermore, as a preferred solution, in this embodiment, after the data transmission channel is successfully established, the following is further included:

[0062] Sending request data to the target shared camera; so that the target shared camera grants camera permissions to the conference terminal based on the request data. This embodiment is designed for smart devices such as mobile phones. That is, the smart device must grant corresponding functional permissions before the conference terminal can use it, which fully ensures the security of the smart device.

[0063] Furthermore, as a preferred solution, in this embodiment, the operation of obtaining the target shared camera includes:

[0064] Broadcasting the first information externally; causing one or more mobile terminals to feedback handshake data after receiving the first information; the handshake data including image data captured by the mobile terminal through the local camera;

[0065] Compare the clarity of all received image data; specifically, the method for comparing the clarity of the image data is not limited in the present invention, and a clarity comparison method commonly used in the art can be used.

[0066] The mobile terminal corresponding to the image data with the highest definition is selected as the target shared camera. That is, in this embodiment, the mobile terminal with the highest definition is selected as the target shared camera to ensure the optimality of the data collected by the conference terminal.

[0067] Accordingly, see Figure 2 The present invention also provides a shared camera control system, comprising:

[0068] A response module, configured to open a virtual camera in response to a predetermined working state;

[0069] a channel construction module, configured to determine a target shared camera in one or more mobile terminals based on the virtual camera, and to construct a data transmission channel with the target shared camera;

[0070] The data transmission module is used to obtain the video stream data transmitted by the target shared camera through the virtual camera and use it as shooting data.

[0071] Accordingly, the present invention further provides a conference terminal, comprising:

[0072] a memory storing a computer program;

[0073] A processor implements any of the shared camera control methods when executing the computer program.

[0074] Correspondingly, the present invention also provides a computer-readable medium storing a computer program, wherein the computer program implements any of the above-mentioned shared camera control methods when executed by a processor.

[0075] More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fibers, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0076] In this application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof.

[0077] It is understandable that those skilled in the art can make equivalent substitutions or changes based on the technical solution and inventive concept of the present invention, and all these changes or substitutions should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A shared camera control method, characterized in that: Applicable to conference terminals, including: In response to a predetermined working state, opening the virtual camera; the predetermined working state includes one of a first working state indicating that the quality of the captured image is lower than a predetermined value, a second working state indicating that the physical camera is unable to work, and a third working state indicating that a camera adjustment instruction has been received; Based on the virtual camera, a target shared camera is determined in one or more mobile terminals, and a data transmission channel is established with the target shared camera. The target shared camera can provide a connection port and publish an mDNS service on the conference large screen platform, so that the conference terminals can discover the shared camera device published by the mDNS. The process of establishing the data transmission channel includes: obtaining device information of the target shared camera through mDNS; and establishing the data transmission channel with the target shared camera based on the RTSP protocol. The method of obtaining, through the virtual camera, video stream data transmitted by the target shared camera and using it as shooting data includes: The virtual camera receives the encoded data sent by the target shared camera; the encoded data is obtained by encoding the video stream data by the target shared camera; the encoded data is transcoded by YUV420 to obtain NV12 video stream data, and the video stream data is used for the virtual camera to display the picture.

2. The shared camera control method according to claim 1, wherein: Before obtaining the device information of the target shared camera through mDNS, the following steps are also included: One or more mobile terminals are connected to the mDNS server; and the conference terminal obtains the device information of the target shared camera through the mDNS server.

3. The shared camera control method according to claim 1, wherein: After the data transmission channel is successfully established, the method further includes: Sending request data to the target shared camera; so that the target shared camera opens the camera permission to the conference terminal based on the request data.

4. The shared camera control method according to claim 1, wherein: The operations for obtaining the target shared camera include: Broadcasting the first information externally; so that one or more mobile terminals feedback handshake data after receiving the first information; The handshake data includes image data captured by the mobile terminal through the local camera; Comparing the clarity of all received image data; The mobile terminal corresponding to the image data with the highest definition is selected as the target shared camera.

5. The shared camera control method according to claim 1, wherein: The predetermined working state includes a first working state indicating that the quality of the captured image is lower than a predetermined value, a second working state indicating that the physical camera cannot work, and a third working state indicating that a camera adjustment instruction has been received; Receiving a camera adjustment instruction specifically includes: Respond to the handshake command sent by the target shared camera and obtain the device information of the corresponding target shared camera through the mDNS server; Receive an adjustment instruction sent by the target shared camera, and perform a camera replacement operation according to the adjustment instruction.

6. A shared camera control system, characterized in that: include: A response module, configured to open a virtual camera in response to a predetermined working state; The predetermined working state includes one of a first working state indicating that the quality of the captured image is lower than a predetermined value, a second working state indicating that the physical camera cannot work, and a third working state indicating that a camera adjustment instruction has been received; A channel construction module is used to determine a target shared camera in one or more mobile terminals based on the virtual camera and establish a data transmission channel with the target shared camera. The target shared camera can provide a connection port and publish an mDNS service externally based on the conference large screen platform, so that the conference terminals can discover the shared camera device published by the mDNS; The process of establishing the data transmission channel includes: obtaining the device information of the target shared camera through mDNS; establishing the data transmission channel between the target shared camera based on the RTSP protocol; A data transmission module, configured to obtain the video stream data transmitted by the target shared camera through the virtual camera and use it as shooting data, including: The virtual camera receives the encoded data sent by the target shared camera; the encoded data is obtained by encoding the video stream data by the target shared camera; the encoded data is transcoded by YUV420 to obtain NV12 video stream data, and the video stream data is used for the virtual camera to display the picture.

7. A conference terminal, characterized in that: include: a memory storing a computer program; The processor implements the shared camera control method described in any one of claims 1-5 when executing the computer program.

8. A computer-readable medium, characterized in that A computer program is stored, and when the computer program is executed by a processor, the shared camera control method described in any one of claims 1-5 is implemented.

Images