Multi-conference-room synchronous interaction system and method

Abstract

The invention relates to the technical field of conference machines, in particular to a multi-conference-room synchronous interaction system and method.The multi-conference-room synchronous interaction system comprises a movable conference machine used for recognizing the position of a target spokesman and driving to the position of the target spokesman; and the control module is used for generating a path of the conference machine according to the position of the target spokesman and controlling the conference machine to move. The position of the target spokesman is recognized through the movable conference machine, and the control module generates the path of the conference machine according to the position of the target spokesman and controls the conference machine to move to the position of the target spokesman to collect voice or video. Therefore, the voice or video collection of the spokesman can be realized only through one conference machine, and the hardware cost is effectively reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of conference machine, in particular to a multi-conference room synchronous interaction system and method. BACKGROUND

[0002] Under the trend of digital office today, enterprises, institutions and other organizations have increasingly high requirements for meeting efficiency and collaboration effect. More and more enterprises frequently use large conference rooms to carry out important activities such as department meetings, quarterly meetings and cross-country meetings. However, the current traditional conference system exposes many problems and cannot meet people's pursuit of efficient, convenient and intelligent conference experience.

[0003] Under the background of modern remote office and increasingly frequent cross-regional collaboration, efficient development of large-scale remote meetings has become a key requirement for enterprises and institutions to improve communication efficiency. In the prior art, a conference machine system is disclosed, see https: / / www.kandaovr.com / zh / meeting-omni. The conference machine system represented by Kandao Meeting Omni can realize accurate face recognition and stable transmission of the video content of the speaker in large-scale remote meeting scenarios by deploying multiple video conference machines, and to some extent, meet the requirements of large meetings for information integrity and accuracy.

[0004] However, in actual conference application scenarios, many conference scenarios often only need to collect the speaking video of a single speaker, such as a special report meeting, a leader's speech meeting, etc. In such scenarios, the prior art still needs to arrange multiple video conference machines according to the standard of full coverage of large meetings. A single device not only integrates precise hardware components such as high-resolution image sensors, high-performance AI chips, multiple microphone arrays, but also is equipped with a high-precision clock synchronization module and a data transmission interface for realizing audio and video synchronization, and its own research and development, production and procurement cost is already not low. The large number of arrangements of multiple video conference machines makes the hardware cost too high.

[0005] In the scenario where multiple video conference machines are only needed to collect the speaking video of a single person, a large number of hardware resources are in idle state, and the functions such as 360° image collection and multi-region sound capture cannot be fully utilized, resulting in low resource utilization efficiency and great waste of resources. SUMMARY

[0006] In order to enable more detailed understanding of the features and technical contents of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure is described in detail below, and the attached drawings are only used for reference and do not limit the embodiments of the present disclosure. In the following technical description, in order to facilitate explanation, a plurality of details are provided to provide a full understanding of the disclosed embodiments. However, one or more embodiments can still be implemented without these details. In other cases, well-known structures and systems can be simplified to facilitate the drawings.

[0007] The following description and drawings are sufficient to illustrate specific embodiments of the present application to enable a person skilled in the art to practice them. Other embodiments can include structural, logical, electrical, process and other changes. The embodiments only represent possible changes. Unless specifically required, individual components and functions are optional, and the order of operation can be changed. Parts and features of some embodiments can be included or replaced by parts and features of other embodiments. The scope of the embodiments of the present application includes the entire scope of the claims, and all available equivalents of the claims. In this document, the embodiments can be individually or collectively referred to as the term "application" for convenience only, and if more than one application is actually disclosed, the scope of the application is not automatically limited to any single application or inventive concept. In this document, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not require or imply any actual relationship or order between the entities or operations. Moreover, the terms "include", "contain" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of additional identical elements in the process, method or device including the element. In this document, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between each embodiment are referred to each other. For the method, product and the like disclosed by the embodiments, since it corresponds to the method part disclosed by the embodiments, the description is relatively simple, and the relevant part is referred to the method part description.

[0008] The embodiments of the present disclosure provide a multi-conference room synchronous interaction system, characterized by comprising: A movable conference machine is used to identify the target speaker position and travel to the target speaker position. A control module is used to generate the path of the conference machine and control the movement of the conference machine according to the target speaker position.

[0009] Preferably, the multi-conference room synchronous interaction system further comprises: a limiting module for limiting the travel range of the conference machine; a camera for real-time shooting of the use environment of the conference machine.

[0010] Preferably, the camera is arranged at a high position to generate panoramic images of the use environment.

[0011] Preferably, the limiting module is a human-computer interaction system with input function.

[0012] Preferably, the limiting module is a fluorescent strip with identification function.

[0013] Preferably, the conference machine comprises a conference machine body and a moving system.

[0014] Preferably, the moving system comprises: a moving chassis, the bottom of the moving chassis is provided with a plurality of drive wheels, the drive wheels at least include two steerable drive wheels for realizing the forward movement, backward movement, turning and in-place rotation of the conference machine; a drive motor, the drive motor is in transmission connection with the drive wheels for providing power for the drive wheels, and the drive motor is in electrical connection with the control module for receiving the drive signal sent by the control module.

[0015] Preferably, the conference machine body comprises: a voice interaction module, the voice interaction module comprises a microphone array and a loudspeaker, the microphone array is used for collecting voice information of the surrounding environment, and the loudspeaker is used for playing voice prompt information and conference audio; the voice interaction module is in communication connection with the control module for realizing the voice interaction between the conference machine and the target speaker, receiving the voice instruction of the target speaker, and feeding back the execution result through voice.

[0016] The embodiments of the present disclosure further provide a multi-conference room synchronous interaction method applied to the control module of the multi-conference room synchronous interaction system, the method comprising: identifying the position of the target speaker; planning the path of the conference machine and controlling the movement of the conference machine according to the position of the target speaker; controlling the conference machine to travel to the position of the target speaker to collect information.

[0017] Preferably, the method applied to the control module of the multi-conference room synchronous interaction system with a defined module and a camera further comprises: acquiring a use environment of the conference machine; acquiring a driving range of the conference machine set in the use environment; acquiring a position of the conference machine in the use environment in real time; and planning a path of the conference machine and controlling the conference machine to move according to the target speaker position, including: planning the path of the conference machine and controlling the conference machine to move in real time according to the position of the conference machine in the use environment, the driving range and the target speaker position.

[0018] The multi-conference room synchronous interaction system and method provided by the embodiments of the present disclosure can recognize the target speaker position through the movable conference machine, and the control module can generate the path of the conference machine and control the conference machine to move to the target speaker position for voice or video collection according to the target speaker position. In this way, the voice or video of the speaker can be collected through only one conference machine, and the hardware cost is effectively reduced.

[0019] The foregoing general description and the following description are only exemplary and explanatory, and are not used to limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0020] One or more embodiments are exemplarily illustrated by corresponding drawings, which do not constitute limitation on the embodiments, elements with the same reference numerals in the drawings are shown as similar elements, the drawings do not constitute proportional limitation, and wherein: Figure 1 is a schematic diagram of a multi-conference room synchronous interaction system provided by the embodiments of the present disclosure; Figure 2 is a flow chart of a multi-conference room synchronous interaction method provided by the embodiments of the present disclosure; Figure 3 is a schematic diagram of another multi-conference room synchronous interaction system provided by the embodiments of the present disclosure; Figure 4 is a schematic diagram of selecting a driving range in a use environment of a shooting conference machine provided by the embodiments of the present disclosure; Figure 5 is a schematic diagram of another multi-conference room synchronous interaction system provided by the embodiments of the present disclosure.

[0021] Reference signs: 1: conference machine; 2: driving range. DETAILED DESCRIPTION

[0022] In order to enable a more detailed understanding of the features and technical content of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure is described in detail below with reference to the drawings, which are only used for reference and do not limit the embodiments of the present disclosure. In the following technical description, for the purpose of easy explanation, a plurality of details are provided to provide a full understanding of the disclosed embodiments. However, one or more embodiments can still be implemented without these details. In other cases, well-known structures and systems can be simplified to facilitate the drawings.

[0023] The following description and drawings are illustrative of specific embodiments of the application and are not intended to limit the scope of the application. Other embodiments can include structural, logical, electrical, process, and other changes. The embodiments are representative only. Individual components and functions are optional and the order of operations can change. Portions and features of some embodiments can be included or replaced in or by portions and features of other embodiments. The scope of embodiments of the application includes the entire scope of the claims and all available equivalents of the claims. In this document, the embodiments can be individually or collectively referred to as the "application" merely for convenience and are not intended to automatically limit the scope of the application to any single application or application concept if more than one application is in fact disclosed. In this document, relational terms such as first and second, and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual relationship or order between such entities or actions. Also, the terms "comprises", "comprising", or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by an "comprising" statement is not excluded from a process, method, article, or apparatus that includes the element, even when the same process, method, article, or apparatus includes other similar elements. Various embodiments are described in a progressive manner, each focusing on the differences from other embodiments, and the same or similar parts between embodiments are referred to each other. For the method, product, etc. disclosed by the embodiments, since it corresponds to the method part disclosed by the embodiments, the description is relatively simple, and the relevant part is referred to the method part description.

[0024] In addition, the terms "set", "connected", and "fixed" should be interpreted broadly. For example, "connected" can be fixed connection, detachable connection, or integral structure; can be mechanical connection, or electrical connection; can be direct connection, or indirect connection through an intermediate medium, or internal communication between two systems, elements or components. Those skilled in the art can understand the specific meaning of the above terms in the embodiments of the present disclosure according to the specific circumstances.

[0025] The multi-conference room synchronous interaction system provided by the embodiments of the present disclosure comprises a movable conference machine for identifying a target speaker position and driving to the target speaker position; and a control module for generating a path of the conference machine and controlling the conference machine to move according to the target speaker position. Figure 1 A schematic diagram of the multi-conference room synchronous interaction provided by the embodiments of the present disclosure.

[0026] The conference machine comprises a conference machine body and a moving system, and is a core device for realizing conference functions. The conference machine body is provided with a voice interaction module, which comprises a microphone array and a loudspeaker. The microphone array can collect voice information of the surrounding environment, and the loudspeaker is used to play voice prompt information and conference audio. Through communication connection with the control module, voice interaction between the conference machine and the target speaker is realized, voice instructions of the target speaker are received, and the execution result is fed back through voice. The moving system comprises a moving chassis and a driving motor. The moving chassis is provided with a plurality of driving wheels at the bottom, at least two of which are steerable driving wheels, which can realize the forward movement, backward movement, turning and rotation of the conference machine. The driving motor is in transmission connection with the driving wheels to provide power for the driving wheels, and is in electrical connection with the control module to receive the driving signal sent by the control module, so as to move according to the planned path. The movable conference machine can identify the target speaker position and drive to the position to provide close conference service for the speaker and realize accurate information collection.

[0027] The control module is used for generating a path of the conference machine and controlling the conference machine to move according to the target speaker position. The control module receives information from the conference machine and other related devices, uses a preset algorithm and strategy to plan an optimal driving path, and ensures that the conference machine can efficiently and accurately reach the target speaker position. The conference machine can be arranged on a conference table or on the ground. The control module exists independently as a system, or can be arranged in the conference machine.

[0028] In actual application, the speaker can say a prompt word as a signal. The conference machine identifies the signal as a criterion for determining the target speaker position. For example, the speaker says "I want to speak", and the conference machine identifies the target speaker position of the speaker, and then drives to the corresponding target speaker position.

[0029] Correspondingly, referring to Figure 2 A multi-conference room synchronous interaction method is disclosed in the embodiments of the present disclosure. The method is applied to the control module in the conference room synchronous interaction system, and comprises the following steps: S100, identifying a target speaker position.

[0030] S200, planning a path of the conference machine and controlling the conference machine to move according to the target speaker position.

[0031] S300, controlling the conference machine to travel to the target speaker position and collect information.

[0032] It should be understood that the conference machine sends the target speaker position to the control module after identifying the target speaker position. The control module controls the conference machine to travel to the target speaker position according to the relative position of the conference machine and the target speaker position.

[0033] Further, in a preferred embodiment, referring to Figure 3 Another schematic diagram of the multi-conference room synchronous interaction method is provided in the embodiments of the present disclosure. The multi-conference room synchronous interaction system comprises: A movable conference machine 1 is used to identify a target speaker position and travel to the target speaker position.

[0034] A control module is used to generate a path of the conference machine 1 and control the conference machine 1 to move according to the target speaker position.

[0035] A limiting module is used to limit the travel range 2 of the conference machine 1. The limiting module can be a human-computer interaction system with input function, such as a mobile phone or a computer. Referring to Figure 4 A schematic diagram of selecting the travel range 2 in the use environment of the conference machine 1 is provided. The speaker can select a range in the use environment of the conference machine 1 as the travel range 2 of the conference machine 1 through the human-computer interaction system. Wherein, Figure 4 The use environment in the camera is to shoot the entire conference picture.

[0036] A camera is used to shoot the use environment of the conference machine 1 in real time. The camera is arranged at a high position. Preferably, the number of cameras is multiple. In this way, a panoramic image of the use environment can be generated.

[0037] Correspondingly, referring to Figure 5 The embodiments of the present disclosure disclose a multi-conference room synchronous interaction method. The method is applied to the control module of the multi-conference room synchronous interaction system with a limiting module and a camera, and comprises the following steps: S100, obtaining a target speaker position.

[0038] S200, obtaining the use environment of the conference machine 1.

[0039] It should be understood that the use environment of the conference machine 1 is for the camera shooting at a high place, and sending to the control module.

[0040] S300, obtaining the driving range 2 in which the conference machine 1 is set.

[0041] It should be understood that referring to Figure 4 , the speaker inputs a range as the driving range 2 of the conference machine 1 through the human-computer interaction system. The movement of the conference machine 1 cannot drive out of the driving range 2.

[0042] S400, obtaining the position of the conference machine 1 in the use environment in real time.

[0043] It should be understood that the conference machine 1 is moved into the driving range 2, and the camera collects the position of the conference machine 1 in the use environment in real time. In actual application, the control module can recognize the conference machine 1 through image recognition of the outline of the conference machine 1. Alternatively, a recognition symbol is arranged on the conference machine 1, and the control module recognizes the position of the conference machine 1 through the recognition symbol of the conference machine 1. For example, a fluorescent circle sticker.

[0044] S500, planning the path of the conference machine 1 and controlling the movement of the conference machine 1 in real time according to the position of the conference machine 1 in the use environment, the driving range 2 and the position of the target speaker.

[0045] It should be understood that the optimal or better driving path is calculated by comprehensively considering the current position of the conference machine 1, the limitation of the driving range 2 and the position of the target speaker. In Figure 4 , the speaker is the second from the right. The conference machine 1 will come to the nearest position of the speaker in the driving range 2 as the end point of the driving path.

[0046] S600, controlling the conference machine 1 to drive to the position of the target speaker to collect information.

[0047] In another preferred embodiment, the limiting module is a fluorescent strip as a recognition mark, which is pasted on the edge of the driving range of the conference machine as the boundary of the driving range. The control module recognizes the fluorescent strip as the boundary of the driving range.

[0048] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this invention is for descriptive purposes only and is not intended to limit the claims. As used in the description of the embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or,” as used herein, refers to any and all possible combinations of one or more of the associated listed elements. Additionally, when used in this invention, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprising a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0049] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, units, and processes described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0050] The computer program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other processing device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other processing device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

Claims

1. A multi-conference room synchronous interactive system, characterized in that: The application relates to a conference machine, a control module, a limiting module and a camera. The conference machine is movable and is used for identifying a target speaker position and driving to the target speaker position. The control module is used for generating a path of the conference machine according to the target speaker position and controlling the conference machine to move.

2. The multi-conference room synchronous interaction system of claim 1, wherein: The application further relates to a limiting module and a camera. The limiting module is used for limiting a driving range of the conference machine. The camera is used for capturing a use environment of the conference machine in real time.

3. The multi-conference room synchronous interaction system of claim 1, wherein: The camera is arranged at a high position and generates a panoramic image of the use environment.

4. The multi-conference room synchronous interaction system of claim 1, wherein: The limiting module is a human-computer interaction system with an input function.

5. The multi-conference room synchronous interaction system of claim 1, wherein: The limiting module is a fluorescent strip with an identification function.

6. The multi-conference room synchronous interaction system of claim 1, wherein: The conference machine comprises a conference machine body and a moving system.

7. The multi-conference room synchronous interaction system of claim 6, wherein: The moving system comprises: a moving chassis, the moving chassis is provided with a plurality of driving wheels at the bottom, the driving wheels at least include two steerable driving wheels, which are used for realizing forward movement, backward movement, steering and in-place rotation of the conference machine; a driving motor, the driving motor is in transmission connection with the driving wheels and is used for providing power for the driving wheels, and the driving motor is in electrical connection with the control module and receives a driving signal sent by the control module.

8. The multi-conference room synchronous interaction system of claim 6, wherein: The conference machine body comprises: a voice interaction module, the voice interaction module comprises a microphone array and a loudspeaker, the microphone array is used for collecting voice information of a surrounding environment, and the loudspeaker is used for playing voice prompt information and conference audio; the voice interaction module is in communication connection with the control module and is used for realizing voice interaction between the conference machine and a target speaker, receiving a voice instruction of the target speaker and feeding back an execution result through voice.

9. A method for multi-conference room synchronous interaction, the method comprising: The application relates to a control module applied to a conference room synchronous interaction system, and a method, the method comprises the following steps: acquiring a target speaker position; planning a path of a conference machine according to the target speaker position and controlling the conference machine to move; controlling the conference machine to drive to the target speaker position and collect information.

10. The multi-conference room synchronous interaction method of claim 9, wherein: The application relates to a control module applied to a multi-conference room synchronous interaction system with a limiting module and a camera, and a method, the method further comprises the following steps: acquiring a use environment of the conference machine; acquiring a driving range of the conference machine in the use environment; acquiring a position of the conference machine in the use environment in real time; wherein the step of planning the path of the conference machine according to the target speaker position and controlling the conference machine to move comprises the following step: planning the path of the conference machine according to the position of the conference machine in the use environment, the driving range and the target speaker position and controlling the conference machine to move.

Images