Intelligent conference robot device and method for replacing personnel to participate in conference

Abstract

The invention discloses an intelligent conference robot device and method for replacing personnel to participate in a conference. The method comprises the steps that a remote control terminal is used for connecting and controlling an intelligent conference robot located on a conference site; the intelligent conference robot collects audios and videos of a conference site in real time and transmits the audios and videos to the remote control terminal for real-time playing; and the remote control terminal transmits audio and video signals of the remote participants to the intelligent conference robot in real time to be displayed on a conference site. According to the invention, the remote control terminal is used for controlling the intelligent conference robot on the conference site to replace the intelligent conference robot to participate in the conference, displaying the head portraits / 3D modeling digital persons / video pictures of the participants, carrying out conference site communication, providing immersive personalized conference experience, and improving the effect of the on-site conference.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent conference robots, and in particular to an intelligent conference robot device and method for replacing human conference attendees. Background Art

[0002] Many activities and meetings are held in the form of on-site meetings. Sometimes, some people cannot attend the meeting on site. The current practice is for people who cannot attend the meeting on site to attend the meeting remotely through video conferencing. In this case, for other participants on site, they lack the experience of remote participants attending the meeting in person, making it difficult to achieve the expected results of the on-site meeting. Summary of the invention

[0003] In view of the above-mentioned defects, the technical problem to be solved by the present invention is to provide an intelligent conference robot device that can replace human attendance at meetings, so as to solve the problem in the prior art that people who are unable to attend meetings on site participate in meetings remotely through video conferencing, while other on-site participants lack the conference experience of real-person attendance.

[0004] To this end, a first aspect of an embodiment of the present application provides a method for replacing a person to attend a meeting, comprising the following steps:

[0005] Use the remote control terminal to connect and control the intelligent conference robot at the conference site;

[0006] The intelligent conference robot collects audio and video from the conference site in real time and transmits them to the remote control terminal. The remote control terminal plays the audio and video signals from the conference site in real time and displays the audio and video playback of the conference site to remote participants.

[0007] The remote control terminal collects the audio and video signals of the remote participants in real time and sends them to the intelligent conference robot located at the conference site. The intelligent conference robot displays the audio and video signals of the remote participants to the participants at the conference site.

[0008] Based on the above technical solutions, this application uses a remote control terminal to control the intelligent conference robot at the meeting site, displays the avatars / 3D modeled digital people / video images of the participants, and conducts on-site communication at the meeting through remote audio and video transmission, thereby achieving the purpose of replacing on-site attendance. For other participants at the site, it provides an immersive and personalized meeting experience, thereby improving the effectiveness of on-site meetings.

[0009] In the above technical solution, preferably, the remote conference participants can also control the movement and rotation of the intelligent conference robot through the remote control terminal. In this implementation, the real experience of the intelligent conference robot attending the conference on behalf of people is further improved.

[0010] In the above technical solution, preferably, the intelligent conference robot is also provided with a screen projection module, which can project the image on the display screen of the robot end to a large screen at the conference site for display.

[0011] In the above technical solution, preferably, the remote control terminal establishes a connection with the intelligent conference robot by inputting the ID number and password of the intelligent conference robot and scanning the code, which is easy to use.

[0012] In the above technical solution, preferably, the intelligent conference robot is also provided with an automatic obstacle avoidance module to ensure the safety of itself and the surrounding environment.

[0013] A second aspect of the embodiments of the present application provides an intelligent conference robot device for replacing human participants in a conference, including:

[0014] A smart base, which is provided with a moving component for driving the smart base to move;

[0015] The robot-side microphone and camera are used to collect audio and video signals at the conference site in real time;

[0016] The robot-side display screen and the robot-side speaker are used to play the audio and video signals of remote participants in real time;

[0017] Image transmission module, used to transmit the audio and video signals of the conference site to the remote control terminal;

[0018] The control module is used to control the movement of the smart base according to the control instructions received from the remote control terminal; and is used to control the image transmission module to transmit the audio and video signals of the conference site and play the audio and video signals of the remote participants.

[0019] In the above technical solution, preferably, the smart base is provided with a base camera, a laser radar and an automatic obstacle avoidance module, and the automatic obstacle avoidance module controls the movement of the mobile component according to the detection signals of the base camera and the laser radar.

[0020] In the above technical solution, preferably, the movement includes translation and rotation.

[0021] In the above technical solution, preferably, the intelligent conference robot is also provided with a screen projection module for projecting the image on the display screen of the robot end onto a large screen at the conference site for display.

[0022] In the above technical solution, preferably, the smart base is also provided with a battery and a power management module for supplying power to the smart conference robot and performing battery power management.

[0023] It can be seen from the above technical solutions that the intelligent conference robot device and method for replacing human participants provided by the present invention solves the problem that people who cannot attend the meeting on site in the prior art participate in the meeting remotely through video conferencing, and other on-site participants lack the experience of meeting with real people. Compared with the prior art, the present invention has the following beneficial effects:

[0024] Use the remote control terminal to control the intelligent conference robot at the meeting site to replace the participants, display the avatars / 3D modeled digital people / video images of the participants, conduct on-site communication at the meeting, provide an immersive and personalized meeting experience, and improve the effectiveness of the on-site meeting. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces and describes the drawings required for use in the embodiments of the present invention or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0026] Figure 1 A flow chart of a method for replacing a person to attend a meeting provided in an embodiment of the present invention;

[0027] Figure 2 This is a system architecture diagram of an intelligent conference robot device for replacing human attendees provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0028] The following will be combined with the accompanying drawings of the embodiments of the present invention to clearly and completely describe the technical solutions of the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0029] In order to more clearly explain and illustrate the technical solution and implementation of the present invention, several preferred specific embodiments for implementing the technical solution of the present invention are introduced below.

[0030] It should be noted that the directional words such as "inside, outside", "front, back" and "left, right" in this article are expressed based on the product usage status. Obviously, the use of the corresponding directional words does not constitute a limitation on the protection scope of this scheme.

[0031] For on-site meetings, it is inevitable that some people will be unable to arrive at the meeting site to attend the meeting. The current practice is that those who are unable to attend the meeting on-site participate remotely through video conferencing. In this case, for other on-site participants, the meeting experience of remote participants in person is lacking, and it is difficult to fully achieve the expected results of the on-site meeting.

[0032] This application utilizes an intelligent conference robot to replace on-site participants in the meeting, and can speak on behalf of remote participants, which can provide other participants with a real-person conference experience and improve the effectiveness of on-site meetings.

[0033] The present application provides a method for using an intelligent conference robot to replace a person to attend a conference, comprising the following steps:

[0034] Step 110: Use a remote control terminal to connect to the intelligent conference robot located at the conference site.

[0035] In this step, the remote participants use the remote control terminal to connect to the intelligent conference robot at the conference site through the network, obtain control of the intelligent conference robot, and control the intelligent conference robot to participate in the on-site meeting, such as moving, turning, speaking, etc.

[0036] Among them, the remote control terminal can be a PC, PAD, mobile phone and other devices, and a connection with the intelligent conference robot can be established by entering the ID number and password of the intelligent conference robot, scanning the code, etc.

[0037] Step 120: The intelligent conference robot collects audio and video of the conference site in real time and transmits them to the remote control terminal through the network. The remote control terminal plays the audio and video of the conference site in real time and displays the audio and video signals of the conference site to the remote participants. Therefore, the remote participants can watch the audio and video of the conference site in real time and understand the progress of the conference site.

[0038] Specifically, the intelligent conference robot is provided with a robot-side microphone and a robot-side camera, which use the robot-side microphone and the robot-side camera to collect audio and video of the conference site in real time, and transmit the collected audio and video of the conference site to the remote control terminal through the network module.

[0039] The remote control terminal is equipped with a remote display screen and a remote speaker, through which the audio and video of the conference site are played in real time.

[0040] Step 130, the remote control terminal collects the audio and video signals of the remote participants in real time and sends them to the intelligent conference robot located at the conference site. The intelligent conference robot displays the audio and video signals of the remote participants to the participants at the conference site.

[0041] Specifically, the remote control terminal is equipped with a remote microphone and a remote camera, which collect the audio and video signals of remote participants in real time and send them to the intelligent conference robot at the conference site through the network module. The intelligent conference robot is equipped with a robot-side display screen and a robot-side speaker, which play the audio and video signals of remote participants through the robot-side display screen and the robot-side speaker to realize the on-site conference function.

[0042] In this application, the intelligent conference robot also has a screen projection function, which can project the screen on the robot's display to the large screen at the conference site, so that every participant at the conference site can clearly see the remote participants. The screen at the conference site can also be projected to the robot's display, which is convenient for some participants in the back row who are blocked to watch closely without having to stand up, turn their heads, etc. to affect the order of the venue.

[0043] In the above steps, remote participants can also control the movement and rotation of the intelligent conference robot through the remote control terminal to provide a better meeting experience.

[0044] For example, when a remote participant needs to speak, the remote participant can control the intelligent conference robot to move in front of the on-site participants (on the podium), turn around to face the on-site participants, and play the audio and video of the remote participant.

[0045] Specifically, virtual operation buttons or operation handles may be set on the remote control terminal, and the design may refer to the virtual control buttons or game handles in the game scene, and no limitation is made here. For example, taking the virtual operation buttons as an example, four direction keys and a rotation button may be set, and the four direction keys are used to control the front, back, left, and right movement of the remote control terminal. Pressing the corresponding direction key can control the intelligent conference robot to move in the corresponding direction. Pressing the rotation button and sliding left and right (or up and down) can control the intelligent conference robot to turn left or right.

[0046] In this application, the intelligent conference robot is also equipped with an automatic obstacle avoidance module, which can realize the automatic obstacle avoidance function during movement to ensure the safety of itself and the surrounding environment.

[0047] Specifically, the mobile base of the intelligent conference robot is equipped with a base camera, a laser radar and a mobile component. The base camera and the laser radar are used to detect obstacles (people, tables and chairs, etc.) in the moving direction and automatically avoid them.

[0048] According to the above description, the present application provides an intelligent conference robot device for replacing human participants, such as Figure 2 As shown, the intelligent conference robot device for replacing human participants in the conference includes:

[0049] Host 10, host 10 is based on SOC chip, SOC chip can adopt ARM architecture or X86 architecture, SOC chip motherboard has built-in DDR memory, SSD storage, WIFI module, 4G / 5G module, SOC chip is used as a control module to control the operation of the intelligent conference robot.

[0050] The intelligent base 20 is provided with a base camera 21, a laser radar 22 and a moving component 23. The base camera 21 and the laser radar 22 are used to detect obstacles in the moving direction, and the moving component 23 is used to drive the intelligent base 20 to move, including moving and rotating. The intelligent base 20 is also provided with a battery and power management module 24, which is used to supply power to the intelligent conference robot and manage battery power. The automatic obstacle avoidance module on the control module is used to realize the automatic obstacle avoidance function to ensure the safety of itself and the surrounding environment.

[0051] The robot-side microphone 31 and the robot-side camera 32 are used to collect audio and video signals at the conference site in real time.

[0052] The robot-side display screen 33 and the robot-side speaker 34 are used to play the audio and video signals of the remote participants in real time.

[0053] The image transmission module 35 is used to transmit the audio and video signals of the conference site to the remote control terminal.

[0054] The control module is used to control the movement and rotation of the intelligent base according to the control instructions received from the remote control terminal. The control module is also used to control the robot-side network module to transmit the audio and video signals of the conference site, and to play the audio and video signals of the remote participants.

[0055] Based on the description of the above specific embodiments, the intelligent conference robot device for replacing human participants provided by the present invention has the following advantages compared with the prior art:

[0056] First, the intelligent conference robot can be controlled by remote participants through a remote control terminal, transmit the audio and video signals of the conference site to the remote control terminal, and play the audio and video signals of the remote participants, replacing the remote participants to participate in the on-site meeting, giving other participants at the conference site the experience of real-life participants and improving the meeting effect.

[0057] Second, the intelligent conference robot can be controlled by remote participants in terms of translation and rotation, which enhances the sense of reality and participation of substitute participants and further improves the experience of substitute participants.

[0058] Third, the intelligent conference robot can be easily connected to the remote control terminal through username + password or scanning code, and can realize the function of attending meetings on behalf of others under the control of the remote control terminal, which is easy to use.

[0059] Finally, it should be noted that the terms "comprises", "includes" or any other variants thereof as used herein are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0060] The present invention is not limited to the above-mentioned optimal implementation mode. Anyone should be aware that any structural changes made under the inspiration of the present invention, and any technical solutions that are the same or similar to the present invention, fall within the protection scope of the present invention.

Claims

1. A method for replacing a person to attend a meeting, characterized in that: The following steps are involved: Use the remote control terminal to connect and control the intelligent conference robot at the conference site; The intelligent conference robot collects audio and video from the conference site in real time and transmits them to the remote control terminal. The remote control terminal plays the audio and video signals from the conference site in real time and displays the audio and video playback of the conference site to remote participants. The remote control terminal collects the audio and video signals of the remote participants in real time and sends them to the intelligent conference robot located at the conference site. The intelligent conference robot displays the audio and video signals of the remote participants to the participants at the conference site.

2. The method according to claim 1, characterized in that Remote participants can also control the movement and rotation of the intelligent conference robot through the remote control terminal.

3. The method according to claim 1, characterized in that The intelligent conference robot is also equipped with a screen projection module, which can project the images on the robot's display screen to the large screen at the conference site.

4. The method according to claim 1, characterized in that: The remote control terminal establishes a connection with the intelligent conference robot by inputting the ID number and password of the intelligent conference robot and scanning the code.

5. The method according to claim 1, characterized in that The intelligent conference robot also has an automatic obstacle avoidance module.

6. An intelligent conference robot device for replacing human participants in a conference, characterized in that: include: A smart base, which is provided with a moving component for driving the smart base to move; The robot-side microphone and camera are used to collect audio and video signals at the conference site in real time; The robot-side display screen and the robot-side speaker are used to play the audio and video signals of remote participants in real time; Image transmission module, used to transmit the audio and video signals of the conference site to the remote control terminal; A control module, used to control the movement of the smart base according to the control instructions received from the remote control terminal; And it is used to control the image transmission module to transmit the audio and video signals of the conference site, and play the audio and video signals of remote participants.

7. The device according to claim 6, characterized in that The smart base is provided with a base camera, a laser radar and an automatic obstacle avoidance module, and the automatic obstacle avoidance module controls the movement of the mobile component according to the detection signals of the base camera and the laser radar.

8. The device according to claim 7, characterized in that The movement includes translation and rotation.

9. The device according to claim 6, characterized in that The intelligent conference robot is also provided with a screen projection module for projecting the images on the display screen of the robot end onto a large screen at the conference site for display.

10. The device according to claim 6, characterized in that The smart base is also provided with a battery and a power management module for supplying power to the smart conference robot and performing battery power management.

Images