Conference terminal control method, device, equipment and medium

Abstract

The invention relates to the technical field of paperless conferences, in particular to a conference terminal control method and device, equipment and a medium. The method comprises the following steps: acquiring biological characteristic information of each participating user reported by target terminal equipment, and acquiring environment perception information of a target conference area; acquiring initial state information of the conference terminal; and determining target pose information of the conference terminal according to the biological feature information, the environmental perception information and the initial state information, so as to adjust the pose of the conference terminal according to the target pose information. According to the method, the biological characteristic factor, the environmental factor and the real-time state factor of the conference terminal are comprehensively considered, so that the target pose information can be obtained based on the factors, and the pose of the conference terminal, namely the screen, can be adaptively adjusted based on the factors in the conference proceeding process; therefore, each participant can watch the screen of the conference terminal comfortably, and the experience feeling of the participant in a paperless conference is improved.

Description

Background Art

[0002] The paperless conference system is an intelligent conference interaction system based on a local area network, a private network or a mobile Internet. By applying communication technology, audio technology, video technology and software technology, it realizes the paperless of the conference through the electronic exchange of documents. When participating in a paperless conference, participants usually need to bring their own mobile devices such as tablets and laptops and place them on the conference table to record the conference content. However, the height of the conference table is often fixed, which results in the fixed height of the mobile devices. Participants cannot adjust the height, screen angle, etc. of the conference terminal according to their actual needs, bringing a lot of inconvenience during the paperless conference, and reducing the participation experience of participants in the face of a long paperless conference. Summary of the Invention

[0003] The present application provides a method, device, equipment and medium for controlling a conference terminal to solve one or more technical problems existing in the prior art, and at least provide a beneficial choice or create conditions.

[0004] Other features and advantages of the present application will become apparent through the following detailed description, or be learned in part through the practice of the present application.

[0005] According to one aspect of the embodiments of the present application, a method for controlling a conference terminal is provided, which is applied to a conference control system. The conference control system includes a controller, a target terminal device, an environment perception device and a conference terminal. The controller is respectively connected to the target terminal device, the environment perception device and the conference terminal. The method is executed on the controller and includes: Obtain the biometric information of each participating user reported by the target terminal device, and obtain the environment perception information of the target conference area reported by the environment perception device; Obtain the initial state information of the conference terminal; Determine the target pose information of the conference terminal according to the biometric information, the environment perception information and the initial state information, so as to adjust the pose of the conference terminal according to the target pose information; Wherein, each of the participating users is within the target conference area.

[0006] In an embodiment of the present application, based on the foregoing solution, the participating users include a first user sitting on a seat and a second user not sitting on a seat; the target terminal device includes a first terminal device and a second terminal device arranged in the target conference area. The obtaining of the biometric information of each participating user reported by the target terminal device includes: Obtain the first biometric information of the first user collected by the first terminal device, and obtain the second biometric information of the second user collected by the second terminal device; Obtain the biometric information based on the first biometric information and the second biometric information.

[0007] In an embodiment of the present application, based on the foregoing solution, the environment perception device includes a temperature and humidity detection device, a light sensor, and a color contrast sensor. The obtaining of the environment perception information of the target meeting area reported by the environment perception device includes: Obtain the temperature and humidity information of the target meeting area collected by the temperature detection device; Obtain the brightness information of the target meeting area collected by the light sensor; Obtain the color contrast information of the target meeting area collected by the color contrast sensor; Determine the environment perception information based on the temperature and humidity information, the brightness information, and the color contrast information.

[0008] In an embodiment of the present application, based on the foregoing solution, the obtaining of the initial state information of the meeting terminal includes: Obtain the backlight rate information, power information, and screen brightness information of the meeting terminal; Obtain the initial state information based on the backlight rate information, the power information, and the screen brightness information.

[0009] In an embodiment of the present application, based on the foregoing solution, the determining of the target pose information of the meeting terminal according to the biometric information, the environment perception information, and the initial state information includes: Generate a first feature vector for controlling the meeting terminal according to the biometric information; Generate a second feature vector for controlling the meeting terminal according to the environment perception information; Generate a third feature vector for controlling the meeting terminal according to the initial state information; Perform feature fusion on the first feature vector, the second feature vector, and the third feature vector to obtain a feature fusion vector; Determine the target pose information according to the feature fusion vector; Wherein, the second feature vector is obtained by performing feature fusion on the temperature and humidity information, the brightness information, and the color contrast information, and the third feature information is obtained by performing feature fusion on the backlight rate information, the power information, and the screen brightness information

[0010] In one embodiment of the present application, based on the foregoing solution, generating the first feature vector for controlling the conference terminal according to the biometric information includes: Determining the first facial expression information, sitting posture information, first voice command information, first heart rate information, and first gesture command information of the first user according to the first biometric information; Determining the second facial expression information, standing posture information, second voice command information, second heart rate information, and second gesture command information of the second user according to the second biometric information; Generating facial feature fusion information according to the first facial expression information and the second facial expression information; Generating pose feature fusion information according to the sitting posture information and the standing posture information; Generating voice feature fusion information according to the first voice command information and the second voice command information; Generating heart rate feature fusion information according to the first heart rate information and the second heart rate information; Generating gesture feature fusion information according to the first gesture command information and the second gesture command information; Performing feature fusion on the facial feature fusion information, the pose feature fusion information, the voice feature fusion information, the heart rate feature fusion information, and the gesture feature fusion information to obtain the first feature vector.

[0011] In one embodiment of the present application, based on the foregoing solution, the method further includes: Determining the first brightness adjustment information of the conference terminal according to the voice feature fusion information and the gesture feature fusion information; Determining the second brightness adjustment information of the conference terminal according to the brightness information and the color contrast information; Determining the third brightness adjustment information of the conference terminal according to the backlight rate information, the power information, and the screen brightness information; Determining the target brightness information of the conference terminal according to the first brightness adjustment information, the second brightness adjustment information, and the third brightness adjustment information, so as to adjust the brightness of the conference terminal according to the target brightness information.

[0012] According to one aspect of the embodiments of the present application, there is provided a conference terminal control device, which is applied to a conference control system. The conference control system includes a controller, a target terminal device, an environment perception device, and a conference terminal. The controller is respectively connected to the target terminal device, the environment perception device, and the conference terminal. The device includes: A first acquisition unit, configured to acquire biometric information of each participating user reported by the target terminal device, and acquire environmental perception information of a target meeting area reported by the environmental perception device; A second acquisition unit, configured to acquire initial state information of the conference terminal; An adjustment unit, configured to determine target pose information of the conference terminal according to the biometric information, the environmental perception information, and the initial state information, so as to adjust the pose of the conference terminal according to the target pose information; Wherein, each of the participating users is within the target meeting area.

[0013] According to one aspect of the embodiments of the present application, an electronic device is provided, including: one or more processors; a memory for storing executable instructions of the processors, and when the executable instructions are executed by the one or more processors, the one or more processors are caused to implement the method as described in the above embodiments.

[0014] According to one aspect of the embodiments of the present application, the embodiments of the present application provide a computer-readable storage medium, where the storage medium stores a computer program, and the computer program is executed by a processor to implement the method as described in the above embodiments.

[0015] The beneficial effects of the present application are as follows: By acquiring the biometric information of each participating user reported by the target terminal device and the environmental perception information of the target meeting area reported by the environmental perception device, and then determining the target pose information of the conference terminal according to the biometric information, the environmental perception information, and the initial state information of the conference terminal, the pose of the conference terminal can be adjusted to the pose corresponding to the target pose information. The present application comprehensively considers biometric factors, environmental factors, and the real-time state factors of the conference terminal, so that the target pose information can be obtained based on the above factors, and then during the conference, the pose of the conference terminal, that is, the screen of the conference terminal, can be adaptively adjusted based on the above factors, so that each participating user can more comfortably view the screen of the conference terminal, improving the experience of the participating users during the paperless conference. Description of the Drawings

[0016] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly describe the drawings required for the description of the embodiments. Obviously, the described drawings are only a part of the embodiments of the present application, rather than all the embodiments. Those skilled in the art can also obtain other design solutions and drawings based on these drawings without creative efforts.

[0017] Figure 1 It is a flowchart of a conference terminal control method shown according to an embodiment of the present application; Figure 2 It is a schematic diagram of a target meeting area shown according to an embodiment of the present application; Figure 3 It is a block diagram of a conference terminal control device shown according to an embodiment of the present application; Figure 4 It is a schematic diagram of the system structure of an electronic device shown according to an embodiment of the present application. Detailed implementation manners

[0018] Now, example embodiments will be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more complete and comprehensive, and will fully convey the concept of the example embodiments to those skilled in the art.

[0019] In addition, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present application. However, those skilled in the art will realize that the technical solutions of the present application can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, well-known methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the present application.

[0020] The block diagrams shown in the drawings are only functional entities and do not necessarily correspond to physically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or micro-control node devices.

[0021] The flowcharts shown in the drawings are only illustrative and do not necessarily include all the content and operations / steps, nor do they necessarily need to be executed in the described order. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to the actual situation.

[0022] It should be noted that: "a plurality of" mentioned herein means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after.

[0023] The following provides a detailed introduction to the conference control system proposed in the embodiments of the present application: The target terminal device proposed in the embodiments of the present application includes a first terminal device and a second terminal device disposed in a target meeting area. The first terminal device is used to collect first biometric information of a first user sitting on a seat, and the second terminal device is used to collect second biometric information of a second user not sitting on a seat (such as standing, squatting, etc.). Then both the first terminal device and the second terminal device include wearable sensors, imaging devices, and voice receiving devices. The wearable sensors are used to detect the heart rate information of the participants, the imaging devices are used to detect the sitting posture information, standing posture information, first facial expression information, second facial expression information, first gesture instruction information, and second gesture instruction information of the participating users, and the voice receiving devices are used to detect the first voice instruction information and the second voice instruction information of the participants.

[0024] The meeting terminal in the embodiments of the present application has functions such as rising, pausing, descending, adjusting the front and rear elevation angles, function switching, signal switching, multimedia conference terminal switch buttons, USB interfaces, etc. The environment perception device includes a temperature and humidity detection device, a light sensor, and a color contrast sensor. The temperature and humidity detection device is a temperature sensor and a humidity sensor.

[0025] The implementation details of the technical solutions in the embodiments of the present application are elaborated in detail below: According to an aspect of the embodiments of the present application, a meeting terminal control method is provided, which is applied to a meeting control system. The meeting control system includes a controller, a target terminal device, an environment perception device, and a meeting terminal. The controller is respectively connected to the target terminal device, the environment perception device, and the meeting terminal. This meeting terminal control method is executed on the controller. Figure 1 FIG. is a flowchart of the meeting terminal control method shown according to the embodiments of the present application. This method includes at least steps S1 to S3, which are introduced in detail as follows: In step S1, obtain the biometric information of each participating user reported by the target terminal device, and obtain the environment perception information of the target meeting area reported by the environment perception device, where each of the participating users is in the target meeting area.

[0026] Specifically, the participating users include a first user sitting on a seat and a second user not sitting on a seat; the target terminal devices include a first terminal device and a second terminal device disposed in the target meeting area. Considering the situation in a paperless meeting where there are many participating users, resulting in some participating users having no seats, or some participating users being accustomed to standing, squatting halfway or other postures to participate in the paperless meeting, by differentiating such situations, the participating users are divided into a first user sitting on a seat and a second user not sitting on a seat. Therefore, it is necessary to correspondingly set a first terminal device to obtain the first biometric information of the first user and correspondingly set a second terminal device to obtain the second biometric information of the second user.

[0027] In an embodiment of the present application, the environment perception device includes a temperature and humidity detection device, a light sensor, and a color contrast sensor. The obtaining of the environment perception information of the target meeting area reported by the environment perception device includes: Obtaining the temperature and humidity information of the target meeting area collected by the temperature detection device; Obtaining the brightness information of the target meeting area collected by the light sensor; Obtaining the color contrast information of the target meeting area collected by the color contrast sensor; Determining the environment perception information according to the temperature and humidity information, the brightness information, and the color contrast information.

[0028] Specifically, the environment perception information of the target meeting area is obtained through the environment perception device, where the environment perception information includes the temperature and humidity information, the brightness information, and the color contrast information of the target meeting area, etc. Considering the biometric information and the environment perception information as influencing factors of the target pose information, the influence of the biometric information of each participating user and the environment perception information of the target meeting area can be comprehensively considered, so that the finally determined target pose information can be adaptively adjusted according to these influencing factors, enabling the pose of the meeting terminal to be adaptively adjusted for the convenience of viewing by each participating user.

[0029] In step S2, the initial state information of the meeting terminal is obtained.

[0030] Specifically, the obtaining of the initial state information of the meeting terminal includes: Obtaining the backlight rate information, the power information, and the screen brightness information of the meeting terminal; Obtaining the initial state information according to the backlight rate information, the power information, and the screen brightness information.

[0031] The initial state information of the conference terminal itself can be obtained through sensors or sensing systems built into the conference terminal. When the conference terminal is in different poses, that is, when the screen angle and screen height of the conference terminal are different in different situations, its backlight rate information, power information, and screen brightness information will all affect the viewing of participating users. Therefore, by using information such as backlight rate information, power information, and screen brightness information as influencing factors for the target pose information, the conference terminal can be adjusted to a suitable pose, that is, the target pose information, so that each participating user can clearly and conveniently view the screen of the conference terminal.

[0032] In step S3, the target pose information of the conference terminal is determined based on the biometric information, the environmental perception information, and the initial state information, so as to adjust the pose of the conference terminal according to the target pose information.

[0033] Specifically, the embodiments of the present application fully consider the influencing factors brought by each object in the target conference area. Each object is a participating user and a conference terminal, and combines the environmental factors of the target conference area (that is, the environmental perception information described in the present application), so that the finally determined target pose information can facilitate each participating user to clearly view the screen of the conference terminal. At the same time, the target brightness information of the conference terminal can also be determined through the biometric information, the environmental perception information, and the initial state information. For example, if the brightness of the conference terminal in the initial state information is relatively dim and the participating users cannot clearly view the content displayed on the screen, then at this time, the brightness of the conference terminal is adjusted through the target brightness information to brighten the screen, so that each participating user can more clearly view the screen of the conference terminal, thereby ensuring the participation quality of the paperless conference.

[0034] In an embodiment of the present application, the determining the target pose information of the conference terminal according to the biometric information, the environmental perception information, and the initial state information includes: Generating a first feature vector for controlling the conference terminal according to the biometric information; Generating a second feature vector for controlling the conference terminal according to the environmental perception information; Generating a third feature vector for controlling the conference terminal according to the initial state information; Performing feature fusion on the first feature vector, the second feature vector, and the third feature vector to obtain a feature fusion vector; Determining the target pose information according to the feature fusion vector; Wherein, the second feature vector is obtained by performing feature fusion through the temperature and humidity information, the brightness information, and the color contrast information, and the third feature information is obtained by performing feature fusion through the backlight rate information, the power information, and the screen brightness information.

[0035] Specifically, a first feature vector for controlling the conference terminal is generated according to the biometric information, so that the generated first feature vector can fully reflect the influencing factors brought by the biometric information. Similarly, a second feature vector for controlling the conference terminal is generated according to the environmental perception information, so that the generated second feature vector can fully consider the influencing factors brought by the environmental perception information. At the same time, a third feature vector for controlling the conference terminal is generated according to the initial state information, so that the generated third feature vector can fully consider the influencing factors brought by the conference terminal itself.

[0036] In an embodiment of the present application, the generating a first feature vector for controlling the conference terminal according to the biometric information includes: Determining first facial expression information, sitting posture information, first voice command information, first heart rate information, and first gesture command information of the first user according to the first biometric information; Determining second facial expression information, standing posture information, second voice command information, second heart rate information, and second gesture command information of the second user according to the second biometric information; Generating facial feature fusion information according to the first facial expression information and the second facial expression information; Generating pose feature fusion information according to the sitting posture information and the standing posture information; Generating voice feature fusion information according to the first voice command information and the second voice command information; Generating heart rate feature fusion information according to the first heart rate information and the second heart rate information; Generating gesture feature fusion information according to the first gesture command information and the second gesture command information; Performing feature fusion on the facial feature fusion information, the pose feature fusion information, the voice feature fusion information, the heart rate feature fusion information, and the gesture feature fusion information to obtain the first feature vector.

[0037] Specifically, the biometric information includes facial expression information, voice command information, heart rate information, gesture command information, standing posture information, sitting posture information, etc. of the participating users. In this application, the first facial expression information, sitting posture information, first voice command information, first heart rate information, and first gesture command information are used as the first biometric information of the first user, and the second facial expression information, standing posture information, second voice command information, second heart rate information, and second gesture command information are used as the second biometric information of the second user, so as to distinguish between sitting and non-sitting participating users.

[0038] The conference user can fine-tune the position of the conference terminal through voice commands, gesture commands, etc., that is, adjust the screen position and angle of the conference terminal. If the current screen position and angle of the conference terminal are not convenient for the conference user A to watch, the user A may stretch his neck to watch, which will cause the user A's heart rate to increase and his facial expression to be more tense. The biometric information of the user A generated can be used to adjust the target position information of the conference terminal, so as to adjust it to a viewing angle and position suitable for the user A.

[0039] In one embodiment of the present application, the method further includes: Determining first brightness adjustment information of the conference terminal according to the voice feature fusion information and the gesture feature fusion information; Determining second brightness adjustment information of the conference terminal according to the brightness information and the color contrast information; Determine third brightness adjustment information of the conference terminal according to the backlight rate information, the power information and the screen brightness information; The target brightness information of the conference terminal is determined according to the first brightness adjustment information, the second brightness adjustment information, and the third brightness adjustment information, so as to adjust the brightness of the conference terminal according to the target brightness information.

[0040] Specifically, in addition to the need to adjust the posture of the conference terminal, the screen brightness of the conference terminal is also one of the factors affecting the comfort of each participating user. Therefore, by fully considering the voice feature fusion information and the gesture feature fusion information, the brightness information and the color contrast information, as well as the backlight rate information, the power information and the screen brightness information, the target brightness information of the conference terminal is comprehensively generated. The target brightness information obtained is suitable for viewing by most participating users.

[0041] See also Figure 2 As shown, Figure 2 This is an internal schematic diagram of an exemplary target conference area, in which the first user is a participant sitting in a chair, and the second user is a participant standing. At this time, the above method logic can be used to control the position, brightness and other information of the conference terminal to facilitate the viewing of the participants, while also improving the experience of the participants in paperless meetings.

[0042] In an embodiment of the present application, if position change information of any participating user is detected (such as position exchange, changing from a first sitting user to a second standing user, changing from a second standing user to a first sitting user, etc.), then the above steps S1 - S3 will be repeated according to the position change information to generate pose adjustment information of the conference terminal, so that the target pose information of the conference terminal can be updated in a timely manner according to the pose adjustment information, adapting to the position changes of the participating users, thereby improving the experience and comfort of the participating users when participating in a paperless meeting.

[0043] According to one aspect of the embodiments of the present application, a conference terminal control device 300 is proposed, as Figure 3 shown, Figure 3 which is a block diagram of the conference terminal control device 300. The conference terminal control device 300 includes a first acquisition unit 301, a second acquisition unit 302, and an adjustment unit 303.

[0044] The first acquisition unit 301 is configured to acquire biometric information of each participating user reported by the target terminal device, and acquire environmental perception information of the target conference area reported by the environmental perception device; The second acquisition unit 302 is configured to acquire the initial state information of the conference terminal; The adjustment unit 303 is configured to determine the target pose information of the conference terminal according to the biometric information, the environmental perception information, and the initial state information, so as to adjust the pose of the conference terminal according to the target pose information; Wherein, each of the participating users is within the target conference area.

[0045] As another aspect, the present application also provides a computer-readable storage medium, on which a program product capable of implementing the method provided above in this specification is stored. In some possible implementation manners, various aspects of the present application can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary embodiments of the present application described in the "Embodiment Method" section above in this specification.

[0046] The program product for implementing the above method according to the embodiments of the present application can be a portable compact disc read-only memory (CD-ROM) and includes program code, and can run on a terminal device, such as a personal computer. However, the program product of the present application is not limited thereto. In this document, the readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, apparatus, or device.

[0047] The program product may employ any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the readable storage medium (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0048] The computer-readable signal medium may include a data signal propagated as part of a carrier wave in a baseband, which carries the readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than the readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device.

[0049] The program code contained on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0050] The program code for performing the operations of this application may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and also including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computing device, partially on the user's device, as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0051] As another aspect, this application also provides an electronic device capable of implementing the above method.

[0052] Those skilled in the art can understand that various aspects of the present application can be implemented as a system, a method, or a program product. Therefore, various aspects of the present application can be specifically implemented in the following forms, that is, a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation combining hardware and software aspects, which can be collectively referred to as "circuits", "modules", or "systems" here.

[0053] Reference is now made to Figure 4 to describe the electronic device 400 according to this embodiment of the present application. Figure 4 The illustrated electronic device 400 is merely an example and should not impose any limitation on the functions and usage scope of the embodiments of the present application.

[0054] As Figure 4 shown, the electronic device 400 is presented in the form of a general-purpose computing device. The components of the electronic device 400 may include, but are not limited to: at least one of the above-mentioned processing units 410, at least one of the above-mentioned storage units 420, and a bus 430 connecting different system components (including the storage unit 420 and the processing unit 410).

[0055] Among them, the storage unit stores program code, and the program code can be executed by the processing unit 410, so that the processing unit 410 executes the steps according to various exemplary embodiments of the present application described in the "Embodiment Method" section of the present specification above.

[0056] The storage unit 420 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 421 and / or a cache storage unit 422, and may further include a read-only storage unit (ROM) 423.

[0057] The storage unit 420 may further include a program / utility 424 having a set (at least one) of program modules 425. Such program modules 425 include, but are not limited to: an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include the implementation of a network environment.

[0058] The bus 430 may represent one or more of several types of bus structures, including a storage unit bus or a storage unit control node, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0059] The electronic device 400 can also communicate with one or more external devices 1200 (such as a keyboard, a pointing device, a Bluetooth device, etc.), and can also communicate with one or more devices that enable a user to interact with the electronic device 400, and / or communicate with any device that enables the electronic device 400 to communicate with one or more other computing devices (such as a router, a modem, etc.). Such communication can be carried out through the input / output (I / O) interface 450. Moreover, the electronic device 400 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 460. As shown in the figure, the network adapter 460 communicates with other modules of the electronic device 400 through the bus 430. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in combination with the electronic device 400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0060] Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software, or can be implemented by the way of software combined with necessary hardware. Therefore, the technical solutions according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0061] In addition, the above drawings are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present application, rather than for limiting purposes. It is easy to understand that the processes shown in the above drawings do not indicate or limit the time sequence of these processes. Additionally, it is also easy to understand that these processes can be executed synchronously or asynchronously in multiple modules.

[0062] It should be understood that the present application is not limited to the exact structure described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.

Claims

1. A conference terminal control method, characterized in that: Applied to a conference control system, the conference control system includes a controller, a target terminal device, an environment sensing device and a conference terminal, the controller is connected to the target terminal device, the environment sensing device and the conference terminal respectively, the method is executed in the controller, and the method includes: Acquire biometric information of each conference participant reported by the target terminal device, and acquire environmental perception information of the target conference area reported by the environmental perception device; Acquiring initial status information of the conference terminal; Determining target position information of the conference terminal according to the biometric information, the environment perception information and the initial state information, so as to adjust the position of the conference terminal according to the target position information; Wherein, each of the participating users is in the target conference area.

2. The conference terminal control method according to claim 1, characterized in that: The participating users include a first user who is in a seat and a second user who is not in a seat; the target terminal device includes a first terminal device and a second terminal device that are set in the target conference area, and the biometric information of each participating user reported by the target terminal device is obtained, including: Acquire first biometric information of the first user collected by the first terminal device, and acquire second biometric information of the second user collected by the second terminal device; The biometric information is obtained according to the first biometric information and the second biometric information [JQ1].

3. The conference terminal control method according to claim 2, characterized in that: The environment perception device includes a temperature and humidity detection device, a light sensor, and a color contrast sensor. The step of obtaining the environment perception information of the target meeting area reported by the environment perception device includes: Acquiring temperature and humidity information of the target meeting area collected by the temperature detection device; Acquire brightness information of the target meeting area collected by the light sensor; Acquire color contrast information of the target conference area collected by the color contrast sensor; The environmental perception information is determined according to the temperature and humidity information, the brightness information, and the color contrast information.

4. The conference terminal control method according to claim 3, characterized in that: The obtaining of the initial status information of the conference terminal includes: Obtaining backlight rate information, power information, and screen brightness information of the conference terminal; The initial state information is obtained according to the backlight rate information, the power information and the screen brightness information.

5. The conference terminal control method according to claim 4, characterized in that: The determining the target position information of the conference terminal according to the biometric information, the environmental perception information and the initial state information includes: generating a first feature vector for controlling the conference terminal according to the biometric information; generating a second feature vector for controlling the conference terminal according to the environmental perception information; generating a third feature vector for controlling the conference terminal according to the initial state information; Performing feature fusion on the first feature vector, the second feature vector, and the third feature vector to obtain a feature fusion vector; Determine the target pose information according to the feature fusion vector; Among them, the second feature vector is obtained by feature fusion of the temperature and humidity information, the brightness information and the color contrast information, and the third feature information is obtained by feature fusion of the backlight rate information, the power information and the screen brightness information.

6. The conference terminal control method according to claim 5, characterized in that: The step of generating a first feature vector for controlling the conference terminal according to the biometric information includes: Determining first facial expression information, sitting posture information, first voice command information, first heart rate information, and first gesture command information of the first user according to the first biometric information; Determining second facial expression information, standing posture information, second voice command information, second heart rate information, and second gesture command information of the second user according to the second biometric information; generating facial feature fusion information according to the first facial expression information and the second facial expression information; Generate posture feature fusion information according to the sitting posture information and the standing posture information; Generate voice feature fusion information according to the first voice command information and the second voice command information; generating heart rate feature fusion information according to the first heart rate information and the second heart rate information; generating gesture feature fusion information according to the first gesture instruction information and the second gesture instruction information; The facial feature fusion information, the posture feature fusion information, the voice feature fusion information, the heart rate feature fusion information and the gesture feature fusion information are subjected to feature fusion to obtain the first feature vector.

7. The conference terminal control method according to claim 6, characterized in that: The method further comprises: Determining first brightness adjustment information of the conference terminal according to the voice feature fusion information and the gesture feature fusion information; Determining second brightness adjustment information of the conference terminal according to the brightness information and the color contrast information; Determine third brightness adjustment information of the conference terminal according to the backlight rate information, the power information and the screen brightness information; The target brightness information of the conference terminal is determined according to the first brightness adjustment information, the second brightness adjustment information, and the third brightness adjustment information, so as to adjust the brightness of the conference terminal according to the target brightness information.

8. A conference terminal control device, characterized in that: Applied to a conference control system, the conference control system includes a controller, a target terminal device, an environment sensing device and a conference terminal, the controller is connected to the target terminal device, the environment sensing device and the conference terminal respectively, and the device includes: A first acquisition unit is used to acquire biometric information of each participating user reported by the target terminal device, and acquire environmental perception information of the target conference area reported by the environmental perception device; A second acquiring unit, configured to acquire initial state information of the conference terminal; An adjustment unit, configured to determine target position information of the conference terminal according to the biometric information, the environment perception information and the initial state information, so as to adjust the position of the conference terminal according to the target position information; Wherein, each of the participating users is in the target conference area.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program code, and the at least one program code is loaded and executed by a processor to implement the operations performed by the method according to any one of claims 1 to 7.

10. An electronic device, characterized in that: The electronic device includes one or more processors and one or more memories, wherein the one or more memories store at least one program code, and the at least one program code is loaded and executed by the one or more processors to implement the operations performed by the method according to any one of claims 1 to 7.

Images