A conference method and device using trajectory simulation interaction technology
Through distributed conference network and trajectory simulation technology, users' speech requests are captured and displayed, which solves the problem of insufficient user requests and interactivity in multimedia conferences, and achieves efficient demonstration and interactive improvement.
Patent Information
- Application Number
- CN202410490549.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-23
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-04-23
AI Technical Summary
In multimedia conferences, due to the large number of users attending and insufficient interaction between sub-venues, each user's meeting request cannot be taken into account, and the demonstration effect is poor and the interaction is poor.
Trajectory simulation interaction technology is used to capture the user's speech request signal through a distributed conference network, distinguish between the master and slave meeting places, and determine whether the user triggers a speech event based on location information, automatically display the content selected by the user, and enhance interactivity.
It improves the demonstration effect and interactivity of multimedia conferences, enhances the interactive experience between participants, has a high degree of automation, and reduces misidentification.
Smart Images

Figure CN118368276B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field related to smart conferences, and in particular to a conference method and device using trajectory simulation interaction technology. Background Art
[0002] Multimedia conferencing refers to the use of various forms of media technology to conduct remote or face-to-face meetings. These media can include text, audio, video, images, etc., in order to communicate and exchange with participants. Multimedia conferencing is usually connected through the Internet or a dedicated network and implemented using specific software or platforms.
[0003] Since multimedia conferences may involve a large number of participants, and the conference may be jointly participated in by multiple different sub-conference rooms via the Internet, it is often impossible to take into account the meeting requests of each participant, and it is difficult for each sub-venue to form effective interaction with the main venue, and the demonstration effect is also insufficient. Summary of the invention
[0004] The purpose of the present invention is to solve at least one of the deficiencies of the prior art and to provide a conference method and device using trajectory simulation interaction technology.
[0005] In order to achieve the above object, the present invention adopts the following technical solutions:
[0006] Specifically, a conference method using trajectory simulation interaction technology is proposed, including the following:
[0007] Identify all conference participants, treat any conference participant as a sub-node, and build a distributed conference network with all sub-nodes;
[0008] Capture the user's speech request signal in real time and define the user with the speech request signal as a potential speaker;
[0009] Conducting a confirmed speech inquiry for all potential speech users, and defining the potential speech users who receive a response to the confirmed speech inquiry as confirmed speech users;
[0010] The conference participant at the subnode where the speaking user is located is defined as the main conference site, and the remaining conference participants are defined as secondary conference sites;
[0011] Continuously acquiring the location information of the determined speaking user, and judging whether the determined speaking user triggers a speaking event based on the location information;
[0012] If a speech event is triggered, the content selected by the user who is determined to speak is demonstrated at the conference site through trajectory simulation technology. If a speech event is not triggered, an alarm is given.
[0013] Furthermore, the method further comprises:
[0014] Obtain parameter and angle adjustment requests from the conference venue, and adjust the demonstration scene in the conference venue according to the parameter and angle adjustment requests.
[0015] Further, specifically, the method of capturing the user's speech request signal includes:
[0016] Select 3 key points on any arm of each user, the key points are located at the wrist, elbow and shoulder respectively;
[0017] Determine the user's arm stretch by continuously acquiring the relative position relationship between the three key points;
[0018] When the degree of stretching of the user's arm changes within a preset time interval, it is determined that the user has sent a speech request signal.
[0019] Further, specifically, the user's arm stretch degree is determined by continuously acquiring the relative position relationship between the three key points, including:
[0020] By setting the KineMt body sensor at the key point position of the user to obtain the real-time position coordinates of the key point;
[0021] Define the coordinates of three key points: K(x1, y1, z1) represents the elbow key point, L(x2, y2, z2) represents the shoulder key point, and M(x3, y3, z3) represents the wrist key point;
[0022] Calculate the following parameters,
[0023] KL vector = LK = ((x2-x1), (y2-y1), (z2-z1)) = (X1, Y2, Z1);
[0024] KM vector = MK = ((x3-x1), (y3-y1), (z3-z1)) = (X2, Y2, Z2);
[0025] The dot product between the KL vector and the KM vector V = KL*KM = (X1*X2)+(Y1*Y2)+(Z1*Z3);
[0026] The modulus of the KL vector
[0027] The modulus of the KM vector
[0028] Calculate the angle between the KL vector and the KM vector COSɑ = V / (|KL|*|KM|);
[0029] Calculate ɑ=arccos((COSɑ)) by inverse trigonometric function;
[0030] By converting radians and angles, we can get θ=ɑ*180 / π;
[0031] θ is used to represent the degree of arm extension of the user.
[0032] Further, specifically, the method of determining whether the degree of stretching of the user's arm changes at a preset time interval includes:
[0033] The θ value collected at the starting endpoint of the preset time interval is recorded as θ1;
[0034] The θ value collected at the end point of the preset time interval is recorded as θ2;
[0035] When the value of θ2-θ1 is greater than the stretch threshold, it means that the stretch degree of the user's arm jumps at a preset time interval.
[0036] Further, specifically, judging whether the speaking user triggers a speaking event based on the location information includes:
[0037] Designate presentation areas in the meeting room for each conference participant;
[0038] When a user is determined as a confirmed speaker, the location information of the confirmed speaker is continuously obtained within a set time period;
[0039] Counting a first time duration during which the location information of the speaking user is within a first distance from the demonstration area within the set time duration, if a ratio of the first time duration to the set time duration is greater than the first ratio, it indicates that the speaking user is suspected to be in place;
[0040] At this time, the acceleration modulus of the speaking user is obtained. If the acceleration modulus is less than the first threshold, the speaking user is determined to be in place. If the acceleration modulus is not less than the first threshold, it is then counted within the set time length to determine the maximum continuous time that the speaking user maintains the position within the first distance from the demonstration area. If the maximum continuous time length is greater than the second threshold, the speaking user is determined to be in place. A speaking event is triggered when the speaking user is determined to be in place. No speaking event is triggered in other cases.
[0041] Further, specifically, the content selected by the user who made the speech is produced by using trajectory simulation technology based on Simulink.
[0042] The present invention also proposes a conference device using trajectory simulation interaction technology, comprising the following:
[0043] The distributed conference network construction module is used to determine all conference participants, regard any conference participant as a sub-node, and build a distributed conference network with all sub-nodes;
[0044] A signal acquisition module, used to capture the user's speech request signal in real time, and define the user with the speech request signal as a potential speaking user;
[0045] A speech inquiry module, used for conducting a confirmed speech inquiry to all potential speech users, and defining the potential speech users who receive a response to the confirmed speech inquiry as confirmed speech users;
[0046] A conference venue distinguishing module, used to define the conference participant at the subnode where the speaking user is located as the main conference venue, and the remaining conference participants as the secondary conference venues;
[0047] a location information determination module, used to continuously obtain the location information of the determined speaking user, and determine whether the determined speaking user triggers a speaking event based on the location information,
[0048] If a speech event is triggered, the content selected by the user who is determined to speak is demonstrated at the conference site through trajectory simulation technology. If a speech event is not triggered, an alarm is given.
[0049] The beneficial effects of the present invention are:
[0050] The present invention provides a conference method using trajectory simulation interaction technology, which combines conference sites where all conference participants are located into a distributed conference network, captures speech requests from any conference participant, distinguishes between master and slave conference sites by determining the speaking user, and then determines whether the user triggers a speech event based on the user's location information. The entire process has a high degree of automation, and the trajectory simulation technology is used to display the user's selected content, which greatly improves the demonstration effect and enhances interactivity. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] The above and other features of the present disclosure will become more obvious by describing in detail the embodiments shown in the accompanying drawings. The same reference numerals in the accompanying drawings of the present disclosure represent the same or similar output voltages. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure. For those skilled in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative work. In the accompanying drawings:
[0052] Figure 1 Shown is a flow chart of a conference method using trajectory simulation interaction technology according to the present invention. DETAILED DESCRIPTION
[0053] The following will be combined with the embodiments and drawings to clearly and completely describe the concept, specific structure and technical effects of the present invention, so as to fully understand the purpose, scheme and effect of the present invention. It should be noted that the embodiments in this application and the features in the embodiments can be combined with each other without conflict. The same reference numerals used throughout the drawings indicate the same or similar parts.
[0054] Reference Figure 1 , Embodiment 1, the present invention proposes a conference method using trajectory simulation interaction technology, comprising the following:
[0055] Step 110: determine all conference participants, regard any conference participant as a sub-node, and construct a distributed conference network with all sub-nodes;
[0056] Step 120: Capture the user's speech request signal in real time, and define the user with the speech request signal as a potential speaker;
[0057] Step 130: Conduct a confirmed speech inquiry for all potential speech users, and define the potential speech users who receive a response to the confirmed speech inquiry as confirmed speech users;
[0058] Step 140: define the conference participant at the subnode where the speaking user is located as the main conference location, and define the remaining conference participants as secondary conference locations;
[0059] Step 150: continuously obtain the location information of the determined speaking user, and determine whether the determined speaking user triggers a speaking event based on the location information;
[0060] Step 160: If a speech event is triggered, the content selected by the user who is determined to speak is demonstrated at the conference site through trajectory simulation technology; if a speech event is not triggered, an alarm is issued.
[0061] In this embodiment 1, the conference venues where all conference participants are located are combined into a distributed conference network, and the speaking request of any conference participant is captured. The main and slave conference venues are distinguished by determining the speaking user, and then the user's location information is used to determine whether the user triggers a speaking event. The whole process has a high degree of automation, and the trajectory simulation technology is used to display the user's selected content, which greatly improves the demonstration effect and enhances interactivity. In addition, when the user's speaking request signal is captured, the user can be questioned by wireless voice, or other reasonable methods can be used to question the user to eliminate misidentification.
[0062] As a preferred embodiment of the present invention, the method further comprises:
[0063] Obtain parameter and angle adjustment requests from the conference venue, and adjust the demonstration scene in the conference venue according to the parameter and angle adjustment requests.
[0064] In this preferred embodiment, the use of trajectory simulation technology in the meeting can also enhance the interactivity with the audience. Through interactive demonstrations, the audience can participate in the demonstration process by manipulating parameters, adjusting viewing angles, etc., enhancing their sense of participation and interactive experience, making the meeting more lively and interesting.
[0065] As a preferred embodiment of the present invention, specifically, a method of capturing a user's speech request signal includes:
[0066] Select 3 key points on any arm of each user, the key points are located at the wrist, elbow and shoulder respectively;
[0067] Determine the user's arm stretch by continuously acquiring the relative position relationship between the three key points;
[0068] When the degree of stretching of the user's arm changes within a preset time interval, it is determined that the user has sent a speech request signal.
[0069] As a preferred embodiment of the present invention, specifically, the user's arm stretch degree is determined by continuously acquiring the relative position relationship between the three key points, including:
[0070] By setting the KineMt body sensor at the key point position of the user to obtain the real-time position coordinates of the key point;
[0071] Define the coordinates of three key points: K(x1, y1, z1) represents the elbow key point, L(x2, y2, z2) represents the shoulder key point, and M(x3, y3, z3) represents the wrist key point;
[0072] Calculate the following parameters,
[0073] KL vector = LK = ((x2-x1), (y2-y1), (z2-z1)) = (X1, Y2, Z1);
[0074] KM vector = MK = ((x3-x1), (y3-y1), (z3-z1)) = (X2, Y2, Z2);
[0075] The dot product between the KL vector and the KM vector V = KL*KM = (X1*X2)+(Y1*Y2)+(Z1*Z3);
[0076] The modulus of the KL vector
[0077] The modulus of the KM vector
[0078] Calculate the angle between the KL vector and the KM vector COSɑ = V / (|KL|*|KM|);
[0079] Calculate ɑ=arccos((COSɑ)) by inverse trigonometric function;
[0080] By converting radians and angles, we can get θ=ɑ*180 / π;
[0081] θ is used to represent the degree of arm extension of the user.
[0082] In this preferred embodiment, the user's arm stretch angle is calculated in the above manner to obtain the user's arm stretch degree, and by comparing whether the user's arm stretch degree changes at a preset time interval, it is determined whether the user has raised his hand or other behaviors of wanting to speak.
[0083] As a preferred embodiment of the present invention, specifically, the method of determining whether the degree of stretching of the user's arm changes at a preset time interval includes:
[0084] The θ value collected at the starting endpoint of the preset time interval is recorded as θ1;
[0085] The θ value collected at the end point of the preset time interval is recorded as θ2;
[0086] When the value of θ2-θ1 is greater than the stretch threshold, it means that the stretch degree of the user's arm jumps at a preset time interval.
[0087] As a preferred implementation mode of the present invention, specifically, judging whether the speaking user triggers a speaking event based on the position information includes:
[0088] Designate presentation areas in the meeting room for each conference participant;
[0089] When a user is determined as a confirmed speaker, the location information of the confirmed speaker is continuously obtained within a set time period;
[0090] Counting a first time duration during which the location information of the speaking user is within a first distance from the demonstration area within the set time duration, if a ratio of the first time duration to the set time duration is greater than the first ratio, it indicates that the speaking user is suspected to be in place;
[0091] At this time, the acceleration modulus of the speaking user is obtained. If the acceleration modulus is less than the first threshold, the speaking user is determined to be in place. If the acceleration modulus is not less than the first threshold, it is then counted within the set time length to determine the maximum continuous time that the speaking user maintains the position within the first distance from the demonstration area. If the maximum continuous time length is greater than the second threshold, the speaking user is determined to be in place. A speaking event is triggered when the speaking user is determined to be in place. No speaking event is triggered in other cases.
[0092] In this preferred embodiment, judging whether the user is in the demonstration area in the above manner can avoid interference in the judgment caused by situations such as the user being out for something.
[0093] As a preferred embodiment of the present invention, specifically, the content selected by the determined speaking user is produced by using trajectory simulation technology based on Simulink.
[0094] In this preferred embodiment, Simulink is an additional toolbox of MATLAB for modeling and simulating dynamic systems. They can be used to build various mathematical models and simulate and interact through Simulink.
[0095] The present invention also proposes a conference device using trajectory simulation interaction technology, comprising the following:
[0096] The distributed conference network construction module is used to determine all conference participants, regard any conference participant as a sub-node, and build a distributed conference network with all sub-nodes;
[0097] A signal acquisition module, used to capture the user's speech request signal in real time, and define the user with the speech request signal as a potential speaking user;
[0098] A speech inquiry module, used for conducting a confirmed speech inquiry to all potential speech users, and defining the potential speech users who receive a response to the confirmed speech inquiry as confirmed speech users;
[0099] A conference venue distinguishing module, used to define the conference participant at the subnode where the speaking user is located as the main conference venue, and the remaining conference participants as the secondary conference venues;
[0100] a location information determination module, used to continuously obtain the location information of the determined speaking user, and determine whether the determined speaking user triggers a speaking event based on the location information,
[0101] If a speech event is triggered, the content selected by the user who is determined to speak is demonstrated at the conference site through trajectory simulation technology. If a speech event is not triggered, an alarm is given.
[0102] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
[0103] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of software functional modules.
[0104] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium, etc.
[0105] Although the description of the present invention has been quite detailed and specifically describes several described embodiments, it is not intended to be limited to any of these details or embodiments or any particular embodiment, but should be regarded as providing a broad possible interpretation of these claims in view of the prior art by reference to the appended claims, thereby effectively covering the intended scope of the present invention. In addition, the above description of the present invention is based on the embodiments foreseeable by the inventor, and its purpose is to provide a useful description, and those non-substantial changes to the present invention that have not yet been foreseen may still represent equivalent changes to the present invention.
[0106] The above is only a preferred embodiment of the present invention. The present invention is not limited to the above implementation. As long as the technical effect of the present invention is achieved by the same means, it should belong to the protection scope of the present invention. Within the protection scope of the present invention, its technical scheme and / or implementation method can have various modifications and changes.
Claims
1. A conference method using trajectory simulation interaction technology, characterized in that: Includes the following: Identify all conference participants, treat any conference participant as a sub-node, and build a distributed conference network with all sub-nodes; Capture the user's speech request signal in real time and define the user with the speech request signal as a potential speaker; Conducting a confirmed speech inquiry for all potential speech users, and defining the potential speech users who receive a response to the confirmed speech inquiry as confirmed speech users; The conference participant at the subnode where the speaking user is located is defined as the main conference site, and the remaining conference participants are defined as secondary conference sites; Continuously acquiring the location information of the determined speaking user, and judging whether the determined speaking user triggers a speaking event based on the location information; If a speech event is triggered, the content selected by the user who is determined to speak is demonstrated at the conference site through trajectory simulation technology; if a speech event is not triggered, an alarm is given; The method further comprises, Obtaining parameter and angle adjustment requests from the conference site, and adjusting the demonstration scene in the conference site according to the parameter and angle adjustment requests; Specifically, the method of capturing the user's speech request signal includes: Select 3 key points on any arm of each user, the key points are located at the wrist, elbow and shoulder respectively; Determine the user's arm stretch by continuously acquiring the relative position relationship between the three key points; When the degree of stretching of the user's arm changes within a preset time interval, it is determined that the user has sent a speech request signal; Specifically, the user's arm stretch degree is determined by continuously obtaining the relative position relationship between the three key points. include, By setting the KineMt body sensor at the key point position of the user to obtain the real-time position coordinates of the key point; Define the coordinates of three key points: K(x1, y1, z1) represents the elbow key point, L(x2, y2, z2) represents the shoulder key point, and M(x3, y3, z3) represents the wrist key point; Calculate the following parameters, KL vector = LK = ((x2-x1), (y2-y1), (z2-z1)) = (X1, Y2, Z1); KM vector = MK = ((x3-x1), (y3-y1), (z3-z1)) = (X2, Y2, Z2); The dot product between the KL vector and the KM vector V = KL*KM = (X1*X2)+(Y1*Y2)+(Z1*Z3); The modulus of the KL vector The modulus of the KM vector Calculate the angle between the KL vector and the KM vector COSɑ = V / (|KL|*|KM|); Calculate ɑ=arccos((COSɑ)) by inverse trigonometric function; By converting radians and angles, we can get θ=ɑ*180 / π; Then θ represents the degree of arm stretch of the user; Specifically, the method of determining whether the degree of stretching of the user's arm changes at a preset time interval includes: The θ value collected at the starting endpoint of the preset time interval is recorded as θ1; The θ value collected at the end point of the preset time interval is recorded as θ2; When the value of θ2-θ1 is greater than the stretch threshold, it means that the user's arm stretch degree jumps at a preset time interval; Specifically, judging whether the speaking user triggers a speaking event based on the location information includes: Designate presentation areas in the meeting room for each conference participant; When a user is determined as a confirmed speaker, the location information of the confirmed speaker is continuously obtained within a set time period; Counting a first time duration during which the location information of the speaking user is within a first distance from the demonstration area within the set time duration, if a ratio of the first time duration to the set time duration is greater than the first ratio, it indicates that the speaking user is suspected to be in place; At this time, the acceleration modulus of the speaking user is obtained. If the acceleration modulus is less than the first threshold, the speaking user is determined to be in place. If the acceleration modulus is not less than the first threshold, it is then counted within the set time length to determine the maximum continuous time that the speaking user maintains the position within the first distance from the demonstration area. If the maximum continuous time length is greater than the second threshold, the speaking user is determined to be in place. A speaking event is triggered when the speaking user is determined to be in place. No speaking event is triggered in other cases.
2. A conference method using trajectory simulation interaction technology according to claim 1, characterized in that: Specifically, the content selected by the user who made the speech is produced by using trajectory simulation technology based on Simulink.
3. A conference device using trajectory simulation interaction technology, characterized in that: A conference method using the trajectory simulation interaction technology described in claim 1, comprising the following: The distributed conference network construction module is used to determine all conference participants, regard any conference participant as a sub-node, and build a distributed conference network with all sub-nodes; A signal acquisition module, used to capture the user's speech request signal in real time, and define the user with the speech request signal as a potential speaking user; A speech inquiry module, used for conducting a confirmed speech inquiry to all potential speech users, and defining the potential speech users who receive a response to the confirmed speech inquiry as confirmed speech users; A conference venue distinguishing module, used to define the conference participant at the subnode where the speaking user is located as the main conference venue, and the remaining conference participants as the secondary conference venues; a location information determination module, used to continuously obtain the location information of the determined speaking user, and determine whether the determined speaking user triggers a speaking event based on the location information, If a speech event is triggered, the content selected by the user who is determined to speak is demonstrated at the conference site through trajectory simulation technology. If a speech event is not triggered, an alarm is given.
Citation Information
Patent Citations
Conference process control method and device, server and storage medium
CN112862461A
Video conference processing method and system, electronic equipment and storage medium
CN115567673A
On-line conference speaking method, server and client
CN116743716A
Method and apparatus for managing minutes
KR101618084B1
