Systems and methods for facilitating enhanced spatial conferencing

Abstract

The present disclosure relates to a system and method for facilitating a robust and effective solution for an entity or organization by enabling the entity to implement a system for enhancing the user experience of a conference user in the case of workflow-based conferences by utilizing spatial conferencing technology and by providing role-based privileges that allow conference users to interact with other subgroups within the conference. Thus, the system and method of the present disclosure can be beneficial to both entities and users.

Description

Technical Field

[0001] Reservation of Rights Part of the disclosure of this patent document includes, but is not limited to, materials that are subject to intellectual property rights such as copyrights, designs, trademarks, IC layout designs, and / or trade dress protection belonging to Jio Platforms Limited (JPL) or its affiliated companies (hereinafter referred to as the owner). The owners of copyrights and trademarks reserve all other copyright and trademark rights, although they have no objection to any complete reproduction by anyone with respect to the patent document or patent disclosure when represented in the patent application and records of the Patent and Trademark Office. All rights to such intellectual property are fully reserved by the owner.

[0002] Embodiments of the present disclosure generally relate to the field of telecommunications. More specifically, the present disclosure relates to Conference call systems and methods for facilitating spatialized audio and video.

Background Art

[0003] The following description of related art is intended to provide background information regarding the field of the disclosure. This section may include specific aspects of the art related to various features of the present disclosure. However, this section should be understood as being used only to deepen the reader's understanding of the present disclosure and not as an approval of the prior art.

[0004] In today's world, Conference call is becoming an increasingly common communication medium. For example, large enterprises can have offices around the world, but employees of the enterprise in various locations often need to Conference call consult with each other to formulate conclusions and solutions to pressing problems.

[0005] With the emergence of large virtual conference rooms that can accommodate hundreds of participants as shown in FIGS. 10A - 10E, it would be a boring experience for everyone to talk to everyone else in a meeting session. Furthermore, the conventional Conference call The system uses a single audio channel for all participants, and the moderator is usually... Conference call It controls the following: Therefore, the user can control one at a time. Conference call I can only participate in this. There are often other issues related to calls, such as during conference calls, which make it difficult to recognize who is speaking by voice alone. Conference call If there are several other participants whose regional accents or voices are similar, Conference call This could become chaotic. Furthermore, if there are two or more Conference minutes Multiple participants may be speaking at the same time, which degrades the quality of the conversation. Conference call Another problem with the approach is, Conference call The main issue is that the meeting cannot be divided into several sub-meetings, and participants cannot freely move between sub-meetings. Furthermore, user engagement in large-scale meetings is currently a one-to-many scenario, and spatial conferencing technology is not utilized.

[0006] Therefore, in this field, space Conference call Use this to appeal to real-world use cases Conference call There is a need to provide a system and method that can facilitate this process.

[0007] Purpose of this disclosure Some of the objects of this disclosure that at least one embodiment of this specification will satisfy are listed below.

[0008] The purpose of this disclosure is to improve the user experience in workflow-based meetings by utilizing spatial conferencing technology.

[0009] The purpose of this disclosure is to provide role-based privileges that allow meeting users to interact with other subgroups in meetings. [Overview of the project]

[0010] This section is provided to introduce a set of concepts in a simplified form, which are further described in the embodiments for carrying out the invention below. This summary is not intended to identify the main features or scope of the claimed subject matter.

[0011] In one embodiment, the proposed system is configured to generate executable bot applications specific to entities, the system comprising a processor that executes a set of executable instructions stored in memory, during execution the processor receiving a set of data packets related to each meeting participant from a set of computing devices associated with each meeting participant, and via an AI engine, one or more Stay Identifying the group, the meeting participants, through the role assigned to each meeting participant, one or more of the group stage The AI ​​engine identifies and initiates eavesdropping behavior permitted to at least one first meeting participant, based on the assigned role and permission for eavesdropping behavior. stage The process involves: initiating snooping; extracting a set of attributes from a set of data packets via an AI engine, the set of attributes corresponding to media streams related to conference participants, and the set of attributes being processed based on a set of signaling criteria and permitted snooping actions; and rendering spatial effects to the set of attributes by the AI ​​engine based on the initiation of snooping actions and the extraction of the set of attributes.

[0012] This disclosure further provides a method for generating an entity-specific executable bot application, the method comprising the steps of receiving a set of data packets related to each meeting participant from a set of computing devices associated with each meeting participant, and via an AI engine, one or more stage A step in which meeting participants identify one or more of the roles assigned to each meeting participant. stage A step which may be associated with, and a step which by an AI engine initiates a snooping action permitted to at least one first meeting participant, wherein at least one first meeting participant, based on their assigned role and permission to snoop, stage The process includes the steps of: starting by eavesdropping; extracting a set of attributes from a set of data packets via an AI engine, wherein the set of attributes corresponds to media streams associated with meeting participants, and the set of attributes is processed based on a set of signaling criteria and permitted eavesdropping behavior; and rendering spatial effects on the set of attributes by the AI ​​engine.

[0013] The accompanying drawings incorporated herein and constituting part of the present invention illustrate exemplary embodiments of the disclosed methods and systems, and similar reference numerals throughout different drawings refer to the same parts. Components in the drawings are not necessarily proportional to the actual size, and instead, emphasis is placed on clearly illustrating the principles of this disclosure. Some drawings may use block diagrams to show components, and the internal circuitry of each component may not be shown. It will be understood by those skilled in the art that the inventions in such drawings include inventions of electrical components, electronic components, or circuits commonly used to mount such components. [Brief explanation of the drawing]

[0014] [Figure 1] This figure shows an exemplary network architecture in which the System of the Disclosure can be implemented to facilitate enhanced conference calls according to embodiments of the Disclosure. [Figure 2] This figure shows an exemplary representation of a system / centralized server for facilitating enhanced conference calls based on an artificial intelligence (AI)-based architecture, according to one embodiment of the present disclosure. [Figure 3] This is a flowchart illustrating an exemplary method for enhancing spatial conference calls according to one embodiment of the present disclosure. [Figure 4A]Exemplary block flow diagram (400) showing components of a selective transfer architecture involved in enhancing spatial conference calls, according to an embodiment of the present disclosure. [Figure 4B] Exemplary block flow diagram (400) showing components of a selective transfer architecture involved in enhancing spatial conference calls, according to an embodiment of the present disclosure. [Figure 5] An exemplary overview representation of workflow implementation, according to an embodiment of the present disclosure. [Figure 6A] A diagram showing a general architecture of an exemplary workflow conference implementation with multiple sub-conferences (or) stages, according to an embodiment of the present disclosure. [Figure 6B] A diagram showing a general architecture of an exemplary workflow conference implementation with multiple sub-conferences (or) stages, according to an embodiment of the present disclosure. [Figure 6C] A diagram showing a general architecture of an exemplary workflow conference implementation with multiple sub-conferences (or) stages, according to an embodiment of the present disclosure. [Figure 6D] A diagram showing a general architecture of an exemplary workflow conference implementation with multiple sub-conferences (or) stages, according to an embodiment of the present disclosure. [Figure 6E] A diagram showing a general architecture of an exemplary workflow conference implementation with multiple sub-conferences (or) stages, according to an embodiment of the present disclosure. [Figure 6F] A diagram showing a general architecture of an exemplary workflow conference implementation with multiple sub-conferences (or) stages, according to an embodiment of the present disclosure. [Figure 7] A diagram showing an exemplary system architecture associated with a media mixer, according to an embodiment of the present disclosure. [Figure 8A] An exemplary flow diagram representing the creation, participation, and use of a workflow, according to an embodiment of the present disclosure. [Figure 8B] An exemplary flow diagram representing the creation, participation, and use of a workflow, according to an embodiment of the present disclosure. [Figure 8C] This is an exemplary flowchart illustrating the creation, participation in, and use of a workflow according to one embodiment of the present disclosure. [Figure 9] This figure shows an exemplary representation of a workflow implementation according to the embodiments of this disclosure. [Figure 10A] This figure shows a representation of an existing workflow according to an embodiment of the disclosure. [Figure 10B] This figure shows a representation of an existing workflow according to an embodiment of the disclosure. [Figure 10C] This figure shows a representation of an existing workflow according to an embodiment of the disclosure. [Figure 10D] This figure shows a representation of an existing workflow according to an embodiment of the disclosure. [Figure 10E] This figure shows a representation of an existing workflow according to an embodiment of the disclosure. [Figure 11] This figure shows an exemplary computer system that can utilize or is capable of utilizing embodiments of the present invention according to embodiments of the present disclosure. [Modes for carrying out the invention]

[0015] The above will become clearer from the following more detailed description of the present invention.

[0016] The following description includes specific details for illustrative purposes to facilitate understanding of the invention. However, it will be apparent to those skilled in the art that embodiments of the invention can be carried out without these specific details. Some of the functions described below can be used independently of each other or in any combination of other functions. Some individual functions may not address all of the above problems, or may address only some of them. Some of the above problems may not be fully addressed by any of the functions described herein.

[0017] The following description provides only exemplary embodiments and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the following description of exemplary embodiments provides a useful explanation for carrying out the exemplary embodiments for those skilled in the art. It should be understood that various modifications can be made to the function and arrangement of the elements without departing from the spirit and scope of the invention described herein.

[0018] The following description includes many specific details in order to provide a complete understanding of the invention. However, it will be apparent to those skilled in the art that the various embodiments described can be implemented without these specific details. For example, circuits, systems, networks, processes, and other components may be shown as components in block diagram form to avoid obscuring the embodiments with unnecessary details. In other examples, well-known circuits, processes, algorithms, structures, and techniques may be shown without unnecessary details to avoid obscuring the embodiments.

[0019] The present invention provides entities or organizations with a robust and effective solution by enabling them to implement a system that enhances the user experience of meeting users in the case of workflow-based meetings by utilizing spatial meeting technology and by providing role-based privileges that allow meeting users to interact with other subgroups within the meeting. Accordingly, the systems and methods of the present disclosure may be beneficial to both entities and users.

[0020] Refer to Figure 1, which shows an exemplary network architecture (100) that can implement the System (110) of the Disclosure according to one embodiment of the Disclosure. Referring to Figure 1 as an example rather than an limitation, the exemplary architecture (100) may include a plurality of conference participants (102-1, 102-2, ..., 102-N) (collectively referred to as Conference Participants (102) or Users (102) or Participants (102), and individually referred to as Conference Participants (102) or Users (102) or Participants (102)) associated with a plurality of user computing devices (104-1, 104-2, ..., 104-N) (collectively referred to as User Devices (104) and individually as User Devices (104)), at least a network 106, at least a central server 110, and at least a second computing device (104) associated with an entity (108). More specifically, the exemplary architecture (100) may include a space for Conference Participants (102). Conference call The system (110) includes an artificial intelligence (AI) engine (214) to enhance the user device (104), which is communicatively coupled to a centralized server (112) via a network (106) to facilitate communication with the centralized server (112). As an example, but not an limitation, the user computing device (104) may be operably coupled to the centralized server (112) via the network (106) and associated with an entity (108). The system (110) can receive a set of data packets about each conference participant from multiple computing devices (104) associated with each conference participant. The AI ​​engine (214), operably coupled to the system (110), communicates with one or more conference participants through roles assigned to each conference participant. stage The system (110), with the help of the AI ​​engine (214), can initiate eavesdropping actions permitted to at least one first meeting participant (102-1), thereby allowing the first meeting participant to perform one or more eavesdropping actions based on the assigned eavesdropping role and permissions. stageIt is possible to peek into the system. The AI ​​engine (214) can further cause the system (110) to extract a set of attributes from a set of data packets corresponding to a media stream associated with a meeting participant (102). The set of attributes may be processed based on signaling criteria and a set of permitted snooping actions, and based on the initiation of a snooping action and the extraction of the set of attributes, the AI ​​engine (214) may render spatial effects on the set of attributes.

[0021] In one embodiment, the set of attributes corresponding to a media stream may include audio data, video data, and conference-related data, or a combination thereof.

[0022] In another embodiment, one or more stage This can indicate tasks related to meeting participants, one or more. stage Each stage This can handle predefined tasks related to meeting participants (102).

[0023] In one embodiment, the AI ​​engine (214) may be configured to assign privileged roles to at least a first meeting participant (102-1) and at least a second meeting participant (102-2). stage Privileged roles can be assigned to control access, and the assignment is performed automatically based on each conference participant's media stream, and conference participants (102) generate real-time queries considering their respective roles, and at least the first and second conference participants (102-1, 102-2) who have been assigned privileged roles can access multiple stage The system controls the tasks generated by the system. In one embodiment, once the assignment of privileged roles to the first and second meeting participants (102-1 and 102-2) is confirmed, the system (110) may send a first set of data packets indicating confirmation of the meeting assignment, and in response, the computer (104) of meeting participant (102) may send a second set of data packets indicating an acknowledgment of the confirmation.

[0024] In yet another embodiment, at least first and second meeting participants (102-1 and 102-2) having assigned privileged roles may, based on a predefined set of rules, stage among the predefined stage They may enter, and the remaining conference participants (102) who do not have a privileged role may enter multiple stage I will participate in everything.

[0025] In yet another embodiment, each meeting participant (102) can be assigned a role based on a set of predefined role requirement rules.

[0026] In another embodiment, a media mixer server can be operationally integrated into the system (110). The media mixer server may be configured to combine the media streams associated with each conference participant (102) into a single media stream.

[0027] In one embodiment, upon request from at least a first conference participant (102-1) to initiate an eavesdropping operation, the system may transmit a third set of data packets indicating the request from at least a first conference participant (102-1) to initiate an eavesdropping operation. In response, the computing device (102-1) of at least a first conference participant (102-1) may transmit a fourth set of data packets indicating an acknowledgment of the request.

[0028] In another embodiment, the first stage The conference participants are 1 stage Interact with other conference participants, and stage The conference participants are 2 stage Interact with other conference participants. In one embodiment, the first stage At least one of the first meeting participants, through the initiation of eavesdropping by at least one of the first meeting participants, at least one of the second stage or more stageAt least the first meeting participant can interact with at least the second meeting participant. At least the first meeting participant can interact with at least the first meeting participant after the eavesdropping action is completed. stage You can return to this.

[0029] In yet another embodiment, at least a second or more meetings initiated by at least a first meeting participant (102-1) stage When approving the peeping action, at least the second or more stage The conference participants will receive at least the media stream associated with the first conference participant who initiated the snooping behavior.

[0030] In yet another embodiment, the second stage If the snooping action is permitted to at least the first meeting participant, then the second stage The above media streams change, and the effects related to the media streams of multiple conference participants change. stage It decreases, and the second or more stage The effect related to media streams for at least the first conference participant will increase.

[0031] In one embodiment, the user computing device (104) can communicate with the system (110) via a set of executable instructions present in any operating system, including but not limited to Android®, iOS®, KaiOS®, etc. In one embodiment, the user computing device (104) may include any electrical, electronic, electromechanical, or device, or one or more of the above devices, including but not limited to mobile phones, smartphones, virtual reality (VR) devices, augmented reality (AR) devices, laptops, general-purpose computers, desktops, personal digital assistants, tablet computers, mainframe computers, or any other computing device, and the computing device may include one or more built-in or externally connected accessories, including visual assistance devices, including input devices for receiving user input such as cameras, audio aids, microphones, keyboards, touchpads, touch-enabled screens, and electronic pens, but not limited to these. It should be understood that the user computing device (104) may be used in a variety of other devices, not limited to those mentioned. A smart computing device is one suitable system for storing data and other personal or confidential information.

[0032] In exemplary embodiments, the network (106) may include, but not limited to, at least part of one or more networks having one or more nodes that transmit, receive, forward, generate, buffer, store, route, switch, process, or perform any combination thereof, one or more messages, packets, signals, waves, voltage or current levels, or any combination thereof. The network may include, but not limited to, one or more wireless networks, wired networks, the Internet, intranets, public networks, private networks, packet-switched networks, circuit-switched networks, ad-hoc networks, infrastructure networks, public-switched telephone networks (PSTN), cable networks, cellular networks, satellite networks, fiber optic networks, and any combination thereof.

[0033] In another exemplary embodiment, the centralized server (112) may include, but not limited to, a standalone server, a server blade, a server rack, a bank of servers, a server farm, hardware supporting part of a cloud service or system, a home server, hardware running a virtualization server, one or more processors running code to function as a server, one or more machines performing the server-side functions described herein, at least some of the above, or one or more of any combination thereof.

[0034] In one embodiment, the system (110) may include one or more processors coupled to memory, and when the memory is executed by one or more processors, it provides advanced information to the system. Conference callInstructions that can facilitate this can be stored. Referring to Figure 1, Figure 2 shows an exemplary representation of a system (110) / centralized server (112) for facilitating augmented conference calls based on an artificial intelligence (AI)-based architecture according to one embodiment of the present disclosure. In one aspect, the system (110) / centralized server (112) may comprise one or more processors (202). One or more processors (202) may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, logic circuits, and / or any device that processes data based on operation instructions. In particular, one or more processors (202) may be configured to fetch and execute computer-readable instructions stored in the memory (206) of the system (110). The memory (206) may be configured to store one or more computer-readable instructions or routines in a non-temporary computer-readable storage medium that can be fetched and executed to create or share data packets over network services. The memory (206) may include any non-temporary storage device, such as volatile memory like RAM, or non-volatile memory like EPROM or flash memory.

[0035] In one embodiment, the system (110) / centralized server (112) may include an interface 204. The interface 204 may include various interfaces, such as interfaces for data input and output devices, including I / O devices and storage devices. The interface 204 can facilitate communication of the system (110). The interface 204 can also provide a communication path for one or more components of the system (110) or centralized server (112). Examples of such components include, but are not limited to, the processing engine 208 and the database 210.

[0036] The processing engine (208) may be implemented as a combination of hardware and programming (e.g., programmable instructions) to implement one or more functions of the processing engine (208). In the examples described herein, such a combination of hardware and programming can be implemented in several different ways. For example, the programming of the processing engine (208) may be processor-executable instructions stored in a non-temporary machine-readable storage medium, and the hardware of the processing engine (208) is a processing resource (e.g., one or more processors) that executes such instructions. In this example, the machine-readable storage medium may store instructions that implement the processing engine (208) when executed by the processing resource. In such an example, the system (110) / centralized server (112) may have a machine-readable storage medium that stores instructions and processing resources for executing those instructions, or the machine-readable storage medium may be separate but accessible to the system (110) / centralized server (112) and the processing resources. In other examples, the processing engine (208) may be implemented by electronic circuits.

[0037] The processing engine (208) may include one or more engines selected from among the data acquisition engine (212), the artificial intelligence (AI) engine (214), and other engines (216).

[0038] In one embodiment, the data acquisition engine (212) may be configured to receive a set of data packets related to each conference participant from a plurality of computing devices (104) associated with each conference participant (102).

[0039] An AI engine (214) operably coupled to the system (110) has one or more associated with the meeting participants through the roles assigned to each meeting participant. stageIt can identify and, furthermore, initiate eavesdropping actions permitted to at least the first meeting participant (102-1), and the first meeting participant may, based on their assigned role and permission to eavesdrop, initiate one or more eavesdropping actions. stage It is possible to peek into the media stream. The AI ​​engine (214) can then extract a set of attributes from the set of data packets corresponding to the media stream, which may include any or a combination of audio data, video data, and meeting-related data associated with the meeting participants (102). The set of attributes is processed based on a set of signaling criteria and permitted eavesdropping behavior. Based on the initiation of eavesdropping behavior and the extraction of the set of attributes, the AI ​​engine can render spatial effects on the set of attributes.

[0040] The AI ​​engine (214) provides one or more predefined tasks associated with the meeting participant (102) to correspond to the predefined tasks associated with the meeting participant (102). stage The configuration may be further configured to assign privileged roles to at least one first meeting participant (102-1) and at least one second meeting participant (102-2). stage Privileged roles can be assigned to control access, and the assignment is performed automatically based on each conference participant's media stream, and conference participants (102) generate real-time queries considering their respective roles, and at least the first and second conference participants (102-1, 102-2) who have been assigned privileged roles can access multiple stage The system controls the tasks generated by the system. In one embodiment, once the assignment of privileged roles to the first and second meeting participants (102-1 and 102-2) is confirmed, the system (110) may send a first set of data packets indicating confirmation of the meeting assignment, and in response, the computer (104) of meeting participant (102) may send a second set of data packets indicating an acknowledgment of the confirmation.

[0041] In yet another embodiment, at least first and second meeting participants (102-1 and 102-2) who have been assigned privileged roles may, based on a set of predefined rules configured by the AI ​​engine (214), stage among the predefined stage They can enter, and the remaining meeting participants (102) without privileged roles can enter multiple stage Participate in all of them. Roles can be assigned to each meeting participant (102) based on a set of predefined role requirement rules.

[0042] In another embodiment, the AI ​​engine (214) may configure a media mixer server operably coupled to the system (110) to combine the media streams associated with each conference participant (102) into a single media stream.

[0043] In one embodiment, when at least a first conference participant (102-1) requests the initiation of an eavesdropping operation, the AI ​​engine (214) may transmit a third set of data packets indicating the request by at least the first conference participant (102-1) to initiate an eavesdropping operation, and in response, the computing device (102-1) of at least the first conference participant (102-1) may transmit a fourth set of data packets indicating an acknowledgment of the request. stage The conference participants were 1 stage This will allow for further interaction with other conference participants, and the second stage The conference participants were second stage Interact with other conference participants. In one embodiment, the first stage At least one of the first meeting participants, through the initiation of eavesdropping by at least one of the first meeting participants, at least one of the second stage or more stage At least the first meeting participant can interact with at least the second meeting participant. At least the first meeting participant can interact with at least the first meeting participant after the eavesdropping action is completed. stage It is possible to return to at least the second stageIf the above is acknowledged as an act of eavesdropping initiated by at least the first meeting participant (102-1), then at least the second stage The above-mentioned conference participants can receive media streams related to at least one conference participant who initiates the snooping behavior.

[0044] In yet another embodiment, a second or more stage If eavesdropping is permitted for at least the first meeting participant, then the second and subsequent stage The media stream is modified to be composed by the AI ​​engine (214), and the second or more stage The effect of associating media streams with multiple conference participants decreases, and the second or more stage Therefore, the effect of associating with the media stream of at least the first conference participant may increase.

[0045] Figure 3 shows an exemplary method flowchart (300) for enhancing spatial conference calls according to one embodiment of the present disclosure. In 302, the method may include the step of receiving a set of data packets related to each conference participant from a plurality of computing devices related to each conference participant, and in 304, the method (300) may further include one or more AI engines. stage Identify and, through the roles assigned to each participant, one or more stage It can be associated with that.

[0046] Furthermore, method (300) may include, in 306, a step of having an AI engine initiate an eavesdropping operation permitted for at least a first meeting participant, at least a first meeting participant, with an assigned role and approval for eavesdropping, and, in 308, a step of having the AI ​​engine extract a set of attributes from a set of data packets associated with the meeting participant. The set of attributes is processed based on signaling criteria and a set of permitted eavesdropping operations.

[0047] Furthermore, based on the initiation of the peeping operation and the extraction of the set of attributes, the method may include a step in 310 of rendering the spatial effects by the AI ​​engine into the set of attributes.

[0048] Figures 4A to 4B show a spatial representation according to one embodiment of the present disclosure. Conference call An exemplary block flow diagram (400) is shown illustrating the components of the selective forwarding architecture involved in the enhancement.

[0049] Figure 5 provides an exemplary overview of a workflow implementation according to one embodiment of the present disclosure (500). As shown in Figure 5, the workflow is ,stage This includes receptionists (502), on standby (504), nurses (506), and doctors (508). Including the stage This may include, but is not limited to, locks, and multiple roles such as receptionist, nurse, patient, and doctor. stage It may be defined for some. stage This requires people to be on standby. stage In some cases, only the owner may be granted the privilege of entering. For example, a doctor may be in a privileged position, and a person may be granted the following by a doctor or nurse: stage One or more people of each role type can proceed. stage It can exist in other places. stage Those who have no other privileges for short conversations stage You can peek inside and then return. Therefore, stage Sometimes the voices of people nearby can sound loud. However, another person stage The volume of other people will be relatively small. For example, the patient and the receptionist stage Even if a call is currently being placed on (502). Reception stage (502) can be used for issuing tokens, paying consultation fees, collecting receipts, etc. Nurses, doctors, or other patients can look into the reception stage (502). Waiting stage In (504), all patients and receptionists may be on standby. Patients wait for a token call, and doctors, nurses, and receptionists are on standby. stageIt is possible to peek into (504). Nursing stage (506) A token is called and physiological parameters are checked. The receptionist, doctor, and nurse then... stage One can peek into it (506). Doctor stage (508) allows for the summoning of a doctor, nurse, and patient. A token summon is made, more physiological parameters may be checked, and consultation may take place. The receptionist is the doctor's stage (508) can be viewed.

[0050] Figures 6A to 6F show a plurality of sub-meetings (or) according to one embodiment of the present disclosure. stage This shows a general architecture for an exemplary workflow meeting implementation.

[0051] As shown in Figure 6A, in one embodiment, the workflow is multiple stage It can include, and each of them can be a local sub-meeting. As shown in the diagram, the workflow meeting is stage 1(604), stage 2(606), stage 3(608), and stage 4(610) at least four stage It can be defined as multiple stage Each of these may be coupled to the server (602). For example, stage 1(604) may include, but is not limited to, meeting participants A and B. stage 2(606) may include meeting participants C, D, and E. stage 3(608) may include meeting participants F and G, stage 4(610) may include meeting participants H, J, and K. stage In 1 and 2 (604 and 606), conference participants A, B, C, D, and E are stage They can be beings that can communicate with each other. However, stage Meeting participants (F or G) from 3(608) stage If you want to speak with 1(604), meeting participant F or G should stageWe need to look at 1(604).

[0052] As shown in Figure 6B, as shown in Figure 6A stage A typical workflow meeting with local sub-meetings can be illustrated using the use case of a physician's consultation. Conference call This could be an SFU implementation, allowing all media streams from one person to be available to another. stage Allowing audio / video from and rendering media based on signaling from the server is device-dependent (602). Signaling may indicate which media will be rendered. stage If someone is eavesdropping, spatial chat will be used and appropriate sound effects will be rendered.

[0053] Figure 6C illustrates, but is not limited to, a scenario in which a receptionist peeks into an examination room and engages in spatial chat. Figure 6D illustrates, but is not limited to, a scenario in which a receptionist peeks into an examination room and engages in spatial chat. Figure 6E illustrates, but is not limited to, a scenario in which a participant in the examination room receives the receptionist's media stream when a snoop request is accepted. The snoop media stream may be transmitted to the participant in the examination room from 602 to 606, 602 to 608, and 602 to 610. Figure 6F illustrates, but is not limited to, a scenario in which media processing with a participant in the reception room may change when a receptionist peeks into the examination room. Possible changes for a participant in the reception room include the receptionist experiencing the change, the patient's voice being spatially controlled at a lower volume, the participant's voice being controlled at a normal volume, and the patient experiencing spatial audio effects that affect the low-volume reception, etc.

[0054] Figure 7 shows an exemplary system architecture associated with a media mixer according to one embodiment of the present disclosure.

[0055] As shown in the diagram, the system architecture can utilize a media mixer (702). The media mixer may be a server that combines individual media to prepare a single media stream, instead of an SFU architecture. The media mixer (702) has at least four stage It may include 704-1, 704-2, 704-3, and 704-4. At least four stage A meeting can include multiple participants. Multiple participants can include a moderator which may indicate a privileged participant, participants who have joined the meeting, a local meeting group which may correspond to a set of people who can talk to or interact with each other, a local meeting which indicates a meeting of a local meeting group, a local participant which indicates a person portion of a local meeting group, a global meeting which indicates a global set of participants, a group transition which indicates a group transition, a local-to-local transition, and a local-global transition which indicates a workflow transition.

[0056] Figures 8A to 8C show exemplary flowcharts illustrating the creation, participation in, and use of a workflow according to one embodiment of the present disclosure.

[0057] As shown in Figure 8A, in one embodiment, the creation of a workflow involves the step of selecting a workflow name, for example, a doctor's consultation, in 802, and in 804, stage 1. stage 3. stage Workflows such as 4 stage and the creation of a workflow may include a step of defining names. In 806, the creation of a workflow may include a step of defining names for roles such as doctor, nurse, and receptionist, and in 808, the creation of a workflow may include a step of defining names for roles such as doctor stage Participating in 4, the patient stage Participate in role names such as 1. stage It may include a step to assign. In 810, the creation of the workflow may include, for example, a physician stage From 1 stage During the transition to step 4, the doctor stageThis could include a step to define the type of role for each role, such as being stationary.

[0058] Figure 8 C As shown, in one embodiment, stage The use of the patient workflow in step 1 involves the steps of obtaining a token in step 822, and making a payment in step 824, and in step 826. Payment Steps to receive an invoice 、8 28 In the case of Participants such as the following stage Steps to decide whether to send it It can The decision may be initiated by the receptionist or the patient, and the patient Step 830 stage It may be moved to 2.

[0059] Figure 9 shows an exemplary representation of a workflow implementation according to an embodiment of the present disclosure.

[0060] Figures 10A to 10E illustrate an existing workflow according to an embodiment of the present disclosure.

[0061] Figure 11 shows an exemplary computer system that can or may utilize embodiments of the present invention according to embodiments of the present disclosure. As shown in Figure 11, the computer system 1100 may include an external storage device 1110, a bus 1120, main memory 1130, read-only memory 1140, mass storage device 1150, a communication port 1160, and a processor 1170. Those skilled in the art will understand that the computer system may include multiple processors and communication ports. Examples of processors 1170 include, but are not limited to, Intel® Itanium® or Itanium 2 processors, or AMD® Opteron® or Athlon MP® processors, Motorola® series processors, FortiSOC® system-on-chip processors, or other future processors. The processor 1170 may include various modules related to embodiments of the present invention. The communication port 1160 may be any of the following: an RS-232 port used for modem-based dial-up connections, a 10 / 100 Ethernet port, a Gigabit or 10 Gigabit port using copper or fiber, a serial port, a parallel port, or any other existing or future port. The communication port 1160 can be selected depending on the network, such as a local area network (LAN), a wide area network (WAN), or any network to which the computer system is connected. The memory 1130 may be random access memory (RAM) or any other dynamic storage device commonly known in the art. The read-only memory 1140 may be any static storage device, such as a programmable read-only memory (PROM) chip for storing static information, such as boot instructions or BIOS instructions for the processor 1170. The mass storage device 1150 may be a current or future mass storage device solution that can be used to store information and / or instructions.Exemplary mass storage solutions include, but are not limited to, parallel advanced technology attachment (PATA) or serial advanced technology attachment (SATA) hard disk drives or solid-state drives (e.g., internal or external with Universal Serial Bus (USB) and / or Firewire interfaces), such as those available from Seagate (e.g., Seagate Barracuda 7102 family) or Hitachi (e.g., Hitachi Deskstar 7K1000), one or more optical disks, and disk array Redundant Array of Independent Disks (RAID) storage devices (e.g., SATA arrays), such as those available from various vendors including Dot Hill Systems Corp., LaCie, Nexsan Technologies, Inc., and Enhance Technology, Inc.

[0062] Bus 1120 connects the processor 1170 to other memory, storage devices, and communication blocks in a communicative manner. Bus 1120 may also be a Peripheral Component Interconnect (PCI) / PCI Extended (PCI-X) bus, a Small Computer System Interface (SCSI), or a USB, for connecting expansion cards, drives, and other subsystems, as well as other buses such as a front-side bus (FSB) that connects the processor 1170 to a software system.

[0063] If necessary, operator and management interfaces such as a display, keyboard, and cursor control device can also be coupled to bus 1120 to support direct interaction between the operator and the computer system. Other operator and management interfaces can be provided via a network connection connected through communication port 1160. The external storage device 1110 may be any type of external hard drive, floppy drive, IOMEGA® Zip drive, compact disc-read-only memory (CD-ROM), compact disc-rewritable (CD-RW), or digital video disc-read-only memory (DVD-ROM). The above components are for illustrative purposes only to illustrate various possibilities. The above-described exemplary computer system is not intended to limit the scope of this disclosure.

[0064] While this specification places considerable emphasis on preferred embodiments, it should be understood that many embodiments can be made and many modifications can be made in the preferred embodiments without departing from the principles of the present invention. These and other modifications in the preferred embodiments of the present invention will be obvious to those skilled in the art from the disclosure herein, and it should be clearly understood that the foregoing descriptions are not limiting to the invention but should be implemented merely as examples.

[0065] Benefits of this disclosure This disclosure provides a system and method for facilitating the easy transition of calls among participants in a workflow without interrupting the call.

[0066] This disclosure is based on the assigned privileged role, and multiple stage This system and method facilitates efficient dialogue among participants across various fields.

[0067] This disclosure provides a system and method that facilitates efficient interaction between multiple participants, who are users of a workflow service, as in the real world.

[0068] This disclosure provides a method for improving the user experience in workflow-based meetings by utilizing spatial conferencing technology.

[0069] This disclosure provides a method for assigning role-based privileges to meeting users to interact with other subgroups within a meeting.

Claims

1. A system for enhancing spatial conferencing, comprising a processor that executes a series of executable instructions stored in memory, wherein when the executable instructions are executed, the processor in the system Receiving a set of data packets related to each conference participant from multiple computing devices associated with each conference participant, Identifying one or more stages via an AI engine, wherein the meeting participants are associated with the one or more stages through the roles assigned to each of the meeting participants, The AI ​​engine initiates a peeping action permitted to at least one first meeting participant, wherein at least one first meeting participant peeks at one or more stages based on the assigned role and permission to peeping; Extracting a set of attributes from the set of data packets via the AI ​​engine, wherein the set of attributes corresponds to media streams related to the conference participants, and the set of attributes is processed based on signaling criteria and permitted snooping behavior, Based on the commencement of the aforementioned peeping operation and the extraction of the set of attributes, the AI ​​engine applies a spatial effect to the set of attributes and renders the set of attributes to which the spatial effect has been applied. The system that causes the execution of the above.

2. The system according to claim 1, wherein the set of attributes corresponding to the media stream includes any or a combination of audio data, video data, and conference-related data.

3. The system according to claim 1, wherein the one or more stages represent tasks associated with the meeting participant, and each stage of the one or more stages corresponds to a predefined task associated with the meeting participant.

4. The system according to claim 3, wherein the AI ​​engine is configured to assign privileged roles to at least a first meeting participant and at least a second meeting participant, the privileged roles being assigned to control access to the one or more stages, the assignments being performed automatically based on the media streams of each meeting participant and real-time queries generated by the meeting participants taking their respective roles into consideration, and the at least first and second meeting participants having the assigned privileged roles controlling tasks generated in the multiple stages.

5. The system according to claim 4, wherein, upon confirmation of the assignment of the privileged roles to the first and second meeting participants, the system transmits a first set of data packets indicating confirmation of the assignment of the meeting participants, and in response, the meeting participant's computer transmits a second set of data packets indicating acceptance of the confirmation.

6. The system according to claim 4, wherein at least the first and second meeting participants, who have been assigned the privileged roles, enter a predefined stage of the plurality of stages based on a predefined set of rules, and the remaining meeting participants without privileged roles participate in all of the plurality of stages.

7. The system according to claim 1, wherein the roles are assigned to each of the meeting participants based on a set of predefined role requirement rules.

8. The system according to claim 1, wherein a media mixer server is operablely coupled to the system, and the media mixer server is configured to combine the media streams associated with each of the conference participants into a single media stream.

9. The system according to claim 1, wherein when at least one of the first meeting participants requests the commencement of the snooping operation, the system transmits a third set of data packets indicating the request by at least one of the first meeting participants to commence the snooping operation, and in response thereto, the computing device of at least one of the first meeting participants transmits a fourth set of data packets indicating an acknowledgment of the request.

10. The system according to claim 1, wherein participants in the first stage interact with other participants in the first stage, and participants in the second stage interact with other participants in the second stage.

11. The system according to claim 10, wherein at least the first conference participant in the first stage interacts with at least the second conference participant in at least the second stage or higher through the initiation of a snooping operation by at least the first conference participant, and the at least the first conference participant returns to the first stage after the completion of the snooping operation.

12. The system according to claim 11, wherein, once an eavesdropping operation initiated by at least the first conference participant for at least the second stage or higher is permitted, the conference participants for at least the second stage or higher receive a media stream associated with at least the first conference participant who initiated the eavesdropping operation.

13. The system according to claim 12, wherein if eavesdropping is permitted to at least the first conference participant in the second stage or higher, the media stream in the second stage or higher changes, the effects related to the media streams of multiple conference participants belonging to the second stage or higher decrease, and the effects related to the media stream of at least the first conference participant in the second stage or higher increase.

14. A method for enhancing spatial conference calls, wherein the method is Receiving a set of data packets related to each conference participant from multiple computing devices associated with each conference participant, Identifying one or more stages via an AI engine, wherein the meeting participants are associated with one or more stages through the roles assigned to each of the meeting participants, The AI ​​engine initiates a peeping action permitted to at least a first meeting participant, wherein at least the first meeting participant peeks at one or more stages based on the assigned role and permission to peeping, and the initiation of the action. Extracting a set of attributes from the set of data packets via the AI ​​engine, wherein the set of attributes corresponds to a media stream associated with the conference participant, and the set of attributes is processed based on signaling criteria and permitted snooping behavior, Based on the commencement of the aforementioned peeping operation and the extraction of the set of attributes, the AI ​​engine applies a spatial effect to the set of attributes and renders the set of attributes to which the spatial effect has been applied. The method, including the method described above.

15. The method according to claim 14, wherein the set of attributes corresponding to the media stream includes any or a combination of audio data, video data, and conference-related data.

16. The method according to claim 14, wherein the one or more stages represent tasks associated with the meeting participant, and each stage of the one or more stages corresponds to a predefined task associated with the meeting participant.

17. The method according to claim 16, wherein the AI ​​engine is configured to assign privileged roles to at least a first meeting participant and at least a second meeting participant, the privileged roles being assigned to control access to the one or more stages, the assignments being performed automatically based on the media streams of each meeting participant and real-time queries generated by the meeting participants taking their respective roles into consideration, and the at least first and second meeting participants having the assigned privileged roles controlling tasks generated in the multiple stages.

18. The method according to claim 17, wherein, upon confirmation of the assignment of the privileged roles to the first and second conference participants, the method transmits a first set of data packets indicating confirmation of the assignment to the conference participants, and in response, the conference participant's computer transmits a second set of data packets indicating acceptance of the confirmation.

19. The method according to claim 17, wherein at least the first and second meeting participants assigned the privileged roles enter a predefined stage of the plurality of stages based on a predefined set of rules, and the remaining meeting participants without privileged roles participate in all of the plurality of stages.

20. The method according to claim 14, wherein the roles are assigned to each of the meeting participants based on a set of predefined role requirement rules.

21. The method according to claim 14, wherein a media mixer server is operably coupled to the method, and the media mixer server is configured to combine the media streams associated with each of the conference participants into a single media stream.

22. The method according to claim 14, wherein, upon request by at least the first conference participant to initiate the snooping operation, the method transmits a third set of data packets indicating the request by at least the first conference participant to initiate the snooping operation, and in response thereto, the computing device of at least the first conference participant transmits a fourth set of data packets indicating an acknowledgment of the request.

23. The method according to claim 14, wherein multiple meeting participants belonging to the first stage interact with other meeting participants in the first stage, and multiple meeting participants belonging to the second stage interact with other meeting participants in the second stage.

24. The method according to claim 23, wherein at least the first conference participant in the first stage interacts with at least the second conference participant in at least the second stage or higher through the initiation of a snooping action by at least the first conference participant, and the at least the first conference participant returns to the first stage after the completion of the snooping action.

25. The method according to claim 24, wherein when an eavesdropping operation initiated by at least the first conference participant for at least the second stage or higher is permitted, the conference participants for at least the second stage or higher receive a media stream associated with at least the first conference participant who initiated the eavesdropping operation.

26. The method according to claim 25, wherein if at least the first conference participant is permitted to eavesdrop on the second or later stages, the media stream of the second or later stages changes, the effects associated with the media streams of the multiple conference participants belonging to the second or later stages decrease, and the effects associated with the media stream of at least the first conference participant increase for the second or later stages.

Images