DEVICE FOR CREATING A COMMUNICATION AND CONTROL ENVIRONMENT FOR A TECHNICAL WORK ENVIRONMENT

DE502021010611D1Active Publication Date: 2026-06-25GEORG AUGUST UNIVERSITAT GOTTINGEN STIFTUNG OFFENLICHEN RECHTS

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
GEORG AUGUST UNIVERSITAT GOTTINGEN STIFTUNG OFFENLICHEN RECHTS
Filing Date
2021-12-09
Publication Date
2026-06-25

AI Technical Summary

Technical Problem

Existing communication systems in technical environments, such as operating rooms, lack flexibility and dynamic adaptation to changing situations, leading to suboptimal communication quality due to static matrix control and ambient noise interference.

Method used

A computer-based communication device with a mixing unit, intercom devices, and a control matrix that dynamically adjusts information flow based on ambient sound levels and spectral analysis, using a control program to amplify or suppress sound and adapt to user-specific needs and operational triggers.

Benefits of technology

Enhances communication quality by ensuring sufficient signal separation from ambient noise and adapting to changing conditions, providing a dynamically optimized audio environment for users.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

AREA OF INVENTION

[0001] The present invention relates to a device for creating a communication and control environment for a technical working environment. TECHNICAL BACKGROUND

[0002] When working in a technical environment such as an operating room, one problem is that many people and devices involved need to be coordinated, and information needs to be exchanged, evaluated, and decisions made between the people and devices involved.

[0003] This task is still largely accomplished today by the people involved using voice communication, without machine support.

[0004] To optimize communication between participants, DE 10 2015 205 463 A1 proposes creating a program-controlled audio environment using a mixer and connected intercom units, which allows, for example, the formation of signal groups. A matrix defines which participants can communicate with each other and in which direction. Hierarchical levels, for instance, can be represented in the matrix.

[0005] In addition, overlapping groups are provided. Thresholds are revealed above which information is forwarded or not forwarded. Directional information is also measured and used to control audio output.

[0006] However, the matrix that controls communication in DE 10 2015 205 463 A1 is essentially static. Therefore, an object of the invention is to further develop the device from DE 10 2015 205 463 A1 in such a way that it exhibits greater flexibility.

[0007] US 2009 / 0299924 A1 discloses a human-machine interface for increasing "situational awareness" in a surgical operating room. SUMMARY OF THE INVENTION

[0008] The present invention is defined in independent claim 1. The dependent claims define embodiments of the invention.

[0009] According to one aspect, the invention comprises a device for creating a computer-based communication environment for a technical work environment, comprising: A mixing device to which a plurality of devices are connected, the plurality of devices comprising: A plurality of intercom devices with a microphone and an audio output, each assigned to a person in the technical work environment, preferably a surgical operating room; wherein the mixing device with the plurality of intercom devices controls, for each pair of two intercom devices connected to the mixing device, whether and in which direction a flow of information is allowed between the two connected intercom devices; wherein a control matrix is ​​provided for controlling the information flow, which has a matrix entry for each pair of devices connected to the mixing device that defines the information flow, wherein the device further comprises: a measuring microphone for measuring the ambient sound, which measures the sound level in the room;and wherein the mixing device comprises: a computer-implemented control program executed by the mixing device, which dynamically adapts the matrix entries to the current situation in the technical working environment depending on the data supplied to the mixing device by the connected devices, wherein the device comprises: a gate for each of the microphones of the intercom devices, which can amplify or suppress the sound entering at one of the microphones of the intercom devices for transmission to the audio outputs of other intercom devices;wherein the control program is designed such that the amplification or suppression of the sound entering at one microphone and being output to the audio outputs of the other intercom devices is dynamically adjusted by the gate depending on the analysis of the ambient sound measured by the measuring microphone, wherein the mixing device controls the gate at at least one of the intercom devices such that it forwards the incoming sound to audio outputs of the other intercom devices from a certain minimum sound level, wherein the minimum sound level is adjusted depending on the sound level of the room measured by the measuring microphone.

[0010] In this way, the device can dynamically react to changing situations in the technical work environment and adjust the signal flow accordingly. In particular, an audio environment can be created in which a dynamically adapted and optimized audio environment is provided to a user via their audio output.

[0011] Dynamic adjustment ensures a sufficient signal distance between a user's speech and the ambient noise, thus improving communication quality.

[0012] According to one embodiment, a user's voice is then played into their own audio output when it reaches the minimum sound level and is then passed on to the audio outputs of the other users.

[0013] In this way, the user notices when their microphone is "muted" and can then speak louder if necessary to reach the dynamically adjusted minimum sound level.

[0014] According to one embodiment, the mixing device further comprises: An analysis device for the spectral analysis of the sound received at the measuring microphone, wherein the mixing device is designed such that, upon detection of a predetermined spectral pattern by the gate of an intercom device, one or more spectral components corresponding to the detected spectral pattern are amplified or suppressed.

[0015] In this way, unwanted signals can be dynamically suppressed or desired signals amplified, adapting to the ambient sound.

[0016] According to one embodiment, the mixing device further comprises: A device for feeding the ambient sound recorded by a measuring microphone into the audio output of one or more of the intercom devices.

[0017] In this way, the user can, if desired or necessary, perceive the real ambient sound within the protected audio environment and step out of the protected environment.

[0018] According to one embodiment, the sound level at which the ambient signal is fed into the audio output is dynamically adjusted in response to a user request or an external trigger signal detected by an analysis unit of the mixing device.

[0019] This allows for adaptively adjusted playback of the natural audio environment in response to a user request or an external signal as a triggering event.

[0020] According to one embodiment, an individual hearing correction curve is stored in the device for one or more users.

[0021] In this way, the device can implement a user-specific hearing aid in addition to its other functionality.

[0022] According to one embodiment, the technical working environment comprises one of the following: a surgical operating room; a production room of an industrial manufacturing facility; a laboratory for the scientific or industrial analysis of chemical or physical processes or substances; a control room for monitoring or controlling an industrial production process; an open-plan office; a conference environment.

[0023] According to one embodiment, when the signals received by the mixing device from connected devices indicate a trigger signal, the matrix data is changed. This allows for the creation of a dynamically adaptable device that adjusts to changing conditions.

[0024] According to one embodiment, the control program includes information about the timing of the operation in the operating room, and based on this information, when an input signal from the sensor data indicates a trigger event representing the occurrence of an event in the timing of the operation, the control matrix is ​​adjusted.

[0025] The mapping of the operational schedule allows for dynamic adaptation of the control matrix to the respective situation in the operating room, depending on the progress of the operation, and it is possible to react automatically according to the course of the operation.

[0026] Based on this information, if the signals received by the mixing device from connected devices indicate that a certain point in the time sequence has been reached, a change in the matrix data can be made.

[0027] For example, a signal indicating a specific surgical step, such as the request for the stapler, can signal that the surgery is almost over and, by adjusting the matrix elements, trigger, for example, the request for personnel to assist with positioning.

[0028] According to one embodiment, one of the following serves as the trigger signal: The reaching of a signal value in one or more sensor data points indicating the attainment of a specific point in the time sequence; the reaching of a threshold value in one or more sensor data points; the detection of a keyword or key signal in a captured acoustic signal; user input for learning a new situation.

[0029] In this way, various adjustments to the control matrix and thus to the functionality of the device can be implemented in response to changing external conditions.

[0030] In one embodiment, the control program is implemented wholly or partially using a neural network that receives signals from multiple sensors as input and provides the control matrix as output. The neural network is preferably trained using data from real-world operational situations, thus continuously adapting to user needs and new circumstances.

[0031] In one embodiment, the input signals of the control matrix comprise speech signals which are captured by means of speech recognition and examined for keywords, wherein a keyword represents a trigger signal.

[0032] In this way, adjustment of the control matrix can be implemented using voice control.

[0033] In one embodiment, the connected sensors, in particular by means of a barcode or QR code, identify the function of a user within a user group and, based on the function of the user, only those data are transmitted from the mixing device to the user that are relevant according to his function and a hierarchy or function plan. DESCRIPTION OF THE FIGURES

[0034] Fig. 1 schematically shows a device according to an embodiment of the invention. DETAILED DESCRIPTION

[0035] The present invention is described below with reference to exemplary embodiments and the accompanying drawings.

[0036] Fig. 1 Figure 1 schematically shows a device according to an embodiment of the invention. The circular element in the center of Fig. 1This is a mixing device to which intercom systems (not shown) of a plurality of users A, B, C,...n are connected.

[0037] The mixing device controls, for each pair of connected intercom units, whether and in which direction information can flow between the two connected intercom units. A control matrix is ​​provided for this purpose to regulate the information flow. Fig. 1 referred to as the SOTOS matrix, which has a matrix entry for each pair of devices connected to the mixing device, defining the information flow.

[0038] The device also includes a measuring microphone (not shown) for measuring ambient sound, which measures the sound level in the room.

[0039] According to one embodiment, the mixing device receives sensor data, for example about the condition of the operating room (air pressure, temperature, humidity, possibly the room geometry measured using, for example, LIDAR), but especially also the input signals from the microphones of the intercom systems and the measuring microphone.

[0040] The mixing device can, for example, include active and / or passive filters, or filters implemented using AI. The input signals are processed by the mixer via the control matrix, and output signals are generated as a result. These output signals can be, for example, speech signals, as defined by the control matrix as a controlled signal flow, and transmitted to users via intercoms. However, according to specific embodiments, they can also be alarm signals, music, etc. Additional elements such as the SOTOS database, an extender, or an operating protocol may be included and will be described later.

[0041] The intercom system preferably consists of a combination of a highly soundproof headphone (over-the-ear or in-ear) that effectively isolates the wearer from ambient noise. Such a headphone is preferably combined with a microphone to form a headset, the microphone preferably being a directional microphone with its pickup pattern directed towards the user. This creates a "protected audio experience space" for the user, ensuring that each user only receives the audio signals intended for them by the mixing device.

[0042] The intercom units, one for each user in the operating room, are connected to the mixing device, as mentioned. The mixing device then controls whether and in which direction information can flow between a pair of connected intercom units. A control matrix (SOTOS matrix in [reference missing]) is used to manage this information flow. Fig. 1 ), which has a matrix entry for each pair of intercoms connected to the mixing device, defining the information flow.

[0043] The device further includes a measuring microphone for measuring ambient sound, which measures the sound level in the room. The mixing device, in turn, has a computer-implemented control program executed by the mixing device, which dynamically adapts the matrix entries to the current situation in the technical working environment, depending on the data supplied to the mixing device by the connected devices. The measuring microphone is preferably arranged centrally in the room (e.g., on the ceiling) and is also sensitive to infrasound (<10 Hz) and suprasonics (>20 kHz) in order to detect disturbances in this frequency range.

[0044] To adjust the information flow via the matrix entries, a gate is provided for each of the intercom microphones. This gate can amplify or suppress the sound entering the microphone of each intercom before it is transmitted to the audio outputs of other intercoms. The control program is designed so that the amplification or suppression of the sound entering a microphone and being output to the audio outputs of other intercoms is dynamically adjusted by the gate based on the analysis of the ambient sound measured by the measuring microphone.

[0045] This allows for a dynamic response to changes in ambient sound.

[0046] For example, in one embodiment, the mixing device controls the microphone gate at at least one of the intercom units so that it only forwards the incoming sound to the audio outputs of the other intercom units once a certain minimum sound level is reached. This minimum sound level is adjusted based on the ambient sound level measured by the measuring microphone. For instance, if the ambient sound level increases, the minimum sound level at the microphone of the intercom unit is raised, and only when the user's speech volume is higher is it forwarded to the audio outputs of the other users. This ensures that the forwarded audio information, or speech, maintains a minimum signal separation from the ambient noise, thus improving communication quality.

[0047] According to one embodiment, a user's voice is played back into their own audio output when it reaches the minimum sound level and is then forwarded to the audio outputs of other users. This provides the user with feedback as to whether their voice meets the minimum sound level required for transmission. Depending on this feedback, they can then speak louder, if necessary, to ensure they reach the minimum sound level and that other users can hear them. Only when the minimum sound level is reached is their voice transmitted; below this level, their microphone is muted, so their voice is not audible to other users. This method ensures high communication quality, particularly in environments with variable ambient noise or where the user is mobile and moving around.

[0048] According to one embodiment, the "gate" can function in the sense of a conventional "noise gate," either completely allowing the sound entering the microphone to pass through to the audio output of one or more of the other intercom devices or completely blocking it. That is, the gate is either "on" or "off," depending on the ambient sound or ambient sound pressure level measured by the measuring microphone.

[0049] In addition to a simple "on" or "off" state, one embodiment of the gate can amplify or suppress the input signal depending on the input signal strength at the measuring microphone or the microphone of the intercom system, optionally with a non-linear relationship between amplification / suppression and input signal strength. This allows the dynamic range of the input signal to be increased (enhancer function) or decreased (compressor function). According to another embodiment, the gate can also perform a limiter function, restricting the output to a maximum signal strength. Additionally or alternatively, the output audio signal can be regulated to a specific minimum signal strength to ensure good audibility. By combining one or more such gate functionalities, the speech quality at the audio outputs can be optimally adjusted.

[0050] According to one embodiment, the device comprises an analysis device for the spectral analysis of the sound received by the measuring microphone. The mixing device is designed such that, upon detection of a predetermined spectral pattern by the gate of an intercom system, one or more spectral components corresponding to the detected spectral pattern are amplified or suppressed.

[0051] In this way, unwanted noises are suppressed by dynamically adjusting the control matrix. For example, the noise when opening a sterile package has a characteristic spectral component above 22 kHz. According to one embodiment, the corresponding pattern is stored in the mixing device. If the spectral analysis device detects such an unwanted signal in the sound from the measuring microphone, the gate of the intercom microphone can either suppress or filter out the unwanted signal component. Alternatively, it can completely mute the intercom microphone if spectral suppression is not sufficiently effective. Once the unwanted noise ceases, the suppression or muting can be lifted.

[0052] Besides complete suppression of the unwanted noise, partial suppression is also possible. For example, a saw in a surgical operating room has a characteristic frequency spectrum in the 5-8 kHz range. If this part of the spectrum is detected in the input sound, the control matrix can be adjusted so that the frequency components of the saw noise are somewhat suppressed or attenuated using equalizer control. This reduces the disturbing effect of the noise, but it is still perceptible.

[0053] In addition to suppressing unwanted noise, the mixing device can also be designed to amplify important or desired sounds that should be clearly audible. For example, an electronic knife (eKnife) in the operating room has a characteristic spectral component at 507 Hz. If this is detected, it can be selectively amplified by the mixing device for individual users, such as the surgeon. This may be accompanied by a slight suppression of other spectral components, such as speech. In this way, the audibility of important sounds can be enhanced for the user.

[0054] The measuring microphone, whose signal triggers the dynamic adjustment of the control matrix, can be a microphone located in the room to measure ambient noise or the microphone of the user's intercom. The measuring microphone can vary depending on the adjustment required. For example, a room microphone can be used to measure ambient noise to adjust the minimum level of the intercom. Conversely, the microphone of the intercom itself can be used to identify the opening of a sterile package and subsequently suppress the noise or mute the intercom microphone.

[0055] According to one embodiment, the mixing device includes a means for feeding the ambient sound recorded by a measuring microphone into the audio output of one or more of the intercom units. The ambient sound can thus be played back to the user to simulate a "normal outside sound".

[0056] Preferably, the sound level at which the ambient signal is fed into the audio output is dynamically adjusted in response to a user request or an external trigger signal detected by an analysis unit of the mixing device. In this way, for example, a user can "leave" the protected audio environment upon request (e.g., by pressing a button) without removing their headphones. A specific detected signal, such as an alarm signal, could serve as the external trigger signal.

[0057] Overall, any desired and dynamically adaptable audio environments can be generated via the mixing device and the control matrix, defined in terms of who hears what and whom, and in what way.

[0058] According to one embodiment, the measuring microphone for measuring ambient sound is preferably mounted centrally in the room, for example on the ceiling, and is separate from the microphones of the intercom systems. However, according to another embodiment, the microphone of one or more intercom systems can also function as the measuring microphone, either additionally or alternatively.

[0059] According to one embodiment, an individual hearing correction curve is stored in the device for one or more users. The audio output at the user's intercom is then controlled by the mixing device in such a way that the audio signal output to the user is adjusted according to the stored hearing correction curve. In this way, the device essentially implements a hearing aid adapted to the respective user.

[0060] Further examples of implementation are described below, whose features may be implemented in addition to or as an alternative to the features described so far.

[0061] According to another embodiment, signal processing and the control matrix can be optimized using an optimization module and user feedback. For example, certain frequency-dependent gains or suppressions can be modified by altering the corresponding frequency response of a filter or amplifier of a gate.

[0062] Using the mixing device described above, precisely defined acoustic conditions can be modeled or modified with a pool of preferably active acoustic filters for implementing the gates, such that unwanted frequency components are suppressed or other (desired or missing) components are amplified. The (active) filter dynamically adapts to the noise characteristics. For example, an FFT can be used to define, capture, and automatically filter out background noise in detail. Furthermore, according to one embodiment, an AI filter is provided as a component of the active filter. This AI filter uses neural networks to respond to the needs of the team members and provides input for the active filters.Here, for example, effects that improve speech comprehension and are optimized for listening can be generated, as well as effects of automated "listening" by compensating for delay differences between various microphone setups within the team. The AI ​​filter can be actively stimulated by the user via a kind of "potentiometer" as an "optimizer" and / or trained through the experiences of team members.

[0063] In this way, not only can the acoustic signal flow between users be controlled via the intercom systems, but it can also be adaptively adjusted and improved.

[0064] According to one embodiment, such an adaptation of the functionality to new circumstances involves an adjustment or change to the matrix data of the control matrix. This can be triggered by a "trigger event" that causes such an adjustment of the matrix data. The trigger event can be user input, for example, for "learning" a new situation. A trigger signal can also be the reaching of a signal value in one or more sensor data points or in a signal captured by the measuring microphone, indicating the attainment of a specific point in time; the reaching of a threshold value in one or more sensor data points or in the signal from the measuring microphone; or the detection of a keyword or key signal in a captured acoustic signal (e.g., resulting from speech recognition).

[0065] In this way, the control matrix can be modified and the functionality of the device adapted to the new circumstances.

[0066] According to one embodiment, the following can serve as a trigger signal: Sound data captured by the measuring microphone, sensor data from connected sensors; video data or image data from image recognition; speech data from speech recognition.

[0067] Fig. 1 Figure 1 schematically shows, as already mentioned, the control matrix (SOTOS matrix) of the control program of the device according to an exemplary embodiment.

[0068] In this matrix, the system's central control functions are implemented according to one exemplary embodiment, specifically defining who hears whom or what, and in what form, via their intercom. A matrix entry defines, for example, the type and extent to which information is output or forwarded from a connected subscriber or device X to another subscriber or device Y. A corresponding matrix entry is provided for each connected subscriber or for each pair of connected subscribers and / or devices. The matrix entry can also be complex and correspond to a processing rule according to which input data is processed or converted and output data is generated.The matrix entry thus defines in particular who hears whom in what form and how captured sound signals are forwarded to the users via their respective audio output devices.

[0069] According to one embodiment, another component of the system is the SOTOS extender, which can be connected to the SOTOS matrix. This then forms an additional control matrix, which, for example, an external team can implement. The SOTOS extender thus represents an extension system for the device.

[0070] According to one example implementation, a protocol server records all output signals, logs them, monitors the process, generates a log file, and distributes the information to a database (represented as a SOTO-DB). This database then connects to, for example, a digital hospital warehouse (DWH).

[0071] The input signals of the control matrix can be, according to one exemplary embodiment: Acoustic content (verbal or tonal, noises, sequences of tones or sounds that can be described temporally, music of various genres, coded or compressed sound carriers), also electrical states and processes (e.g. voltages, currents, impulses, temporal sequences, switch states) or electronically coded content (e.g. programming languages, hexadecimal codes, character strings, mathematical formulas).

[0072] Speech signals can be captured, for example, using speech recognition and examined for keywords, which can then serve as a trigger event for adjusting the control matrix.

[0073] Using the described embodiment, an environment can be created in the operating room that provides the user with a protected experiential space. This protected experiential space can be achieved by using (occlusive) hearing systems to isolate the user from the loud, acoustically information-filled environment through active and passive noise cancellation, each implemented via the control matrix.

[0074] Active noise suppression in the system can be static or dynamic, whereby the changing noise situation in the work environment is controlled by algorithms to change the noise filters. In this case, the changing noise situation acts as the "trigger signal" for adjusting the control matrix.

[0075] As previously described, according to one embodiment, gates (or noise gates) can control the opening and closing of the microphones used in the intercom system. In one embodiment, these gates are designed such that, in addition to a static basic setting, the opening thresholds are automatically influenced by a control algorithm.

[0076] The control of these gates within the system can be designed so that the integration of surrounding machinery allows for the predictive (in anticipation of future noise levels) adjustment of thresholds or acoustic filters (transients) in real time. An operational sequence can be mapped in the control program, with a sensor signal indicating the occurrence of an event within this sequence. This event can then act as a trigger, for example, raising the gate thresholds (corresponding to an adjustment of the control matrix) because, for instance, a "noisy device" is switched on according to the operational sequence. This immediate reaction can lead to optimized noise protection tailored to human needs.

[0077] A protected experiential space can also be achieved by suppressing or amplifying other possible sensory perceptions in order to use them individually with information relevant to the experiential space. Sensory perceptions can include not only auditory but also visual and tactile, or...

[0078] These are vibration perceptions; the output signals of the control matrix then control corresponding actuators.

[0079] The function of the device and control matrix is ​​described in more detail below, according to an exemplary embodiment.

[0080] Fig. 2This illustrates the functionality of the device and the control matrix according to an exemplary embodiment. First, the work environment is configured using a graphical user interface (GUI) and loaded into the main module of the control program (represented as the SOTOS matrix or control matrix). The scenario, users, possible visual and acoustic signals, and acoustic filters are configured and adapted to the work environment. The control program, with its control matrix, then manages the information. Specifically, the acoustic channels are monitored and managed on a user-specific basis. Visual, acoustic, and mechanical inputs (alarm / information) are distributed to the respective participants. The entire acoustic performance is supported by the AI ​​acoustic module, which, for example, implements adaptable filters.Active filters are instantly trained, thus optimizing the acoustic working environment for each user. The system can also react to unforeseen noises (e.g., bangs, airplanes, etc.) and filter them, among other things providing intelligent, dynamic, real-time hearing protection that automatically adapts to the environment. This is particularly possible when the parameters of the control matrix have already been configured or "trained" accordingly by storing the relevant spectral patterns. This ensures that the stress level for the user is reduced to the absolute minimum.

[0081] According to one example implementation, the control program includes a connection to external communication systems. An AI module and a logging module run throughout the system's entire operating phase. The AI ​​module monitors and learns (e.g., through user feedback), thus becoming increasingly adept at detecting unexpected noises with each use. The logging module monitors the process, creates a log, and updates the digital patient database.

[0082] According to one embodiment, the device represents or implements a digital model of the operating room environment that is as comprehensive as possible. This model captures and creates a self-learning control system that includes people, machines, all circumstances and influencing factors that determine the work process, and spatial conditions. The control program incorporates information about the timing of the operation in the operating room. Based on this information, the control matrix is ​​adjusted whenever a sensor input signal indicates a trigger event—representing the occurrence of an event in the operational sequence.

[0083] In this way, the device knows the objective of the work process to be controlled. According to one embodiment, the following parameters are used as input parameters for the control matrix, which may be detected by means of sensors: a) Verbal communication packets of all team members (who is speaking, how loud, etc.) b) Traffic of team members (barcodes) Identification of team roles c) Traffic of equipment, devices, tools d) Parameters of the climatic work environment and adjacent areas, i.e., information on temperature, pressure, pressure gradients to the environment, status of doors (open / closed), light, humidity e) Status of relevant technology in the work environment (measurements, settings, condition, maintenance times, safety, runtime, maintenance time, interactions, ...) f) Dimension or status of ongoing procedures and processes (timeline, productivity, dependencies on other processes, feedback management) h) Speech content (index words for process assessment and control of dependent processes, voice control of technology, processes, documentation) i) Video and images (facial recognition, e.g., also via barcode), assessment of situations and processes to identify dependent processes (e.g., ...anesthesiologist enters the room) and to control, documentation, video conferences, video calls j) overall hierarchy of processes, people, higher management, schedules, material planning k) acoustic feedback from machines and activities (working noises, engine noises, tool noises, tire noises, gearboxes, fans, l) health data of people in the work environment (ECG, respiration, body temperature, blood pressure, SaO2, CO2 toxins, color temperature, posture, physical strain, movement) .

[0084] The device's control program records, evaluates, interprets, controls, plans, and provides feedback to users in the work area, controlling interaction with technology (e.g., switching on the ECG), air conditioning, door states, etc. According to one embodiment, the system can also warn (alarm signal), guide (e.g., through visual information), and place orders (request a transport bed).

[0085] The numerous sensors and their data are collected and processed by the control matrix or control program, which then produces output according to the program's instructions for transmission to users or for controlling devices. For example, a machine that is overheating, making certain noises, and drawing more power can be made to slow down. Or a person who hasn't taken a break in a long time, is tachycardia, breathing rapidly and heavily, and has experienced rare bouts of diaphragmatic breathing is exhausted and at risk of making mistakes, and is warned.

[0086] This is made possible by the sensor data and its processing by the control program and its adaptable control matrix, as well as by the mapping of the surgical procedure within the control program. For example, the request for the stapler in the operating room indicates that the skin is closed and the operation is about to be completed, which then triggers dependent processes such as calling in personnel for patient positioning assistance. According to one embodiment, the patient's condition is also recorded, e.g., as a digital representation comprised of numerous data points: vital signs, lab results, current medication doses administered per unit of time, ventilation parameters, and predicted duration of the operation. Depending on the sensor data, the control matrix or the control program then generates corresponding output, which is passed on to the users of the operating room or controls its functional devices.

[0087] In addition to its application to the technical work environment of an operating room, as described above, the approach described can also be applied to other technical work environments. These include, for example, industrial manufacturing environments and laboratories. A "technical work environment" is defined as an environment where information must be transmitted and channeled between a large number of people, and where human-machine interaction takes place through the control or monitoring of measuring, monitoring, or processing devices.

[0088] In an industrial manufacturing environment, the data acquired by the sensors and fed into the mixing device then includes, for example, acoustic feedback from machines, particularly operating noises, motor noises, tool noises, or signals from other sensors. Certain threshold values ​​can then serve as trigger signals. For example, a pallet is monitored by a sensor. If the pallet at the machine is full according to the sensor signal (which acts as a trigger signal), a new one is ordered in a timely manner via the control matrix and corresponding output channels.

Claims

1. A device for creating a computer-assisted communication environment for a technical working environment, comprising: a mixing device to which a plurality of devices can be connected, wherein the plurality of devices comprise: a plurality of intercom devices having a microphone and an audio output, each assigned to a person in the technical working environment, preferably a surgical operating room; wherein the mixing device is adapted to control, for each pair of two intercom devices connected to the mixing device, whether and in which direction a flow of information between the two connected intercom devices is enabled; wherein, for controlling the flow of information, a control matrix is provided, which has, for each pair of devices connected to the mixing device, a matrix entry defining the flow of information, wherein the device further comprises: a measurement microphone for measuring ambient sound, which is adapted to measure the sound level in the room; and wherein the mixing device comprises: a computer-implemented control program executed by the mixing device, which is adapted to dynamically adapt the matrix entries to the current situation in the technical working environment as a function of the data supplied to the mixing device by the connected devices, wherein the device comprises: a gate for each of the microphones of the intercom devices, which is adapted to amplify or attenuate the sound entering one of the microphones of the intercom devices for forwarding to the audio outputs of other intercom devices; wherein the control program is designed such that the amplification or attenuation of the sound entering a microphone and to be output to the audio outputs of the other intercom devices by the gate is dynamically adapted as a function of the analysis of the ambient sound measured by the measurement microphone, characterised in that the mixing device is adapted to control the gate at at least one of the intercom devices such that it forwards the incoming sound to the audio outputs of the other intercom devices only above a certain minimum sound level, wherein the mixing device is adapted to adapt the minimum sound level as a function of the sound level of the room measured by the measurement microphone.

2. The device according to claim 1, wherein the device is adapted to feed the speech of a user into the user's own audio output when it reaches the minimum sound level and is forwarded to the audio outputs of the other users.

3. The device according to any one of the preceding claims, wherein the gate is adapted, preferably as a function of the input signal, to perform one or more of the following functions: completely blocking or completely passing the input signal entering the microphone to the audio output of one or more of the other intercom devices; amplifying or attenuating the input signal, preferably in a non-linear relationship between amplification or attenuation and input signal strength; limiting the output signal to a maximum signal strength and / or outputting the output signal with a minimum signal strength.

4. The device according to any one of claims 1 to 3, wherein the mixing device further comprises: an analysis device for spectral analysis of the sound entering the measurement microphone, and wherein the mixing device is adapted, upon detection of a predetermined spectral pattern, to amplify or attenuate, by means of the gate of an intercom device, one or more spectral components corresponding to the detected spectral pattern.

5. The device according to any one of claims 1 to 4, wherein the mixing device further comprises: a device for feeding the ambient sound recorded by the measurement microphone into the audio output of one or more of the intercom devices.

6. The device according to claim 5, wherein the device is adapted to dynamically adjust the sound level at which the ambient signal is fed into the audio output in response to a user request or to an external trigger signal detected by an analysis device of the mixing device.

7. The device according to any one of claims 1 to 6, wherein an individual hearing correction curve for one or more users is stored in the device and the mixing device is adapted to control the audio output at the intercom device of the user such that the audio signal output to the user is adapted in accordance with the stored hearing correction curve.

8. The device according to any one of claims 1 to 7, wherein the plurality of devices connectable to the mixing device comprises: a plurality of functional units configured for fully or partially automated execution of a function in the technical working environment; a plurality of sensors configured to capture parameters of the state of the technical working environment, of functional units present in the technical working environment, and parameters of the state of persons present in the technical working environment; wherein the mixing device is adapted to control which information is output from the mixing device to one of the connected devices.

9. The device according to any one of claims 1 to 8, wherein the technical working environment is one of the following: a surgical operating room; a production facility of an industrial manufacturing process; a laboratory for scientific or industrial analysis of chemical or physical processes or substances, a control room for monitoring or controlling an industrial production process, an open-plan office, a conference environment.

10. The device according to any one of claims 8 or 9, wherein the device is adapted, when the signals received in the mixing device from connected devices indicate a trigger signal, to perform a modification of the matrix data.

11. The device according to any one of claims 1 to 10, wherein the working environment is an operating room and the control program comprises information relating to the temporal sequence of the operation in the operating room and, on the basis of this information, when an input signal of the sensor data indicates a trigger event representing the occurrence of an event in the temporal sequence of the operation, the control matrix is adapted.

12. The device according to any one of claims 10 or 11, wherein the trigger signal comprises one of the following: the reaching of a signal value in one or more sensor data indicating that a specific point in the temporal sequence has been reached; the reaching of a threshold value in one or more sensor data; the detection of a keyword or key signal in a captured acoustic signal; a user input for learning a new situation.

13. The device according to any one of the preceding claims, wherein the control program is implemented wholly or partially by means of a neural network, which receives, as input, signals from the plurality of sensors and provides, as output, data of the control matrix.

14. The device according to any one of the preceding claims, wherein the input signals of the control matrix comprise speech signals which are captured by means of speech recognition and analysed for keywords, wherein a keyword represents a trigger signal, wherein one or more of the following serve as trigger signals for adapting the control matrix: sensor data from connected sensors; video data or image data from image recognition; speech data from speech recognition.

15. The device according to any one of the preceding claims, wherein the data captured by the sensors and input into the mixing device comprise: acoustic feedback from machines, in particular operational noises, engine noises, or tool noises, or wherein connected sensors, in particular by means of a barcode or QR code, identify the function of a user within a user group and, based on the function, only those data are transmitted by the mixing device to the user which are relevant according to the user's function and a hierarchy or functional plan.