5D motion theater playing control method and device, equipment and storage medium
By installing multimodal physiological sensors on 5D cinema seats, audience physiological parameters are collected in real time and safety thresholds are calculated. The intensity of seat movements is dynamically adjusted, which solves the safety hazards and experience quality problems of audiences with different physical conditions, and realizes personalized safety control and immersive experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- GUANGZHOU YIDONG NETWORK TECH
- Filing Date
- 2026-05-08
- Publication Date
- 2026-06-09
AI Technical Summary
The existing playback control methods of 5D cinemas cannot adapt to the individual differences of viewers of different ages and physical conditions, resulting in safety hazards and a decline in the quality of experience.
By setting up a multimodal physiological sensor array on the seats to collect physiological parameters such as the audience’s weight, heart rate and respiratory rate in real time, a safety tolerance model is used to calculate personalized safety thresholds, dynamically adjust the intensity of seat movements, and adopt group collaborative control in multi-person scenarios to ensure the safety tolerance of all audience members.
It enables dynamic adjustment of seat movement intensity based on the audience's real-time physiological state, improving the audience's safety and experience quality, and avoiding safety hazards and decreased experience caused by unsuitable intensity.
Smart Images

Figure CN122172531A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of 5D cinema technology, and in particular to a playback control method, device, equipment and storage medium for a 5D motion cinema. Background Technology
[0002] 5D motion cinema is an immersive viewing experience built upon traditional 3D stereoscopic cinema, adding motion seats and environmental effects such as wind, rain, fog, and scents. While watching a 3D movie, the seats tilt, sway, and vibrate in sync with the plot, and environmental effects are triggered simultaneously, creating a truly immersive experience.
[0003] Currently, most mainstream 5D cinema playback control methods employ a preset script synchronous triggering mode: during film production, technicians manually annotate keyframes on the timeline to set corresponding seat motion parameters and environmental effect instructions; during playback, the player polls each execution device according to a fixed timecode, sequentially issuing preset instructions. This mode is essentially a unidirectional, static, and feedback-free open-loop control.
[0004] However, this traditional model still has some drawbacks: First, 5D cinemas cater to audiences of different ages and physical conditions, including children, teenagers, adults, and the elderly. The preset seat motion intensity is designed based on the tolerance of a "standard adult male," which is not suitable for the elderly and children, and cannot adapt to individual differences and tolerance levels, posing a safety hazard. Second, it cannot respond to real-time changes in the audience's physiological state, causing viewers to continue receiving high-intensity stimulation even when they are already experiencing discomfort, resulting in a sharp decline in the quality of the experience. Summary of the Invention
[0005] To address at least one of the aforementioned technical problems, the present invention provides a playback control method, apparatus, device, and storage medium for a 5D motion cinema.
[0006] In a first aspect, the present invention provides a playback control method for a 5D motion cinema, the method comprising:
[0007] A multimodal physiological sensor array mounted on the motion seat collects the spatial position information and at least two physiological parameters of the current audience member in real time; the physiological parameters include weight, heart rate, and respiratory rate; the number of audience members is at least one.
[0008] Physiological parameters are input into a preset safety tolerance model to calculate the safety tolerance threshold of the audience at the current moment; the safety tolerance threshold is used to characterize the maximum intensity of movement that the audience can withstand under the current physiological state.
[0009] Obtain a preset 5D motion script, which contains multiple motion instructions arranged in chronological order, and each motion instruction corresponds to a preset motion intensity.
[0010] Based on the safety tolerance threshold, the preset action intensity of subsequent action instructions to be executed is dynamically adjusted to generate the adjusted actual execution intensity.
[0011] Control the motion seat to perform corresponding actions according to the actual intensity of the action.
[0012] Preferably, the multimodal physiological sensor array comprises:
[0013] A flexible pressure sensor array positioned under the seat cushion is used to detect the weight distribution and real-time changes in the sitting posture of the audience.
[0014] Photoelectric volumetric sensors installed on the inside of the seat armrests are used to detect the audience's real-time heart rate;
[0015] Miniature millimeter-wave radar sensors installed inside the seat headrests are used for non-contact detection of the audience's breathing rate;
[0016] A depth camera or structured light sensor mounted above the seat is used to collect the spatial coordinates and posture of key points on the viewer's body. The spatial position information includes body tilt angle, center of gravity offset, and limb position.
[0017] Preferably, the safety tolerance model specifically includes:
[0018] Establish a mapping relationship between the audience's basic tolerance threshold and weight, and determine the current audience's basic tolerance threshold based on the mapping relationship and the current audience's weight;
[0019] Calculate the current fatigue coefficient based on heart rate and respiratory rate parameters:
[0020] ;
[0021] In the formula, This represents the current fatigue coefficient. , Preset weighting coefficients; , These are heart rate parameters and respiratory rate parameters, respectively. , These are resting heart rate and resting respiratory rate, respectively.
[0022] Calculate the current posture coefficient based on the spatial location information:
[0023] ;
[0024] In the formula, This is the current pose coefficient, with a value range of (0,1]. As a preset posture influence factor, This is a comprehensive measure of the body's deviation from the standard sitting posture, calculated based on the body's tilt angle and center of gravity shift.
[0025] Calculate the current safe tolerance threshold based on the current baseline tolerance threshold, current fatigue coefficient, and current posture coefficient:
[0026] ;
[0027] In the formula, Based on the basic safety tolerance threshold, As the current safety tolerance threshold, This represents the fatigue effect coefficient.
[0028] Preferably, the step of dynamically adjusting the preset action intensity of subsequent action commands to be executed based on a safety tolerance threshold includes:
[0029] Get the preset action intensity of the action command to be executed. Compare preset motion intensity Compared with the current safety tolerance threshold Size:
[0030] like The actual execution intensity ;
[0031] like The actual execution intensity ,in This is the compensation coefficient, with a value ranging from 0.2 to 0.5.
[0032] Preferably, when multiple viewers are watching a film simultaneously, the method further includes a group collaborative control step, comprising:
[0033] Calculate the safety tolerance threshold for each audience member separately, and take the minimum value as the group safety tolerance threshold.
[0034] The intensity of movement of all seats is adjusted uniformly according to the group's safety tolerance threshold.
[0035] Preferably, the method further includes:
[0036] The system monitors the audience's physiological parameters in real time. If the heart rate exceeds the first preset threshold or the respiratory rate exceeds the second preset threshold, the emergency protection mode is immediately triggered. The system suspends the execution of all subsequent action commands and slowly restores the seat to its initial reclining position. At the same time, the system asks the audience via voice prompt whether they need to stop watching the movie.
[0037] Secondly, the present invention also provides a playback control device for a 5D motion cinema, the device comprising:
[0038] The parameter acquisition module is used to collect the spatial position information of the current audience member and at least two physiological parameters in real time through a multimodal physiological sensor array installed on the motion seat; the physiological parameters include weight parameters, heart rate parameters, and respiratory rate parameters; the number of audience members is at least one.
[0039] The tolerance analysis module is used to input physiological parameters into a preset safety tolerance model and calculate the safety tolerance threshold of the audience at the current moment; the safety tolerance threshold is used to characterize the maximum intensity of action that the audience can withstand under the current physiological state.
[0040] The script acquisition module is used to acquire a preset 5D action script, which contains multiple action instructions arranged in chronological order, and each action instruction corresponds to a preset action intensity.
[0041] The intensity adjustment module is used to dynamically adjust the preset intensity of subsequent action commands to be executed based on the safety tolerance threshold, and generate the adjusted actual execution intensity.
[0042] The instruction execution module is used to control the motion seat to perform corresponding actions according to the actual execution intensity.
[0043] Thirdly, the present invention also provides an electronic device including a processor and a memory, the memory being used to store computer program code, the computer program code including computer instructions, wherein when the processor executes the computer instructions, the electronic device performs the method as described in the first aspect above and any possible implementation thereof.
[0044] Fourthly, the present invention also provides a computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a processor of an electronic device, cause the processor to perform a method as described in the first aspect above and any possible implementation thereof.
[0045] Compared with the prior art, the beneficial effects of the present invention are as follows:
[0046] This invention quantifies the audience's current physiological tolerance limits using a safety tolerance model, and dynamically constrains the intensity of actions accordingly, establishing a proactive safety protection mechanism. This changes the "one-size-fits-all" playback mode. The device can calculate a personalized safety threshold based on each audience member's spatial location information and real-time physiological data, including weight, heart rate, and respiratory rate, and adjust actions accordingly to match the experience intensity with individual physical conditions, balancing comfort and immersion. In multi-person scenarios, the "weakest link" principle is adopted, uniformly adjusting the intensity based on the lowest safety tolerance threshold for the entire audience, ensuring the basic safety of all audience members, especially those in the weakest physical condition, and avoiding the problem of ignoring the tolerance of some audience members in pursuit of effect. The dynamic adjustment algorithm does not simply weaken excessive actions to the safety threshold, but introduces a compensation coefficient for smoothing, maintaining the original intensity variation trend and rhythm of the action script as much as possible while ensuring safety, reducing the interruption of the immersive experience caused by safety interventions.
[0047] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0048] To more clearly illustrate the technical solutions in the embodiments of the present invention or the background art, the accompanying drawings used in the embodiments of the present invention or the background art will be described below.
[0049] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the specification, serve to illustrate the technical solutions of this disclosure.
[0050] Figure 1 A flowchart illustrating a playback control method for a 5D motion cinema provided in an embodiment of the present invention;
[0051] Figure 2 This is a schematic diagram of the structure of a playback control device for a 5D motion cinema provided in an embodiment of the present invention. Detailed Implementation
[0052] To enable those skilled in the art to better understand the present invention, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0053] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or devices.
[0054] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.
[0055] Please see Figure 1 , Figure 1 This is a flowchart illustrating a playback control method for a 5D motion cinema provided in an embodiment of the present invention. Figure 1 As shown, the method includes:
[0056] S10. Using a multimodal physiological sensor array mounted on the motion seat, the spatial position information of the current audience member and at least two physiological parameters are collected in real time; the physiological parameters include weight, heart rate, and respiratory rate; the number of audience members is at least one.
[0057] S20. Input physiological parameters into a preset safety tolerance model to calculate the safety tolerance threshold of the audience at the current moment; the safety tolerance threshold is used to characterize the maximum intensity of movement that the audience can withstand under the current physiological state.
[0058] S30. Obtain a preset 5D action script, wherein the 5D action script contains multiple action instructions arranged in chronological order, and each action instruction corresponds to a preset action intensity.
[0059] S40. Based on the safety tolerance threshold, dynamically adjust the preset action intensity of subsequent action instructions to be executed, and generate the adjusted actual execution intensity.
[0060] S50: Control the dynamic seat to perform corresponding actions according to the actual intensity of execution.
[0061] In existing 5D cinemas, the preset seat motion intensity is designed based on the tolerance level of a "standard adult male," which is not friendly to audiences such as the elderly and children. It cannot adapt to individual differences and tolerance differences among audiences, posing safety risks. At the same time, it cannot cope with changes in the audience's real-time physiological state, causing audiences to continue to receive high-intensity stimulation when they are already uncomfortable, resulting in a sharp decline in the quality of the experience.
[0062] To address this, this embodiment provides a playback control method for a 5D motion cinema, shifting from a "fixed script-driven" approach to a "human-centered closed-loop adaptive control." The aim is to establish a feedback control device that integrates real-time perception, dynamic evaluation, and intelligent adjustment. This method uses the audience's physiological state and spatial location information as core input variables, allowing seat movements to dynamically adapt to each audience member's real-time tolerance. In implementation, a multimodal sensor array is deployed at key seat locations (seat cushion, armrests, headrest) to non-intrusively and synchronously collect key physiological signals such as the audience member's weight distribution, heart rate, and respiratory rate. The collected physiological parameters are input into a preset safety tolerance model. This model uses weight as a basic tolerance benchmark, combined with real-time changes in heart rate and respiratory rate relative to the resting state, to calculate a "fatigue coefficient," dynamically determining the maximum safe action intensity threshold that the audience member can currently withstand. The device reads a preset 5D action script and compares the preset intensity of each action command with the real-time calculated individual safety threshold before execution. Through a specific dynamic adjustment algorithm, commands exceeding the safety threshold are smoothly weakened to generate the actual execution intensity. In multi-person scenarios, the minimum safety threshold of all viewers is taken as the group standard to achieve collaborative safety. Simultaneously, the device continuously monitors physiological parameters. Once it detects an abnormal heart rate or breathing exceeding the safety limit, it immediately triggers an emergency protection mode, pausing actions and restoring the seats to a safe state. Thus, through a safety tolerance model, the device no longer assumes all viewers have the same "standard adult male" tolerance. The model can calculate personalized safety limits based on each viewer's specific physiological data (e.g., underweight children, elderly people with slow heart rate recovery), fundamentally eliminating safety hazards caused by uniform intensity. Furthermore, the device can sense real-time physiological changes in viewers during the viewing process (e.g., increased heart rate due to tension, increased breathing due to fatigue). When the model calculates a decrease in a viewer's real-time tolerance, the device can immediately reduce the intensity of subsequent actions, avoiding continued high-intensity stimulation when viewers are already feeling uncomfortable, achieving dynamic protection.
[0063] In one embodiment, weight, heart rate, and respiratory rate parameters are collected because body mass is a fundamental physical factor for withstanding physical acceleration and inertial forces. Heavier viewers typically have greater mass and inertia, resulting in a significantly different distribution of internal stress under the same intensity of movement compared to lighter viewers (such as children). Weight parameters provide a static, personalized calibration starting point for the safety model, ensuring that the baseline of the safety threshold aligns with the viewer's basic physical condition, directly addressing the issue of a "standard adult male" design failing to accommodate children, the elderly, and other different weight groups. During exercise or under stress, sympathetic nerve excitation leads to a significant increase in heart rate. Tension, fright, or strenuous activity during a movie viewing directly cause an increase in heart rate. Sustained high heart rate or abnormal heart rate fluctuations are direct signals of excessive strain on cardiovascular devices, mental stress, or potential discomfort. When emotionally agitated, physically tense, or uncomfortable, breathing becomes rapid and shallow. Changes in respiratory rate sensitively reflect the viewer's overall stress level and accumulated fatigue. By continuously monitoring these two dynamic parameters and comparing them to an individual's resting baseline, the device can quantitatively assess the audience's current physiological arousal level, fatigue coefficient, and even potential risk level. This solves the problem of being unable to respond to real-time changes in the audience's state, allowing the device to provide early warning and intervention before the audience feels significant discomfort (manifested as increased heart rate and respiratory rate). Therefore, body weight provides a static baseline for individual tolerance, while heart rate and respiratory rate provide dynamic feedback on real-time load. The combination of these three parameters constitutes a complete physiological profile from static physical condition to dynamic response, providing scientifically sound and necessary multi-dimensional data input for subsequent accurate calculation of the "safe tolerance threshold."
[0064] In one embodiment, the multimodal physiological sensor array includes:
[0065] A flexible pressure sensor array positioned under the seat cushion is used to detect the weight distribution and real-time changes in the sitting posture of the audience.
[0066] Photoelectric volumetric sensors installed on the inside of the seat armrests are used to detect the audience's real-time heart rate;
[0067] Miniature millimeter-wave radar sensors installed inside the seat headrests are used for non-contact detection of the audience's breathing rate;
[0068] A depth camera or structured light sensor mounted above the seat is used to collect the spatial coordinates and posture of key points on the viewer's body. The spatial position information includes body tilt angle, center of gravity offset, and limb position.
[0069] Furthermore, in order to collect the physiological parameters mentioned in step S10, the following method is used:
[0070] Weight and Posture Detection: A flexible pressure sensor array (e.g., using piezoresistive or capacitive sensors) is embedded beneath the seat cushion. This array consists of multiple densely distributed sensor units. Once seated, the array accurately measures the pressure distribution, thereby calculating the spectator's total weight. More importantly, it monitors changes in pressure distribution in real time, inferring the spectator's real-time posture (e.g., upright, leaning to the side, leaning forward, etc.). Drastic or unstable changes in posture may be early behavioral signals of discomfort with the current movement.
[0071] Heart rate parameter detection: An integrated photoelectric volumetric sensor is placed on the inside of the armrest (where the palm rests naturally) or at a specific location where the seat cushion contacts the thigh. This sensor emits light of a specific wavelength (typically green light, sensitive to changes in blood flow) into the skin and detects the intensity of reflected or transmitted light. As the heart pumps blood periodically, the blood volume in the subcutaneous capillaries pulsates synchronously, causing changes in light absorption. By processing this optical signal, real-time heart rate and heart rate variability information can be extracted.
[0072] Respiratory rate parameter detection: A miniature millimeter-wave radar sensor is embedded inside the seat headrest, facing the back of the viewer. The radar emits extremely low-power millimeter-wave signals and receives signals reflected back from the viewer's body (mainly the chest and back). Because breathing causes periodic micro-movements in the chest cavity, it alters the phase and frequency of the reflected signals. Using advanced signal processing algorithms (such as Fourier transform and filtering), real-time respiratory rate and depth can be calculated with high precision and non-contact.
[0073] A depth camera is installed above the theater seats to collect real-time 3D skeletal data of the audience. First, camera calibration is performed to determine its spatial transformation relationship with the seat's reference coordinate system. During playback, the camera captures the spatial coordinates of 20 key points on the audience's body (such as the head, shoulders, hips, and knees) at a preset frame rate. Based on these coordinates, the device calculates: body tilt angle (the angle between the torso and the vertical axis), center of gravity offset (the horizontal displacement of the hip center point relative to the seat center point), and limb positions (the deviation distance of the hands and feet relative to the seat armrests or footrests).
[0074] Finally, the raw analog signals collected by the aforementioned sensors will be preprocessed and initially calculated by the microcontroller built into the seat, packaged into a structured physiological parameter data package, and uploaded in real time to the central playback control device of the cinema via wired or wireless Bluetooth, Wi-Fi, etc., for use in the model calculation of the subsequent step S20.
[0075] In one embodiment, step S20 requires the multimodal physiological parameters collected in real time in step S10 to be dynamically converted into a value that characterizes the current tolerance limit of the audience and can be directly used by the control device, namely the safety tolerance threshold, through a preset quantitative calculation model.
[0076] Establish a mapping relationship between the audience's basic tolerance threshold and weight, and determine the current audience's basic tolerance threshold based on the mapping relationship and the current audience's weight;
[0077] Calculate the current fatigue coefficient based on heart rate and respiratory rate parameters:
[0078] ;
[0079] In the formula, This represents the current fatigue coefficient. , Preset weighting coefficients; , These are heart rate parameters and respiratory rate parameters, respectively. , These are resting heart rate and resting respiratory rate, respectively.
[0080] Calculate the current posture coefficient based on the spatial location information:
[0081] ;
[0082] In the formula, This is the current pose coefficient, with a value range of (0,1]. As a preset posture influence factor, This is a comprehensive measure of the body's deviation from the standard sitting posture, calculated based on the body's tilt angle and center of gravity shift.
[0083] Calculate the current safe tolerance threshold based on the current baseline tolerance threshold, current fatigue coefficient, and current posture coefficient:
[0084] ;
[0085] In the formula, Based on the basic safety tolerance threshold, As the current safety tolerance threshold, This represents the fatigue effect coefficient.
[0086] After the audience is seated and before the film begins, the installation performs the following initialization operations:
[0087] 1) Model parameter initialization and personal baseline calibration:
[0088] Establish a baseline tolerance mapping table: A "weight-basal tolerance threshold" is pre-stored in the device database or obtained through machine learning training. "Mapping table or function. This mapping is usually non-linear, for example: setting different base thresholds for different weight ranges (such as children <30kg, 30-60kg, adults >60kg, etc.) to ensure that the threshold settings conform to the common sense of ergonomics and biomechanics."
[0089] Determine the weighting coefficient: Preset heart rate weighting coefficient and respiratory rate weighting coefficient (For example, after experimental calibration, set) =0.7, =0.3), to reflect the difference in the contribution of heart rate and respiration to the "fatigue / stress" state.
[0090] Obtaining a personal resting baseline: The device keeps the seat stationary for 30-60 seconds, and the heart rate is collected during this period. and respiratory rate The data were analyzed, and their average values were calculated to represent the viewer's resting heart rate during the movie screening. and individual resting breathing rate Store the data for later use. If the customer is a repeat customer and historical data is available, it can be quickly retrieved to shorten preparation time.
[0091] 2) Real-time safety tolerance threshold Calculation process:
[0092] During video playback, the device performs the following calculation steps in a loop at a high frequency (e.g., 10Hz):
[0093] 2.1) Query / calculate the current baseline tolerance threshold :
[0094] Real-time reading of audience weight values measured by the pressure sensor array, based on pre-stored "weight- "Mapping relationship, query or interpolate to calculate the basic tolerance threshold corresponding to the spectator's physique." This value remains relatively stable during a single viewing session and is only recalculated when the device detects a significant change in the viewer's weight, such as when a viewer is replaced.
[0095] 2.2) Calculate the real-time fatigue / stress coefficient :
[0096] Real-time reading of heart rate from photoelectric sensors and millimeter-wave radar and real-time respiratory rate Substitute The calculation is performed using the formula, where, , These represent the ratios of real-time heart rate and respiratory rate relative to the individual's resting baseline, respectively. A ratio greater than 1 indicates that the body has entered a state of excitement or stress. The calculated... It is a coefficient greater than or equal to 1. A value of 1 indicates that the audience is completely at rest. The higher the value, the higher the level of physiological excitement / stress caused by the film's stimulation, tension, or accumulated fatigue, and the smaller the safe tolerance margin.
[0097] 2.3) Calculate the current posture coefficient :
[0098] Real-time acquisition of the audience's torso tilt angle using a depth camera (Unit: degrees) and horizontal offset of the hip center of gravity (Unit: cm). First, normalization is performed: (Assuming a maximum tilt of 90°) , This refers to the seat width. Therefore, the overall deviation measurement... , usually take , For example, if an audience member's body tilts at a 20° angle and their center of gravity shifts by 5cm, if... =50cm, then =0.222, =0.2, =0.6×0.222+0.4×0.2=0.133+0.08=0.213.
[0099] 2.4) Calculate the final real-time safety tolerance threshold. :
[0100] The calculations obtained from the first three steps and Substitute into the core decision-making formula: ; This is typically a fixed empirical parameter (ranging from 0.2 to 0.5) used to control the degree to which fatigue weakens endurance. When A value of 1 indicates extreme fatigue. The minimum value of the item is It will not decrease to 0. This formula represents the real-time safety limit for spectators. It will vary depending on its physiological stress level The value increases and then decreases dynamically. It also decreases as the overall measurement value of the audience's body deviates from the standard sitting posture. In other words, the more non-standard the audience's sitting posture, the less safe it is.
[0101] 3) Data updates, smoothing, and anomaly handling:
[0102] Real-time updates: , , , and All updates are performed in real time at a high frequency to ensure timely device response.
[0103] Data smoothing: To prevent data loss due to transient interference (such as missed heartbeats or coughing). Violent fluctuations will have the following effects: , and the final calculated Smoothing processes such as moving average filtering are applied.
[0104] Anomaly Handling: If sensor data is briefly lost, the device will maintain the last valid... If the value is missing for an extended period, it will be reduced to a conservative default safety threshold, and a maintenance alert will be issued.
[0105] Finally, the calculated real-time safety tolerance threshold As a continuously changing numerical signal, it is output to the playback control main device in real time, serving as the maximum intensity limit for dynamically adjusting the intensity of each seat movement command in the subsequent step S40. Simultaneously, The value itself is also continuously monitored, such as Exceeding a certain preset warning value or the absolute value of heart rate / respiration exceeding the safety limit, or... If a certain safety threshold is exceeded, the emergency protection procedure will be triggered directly.
[0106] In one embodiment, a 5D motion script is a pre-made digital file that is strictly synchronized with video and audio content. It is typically stored as a structured data file (such as JSON, XML, or a specific binary format) based on a timeline. Each motion instruction contains at least the following core information:
[0107] Timestamp: The trigger time point accurate to the millisecond, aligned with the video playback timeline.
[0108] Action type / code: Defines the type of action, such as "dive", "tilt", "vibrate", "bump", etc., or directly corresponds to the control command code of the seat drive unit (such as servo motor, pneumatic valve).
[0109] Preset action intensity: A normalized intensity value, for example, in the range of 0-1.0, where 1.0 represents the maximum design physical strength of the seat model, representing the target intensity that the instruction is expected to execute in standard mode.
[0110] Before playback begins, the central control unit loads the corresponding 5D motion script file from a storage device (such as a local server) into memory based on the selected movie. The unit parses the script structure and establishes a timestamp-sorted instruction queue in memory, ensuring that instructions are retrieved and executed strictly in chronological order. During movie playback, a high-precision timing module pre-reads upcoming motion instructions from the instruction queue according to the movie playback progress (master clock). To ensure real-time performance, the unit prepares the instructions to be executed and their preset intensity Th0 in advance within a very small time window (e.g., 100-300 milliseconds) and sends them to step S40 for processing. This "look-ahead" mechanism ensures sufficient time for intensity calculation and adjustment without causing delays or stuttering in motion execution. The execution of the motion script must be strictly synchronized with video and audio frames. The control unit typically uses master-slave clock synchronization or timecode-based synchronization technology to ensure that motion instructions are triggered at specified frame moments accurate to the millisecond level. The device is fault-tolerant. If it encounters script data errors or timing deviations, it can smoothly skip or interpolate, preventing the seat from making violent or unexpected erroneous movements.
[0111] Through this step, content creators can freely design scripts containing various intensities and complex movements based on the expected experience of a "standard audience." The structured script provides the device with a precise and predictable sequence of future movements. This allows the device to make "proactive" adjustments—that is, to anticipate the preset intensity of subsequent movements and compare and adjust it with currently calculated safety thresholds—thus achieving smooth, delay-free dynamic intensity control and avoiding abrupt "remedial" adjustments. A command scheduling mechanism based on high-precision timestamps ensures millisecond-level precise synchronization between seat movements and visual and audio effects on the screen. The standardized script format allows the same safety control device to easily adapt to different film content; only the motion script file needs to be changed.
[0112] In one embodiment, step S40, which involves dynamically adjusting the preset action intensity of subsequent action commands based on a safety tolerance threshold, includes:
[0113] Get the preset action intensity of the action command to be executed. Compare preset motion intensity Compared with the current safety tolerance threshold Size:
[0114] like The actual execution intensity ;
[0115] like The actual execution intensity ,in This is the compensation coefficient, with a value ranging from 0.2 to 0.5.
[0116] In this embodiment, the device will and Real-time comparisons are performed, and based on the comparison results, different strategies are used to calculate the actual execution intensity. When the preset strength is within the safe range, that is... This indicates that the original design intensity of the action did not exceed the audience's current physical limits. There is no need to reduce the intensity; it should be executed entirely according to the director's or designer's original intention. At this point, the actual execution intensity... The audience experiences the complete, uncompressed motion effect. When the preset intensity exceeds the safety threshold, that is... This indicates that the original design intensity of the action exceeded the audience's current tolerance level, necessitating adjustments to reduce its intensity to ensure safety. An intelligent compensation algorithm was used for calculation; the formula is as follows: ,in, The calculation is based on the excess ratio, which is the relative amount by which the preset intensity exceeds the safety threshold. It is a preset compensation coefficient (ranging from 0.2 to 0.5). It determines the upper limit of safety. Based on this, how much of the "excess amount" can be added as compensation? The result of the entire formula... The value will be between and between. The larger, The closer (The experience is more exciting, but the risks are slightly increased.) The smaller, The closer (More conservative and safer).
[0117] Finally, the calculated This is immediately converted into a specific control signal (such as voltage, pulse width, valve opening, etc.) and sent to the drive mechanism of the motion seat in step S50. Step S50 will then execute the signal according to the actual intensity of the motion. Control the motion seat to perform corresponding actions. It should be noted that the above process is continuously looped during playback. The device usually uses a "look-ahead window" mechanism to predict and adjust multiple action commands within a short period of time (such as the next second) in advance to ensure a smooth transition and avoid sudden changes in intensity.
[0118] Through this embodiment, by As a rigid upper limit for intensity adjustment, it fundamentally eliminates the possibility of discomfort or risk caused by the intensity of the movement exceeding the audience's real-time physiological tolerance limit. When the audience is in good condition ( At higher intensity levels, one can experience the authentic, intense action. When the audience's workload increases (…), they can also experience the raw, powerful movements. When reducing (the load), for high-intensity actions, the device does not uniformly lower to the minimum safe level. Instead, it is through the compensation coefficient. It provides a smooth, gradient decay. This makes the intensity changes more natural, preserving the "feel" and rhythm of the action to the greatest extent possible while ensuring safety, avoiding sudden "dropouts" or monotony in the experience. It achieves an adaptive and smooth transition from "complete presentation" to "graceful degradation" in the viewing experience, thereby maximizing the immersion and appeal of the 5D motion experience while ensuring absolute safety.
[0119] In one embodiment, when multiple viewers watch a film simultaneously, the method further includes a group coordination control step, comprising:
[0120] Calculate the safety tolerance threshold for each audience member separately, and take the minimum value as the group safety tolerance threshold.
[0121] The intensity of movement of all seats is adjusted uniformly according to the group's safety tolerance threshold.
[0122] This implementation follows the principle that "safety depends on the weakest link." By using the lowest individual safety tolerance threshold as a uniform standard, it ensures that the intensity of movement experienced by every audience member in the theater, regardless of their physical strength or condition, will not exceed their own physiological limits. This fundamentally eliminates the safety risks posed by neglecting the safety of a few vulnerable or unwell individuals in order to cater to the experience of the majority, achieving inclusive safety. Uniform intensity control ensures that the movement of all audience seats is completely synchronized and consistent. This avoids the risk of collisions, confusion, or a fragmented experience that may arise from asynchronous seat movement or unexpected changes in the relative positions of audience members due to differences in individual strength. The dynamic rhythm and intensity changes felt by all audience members are completely consistent, maintaining the collective atmosphere and spatial consistency required for immersive viewing.
[0123] In one embodiment, the method further includes:
[0124] The system monitors the audience's physiological parameters in real time. If the heart rate exceeds the first preset threshold or the respiratory rate exceeds the second preset threshold, the emergency protection mode is immediately triggered. The system suspends the execution of all subsequent action commands and slowly restores the seat to its initial reclining position. At the same time, the system asks the audience via voice prompt whether they need to stop watching the movie.
[0125] Throughout the video playback, in addition to using heart rate and respiratory rate data to calculate the safety tolerance threshold, the device also runs a separate, high-priority emergency monitoring thread in parallel. The device has two preset absolute safety thresholds:
[0126] First preset threshold (maximum heart rate): For example, set to 150 beats / minute, or an extremely high heart rate value calculated based on the age of the audience.
[0127] Second preset threshold (upper limit of respiratory rate): For example, set to 30 breaths / minute.
[0128] The monitoring thread continuously compares the real-time heart rate and respiratory rate with the aforementioned thresholds. Once a condition is met: if the heart rate exceeds the first preset threshold or the respiratory rate exceeds the second preset threshold, a highest-priority emergency interruption signal is immediately generated. Once the trigger condition is met, the device will immediately interrupt the normal playback control process and execute the following protection actions in sequence:
[0129] a) Immediately suspend the execution of the action:
[0130] The central controller sends an emergency stop command to the drive units of all motion seats. Upon receiving the command, the drive units immediately cease any ongoing actions and lock the actuators to prevent any unexpected movements.
[0131] b) The seat gently returns to a safe position:
[0132] The controller invokes a preset "safety recovery program." This program controls all motors or pneumatic devices in the seat to gradually and synchronously move and fix the seat from any possible tilt, pitch, or vibration state back to the initial flat or gently inclined supine position at a very slow and smooth speed (e.g., taking 5-8 seconds). This is a preset "safe posture" that minimizes body load and is least likely to cause discomfort.
[0133] c) Initiate voice prompts and manual confirmation:
[0134] As the seat begins to resume movement, or afterward, a pre-recorded, gentle but clear voice prompt will play through the seat's individual audio channel or overhead speaker, such as: "We have detected that you may be feeling unwell. The seat has paused its movement and returned to a stable position. To stop watching the movie, please press the red button next to the armrest or signal to staff." During the voice prompt, a specific service call light for that seat (such as an armrest indicator light) will flash slowly to alert staff.
[0135] After the protective action is executed, the device enters a waiting state. If the viewer presses the confirmation button or confirms the stop through other means (such as gesture recognition), the device will exit the film playback for that viewer and may turn on the lighting to guide them out of the room. If, within a certain time (e.g., 60 seconds), the viewer's HR and RR data automatically fall below the safe threshold and the viewer does not actively trigger the stop, the device may play a voice prompt again (e.g., "You seem to have recovered. To continue watching the film, please press the confirmation button."). Only after obtaining explicit confirmation from the viewer can playback be gradually resumed from the pause point in a very gentle manner. Regardless of the subsequent handling, the time of this emergency trigger, physiological data, and seat number will be recorded in detail for post-event analysis and equipment maintenance.
[0136] This embodiment provides a top-priority, proactive, ultimate safety barrier, independent of dynamic adjustment devices based on tolerance thresholds, focusing on monitoring physiological signals of absolute danger. Upon detecting an abnormal spike in heart rate or respiration (potentially due to underlying health issues, sudden panic, etc.), the experience is immediately interrupted with the highest priority, providing viewers with the last and most reliable line of defense against accidental injury. It does not rely on complex model calculations but responds to extreme situations through direct, rapid, and hard-rule-based responses, endowing the entire 5D motion theater installation with crucial proactive safety capabilities.
[0137] See Figure 2 In one embodiment, the present invention also provides a playback control device for a 5D motion cinema, the device comprising:
[0138] The parameter acquisition module 100 is used to acquire, in real time, the spatial position information of the current audience member and at least two physiological parameters through a multimodal physiological sensor array installed on the motion seat; the physiological parameters include weight parameters, heart rate parameters and respiratory rate parameters; the number of audience members is at least one.
[0139] The tolerance analysis module 200 is used to input physiological parameters into a preset safety tolerance model and calculate the safety tolerance threshold of the audience at the current moment; the safety tolerance threshold is used to characterize the maximum intensity of action that the audience can withstand under the current physiological state.
[0140] The script acquisition module 300 is used to acquire a preset 5D action script, which contains multiple action instructions arranged in chronological order, and each action instruction corresponds to a preset action intensity.
[0141] The intensity adjustment module 400 is used to dynamically adjust the preset intensity of subsequent action commands to be executed based on the safety tolerance threshold, and generate the adjusted actual execution intensity.
[0142] The instruction execution module 500 is used to control the motion seat to perform corresponding actions according to the actual execution intensity.
[0143] It is understood that the functions or modules of the device provided in this embodiment can be used to execute the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.
[0144] The present invention also provides an electronic device including a processor and a memory, the memory being used to store computer program code, the computer program code including computer instructions, wherein when the processor executes the computer instructions, the electronic device performs a method as described in any of the above possible implementations.
[0145] The present invention also provides a computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a processor of an electronic device, cause the processor to perform a method as described in any of the above possible implementations.
[0146] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.
Claims
1. A playback control method for a 5D motion cinema, characterized in that, The method includes: A multimodal physiological sensor array mounted on the motion seat collects the spatial position information and at least two physiological parameters of the current audience member in real time; the physiological parameters include weight, heart rate, and respiratory rate; the number of audience members is at least one. Physiological parameters are input into a preset safety tolerance model to calculate the safety tolerance threshold of the audience at the current moment; the safety tolerance threshold is used to characterize the maximum intensity of movement that the audience can withstand under the current physiological state. Obtain a preset 5D motion script, which contains multiple motion instructions arranged in chronological order, and each motion instruction corresponds to a preset motion intensity. Based on the safety tolerance threshold, the preset action intensity of subsequent action instructions to be executed is dynamically adjusted to generate the adjusted actual execution intensity. Control the motion seat to perform corresponding actions according to the actual intensity of the action.
2. The playback control method for a 5D motion cinema according to claim 1, characterized in that, The multimodal physiological sensor array includes: A flexible pressure sensor array positioned under the seat cushion is used to detect the weight distribution and real-time changes in the sitting posture of the audience. Photoelectric volumetric sensors installed on the inside of the seat armrests are used to detect the audience's real-time heart rate; Miniature millimeter-wave radar sensors installed inside the seat headrests are used for non-contact detection of the audience's breathing rate; A depth camera or structured light sensor mounted above the seat is used to collect the spatial coordinates and posture of key points on the viewer's body. The spatial position information includes body tilt angle, center of gravity offset, and limb position.
3. The playback control method for a 5D motion cinema according to claim 1, characterized in that, The safety tolerance model specifically includes: Establish a mapping relationship between the audience's basic tolerance threshold and weight, and determine the current audience's basic tolerance threshold based on the mapping relationship and the current audience's weight; Calculate the current fatigue coefficient based on heart rate and respiratory rate parameters: ; In the formula, This represents the current fatigue coefficient. , Preset weighting coefficients; , These are heart rate parameters and respiratory rate parameters, respectively. , These are resting heart rate and resting respiratory rate, respectively. Calculate the current posture coefficient based on the spatial location information: ; In the formula, This is the current pose coefficient, with a value range of (0,1]. As a preset posture influence factor, This is a comprehensive measure of the body's deviation from the standard sitting posture, calculated based on the body's tilt angle and center of gravity shift. Calculate the current safe tolerance threshold based on the current baseline tolerance threshold, current fatigue coefficient, and current posture coefficient: ; In the formula, Based on the basic safety tolerance threshold, As the current safety tolerance threshold, This represents the fatigue effect coefficient.
4. The playback control method for a 5D motion cinema according to claim 3, characterized in that, The step of dynamically adjusting the preset action intensity of subsequent action commands to be executed based on a safety tolerance threshold includes: Get the preset action intensity of the action command to be executed. Compare preset motion intensity Compared with the current safety tolerance threshold Size: like The actual execution intensity ; like The actual execution intensity ,in This is the compensation coefficient, with a value ranging from 0.2 to 0.
5.
5. The playback control method for a 5D motion cinema according to claim 1, characterized in that, When multiple viewers are watching a film simultaneously, the method further includes a group coordination control step, including: Calculate the safety tolerance threshold for each audience member separately, and take the minimum value as the group safety tolerance threshold. The intensity of movement of all seats is adjusted uniformly according to the group's safety tolerance threshold.
6. The playback control method for a 5D motion cinema according to claim 1, characterized in that, The method further includes: The system monitors the audience's physiological parameters in real time. If the heart rate exceeds the first preset threshold or the respiratory rate exceeds the second preset threshold, the emergency protection mode is immediately triggered. The system suspends the execution of all subsequent action commands and slowly restores the seat to its initial reclining position. At the same time, the system asks the audience via voice prompt whether they need to stop watching the movie.
7. A playback control device for a 5D motion cinema, characterized in that, The device includes: The parameter acquisition module is used to collect the spatial position information of the current audience member and at least two physiological parameters in real time through a multimodal physiological sensor array installed on the motion seat; the physiological parameters include weight parameters, heart rate parameters, and respiratory rate parameters; the number of audience members is at least one. The tolerance analysis module is used to input physiological parameters into a preset safety tolerance model and calculate the safety tolerance threshold of the audience at the current moment; the safety tolerance threshold is used to characterize the maximum intensity of action that the audience can withstand under the current physiological state. The script acquisition module is used to acquire a preset 5D action script, which contains multiple action instructions arranged in chronological order, and each action instruction corresponds to a preset action intensity. The intensity adjustment module is used to dynamically adjust the preset intensity of subsequent action commands to be executed based on the safety tolerance threshold, and generate the adjusted actual execution intensity. The instruction execution module is used to control the motion seat to perform corresponding actions according to the actual execution intensity.
8. An electronic device, characterized in that, include: A processor and a memory, the memory being used to store computer program code, the computer program code including computer instructions, wherein when the processor executes the computer instructions, the electronic device performs the playback control method of the 5D motion cinema as described in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which includes program instructions that, when executed by a processor of an electronic device, cause the processor to perform the playback control method of the 5D motion cinema according to any one of claims 1 to 6.