SOR optimization system and method for tourism dance immersion experience
By using real-time monitoring and data modeling, the dance stimulation and audience psychological response in tourism dance performances are optimized, solving the problem of audience rhythm overload and visual fatigue in a short period of time in existing technologies, and realizing a personalized and stable immersive experience in dance performances.
Patent Information
- Application Number
- CN202511876185.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-12
- Publication Date
- 2026-01-09
- Estimated Expiration
- 2045-12-12
AI Technical Summary
Existing tourism dance performances lack dynamic models that analyze the relationship between dance stimuli and the audience's psychological endurance in real time, leading to audiences experiencing rhythm overload, visual fatigue, or distorted understanding of meaning within a short period of time, making it difficult to optimize the immersive experience.
By deploying multi-source acquisition devices on the stage and in the audience area, the characteristics of dance stimuli and audience reactions are monitored in real time. A data set of dance stimuli and psychological reactions is constructed, a narrative rhythm-driven curve and a cultural symbol resonance index are established, and psychological load modeling and immersion trigger sensitivity model are used to make closed-loop adjustments to match the audience's psychological carrying capacity.
It achieves dynamic matching of dance performances, enhances the accuracy and personalization of the immersive experience, ensures the safety and cultural identity of the audience, and reduces the risk of decreased attention, emotional fluctuations, or experience overload.
Smart Images

Figure CN121300637A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of tourism culture experience and human-computer interaction, in particular to a SOR optimization system and method for tourism dance immersion experience. BACKGROUND
[0002] As one of the most immersive content forms in the tourism and culture scene, the experience quality of tourism dance performance not only depends on external stimulating factors such as dance movements, music rhythm, visual presentation, but also is significantly affected by internal psychological states such as audience attention, physiological rhythm and emotional dynamic changes. However, the existing tourism performance and stage experience optimization methods mainly rely on stage director experience, crowd feedback statistics or traditional satisfaction evaluation, and lack a dynamic model for real-time analysis of the relationship between dance stimulation and audience psychological carrying capacity. Because dance movement energy peaks, rhythm-intensive sections, symbolic visual elements superimposition and narrative speed have high time resolution and complex coupling, the audience is prone to rhythm overload, visual fatigue or meaning understanding deviation in a short period of time, resulting in immersion chain break, emotional disconnection or experience quality decline.
[0003] The existing dance performance experience control method mainly stays in the experience-based processing of light weakening, rhythm slowing down or adding narrative prompts, lacks quantifiable stimulation-carrying deviation index, and lacks real-time monitoring mechanism for the relationship between cultural symbol presentation and audience understanding ability, and it is difficult to effectively regulate the cognitive load caused by cultural symbol density. SUMMARY
[0004] In view of the deficiencies of the prior art, the present application provides a SOR optimization system and method for tourism dance immersion experience to solve the problems mentioned in the background art.
[0005] To achieve the above purpose, the present application is realized by the following technical scheme: a SOR optimization method for tourism dance immersion experience, comprising the following steps: Step one, real-time monitoring of dance stimulation characteristics and audience psychological and behavioral reaction characteristics during the tourism dance performance; by arranging multi-source collection devices in the stage area and the audience interaction area, respectively acquiring dance stimulation input data and audience reaction data, performing unified time synchronization and structured integration, and constructing a dance stimulation- psychological reaction original data set; Step two, structuring modeling of the data on the dance stimulation side and the audience psychological reaction side, and constructing a narrative rhythm driving curve NDC based on a multi-dimensional stimulation fusion method; then synchronously processing the dance stimulation- psychological reaction original data set, extracting the characteristics of attention, physiological rhythm and emotional fluctuation, constructing an experience carrying capacity model using a psychological load modeling algorithm, and outputting a psychological carrying capacity index ELC representing the audience's bearable stimulation change intensity; Step three, linear fitting the amplitude change of narrative rhythm driving curve NDC within the set time window to obtain the narrative rhythm change rate , combined with the psychological carrying capacity index ELC, the stimulation-carrying deviation index SCI is calculated and compared with the stimulation deviation threshold Sth to determine whether the dance stimulation and the audience's psychological carrying capacity match. If not, appropriate strategies are given; Step four, through the structured analysis and quantitative processing of the visual symbols of dance costumes, movements, lights and scenes, the cultural symbol density CSD representing the intensity of dance cultural symbol presentation is obtained. Combined with the micro-expression change rate ME(t) and the gaze lock duration GL(t), the cultural symbol resonance index CSR is established and compared with the cultural resonance threshold Cth to determine whether the cultural symbol presentation and the audience's cultural understanding level match. If not, appropriate strategies are given; Step five, through multi-modal psychological precursor signal integration and dynamic window analysis, key physiological-emotional coupling features before immersion triggering are extracted, and attention sensitivity AS, physiological rhythm synchronization coefficient PS and emotional response excitation coefficient ES are generated using immersion trigger sensitivity modeling method. The immersion precursor variable index IPV is calculated and compared with the immersion precursor threshold Ith to determine whether the conditions for dance stimulation triggering immersion experience are qualified. If not, appropriate strategies are given. Through the joint feedback of SCI, CSR and IPV and the dynamic correction of narrative rhythm driving curve NDC, closed-loop adjustment of dance stimulation, cultural symbols and psychological precursor state is carried out.
[0006] Preferably, the step one comprises: S11, real-time monitoring of dance stimulation features and audience psychological and behavioral reaction features during the process of tourism dance performance; through laying multiple source collection devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are obtained respectively, including the following steps: By laying visual capture devices including high-speed cameras, depth cameras and motion capture arrays, dancer motion trajectories are analyzed, and instantaneous energy and movement amplitude of dance movements are extracted to generate motion energy sequence E(t); By installing acoustic sensors and beat detection devices, music rhythm analysis algorithm is used to detect the rhythm speed, beat density and rhythm change points of the accompaniment music, and rhythm density RD(t) is extracted; Through stage visual imaging devices including multi-angle cameras, stage light recognition sensors and image semantic recognition models, visual elements of dance costumes, movement symbols, light changes and stage backgrounds are analyzed to obtain visual symbol change rate VSD(t); By acquiring the dance content script, action paragraph sequence and music chapter for synchronous labeling, a narrative paragraph identification algorithm is adopted to establish scene narrative paragraph label Nd; By arranging eye tracking equipment, eye movement instrument, the line of sight landing point and gaze maintenance time of the audience during the performance are detected, and the gaze locking duration GL(t) is collected; By high-precision face capture equipment and micro-expression recognition algorithm, the micro-movement of the facial muscles of the audience is analyzed, and the micro-expression change rate ME(t) is extracted; By wearing physiological signal monitoring equipment including chest strap respiration sensor and wrist heart rate sensor, the respiration rhythm and heart rate change are monitored in real time, and the respiration rhythm difference and heart rate change rate are obtained; By arranging posture capture cameras, pressure-sensitive seats or body motion capture modules, the body swing and micro-resonance behavior of the audience are detected, and the body swing amplitude MB(t) is collected; S12, by time synchronization and structured integration of the collected action energy sequence E(t), rhythm density RD(t), visual symbol change rate VSD(t), narrative paragraph label Nd, gaze locking duration GL(t), micro-expression change rate ME(t), respiration rhythm difference , heart rate change rate and body swing amplitude MB(t), a dance stimulation-mental response original data set is established.
[0007] Preferably, the step two comprises: S21, based on the action energy sequence E(t), rhythm density RD(t), visual symbol change rate VSD(t) and scene narrative paragraph label Nd in the dance stimulation-mental response original data set, the time stamp synchronization alignment method and multi-source data fusion technology are used to uniformly map the instantaneous parameters of different sources to the same time axis; the interpolation and smoothing processing algorithm is used to compensate and continuous processing for the collection gap and sampling frequency difference; S22, by time series feature analysis method, the fluctuation trend of action energy sequence E(t) in continuous period is analyzed, the strong and weak change of action energy in different paragraphs is extracted, and the energy feature is obtained; the rhythm complexity analysis technology is used to structure process the rhythm density RD(t), identify the change of rhythm acceleration section, rhythm deceleration section and rhythm repetition mode, and obtain the rhythm density feature; the visual symbol recognition and change rate statistical method is used to quantify the symbol switching frequency, visual load and symbol richness in visual symbol change rate VSD(t), and obtain the visual symbol feature; based on scene narrative paragraph label Nd, the narrative paragraph label identification algorithm is used to map the dance script, action paragraph and music chapter at paragraph level, and obtain the narrative paragraph structure feature; S23, by the acquired energy features, rhythm density features, visual symbol features and narrative paragraph structure features, a multi-dimensional stimulus fusion modeling method is used to establish a narrative rhythm driving curve NDC.
[0008] Preferably, the step two further comprises: S24, based on the multi-modal psychological response data of the gaze lock duration GL(t), the micro-expression change rate ME(t), the breathing rhythm difference , the heart rate change rate and the body swing amplitude MB(t) in the dance stimulus- psychological response original data set, the changes of attention, physiological state and emotion of the audience under the action of dance stimulus are processed synchronously and aligned; S25, using a gaze stability analysis method, the persistence of the gaze lock duration GL(t) in different narrative paragraphs is quantified to obtain the attention stability interval and attention decay trend of the audience; using a micro-expression fluctuation evaluation technology, the dispersion, local fluctuation amplitude and change frequency of the micro-expression change rate ME(t) are extracted to depict the emotional sensitivity and emotional fluctuation response level of the audience; using a physiological rhythm change analysis method, the time series of the heart rate change rate is adjusted to identify the adjustment trend to obtain the physiological adaptation ability and stress response characteristics of the audience under the change of stimulus intensity; through a posture stability analysis method, the change amplitude, fluctuation frequency and resonance characteristics of the body swing amplitude MB(t) are quantified; and using a breathing rhythm fluctuation modeling method, the rhythm, fluctuation amplitude and change trend of the breathing rhythm difference are analyzed to obtain the breathing regulation ability and psychological load response characteristics of the audience; S26, by the obtained attention stability interval and attention decay trend, the physiological adaptation ability and stress response characteristics of the audience under the change of stimulus intensity and the breathing regulation ability and psychological load response characteristics of the audience, a psychological load modeling algorithm is used to construct an experience bearing capacity model; the experience bearing capacity model analyzes the psychological bearing capacity of the audience to the change of dance stimulus by running, calculates the attention stability, physiological rhythm change amplitude and emotional fluctuation dispersion of the audience, and outputs a psychological bearing capacity index ELC.
[0009] Preferably, the step three comprises: S31, using a sliding window gradient calculation algorithm, the amplitude change of the narrative rhythm driving curve NDC is linearly fitted in a set time window, the local slope is extracted, and the narrative rhythm change rate is obtained, and the stimulus-bearing offset index SCI is calculated after dimensionless processing combined with the psychological bearing capacity index ELC. S32, by presetting a stimulation offset threshold Sth, and comparing and analyzing the stimulation-carrying offset index SCI with the stimulation offset threshold Sth, a first evaluation result is obtained, including: When the stimulation-carrying offset index SCI ≤ the stimulation offset threshold Sth, it indicates that the dance stimulation matches the audience's psychological carrying capacity, and the experience is in a safe immersion state, and no adjustment is made, and continuous monitoring is performed; When the stimulation-carrying offset index SCI > the stimulation offset threshold Sth, it indicates that the dance stimulation does not match the audience's psychological carrying capacity, and there is a risk of immersion offset or experience overload leading to a decline in audience attention, an increase in emotional fluctuations, or physical fatigue, a first warning instruction is triggered, and a first strategy is generated: by reducing the rhythm density RD(t), adjusting the music rhythm, reducing the continuous density of the rhythm paragraph, and relieving the rhythm pressure of the audience; by reducing the visual symbol complexity VSD(t), reducing the stage light change, dance symbol switching and costume color contrast, and reducing the visual stimulation load; by weakening the NDC curve peak paragraph intensity, and in the peak area of the narrative rhythm driving curve, replacing the motion block and adjusting the dance intensity, the overall stimulation level is reduced; by reducing the motion energy E(t), reducing high-intensity movements, adjusting the motion amplitude and rhythm distribution, and keeping the motion energy within the range that the audience can bear; the stimulation-carrying offset index SCI value is updated after adjustment until the stimulation-carrying offset index SCI ≤ the stimulation offset threshold Sth.
[0010] Preferably, the fourth step comprises: S41, based on the visual elements of dance costumes, motion symbols, light changes and stage backgrounds, a cultural symbol semantic coding method is used to structurally analyze the dance costume texture, symbolic motion, scene image and light symbol; through a symbol level decomposition algorithm, the appearance frequency, symbol complexity and symbol superposition relationship of the visual symbol are quantitatively processed to obtain a cultural symbol density CSD representing the degree of presentation of the dance cultural symbol.
[0011] Preferably, the fourth step further comprises: S42, by the obtained cultural symbol density CSD, in combination with the corresponding micro-expression change rate ME(t) and gaze lock duration GL(t), after dimensionless processing, a multi-modal cultural resonance fusion algorithm is used to establish a cultural symbol resonance index CSR; S43, by presetting a cultural resonance threshold Cth, and comparing and analyzing the cultural symbol resonance index CSR with the cultural resonance threshold Cth, a second evaluation result is obtained, including: When the cultural symbol resonance index CSR ≥ the cultural resonance threshold Cth, it indicates that the cultural symbol presentation matches the audience's cultural understanding level, and the experience is in a cultural adaptation state, and continuous monitoring is performed; When the cultural symbol resonance index CSR < the cultural resonance threshold Cth, it indicates that the cultural symbol presents a mismatch with the audience's cultural understanding level, there is a cultural understanding deviation, which causes a decrease in attention, a misreading of meaning, or a break in emotion, affects the continuity of the immersive experience, triggers a second warning instruction, and generates a second strategy: reducing the cultural symbol density CSD, reducing complexity or multi-layer symbol superposition; increasing the narrative prompt paragraph, including action semantic reinforcement, background image suggestion or formation migration prompt; transferring the cognitive pressure caused by the load cultural symbol by enhancing the rhythm flow; simplifying the symbol action structure, making the visual presentation guiding and reducing information decoding difficulty, adjusting, updating the cultural symbol resonance index CSR value until the cultural symbol resonance index CSR ≥ the cultural resonance threshold Cth.
[0012] Preferably, the step five comprises: S51, based on the gaze lock time GL(t), micro-expression change rate ME(t), respiration rhythm difference , heart rate change rate and body swing amplitude MB(t) in the dance stimulation- psychological response original data set, using a multi-modal psychological precursor signal integration method, the attention, physiological rhythm and emotional response are unified in time alignment; through continuous dynamic window analysis algorithm, the short-term peak value, change gradient and response acceleration of each parameter are analyzed, and the key physiological-emotional coupling characteristics before immersion triggering are extracted; S52, based on the key physiological-emotional coupling characteristics before immersion triggering, through the immersion triggering sensitivity modeling method, the attention sensitivity coefficient AS, the physiological rhythm synchronization coefficient PS and the emotional response excitation coefficient ES are extracted respectively; the specific steps include: Based on the short-time stability of the gaze lock time GL(t) and the gaze shift rate, using the gaze dynamic sensitivity analysis method, the attention sensitivity coefficient AS is obtained; Using the physiological rhythm change analysis method, the phase synchronization of the heart rate change rate and the respiration rhythm difference is fitted, the synchronization degree in the stimulation growth paragraph is calculated, and the physiological rhythm synchronization coefficient PS is obtained; Using the micro-expression fluctuation evaluation technology, the change acceleration, peak density and local high response section of the micro-expression change rate ME(t) are extracted, the potential immersion triggering ability is quantified, and the emotional response excitation coefficient ES is obtained.
[0013] Preferably, the step five further comprises: S53, through the extracted attention sensitivity coefficient AS, physiological rhythm synchronization coefficient PS and emotional response excitation coefficient ES, after non-dimensional processing, using a multi-factor immersion precursor fusion algorithm, the immersion precursor variable index IPV is calculated. S54, by presetting the immersion precursor threshold Ith, and comparing the immersion precursor variable index IPV with the immersion precursor threshold Ith, a third evaluation result is obtained, including: When the immersion precursor variable index IPV is greater than or equal to the immersion precursor threshold Ith, it indicates that the conditions for triggering the immersive experience by dance stimulation are qualified, and the audience reaches the immersion precursor state, and the monitoring is continued. When the immersion precursor variable index IPV is less than the immersion precursor threshold Ith, it indicates that the conditions for triggering the immersive experience by dance stimulation are not qualified, and the audience does not reach the immersion precursor state, and there is a risk of insufficient immersion start, insufficient experience input, and scattered attention, a third warning instruction is triggered, and a third strategy is generated: reducing the rhythm complexity RD(t), reducing unnecessary rhythm disturbance, and avoiding excessive stimulation jumps; by reducing the symbol density of the visual symbol change rate VSD(t), the visual content coherence is improved; by reducing the amplitude of the action energy E(t), the action rhythm and the audience's psychological state are rebalanced; the buffer scene in the narrative paragraph is increased to strengthen the content understanding and gradually guide the audience to return to the immersion precursor state, and the calculation is adjusted until the immersion precursor variable index IPV is greater than or equal to the immersion precursor threshold Ith. S55, after updating the immersion precursor variable index IPV, the stimulation-carrying offset index SCI, the cultural symbol resonance index CSR, and the immersion precursor variable index IPV are fed back jointly, and the narrative rhythm driving curve NDC is corrected synchronously, and a dynamic control mechanism for immersive experience is adopted to continuously monitor and closed-loop adjust the dance stimulation intensity, the cultural symbol presentation degree, and the psychological precursor state; when the stimulation-carrying offset index SCI, the cultural symbol resonance index CSR, and the immersion precursor variable index IPV are all in the stable interval, an immersive enhancement instruction is output to make the dance performance enter a stable immersive experience state.
[0014] Preferably, a SOR optimization system for tourism dance immersive experience includes: A multi-source data acquisition module is used to monitor the dance stimulation characteristics and the psychological and behavioral reaction characteristics of the audience in real time during the dance performance; by arranging multi-source acquisition devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are obtained respectively, unified time synchronization and structured integration are performed, and a dance stimulation- psychological reaction original data set is constructed; A narrative rhythm and psychological load modeling module is used to structure model the data on the dance stimulation side and the audience psychological reaction side, and construct a narrative rhythm driving curve NDC based on a multi-dimensional stimulation fusion method; the dance stimulation- psychological reaction original data set is processed synchronously, the characteristics of attention, physiological rhythm, and emotional fluctuation are extracted, an experience carrying capacity model is constructed by using a psychological load modeling algorithm, and a psychological carrying capacity index ELC is output to represent the audience's bearable stimulation change intensity; The stimulation-carrying matching evaluation module is used for linear fitting of the amplitude change of the narrative rhythm driving curve NDC within a set time window to obtain a narrative rhythm change rate , in combination with a psychological carrying capacity index ELC, a stimulation-carrying offset index SCI is calculated and compared with a stimulation offset threshold Sth to determine whether the dance stimulation matches the psychological carrying capacity of the audience, and if not, corresponding strategies are given. The cultural symbol resonance evaluation module is used for structured analysis and quantitative processing of visual symbols of dance costumes, movements, lights and scenes to obtain a cultural symbol density CSD representing the presentation intensity of the cultural symbols, in combination with a corresponding micro-expression change rate ME(t) and a gaze lock duration GL(t), a cultural symbol resonance index CSR is established and compared with a cultural resonance threshold Cth to determine whether the presentation of the cultural symbols matches the cultural understanding level of the audience, and if not, corresponding strategies are given. The immersion precursor regulation module is used for extracting key physiological-emotional coupling features before the immersion trigger through multi-modal psychological precursor signal integration and dynamic window analysis, and generating attention sensitivity AS, physiological rhythm synchronization coefficient PS and emotional response excitation coefficient ES using an immersion trigger sensitivity modeling method to calculate an immersion precursor variable index IPV and compare it with an immersion precursor threshold Ith to determine whether the conditions for triggering the dance stimulation to experience immersion are qualified, and if not, corresponding strategies are given.
[0015] The present application provides a kind of SOR optimization system and method of tourism dance immersion experience.There are the following beneficial effects: (1) The SOR optimization system and method of tourism dance immersion experience, through multi-source data acquisition and synchronous processing, the dance stimulation characteristics and audience psychological behavior reaction are unified time alignment, realize the fine description of attention, physiological rhythm and emotional fluctuation, make dance performance can dynamically match audience psychological carrying capacity, significantly improve the precision and individualization of immersive experience.
[0016] (2) The SOR optimization system and method of tourism dance immersion experience, through narrative rhythm driving curve modeling, cultural symbol density analysis and cultural symbol resonance index evaluation, the presentation effect of dance action, light, costume and scene symbol can be quantified, the dynamic regulation of rhythm and cultural elements is realized, so as to enhance the understanding and cultural identity of audience to dance content.
[0017] (3) The SOR optimization system and method for tourism dance immersion experience can establish a dynamic regulation mechanism for immersion experience by jointly feeding back SCI, CSR and IPV and synchronously correcting the narrative rhythm driving curve, can adjust the stimulation intensity, cultural symbol presentation and psychological precursor state in real time during the dance performance, and realizes the continuity, stability and safety of the immersion experience.
[0018] (4) The SOR optimization system and method for tourism dance immersion experience can automatically trigger early warning instructions and generate optimization strategies such as adjusting the action energy, visual symbol complexity and rhythm density based on the threshold comparison analysis of stimulation-carrying matching, cultural resonance and immersion precursor indicators, effectively reduces the risk of audience attention decline, emotional fluctuation or experience overload, and improves the performance management and audience experience safety. BRIEF DESCRIPTION OF DRAWINGS
[0019] Figure 1 It is a tourism dance immersion experience SOR optimization method step schematic diagram of the application; Figure 2 It is a tourism dance immersion experience SOR optimization system block diagram flow chart of the application. DETAILED DESCRIPTION
[0020] The technical solutions in the embodiments of the application will be described clearly and completely below with reference to the drawings in the embodiments of the application. Obviously, the described embodiments are only part of the embodiments of the application, rather than all the embodiments. Based on the embodiments in the application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the application.
[0021] Embodiment 1 Please refer to Figure 1 The application provides a SOR optimization method for tourism dance immersion experience, comprising the following steps: Step one, real-time monitoring of the dance stimulation characteristics and the psychological and behavioral reaction characteristics of the audience during the tourism dance performance; by arranging multi-source collection devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are obtained respectively, unified time synchronization and structured integration are performed, and a dance stimulation-mental reaction original data set is constructed; Step two, structuring modeling of the data on the dance stimulation side and the audience psychological reaction side, and constructing a narrative rhythm driving curve NDC based on a multi-dimensional stimulation fusion method; then, the dance stimulation-mental reaction original data set is synchronously processed, the characteristics of attention, physiological rhythm and emotional fluctuation are extracted, an experience carrying capacity model is constructed by using a psychological load modeling algorithm, and a psychological carrying capacity index ELC for representing the change intensity of the stimulation that the audience can bear is output. Step three, linear fitting is performed on the amplitude change of the narrative rhythm driving curve NDC within the set time window to obtain the narrative rhythm change rate , in combination with the psychological bearing capacity index ELC, the stimulation-bearing offset index SCI is calculated and compared with the stimulation offset threshold Sth to determine whether the dance stimulation and the audience's psychological bearing capacity are matched, and if not, appropriate strategies are given; Step four, through structured analysis and quantitative processing of the visual symbols of dance costumes, movements, lights and scenes, the cultural symbol density CSD representing the intensity of dance cultural symbol presentation is obtained, in combination with the corresponding micro-expression change rate ME(t) and gaze lock duration GL(t), the cultural symbol resonance index CSR is established, and compared with the cultural resonance threshold Cth to determine whether the cultural symbol presentation and the audience's cultural understanding level are matched, and if not, appropriate strategies are given; Step five, through multi-modal psychological precursor signal integration and dynamic window analysis, key physiological-emotional coupling features before immersion triggering are extracted, and attention sensitivity AS, physiological rhythm synchronization coefficient PS and emotional response excitation coefficient ES are generated using immersion trigger sensitivity modeling method, to calculate the immersion precursor variable index IPV, and compared with the immersion precursor threshold Ith to determine whether the conditions for triggering the dance stimulation experience are qualified, and if not, appropriate strategies are given; through joint feedback of SCI, CSR and IPV and dynamic correction of narrative rhythm driving curve NDC, closed-loop adjustment of dance stimulation, cultural symbol and psychological precursor state is performed.
[0022] In this embodiment, through real-time acquisition of multi-source dance stimulation and audience psychological behavior data, narrative rhythm driving curve modeling, psychological bearing capacity analysis and multi-modal immersion precursor signal integration, joint closed-loop regulation of dance stimulation, cultural symbol presentation and psychological precursor state is realized, which can significantly improve the continuity, stability and personalized matching effect of audience immersive experience.
[0023] Embodiment 2 This embodiment is an explanation and description in embodiment 1, please refer to Figure 1 Specifically, the step one comprises: S11, real-time monitoring of dance stimulation features and audience psychological and behavioral reaction features during the process of tourism dance performance; through arranging multi-source acquisition devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are obtained, specifically including the following steps: By arranging visual capture devices including high-speed cameras, depth cameras and motion capture arrays, dancer motion trajectories are analyzed, and instantaneous energy and movement amplitude of dance movements are extracted to generate motion energy sequence E(t) for representing stimulation intensity change; By installing acoustic sensors and beat detection devices, using music rhythm analysis algorithms to detect the rhythm speed, beat density and rhythm change points of the accompaniment music, and extracting the rhythm density RD(t) to represent the influence of dance rhythm stimulation on the audience; By using stage visual imaging devices including multi-angle cameras, stage light recognition sensors and image semantic recognition models, the visual elements of dance costumes, action symbols, light changes and stage backgrounds are analyzed to obtain the visual symbol change rate VSD(t) to quantify the dynamic intensity of symbolic stimulation. By synchronously labeling the dance content script, action paragraph sequence and music chapter, using narrative paragraph recognition algorithms, the scene narrative paragraph label Nd is established to describe the segmentation and conversion relationship of the dance structure on the time axis. By using eye tracking devices to detect the gaze landing point and gaze maintenance time of the audience during the performance, the gaze lock duration GL(t) is collected to analyze the attention level. By using high-precision face capture devices and micro-expression recognition algorithms, the micro-movement of the audience's facial muscles is analyzed to extract the micro-expression change rate ME(t) to reflect the immediacy of emotional changes. By using wearable physiological signal monitoring devices including chest strap respiration sensors and wrist heart rate sensors, real-time monitoring of breathing patterns and heart rate changes is performed to obtain the respiration rhythm difference and heart rate change rate to analyze the physiological excitement level. By using posture capture cameras, pressure-sensitive seats or body motion capture modules, the audience's body sway and micro-resonance behavior are detected to collect the body sway amplitude MB(t) to represent the unconscious behavior reaction caused by immersion. S12, by time synchronization and structured integration of the collected action energy sequence E(t), rhythm density RD(t), visual symbol change rate VSD(t), narrative paragraph label Nd, gaze lock duration GL(t), micro-expression change rate ME(t), respiration rhythm difference , heart rate change rate and body sway amplitude MB(t), a dance stimulation-mental response original data set is established.
[0024] In this embodiment, by arranging multi-source collection devices in the stage and audience interaction area, multi-dimensional data such as dance movements, music rhythm, visual symbols, audience attention, micro-expression, heart rate, respiration and body micro-reaction are collected in real time and synchronized, and are structured and integrated, which can accurately depict the dynamic correlation between dance stimulation and audience psychological response, and provide high-precision, multi-modal data basis for subsequent immersive experience optimization.
[0025] Embodiment 3 This embodiment is explained in embodiment 1, please refer to Figure 1 , specifically, the step two comprises: S21, based on the action energy sequence E(t), the rhythm density RD(t), the visual symbol change rate VSD(t) and the scene narrative paragraph label Nd in the dance stimulation- psychological reaction original data set, the time stamp synchronization alignment method and the multi-source data fusion technology are used to uniformly map the instantaneous parameters of different sources to the same time axis; the interpolation and smoothing processing algorithm is used to compensate and continuous processing for the collection gap and the sampling frequency difference; S22, through the time sequence feature analysis method, the fluctuation trend of the action energy sequence E(t) in the continuous period is analyzed, the strong and weak changes of the action energy in different paragraphs are extracted, and the energy features are obtained; the rhythm complexity analysis technology is used to structure the rhythm density RD(t), the changes of the rhythm acceleration section, the rhythm deceleration section and the rhythm repetition mode are identified, and the rhythm density features are obtained; the visual symbol recognition and change rate statistical method is used to quantify the symbol switching frequency, the visual load and the symbol richness in the visual symbol change rate VSD(t), and the visual symbol features are obtained; based on the scene narrative paragraph label Nd, the narrative paragraph label recognition algorithm is used to map the dance script, the action paragraph and the music chapter at the paragraph level, and the narrative paragraph structure features are obtained; S23, through the obtained energy features, rhythm density features, visual symbol features and narrative paragraph structure features, the multi-dimensional stimulation fusion modeling method is used to establish the narrative rhythm driving curve NDC.
[0026] In this embodiment, through multi-source data fusion and feature extraction of action energy, rhythm density, visual symbol and narrative paragraph structure, the narrative rhythm driving curve NDC is constructed, the multi-dimensional quantitative description of dance stimulation is realized, the dynamic correlation of rhythm change of dance performance and audience psychological feeling can be accurately reflected, and scientific basis is provided for immersive experience optimization.
[0027] Embodiment 4 This embodiment is explained in embodiment 1, please refer to Figure 1 , specifically, the step two further comprises: S24, based on the multi-modal psychological reaction data of the gaze lock duration GL(t), the micro-expression change rate ME(t), the respiratory rhythm difference , the heart rate change rate and the body swing amplitude MB(t) in the dance stimulation- psychological reaction original data set, the attention, physiological state and emotional changes of the audience under the action of dance stimulation are synchronously aligned; S25, using the line of sight stability analysis method, the line of sight locking duration GL(t) in different narrative paragraphs is quantified, the audience attention stable interval and attention decay trend are obtained; using the micro-expression fluctuation evaluation technology, the dispersion, local fluctuation amplitude and change frequency of the micro-expression change rate ME(t) are extracted, the audience emotional sensitivity and emotional fluctuation response level are described; using the physiological rhythm change analysis method, the time series of the heart rate change rate is adjusted to identify the adjustment trend, the audience physiological adaptation ability and stress response characteristics under the stimulation intensity change are obtained; through the posture stability analysis method, the change amplitude, fluctuation frequency and resonance characteristics of the body swing amplitude MB(t) are quantified; then, using the respiratory rhythm fluctuation modeling method, the rhythm, fluctuation amplitude and change trend of the respiratory rhythm difference are analyzed, the audience respiratory regulation ability and psychological load response characteristics are obtained; S26, through the obtained audience attention stable interval and attention decay trend, audience physiological adaptation ability and stress response characteristics under the stimulation intensity change, and audience respiratory regulation ability and psychological load response characteristics, using the psychological load modeling algorithm, the experience bearing capacity model is constructed; the experience bearing capacity model analyzes the psychological bearing capacity of the audience to the change of dance stimulation through running, calculates the audience's attention stability, physiological rhythm change amplitude and emotional fluctuation dispersion, and outputs the psychological bearing capacity index ELC.
[0028] In this embodiment, through the synchronous analysis and psychological load modeling of the multi-modal psychological reaction data such as audience line of sight, micro-expression, physiological rhythm and body micro-motion, the experience bearing capacity model is constructed and the psychological bearing capacity index ELC is calculated, which can scientifically quantify the bearable degree of the audience to the dance stimulation, realize the real-time evaluation of attention, emotion and physiological state, and provide accurate basis for the optimization of dance performance rhythm and stimulation intensity.
[0029] Embodiment 5 This embodiment is an explanation and description in embodiment 1, please refer to Figure 1 , specifically, the step three comprises: S31, using the sliding window gradient calculation algorithm, the amplitude change of the narrative rhythm driving curve NDC in the set time window is linearly fitted, the local slope is extracted, and the narrative rhythm change rate is obtained, combined with the psychological bearing capacity index ELC, after dimensionless processing, the stimulation-bearing offset index SCI is calculated and obtained, the formula is as follows:
[0030] In the formula, represents a micro-constant that suppresses the denominator to zero; S32, obtain the first evaluation result by presetting the stimulation offset threshold Sth and comparing the stimulation-carrying offset index SCI with the stimulation offset threshold Sth, including: When the stimulation-carrying offset index SCI ≤ the stimulation offset threshold Sth, it indicates that the dance stimulation matches the audience's psychological carrying capacity, and the experience is in a safe immersion state, and no adjustment is made, and continuous monitoring is performed. When the stimulation-carrying offset index SCI > the stimulation offset threshold Sth, it indicates that the dance stimulation does not match the audience's psychological carrying capacity, and there is a risk of immersion offset or experience overload leading to a decline in audience attention, an increase in emotional fluctuations, or physical fatigue, a first warning instruction is triggered, and a first strategy is generated: reducing the rhythm density RD(t) to adjust the music rhythm and reduce the continuous density of the rhythm paragraph, to relieve the rhythm pressure of the audience; reducing the visual symbol complexity VSD(t) to reduce the stage light change, dance symbol switching and costume color contrast, to reduce the visual stimulation load; reducing the intensity of the peak paragraph of the NDC curve, and replacing the motion block and adjusting the dance intensity in the peak area of the narrative rhythm driving curve, to reduce the overall stimulation level; reducing the motion energy E(t) to reduce high-intensity movements, adjust the motion amplitude and rhythm distribution, so that the motion energy remains within the range that the audience can bear; and updating the stimulation-carrying offset index SCI value after adjustment until the stimulation-carrying offset index SCI ≤ the stimulation offset threshold Sth.
[0031] The stimulation offset threshold Sth is obtained by statistically analyzing a large amount of audience psychological and behavioral response data in dance performances, extracting the stimulation-carrying offset index SCI distribution range in the audience's safe immersion state and overload state, and combining the experience judgment of psychology experts and dance performance professionals to determine a reasonable threshold. Referring to the research results of psychological carrying capacity, on-site audience physiological and behavioral response data, and safety and experience specifications of the dance performance industry, these data usually provide a range of bearable stimulation changes or recommended threshold intervals. The threshold is used to effectively distinguish whether the dance stimulation intensity matches the audience's psychological carrying capacity, thereby ensuring the safety and comfort of the audience's immersive experience.
[0032] In this embodiment, by calculating the stimulation-carrying offset index SCI and comparing it with the preset threshold Sth, dynamic matching of the dance narrative rhythm and the audience's psychological carrying capacity is realized, and when a mismatch is found, the motion energy, rhythm density and visual symbol complexity are automatically adjusted to effectively prevent the audience's attention from declining, emotional fluctuations from increasing or physical fatigue, and to ensure the safety and comfort of the immersive experience.
[0033] Embodiment 6 This embodiment is an explanation and description in Embodiment 1, please refer to Figure 1 , specifically, the step four comprises: S41, based on the visual elements of dance costumes, action symbols, light changes and stage backgrounds, the cultural symbol semantic coding method is used to structurally analyze the dance costume texture, symbolic action, scene image and light symbol; through the symbol level decomposition algorithm, the appearance frequency, symbol complexity and symbol superposition relationship of the visual symbol are quantitatively processed, and the cultural symbol density CSD representing the degree of presentation of the dance culture symbol is obtained.
[0034] In this embodiment, by quantitatively analyzing the cultural symbol density CSD of the visual elements of dance costumes, action symbols, lights and stage backgrounds, the degree of presentation of the dance culture symbol is accurately evaluated, which provides an objective basis for judging the matching of the dance culture expression and the audience's understanding level, and can effectively improve the audience's cultural resonance experience.
[0035] Embodiment 7 This embodiment is an explanation and description in embodiment 1, please refer to Figure 1 , specifically, the step four further comprises: S42, through the obtained cultural symbol density CSD, combined with the corresponding micro-expression change rate ME(t) and gaze lock duration GL(t), after non-dimensional processing, a multi-modal cultural resonance fusion algorithm is used to establish a cultural symbol resonance index CSR, and the formula is as follows:
[0036] In the formula, w1, w2 and w3 represent weight coefficients; : represents the influence of cultural symbol density CSD on cultural symbol resonance index CSR, occupies a higher weight, is a key indicator, and directly reflects the contribution of dance visual symbol presentation intensity to audience cultural understanding and resonance; : represents the influence of micro-expression change rate ME(t) on cultural symbol resonance index CSR, occupies a secondary high weight, and reflects the sensitivity of audience emotional feedback to cultural symbol cognition; : represents the influence of gaze lock duration GL(t) on cultural symbol resonance index CSR, occupies a medium weight, and reflects the auxiliary role of audience attention concentration degree to cultural symbol understanding; By weighted fusion of the visual reception, emotional reaction and attention concentration of the audience to the dance culture symbol, the overall cultural resonance effect is quantified, and the weight coefficients reflect the relative contribution of each factor to cultural resonance.
[0037] S43, by presetting a cultural resonance threshold Cth, and comparing and analyzing the cultural symbol resonance index CSR with the cultural resonance threshold Cth, a second evaluation result is obtained, including: When the cultural symbol resonance index CSR is greater than or equal to the cultural resonance threshold Cth, it indicates that the cultural symbol presentation matches the audience's cultural understanding level, and the experience is in a state of cultural adaptation, and continuous monitoring is performed. When the cultural symbol resonance index CSR is less than the cultural resonance threshold Cth, it indicates that the cultural symbol presentation does not match the audience's cultural understanding level, and there is a cultural understanding deviation, which causes a decrease in attention, a misreading of meaning, or a break in emotion, affecting the continuity of the immersive experience, triggering a second warning instruction, and generating a second strategy: reducing the cultural symbol density CSD, reducing complexity or multi-layer symbol superposition; increasing the narrative prompt paragraph, including action semantic reinforcement, background image suggestion or formation migration prompt; transferring the cognitive pressure caused by the load cultural symbol by enhancing the rhythm flow; simplifying the symbol action structure to make the visual presentation guiding and reduce information decoding difficulty, and updating the cultural symbol resonance index CSR value until the cultural symbol resonance index CSR is greater than or equal to the cultural resonance threshold Cth.
[0038] The cultural resonance threshold Cth is obtained by statistical analysis of a large number of audience micro-expression, gaze fixation and visual symbol presentation data in dance performances, extracting the cultural symbol resonance index CSR distribution range in the cultural understanding matching state and the cultural understanding deviation state, and combining the experience judgment of dance culture experts and psychologists to determine a reasonable threshold. Referring to the cultural experience evaluation standard, the dance performance art specification and the audience cultural background analysis result, these data usually provide the index range of symbol presentation matching the audience's understanding level. The threshold is used to effectively distinguish whether the dance cultural symbol presentation matches the audience's understanding level, and to ensure the accuracy of cultural transmission and the coherence of experience.
[0039] In this embodiment, by establishing the cultural symbol resonance index CSR and combining the micro-expression change rate and the gaze fixation duration to quantitatively evaluate the audience's cultural understanding, real-time monitoring and dynamic adjustment of the matching of dance cultural symbol presentation and audience understanding are realized, which can effectively improve the audience's cultural resonance feeling, prevent cultural information misreading or high cognitive load, and thus enhance the continuity and depth of the immersive experience.
[0040] Embodiment 8 This embodiment is an explanation and description in Embodiment 1, please refer to Figure 1 , specifically, the step five comprises: S51, based on the gaze fixation duration GL(t), the micro-expression change rate ME(t), the breathing rhythm difference , and the heart rate change rate and body swing amplitude MB(t), the multi-modal psychological precursor signal integration method is used to unify the attention, physiological rhythm and emotional response in time alignment; through the continuous dynamic window analysis algorithm, the short-term peak value, change gradient and response acceleration of each parameter are analyzed, and the key physiological-emotional coupling characteristics before immersion triggering are extracted; S52, based on the key physiological-emotional coupling characteristics before immersion triggering, the immersion triggering sensitivity modeling method is used to extract the attention sensitivity coefficient AS, the physiological rhythm synchronization coefficient PS and the emotional response excitation coefficient ES respectively; the specific steps include: Based on the short-time stability of the gaze lock duration GL(t) and the gaze shift rate, the gaze dynamic sensitivity analysis method is used to obtain the attention sensitivity coefficient AS; The physiological rhythm change analysis method is used to fit the phase synchronization of the heart rate change rate and the respiration rhythm difference , calculate the synchronization degree in the stimulation growth segment, and obtain the physiological rhythm synchronization coefficient PS; The micro-expression fluctuation evaluation technology is used to extract the change acceleration, peak density and local high response segment of the micro-expression change rate ME(t), quantify its potential immersion triggering ability, and obtain the emotional response excitation coefficient ES.
[0041] In this embodiment, by extracting the multi-modal psychological precursor characteristics before immersion triggering, and establishing the quantitative indicators of attention sensitivity AS, physiological rhythm synchronization PS and emotional response excitation ES, the precise evaluation and prediction of the triggering conditions of audience immersion experience are realized, the situation of insufficient immersion triggering potential can be identified in advance, so as to guide the adjustment of dance stimulation and audience psychological guidance, and improve the effectiveness and timeliness of immersion experience.
[0042] Embodiment 9 This embodiment is an explanation and description in embodiment 1, please refer to Figure 1 , specifically, the step five further includes: S53, through the extracted attention sensitivity coefficient AS, physiological rhythm synchronization coefficient PS and emotional response excitation coefficient ES, after non-dimensional processing, the multi-factor immersion precursor fusion algorithm is used to calculate the immersion precursor variable index IPV, and the formula is as follows:
[0043] In the formula, a1, a2 and a3 represent weight coefficients; : represents the influence of attention sensitivity AS on immersion precursor variable index IPV, occupies a higher weight, is a key indicator, and directly reflects the contribution of audience attention state to the start of immersion experience; : Characterize the influence of the physiological rhythm synchronization coefficient PS on the immersion precursor variable index IPV, which occupies the second highest weight, and reflect the triggering effect of the synchronization of the audience's physiological state on the immersion experience; : Characterize the influence of the emotional response excitation coefficient ES on the immersion precursor variable index IPV, which occupies a medium weight, and reflect the effect of the amplitude and sensitivity of the audience's emotional response on the start of the immersion experience; By weighted fusion of attention, psychosomatic physiological synchronization and emotional excitation, the conditions for the audience to reach the immersion precursor state are quantified, and the weight coefficients reflect the relative importance of each factor in triggering the immersion experience process.
[0044] S54, by presetting the immersion precursor threshold Ith, and comparing and analyzing the immersion precursor variable index IPV with the immersion precursor threshold Ith, a third evaluation result is obtained, including: When the immersion precursor variable index IPV is greater than or equal to the immersion precursor threshold Ith, it indicates that the conditions for triggering the immersion experience by the dance stimulus are qualified, the audience reaches the immersion precursor state, and continuous monitoring is performed; When the immersion precursor variable index IPV is less than the immersion precursor threshold Ith, it indicates that the conditions for triggering the immersion experience by the dance stimulus are not qualified, the audience does not reach the immersion precursor state, and there is a risk of insufficient immersion start, insufficient experience input, and scattered attention, triggering a third warning instruction, and generating a third strategy: reducing the rhythm complexity RD(t), reducing unnecessary rhythm disturbance, and avoiding excessive jumping of the stimulus; by reducing the symbol density of the visual symbol change rate VSD(t), the coherence of the visual content is improved; by reducing the amplitude of the action energy E(t), the rhythm of the action and the psychological state of the audience are rebalanced; increasing the buffer scene in the narrative paragraph, strengthening the content understanding, gradually guiding the audience to return to the immersion precursor state, and adjusting and recalculating until the immersion precursor variable index IPV is greater than or equal to the immersion precursor threshold Ith; The way to obtain the immersion precursor threshold Ith: by statistically analyzing a large number of audience attention, physiological rhythm and emotional response data in dance performances, extracting the distribution range of the immersion precursor variable index IPV in the immersion precursor state and the insufficient immersion start state, and combining the experience judgment of psychologists and dance experience design personnel, a reasonable threshold is determined. Reference is made to the results of immersion experience research, the psychological and physiological response law of the audience, and the immersion evaluation standard of dance performances. These data usually provide the key index range for triggering the immersion experience. This threshold is used to effectively determine whether the dance stimulus can trigger the audience's immersion experience, and to ensure the experience input and immersion continuity.
[0045] S55, after updating the immersion precursor variable index IPV, the stimulus-carrying offset index SCI, the cultural symbol resonance index CSR and the immersion precursor variable index IPV are fed back jointly, and the narrative rhythm driving curve NDC is corrected synchronously, the immersion experience dynamic regulation mechanism is adopted, the dance stimulation intensity, the cultural symbol presentation degree and the psychological precursor state are continuously monitored and closed loop adjusted; when the stimulus-carrying offset index SCI, the cultural symbol resonance index CSR and the immersion precursor variable index IPV are in the stable interval, the immersion enhancement instruction is output, and the dance performance enters the stable immersion experience state.
[0046] In the embodiment, by jointly feeding back the immersion precursor variable index IPV, the stimulus-carrying offset index SCI and the cultural symbol resonance index CSR, and dynamically correcting the narrative rhythm driving curve NDC, the closed loop regulation of dance stimulation, cultural symbol presentation and audience psychological precursor state is realized, which can effectively ensure that the audience is continuously in the stable interval of immersion experience, improve the immersion and participation of dance performance, and reduce the risk of attention dispersion, emotional fluctuation or experience interruption.
[0047] Embodiment 10 A SOR optimization system for tourism dance immersion experience, please refer to Figure 2 , specifically, comprising: A multi-source data acquisition module is used for real-time monitoring of dance stimulation characteristics and psychological and behavioral reaction characteristics of the audience during the dance performance; by arranging multi-source acquisition devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are obtained respectively, unified time synchronization and structured integration are carried out, and a dance stimulation-mental reaction original data set is constructed; A narrative rhythm and psychological load modeling module is used for structuring modeling of data on the dance stimulation side and the audience psychological reaction side, and constructing a narrative rhythm driving curve NDC based on a multi-dimensional stimulation fusion method; the dance stimulation-mental reaction original data set is processed synchronously, the characteristics of attention, physiological rhythm and emotional fluctuation are extracted, a experience carrying capacity model is constructed by using a psychological load modeling algorithm, and a psychological carrying capacity index ELC is output to represent the audience's carrying capacity of stimulation change intensity; A stimulus-carrying matching evaluation module is used for linear fitting of the amplitude change of the narrative rhythm driving curve NDC within a set time window to obtain the narrative rhythm change rate , in combination with the psychological carrying capacity index ELC, the stimulus-carrying offset index SCI is calculated and obtained, and compared with the stimulation offset threshold Sth to judge whether the dance stimulation and the audience's psychological carrying capacity are matched, if not matched, the corresponding strategy is given; The cultural symbol resonance evaluation module is configured to perform structured analysis and quantitative processing on visual symbols of dance costumes, movements, lights and scenes, to obtain a cultural symbol density CSD representing the intensity of the presentation of the dance cultural symbols, to combine a corresponding micro-expression change rate ME(t) and a gaze lock duration GL(t), to establish a cultural symbol resonance index CSR, and to compare the cultural symbol resonance index CSR with a cultural resonance threshold Cth to determine whether the presentation of the cultural symbols and the understanding level of the audience are matched, and to provide corresponding strategies if they are not matched. The immersion precursor regulation module is configured to extract key physiological-emotional coupling features before the immersion trigger through multi-modal psychological precursor signal integration and dynamic window analysis, to generate an attention sensitivity AS, a physiological rhythm synchronization coefficient PS and an emotional response excitation coefficient ES using an immersion trigger sensitivity modeling method, to calculate an immersion precursor variable index IPV, and to compare the immersion precursor variable index IPV with an immersion precursor threshold Ith to determine whether the conditions for triggering the immersion experience by the dance stimulation are qualified, and to provide corresponding strategies if they are not qualified. The dance stimulation, cultural symbols and psychological precursor state are closed-loop adjusted by jointly feeding back SCI, CSR and IPV and dynamically correcting a narrative rhythm driving curve NDC.
[0048] In this embodiment, the joint action of the multi-source data acquisition, narrative rhythm modeling, stimulation-carrying matching evaluation, cultural symbol resonance evaluation and immersion precursor regulation modules realizes closed-loop dynamic regulation of the dance stimulation, audience psychological state and cultural symbol presentation, which can effectively improve the continuity and stability of the audience's immersion experience, enhance the emotional infectivity and cultural resonance effect of the dance performance, and reduce the risk of attention dispersion, emotional fluctuation or experience interruption.
[0049] The size of the threshold is set for ease of comparison. The size of the threshold depends on the amount of sample data and the base number set by the person skilled in the art for each group of sample data. As long as the proportional relationship between the parameters and the quantized values is not affected, it is acceptable.
[0050] The above formulas are obtained by collecting a large amount of data for software simulation and selecting a formula close to the true value. The coefficients in the formulas are set by the person skilled in the art according to the actual situation. The above description is only a preferred specific embodiment of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can make equivalent substitutions or changes to the technical solutions and inventive concepts of the present application within the technical scope disclosed by the present application, which should be covered within the protection scope of the present application.
Claims
1. A SOR optimization method for a travel dance immersion experience, characterized in that, The method comprises the following steps: Step one, real-time monitoring of the dance stimulation characteristics and the psychological and behavioral reaction characteristics of the audience during the dance performance; by arranging multi-source collection devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are respectively obtained, unified time synchronization and structured integration are performed, and a dance stimulation- psychological reaction original data set is constructed; Step two, structuring modeling of the dance stimulation side and the audience psychological reaction side data, and constructing a narrative rhythm driving curve NDC based on a multi-dimensional stimulation fusion method; the dance stimulation- psychological reaction original data set is synchronously processed, the characteristics of attention, physiological rhythm and emotional fluctuation are extracted, the experience bearing capacity model is constructed by using the psychological load modeling algorithm, and the psychological bearing capacity index ELC for representing the audience's bearable stimulation change intensity is outputted; Step three, linear fitting is performed on the amplitude change of the narrative rhythm driving curve NDC within the set time window to obtain the narrative rhythm change rate In combination with the psychological bearing capacity index ELC, the stimulation-bearing offset index SCI is calculated and compared with the stimulation offset threshold Sth to determine whether the dance stimulation matches the psychological bearing capacity of the audience, and appropriate strategies are given if they do not match. Step four, structured analysis and quantitative processing of the visual symbols of dance costumes, movements, lights and scenes are performed to obtain the cultural symbol density CSD representing the presentation intensity of dance cultural symbols, the cultural symbol resonance index CSR is established combining the corresponding micro-expression change rate ME(t) and gaze lock duration GL(t), and compared with the cultural resonance threshold Cth to determine whether the cultural symbol presentation and the audience's cultural understanding level are matched, and if not, corresponding strategies are given; Step five, key physiological-emotional coupling characteristics before immersion triggering are extracted through multi-modal psychological precursor signal integration and dynamic window analysis, and the attention sensitivity AS, physiological rhythm synchronization coefficient PS and emotional response excitation coefficient ES are generated by using the immersion trigger sensitivity modeling method, the immersion precursor variable index IPV is calculated and obtained, and compared with the immersion precursor threshold Ith to determine whether the conditions for triggering the dance stimulation experience are qualified, and if not, corresponding strategies are given; the narrative rhythm driving curve NDC is dynamically corrected by combining the feedback SCI, CSR and IPV, and the closed-loop adjustment of dance stimulation, cultural symbols and psychological precursor state is performed.
2. The SOR optimization method for a travel dance immersion experience according to claim 1, wherein, The step one comprises: S11, real-time monitoring of the dance stimulation characteristics and the psychological and behavioral reaction characteristics of the audience during the dance performance; by arranging multi-source collection devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are respectively obtained, specifically comprising the following steps: By arranging visual capture devices including high-speed cameras, depth cameras and motion capture arrays, dancer motion trajectories are analyzed, and the instantaneous energy and movement amplitude of dance movements are extracted to generate motion energy sequence E(t); By installing acoustic sensors and beat detection devices, the rhythm speed, beat density and rhythm change points of the accompaniment music are detected by using a music rhythm analysis algorithm, and the rhythm density RD(t) is extracted; By stage visual imaging devices including multi-angle cameras, stage light recognition sensors and image semantic recognition models, the visual elements of dance costumes, movement symbols, light changes and stage backgrounds are analyzed to obtain the visual symbol change rate VSD(t); By acquiring the dance content script, action paragraph sequence and music chapter for synchronous annotation, a narrative paragraph identification algorithm is adopted to establish scene narrative paragraph label Nd; By laying out eye tracking equipment eye tracker, the viewer's gaze landing point and gaze maintenance time during the performance are detected, and the gaze lock duration GL(t) is collected; By laying out high-precision face capture equipment and micro-expression recognition algorithm, the micro-movement of the viewer's facial muscles is analyzed, and the micro-expression change rate ME(t) is extracted; The respiratory rhythm and the heart rate change are monitored in real time by wearing a physiological signal monitoring device including a chest belt type respiration sensor and a wrist type heart rate sensor, and the respiratory rhythm difference and the heart rate change rate are acquired By laying out posture capture cameras, pressure-sensitive seats or body motion capture modules, the viewer's body swing and micro-resonance behavior are detected, and the body swing amplitude MB(t) is collected; S12, through the collected action energy sequence E(t), rhythm density RD(t), visual symbol change rate VSD(t), narrative paragraph label Nd, gaze lock duration GL(t), micro-expression change rate ME(t), respiratory rhythm difference , heart rate change rate and body swing amplitude MB(t) time synchronization and structured integration, to establish dance stimulation- psychological reaction original data set.
3. The SOR optimization method for a travel dance immersion experience of claim 2, wherein, The step two includes: S21, based on the action energy sequence E(t), rhythm density RD(t), visual symbol change rate VSD(t) and scene narrative paragraph label Nd in the dance stimulation-psychological response original data set, a time stamp synchronous alignment method and multi-source data fusion technology are used to uniformly map the instantaneous parameters of different sources to the same time axis; the interpolation and smoothing processing algorithm is used to compensate and continuous processing for the collection gap and sampling frequency difference; S22, by using time sequence feature analysis method, the fluctuation trend of action energy sequence E(t) in continuous period is analyzed, the strong and weak change of action energy in different paragraphs is extracted, and the energy feature is obtained; by using rhythm complexity analysis technology, the rhythm density RD(t) is structured, the change of rhythm acceleration section, rhythm deceleration section and rhythm repetition mode is identified, and the rhythm density feature is obtained; by using visual symbol recognition and change rate statistical method, the symbol switching frequency, visual load and symbol richness in visual symbol change rate VSD(t) are quantified, and the visual symbol feature is obtained; based on scene narrative paragraph label Nd, by using narrative paragraph label identification algorithm, the paragraph-level mapping of dance script, action paragraph and music chapter is carried out, and the narrative paragraph structure feature is obtained; S23, by using multi-dimensional stimulation fusion modeling method, the narrative rhythm driving curve NDC is established by using the energy feature, rhythm density feature, visual symbol feature and narrative paragraph structure feature.
4. The SOR optimization method for a travel dance immersion experience of claim 2, wherein, The step two further includes: S24, based on the gaze lock time GL(t), micro-expression change rate ME(t), respiration rhythm difference , heart rate change rate and body swing amplitude MB(t) in the dance stimulation-psychological response original data set, the attention, physiological state and emotional changes of the audience under the action of the dance stimulation are processed synchronously. S25, using the line of sight stability analysis method, the line of sight lock duration GL(t) in different narrative paragraphs is quantified, the attention stability interval and the attention decay trend are obtained; using the micro-expression fluctuation evaluation technology, the dispersion, local fluctuation amplitude and change frequency of micro-expression change rate ME(t) are extracted, the audience emotional sensitivity and emotional fluctuation response level are described; using the physiological rhythm change analysis method, the time series of heart rate change rate is adjusted to identify the trend, the audience physiological adaptation ability and stress response characteristics under the change of stimulation intensity are obtained; through the posture stability analysis method, the change amplitude, fluctuation frequency and resonance characteristics of body swing amplitude MB(t) are quantified; then using the respiratory rhythm fluctuation modeling method, the rhythm, fluctuation amplitude and change trend of respiratory rhythm difference are analyzed, the audience respiratory regulation ability and psychological load response characteristics are obtained; S26, by using psychological load modeling algorithm, the experience bearing capacity model is constructed by using the obtained audience attention stability interval and attention decay trend, audience physiological adaptation ability and stress response characteristics under stimulation intensity change, and audience respiratory regulation ability and psychological load response characteristics; the experience bearing capacity model analyzes the psychological bearing capacity of the audience to the change of dance stimulation, calculates the attention stability, physiological rhythm change amplitude and emotional fluctuation dispersion of the audience, and outputs the psychological bearing capacity index ELC.
5. The SOR optimization method for a travel dance immersion experience of claim 1, wherein, The step three includes: S31, using a sliding window gradient calculation algorithm, the amplitude change of the narrative rhythm driving curve NDC is linearly fitted in the set time window, the local slope is extracted, and the narrative rhythm change rate is obtained , combined with the psychological bearing capacity index ELC, after dimensionless processing, the stimulus-bearing deviation index SCI is calculated and obtained. S32, by comparing and analyzing the stimulation-bearing offset index SCI and the stimulation offset threshold Sth, the first evaluation result is obtained, including: When the stimulation-carrying offset index SCI ≤ the stimulation offset threshold Sth, it indicates that the dance stimulation matches the audience's psychological carrying capacity, and the experience is in a safe immersion state, and no adjustment is made, and continuous monitoring is performed. When the stimulation-carrying offset index SCI > the stimulation offset threshold Sth, it indicates that the dance stimulation does not match the audience's psychological carrying capacity, and there is a risk of immersion offset or experience overload, which causes the audience's attention to decline, emotional fluctuations to increase, or physical fatigue, and a first warning instruction is triggered, and a first strategy is generated: by reducing the rhythm density RD(t), adjusting the music rhythm, reducing the continuous density rhythm paragraph, relieving the rhythm pressure of the audience; by reducing the visual symbol complexity VSD(t), reducing the stage light change, dance symbol switching and costume color contrast, reducing the visual stimulation load; by weakening the NDC curve peak paragraph intensity, and in the peak area of the narrative rhythm driving curve, replacing the motion block and adjusting the dance intensity, reducing the overall stimulation level; by reducing the motion energy E(t), reducing high-intensity movements, adjusting the motion amplitude and rhythm distribution, so that the motion energy remains within the audience's bearing range; the stimulation-carrying offset index SCI value is updated after adjustment until the stimulation-carrying offset index SCI ≤ the stimulation offset threshold Sth.
6. The SOR optimization method of a tourism dance immersion experience according to claim 5, wherein, The fourth step comprises: S41, based on the visual elements of dance costumes, motion symbols, light changes and stage backgrounds, a cultural symbol semantic coding method is used to structurally analyze the dance costume texture, symbolic motion, scene image and light symbol; through a symbol hierarchical decomposition algorithm, the appearance frequency, symbol complexity and symbol superposition relationship of the visual symbol are quantitatively processed to obtain a cultural symbol density CSD representing the degree of presentation of the dance cultural symbol.
7. The SOR optimization method of a tourism dance immersion experience according to claim 6, wherein, The fourth step further comprises: S42, by obtaining the cultural symbol density CSD, combining the corresponding micro-expression change rate ME(t) and gaze lock duration GL(t), after non-dimensional processing, a multi-modal cultural resonance fusion algorithm is used to establish a cultural symbol resonance index CSR; S43, by presetting a cultural resonance threshold Cth, and comparing and analyzing the cultural symbol resonance index CSR with the cultural resonance threshold Cth, a second evaluation result is obtained, including: When the cultural symbol resonance index CSR ≥ the cultural resonance threshold Cth, it indicates that the cultural symbol presentation matches the audience's cultural understanding level, and the experience is in a cultural adaptation state, and continuous monitoring is performed. When the cultural symbol resonance index CSR < the cultural resonance threshold Cth, it indicates that the cultural symbol presents a mismatch with the audience's cultural understanding level, there is a cultural understanding deviation, which causes a decrease in attention, a misreading of meaning, or a break in emotional chain, affects the continuity of immersive experience, triggers a second early warning instruction, and generates a second strategy: reducing the cultural symbol density CSD, reducing complexity or multi-layer symbol superposition; increasing narrative prompt paragraphs, including action semantic reinforcement, background image suggestion or formation migration prompt; transferring the cognitive pressure caused by the load cultural symbol by enhancing the rhythm flow; simplifying the symbol action structure, making the visual presentation guiding and reducing information decoding difficulty, adjusting the cultural symbol resonance index CSR value until the cultural symbol resonance index CSR ≥ the cultural resonance threshold Cth.
8. The SOR optimization method of a tourism dance immersion experience according to claim 7, wherein, The step five comprises: S51, based on the gaze lock duration GL(t), micro-expression change rate ME(t), respiratory rhythm difference , heart rate change rate and body swing amplitude MB(t) in the dance stimulation-psychological response original data set, a multi-modal psychological precursor signal integration method is adopted to unify the time alignment of attention, physiological rhythm and emotional response; through continuous dynamic window analysis algorithm, the short-term peak value, change gradient and response acceleration of each parameter are analyzed, and the key physiological-emotional coupling characteristics before immersion triggering are extracted; S52, based on the key physiological-emotional coupling characteristics before immersion triggering, the attention sensitivity coefficient AS, the physiological rhythm synchronization coefficient PS and the emotional response excitation coefficient ES are extracted respectively by the immersion triggering sensitivity modeling method; the specific steps comprise: The attention sensitivity coefficient AS is obtained by using the gaze dynamic sensitivity analysis method based on the short-time stability of the gaze lock time GL(t) and the gaze transfer rate; Using physiological rhythm variation analysis methods, the rate of change in heart rate was analyzed. Difference with breathing rhythm The phase synchronization is fitted, the degree of synchronization in the stimulation growth segment is calculated, and the physiological rhythm synchronization coefficient PS is obtained. The change acceleration, peak density and local high response segment of the micro-expression change rate ME(t) are extracted by using the micro-expression fluctuation evaluation technology, the potential immersion triggering ability is quantified, and the emotional response excitation coefficient ES is obtained.
9. The SOR optimization method of a tourism dance immersion experience according to claim 8, wherein, The step five further comprises: S53, by using the multi-factor immersion precursor fusion algorithm, the immersion precursor variable index IPV is calculated after the attention sensitivity coefficient AS, the physiological rhythm synchronization coefficient PS and the emotional response excitation coefficient ES are extracted and dimensionless processed; S54, by comparing the immersion precursor variable index IPV with the preset immersion precursor threshold Ith, the third evaluation result is obtained, comprising: When the immersion precursor variable index IPV ≥ the immersion precursor threshold Ith, it indicates that the conditions for triggering the immersive experience by the dance stimulation are qualified, the audience reaches the immersion precursor state, and the monitoring is continued; When the immersion precursor variable index IPV < the immersion precursor threshold Ith, it indicates that the conditions for triggering the immersive experience by the dance stimulation are not qualified, the audience does not reach the immersion precursor state, there is a risk of insufficient immersion start, insufficient experience input, and attention dispersion, a third early warning instruction is triggered, and a third strategy is generated: reducing the rhythm complexity RD(t) to reduce unnecessary rhythm disturbance and avoid excessive jumping stimulation; by reducing the symbol density of the visual symbol change rate VSD(t), the visual content continuity is improved; by reducing the amplitude of the action energy E(t), the action rhythm and the audience's psychological state are rebalanced; the buffer scene in the narrative paragraph is increased to strengthen the content understanding and gradually guide the audience to return to the immersion precursor state, and the calculation is restarted after adjustment until the immersion precursor variable index IPV ≥ the immersion precursor threshold Ith. S55, after updating the immersion precursor variable index IPV, the stimulus-carrying offset index SCI, the cultural symbol resonance index CSR and the immersion precursor variable index IPV are jointly fed back, and the narrative rhythm driving curve NDC is synchronously corrected, the immersion experience dynamic regulation mechanism is adopted, the dance stimulation intensity, the cultural symbol presentation degree and the psychological precursor state are continuously monitored and closed loop adjusted; when the stimulus-carrying offset index SCI, the cultural symbol resonance index CSR and the immersion precursor variable index IPV are in the stable interval, the immersion enhancement instruction is output, and the dance performance enters the stable immersion experience state.
10. A SOR optimization system for a travel dance immersive experience, applying the SOR optimization method for a travel dance immersive experience according to any one of claims 1-9, characterized in that, It comprises: A multi-source data acquisition module for real-time monitoring of dance stimulation characteristics and audience psychological and behavioral reaction characteristics during the dance performance; By arranging multi-source acquisition devices in the stage area and the audience interaction area, dance stimulation input data and audience reaction data are obtained respectively, unified time synchronization and structured integration are carried out, and a dance stimulation-mental reaction original data set is constructed; A narrative rhythm and psychological load modeling module for structuring the data on the dance stimulation side and the audience psychological reaction side, and constructing a narrative rhythm driving curve NDC based on a multi-dimensional stimulation fusion method; the dance stimulation-mental reaction original data set is synchronously processed, the characteristics of attention, physiological rhythm and emotional fluctuation are extracted, the experience carrying capacity model is constructed by using the psychological load modeling algorithm, and the psychological carrying capacity index ELC for representing the audience's bearable stimulation change intensity is output; The stimulation-carrying capacity matching evaluation module is used for linear fitting of amplitude variation of the narrative rhythm driving curve NDC within a set time window to obtain a narrative rhythm variation rate , in combination with the psychological carrying capacity index ELC, a stimulation-carrying capacity offset index SCI is calculated and compared with a stimulation offset threshold Sth to determine whether the dance stimulation matches the psychological carrying capacity of the audience, and if not, appropriate strategies are given. A cultural symbol resonance evaluation module for structuring and quantitatively processing the visual symbols of dance costumes, movements, lights and scenes, obtaining the cultural symbol density CSD representing the presentation intensity of dance cultural symbols, establishing the cultural symbol resonance index CSR in combination with the corresponding micro-expression change rate ME(t) and gaze lock duration GL(t), and comparing it with the cultural resonance threshold Cth to determine whether the cultural symbol presentation and the audience's cultural understanding level match, and giving corresponding strategies if they do not match; An immersion precursor regulation module for extracting key physiological-emotional coupling characteristics before immersion triggering through multi-modal psychological precursor signal integration and dynamic window analysis, generating attention sensitivity AS, physiological rhythm synchronization coefficient PS and emotional response excitation coefficient ES by using immersion triggering sensitivity modeling method, calculating and obtaining immersion precursor variable index IPV, comparing it with immersion precursor threshold Ith to determine whether the conditions for dance stimulation triggering immersion experience are qualified, and giving corresponding strategies if they are not qualified; through joint feedback of SCI, CSR and IPV and dynamic correction of narrative rhythm driving curve NDC, closed loop adjustment of dance stimulation, cultural symbol and psychological precursor state is carried out.
Citation Information
Patent Citations
Dance video generation method and device, equipment, storage medium and program product
CN118984403A
Real-time dance movement generation system based on AI music rhythm
CN120199210A
Virtual reality-based dance teaching equipment and teaching method thereof
CN120635374A
Game system, computer program used therein, and control method
JP6621156B1
Interactive entertainment apparatus and system and a method of interacting with water to provide audio, visual, olfactory, gustatory or tactile effect
US20140239086A1
Cited By
Biomimetic robot cluster dance action consistency correction method based on state feedback
CN122378754A