A Peking opera culture propaganda system based on user experience interactive design

Abstract

The present application belongs to the technical field of cultural communication, and provides a Beijing opera culture propaganda system based on user experience interactive design, which comprises: a software application program running on an Android platform, the program being adapted to a PICO VR head-mounted device; a plurality of virtual checkpoints, each checkpoint comprising a plurality of Beijing opera face painting character roles; an expression recognition module for capturing and analyzing the expression changes of a user in a virtual space as the basis for user input; a Beijing opera role performance module for displaying the facial expressions and emotional changes of the roles; the present application realizes language-free interaction through expression recognition technology, enabling the experimenter to more intuitively participate in the dissemination and experience of Beijing opera culture, improving the realism and interest of the interaction, and at the same time presenting Beijing opera culture in the form of VR immersive experience, enabling the experimenter to enjoy the interactive fun while deeply understanding the connotation and charm of Beijing opera culture, thereby improving the efficiency and quality of cultural communication.

Description

Technical Field

[0001] This invention belongs to the field of cultural communication technology, specifically a Peking Opera cultural promotion system based on user experience interaction design. Background Technology

[0002] With the rapid development of virtual reality (VR) technology, its application in cultural promotion, education, and business experiences is becoming increasingly widespread. Traditional Peking Opera, as a cultural treasure of the Chinese nation, faces new opportunities and challenges in its dissemination and inheritance.

[0003] While some existing VR experience projects have attempted to incorporate Peking Opera elements, most focus on visual display and lack in-depth interactive experience. This results in a lack of realism and fun for users, thereby reducing the efficiency and quality of cultural dissemination.

[0004] To address the problems raised in the background section, those skilled in the art have proposed a Peking Opera culture promotion system based on user experience interaction design. Summary of the Invention

[0005] To address the aforementioned technical problems, this invention provides a Peking Opera cultural promotion system based on user experience interaction design. This system addresses the issue that while some existing VR experience projects attempt to incorporate Peking Opera elements, they mostly focus on visual display and lack in-depth interactive experience. As a result, users currently lack a sense of realism and enjoyment when using these systems, which in turn reduces the efficiency and quality of cultural dissemination.

[0006] To achieve the above objectives, this invention proposes a Peking Opera culture promotion system based on user experience interaction design, comprising:

[0007] A software application running on the Android platform that is compatible with the PI CO VR headset.

[0008] Multiple virtual levels, each containing different Peking Opera facial makeup characters, are used for non-verbal interaction with users;

[0009] The facial expression recognition module is used to capture and analyze changes in the user's facial expressions in virtual space, using this as a basis for user input.

[0010] The Peking Opera character performance module displays the characters' facial expressions and emotional changes, guiding users to make selections;

[0011] The system uses a feedback mechanism to determine whether a user's choice is correct based on their facial expression input, and then proceeds to the next level or ends the experience accordingly.

[0012] Preferably, the software application includes:

[0013] User interface design optimizes the user's workflow in the VR environment and enhances the user experience;

[0014] The education and promotion content module provides detailed introductions and background information on Peking Opera culture as supplementary learning materials during the experience.

[0015] Preferably, the facial expression recognition module captures the user's facial expressions using the built-in camera of the PICO VR headset, and analyzes and processes them using machine learning algorithms to achieve non-verbal interaction; the steps for analyzing and processing using machine learning algorithms are as follows:

[0016] S101. The captured facial expression image is first preprocessed, including noise removal, brightness and contrast adjustment, and facial region localization, to ensure the accuracy of subsequent analysis and processing. The image noise reduction uses a Gaussian filtering algorithm, the formula of which is as follows:

[0017]

[0018] Where G(x,y) is the filtered pixel gray value; σ is the standard deviation of the Gaussian curve; and x and y are the position coordinates of the filter template.

[0019] S102. Using feature extraction techniques in machine learning algorithms, key feature values ​​are extracted from the preprocessed facial expression images. These feature values ​​include facial geometry, texture information, and motion trajectories, effectively representing changes in the user's facial expressions. Then, a fusion cross-entropy loss method is used to provide richer supervision signals to accelerate network convergence, overcome the challenges of large-scale network training, and enable the network to learn feature discrimination more effectively, thereby improving the overall performance of the model. The fusion cross-entropy loss method incorporates cross-entropy loss into the TL loss function, as shown in the following formula:

[0020]

[0021] Among them, L t This represents the time-to-live (TL) loss function; N represents the number of samples; m represents the number of classes; Represents a binary indicator function; Represents the probability of a category;

[0022] S103. The extracted feature values ​​are compared and analyzed with the pre-trained machine learning model. Through comparison and analysis, the system can determine the user's current expression state and use it as the basis for user input.

[0023] S104. Simultaneously, a matching detection algorithm is set, and a corresponding detection threshold is set for the above analysis and processing results to complete the recognition and matching judgment of user facial expression analysis and processing. The formula is as follows:

[0024]

[0025] in, To capture feature values ​​from user facial expression images; Let x be the feature value of the user's facial expression image to be identified, and let x be the feature quantity of the user's facial expression image.

[0026] As can be seen from the above formula, the smaller P(A,B) is, the higher the matching degree between the user's facial expression image to be identified and the captured user's facial expression image, and vice versa.

[0027] Preferably, the Peking Opera character performance module includes a variety of preset facial expressions and emotional changes, which are presented in the form of animation to enhance the realism and immersion of the interaction.

[0028] Preferably, the selection feedback mechanism employs real-time visual and auditory feedback, including confirmation prompts for correct options and guidance prompts for incorrect options, ensuring that users can clearly understand the interaction results.

[0029] A processor is configured to execute the aforementioned Peking Opera cultural promotion system based on user experience interaction design.

[0030] A computer-readable storage medium having a computer program stored thereon, the computer program being executed by a processor of the aforementioned Peking Opera cultural promotion system based on user experience interaction design.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] 1. This invention achieves non-verbal interaction through facial expression recognition technology, enabling users to participate more intuitively in the dissemination and experience of Peking Opera culture, and enhancing the realism and fun of the interaction;

[0033] 2. This invention presents Peking Opera culture in the form of a VR immersive experience, allowing users to enjoy interactive fun while gaining a deeper understanding of the connotation and charm of Peking Opera culture, thereby improving the efficiency and quality of cultural dissemination. Attached Figure Description

[0034] Figure 1 This is a framework diagram of the Peking Opera culture promotion system based on user experience interaction design according to the present invention; Detailed Implementation

[0035] The embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and examples; the following examples are used to illustrate the present invention, but should not be used to limit the scope of the present invention;

[0036] like Figure 1 As shown:

[0037] Example: This invention provides a Peking Opera culture promotion system based on user experience interaction design, comprising:

[0038] A software application running on the Android platform that is compatible with the PI CO VR headset.

[0039] Multiple virtual levels, each containing different Peking Opera facial makeup characters, are used for non-verbal interaction with users;

[0040] The facial expression recognition module is used to capture and analyze changes in the user's facial expressions in virtual space, using this as a basis for user input.

[0041] The Peking Opera character performance module displays the characters' facial expressions and emotional changes, guiding users to make selections;

[0042] The system selects a feedback mechanism that judges whether the user's choice is correct based on their facial expression input, and then proceeds to the next level or ends the experience accordingly.

[0043] Furthermore, the software application includes:

[0044] User interface design optimizes the user's workflow in the VR environment and enhances the user experience;

[0045] The education and publicity content module provides a detailed introduction and background knowledge about Peking Opera culture as supplementary learning materials during the experience.

[0046] Furthermore, the facial expression recognition module captures the user's facial expressions using the built-in camera of the PICO VR headset and analyzes and processes them using machine learning algorithms; the steps for analyzing and processing using machine learning algorithms are as follows:

[0047] S101. The captured facial expression image is first preprocessed, including noise removal, brightness and contrast adjustment, and facial region localization, to ensure the accuracy of subsequent analysis and processing. The image noise reduction uses a Gaussian filtering algorithm, the formula of which is as follows:

[0048]

[0049] Where G(x,y) is the filtered pixel gray value; σ is the standard deviation of the Gaussian curve; and x and y are the position coordinates of the filter template.

[0050] S102. Using feature extraction techniques in machine learning algorithms, key feature values ​​are extracted from the preprocessed facial expression images. Then, a fusion cross-entropy loss method is used to provide richer supervision signals to accelerate network convergence, overcome the challenges of large-scale network training, and enable the network to learn feature discrimination more effectively. The fusion cross-entropy loss method incorporates cross-entropy loss into the TL loss function, and the formula is as follows:

[0051]

[0052] Among them, L t This represents the time-to-live (TL) loss function; N represents the number of samples; m represents the number of classes; Represents a binary indicator function; Represents the probability of a category;

[0053] S103. The extracted feature values ​​are compared and analyzed with the pre-trained machine learning model. Through comparison and analysis, the system can determine the user's current expression state and use it as the basis for user input.

[0054] S104. Simultaneously, a matching detection algorithm is set, and a corresponding detection threshold is set for the above analysis and processing results to complete the recognition and matching judgment of user facial expression analysis and processing. The formula is as follows:

[0055]

[0056] in, To capture feature values ​​from user facial expression images; Let x be the feature value of the user's facial expression image to be identified, and let x be the feature quantity of the user's facial expression image.

[0057] The smaller P(A,B) is, the higher the matching degree between the user's facial expression image to be identified and the captured user's facial expression image, and vice versa;

[0058] As shown above, the Gaussian filtering algorithm ensures the clarity of facial expression images during the preprocessing stage by removing noise, adjusting brightness and contrast, and locating facial regions, thereby improving the accuracy of subsequent analysis and processing. Simultaneously, the use of the cross-entropy loss method provides the model with richer supervision signals, which not only helps accelerate the network's convergence speed but also effectively overcomes the challenges of large-scale network training, improving the overall performance of the model. Furthermore, by setting a matching detection algorithm to define the detection threshold, the algorithm completes the recognition and matching judgment of user facial expression analysis and processing. Quantitative analysis of the matching degree between the captured facial expression image and the image to be recognized improves the accuracy and reliability of expression recognition.

[0059] Furthermore, the Peking Opera character performance module includes a variety of preset facial expressions and emotional changes, which are presented in animation to enhance the realism and immersion of the interaction.

[0060] Furthermore, the selection feedback mechanism employs real-time visual and auditory feedback, including confirmation prompts for correct options and guidance prompts for incorrect options, to ensure that users can clearly understand the interaction results;

[0061] Real-time visual feedback includes

[0062] (1) Selection feedback: When a user makes a selection through the facial expression recognition module, the system will judge whether the selection is correct based on the user's facial expression input; if the selection is correct, a confirmation prompt will be displayed (such as a green check mark, animation effects, etc.); if the selection is incorrect, a guidance prompt will be displayed (such as a red cross, prompt text or arrows, etc.) to guide the user to make a new selection.

[0063] (2) Role performance: The Peking Opera role performance module displays the characters' facial expressions and emotional changes through animation. These changes are also part of the real-time visual feedback, which is used to enhance the realism and immersion of the interaction.

[0064] (3) Level changes: When a user completes a level, the system will guide the user to the next level through visual prompts (such as interface jumps, background changes, etc.).

[0065] Real-time auditory feedback includes:

[0066] (1) Sound feedback: When users interact with the system, there will be corresponding sound feedback, such as affirmation sound effects when the correct choice is made (such as applause, cheers, etc.) and guidance sound effects when the wrong choice is made (such as gentle prompts, encouraging words, etc.).

[0067] (2) Peking Opera music and singing style: In order to create a more realistic Peking Opera cultural atmosphere, the system may also play Peking Opera music or singing style at appropriate times as part of auditory feedback.

[0068] As can be seen from the above, the present invention has the following effects:

[0069] 1. Enhance interactive experience: Through facial expression recognition technology, non-verbal interaction is achieved, enabling users to participate more intuitively in the dissemination and experience of Peking Opera culture, thereby enhancing the realism and fun of the interaction.

[0070] 2. Improve the efficiency of cultural dissemination: Present Peking Opera culture in the form of VR immersive experience, so that while enjoying the interactive fun, users can gain a deeper understanding of the connotation and charm of Peking Opera culture, thereby improving the efficiency and quality of cultural dissemination.

[0071] This application provides an electronic device applicable to the aforementioned Peking Opera culture promotion system based on user experience interaction design, comprising:

[0072] Memory is used to protect computer programs and data;

[0073] A processor is used to run system programs.

[0074] This application provides a computer storage medium applicable to the statistical management methods for various ranges of enterprise carbon emissions described above, and performs hierarchical confidentiality management of the above systems and data in accordance with confidentiality management requirements.

[0075] Those skilled in the art will understand that embodiments of this application can be provided as a system or a computer program product. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0076] This application is described with reference to flowchart illustrations and / or block diagrams of devices (systems) and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0077] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0078] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0079] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0080] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash memory. Memory is an example of computer-readable media.

[0081] Computer-readable media include both permanent and non-permanent, removable and non-removable media, which can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transfer medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media do not include transient computer-readable media, such as modulated data signals and carrier waves.

[0082] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, article, or apparatus that includes that element.

[0083] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A Peking Opera culture promotion system based on user experience interaction design, characterized in that: include: A software application running on the Android platform that is compatible with the PICO VR headset. Multiple virtual levels, each containing multiple Peking Opera mask characters; The facial expression recognition module is used to capture and analyze changes in the user's facial expressions in virtual space, serving as a basis for user input; The Peking Opera character performance module is used to display the character's facial expressions and emotional changes, guiding the user to make selections; The system uses a feedback mechanism to determine whether a user's choice is correct based on their facial expression input, and then proceeds to the next level or ends the experience accordingly.

2. The Peking Opera culture promotion system based on user experience interaction design as described in claim 1, characterized in that: The software application includes: User interface design optimizes the user's workflow in the VR environment and enhances the user experience; The education and promotion content module provides detailed introductions and background information on Peking Opera culture as supplementary learning materials during the experience.

3. The Peking Opera culture promotion system based on user experience interaction design as described in claim 1, characterized in that: The facial expression recognition module captures the user's facial expressions using the built-in camera of the PICO VR headset and analyzes and processes them using machine learning algorithms. The steps for analyzing and processing using machine learning algorithms are as follows: S101. The captured facial expression image is first preprocessed, including noise removal, brightness and contrast adjustment, and facial region localization, to ensure the accuracy of subsequent analysis and processing. The image noise reduction uses a Gaussian filtering algorithm, the formula of which is as follows: Where G(x,y) is the filtered pixel gray value; σ is the standard deviation of the Gaussian curve; and x and y are the position coordinates of the filter template. S102. Using feature extraction techniques in machine learning algorithms, key feature values ​​are extracted from the preprocessed facial expression images. Then, a fusion cross-entropy loss method is used to provide richer supervision signals to accelerate network convergence, overcome the challenges of large-scale network training, and enable the network to learn feature discrimination more effectively. The fusion cross-entropy loss method incorporates cross-entropy loss into the TL loss function, and the formula is as follows: Among them, L t This represents the time-to-live (TL) loss function; N represents the number of samples; m represents the number of classes; Represents a binary indicator function; Represents the probability of a category; S103. The extracted feature values ​​are compared and analyzed with the pre-trained machine learning model. Through comparison and analysis, the system can determine the user's current expression state and use it as the basis for user input. S104. Simultaneously, a matching detection algorithm is set, and a corresponding detection threshold is set for the above analysis and processing results to complete the recognition and matching judgment of user facial expression analysis and processing. The formula is as follows: in, To capture feature values ​​from user facial expression images; Let x be the feature value of the user's facial expression image to be identified, and let x be the feature quantity of the user's facial expression image. The smaller P(A,B) is, the higher the matching degree between the user's facial expression image to be identified and the captured user's facial expression image, and vice versa.

4. The Peking Opera culture promotion system based on user experience interaction design as described in claim 1, characterized in that: The Peking Opera character performance module includes a variety of preset facial expressions and emotional changes, which are presented in animation to enhance the realism and immersion of the interaction.

5. The Peking Opera culture promotion system based on user experience interaction design as described in claim 1, characterized in that: The selection feedback mechanism employs real-time visual and auditory feedback, including confirmation prompts for correct options and guidance prompts for incorrect options, ensuring that users can clearly understand the interaction results.

6. A processor, characterized in that, The system is configured to perform a Peking Opera cultural promotion system based on user experience interaction design according to any one of claims 1 to 5.

7. A computer-readable storage medium having a computer program stored thereon, the computer program being executed by a processor as described in any one of claims 1 to 5, a Peking Opera cultural promotion system based on user experience interaction design.

Images